climateprediction.net home page
Task 22438141

Task 22438141

Name oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0
Workunit 12286520
Created 7 Jun 2024, 17:37:50 UTC
Sent 8 Jun 2024, 8:16:40 UTC
Report deadline 7 Aug 2024, 8:16:40 UTC
Received 8 Jun 2024, 21:00:20 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1538892
Run time 12 hours 17 min 59 sec
CPU time 12 hours 14 min 34 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 5.41 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,015.48 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,283.26 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
 834 H= 208:30 +CPU= 29.849
  10:40:25 STEP  835 H= 208:45 +CPU= 29.766
  10:40:55 STEP  836 H= 209:00 +CPU= 30.471
  10:41:25 STEP  837 H= 209:15 +CPU= 29.984
  10:41:54 STEP  838 H= 209:30 +CPU= 28.918
  10:42:23 STEP  839 H= 209:45 +CPU= 28.901
  10:43:02 STEP  840 H= 210:00 +CPU= 38.332
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000840
  10:43:31 STEP  841 H= 210:15 +CPU= 29.411
  10:44:00 STEP  842 H= 210:30 +CPU= 29.005
  10:44:29 STEP  843 H= 210:45 +CPU= 28.694
  10:44:59 STEP  844 H= 211:00 +CPU= 29.316
  10:45:27 STEP  845 H= 211:15 +CPU= 28.677
  10:45:56 STEP  846 H= 211:30 +CPU= 28.650
  10:46:26 STEP  847 H= 211:45 +CPU= 29.614
  10:46:56 STEP  848 H= 212:00 +CPU= 30.183
  10:47:25 STEP  849 H= 212:15 +CPU= 29.387
  10:47:55 STEP  850 H= 212:30 +CPU= 29.406
  10:48:24 STEP  851 H= 212:45 +CPU= 29.492
  10:49:01 STEP  852 H= 213:00 +CPU= 36.560
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000852
  10:49:30 STEP  853 H= 213:15 +CPU= 29.131
  10:49:59 STEP  854 H= 213:30 +CPU= 28.944
  10:50:28 STEP  855 H= 213:45 +CPU= 28.947
  10:50:58 STEP  856 H= 214:00 +CPU= 29.741
  10:51:27 STEP  857 H= 214:15 +CPU= 28.805
  10:51:56 STEP  858 H= 214:30 +CPU= 29.200
  10:52:24 STEP  859 H= 214:45 +CPU= 28.350
  10:52:54 STEP  860 H= 215:00 +CPU= 29.303
  10:53:23 STEP  861 H= 215:15 +CPU= 29.009
  10:53:52 STEP  862 H= 215:30 +CPU= 29.427
  10:54:22 STEP  863 H= 215:45 +CPU= 29.411
  10:55:04 STEP  864 H= 216:00 +CPU= 41.109
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0_r501198636_8.zip
Uploading the intermediate file: upload_file_8.zip
  10:55:35 STEP  865 H= 216:15 +CPU= 30.563
  10:56:05 STEP  866 H= 216:30 +CPU= 29.845
  10:56:34 STEP  867 H= 216:45 +CPU= 29.448
  10:57:04 STEP  868 H= 217:00 +CPU= 30.151
  10:57:35 STEP  869 H= 217:15 +CPU= 30.566
  10:58:05 STEP  870 H= 217:30 +CPU= 29.439
  10:58:34 STEP  871 H= 217:45 +CPU= 29.278
  10:59:04 STEP  872 H= 218:00 +CPU= 30.225
  10:59:35 STEP  873 H= 218:15 +CPU= 29.677
  11:00:05 STEP  874 H= 218:30 +CPU= 29.493
  11:00:34 STEP  875 H= 218:45 +CPU= 28.826
  11:01:10 STEP  876 H= 219:00 +CPU= 36.491
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000876
  11:01:39 STEP  877 H= 219:15 +CPU= 29.343
  11:02:09 STEP  878 H= 219:30 +CPU= 29.566
  11:02:40 STEP  879 H= 219:45 +CPU= 31.306
  11:03:12 STEP  880 H= 220:00 +CPU= 31.180
  11:03:41 STEP  881 H= 220:15 +CPU= 28.979
  11:04:10 STEP  882 H= 220:30 +CPU= 29.037
  11:04:39 STEP  883 H= 220:45 +CPU= 29.093
  11:05:09 STEP  884 H= 221:00 +CPU= 29.993
  11:05:38 STEP  885 H= 221:15 +CPU= 29.364
  11:06:08 STEP  886 H= 221:30 +CPU= 29.999
  11:06:38 STEP  887 H= 221:45 +CPU= 29.307
  11:07:15 STEP  888 H= 222:00 +CPU= 36.887
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000888
  11:07:44 STEP  889 H= 222:15 +CPU= 28.959
  11:08:13 STEP  890 H= 222:30 +CPU= 28.782
  11:08:42 STEP  891 H= 222:45 +CPU= 28.783
  11:09:11 STEP  892 H= 223:00 +CPU= 29.330
  11:09:40 STEP  893 H= 223:15 +CPU= 28.602
  11:10:09 STEP  894 H= 223:30 +CPU= 29.488
  11:10:38 STEP  895 H= 223:45 +CPU= 29.247
  11:11:08 STEP  896 H= 224:00 +CPU= 30.043
  11:11:38 STEP  897 H= 224:15 +CPU= 29.440
  11:12:07 STEP  898 H= 224:30 +CPU= 29.398
  11:12:37 STEP  899 H= 224:45 +CPU= 29.339
  11:13:13 STEP  900 H= 225:00 +CPU= 36.697
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000900
  11:13:43 STEP  901 H= 225:15 +CPU= 29.166
  11:14:18 STEP  902 H= 225:30 +CPU= 29.774
  11:14:47 STEP  903 H= 225:45 +CPU= 29.208
  11:15:19 STEP  904 H= 226:00 +CPU= 31.701
  11:15:50 STEP  905 H= 226:15 +CPU= 31.064
  11:16:22 STEP  906 H= 226:30 +CPU= 31.711
  11:16:52 STEP  907 H= 226:45 +CPU= 29.784
  11:17:21 STEP  908 H= 227:00 +CPU= 29.460
  11:17:50 STEP  909 H= 227:15 +CPU= 28.735
  11:18:19 STEP  910 H= 227:30 +CPU= 28.888
  11:18:49 STEP  911 H= 227:45 +CPU= 29.856
  11:19:29 STEP  912 H= 228:00 +CPU= 40.550
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000912
  11:19:59 STEP  913 H= 228:15 +CPU= 29.366
  11:20:28 STEP  914 H= 228:30 +CPU= 29.850
  11:20:58 STEP  915 H= 228:45 +CPU= 29.400
  11:21:28 STEP  916 H= 229:00 +CPU= 30.055
  11:21:57 STEP  917 H= 229:15 +CPU= 29.370
  11:22:27 STEP  918 H= 229:30 +CPU= 29.412
  11:22:57 STEP  919 H= 229:45 +CPU= 30.060
  11:23:27 STEP  920 H= 230:00 +CPU= 30.060
  11:23:57 STEP  921 H= 230:15 +CPU= 30.219
  11:24:29 STEP  922 H= 230:30 +CPU= 31.585
  11:25:00 STEP  923 H= 230:45 +CPU= 31.297
  11:25:39 STEP  924 H= 231:00 +CPU= 38.717
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000924
  11:26:08 STEP  925 H= 231:15 +CPU= 29.517
  11:26:38 STEP  926 H= 231:30 +CPU= 29.616
  11:27:08 STEP  927 H= 231:45 +CPU= 29.550
  11:27:38 STEP  928 H= 232:00 +CPU= 30.201
  11:28:07 STEP  929 H= 232:15 +CPU= 29.409
  11:28:37 STEP  930 H= 232:30 +CPU= 29.490
  11:29:06 STEP  931 H= 232:45 +CPU= 29.465
  11:29:38 STEP  932 H= 233:00 +CPU= 31.986
  11:30:10 STEP  933 H= 233:15 +CPU= 31.343
  11:30:41 STEP  934 H= 233:30 +CPU= 31.379
  11:31:12 STEP  935 H= 233:45 +CPU= 31.149
  11:31:50 STEP  936 H= 234:00 +CPU= 37.386
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000936
  11:32:19 STEP  937 H= 234:15 +CPU= 29.499
  11:32:49 STEP  938 H= 234:30 +CPU= 29.459
  11:33:18 STEP  939 H= 234:45 +CPU= 29.453
  11:33:48 STEP  940 H= 235:00 +CPU= 30.117
  11:34:18 STEP  941 H= 235:15 +CPU= 29.439
  11:34:47 STEP  942 H= 235:30 +CPU= 29.398
  11:35:19 STEP  943 H= 235:45 +CPU= 31.701
  11:35:49 STEP  944 H= 236:00 +CPU= 30.446
  11:36:18 STEP  945 H= 236:15 +CPU= 28.931
  11:36:50 STEP  946 H= 236:30 +CPU= 31.058
  11:37:19 STEP  947 H= 236:45 +CPU= 29.148
  11:37:56 STEP  948 H= 237:00 +CPU= 36.770
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000948
  11:38:25 STEP  949 H= 237:15 +CPU= 29.333
  11:38:55 STEP  950 H= 237:30 +CPU= 30.038
  11:39:26 STEP  951 H= 237:45 +CPU= 31.203
  11:39:57 STEP  952 H= 238:00 +CPU= 30.209
  11:40:27 STEP  953 H= 238:15 +CPU= 30.140
  11:40:57 STEP  954 H= 238:30 +CPU= 30.000
  11:41:28 STEP  955 H= 238:45 +CPU= 31.290
  11:41:58 STEP  956 H= 239:00 +CPU= 30.252
  11:42:28 STEP  957 H= 239:15 +CPU= 29.352
  11:42:57 STEP  958 H= 239:30 +CPU= 29.101
  11:43:27 STEP  959 H= 239:45 +CPU= 29.777
  11:44:08 STEP  960 H= 240:00 +CPU= 41.033
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0_r501198636_9.zip
Uploading the intermediate file: upload_file_9.zip
  11:44:37 STEP  961 H= 240:15 +CPU= 29.132
Uploading trickle at timestep: 864000
  11:45:06 STEP  962 H= 240:30 +CPU= 29.359
  11:45:36 STEP  963 H= 240:45 +CPU= 29.290
  11:46:05 STEP  964 H= 241:00 +CPU= 29.676
  11:46:35 STEP  965 H= 241:15 +CPU= 29.312
  11:47:05 STEP  966 H= 241:30 +CPU= 29.483
  11:47:34 STEP  967 H= 241:45 +CPU= 29.186
  11:48:04 STEP  968 H= 242:00 +CPU= 30.065
  11:48:33 STEP  969 H= 242:15 +CPU= 29.186
  11:49:02 STEP  970 H= 242:30 +CPU= 29.071
  11:49:33 STEP  971 H= 242:45 +CPU= 30.864
  11:50:12 STEP  972 H= 243:00 +CPU= 38.564
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000972
  11:50:42 STEP  973 H= 243:15 +CPU= 29.810
  11:51:11 STEP  974 H= 243:30 +CPU= 28.867
  11:51:39 STEP  975 H= 243:45 +CPU= 28.137
  11:52:07 STEP  976 H= 244:00 +CPU= 28.313
  11:52:34 STEP  977 H= 244:15 +CPU= 27.301
  11:53:02 STEP  978 H= 244:30 +CPU= 27.512
  11:53:30 STEP  979 H= 244:45 +CPU= 28.273
  11:53:59 STEP  980 H= 245:00 +CPU= 28.784
  11:54:27 STEP  981 H= 245:15 +CPU= 27.849
  11:54:55 STEP  982 H= 245:30 +CPU= 27.855
  11:55:22 STEP  983 H= 245:45 +CPU= 27.653
  11:55:58 STEP  984 H= 246:00 +CPU= 35.184
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000984
  11:56:25 STEP  985 H= 246:15 +CPU= 27.828
  11:56:55 STEP  986 H= 246:30 +CPU= 29.602
  11:57:24 STEP  987 H= 246:45 +CPU= 28.535
  11:57:53 STEP  988 H= 247:00 +CPU= 29.178
  11:58:21 STEP  989 H= 247:15 +CPU= 28.377
  11:58:50 STEP  990 H= 247:30 +CPU= 28.408
  11:59:18 STEP  991 H= 247:45 +CPU= 28.309
  11:59:47 STEP  992 H= 248:00 +CPU= 29.237
  12:00:16 STEP  993 H= 248:15 +CPU= 28.691
  12:00:44 STEP  994 H= 248:30 +CPU= 28.420
  12:01:13 STEP  995 H= 248:45 +CPU= 28.401
  12:01:49 STEP  996 H= 249:00 +CPU= 35.767
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000996
  12:02:17 STEP  997 H= 249:15 +CPU= 28.509
  12:02:45 STEP  998 H= 249:30 +CPU= 28.325
  12:03:14 STEP  999 H= 249:45 +CPU= 28.330
  12:03:43 STEP 1000 H= 250:00 +CPU= 28.705
  12:04:11 STEP 1001 H= 250:15 +CPU= 27.981
  12:04:39 STEP 1002 H= 250:30 +CPU= 28.054
  12:05:07 STEP 1003 H= 250:45 +CPU= 28.588
  12:05:37 STEP 1004 H= 251:00 +CPU= 29.238
  12:06:05 STEP 1005 H= 251:15 +CPU= 28.643
  12:06:34 STEP 1006 H= 251:30 +CPU= 28.696
  12:07:03 STEP 1007 H= 251:45 +CPU= 28.712
  12:07:43 STEP 1008 H= 252:00 +CPU= 40.329
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001008
  12:08:12 STEP 1009 H= 252:15 +CPU= 28.597
  12:08:41 STEP 1010 H= 252:30 +CPU= 28.691
  12:09:10 STEP 1011 H= 252:45 +CPU= 29.486
  12:09:40 STEP 1012 H= 253:00 +CPU= 30.021
  12:10:09 STEP 1013 H= 253:15 +CPU= 28.380
  12:10:38 STEP 1014 H= 253:30 +CPU= 28.227
  12:11:06 STEP 1015 H= 253:45 +CPU= 28.181
  12:11:34 STEP 1016 H= 254:00 +CPU= 28.701
  12:12:03 STEP 1017 H= 254:15 +CPU= 28.243
  12:12:31 STEP 1018 H= 254:30 +CPU= 27.923
  12:12:59 STEP 1019 H= 254:45 +CPU= 28.037
  12:13:34 STEP 1020 H= 255:00 +CPU= 35.110
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001020
  12:14:03 STEP 1021 H= 255:15 +CPU= 28.815
  12:14:31 STEP 1022 H= 255:30 +CPU= 28.300
  12:15:00 STEP 1023 H= 255:45 +CPU= 29.057
  12:15:30 STEP 1024 H= 256:00 +CPU= 29.188
  12:15:58 STEP 1025 H= 256:15 +CPU= 28.454
  12:16:30 STEP 1026 H= 256:30 +CPU= 30.601
  12:16:58 STEP 1027 H= 256:45 +CPU= 28.659
  12:17:28 STEP 1028 H= 257:00 +CPU= 29.161
  12:17:56 STEP 1029 H= 257:15 +CPU= 28.265
  12:18:25 STEP 1030 H= 257:30 +CPU= 28.422
  12:18:53 STEP 1031 H= 257:45 +CPU= 28.670
  12:19:29 STEP 1032 H= 258:00 +CPU= 35.646
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001032
  12:19:57 STEP 1033 H= 258:15 +CPU= 28.104
  12:20:25 STEP 1034 H= 258:30 +CPU= 27.857
  12:20:53 STEP 1035 H= 258:45 +CPU= 28.110
  12:21:22 STEP 1036 H= 259:00 +CPU= 28.668
  12:21:50 STEP 1037 H= 259:15 +CPU= 27.863
  12:22:18 STEP 1038 H= 259:30 +CPU= 28.141
  12:22:46 STEP 1039 H= 259:45 +CPU= 28.489
  12:23:15 STEP 1040 H= 260:00 +CPU= 28.822
  12:23:43 STEP 1041 H= 260:15 +CPU= 27.642
  12:24:11 STEP 1042 H= 260:30 +CPU= 28.075
  12:24:39 STEP 1043 H= 260:45 +CPU= 28.026
  12:25:14 STEP 1044 H= 261:00 +CPU= 35.079
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001044
  12:25:42 STEP 1045 H= 261:15 +CPU= 28.085
  12:26:11 STEP 1046 H= 261:30 +CPU= 28.555
  12:26:39 STEP 1047 H= 261:45 +CPU= 28.597
  12:27:08 STEP 1048 H= 262:00 +CPU= 29.194
  12:27:37 STEP 1049 H= 262:15 +CPU= 28.526
  12:28:06 STEP 1050 H= 262:30 +CPU= 28.624
  12:28:34 STEP 1051 H= 262:45 +CPU= 28.409
  12:29:03 STEP 1052 H= 263:00 +CPU= 28.967
  12:29:32 STEP 1053 H= 263:15 +CPU= 28.497
  12:30:00 STEP 1054 H= 263:30 +CPU= 28.327
  12:30:28 STEP 1055 H= 263:45 +CPU= 27.802
  12:31:07 STEP 1056 H= 264:00 +CPU= 39.196
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0_r501198636_10.zip
Uploading the intermediate file: upload_file_10.zip
  12:31:35 STEP 1057 H= 264:15 +CPU= 27.976
  12:32:03 STEP 1058 H= 264:30 +CPU= 27.871
  12:32:32 STEP 1059 H= 264:45 +CPU= 27.987
  12:33:00 STEP 1060 H= 265:00 +CPU= 28.428
  12:33:28 STEP 1061 H= 265:15 +CPU= 28.159
  12:33:57 STEP 1062 H= 265:30 +CPU= 29.037
  12:34:26 STEP 1063 H= 265:45 +CPU= 28.695
  12:34:55 STEP 1064 H= 266:00 +CPU= 29.131
  12:35:24 STEP 1065 H= 266:15 +CPU= 28.813
  12:35:53 STEP 1066 H= 266:30 +CPU= 28.772
  12:36:22 STEP 1067 H= 266:45 +CPU= 28.867
  12:36:58 STEP 1068 H= 267:00 +CPU= 35.457
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001068
  12:37:26 STEP 1069 H= 267:15 +CPU= 28.761
  12:37:55 STEP 1070 H= 267:30 +CPU= 28.638
  12:38:24 STEP 1071 H= 267:45 +CPU= 28.660
  12:38:53 STEP 1072 H= 268:00 +CPU= 29.076
  12:39:21 STEP 1073 H= 268:15 +CPU= 28.219
  12:39:49 STEP 1074 H= 268:30 +CPU= 28.401
  12:40:18 STEP 1075 H= 268:45 +CPU= 28.892
  12:40:48 STEP 1076 H= 269:00 +CPU= 29.636
  12:41:17 STEP 1077 H= 269:15 +CPU= 28.876
  12:41:45 STEP 1078 H= 269:30 +CPU= 28.643
  12:42:14 STEP 1079 H= 269:45 +CPU= 28.508
  12:42:49 STEP 1080 H= 270:00 +CPU= 35.576
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001080
  12:43:18 STEP 1081 H= 270:15 +CPU= 28.482
  12:43:46 STEP 1082 H= 270:30 +CPU= 28.308
  12:44:15 STEP 1083 H= 270:45 +CPU= 28.351
  12:44:44 STEP 1084 H= 271:00 +CPU= 28.942
  12:45:12 STEP 1085 H= 271:15 +CPU= 28.364
  12:45:40 STEP 1086 H= 271:30 +CPU= 28.304
  12:46:10 STEP 1087 H= 271:45 +CPU= 29.311
  12:46:40 STEP 1088 H= 272:00 +CPU= 30.641
  12:47:09 STEP 1089 H= 272:15 +CPU= 28.377
  12:47:37 STEP 1090 H= 272:30 +CPU= 28.270
  12:48:05 STEP 1091 H= 272:45 +CPU= 28.207
  12:48:41 STEP 1092 H= 273:00 +CPU= 35.340
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001092
  12:49:09 STEP 1093 H= 273:15 +CPU= 27.853
  12:49:37 STEP 1094 H= 273:30 +CPU= 28.165
  12:50:05 STEP 1095 H= 273:45 +CPU= 27.907
  12:50:34 STEP 1096 H= 274:00 +CPU= 29.098
  12:51:03 STEP 1097 H= 274:15 +CPU= 29.364
  12:51:33 STEP 1098 H= 274:30 +CPU= 29.625
  12:52:01 STEP 1099 H= 274:45 +CPU= 28.021
  12:52:29 STEP 1100 H= 275:00 +CPU= 28.481
  12:52:57 STEP 1101 H= 275:15 +CPU= 27.876
  12:53:26 STEP 1102 H= 275:30 +CPU= 28.549
  12:53:55 STEP 1103 H= 275:45 +CPU= 29.162
  12:54:36 STEP 1104 H= 276:00 +CPU= 40.489
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001104
  12:55:04 STEP 1105 H= 276:15 +CPU= 27.977
  12:55:32 STEP 1106 H= 276:30 +CPU= 27.930
  12:56:00 STEP 1107 H= 276:45 +CPU= 27.914
  12:56:29 STEP 1108 H= 277:00 +CPU= 28.600
  12:56:57 STEP 1109 H= 277:15 +CPU= 27.851
  12:57:27 STEP 1110 H= 277:30 +CPU= 30.011
  12:57:56 STEP 1111 H= 277:45 +CPU= 28.721
  12:58:25 STEP 1112 H= 278:00 +CPU= 28.801
  12:58:53 STEP 1113 H= 278:15 +CPU= 28.495
  12:59:21 STEP 1114 H= 278:30 +CPU= 28.096
  12:59:49 STEP 1115 H= 278:45 +CPU= 28.126
  13:00:25 STEP 1116 H= 279:00 +CPU= 35.137
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001116
  13:00:53 STEP 1117 H= 279:15 +CPU= 28.394
  13:01:22 STEP 1118 H= 279:30 +CPU= 28.742
  13:01:50 STEP 1119 H= 279:45 +CPU= 28.803
  13:02:20 STEP 1120 H= 280:00 +CPU= 29.400
  13:02:49 STEP 1121 H= 280:15 +CPU= 28.799
  13:03:19 STEP 1122 H= 280:30 +CPU= 29.006
  13:03:48 STEP 1123 H= 280:45 +CPU= 28.798
  13:04:17 STEP 1124 H= 281:00 +CPU= 29.498
  13:04:46 STEP 1125 H= 281:15 +CPU= 28.890
  13:05:15 STEP 1126 H= 281:30 +CPU= 28.745
  13:05:43 STEP 1127 H= 281:45 +CPU= 28.256
  13:06:18 STEP 1128 H= 282:00 +CPU= 35.308
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001128
  13:06:47 STEP 1129 H= 282:15 +CPU= 28.158
  13:07:15 STEP 1130 H= 282:30 +CPU= 28.251
  13:07:43 STEP 1131 H= 282:45 +CPU= 28.314
  13:08:14 STEP 1132 H= 283:00 +CPU= 30.331
  13:08:43 STEP 1133 H= 283:15 +CPU= 29.803
  13:09:13 STEP 1134 H= 283:30 +CPU= 29.262
  13:09:41 STEP 1135 H= 283:45 +CPU= 28.078
  13:10:10 STEP 1136 H= 284:00 +CPU= 28.762
  13:10:38 STEP 1137 H= 284:15 +CPU= 28.206
  13:11:06 STEP 1138 H= 284:30 +CPU= 27.940
  13:11:34 STEP 1139 H= 284:45 +CPU= 28.161
  13:12:09 STEP 1140 H= 285:00 +CPU= 35.212
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001140
  13:12:37 STEP 1141 H= 285:15 +CPU= 28.194
  13:13:06 STEP 1142 H= 285:30 +CPU= 28.909
  13:13:35 STEP 1143 H= 285:45 +CPU= 28.765
  13:14:04 STEP 1144 H= 286:00 +CPU= 29.200
  13:14:32 STEP 1145 H= 286:15 +CPU= 27.975
  13:15:01 STEP 1146 H= 286:30 +CPU= 28.380
  13:15:29 STEP 1147 H= 286:45 +CPU= 28.246
  13:16:01 STEP 1148 H= 287:00 +CPU= 31.641
  13:16:31 STEP 1149 H= 287:15 +CPU= 29.585
  13:16:59 STEP 1150 H= 287:30 +CPU= 28.838
  13:17:28 STEP 1151 H= 287:45 +CPU= 28.733
  13:18:09 STEP 1152 H= 288:00 +CPU= 40.359
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0_r501198636_11.zip
Uploading the intermediate file: upload_file_11.zip
  13:18:38 STEP 1153 H= 288:15 +CPU= 28.864
  13:19:08 STEP 1154 H= 288:30 +CPU= 29.959
  13:19:36 STEP 1155 H= 288:45 +CPU= 28.436
  13:20:06 STEP 1156 H= 289:00 +CPU= 29.298
  13:20:35 STEP 1157 H= 289:15 +CPU= 28.933
  13:21:04 STEP 1158 H= 289:30 +CPU= 28.614
  13:21:32 STEP 1159 H= 289:45 +CPU= 28.402
  13:22:01 STEP 1160 H= 290:00 +CPU= 28.876
  13:22:31 STEP 1161 H= 290:15 +CPU= 29.786
  13:23:01 STEP 1162 H= 290:30 +CPU= 30.159
  13:23:32 STEP 1163 H= 290:45 +CPU= 30.746
  13:24:09 STEP 1164 H= 291:00 +CPU= 37.546
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001164
  13:24:39 STEP 1165 H= 291:15 +CPU= 29.921
  13:25:08 STEP 1166 H= 291:30 +CPU= 28.750
  13:25:36 STEP 1167 H= 291:45 +CPU= 28.240
  13:26:05 STEP 1168 H= 292:00 +CPU= 28.651
  13:26:33 STEP 1169 H= 292:15 +CPU= 28.123
  13:27:01 STEP 1170 H= 292:30 +CPU= 28.207
  13:27:29 STEP 1171 H= 292:45 +CPU= 28.098
  13:27:58 STEP 1172 H= 293:00 +CPU= 28.652
  13:28:26 STEP 1173 H= 293:15 +CPU= 28.136
  13:28:54 STEP 1174 H= 293:30 +CPU= 28.175
  13:29:23 STEP 1175 H= 293:45 +CPU= 28.357
  13:29:58 STEP 1176 H= 294:00 +CPU= 35.356
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001176
  13:30:26 STEP 1177 H= 294:15 +CPU= 27.955
  13:30:54 STEP 1178 H= 294:30 +CPU= 27.898
  13:31:22 STEP 1179 H= 294:45 +CPU= 27.999
  13:31:51 STEP 1180 H= 295:00 +CPU= 28.569
  13:32:20 STEP 1181 H= 295:15 +CPU= 28.798
  13:32:48 STEP 1182 H= 295:30 +CPU= 28.397
  13:33:17 STEP 1183 H= 295:45 +CPU= 28.492
  13:33:46 STEP 1184 H= 296:00 +CPU= 29.051
  13:34:14 STEP 1185 H= 296:15 +CPU= 28.314
  13:34:42 STEP 1186 H= 296:30 +CPU= 28.306
  13:35:11 STEP 1187 H= 296:45 +CPU= 28.315
  13:35:46 STEP 1188 H= 297:00 +CPU= 35.634
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001188
  13:36:15 STEP 1189 H= 297:15 +CPU= 28.347
  13:36:43 STEP 1190 H= 297:30 +CPU= 28.294
  13:37:12 STEP 1191 H= 297:45 +CPU= 28.282
  13:37:41 STEP 1192 H= 298:00 +CPU= 29.269
  13:38:10 STEP 1193 H= 298:15 +CPU= 28.652
  13:38:38 STEP 1194 H= 298:30 +CPU= 28.804
  13:39:07 STEP 1195 H= 298:45 +CPU= 28.846
  13:39:37 STEP 1196 H= 299:00 +CPU= 29.352
  13:40:05 STEP 1197 H= 299:15 +CPU= 28.489
  13:40:34 STEP 1198 H= 299:30 +CPU= 28.541
  13:41:02 STEP 1199 H= 299:45 +CPU= 28.082
  13:41:42 STEP 1200 H= 300:00 +CPU= 39.769
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001200
  13:42:10 STEP 1201 H= 300:15 +CPU= 28.136
  13:42:38 STEP 1202 H= 300:30 +CPU= 28.191
  13:43:08 STEP 1203 H= 300:45 +CPU= 29.807
  13:43:38 STEP 1204 H= 301:00 +CPU= 30.650
  13:44:09 STEP 1205 H= 301:15 +CPU= 30.374
  13:44:35 STEP 1206 H= 301:30 +CPU= 26.388
  13:45:03 STEP 1207 H= 301:45 +CPU= 27.988
  13:45:32 STEP 1208 H= 302:00 +CPU= 28.722
  13:46:00 STEP 1209 H= 302:15 +CPU= 28.216
  13:46:30 STEP 1210 H= 302:30 +CPU= 29.538
  13:46:59 STEP 1211 H= 302:45 +CPU= 29.484
  13:47:36 STEP 1212 H= 303:00 +CPU= 36.893
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001212
  13:48:04 STEP 1213 H= 303:15 +CPU= 28.186
  13:48:32 STEP 1214 H= 303:30 +CPU= 27.762
  13:49:00 STEP 1215 H= 303:45 +CPU= 27.731
  13:49:28 STEP 1216 H= 304:00 +CPU= 27.853
  13:49:56 STEP 1217 H= 304:15 +CPU= 27.998
  13:50:24 STEP 1218 H= 304:30 +CPU= 28.403
  13:50:57 STEP 1219 H= 304:45 +CPU= 27.996
  13:51:25 STEP 1220 H= 305:00 +CPU= 28.540
  13:51:53 STEP 1221 H= 305:15 +CPU= 27.589
  13:52:21 STEP 1222 H= 305:30 +CPU= 27.649
  13:52:48 STEP 1223 H= 305:45 +CPU= 27.657
  13:53:23 STEP 1224 H= 306:00 +CPU= 34.734
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001224
  13:53:50 STEP 1225 H= 306:15 +CPU= 27.328
  13:54:18 STEP 1226 H= 306:30 +CPU= 27.530
  13:54:46 STEP 1227 H= 306:45 +CPU= 27.608
  13:55:14 STEP 1228 H= 307:00 +CPU= 28.083
  13:55:41 STEP 1229 H= 307:15 +CPU= 27.222
  13:56:08 STEP 1230 H= 307:30 +CPU= 27.277
  13:56:36 STEP 1231 H= 307:45 +CPU= 28.069
  13:57:05 STEP 1232 H= 308:00 +CPU= 28.763
  13:57:33 STEP 1233 H= 308:15 +CPU= 28.064
  13:58:02 STEP 1234 H= 308:30 +CPU= 28.115
  13:58:29 STEP 1235 H= 308:45 +CPU= 27.832
  13:59:04 STEP 1236 H= 309:00 +CPU= 34.749
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001236
  13:59:33 STEP 1237 H= 309:15 +CPU= 28.219
  14:00:01 STEP 1238 H= 309:30 +CPU= 28.170
  14:00:30 STEP 1239 H= 309:45 +CPU= 28.823
  14:01:00 STEP 1240 H= 310:00 +CPU= 30.379
  14:01:30 STEP 1241 H= 310:15 +CPU= 29.664
  14:01:58 STEP 1242 H= 310:30 +CPU= 28.384
  14:02:26 STEP 1243 H= 310:45 +CPU= 28.214
  14:02:55 STEP 1244 H= 311:00 +CPU= 28.572
  14:03:23 STEP 1245 H= 311:15 +CPU= 28.189
  14:03:51 STEP 1246 H= 311:30 +CPU= 27.901
  14:04:19 STEP 1247 H= 311:45 +CPU= 27.618
  14:05:01 STEP 1248 H= 312:00 +CPU= 39.095
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0_r501198636_12.zip
Uploading the intermediate file: upload_file_12.zip
  14:05:29 STEP 1249 H= 312:15 +CPU= 27.923
  14:05:57 STEP 1250 H= 312:30 +CPU= 28.065
  14:06:25 STEP 1251 H= 312:45 +CPU= 28.028
  14:06:54 STEP 1252 H= 313:00 +CPU= 28.639
  14:07:23 STEP 1253 H= 313:15 +CPU= 29.216
  14:07:51 STEP 1254 H= 313:30 +CPU= 27.726
  14:08:19 STEP 1255 H= 313:45 +CPU= 27.629
  14:08:47 STEP 1256 H= 314:00 +CPU= 28.276
  14:09:15 STEP 1257 H= 314:15 +CPU= 27.650
  14:09:42 STEP 1258 H= 314:30 +CPU= 27.434
  14:10:10 STEP 1259 H= 314:45 +CPU= 27.597
  14:10:45 STEP 1260 H= 315:00 +CPU= 35.191
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001260
  14:11:13 STEP 1261 H= 315:15 +CPU= 28.211
  14:11:42 STEP 1262 H= 315:30 +CPU= 28.243
  14:12:10 STEP 1263 H= 315:45 +CPU= 28.013
  14:12:38 STEP 1264 H= 316:00 +CPU= 28.659
  14:13:06 STEP 1265 H= 316:15 +CPU= 28.023
  14:13:34 STEP 1266 H= 316:30 +CPU= 27.846
  14:14:02 STEP 1267 H= 316:45 +CPU= 27.824
  14:14:31 STEP 1268 H= 317:00 +CPU= 28.640
  14:14:59 STEP 1269 H= 317:15 +CPU= 27.592
  14:15:26 STEP 1270 H= 317:30 +CPU= 27.568
  14:15:54 STEP 1271 H= 317:45 +CPU= 27.673
  14:16:28 STEP 1272 H= 318:00 +CPU= 34.596
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001272
  14:16:56 STEP 1273 H= 318:15 +CPU= 27.290
  14:17:23 STEP 1274 H= 318:30 +CPU= 27.316
  14:17:51 STEP 1275 H= 318:45 +CPU= 27.442
  14:18:18 STEP 1276 H= 319:00 +CPU= 27.857
  14:18:46 STEP 1277 H= 319:15 +CPU= 27.227
  14:19:14 STEP 1278 H= 319:30 +CPU= 27.859
  14:19:42 STEP 1279 H= 319:45 +CPU= 28.119
  14:20:10 STEP 1280 H= 320:00 +CPU= 28.143
  14:20:38 STEP 1281 H= 320:15 +CPU= 27.733
  14:21:06 STEP 1282 H= 320:30 +CPU= 27.733
  14:21:34 STEP 1283 H= 320:45 +CPU= 27.916
  14:22:09 STEP 1284 H= 321:00 +CPU= 35.014
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001284
  14:22:36 STEP 1285 H= 321:15 +CPU= 27.679
  14:23:04 STEP 1286 H= 321:30 +CPU= 27.461
  14:23:31 STEP 1287 H= 321:45 +CPU= 27.200
  14:23:59 STEP 1288 H= 322:00 +CPU= 27.891
  14:24:26 STEP 1289 H= 322:15 +CPU= 27.480
  14:24:54 STEP 1290 H= 322:30 +CPU= 27.691
  14:25:22 STEP 1291 H= 322:45 +CPU= 27.472
  14:25:50 STEP 1292 H= 323:00 +CPU= 27.892
  14:26:17 STEP 1293 H= 323:15 +CPU= 27.291
  14:26:44 STEP 1294 H= 323:30 +CPU= 27.439
  14:27:13 STEP 1295 H= 323:45 +CPU= 29.019
  14:27:54 STEP 1296 H= 324:00 +CPU= 39.401
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001296
  14:28:23 STEP 1297 H= 324:15 +CPU= 28.267
  14:28:50 STEP 1298 H= 324:30 +CPU= 27.768
  14:29:19 STEP 1299 H= 324:45 +CPU= 28.014
  14:29:47 STEP 1300 H= 325:00 +CPU= 28.546
  14:30:15 STEP 1301 H= 325:15 +CPU= 28.013
  14:30:43 STEP 1302 H= 325:30 +CPU= 28.036
  14:31:11 STEP 1303 H= 325:45 +CPU= 28.041
  14:31:40 STEP 1304 H= 326:00 +CPU= 28.463
  14:32:07 STEP 1305 H= 326:15 +CPU= 27.787
  14:32:35 STEP 1306 H= 326:30 +CPU= 27.840
  14:33:03 STEP 1307 H= 326:45 +CPU= 27.882
  14:33:38 STEP 1308 H= 327:00 +CPU= 34.896
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001308
  14:34:06 STEP 1309 H= 327:15 +CPU= 27.664
  14:34:33 STEP 1310 H= 327:30 +CPU= 27.424
  14:35:01 STEP 1311 H= 327:45 +CPU= 27.406
  14:35:29 STEP 1312 H= 328:00 +CPU= 27.980
  14:35:56 STEP 1313 H= 328:15 +CPU= 27.438
  14:36:23 STEP 1314 H= 328:30 +CPU= 26.951
  14:36:50 STEP 1315 H= 328:45 +CPU= 26.682
  14:37:18 STEP 1316 H= 329:00 +CPU= 27.828
  14:37:45 STEP 1317 H= 329:15 +CPU= 27.104
  14:38:12 STEP 1318 H= 329:30 +CPU= 27.347
  14:38:39 STEP 1319 H= 329:45 +CPU= 27.055
  14:39:13 STEP 1320 H= 330:00 +CPU= 33.940
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001320
  14:39:41 STEP 1321 H= 330:15 +CPU= 27.207
  14:40:08 STEP 1322 H= 330:30 +CPU= 27.506
  14:40:35 STEP 1323 H= 330:45 +CPU= 26.663
  14:41:03 STEP 1324 H= 331:00 +CPU= 28.332
  14:41:31 STEP 1325 H= 331:15 +CPU= 27.735
  14:41:58 STEP 1326 H= 331:30 +CPU= 27.691
  14:42:26 STEP 1327 H= 331:45 +CPU= 27.443
  14:42:54 STEP 1328 H= 332:00 +CPU= 28.114
  14:43:22 STEP 1329 H= 332:15 +CPU= 27.712
  14:43:49 STEP 1330 H= 332:30 +CPU= 27.691
  14:44:17 STEP 1331 H= 332:45 +CPU= 27.681
  14:44:51 STEP 1332 H= 333:00 +CPU= 34.099
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001332
  14:45:19 STEP 1333 H= 333:15 +CPU= 27.371
  14:45:46 STEP 1334 H= 333:30 +CPU= 26.972
  14:46:13 STEP 1335 H= 333:45 +CPU= 27.535
  14:46:41 STEP 1336 H= 334:00 +CPU= 28.211
  14:47:09 STEP 1337 H= 334:15 +CPU= 27.609
  14:47:37 STEP 1338 H= 334:30 +CPU= 27.328
  14:48:04 STEP 1339 H= 334:45 +CPU= 27.313
  14:48:32 STEP 1340 H= 335:00 +CPU= 28.017
  14:48:59 STEP 1341 H= 335:15 +CPU= 27.093
  14:49:27 STEP 1342 H= 335:30 +CPU= 27.429
  14:49:54 STEP 1343 H= 335:45 +CPU= 27.304
  14:50:33 STEP 1344 H= 336:00 +CPU= 38.715
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0_r501198636_13.zip
Uploading the intermediate file: upload_file_13.zip
  14:51:00 STEP 1345 H= 336:15 +CPU= 27.156
  14:51:27 STEP 1346 H= 336:30 +CPU= 27.141
  14:51:55 STEP 1347 H= 336:45 +CPU= 27.381
  14:52:23 STEP 1348 H= 337:00 +CPU= 27.527
  14:52:50 STEP 1349 H= 337:15 +CPU= 27.590
  14:53:18 STEP 1350 H= 337:30 +CPU= 27.135
  14:53:45 STEP 1351 H= 337:45 +CPU= 26.762
  14:54:12 STEP 1352 H= 338:00 +CPU= 27.512
  14:54:39 STEP 1353 H= 338:15 +CPU= 27.052
  14:55:06 STEP 1354 H= 338:30 +CPU= 27.044
  14:55:34 STEP 1355 H= 338:45 +CPU= 27.597
  14:56:08 STEP 1356 H= 339:00 +CPU= 34.329
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001356
  14:56:35 STEP 1357 H= 339:15 +CPU= 27.020
  14:57:02 STEP 1358 H= 339:30 +CPU= 27.155
  14:57:29 STEP 1359 H= 339:45 +CPU= 26.897
  14:57:57 STEP 1360 H= 340:00 +CPU= 27.652
  14:58:24 STEP 1361 H= 340:15 +CPU= 27.357
  14:58:52 STEP 1362 H= 340:30 +CPU= 27.455
  14:59:19 STEP 1363 H= 340:45 +CPU= 27.481
  14:59:47 STEP 1364 H= 341:00 +CPU= 28.185
  15:00:15 STEP 1365 H= 341:15 +CPU= 27.726
  15:00:43 STEP 1366 H= 341:30 +CPU= 27.784
  15:01:11 STEP 1367 H= 341:45 +CPU= 27.780
  15:01:46 STEP 1368 H= 342:00 +CPU= 35.184
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001368
  15:02:14 STEP 1369 H= 342:15 +CPU= 27.779
  15:02:42 STEP 1370 H= 342:30 +CPU= 27.555
  15:03:09 STEP 1371 H= 342:45 +CPU= 27.555
  15:03:37 STEP 1372 H= 343:00 +CPU= 27.992
  15:04:05 STEP 1373 H= 343:15 +CPU= 27.477
  15:04:35 STEP 1374 H= 343:30 +CPU= 28.307
  15:05:02 STEP 1375 H= 343:45 +CPU= 27.046
  15:05:30 STEP 1376 H= 344:00 +CPU= 27.734
  15:05:58 STEP 1377 H= 344:15 +CPU= 28.497
  15:06:26 STEP 1378 H= 344:30 +CPU= 27.332
  15:06:54 STEP 1379 H= 344:45 +CPU= 27.252
  15:07:28 STEP 1380 H= 345:00 +CPU= 34.085
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001380
  15:07:55 STEP 1381 H= 345:15 +CPU= 27.023
  15:08:22 STEP 1382 H= 345:30 +CPU= 26.848
  15:08:49 STEP 1383 H= 345:45 +CPU= 26.753
  15:09:16 STEP 1384 H= 346:00 +CPU= 27.414
  15:09:43 STEP 1385 H= 346:15 +CPU= 26.844
  15:10:10 STEP 1386 H= 346:30 +CPU= 27.073
  15:10:37 STEP 1387 H= 346:45 +CPU= 26.979
  15:11:04 STEP 1388 H= 347:00 +CPU= 27.358
  15:11:31 STEP 1389 H= 347:15 +CPU= 26.862
  15:11:58 STEP 1390 H= 347:30 +CPU= 27.032
  15:12:25 STEP 1391 H= 347:45 +CPU= 26.884
  15:13:03 STEP 1392 H= 348:00 +CPU= 38.011
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001392
  15:13:30 STEP 1393 H= 348:15 +CPU= 26.760
  15:13:58 STEP 1394 H= 348:30 +CPU= 27.497
  15:14:25 STEP 1395 H= 348:45 +CPU= 27.506
  15:14:53 STEP 1396 H= 349:00 +CPU= 28.095
  15:15:21 STEP 1397 H= 349:15 +CPU= 27.384
  15:15:48 STEP 1398 H= 349:30 +CPU= 27.458
  15:16:15 STEP 1399 H= 349:45 +CPU= 27.493
  15:16:44 STEP 1400 H= 350:00 +CPU= 28.027
  15:17:11 STEP 1401 H= 350:15 +CPU= 27.235
  15:17:38 STEP 1402 H= 350:30 +CPU= 27.605
  15:18:06 STEP 1403 H= 350:45 +CPU= 27.615
  15:18:41 STEP 1404 H= 351:00 +CPU= 34.752
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001404
  15:19:09 STEP 1405 H= 351:15 +CPU= 27.449
  15:19:36 STEP 1406 H= 351:30 +CPU= 27.347
  15:20:03 STEP 1407 H= 351:45 +CPU= 26.886
  15:20:31 STEP 1408 H= 352:00 +CPU= 28.247
  15:20:59 STEP 1409 H= 352:15 +CPU= 27.586
  15:21:27 STEP 1410 H= 352:30 +CPU= 27.709
  15:21:54 STEP 1411 H= 352:45 +CPU= 27.333
  15:22:22 STEP 1412 H= 353:00 +CPU= 27.970
  15:22:49 STEP 1413 H= 353:15 +CPU= 27.370
  15:23:17 STEP 1414 H= 353:30 +CPU= 27.538
  15:23:44 STEP 1415 H= 353:45 +CPU= 27.506
  15:24:19 STEP 1416 H= 354:00 +CPU= 34.740
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001416
  15:24:46 STEP 1417 H= 354:15 +CPU= 27.330
  15:25:14 STEP 1418 H= 354:30 +CPU= 27.569
  15:25:42 STEP 1419 H= 354:45 +CPU= 27.468
  15:26:09 STEP 1420 H= 355:00 +CPU= 27.355
  15:26:36 STEP 1421 H= 355:15 +CPU= 27.570
  15:27:04 STEP 1422 H= 355:30 +CPU= 27.678
  15:27:32 STEP 1423 H= 355:45 +CPU= 27.587
  15:28:00 STEP 1424 H= 356:00 +CPU= 28.025
  15:28:27 STEP 1425 H= 356:15 +CPU= 27.255
  15:28:54 STEP 1426 H= 356:30 +CPU= 27.213
  15:29:21 STEP 1427 H= 356:45 +CPU= 27.100
  15:29:55 STEP 1428 H= 357:00 +CPU= 33.868
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001428
  15:30:22 STEP 1429 H= 357:15 +CPU= 27.162
  15:30:50 STEP 1430 H= 357:30 +CPU= 27.773
  15:31:18 STEP 1431 H= 357:45 +CPU= 27.743
  15:31:46 STEP 1432 H= 358:00 +CPU= 28.195
  15:32:14 STEP 1433 H= 358:15 +CPU= 27.512
  15:32:41 STEP 1434 H= 358:30 +CPU= 27.604
  15:33:09 STEP 1435 H= 358:45 +CPU= 27.315
  15:33:37 STEP 1436 H= 359:00 +CPU= 27.913
  15:34:04 STEP 1437 H= 359:15 +CPU= 27.125
  15:34:31 STEP 1438 H= 359:30 +CPU= 26.999
  15:34:58 STEP 1439 H= 359:45 +CPU= 26.692
  15:35:34 STEP 1440 H= 360:00 +CPU= 36.308
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.4825174355E-22      I       0.9965166730E-06      I
ICloud fractionI      0.0000000000E+00      I       0.1427684981E-01      I
I  Relat. Hum. I      0.3141578582E+00      I       0.3607820898E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2612427878E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    321682900 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS536138.2 Mbytes/s, TOTAL TIME=    0.0132( 4.5%)
 15:35:34 STEP 1440 H= 360:00 +CPU= 36.308
 END CNT3
 NSTEP =  1440 CNT0   000000000  25.696  25.696  25.714   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************    98.9     0.0    98.9     0.0   201.1
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    4906.3    4906.3     17.30      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     882.8     882.8      2.87      0.00
  10 SCAN2M - PHYSICS                             1441   13916.0   13916.0     45.26      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1220.4    1220.4      0.33      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      40.3      40.3      0.01      0.00
  14 SUINIF                                          1    8489.2    8489.2      0.02      0.00
  17 GRIDFPOS IN CNT4                              121     147.8     147.8      0.04      0.00
  18 SUSPECG                                         1    4166.6    4166.6      0.01      0.00
  19 SUSPEC                                          1    4174.4    4174.4      0.01      0.00
  24 SUGRIDU                                         1    3535.9    3535.9      0.01      0.00
  25 SPECRT                                          1     333.3     333.3      0.00      0.00
  26 SUGRIDF                                         1     445.6     445.6      0.00      0.00
  27 RESTART FILES - WRITING                        30    4922.1    4922.1      0.33      0.00
  28 RESTART FILES - READING                         1       0.1       0.1      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    6784.6    6784.6      1.85      0.00
  31 POSDDH IN STEPO                                 7     150.8     150.8      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    6435.7    6435.7     20.93      0.00
  39 SU0YOMB                                         1     474.6     474.6      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      28.6      28.6      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     312.6     312.6      1.02      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      81.5      81.5      0.27      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     567.3     567.3      4.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     326.7     326.7      2.22      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     125.5     125.5      0.85      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     166.2     166.2      1.17      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      46.5      46.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      71.9      71.9      0.51      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      35.6      35.6      0.24      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     107.7     107.7      0.76      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      55.1      55.1      0.37      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    44306.3 CPU TIME   44074.6 VECTOR TIME    44074.6


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       29.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/0/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/0/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286520/ICMUAh7zg+001404
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0_r501198636_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
15:39:05 (3941759): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0_r501198636_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0_r501198636_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0_r501198636_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0_r501198636_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0_r501198636_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 21:00:52 1538892 22438141 oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0 1,295,100 44,074 0.0340
08 Jun 2024 17:01:58 1538892 22438141 oifs_43r3_bl_a3md_2016092300_20_1017_12286520_0 864,000 30,226 0.0350


©2024 climateprediction.net