climateprediction.net home page
Task 22311325

Task 22311325

Name oifs_43r3_bl_a3bh_2016092300_15_991_12211088_0
Workunit 12211088
Created 13 Feb 2023, 19:55:38 UTC
Sent 14 Feb 2023, 5:18:57 UTC
Report deadline 15 Apr 2023, 5:18:57 UTC
Received 2 Mar 2023, 19:01:27 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1537235
Run time 10 hours 23 min 56 sec
CPU time 10 hours 23 min 56 sec
Validate state Invalid
Credit 1,813.14
Device peak FLOPS 4.29 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,073.28 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,343.91 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
23.983
  15:44:55 STEP  830 H= 207:30 +CPU= 24.053
  15:45:19 STEP  831 H= 207:45 +CPU= 24.109
  15:45:44 STEP  832 H= 208:00 +CPU= 24.525
  15:46:08 STEP  833 H= 208:15 +CPU= 23.925
  15:46:32 STEP  834 H= 208:30 +CPU= 23.988
  15:46:56 STEP  835 H= 208:45 +CPU= 24.102
  15:47:21 STEP  836 H= 209:00 +CPU= 24.653
  15:47:45 STEP  837 H= 209:15 +CPU= 24.180
  15:48:10 STEP  838 H= 209:30 +CPU= 24.373
  15:48:34 STEP  839 H= 209:45 +CPU= 24.201
  15:49:04 STEP  840 H= 210:00 +CPU= 29.523
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000840
  15:49:28 STEP  841 H= 210:15 +CPU= 23.899
  15:49:52 STEP  842 H= 210:30 +CPU= 24.012
  15:50:16 STEP  843 H= 210:45 +CPU= 24.077
  15:50:41 STEP  844 H= 211:00 +CPU= 24.367
  15:51:05 STEP  845 H= 211:15 +CPU= 23.983
  15:51:29 STEP  846 H= 211:30 +CPU= 24.008
  15:51:53 STEP  847 H= 211:45 +CPU= 24.318
  15:52:18 STEP  848 H= 212:00 +CPU= 24.429
  15:52:42 STEP  849 H= 212:15 +CPU= 23.995
  15:53:06 STEP  850 H= 212:30 +CPU= 24.075
  15:53:30 STEP  851 H= 212:45 +CPU= 24.089
  15:54:00 STEP  852 H= 213:00 +CPU= 29.590
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000852
  15:54:24 STEP  853 H= 213:15 +CPU= 24.000
  15:54:48 STEP  854 H= 213:30 +CPU= 24.152
  15:55:12 STEP  855 H= 213:45 +CPU= 24.139
  15:55:37 STEP  856 H= 214:00 +CPU= 24.836
  15:56:01 STEP  857 H= 214:15 +CPU= 24.041
  15:56:25 STEP  858 H= 214:30 +CPU= 23.997
  15:56:50 STEP  859 H= 214:45 +CPU= 24.071
  15:57:14 STEP  860 H= 215:00 +CPU= 24.474
  15:57:38 STEP  861 H= 215:15 +CPU= 24.185
  15:58:03 STEP  862 H= 215:30 +CPU= 24.226
  15:58:27 STEP  863 H= 215:45 +CPU= 23.962
  15:59:00 STEP  864 H= 216:00 +CPU= 32.680
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3bh_2016092300_15_991_12211088_0_r1171764858_8.zip
Uploading the intermediate file: upload_file_8.zip
  15:59:24 STEP  865 H= 216:15 +CPU= 24.581
  15:59:48 STEP  866 H= 216:30 +CPU= 24.030
  16:00:12 STEP  867 H= 216:45 +CPU= 24.017
  16:00:37 STEP  868 H= 217:00 +CPU= 24.454
  16:01:01 STEP  869 H= 217:15 +CPU= 24.009
  16:01:25 STEP  870 H= 217:30 +CPU= 23.947
  16:01:49 STEP  871 H= 217:45 +CPU= 24.081
  16:02:14 STEP  872 H= 218:00 +CPU= 24.562
  16:02:38 STEP  873 H= 218:15 +CPU= 24.021
  16:03:02 STEP  874 H= 218:30 +CPU= 24.167
  16:03:27 STEP  875 H= 218:45 +CPU= 24.328
  16:03:56 STEP  876 H= 219:00 +CPU= 29.514
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000876
  16:04:21 STEP  877 H= 219:15 +CPU= 24.131
  16:04:45 STEP  878 H= 219:30 +CPU= 24.084
  16:05:09 STEP  879 H= 219:45 +CPU= 24.107
  16:05:34 STEP  880 H= 220:00 +CPU= 24.523
  16:05:58 STEP  881 H= 220:15 +CPU= 24.013
  16:06:22 STEP  882 H= 220:30 +CPU= 24.003
  16:06:46 STEP  883 H= 220:45 +CPU= 24.235
  16:07:11 STEP  884 H= 221:00 +CPU= 24.917
  16:07:35 STEP  885 H= 221:15 +CPU= 24.092
  16:08:00 STEP  886 H= 221:30 +CPU= 24.101
  16:08:24 STEP  887 H= 221:45 +CPU= 23.912
  16:08:53 STEP  888 H= 222:00 +CPU= 29.390
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000888
  16:09:17 STEP  889 H= 222:15 +CPU= 23.998
  16:09:41 STEP  890 H= 222:30 +CPU= 23.908
  16:10:05 STEP  891 H= 222:45 +CPU= 24.114
  16:10:30 STEP  892 H= 223:00 +CPU= 24.378
  16:10:54 STEP  893 H= 223:15 +CPU= 24.114
  16:11:18 STEP  894 H= 223:30 +CPU= 24.373
  16:11:43 STEP  895 H= 223:45 +CPU= 24.432
  16:12:08 STEP  896 H= 224:00 +CPU= 24.439
  16:12:31 STEP  897 H= 224:15 +CPU= 23.888
  16:12:56 STEP  898 H= 224:30 +CPU= 23.993
  16:13:20 STEP  899 H= 224:45 +CPU= 24.132
  16:13:49 STEP  900 H= 225:00 +CPU= 29.628
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000900
  16:14:14 STEP  901 H= 225:15 +CPU= 24.059
  16:14:38 STEP  902 H= 225:30 +CPU= 24.045
  16:15:02 STEP  903 H= 225:45 +CPU= 24.074
  16:15:27 STEP  904 H= 226:00 +CPU= 24.734
  16:15:51 STEP  905 H= 226:15 +CPU= 23.960
  16:16:15 STEP  906 H= 226:30 +CPU= 23.946
  16:16:39 STEP  907 H= 226:45 +CPU= 24.073
  16:17:03 STEP  908 H= 227:00 +CPU= 24.292
  16:17:28 STEP  909 H= 227:15 +CPU= 24.135
  16:17:52 STEP  910 H= 227:30 +CPU= 23.832
  16:18:16 STEP  911 H= 227:45 +CPU= 23.943
  16:18:48 STEP  912 H= 228:00 +CPU= 32.596
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000912
  16:19:12 STEP  913 H= 228:15 +CPU= 24.117
  16:19:37 STEP  914 H= 228:30 +CPU= 24.477
  16:20:01 STEP  915 H= 228:45 +CPU= 24.014
  16:20:26 STEP  916 H= 229:00 +CPU= 24.472
  16:20:50 STEP  917 H= 229:15 +CPU= 24.100
  16:21:14 STEP  918 H= 229:30 +CPU= 23.917
  16:21:38 STEP  919 H= 229:45 +CPU= 24.074
  16:22:03 STEP  920 H= 230:00 +CPU= 24.385
  16:22:27 STEP  921 H= 230:15 +CPU= 24.016
  16:22:51 STEP  922 H= 230:30 +CPU= 24.181
  16:23:15 STEP  923 H= 230:45 +CPU= 24.241
  16:23:45 STEP  924 H= 231:00 +CPU= 29.941
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000924
  16:24:10 STEP  925 H= 231:15 +CPU= 24.186
  16:24:34 STEP  926 H= 231:30 +CPU= 24.095
  16:24:58 STEP  927 H= 231:45 +CPU= 24.149
  16:25:23 STEP  928 H= 232:00 +CPU= 24.516
  16:25:47 STEP  929 H= 232:15 +CPU= 23.895
  16:26:11 STEP  930 H= 232:30 +CPU= 24.039
  16:26:35 STEP  931 H= 232:45 +CPU= 24.145
  16:26:59 STEP  932 H= 233:00 +CPU= 24.437
  16:27:24 STEP  933 H= 233:15 +CPU= 24.336
  16:27:48 STEP  934 H= 233:30 +CPU= 24.351
  16:28:13 STEP  935 H= 233:45 +CPU= 24.329
  16:28:42 STEP  936 H= 234:00 +CPU= 29.509
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000936
  16:29:07 STEP  937 H= 234:15 +CPU= 24.156
  16:29:31 STEP  938 H= 234:30 +CPU= 23.972
  16:29:55 STEP  939 H= 234:45 +CPU= 24.060
  16:30:19 STEP  940 H= 235:00 +CPU= 24.422
  16:30:43 STEP  941 H= 235:15 +CPU= 23.924
  16:31:08 STEP  942 H= 235:30 +CPU= 24.083
  16:31:32 STEP  943 H= 235:45 +CPU= 24.168
  16:31:57 STEP  944 H= 236:00 +CPU= 25.069
  16:32:22 STEP  945 H= 236:15 +CPU= 24.353
  16:32:46 STEP  946 H= 236:30 +CPU= 24.166
  16:33:10 STEP  947 H= 236:45 +CPU= 24.118
  16:33:40 STEP  948 H= 237:00 +CPU= 29.603
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000948
  16:34:04 STEP  949 H= 237:15 +CPU= 24.059
  16:34:28 STEP  950 H= 237:30 +CPU= 24.114
  16:34:52 STEP  951 H= 237:45 +CPU= 24.157
  16:35:17 STEP  952 H= 238:00 +CPU= 24.435
  16:35:41 STEP  953 H= 238:15 +CPU= 23.980
  16:36:05 STEP  954 H= 238:30 +CPU= 24.121
  16:36:30 STEP  955 H= 238:45 +CPU= 24.505
  16:36:55 STEP  956 H= 239:00 +CPU= 24.773
  16:37:19 STEP  957 H= 239:15 +CPU= 24.140
  16:37:43 STEP  958 H= 239:30 +CPU= 24.196
  16:38:07 STEP  959 H= 239:45 +CPU= 23.984
  16:38:40 STEP  960 H= 240:00 +CPU= 32.596
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3bh_2016092300_15_991_12211088_0_r1171764858_9.zip
Uploading the intermediate file: upload_file_9.zip
  16:39:04 STEP  961 H= 240:15 +CPU= 24.341
  16:39:29 STEP  962 H= 240:30 +CPU= 24.125
  16:39:53 STEP  963 H= 240:45 +CPU= 24.072
  16:40:17 STEP  964 H= 241:00 +CPU= 24.526
  16:40:42 STEP  965 H= 241:15 +CPU= 24.475
  16:41:06 STEP  966 H= 241:30 +CPU= 24.365
  16:41:31 STEP  967 H= 241:45 +CPU= 24.118
  16:41:55 STEP  968 H= 242:00 +CPU= 24.529
  16:42:19 STEP  969 H= 242:15 +CPU= 23.997
  16:42:44 STEP  970 H= 242:30 +CPU= 24.074
  16:43:08 STEP  971 H= 242:45 +CPU= 24.054
  16:43:37 STEP  972 H= 243:00 +CPU= 29.676
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000972
  16:44:02 STEP  973 H= 243:15 +CPU= 24.197
  16:44:26 STEP  974 H= 243:30 +CPU= 24.173
  16:44:51 STEP  975 H= 243:45 +CPU= 24.434
  16:45:15 STEP  976 H= 244:00 +CPU= 24.817
  16:45:40 STEP  977 H= 244:15 +CPU= 24.278
  16:46:04 STEP  978 H= 244:30 +CPU= 23.999
  16:46:28 STEP  979 H= 244:45 +CPU= 24.085
  16:46:53 STEP  980 H= 245:00 +CPU= 24.415
  16:47:17 STEP  981 H= 245:15 +CPU= 23.968
  16:47:41 STEP  982 H= 245:30 +CPU= 23.925
  16:48:05 STEP  983 H= 245:45 +CPU= 24.016
  16:48:34 STEP  984 H= 246:00 +CPU= 29.517
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000984
  16:48:59 STEP  985 H= 246:15 +CPU= 24.116
  16:49:23 STEP  986 H= 246:30 +CPU= 24.274
  16:49:47 STEP  987 H= 246:45 +CPU= 24.237
  16:50:12 STEP  988 H= 247:00 +CPU= 24.537
  16:50:36 STEP  989 H= 247:15 +CPU= 24.025
  16:51:00 STEP  990 H= 247:30 +CPU= 23.998
  16:51:24 STEP  991 H= 247:45 +CPU= 24.138
  16:51:49 STEP  992 H= 248:00 +CPU= 24.465
  16:52:13 STEP  993 H= 248:15 +CPU= 23.888
  16:52:37 STEP  994 H= 248:30 +CPU= 23.977
  16:53:01 STEP  995 H= 248:45 +CPU= 24.124
  16:53:31 STEP  996 H= 249:00 +CPU= 29.796
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+000996
  16:53:56 STEP  997 H= 249:15 +CPU= 24.420
  16:54:20 STEP  998 H= 249:30 +CPU= 24.326
  16:54:44 STEP  999 H= 249:45 +CPU= 24.318
  16:55:09 STEP 1000 H= 250:00 +CPU= 24.560
  16:55:33 STEP 1001 H= 250:15 +CPU= 24.093
  16:55:57 STEP 1002 H= 250:30 +CPU= 23.916
  16:56:21 STEP 1003 H= 250:45 +CPU= 24.093
  16:56:46 STEP 1004 H= 251:00 +CPU= 24.440
  16:57:10 STEP 1005 H= 251:15 +CPU= 24.165
  16:57:34 STEP 1006 H= 251:30 +CPU= 23.736
  16:57:58 STEP 1007 H= 251:45 +CPU= 23.816
  16:58:31 STEP 1008 H= 252:00 +CPU= 32.645
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001008
  16:58:55 STEP 1009 H= 252:15 +CPU= 24.282
  16:59:19 STEP 1010 H= 252:30 +CPU= 24.102
  16:59:43 STEP 1011 H= 252:45 +CPU= 23.999
  17:00:08 STEP 1012 H= 253:00 +CPU= 24.476
  17:00:32 STEP 1013 H= 253:15 +CPU= 24.041
  17:00:56 STEP 1014 H= 253:30 +CPU= 23.813
  17:01:20 STEP 1015 H= 253:45 +CPU= 23.976
  17:01:44 STEP 1016 H= 254:00 +CPU= 24.269
  17:02:09 STEP 1017 H= 254:15 +CPU= 24.065
  17:02:33 STEP 1018 H= 254:30 +CPU= 24.615
  17:02:58 STEP 1019 H= 254:45 +CPU= 24.440
  17:03:28 STEP 1020 H= 255:00 +CPU= 29.965
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001020
  17:03:52 STEP 1021 H= 255:15 +CPU= 24.173
  17:04:16 STEP 1022 H= 255:30 +CPU= 24.104
  17:04:41 STEP 1023 H= 255:45 +CPU= 24.359
  17:05:06 STEP 1024 H= 256:00 +CPU= 24.573
  17:05:31 STEP 1025 H= 256:15 +CPU= 24.771
  17:05:55 STEP 1026 H= 256:30 +CPU= 24.500
  17:06:19 STEP 1027 H= 256:45 +CPU= 24.262
  17:06:44 STEP 1028 H= 257:00 +CPU= 24.611
  17:07:09 STEP 1029 H= 257:15 +CPU= 24.780
  17:07:33 STEP 1030 H= 257:30 +CPU= 23.952
  17:07:57 STEP 1031 H= 257:45 +CPU= 24.081
  17:08:28 STEP 1032 H= 258:00 +CPU= 29.986
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001032
  17:08:52 STEP 1033 H= 258:15 +CPU= 24.252
  17:09:16 STEP 1034 H= 258:30 +CPU= 24.127
  17:09:41 STEP 1035 H= 258:45 +CPU= 24.166
  17:10:05 STEP 1036 H= 259:00 +CPU= 24.727
  17:10:30 STEP 1037 H= 259:15 +CPU= 24.174
  17:10:55 STEP 1038 H= 259:30 +CPU= 24.691
  17:11:19 STEP 1039 H= 259:45 +CPU= 24.395
  17:11:44 STEP 1040 H= 260:00 +CPU= 24.533
  17:12:08 STEP 1041 H= 260:15 +CPU= 23.883
  17:12:32 STEP 1042 H= 260:30 +CPU= 24.039
  17:12:56 STEP 1043 H= 260:45 +CPU= 23.887
  17:13:25 STEP 1044 H= 261:00 +CPU= 29.246
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001044
  17:13:49 STEP 1045 H= 261:15 +CPU= 24.193
  17:14:13 STEP 1046 H= 261:30 +CPU= 23.866
  17:14:37 STEP 1047 H= 261:45 +CPU= 23.882
  17:15:02 STEP 1048 H= 262:00 +CPU= 24.892
  17:15:26 STEP 1049 H= 262:15 +CPU= 24.051
  17:15:50 STEP 1050 H= 262:30 +CPU= 23.878
  17:16:14 STEP 1051 H= 262:45 +CPU= 23.752
  17:16:39 STEP 1052 H= 263:00 +CPU= 24.357
  17:17:03 STEP 1053 H= 263:15 +CPU= 23.970
  17:17:26 STEP 1054 H= 263:30 +CPU= 23.532
  17:17:50 STEP 1055 H= 263:45 +CPU= 23.994
  17:18:24 STEP 1056 H= 264:00 +CPU= 33.196
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3bh_2016092300_15_991_12211088_0_r1171764858_10.zip
Uploading the intermediate file: upload_file_10.zip
  17:18:48 STEP 1057 H= 264:15 +CPU= 24.292
Uploading trickle at timestep: 950400
  17:19:12 STEP 1058 H= 264:30 +CPU= 24.090
  17:19:36 STEP 1059 H= 264:45 +CPU= 23.858
  17:20:01 STEP 1060 H= 265:00 +CPU= 24.196
  17:20:25 STEP 1061 H= 265:15 +CPU= 23.737
  17:20:48 STEP 1062 H= 265:30 +CPU= 23.609
  17:21:12 STEP 1063 H= 265:45 +CPU= 24.009
  17:21:37 STEP 1064 H= 266:00 +CPU= 24.339
  17:22:01 STEP 1065 H= 266:15 +CPU= 24.040
  17:22:24 STEP 1066 H= 266:30 +CPU= 23.389
  17:22:49 STEP 1067 H= 266:45 +CPU= 24.351
  17:23:19 STEP 1068 H= 267:00 +CPU= 30.277
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001068
  17:23:43 STEP 1069 H= 267:15 +CPU= 24.151
  17:24:08 STEP 1070 H= 267:30 +CPU= 23.973
  17:24:32 STEP 1071 H= 267:45 +CPU= 24.241
  17:24:56 STEP 1072 H= 268:00 +CPU= 24.555
  17:25:21 STEP 1073 H= 268:15 +CPU= 24.222
  17:25:45 STEP 1074 H= 268:30 +CPU= 23.988
  17:26:09 STEP 1075 H= 268:45 +CPU= 24.207
  17:26:34 STEP 1076 H= 269:00 +CPU= 24.547
  17:26:58 STEP 1077 H= 269:15 +CPU= 24.248
  17:27:22 STEP 1078 H= 269:30 +CPU= 23.661
  17:27:46 STEP 1079 H= 269:45 +CPU= 24.143
  17:28:16 STEP 1080 H= 270:00 +CPU= 29.564
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001080
  17:28:40 STEP 1081 H= 270:15 +CPU= 23.971
  17:29:04 STEP 1082 H= 270:30 +CPU= 23.874
  17:29:28 STEP 1083 H= 270:45 +CPU= 23.863
  17:29:52 STEP 1084 H= 271:00 +CPU= 24.406
  17:30:17 STEP 1085 H= 271:15 +CPU= 24.322
  17:30:41 STEP 1086 H= 271:30 +CPU= 23.831
  17:31:05 STEP 1087 H= 271:45 +CPU= 23.867
  17:31:29 STEP 1088 H= 272:00 +CPU= 24.335
  17:31:53 STEP 1089 H= 272:15 +CPU= 23.963
  17:32:17 STEP 1090 H= 272:30 +CPU= 24.109
  17:32:42 STEP 1091 H= 272:45 +CPU= 24.272
  17:33:11 STEP 1092 H= 273:00 +CPU= 29.470
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001092
  17:33:35 STEP 1093 H= 273:15 +CPU= 24.090
  17:33:59 STEP 1094 H= 273:30 +CPU= 23.935
  17:34:24 STEP 1095 H= 273:45 +CPU= 24.233
  17:34:49 STEP 1096 H= 274:00 +CPU= 24.760
  17:35:13 STEP 1097 H= 274:15 +CPU= 23.970
  17:35:37 STEP 1098 H= 274:30 +CPU= 23.930
  17:36:01 STEP 1099 H= 274:45 +CPU= 24.012
  17:36:25 STEP 1100 H= 275:00 +CPU= 24.420
  17:36:50 STEP 1101 H= 275:15 +CPU= 24.123
  17:37:14 STEP 1102 H= 275:30 +CPU= 24.189
  17:37:38 STEP 1103 H= 275:45 +CPU= 23.988
  17:38:11 STEP 1104 H= 276:00 +CPU= 32.727
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001104
  17:38:36 STEP 1105 H= 276:15 +CPU= 24.585
  17:39:00 STEP 1106 H= 276:30 +CPU= 24.275
  17:39:24 STEP 1107 H= 276:45 +CPU= 24.204
  17:39:49 STEP 1108 H= 277:00 +CPU= 24.558
  17:40:13 STEP 1109 H= 277:15 +CPU= 24.188
  17:40:37 STEP 1110 H= 277:30 +CPU= 24.119
  17:41:02 STEP 1111 H= 277:45 +CPU= 24.186
  17:41:26 STEP 1112 H= 278:00 +CPU= 24.537
  17:41:51 STEP 1113 H= 278:15 +CPU= 24.300
  17:42:15 STEP 1114 H= 278:30 +CPU= 24.121
  17:42:39 STEP 1115 H= 278:45 +CPU= 24.332
  17:43:10 STEP 1116 H= 279:00 +CPU= 30.218
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001116
  17:43:34 STEP 1117 H= 279:15 +CPU= 24.417
  17:43:58 STEP 1118 H= 279:30 +CPU= 24.048
  17:44:23 STEP 1119 H= 279:45 +CPU= 24.133
  17:44:47 STEP 1120 H= 280:00 +CPU= 24.499
  17:45:11 STEP 1121 H= 280:15 +CPU= 24.121
  17:45:36 STEP 1122 H= 280:30 +CPU= 24.023
  17:46:00 STEP 1123 H= 280:45 +CPU= 24.136
  17:46:24 STEP 1124 H= 281:00 +CPU= 24.571
  17:46:49 STEP 1125 H= 281:15 +CPU= 24.153
  17:47:13 STEP 1126 H= 281:30 +CPU= 24.320
  17:47:38 STEP 1127 H= 281:45 +CPU= 24.508
  17:48:08 STEP 1128 H= 282:00 +CPU= 29.896
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001128
  17:48:32 STEP 1129 H= 282:15 +CPU= 24.193
  17:48:56 STEP 1130 H= 282:30 +CPU= 24.008
  17:49:20 STEP 1131 H= 282:45 +CPU= 24.171
  17:49:45 STEP 1132 H= 283:00 +CPU= 24.573
  17:50:09 STEP 1133 H= 283:15 +CPU= 24.224
  17:50:34 STEP 1134 H= 283:30 +CPU= 24.170
  17:50:58 STEP 1135 H= 283:45 +CPU= 24.108
  17:51:23 STEP 1136 H= 284:00 +CPU= 24.659
  17:51:48 STEP 1137 H= 284:15 +CPU= 24.851
  17:52:12 STEP 1138 H= 284:30 +CPU= 24.273
  17:52:36 STEP 1139 H= 284:45 +CPU= 24.235
  17:53:06 STEP 1140 H= 285:00 +CPU= 29.884
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001140
  17:53:31 STEP 1141 H= 285:15 +CPU= 24.301
  17:53:55 STEP 1142 H= 285:30 +CPU= 24.321
  17:54:19 STEP 1143 H= 285:45 +CPU= 24.215
  17:54:44 STEP 1144 H= 286:00 +CPU= 24.480
  17:55:08 STEP 1145 H= 286:15 +CPU= 24.140
  17:55:32 STEP 1146 H= 286:30 +CPU= 24.087
  17:55:57 STEP 1147 H= 286:45 +CPU= 24.162
  17:56:21 STEP 1148 H= 287:00 +CPU= 24.492
  17:56:45 STEP 1149 H= 287:15 +CPU= 24.174
  17:57:10 STEP 1150 H= 287:30 +CPU= 24.210
  17:57:34 STEP 1151 H= 287:45 +CPU= 24.510
  17:58:08 STEP 1152 H= 288:00 +CPU= 33.349
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3bh_2016092300_15_991_12211088_0_r1171764858_11.zip
Uploading the intermediate file: upload_file_11.zip
  17:58:32 STEP 1153 H= 288:15 +CPU= 24.402
  17:58:57 STEP 1154 H= 288:30 +CPU= 24.190
  17:59:21 STEP 1155 H= 288:45 +CPU= 24.025
  17:59:46 STEP 1156 H= 289:00 +CPU= 24.575
  18:00:10 STEP 1157 H= 289:15 +CPU= 24.202
  18:00:34 STEP 1158 H= 289:30 +CPU= 24.139
  18:00:58 STEP 1159 H= 289:45 +CPU= 24.159
  18:01:23 STEP 1160 H= 290:00 +CPU= 24.635
  18:01:48 STEP 1161 H= 290:15 +CPU= 24.499
  18:02:12 STEP 1162 H= 290:30 +CPU= 24.390
  18:02:36 STEP 1163 H= 290:45 +CPU= 24.168
  18:03:06 STEP 1164 H= 291:00 +CPU= 29.695
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001164
  18:03:31 STEP 1165 H= 291:15 +CPU= 24.362
  18:03:55 STEP 1166 H= 291:30 +CPU= 24.180
  18:04:19 STEP 1167 H= 291:45 +CPU= 24.222
  18:04:44 STEP 1168 H= 292:00 +CPU= 24.676
  18:05:08 STEP 1169 H= 292:15 +CPU= 24.243
  18:05:33 STEP 1170 H= 292:30 +CPU= 24.200
  18:05:57 STEP 1171 H= 292:45 +CPU= 24.442
  18:06:22 STEP 1172 H= 293:00 +CPU= 24.604
  18:06:46 STEP 1173 H= 293:15 +CPU= 24.207
  18:07:10 STEP 1174 H= 293:30 +CPU= 24.094
  18:07:35 STEP 1175 H= 293:45 +CPU= 24.079
  18:08:04 STEP 1176 H= 294:00 +CPU= 29.602
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001176
  18:08:29 STEP 1177 H= 294:15 +CPU= 24.190
  18:08:53 STEP 1178 H= 294:30 +CPU= 24.226
  18:09:17 STEP 1179 H= 294:45 +CPU= 24.066
  18:09:42 STEP 1180 H= 295:00 +CPU= 24.624
  18:10:06 STEP 1181 H= 295:15 +CPU= 24.429
  18:10:31 STEP 1182 H= 295:30 +CPU= 24.268
  18:10:55 STEP 1183 H= 295:45 +CPU= 24.031
  18:11:19 STEP 1184 H= 296:00 +CPU= 24.542
  18:11:44 STEP 1185 H= 296:15 +CPU= 24.243
  18:12:08 STEP 1186 H= 296:30 +CPU= 24.060
  18:12:32 STEP 1187 H= 296:45 +CPU= 24.192
  18:13:02 STEP 1188 H= 297:00 +CPU= 29.727
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001188
  18:13:26 STEP 1189 H= 297:15 +CPU= 24.261
  18:13:51 STEP 1190 H= 297:30 +CPU= 24.419
  18:14:16 STEP 1191 H= 297:45 +CPU= 24.518
  18:14:40 STEP 1192 H= 298:00 +CPU= 24.767
  18:15:05 STEP 1193 H= 298:15 +CPU= 24.155
  18:15:29 STEP 1194 H= 298:30 +CPU= 24.086
  18:15:53 STEP 1195 H= 298:45 +CPU= 24.194
  18:16:18 STEP 1196 H= 299:00 +CPU= 24.718
  18:16:42 STEP 1197 H= 299:15 +CPU= 24.242
  18:17:07 STEP 1198 H= 299:30 +CPU= 24.248
  18:17:30 STEP 1199 H= 299:45 +CPU= 23.802
  18:18:03 STEP 1200 H= 300:00 +CPU= 32.717
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001200
  18:18:28 STEP 1201 H= 300:15 +CPU= 24.462
  18:18:53 STEP 1202 H= 300:30 +CPU= 24.780
  18:19:17 STEP 1203 H= 300:45 +CPU= 24.087
  18:19:42 STEP 1204 H= 301:00 +CPU= 24.551
  18:20:06 STEP 1205 H= 301:15 +CPU= 24.171
  18:20:30 STEP 1206 H= 301:30 +CPU= 24.005
  18:20:54 STEP 1207 H= 301:45 +CPU= 24.064
  18:21:19 STEP 1208 H= 302:00 +CPU= 24.450
  18:21:43 STEP 1209 H= 302:15 +CPU= 24.196
  18:22:07 STEP 1210 H= 302:30 +CPU= 24.045
  18:22:31 STEP 1211 H= 302:45 +CPU= 24.196
  18:23:02 STEP 1212 H= 303:00 +CPU= 30.057
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001212
  18:23:26 STEP 1213 H= 303:15 +CPU= 24.174
  18:23:50 STEP 1214 H= 303:30 +CPU= 23.964
  18:24:14 STEP 1215 H= 303:45 +CPU= 24.252
  18:24:39 STEP 1216 H= 304:00 +CPU= 24.732
  18:25:03 STEP 1217 H= 304:15 +CPU= 24.140
  18:25:27 STEP 1218 H= 304:30 +CPU= 23.877
  18:25:51 STEP 1219 H= 304:45 +CPU= 24.049
  18:26:16 STEP 1220 H= 305:00 +CPU= 24.567
  18:26:40 STEP 1221 H= 305:15 +CPU= 24.297
  18:27:05 STEP 1222 H= 305:30 +CPU= 24.409
  18:27:29 STEP 1223 H= 305:45 +CPU= 23.958
  18:27:59 STEP 1224 H= 306:00 +CPU= 29.887
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001224
  18:28:23 STEP 1225 H= 306:15 +CPU= 24.142
  18:28:48 STEP 1226 H= 306:30 +CPU= 24.181
  18:29:12 STEP 1227 H= 306:45 +CPU= 24.051
  18:29:36 STEP 1228 H= 307:00 +CPU= 24.532
  18:30:01 STEP 1229 H= 307:15 +CPU= 24.163
  18:30:25 STEP 1230 H= 307:30 +CPU= 24.115
  18:30:49 STEP 1231 H= 307:45 +CPU= 24.169
  18:31:14 STEP 1232 H= 308:00 +CPU= 25.073
  18:31:39 STEP 1233 H= 308:15 +CPU= 24.205
  18:32:03 STEP 1234 H= 308:30 +CPU= 23.983
  18:32:27 STEP 1235 H= 308:45 +CPU= 24.037
  18:32:56 STEP 1236 H= 309:00 +CPU= 29.318
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001236
  18:33:20 STEP 1237 H= 309:15 +CPU= 24.145
  18:33:45 STEP 1238 H= 309:30 +CPU= 24.080
  18:34:09 STEP 1239 H= 309:45 +CPU= 23.857
  18:34:33 STEP 1240 H= 310:00 +CPU= 24.498
  18:34:58 STEP 1241 H= 310:15 +CPU= 24.402
  18:35:22 STEP 1242 H= 310:30 +CPU= 23.908
  18:35:46 STEP 1243 H= 310:45 +CPU= 24.052
  18:36:10 STEP 1244 H= 311:00 +CPU= 24.298
  18:36:34 STEP 1245 H= 311:15 +CPU= 23.934
  18:36:58 STEP 1246 H= 311:30 +CPU= 24.025
  18:37:22 STEP 1247 H= 311:45 +CPU= 23.777
  18:37:55 STEP 1248 H= 312:00 +CPU= 32.977
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3bh_2016092300_15_991_12211088_0_r1171764858_12.zip
Uploading the intermediate file: upload_file_12.zip
  18:38:20 STEP 1249 H= 312:15 +CPU= 24.455
  18:38:44 STEP 1250 H= 312:30 +CPU= 23.933
  18:39:08 STEP 1251 H= 312:45 +CPU= 24.165
  18:39:33 STEP 1252 H= 313:00 +CPU= 24.613
  18:39:57 STEP 1253 H= 313:15 +CPU= 23.879
  18:40:21 STEP 1254 H= 313:30 +CPU= 24.007
  18:40:45 STEP 1255 H= 313:45 +CPU= 23.801
  18:41:09 STEP 1256 H= 314:00 +CPU= 24.492
  18:41:33 STEP 1257 H= 314:15 +CPU= 23.934
  18:41:58 STEP 1258 H= 314:30 +CPU= 24.162
  18:42:21 STEP 1259 H= 314:45 +CPU= 23.545
  18:42:52 STEP 1260 H= 315:00 +CPU= 30.135
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001260
  18:43:16 STEP 1261 H= 315:15 +CPU= 24.758
  18:43:41 STEP 1262 H= 315:30 +CPU= 24.656
  18:44:06 STEP 1263 H= 315:45 +CPU= 24.269
  18:44:30 STEP 1264 H= 316:00 +CPU= 24.763
  18:44:55 STEP 1265 H= 316:15 +CPU= 24.280
  18:45:19 STEP 1266 H= 316:30 +CPU= 24.365
  18:45:44 STEP 1267 H= 316:45 +CPU= 24.293
  18:46:08 STEP 1268 H= 317:00 +CPU= 24.588
  18:46:33 STEP 1269 H= 317:15 +CPU= 24.324
  18:46:57 STEP 1270 H= 317:30 +CPU= 24.114
  18:47:21 STEP 1271 H= 317:45 +CPU= 24.195
  18:47:51 STEP 1272 H= 318:00 +CPU= 29.997
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001272
  18:48:16 STEP 1273 H= 318:15 +CPU= 24.083
  18:48:40 STEP 1274 H= 318:30 +CPU= 24.022
  18:49:04 STEP 1275 H= 318:45 +CPU= 23.891
  18:49:28 STEP 1276 H= 319:00 +CPU= 24.369
  18:49:52 STEP 1277 H= 319:15 +CPU= 23.924
  18:50:16 STEP 1278 H= 319:30 +CPU= 23.905
  18:50:40 STEP 1279 H= 319:45 +CPU= 23.840
  18:51:05 STEP 1280 H= 320:00 +CPU= 24.497
  18:51:29 STEP 1281 H= 320:15 +CPU= 24.038
  18:51:53 STEP 1282 H= 320:30 +CPU= 24.293
  18:52:18 STEP 1283 H= 320:45 +CPU= 24.275
  18:52:47 STEP 1284 H= 321:00 +CPU= 29.606
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001284
  18:53:11 STEP 1285 H= 321:15 +CPU= 24.112
  18:53:36 STEP 1286 H= 321:30 +CPU= 24.175
  18:54:00 STEP 1287 H= 321:45 +CPU= 23.959
  18:54:24 STEP 1288 H= 322:00 +CPU= 24.640
  18:54:49 STEP 1289 H= 322:15 +CPU= 24.111
  18:55:13 STEP 1290 H= 322:30 +CPU= 24.203
  18:55:37 STEP 1291 H= 322:45 +CPU= 24.189
  18:56:02 STEP 1292 H= 323:00 +CPU= 24.761
  18:56:26 STEP 1293 H= 323:15 +CPU= 24.111
  18:56:50 STEP 1294 H= 323:30 +CPU= 24.030
  18:57:15 STEP 1295 H= 323:45 +CPU= 24.214
  18:57:48 STEP 1296 H= 324:00 +CPU= 32.855
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001296
  18:58:12 STEP 1297 H= 324:15 +CPU= 24.239
  18:58:37 STEP 1298 H= 324:30 +CPU= 24.317
  18:59:01 STEP 1299 H= 324:45 +CPU= 24.104
  18:59:26 STEP 1300 H= 325:00 +CPU= 24.728
  18:59:50 STEP 1301 H= 325:15 +CPU= 24.685
  19:00:15 STEP 1302 H= 325:30 +CPU= 24.670
  19:00:39 STEP 1303 H= 325:45 +CPU= 24.227
  19:01:04 STEP 1304 H= 326:00 +CPU= 24.794
  19:01:29 STEP 1305 H= 326:15 +CPU= 24.286
  19:01:53 STEP 1306 H= 326:30 +CPU= 24.341
  19:02:17 STEP 1307 H= 326:45 +CPU= 24.207
  19:02:47 STEP 1308 H= 327:00 +CPU= 29.712
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001308
  19:03:12 STEP 1309 H= 327:15 +CPU= 24.268
  19:03:36 STEP 1310 H= 327:30 +CPU= 24.462
  19:04:01 STEP 1311 H= 327:45 +CPU= 24.539
  19:04:26 STEP 1312 H= 328:00 +CPU= 24.734
  19:04:50 STEP 1313 H= 328:15 +CPU= 24.283
  19:05:14 STEP 1314 H= 328:30 +CPU= 24.256
  19:05:39 STEP 1315 H= 328:45 +CPU= 24.203
  19:06:03 STEP 1316 H= 329:00 +CPU= 24.724
  19:06:28 STEP 1317 H= 329:15 +CPU= 24.182
  19:06:52 STEP 1318 H= 329:30 +CPU= 24.200
  19:07:16 STEP 1319 H= 329:45 +CPU= 24.148
  19:07:46 STEP 1320 H= 330:00 +CPU= 29.932
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001320
  19:08:11 STEP 1321 H= 330:15 +CPU= 24.688
  19:08:36 STEP 1322 H= 330:30 +CPU= 24.406
  19:09:00 STEP 1323 H= 330:45 +CPU= 24.294
  19:09:25 STEP 1324 H= 331:00 +CPU= 24.722
  19:09:49 STEP 1325 H= 331:15 +CPU= 24.306
  19:10:14 STEP 1326 H= 331:30 +CPU= 24.466
  19:10:38 STEP 1327 H= 331:45 +CPU= 24.159
  19:11:03 STEP 1328 H= 332:00 +CPU= 24.702
  19:11:27 STEP 1329 H= 332:15 +CPU= 24.340
  19:11:52 STEP 1330 H= 332:30 +CPU= 24.396
  19:12:16 STEP 1331 H= 332:45 +CPU= 24.464
  19:12:47 STEP 1332 H= 333:00 +CPU= 30.279
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001332
  19:13:11 STEP 1333 H= 333:15 +CPU= 24.209
  19:13:36 STEP 1334 H= 333:30 +CPU= 24.414
  19:14:00 STEP 1335 H= 333:45 +CPU= 24.161
  19:14:25 STEP 1336 H= 334:00 +CPU= 24.623
  19:14:49 STEP 1337 H= 334:15 +CPU= 24.203
  19:15:14 STEP 1338 H= 334:30 +CPU= 24.556
  19:15:39 STEP 1339 H= 334:45 +CPU= 25.188
  19:16:05 STEP 1340 H= 335:00 +CPU= 25.701
  19:16:30 STEP 1341 H= 335:15 +CPU= 25.026
  19:16:55 STEP 1342 H= 335:30 +CPU= 24.415
  19:17:19 STEP 1343 H= 335:45 +CPU= 24.364
  19:17:52 STEP 1344 H= 336:00 +CPU= 33.003
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3bh_2016092300_15_991_12211088_0_r1171764858_13.zip
Uploading the intermediate file: upload_file_13.zip
  19:18:17 STEP 1345 H= 336:15 +CPU= 24.602
  19:18:42 STEP 1346 H= 336:30 +CPU= 24.544
  19:19:06 STEP 1347 H= 336:45 +CPU= 24.329
  19:19:31 STEP 1348 H= 337:00 +CPU= 24.753
  19:19:55 STEP 1349 H= 337:15 +CPU= 24.263
  19:20:20 STEP 1350 H= 337:30 +CPU= 24.674
  19:20:45 STEP 1351 H= 337:45 +CPU= 24.676
  19:21:10 STEP 1352 H= 338:00 +CPU= 25.067
  19:21:35 STEP 1353 H= 338:15 +CPU= 24.401
  19:21:59 STEP 1354 H= 338:30 +CPU= 24.393
  19:22:23 STEP 1355 H= 338:45 +CPU= 24.077
  19:22:53 STEP 1356 H= 339:00 +CPU= 29.849
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001356
  19:23:18 STEP 1357 H= 339:15 +CPU= 24.188
  19:23:42 STEP 1358 H= 339:30 +CPU= 24.359
  19:24:06 STEP 1359 H= 339:45 +CPU= 24.204
  19:24:31 STEP 1360 H= 340:00 +CPU= 24.697
  19:24:56 STEP 1361 H= 340:15 +CPU= 24.578
  19:25:21 STEP 1362 H= 340:30 +CPU= 24.543
  19:25:45 STEP 1363 H= 340:45 +CPU= 24.240
  19:26:10 STEP 1364 H= 341:00 +CPU= 24.761
  19:26:34 STEP 1365 H= 341:15 +CPU= 24.165
  19:26:58 STEP 1366 H= 341:30 +CPU= 24.220
  19:27:22 STEP 1367 H= 341:45 +CPU= 24.151
  19:27:52 STEP 1368 H= 342:00 +CPU= 29.606
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001368
  19:28:16 STEP 1369 H= 342:15 +CPU= 24.076
  19:28:41 STEP 1370 H= 342:30 +CPU= 24.397
  19:29:05 STEP 1371 H= 342:45 +CPU= 24.364
  19:29:30 STEP 1372 H= 343:00 +CPU= 25.037
  19:29:55 STEP 1373 H= 343:15 +CPU= 24.405
  19:30:19 STEP 1374 H= 343:30 +CPU= 24.366
  19:30:44 STEP 1375 H= 343:45 +CPU= 24.256
  19:31:09 STEP 1376 H= 344:00 +CPU= 24.692
  19:31:33 STEP 1377 H= 344:15 +CPU= 24.273
  19:31:57 STEP 1378 H= 344:30 +CPU= 24.329
  19:32:22 STEP 1379 H= 344:45 +CPU= 24.174
  19:32:52 STEP 1380 H= 345:00 +CPU= 29.973
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001380
  19:33:16 STEP 1381 H= 345:15 +CPU= 24.518
  19:33:41 STEP 1382 H= 345:30 +CPU= 24.573
  19:34:05 STEP 1383 H= 345:45 +CPU= 24.319
  19:34:30 STEP 1384 H= 346:00 +CPU= 24.610
  19:34:54 STEP 1385 H= 346:15 +CPU= 24.220
  19:35:19 STEP 1386 H= 346:30 +CPU= 24.193
  19:35:43 STEP 1387 H= 346:45 +CPU= 24.152
  19:36:08 STEP 1388 H= 347:00 +CPU= 24.650
  19:36:32 STEP 1389 H= 347:15 +CPU= 24.258
  19:36:56 STEP 1390 H= 347:30 +CPU= 24.285
  19:37:21 STEP 1391 H= 347:45 +CPU= 24.401
  19:37:54 STEP 1392 H= 348:00 +CPU= 33.170
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001392
  19:38:19 STEP 1393 H= 348:15 +CPU= 24.541
  19:38:43 STEP 1394 H= 348:30 +CPU= 24.323
  19:39:08 STEP 1395 H= 348:45 +CPU= 24.216
  19:39:32 STEP 1396 H= 349:00 +CPU= 24.609
  19:39:57 STEP 1397 H= 349:15 +CPU= 24.173
  19:40:21 STEP 1398 H= 349:30 +CPU= 24.455
  19:40:45 STEP 1399 H= 349:45 +CPU= 24.182
  19:41:10 STEP 1400 H= 350:00 +CPU= 24.917
  19:41:35 STEP 1401 H= 350:15 +CPU= 24.264
  19:41:59 STEP 1402 H= 350:30 +CPU= 24.591
  19:42:24 STEP 1403 H= 350:45 +CPU= 24.482
  19:42:54 STEP 1404 H= 351:00 +CPU= 29.669
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001404
  19:43:18 STEP 1405 H= 351:15 +CPU= 24.208
  19:43:43 STEP 1406 H= 351:30 +CPU= 24.402
  19:44:07 STEP 1407 H= 351:45 +CPU= 24.177
  19:44:32 STEP 1408 H= 352:00 +CPU= 24.667
  19:44:56 STEP 1409 H= 352:15 +CPU= 24.158
  19:45:20 STEP 1410 H= 352:30 +CPU= 24.384
  19:45:45 STEP 1411 H= 352:45 +CPU= 24.209
  19:46:10 STEP 1412 H= 353:00 +CPU= 25.377
  19:46:35 STEP 1413 H= 353:15 +CPU= 24.301
  19:46:59 STEP 1414 H= 353:30 +CPU= 24.250
  19:47:23 STEP 1415 H= 353:45 +CPU= 24.047
  19:47:53 STEP 1416 H= 354:00 +CPU= 29.777
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001416
  19:48:17 STEP 1417 H= 354:15 +CPU= 24.247
  19:48:42 STEP 1418 H= 354:30 +CPU= 24.292
  19:49:06 STEP 1419 H= 354:45 +CPU= 24.215
  19:49:31 STEP 1420 H= 355:00 +CPU= 24.679
  19:49:55 STEP 1421 H= 355:15 +CPU= 24.317
  19:50:20 STEP 1422 H= 355:30 +CPU= 24.568
  19:50:44 STEP 1423 H= 355:45 +CPU= 24.282
  19:51:09 STEP 1424 H= 356:00 +CPU= 24.750
  19:51:33 STEP 1425 H= 356:15 +CPU= 24.205
  19:51:58 STEP 1426 H= 356:30 +CPU= 24.393
  19:52:22 STEP 1427 H= 356:45 +CPU= 24.095
  19:52:52 STEP 1428 H= 357:00 +CPU= 29.831
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001428
  19:53:16 STEP 1429 H= 357:15 +CPU= 24.292
  19:53:41 STEP 1430 H= 357:30 +CPU= 24.467
  19:54:06 STEP 1431 H= 357:45 +CPU= 24.572
  19:54:31 STEP 1432 H= 358:00 +CPU= 24.906
  19:54:55 STEP 1433 H= 358:15 +CPU= 24.279
  19:55:19 STEP 1434 H= 358:30 +CPU= 24.145
  19:55:43 STEP 1435 H= 358:45 +CPU= 24.241
  19:56:08 STEP 1436 H= 359:00 +CPU= 24.551
  19:56:32 STEP 1437 H= 359:15 +CPU= 24.281
  19:56:57 STEP 1438 H= 359:30 +CPU= 24.172
  19:57:21 STEP 1439 H= 359:45 +CPU= 24.184
  19:57:48 STEP 1440 H= 360:00 +CPU= 27.419
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1371853439E-20      I       0.6392446273E-06      I
ICloud fractionI      0.0000000000E+00      I       0.4090429926E-01      I
I  Relat. Hum. I      0.5744178237E+00      I       0.6054386237E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2313074135E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    299833153 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS999443.8 Mbytes/s, TOTAL TIME=    0.0074( 4.1%)
 19:57:48 STEP 1440 H= 360:00 +CPU= 27.419
 END CNT3
 NSTEP =  1440 CNT0   000000000  19.578  19.578  19.627   0.998               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN        38286/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    678    0       34      1044068    38286 ************    56.7     4.7    52.0     8.2   113.2
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.96      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1405    3898.5    3898.5     16.79      0.00
   9 SPCM     - SPECTRAL COMP.                    1296     865.8     865.8      3.44      0.00
  10 SCAN2M - PHYSICS                             1297   12703.4   12703.4     50.50      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                108     746.8     746.8      0.25      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 55      40.0      40.0      0.01      0.00
  17 GRIDFPOS IN CNT4                              108      22.5      22.5      0.01      0.00
  27 RESTART FILES - WRITING                        27    2987.4    2987.4      0.25      0.00
  28 RESTART FILES - READING                         1   12437.5   12437.5      0.04      0.00
  29 SU4FPOS IN CNT4                               108       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               108    5001.9    5001.9      1.66      0.00
  31 POSDDH IN STEPO                                 6       0.9       0.9      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1297    4374.9    4374.9     17.39      0.00
  39 SU0YOMB                                         1     933.5     933.5      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1297      28.1      28.1      0.11      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1296     495.2     495.2      1.97      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1296      52.4      52.4      0.21      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 55       0.4       0.4      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     2812     334.7     334.7      2.88      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      2700     193.0     193.0      1.60      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       2700      75.2      75.2      0.62      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      2812     128.8     128.8      1.11      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1     359.3     359.3      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           2812      47.4      47.4      0.41      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           2700      29.6      29.6      0.24      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           2812      74.1      74.1      0.64      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           2700      27.9      27.9      0.23      0.00
 400 GSTATS                                     150580       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                140038       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    32626.7 CPU TIME   32491.5 VECTOR TIME    32491.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       39.7
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/4/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/4/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/4/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211088/ICMSHh7zg+001392
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3bh_2016092300_15_991_12211088_0_r1171764858_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
double free or corruption (out)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:55:11 1537235 22311325 oifs_43r3_bl_a3bh_2016092300_15_991_12211088_0 1,295,100 37,436 0.0289
09 May 2023 16:55:11 1537235 22311325 oifs_43r3_bl_a3bh_2016092300_15_991_12211088_0 950,400 27,915 0.0294


©2024 climateprediction.net