climateprediction.net home page
Task 22440034

Task 22440034

Name oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1
Workunit 12286090
Created 7 Jun 2024, 21:08:42 UTC
Sent 8 Jun 2024, 6:07:09 UTC
Report deadline 7 Aug 2024, 6:07:09 UTC
Received 9 Jun 2024, 0:02:17 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1538905
Run time 16 hours 57 min 40 sec
CPU time 16 hours 48 min 52 sec
Validate state Invalid
Credit 1,318.46
Device peak FLOPS 3.84 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,024.68 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,442.61 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
EP  835 H= 208:45 +CPU= 41.344
  11:10:00 STEP  836 H= 209:00 +CPU= 44.788
  11:10:44 STEP  837 H= 209:15 +CPU= 43.565
  11:11:28 STEP  838 H= 209:30 +CPU= 43.848
  11:12:08 STEP  839 H= 209:45 +CPU= 40.360
  11:13:00 STEP  840 H= 210:00 +CPU= 51.932
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000840
  11:13:41 STEP  841 H= 210:15 +CPU= 40.636
  11:14:23 STEP  842 H= 210:30 +CPU= 41.418
  11:15:06 STEP  843 H= 210:45 +CPU= 42.778
  11:15:48 STEP  844 H= 211:00 +CPU= 42.809
  11:16:32 STEP  845 H= 211:15 +CPU= 43.942
  11:17:16 STEP  846 H= 211:30 +CPU= 43.201
  11:18:00 STEP  847 H= 211:45 +CPU= 43.629
  11:18:41 STEP  848 H= 212:00 +CPU= 41.051
  11:19:21 STEP  849 H= 212:15 +CPU= 39.597
  11:20:02 STEP  850 H= 212:30 +CPU= 41.164
  11:20:45 STEP  851 H= 212:45 +CPU= 42.676
  11:21:39 STEP  852 H= 213:00 +CPU= 53.219
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000852
  11:22:20 STEP  853 H= 213:15 +CPU= 41.417
  11:23:02 STEP  854 H= 213:30 +CPU= 41.805
  11:23:43 STEP  855 H= 213:45 +CPU= 40.554
  11:24:23 STEP  856 H= 214:00 +CPU= 40.382
  11:25:04 STEP  857 H= 214:15 +CPU= 41.009
  11:25:46 STEP  858 H= 214:30 +CPU= 42.011
  11:26:27 STEP  859 H= 214:45 +CPU= 40.232
  11:27:07 STEP  860 H= 215:00 +CPU= 40.747
  11:27:47 STEP  861 H= 215:15 +CPU= 39.699
  11:28:30 STEP  862 H= 215:30 +CPU= 42.105
  11:29:11 STEP  863 H= 215:45 +CPU= 40.845
  11:30:09 STEP  864 H= 216:00 +CPU= 55.714
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1_r1412098885_8.zip
Uploading the intermediate file: upload_file_8.zip
  11:30:51 STEP  865 H= 216:15 +CPU= 42.027
  11:31:35 STEP  866 H= 216:30 +CPU= 43.242
  11:32:17 STEP  867 H= 216:45 +CPU= 41.794
  11:32:59 STEP  868 H= 217:00 +CPU= 42.136
  11:33:43 STEP  869 H= 217:15 +CPU= 43.667
  11:34:26 STEP  870 H= 217:30 +CPU= 42.042
  11:35:08 STEP  871 H= 217:45 +CPU= 41.968
  11:35:51 STEP  872 H= 218:00 +CPU= 42.515
  11:36:34 STEP  873 H= 218:15 +CPU= 41.613
  11:37:17 STEP  874 H= 218:30 +CPU= 43.471
  11:38:00 STEP  875 H= 218:45 +CPU= 42.961
  11:38:52 STEP  876 H= 219:00 +CPU= 51.503
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000876
  11:39:35 STEP  877 H= 219:15 +CPU= 42.564
  11:40:16 STEP  878 H= 219:30 +CPU= 40.356
  11:41:00 STEP  879 H= 219:45 +CPU= 43.874
  11:41:44 STEP  880 H= 220:00 +CPU= 43.173
  11:42:26 STEP  881 H= 220:15 +CPU= 41.401
  11:43:08 STEP  882 H= 220:30 +CPU= 41.711
  11:43:51 STEP  883 H= 220:45 +CPU= 42.540
  11:44:36 STEP  884 H= 221:00 +CPU= 44.650
  11:45:19 STEP  885 H= 221:15 +CPU= 43.250
  11:46:00 STEP  886 H= 221:30 +CPU= 40.179
  11:46:43 STEP  887 H= 221:45 +CPU= 43.066
  11:47:36 STEP  888 H= 222:00 +CPU= 52.513
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000888
  11:48:18 STEP  889 H= 222:15 +CPU= 42.186
  11:49:00 STEP  890 H= 222:30 +CPU= 41.245
  11:49:42 STEP  891 H= 222:45 +CPU= 41.841
  11:50:27 STEP  892 H= 223:00 +CPU= 43.646
  11:51:09 STEP  893 H= 223:15 +CPU= 41.364
  11:51:52 STEP  894 H= 223:30 +CPU= 42.575
  11:52:32 STEP  895 H= 223:45 +CPU= 40.067
  11:53:16 STEP  896 H= 224:00 +CPU= 43.977
  11:53:59 STEP  897 H= 224:15 +CPU= 42.483
  11:54:42 STEP  898 H= 224:30 +CPU= 42.628
  11:55:22 STEP  899 H= 224:45 +CPU= 39.973
  11:56:15 STEP  900 H= 225:00 +CPU= 52.929
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000900
  11:56:58 STEP  901 H= 225:15 +CPU= 43.125
  11:57:42 STEP  902 H= 225:30 +CPU= 43.879
  11:58:23 STEP  903 H= 225:45 +CPU= 41.406
  11:59:07 STEP  904 H= 226:00 +CPU= 43.736
  11:59:51 STEP  905 H= 226:15 +CPU= 43.645
  12:00:31 STEP  906 H= 226:30 +CPU= 40.108
  12:01:11 STEP  907 H= 226:45 +CPU= 39.909
  12:01:54 STEP  908 H= 227:00 +CPU= 43.220
  12:02:38 STEP  909 H= 227:15 +CPU= 43.539
  12:03:21 STEP  910 H= 227:30 +CPU= 42.532
  12:04:02 STEP  911 H= 227:45 +CPU= 40.433
  12:05:00 STEP  912 H= 228:00 +CPU= 58.605
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000912
  12:05:42 STEP  913 H= 228:15 +CPU= 40.827
  12:06:23 STEP  914 H= 228:30 +CPU= 41.171
  12:07:03 STEP  915 H= 228:45 +CPU= 39.945
  12:07:44 STEP  916 H= 229:00 +CPU= 40.791
  12:08:28 STEP  917 H= 229:15 +CPU= 43.993
  12:09:13 STEP  918 H= 229:30 +CPU= 44.276
  12:09:56 STEP  919 H= 229:45 +CPU= 43.752
  12:10:40 STEP  920 H= 230:00 +CPU= 43.074
  12:11:22 STEP  921 H= 230:15 +CPU= 42.713
  12:12:06 STEP  922 H= 230:30 +CPU= 43.448
  12:12:48 STEP  923 H= 230:45 +CPU= 42.157
  12:13:39 STEP  924 H= 231:00 +CPU= 51.452
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000924
  12:14:19 STEP  925 H= 231:15 +CPU= 39.975
  12:15:00 STEP  926 H= 231:30 +CPU= 40.068
  12:15:41 STEP  927 H= 231:45 +CPU= 40.917
  12:16:24 STEP  928 H= 232:00 +CPU= 43.238
  12:17:07 STEP  929 H= 232:15 +CPU= 43.347
  12:17:51 STEP  930 H= 232:30 +CPU= 43.561
  12:18:34 STEP  931 H= 232:45 +CPU= 42.930
  12:19:17 STEP  932 H= 233:00 +CPU= 43.125
  12:20:01 STEP  933 H= 233:15 +CPU= 43.876
  12:20:46 STEP  934 H= 233:30 +CPU= 43.501
  12:21:29 STEP  935 H= 233:45 +CPU= 42.888
  12:22:23 STEP  936 H= 234:00 +CPU= 54.245
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000936
  12:23:03 STEP  937 H= 234:15 +CPU= 39.905
  12:23:46 STEP  938 H= 234:30 +CPU= 42.401
  12:24:26 STEP  939 H= 234:45 +CPU= 39.843
  12:25:11 STEP  940 H= 235:00 +CPU= 44.506
  12:25:54 STEP  941 H= 235:15 +CPU= 43.378
  12:26:38 STEP  942 H= 235:30 +CPU= 43.671
  12:27:20 STEP  943 H= 235:45 +CPU= 42.077
  12:28:04 STEP  944 H= 236:00 +CPU= 43.655
  12:28:48 STEP  945 H= 236:15 +CPU= 44.369
  12:29:28 STEP  946 H= 236:30 +CPU= 40.060
  12:30:11 STEP  947 H= 236:45 +CPU= 42.092
  12:31:04 STEP  948 H= 237:00 +CPU= 52.900
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000948
  12:31:45 STEP  949 H= 237:15 +CPU= 41.214
  12:32:30 STEP  950 H= 237:30 +CPU= 44.727
  12:33:14 STEP  951 H= 237:45 +CPU= 43.871
  12:33:56 STEP  952 H= 238:00 +CPU= 42.066
  12:34:40 STEP  953 H= 238:15 +CPU= 44.088
  12:35:24 STEP  954 H= 238:30 +CPU= 43.308
  12:36:07 STEP  955 H= 238:45 +CPU= 42.133
  12:36:52 STEP  956 H= 239:00 +CPU= 44.570
  12:37:33 STEP  957 H= 239:15 +CPU= 41.045
  12:38:17 STEP  958 H= 239:30 +CPU= 43.083
  12:39:01 STEP  959 H= 239:45 +CPU= 43.390
  12:40:01 STEP  960 H= 240:00 +CPU= 59.620
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1_r1412098885_9.zip
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 864000
  12:40:45 STEP  961 H= 240:15 +CPU= 43.888
  12:41:27 STEP  962 H= 240:30 +CPU= 41.340
  12:42:06 STEP  963 H= 240:45 +CPU= 39.274
  12:42:47 STEP  964 H= 241:00 +CPU= 40.684
  12:43:29 STEP  965 H= 241:15 +CPU= 41.700
  12:44:13 STEP  966 H= 241:30 +CPU= 44.081
  12:44:57 STEP  967 H= 241:45 +CPU= 43.452
  12:45:41 STEP  968 H= 242:00 +CPU= 43.177
  12:46:24 STEP  969 H= 242:15 +CPU= 43.158
  12:47:04 STEP  970 H= 242:30 +CPU= 39.702
  12:47:47 STEP  971 H= 242:45 +CPU= 41.915
  12:48:39 STEP  972 H= 243:00 +CPU= 51.716
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000972
  12:49:18 STEP  973 H= 243:15 +CPU= 39.078
  12:50:00 STEP  974 H= 243:30 +CPU= 40.810
  12:50:41 STEP  975 H= 243:45 +CPU= 41.130
  12:51:24 STEP  976 H= 244:00 +CPU= 41.492
  12:52:07 STEP  977 H= 244:15 +CPU= 41.776
  12:52:50 STEP  978 H= 244:30 +CPU= 42.310
  12:53:30 STEP  979 H= 244:45 +CPU= 39.518
  12:54:11 STEP  980 H= 245:00 +CPU= 41.136
  12:54:50 STEP  981 H= 245:15 +CPU= 39.007
  12:55:32 STEP  982 H= 245:30 +CPU= 41.548
  12:56:14 STEP  983 H= 245:45 +CPU= 42.295
  12:57:03 STEP  984 H= 246:00 +CPU= 48.536
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000984
  12:57:42 STEP  985 H= 246:15 +CPU= 39.472
  12:58:24 STEP  986 H= 246:30 +CPU= 41.120
  12:59:05 STEP  987 H= 246:45 +CPU= 41.075
  12:59:49 STEP  988 H= 247:00 +CPU= 43.252
  13:00:31 STEP  989 H= 247:15 +CPU= 42.704
  13:01:12 STEP  990 H= 247:30 +CPU= 40.329
  13:01:53 STEP  991 H= 247:45 +CPU= 40.642
  13:02:36 STEP  992 H= 248:00 +CPU= 42.739
  13:03:19 STEP  993 H= 248:15 +CPU= 41.975
  13:04:01 STEP  994 H= 248:30 +CPU= 42.170
  13:04:42 STEP  995 H= 248:45 +CPU= 40.632
  13:05:35 STEP  996 H= 249:00 +CPU= 52.426
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+000996
  13:06:17 STEP  997 H= 249:15 +CPU= 42.208
  13:06:57 STEP  998 H= 249:30 +CPU= 39.646
  13:07:40 STEP  999 H= 249:45 +CPU= 42.180
  13:08:22 STEP 1000 H= 250:00 +CPU= 42.620
  13:09:04 STEP 1001 H= 250:15 +CPU= 41.954
  13:09:45 STEP 1002 H= 250:30 +CPU= 40.640
  13:10:29 STEP 1003 H= 250:45 +CPU= 43.330
  13:11:13 STEP 1004 H= 251:00 +CPU= 44.059
  13:11:53 STEP 1005 H= 251:15 +CPU= 40.339
  13:12:34 STEP 1006 H= 251:30 +CPU= 40.778
  13:13:13 STEP 1007 H= 251:45 +CPU= 39.104
  13:14:09 STEP 1008 H= 252:00 +CPU= 55.632
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001008
  13:14:52 STEP 1009 H= 252:15 +CPU= 42.597
  13:15:31 STEP 1010 H= 252:30 +CPU= 39.791
  13:16:11 STEP 1011 H= 252:45 +CPU= 39.708
  13:16:52 STEP 1012 H= 253:00 +CPU= 40.642
  13:17:35 STEP 1013 H= 253:15 +CPU= 42.990
  13:18:18 STEP 1014 H= 253:30 +CPU= 43.278
  13:19:01 STEP 1015 H= 253:45 +CPU= 42.767
  13:19:44 STEP 1016 H= 254:00 +CPU= 42.214
  13:20:24 STEP 1017 H= 254:15 +CPU= 40.451
  13:21:07 STEP 1018 H= 254:30 +CPU= 42.526
  13:21:50 STEP 1019 H= 254:45 +CPU= 42.815
  13:22:44 STEP 1020 H= 255:00 +CPU= 52.718
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001020
  13:23:25 STEP 1021 H= 255:15 +CPU= 41.478
  13:24:09 STEP 1022 H= 255:30 +CPU= 43.489
  13:24:52 STEP 1023 H= 255:45 +CPU= 42.619
  13:25:35 STEP 1024 H= 256:00 +CPU= 43.167
  13:26:18 STEP 1025 H= 256:15 +CPU= 43.106
  13:27:01 STEP 1026 H= 256:30 +CPU= 43.369
  13:27:41 STEP 1027 H= 256:45 +CPU= 40.049
  13:28:24 STEP 1028 H= 257:00 +CPU= 42.136
  13:29:08 STEP 1029 H= 257:15 +CPU= 43.933
  13:29:48 STEP 1030 H= 257:30 +CPU= 40.704
  13:30:31 STEP 1031 H= 257:45 +CPU= 42.260
  13:31:22 STEP 1032 H= 258:00 +CPU= 50.984
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001032
  13:32:01 STEP 1033 H= 258:15 +CPU= 39.523
  13:32:43 STEP 1034 H= 258:30 +CPU= 41.847
  13:33:25 STEP 1035 H= 258:45 +CPU= 41.719
  13:34:10 STEP 1036 H= 259:00 +CPU= 44.243
  13:34:51 STEP 1037 H= 259:15 +CPU= 41.613
  13:35:34 STEP 1038 H= 259:30 +CPU= 42.486
  13:36:16 STEP 1039 H= 259:45 +CPU= 41.217
  13:36:59 STEP 1040 H= 260:00 +CPU= 42.879
  13:37:39 STEP 1041 H= 260:15 +CPU= 40.382
  13:38:20 STEP 1042 H= 260:30 +CPU= 40.995
  13:39:04 STEP 1043 H= 260:45 +CPU= 43.332
  13:39:55 STEP 1044 H= 261:00 +CPU= 51.197
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001044
  13:40:39 STEP 1045 H= 261:15 +CPU= 42.920
  13:41:22 STEP 1046 H= 261:30 +CPU= 43.454
  13:42:06 STEP 1047 H= 261:45 +CPU= 43.558
  13:42:49 STEP 1048 H= 262:00 +CPU= 43.553
  13:43:33 STEP 1049 H= 262:15 +CPU= 43.304
  13:44:14 STEP 1050 H= 262:30 +CPU= 40.917
  13:44:54 STEP 1051 H= 262:45 +CPU= 40.172
  13:45:37 STEP 1052 H= 263:00 +CPU= 43.504
  13:46:17 STEP 1053 H= 263:15 +CPU= 39.606
  13:46:57 STEP 1054 H= 263:30 +CPU= 39.798
  13:47:40 STEP 1055 H= 263:45 +CPU= 42.865
  13:48:37 STEP 1056 H= 264:00 +CPU= 56.551
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1_r1412098885_10.zip
Uploading the intermediate file: upload_file_10.zip
  13:49:17 STEP 1057 H= 264:15 +CPU= 40.512
  13:50:00 STEP 1058 H= 264:30 +CPU= 42.788
  13:50:41 STEP 1059 H= 264:45 +CPU= 40.753
double free or corruption (!prev)
  13:51:24 STEP 1060 H= 265:00 +CPU= 43.031
  13:52:05 STEP 1061 H= 265:15 +CPU= 40.797
  13:52:47 STEP 1062 H= 265:30 +CPU= 41.465
  13:53:29 STEP 1063 H= 265:45 +CPU= 40.397
  13:54:12 STEP 1064 H= 266:00 +CPU= 42.890
  13:54:53 STEP 1065 H= 266:15 +CPU= 41.434
  13:55:35 STEP 1066 H= 266:30 +CPU= 41.961
  13:56:15 STEP 1067 H= 266:45 +CPU= 39.222
  13:57:03 STEP 1068 H= 267:00 +CPU= 48.436
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001068
  13:57:42 STEP 1069 H= 267:15 +CPU= 39.034
  13:58:22 STEP 1070 H= 267:30 +CPU= 39.494
  13:59:02 STEP 1071 H= 267:45 +CPU= 40.072
  13:59:43 STEP 1072 H= 268:00 +CPU= 40.774
  14:00:22 STEP 1073 H= 268:15 +CPU= 38.936
  14:01:00 STEP 1074 H= 268:30 +CPU= 38.732
  14:01:42 STEP 1075 H= 268:45 +CPU= 40.993
  14:02:25 STEP 1076 H= 269:00 +CPU= 42.169
  14:03:05 STEP 1077 H= 269:15 +CPU= 39.525
  14:03:47 STEP 1078 H= 269:30 +CPU= 39.981
  14:04:26 STEP 1079 H= 269:45 +CPU= 38.992
  14:05:15 STEP 1080 H= 270:00 +CPU= 49.146
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001080
  14:05:55 STEP 1081 H= 270:15 +CPU= 39.593
  14:06:34 STEP 1082 H= 270:30 +CPU= 39.264
  14:07:14 STEP 1083 H= 270:45 +CPU= 39.740
  14:07:54 STEP 1084 H= 271:00 +CPU= 39.506
  14:08:35 STEP 1085 H= 271:15 +CPU= 40.555
  14:09:13 STEP 1086 H= 271:30 +CPU= 38.635
  14:09:52 STEP 1087 H= 271:45 +CPU= 38.838
  14:10:32 STEP 1088 H= 272:00 +CPU= 39.417
  14:11:11 STEP 1089 H= 272:15 +CPU= 39.797
  14:11:50 STEP 1090 H= 272:30 +CPU= 38.714
  14:12:31 STEP 1091 H= 272:45 +CPU= 40.997
  14:13:21 STEP 1092 H= 273:00 +CPU= 50.090
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001092
  14:13:59 STEP 1093 H= 273:15 +CPU= 37.947
  14:14:38 STEP 1094 H= 273:30 +CPU= 38.247
  14:15:17 STEP 1095 H= 273:45 +CPU= 39.048
  14:15:57 STEP 1096 H= 274:00 +CPU= 40.024
  14:16:36 STEP 1097 H= 274:15 +CPU= 39.523
  14:17:17 STEP 1098 H= 274:30 +CPU= 40.386
  14:17:56 STEP 1099 H= 274:45 +CPU= 39.136
  14:18:36 STEP 1100 H= 275:00 +CPU= 40.394
  14:19:15 STEP 1101 H= 275:15 +CPU= 38.368
  14:19:54 STEP 1102 H= 275:30 +CPU= 38.830
  14:20:33 STEP 1103 H= 275:45 +CPU= 39.589
  14:21:27 STEP 1104 H= 276:00 +CPU= 53.584
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001104
  14:22:06 STEP 1105 H= 276:15 +CPU= 38.296
  14:22:44 STEP 1106 H= 276:30 +CPU= 38.258
  14:23:24 STEP 1107 H= 276:45 +CPU= 39.990
  14:24:07 STEP 1108 H= 277:00 +CPU= 42.502
  14:24:47 STEP 1109 H= 277:15 +CPU= 39.894
  14:25:25 STEP 1110 H= 277:30 +CPU= 38.694
  14:26:04 STEP 1111 H= 277:45 +CPU= 38.400
  14:26:44 STEP 1112 H= 278:00 +CPU= 40.149
  14:27:24 STEP 1113 H= 278:15 +CPU= 39.313
  14:28:02 STEP 1114 H= 278:30 +CPU= 38.831
  14:28:42 STEP 1115 H= 278:45 +CPU= 39.918
  14:29:31 STEP 1116 H= 279:00 +CPU= 48.450
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001116
  14:30:12 STEP 1117 H= 279:15 +CPU= 40.540
  14:30:50 STEP 1118 H= 279:30 +CPU= 38.254
  14:31:29 STEP 1119 H= 279:45 +CPU= 38.445
  14:32:08 STEP 1120 H= 280:00 +CPU= 39.495
  14:32:47 STEP 1121 H= 280:15 +CPU= 38.518
  14:33:26 STEP 1122 H= 280:30 +CPU= 39.423
  14:34:05 STEP 1123 H= 280:45 +CPU= 38.085
  14:34:45 STEP 1124 H= 281:00 +CPU= 40.321
  14:35:25 STEP 1125 H= 281:15 +CPU= 39.245
  14:36:05 STEP 1126 H= 281:30 +CPU= 39.556
  14:36:45 STEP 1127 H= 281:45 +CPU= 40.104
  14:37:36 STEP 1128 H= 282:00 +CPU= 51.064
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001128
  14:38:16 STEP 1129 H= 282:15 +CPU= 39.258
  14:38:54 STEP 1130 H= 282:30 +CPU= 37.843
  14:39:32 STEP 1131 H= 282:45 +CPU= 37.831
  14:40:14 STEP 1132 H= 283:00 +CPU= 42.369
  14:40:54 STEP 1133 H= 283:15 +CPU= 40.142
  14:41:33 STEP 1134 H= 283:30 +CPU= 38.653
  14:42:12 STEP 1135 H= 283:45 +CPU= 38.729
  14:42:52 STEP 1136 H= 284:00 +CPU= 40.160
  14:43:32 STEP 1137 H= 284:15 +CPU= 39.493
  14:44:10 STEP 1138 H= 284:30 +CPU= 38.597
  14:44:52 STEP 1139 H= 284:45 +CPU= 42.203
  14:45:44 STEP 1140 H= 285:00 +CPU= 51.238
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001140
  14:46:22 STEP 1141 H= 285:15 +CPU= 38.561
  14:47:02 STEP 1142 H= 285:30 +CPU= 39.096
  14:47:43 STEP 1143 H= 285:45 +CPU= 40.915
  14:48:24 STEP 1144 H= 286:00 +CPU= 40.652
  14:49:03 STEP 1145 H= 286:15 +CPU= 39.774
  14:49:42 STEP 1146 H= 286:30 +CPU= 38.520
  14:50:22 STEP 1147 H= 286:45 +CPU= 39.102
  14:51:01 STEP 1148 H= 287:00 +CPU= 39.755
  14:51:44 STEP 1149 H= 287:15 +CPU= 41.768
  14:52:24 STEP 1150 H= 287:30 +CPU= 40.437
  14:53:03 STEP 1151 H= 287:45 +CPU= 38.643
  14:53:56 STEP 1152 H= 288:00 +CPU= 52.698
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1_r1412098885_11.zip
Uploading the intermediate file: upload_file_11.zip
  14:54:34 STEP 1153 H= 288:15 +CPU= 38.187
  14:55:12 STEP 1154 H= 288:30 +CPU= 37.681
  14:55:49 STEP 1155 H= 288:45 +CPU= 36.820
  14:56:27 STEP 1156 H= 289:00 +CPU= 37.972
  14:57:07 STEP 1157 H= 289:15 +CPU= 40.646
  14:57:47 STEP 1158 H= 289:30 +CPU= 39.481
  14:58:25 STEP 1159 H= 289:45 +CPU= 38.147
  14:59:05 STEP 1160 H= 290:00 +CPU= 39.569
  14:59:43 STEP 1161 H= 290:15 +CPU= 38.259
  15:00:24 STEP 1162 H= 290:30 +CPU= 40.771
  15:01:04 STEP 1163 H= 290:45 +CPU= 40.401
  15:01:53 STEP 1164 H= 291:00 +CPU= 48.410
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001164
  15:02:30 STEP 1165 H= 291:15 +CPU= 37.479
  15:03:09 STEP 1166 H= 291:30 +CPU= 38.283
  15:03:47 STEP 1167 H= 291:45 +CPU= 38.255
  15:04:26 STEP 1168 H= 292:00 +CPU= 39.399
  15:05:05 STEP 1169 H= 292:15 +CPU= 38.398
  15:05:44 STEP 1170 H= 292:30 +CPU= 38.602
  15:06:23 STEP 1171 H= 292:45 +CPU= 38.477
  15:07:03 STEP 1172 H= 293:00 +CPU= 40.068
  15:07:41 STEP 1173 H= 293:15 +CPU= 37.839
  15:08:19 STEP 1174 H= 293:30 +CPU= 38.515
  15:09:01 STEP 1175 H= 293:45 +CPU= 41.771
  15:09:52 STEP 1176 H= 294:00 +CPU= 50.344
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001176
  15:10:31 STEP 1177 H= 294:15 +CPU= 38.769
  15:11:08 STEP 1178 H= 294:30 +CPU= 37.774
  15:11:46 STEP 1179 H= 294:45 +CPU= 37.582
  15:12:24 STEP 1180 H= 295:00 +CPU= 38.322
  15:13:00 STEP 1181 H= 295:15 +CPU= 35.826
  15:13:38 STEP 1182 H= 295:30 +CPU= 37.181
  15:14:16 STEP 1183 H= 295:45 +CPU= 38.415
  15:14:57 STEP 1184 H= 296:00 +CPU= 41.121
  15:15:36 STEP 1185 H= 296:15 +CPU= 39.009
  15:16:14 STEP 1186 H= 296:30 +CPU= 37.636
  15:16:52 STEP 1187 H= 296:45 +CPU= 37.721
  15:17:39 STEP 1188 H= 297:00 +CPU= 47.672
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001188
  15:18:18 STEP 1189 H= 297:15 +CPU= 38.354
  15:18:59 STEP 1190 H= 297:30 +CPU= 41.511
  15:19:38 STEP 1191 H= 297:45 +CPU= 38.187
  15:20:17 STEP 1192 H= 298:00 +CPU= 39.234
  15:20:57 STEP 1193 H= 298:15 +CPU= 38.948
  15:21:37 STEP 1194 H= 298:30 +CPU= 39.444
  15:22:15 STEP 1195 H= 298:45 +CPU= 38.389
  15:22:54 STEP 1196 H= 299:00 +CPU= 38.260
  15:23:32 STEP 1197 H= 299:15 +CPU= 38.227
  15:24:11 STEP 1198 H= 299:30 +CPU= 38.633
  15:24:50 STEP 1199 H= 299:45 +CPU= 39.193
  15:25:43 STEP 1200 H= 300:00 +CPU= 52.165
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001200
  15:26:21 STEP 1201 H= 300:15 +CPU= 38.727
  15:27:00 STEP 1202 H= 300:30 +CPU= 38.668
  15:27:39 STEP 1203 H= 300:45 +CPU= 38.498
  15:28:18 STEP 1204 H= 301:00 +CPU= 39.066
  15:28:57 STEP 1205 H= 301:15 +CPU= 38.815
  15:29:36 STEP 1206 H= 301:30 +CPU= 39.389
  15:30:14 STEP 1207 H= 301:45 +CPU= 38.089
  15:30:53 STEP 1208 H= 302:00 +CPU= 38.939
  15:31:31 STEP 1209 H= 302:15 +CPU= 37.643
  15:32:08 STEP 1210 H= 302:30 +CPU= 37.421
  15:32:49 STEP 1211 H= 302:45 +CPU= 39.989
  15:33:36 STEP 1212 H= 303:00 +CPU= 47.133
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001212
  15:34:16 STEP 1213 H= 303:15 +CPU= 40.005
  15:34:54 STEP 1214 H= 303:30 +CPU= 38.253
  15:35:34 STEP 1215 H= 303:45 +CPU= 38.942
  15:36:13 STEP 1216 H= 304:00 +CPU= 39.390
  15:36:51 STEP 1217 H= 304:15 +CPU= 37.142
  15:37:30 STEP 1218 H= 304:30 +CPU= 39.051
  15:38:08 STEP 1219 H= 304:45 +CPU= 37.906
  15:38:47 STEP 1220 H= 305:00 +CPU= 39.375
  15:39:25 STEP 1221 H= 305:15 +CPU= 37.859
  15:40:04 STEP 1222 H= 305:30 +CPU= 38.564
  15:40:45 STEP 1223 H= 305:45 +CPU= 41.560
  15:41:33 STEP 1224 H= 306:00 +CPU= 47.830
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001224
  15:42:12 STEP 1225 H= 306:15 +CPU= 38.150
  15:42:49 STEP 1226 H= 306:30 +CPU= 37.596
  15:43:27 STEP 1227 H= 306:45 +CPU= 37.417
  15:44:06 STEP 1228 H= 307:00 +CPU= 38.408
  15:44:45 STEP 1229 H= 307:15 +CPU= 38.817
  15:45:23 STEP 1230 H= 307:30 +CPU= 37.929
  15:46:02 STEP 1231 H= 307:45 +CPU= 38.381
  15:46:43 STEP 1232 H= 308:00 +CPU= 41.166
  15:47:21 STEP 1233 H= 308:15 +CPU= 37.970
  15:47:59 STEP 1234 H= 308:30 +CPU= 37.864
  15:48:38 STEP 1235 H= 308:45 +CPU= 39.459
  15:49:29 STEP 1236 H= 309:00 +CPU= 51.135
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001236
  15:50:10 STEP 1237 H= 309:15 +CPU= 40.470
  15:50:49 STEP 1238 H= 309:30 +CPU= 38.365
  15:51:29 STEP 1239 H= 309:45 +CPU= 39.753
  15:52:09 STEP 1240 H= 310:00 +CPU= 40.195
  15:52:49 STEP 1241 H= 310:15 +CPU= 39.289
  15:53:26 STEP 1242 H= 310:30 +CPU= 37.865
  15:54:05 STEP 1243 H= 310:45 +CPU= 38.236
  15:54:44 STEP 1244 H= 311:00 +CPU= 38.682
  15:55:25 STEP 1245 H= 311:15 +CPU= 40.826
  15:56:06 STEP 1246 H= 311:30 +CPU= 41.132
  15:56:47 STEP 1247 H= 311:45 +CPU= 40.971
  15:57:39 STEP 1248 H= 312:00 +CPU= 51.912
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1_r1412098885_12.zip
Uploading the intermediate file: upload_file_12.zip
  15:58:20 STEP 1249 H= 312:15 +CPU= 40.784
  15:58:59 STEP 1250 H= 312:30 +CPU= 38.207
  15:59:38 STEP 1251 H= 312:45 +CPU= 39.215
  16:00:17 STEP 1252 H= 313:00 +CPU= 39.183
  16:00:58 STEP 1253 H= 313:15 +CPU= 40.683
  16:01:36 STEP 1254 H= 313:30 +CPU= 37.763
  16:02:14 STEP 1255 H= 313:45 +CPU= 38.543
  16:02:53 STEP 1256 H= 314:00 +CPU= 38.329
  16:03:33 STEP 1257 H= 314:15 +CPU= 39.951
  16:04:11 STEP 1258 H= 314:30 +CPU= 38.235
  16:04:52 STEP 1259 H= 314:45 +CPU= 40.290
  16:05:41 STEP 1260 H= 315:00 +CPU= 49.220
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001260
  16:06:21 STEP 1261 H= 315:15 +CPU= 39.459
  16:07:01 STEP 1262 H= 315:30 +CPU= 40.231
  16:07:40 STEP 1263 H= 315:45 +CPU= 38.075
  16:08:19 STEP 1264 H= 316:00 +CPU= 38.974
  16:08:58 STEP 1265 H= 316:15 +CPU= 39.289
  16:09:36 STEP 1266 H= 316:30 +CPU= 37.337
  16:10:13 STEP 1267 H= 316:45 +CPU= 37.250
  16:10:51 STEP 1268 H= 317:00 +CPU= 38.093
  16:11:27 STEP 1269 H= 317:15 +CPU= 35.927
  16:12:05 STEP 1270 H= 317:30 +CPU= 38.009
  16:12:43 STEP 1271 H= 317:45 +CPU= 37.525
  16:13:30 STEP 1272 H= 318:00 +CPU= 47.426
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001272
  16:14:09 STEP 1273 H= 318:15 +CPU= 39.212
  16:14:47 STEP 1274 H= 318:30 +CPU= 37.130
  16:15:26 STEP 1275 H= 318:45 +CPU= 39.253
  16:16:04 STEP 1276 H= 319:00 +CPU= 38.083
  16:16:41 STEP 1277 H= 319:15 +CPU= 36.819
  16:17:17 STEP 1278 H= 319:30 +CPU= 36.380
  16:17:54 STEP 1279 H= 319:45 +CPU= 36.791
  16:18:32 STEP 1280 H= 320:00 +CPU= 38.024
  16:19:10 STEP 1281 H= 320:15 +CPU= 37.119
  16:19:47 STEP 1282 H= 320:30 +CPU= 37.739
  16:20:26 STEP 1283 H= 320:45 +CPU= 38.542
  16:21:14 STEP 1284 H= 321:00 +CPU= 47.871
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001284
  16:21:51 STEP 1285 H= 321:15 +CPU= 36.938
  16:22:28 STEP 1286 H= 321:30 +CPU= 36.302
  16:23:06 STEP 1287 H= 321:45 +CPU= 38.029
  16:23:44 STEP 1288 H= 322:00 +CPU= 38.154
  16:24:21 STEP 1289 H= 322:15 +CPU= 37.214
  16:24:59 STEP 1290 H= 322:30 +CPU= 37.203
  16:25:35 STEP 1291 H= 322:45 +CPU= 36.772
  16:26:11 STEP 1292 H= 323:00 +CPU= 36.036
  16:26:49 STEP 1293 H= 323:15 +CPU= 37.920
  16:27:26 STEP 1294 H= 323:30 +CPU= 36.975
  16:28:03 STEP 1295 H= 323:45 +CPU= 37.003
  16:28:54 STEP 1296 H= 324:00 +CPU= 50.128
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001296
  16:29:31 STEP 1297 H= 324:15 +CPU= 37.313
  16:30:08 STEP 1298 H= 324:30 +CPU= 37.312
  16:30:48 STEP 1299 H= 324:45 +CPU= 39.942
  16:31:29 STEP 1300 H= 325:00 +CPU= 40.146
  16:32:06 STEP 1301 H= 325:15 +CPU= 37.779
  16:32:45 STEP 1302 H= 325:30 +CPU= 38.359
  16:33:23 STEP 1303 H= 325:45 +CPU= 37.878
  16:34:01 STEP 1304 H= 326:00 +CPU= 37.800
  16:34:38 STEP 1305 H= 326:15 +CPU= 37.088
  16:35:16 STEP 1306 H= 326:30 +CPU= 37.463
  16:35:55 STEP 1307 H= 326:45 +CPU= 38.473
  16:36:41 STEP 1308 H= 327:00 +CPU= 46.661
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001308
  16:37:19 STEP 1309 H= 327:15 +CPU= 37.052
  16:37:56 STEP 1310 H= 327:30 +CPU= 37.219
  16:38:33 STEP 1311 H= 327:45 +CPU= 37.228
  16:39:12 STEP 1312 H= 328:00 +CPU= 38.807
  16:39:49 STEP 1313 H= 328:15 +CPU= 36.752
  16:40:26 STEP 1314 H= 328:30 +CPU= 37.270
  16:41:04 STEP 1315 H= 328:45 +CPU= 37.169
  16:41:42 STEP 1316 H= 329:00 +CPU= 38.227
  16:42:19 STEP 1317 H= 329:15 +CPU= 37.137
  16:42:56 STEP 1318 H= 329:30 +CPU= 37.098
  16:43:35 STEP 1319 H= 329:45 +CPU= 38.286
  16:44:21 STEP 1320 H= 330:00 +CPU= 46.234
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001320
  16:44:58 STEP 1321 H= 330:15 +CPU= 36.840
  16:45:35 STEP 1322 H= 330:30 +CPU= 36.664
  16:46:11 STEP 1323 H= 330:45 +CPU= 36.638
  16:46:50 STEP 1324 H= 331:00 +CPU= 37.633
  16:47:27 STEP 1325 H= 331:15 +CPU= 36.984
  16:48:04 STEP 1326 H= 331:30 +CPU= 37.631
  16:48:44 STEP 1327 H= 331:45 +CPU= 39.667
  16:49:25 STEP 1328 H= 332:00 +CPU= 40.994
  16:50:02 STEP 1329 H= 332:15 +CPU= 37.095
  16:50:42 STEP 1330 H= 332:30 +CPU= 39.158
  16:51:22 STEP 1331 H= 332:45 +CPU= 40.153
  16:52:10 STEP 1332 H= 333:00 +CPU= 47.779
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001332
  16:52:48 STEP 1333 H= 333:15 +CPU= 37.238
  16:53:25 STEP 1334 H= 333:30 +CPU= 37.821
  16:54:03 STEP 1335 H= 333:45 +CPU= 37.382
  16:54:41 STEP 1336 H= 334:00 +CPU= 38.045
  16:55:18 STEP 1337 H= 334:15 +CPU= 37.483
  16:55:56 STEP 1338 H= 334:30 +CPU= 37.419
  16:56:33 STEP 1339 H= 334:45 +CPU= 36.815
  16:57:11 STEP 1340 H= 335:00 +CPU= 38.216
  16:57:49 STEP 1341 H= 335:15 +CPU= 37.124
  16:58:26 STEP 1342 H= 335:30 +CPU= 37.228
  16:59:03 STEP 1343 H= 335:45 +CPU= 36.953
  16:59:58 STEP 1344 H= 336:00 +CPU= 54.700
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1_r1412098885_13.zip
Uploading the intermediate file: upload_file_13.zip
  17:00:38 STEP 1345 H= 336:15 +CPU= 39.332
  17:01:18 STEP 1346 H= 336:30 +CPU= 39.809
  17:01:55 STEP 1347 H= 336:45 +CPU= 37.289
  17:02:33 STEP 1348 H= 337:00 +CPU= 38.037
  17:03:11 STEP 1349 H= 337:15 +CPU= 37.230
  17:03:48 STEP 1350 H= 337:30 +CPU= 37.119
  17:04:26 STEP 1351 H= 337:45 +CPU= 38.089
  17:05:04 STEP 1352 H= 338:00 +CPU= 37.826
  17:05:41 STEP 1353 H= 338:15 +CPU= 37.149
  17:06:19 STEP 1354 H= 338:30 +CPU= 37.082
  17:06:56 STEP 1355 H= 338:45 +CPU= 37.551
  17:07:46 STEP 1356 H= 339:00 +CPU= 49.730
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001356
  17:08:24 STEP 1357 H= 339:15 +CPU= 37.974
  17:09:01 STEP 1358 H= 339:30 +CPU= 37.255
  17:09:39 STEP 1359 H= 339:45 +CPU= 37.620
  17:10:19 STEP 1360 H= 340:00 +CPU= 40.251
  17:11:00 STEP 1361 H= 340:15 +CPU= 40.510
  17:11:37 STEP 1362 H= 340:30 +CPU= 37.135
  17:12:16 STEP 1363 H= 340:45 +CPU= 38.408
  17:12:53 STEP 1364 H= 341:00 +CPU= 37.686
  17:13:30 STEP 1365 H= 341:15 +CPU= 36.590
  17:14:07 STEP 1366 H= 341:30 +CPU= 36.787
  17:14:44 STEP 1367 H= 341:45 +CPU= 37.086
  17:15:31 STEP 1368 H= 342:00 +CPU= 47.513
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001368
  17:16:09 STEP 1369 H= 342:15 +CPU= 37.101
  17:16:45 STEP 1370 H= 342:30 +CPU= 36.796
  17:17:23 STEP 1371 H= 342:45 +CPU= 37.494
  17:18:01 STEP 1372 H= 343:00 +CPU= 38.414
  17:18:40 STEP 1373 H= 343:15 +CPU= 37.992
  17:19:17 STEP 1374 H= 343:30 +CPU= 37.244
  17:19:57 STEP 1375 H= 343:45 +CPU= 39.910
  17:20:37 STEP 1376 H= 344:00 +CPU= 39.963
  17:21:16 STEP 1377 H= 344:15 +CPU= 38.281
  17:21:53 STEP 1378 H= 344:30 +CPU= 37.167
  17:22:30 STEP 1379 H= 344:45 +CPU= 36.659
  17:23:19 STEP 1380 H= 345:00 +CPU= 49.102
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001380
  17:23:58 STEP 1381 H= 345:15 +CPU= 38.504
  17:24:34 STEP 1382 H= 345:30 +CPU= 36.843
  17:25:11 STEP 1383 H= 345:45 +CPU= 36.559
  17:25:49 STEP 1384 H= 346:00 +CPU= 37.832
  17:26:26 STEP 1385 H= 346:15 +CPU= 37.433
  17:27:04 STEP 1386 H= 346:30 +CPU= 37.345
  17:27:43 STEP 1387 H= 346:45 +CPU= 38.932
  17:28:20 STEP 1388 H= 347:00 +CPU= 37.365
  17:28:58 STEP 1389 H= 347:15 +CPU= 38.296
  17:29:36 STEP 1390 H= 347:30 +CPU= 38.003
  17:30:14 STEP 1391 H= 347:45 +CPU= 37.014
  17:31:04 STEP 1392 H= 348:00 +CPU= 50.410
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001392
  17:31:42 STEP 1393 H= 348:15 +CPU= 37.311
  17:32:19 STEP 1394 H= 348:30 +CPU= 37.471
  17:32:56 STEP 1395 H= 348:45 +CPU= 36.618
  17:33:35 STEP 1396 H= 349:00 +CPU= 38.426
  17:34:12 STEP 1397 H= 349:15 +CPU= 37.101
  17:34:48 STEP 1398 H= 349:30 +CPU= 36.244
  17:35:25 STEP 1399 H= 349:45 +CPU= 36.201
  17:36:03 STEP 1400 H= 350:00 +CPU= 38.011
  17:36:42 STEP 1401 H= 350:15 +CPU= 38.509
  17:37:19 STEP 1402 H= 350:30 +CPU= 37.482
  17:37:56 STEP 1403 H= 350:45 +CPU= 36.642
  17:38:43 STEP 1404 H= 351:00 +CPU= 46.789
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001404
  17:39:19 STEP 1405 H= 351:15 +CPU= 36.396
  17:39:55 STEP 1406 H= 351:30 +CPU= 36.413
  17:40:31 STEP 1407 H= 351:45 +CPU= 35.754
  17:41:09 STEP 1408 H= 352:00 +CPU= 37.182
  17:41:45 STEP 1409 H= 352:15 +CPU= 36.472
  17:42:22 STEP 1410 H= 352:30 +CPU= 36.459
  17:43:01 STEP 1411 H= 352:45 +CPU= 39.617
  17:43:42 STEP 1412 H= 353:00 +CPU= 40.400
  17:44:19 STEP 1413 H= 353:15 +CPU= 37.574
  17:44:56 STEP 1414 H= 353:30 +CPU= 36.317
  17:45:34 STEP 1415 H= 353:45 +CPU= 38.676
  17:46:21 STEP 1416 H= 354:00 +CPU= 46.799
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001416
  17:47:00 STEP 1417 H= 354:15 +CPU= 39.180
  17:47:37 STEP 1418 H= 354:30 +CPU= 36.846
  17:48:15 STEP 1419 H= 354:45 +CPU= 36.626
  17:48:55 STEP 1420 H= 355:00 +CPU= 40.010
  17:49:32 STEP 1421 H= 355:15 +CPU= 36.860
  17:50:09 STEP 1422 H= 355:30 +CPU= 36.740
  17:50:46 STEP 1423 H= 355:45 +CPU= 36.908
  17:51:25 STEP 1424 H= 356:00 +CPU= 38.101
  17:52:01 STEP 1425 H= 356:15 +CPU= 36.422
  17:52:38 STEP 1426 H= 356:30 +CPU= 36.342
  17:53:14 STEP 1427 H= 356:45 +CPU= 36.547
  17:54:00 STEP 1428 H= 357:00 +CPU= 45.966
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001428
  17:54:37 STEP 1429 H= 357:15 +CPU= 36.523
  17:55:13 STEP 1430 H= 357:30 +CPU= 36.594
  17:55:51 STEP 1431 H= 357:45 +CPU= 37.611
  17:56:30 STEP 1432 H= 358:00 +CPU= 39.001
  17:57:07 STEP 1433 H= 358:15 +CPU= 36.975
  17:57:45 STEP 1434 H= 358:30 +CPU= 37.613
  17:58:21 STEP 1435 H= 358:45 +CPU= 36.351
  17:58:59 STEP 1436 H= 359:00 +CPU= 37.359
  17:59:36 STEP 1437 H= 359:15 +CPU= 36.581
  18:00:15 STEP 1438 H= 359:30 +CPU= 38.600
  18:00:52 STEP 1439 H= 359:45 +CPU= 36.337
  18:01:41 STEP 1440 H= 360:00 +CPU= 48.858
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.2205155189E-20      I       0.8433864129E-06      I
ICloud fractionI      0.0000000000E+00      I       0.2958884064E-01      I
I  Relat. Hum. I      0.2657314467E+00      I       0.3203242091E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2234433549E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    324812244 BYTES IN      7 RECORDS TRANSFERRED IN    0.0007 SECONDS464017.5 Mbytes/s, TOTAL TIME=    0.0152( 4.6%)
 18:01:41 STEP 1440 H= 360:00 +CPU= 48.858
 END CNT3
 NSTEP =  1440 CNT0   000000000  36.310  36.310  36.337   0.999               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************   106.0     0.0   106.0     0.0   222.5
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    6271.3    6271.3     16.10      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1133.3    1133.3      2.68      0.00
  10 SCAN2M - PHYSICS                             1441   20275.0   20275.0     48.02      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1194.9    1194.9      0.24      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      57.3      57.3      0.01      0.00
  14 SUINIF                                          1   11433.6   11433.6      0.02      0.00
  17 GRIDFPOS IN CNT4                              121      49.9      49.9      0.01      0.00
  18 SUSPECG                                         1    6118.2    6118.2      0.01      0.00
  19 SUSPEC                                          1    6127.7    6127.7      0.01      0.00
  24 SUGRIDU                                         1    4444.4    4444.4      0.01      0.00
  25 SPECRT                                          1     671.7     671.7      0.00      0.00
  26 SUGRIDF                                         1     189.8     189.8      0.00      0.00
  27 RESTART FILES - WRITING                        30    4819.6    4819.6      0.24      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    9107.0    9107.0      1.81      0.00
  31 POSDDH IN STEPO                                 7      62.4      62.4      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    8557.1    8557.1     20.27      0.00
  39 SU0YOMB                                         1     538.1     538.1      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      40.1      40.1      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     496.0     496.0      1.17      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      89.3      89.3      0.21      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     794.4     794.4      4.08      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     414.1     414.1      2.05      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     148.0     148.0      0.73      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     219.5     219.5      1.13      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      64.7      64.7      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      73.4      73.4      0.38      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      36.4      36.4      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     147.5     147.5      0.76      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      70.8      70.8      0.35      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    60843.3 CPU TIME   60532.0 VECTOR TIME    60532.0


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       21.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/5/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/5/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/5/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12286090/ICMGGh7zg+001344
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1_r1412098885_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
18:05:13 (1436773): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1_r1412098885_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1_r1412098885_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1_r1412098885_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1_r1412098885_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1_r1412098885_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 18:03:01 1538905 22440034 oifs_43r3_bl_a3af_2016092300_20_1017_12286090_1 864,000 41,307 0.0478


©2024 climateprediction.net