climateprediction.net home page
Task 22310072

Task 22310072

Name oifs_43r3_bl_a2dn_2016092300_15_991_12209870_0
Workunit 12209870
Created 13 Feb 2023, 17:41:02 UTC
Sent 14 Feb 2023, 7:47:06 UTC
Report deadline 15 Apr 2023, 7:47:06 UTC
Received 15 Feb 2023, 0:00:15 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 9 (0x00000009) Unknown error code
Computer ID 1537295
Run time 11 hours 20 min 19 sec
CPU time 11 hours 13 min 28 sec
Validate state Invalid
Credit 1,813.14
Device peak FLOPS 5.16 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,076.07 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,361.84 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 9 (0x9, -247)</message>
<stderr_txt>
  18:25:11 STEP  861 H= 215:15 +CPU= 26.966
  18:25:39 STEP  862 H= 215:30 +CPU= 27.610
  18:26:06 STEP  863 H= 215:45 +CPU= 26.879
  18:26:55 STEP  864 H= 216:00 +CPU= 37.337
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2dn_2016092300_15_991_12209870_0_r1706318508_8.zip
Uploading the intermediate file: upload_file_8.zip
  18:27:23 STEP  865 H= 216:15 +CPU= 27.427
  18:27:51 STEP  866 H= 216:30 +CPU= 27.315
  18:28:18 STEP  867 H= 216:45 +CPU= 27.510
  18:28:46 STEP  868 H= 217:00 +CPU= 27.745
  18:29:13 STEP  869 H= 217:15 +CPU= 27.059
  18:29:41 STEP  870 H= 217:30 +CPU= 27.400
  18:30:09 STEP  871 H= 217:45 +CPU= 28.232
  18:30:37 STEP  872 H= 218:00 +CPU= 27.412
  18:31:03 STEP  873 H= 218:15 +CPU= 26.208
  18:31:30 STEP  874 H= 218:30 +CPU= 26.577
  18:31:57 STEP  875 H= 218:45 +CPU= 27.107
  18:32:31 STEP  876 H= 219:00 +CPU= 34.511
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000876
  18:32:59 STEP  877 H= 219:15 +CPU= 27.525
  18:33:26 STEP  878 H= 219:30 +CPU= 27.260
  18:33:54 STEP  879 H= 219:45 +CPU= 27.235
  18:34:21 STEP  880 H= 220:00 +CPU= 27.128
  18:34:49 STEP  881 H= 220:15 +CPU= 27.611
  18:35:16 STEP  882 H= 220:30 +CPU= 26.845
  18:35:43 STEP  883 H= 220:45 +CPU= 27.247
  18:36:11 STEP  884 H= 221:00 +CPU= 27.873
  18:36:38 STEP  885 H= 221:15 +CPU= 27.369
  18:37:06 STEP  886 H= 221:30 +CPU= 28.072
  18:37:34 STEP  887 H= 221:45 +CPU= 27.662
  18:38:08 STEP  888 H= 222:00 +CPU= 33.895
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000888
  18:38:36 STEP  889 H= 222:15 +CPU= 27.134
  18:39:03 STEP  890 H= 222:30 +CPU= 26.974
  18:39:30 STEP  891 H= 222:45 +CPU= 27.581
  18:39:58 STEP  892 H= 223:00 +CPU= 27.887
  18:40:27 STEP  893 H= 223:15 +CPU= 28.189
  18:40:54 STEP  894 H= 223:30 +CPU= 27.478
  18:41:22 STEP  895 H= 223:45 +CPU= 27.730
  18:41:50 STEP  896 H= 224:00 +CPU= 27.698
  18:42:17 STEP  897 H= 224:15 +CPU= 27.501
  18:42:45 STEP  898 H= 224:30 +CPU= 27.547
  18:43:13 STEP  899 H= 224:45 +CPU= 27.665
  18:43:47 STEP  900 H= 225:00 +CPU= 33.493
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000900
  18:44:14 STEP  901 H= 225:15 +CPU= 27.743
  18:44:42 STEP  902 H= 225:30 +CPU= 27.374
  18:45:09 STEP  903 H= 225:45 +CPU= 27.173
  18:45:37 STEP  904 H= 226:00 +CPU= 27.658
  18:46:04 STEP  905 H= 226:15 +CPU= 26.673
  18:46:31 STEP  906 H= 226:30 +CPU= 27.536
  18:46:59 STEP  907 H= 226:45 +CPU= 27.320
  18:47:25 STEP  908 H= 227:00 +CPU= 25.602
  18:47:52 STEP  909 H= 227:15 +CPU= 27.369
  18:48:18 STEP  910 H= 227:30 +CPU= 25.950
  18:48:45 STEP  911 H= 227:45 +CPU= 26.446
  18:49:20 STEP  912 H= 228:00 +CPU= 34.937
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000912
  18:49:48 STEP  913 H= 228:15 +CPU= 27.475
  18:50:15 STEP  914 H= 228:30 +CPU= 27.193
  18:50:43 STEP  915 H= 228:45 +CPU= 27.593
  18:51:10 STEP  916 H= 229:00 +CPU= 27.433
  18:51:38 STEP  917 H= 229:15 +CPU= 27.644
  18:52:06 STEP  918 H= 229:30 +CPU= 27.467
  18:52:33 STEP  919 H= 229:45 +CPU= 26.907
  18:53:01 STEP  920 H= 230:00 +CPU= 28.127
  18:53:28 STEP  921 H= 230:15 +CPU= 26.904
  18:53:56 STEP  922 H= 230:30 +CPU= 27.739
  18:54:24 STEP  923 H= 230:45 +CPU= 28.292
  18:54:58 STEP  924 H= 231:00 +CPU= 33.698
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000924
  18:55:26 STEP  925 H= 231:15 +CPU= 27.733
  18:55:55 STEP  926 H= 231:30 +CPU= 28.518
  18:56:22 STEP  927 H= 231:45 +CPU= 27.736
  18:56:50 STEP  928 H= 232:00 +CPU= 27.898
  18:57:18 STEP  929 H= 232:15 +CPU= 27.080
  18:57:45 STEP  930 H= 232:30 +CPU= 26.997
  18:58:12 STEP  931 H= 232:45 +CPU= 27.415
  18:58:41 STEP  932 H= 233:00 +CPU= 28.309
  18:59:08 STEP  933 H= 233:15 +CPU= 27.465
  18:59:36 STEP  934 H= 233:30 +CPU= 27.301
  19:00:03 STEP  935 H= 233:45 +CPU= 26.868
  19:00:37 STEP  936 H= 234:00 +CPU= 34.233
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000936
  19:01:04 STEP  937 H= 234:15 +CPU= 27.079
  19:01:32 STEP  938 H= 234:30 +CPU= 28.126
  19:02:00 STEP  939 H= 234:45 +CPU= 27.055
  19:02:27 STEP  940 H= 235:00 +CPU= 27.678
  19:02:55 STEP  941 H= 235:15 +CPU= 27.125
  19:03:22 STEP  942 H= 235:30 +CPU= 27.200
  19:03:49 STEP  943 H= 235:45 +CPU= 27.103
  19:04:18 STEP  944 H= 236:00 +CPU= 28.528
  19:04:45 STEP  945 H= 236:15 +CPU= 27.571
  19:05:13 STEP  946 H= 236:30 +CPU= 27.155
  19:05:39 STEP  947 H= 236:45 +CPU= 26.468
  19:06:13 STEP  948 H= 237:00 +CPU= 33.662
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000948
  19:06:40 STEP  949 H= 237:15 +CPU= 27.278
  19:07:08 STEP  950 H= 237:30 +CPU= 27.993
  19:07:36 STEP  951 H= 237:45 +CPU= 27.717
  19:08:05 STEP  952 H= 238:00 +CPU= 28.198
  19:08:31 STEP  953 H= 238:15 +CPU= 26.843
  19:08:59 STEP  954 H= 238:30 +CPU= 27.268
  19:09:26 STEP  955 H= 238:45 +CPU= 27.190
  19:09:54 STEP  956 H= 239:00 +CPU= 27.913
  19:10:22 STEP  957 H= 239:15 +CPU= 27.339
  19:10:49 STEP  958 H= 239:30 +CPU= 27.104
  19:11:16 STEP  959 H= 239:45 +CPU= 27.368
  19:11:55 STEP  960 H= 240:00 +CPU= 38.641
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2dn_2016092300_15_991_12209870_0_r1706318508_9.zip
  19:12:23 STEP  961 H= 240:15 +CPU= 26.896
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 864000
  19:12:51 STEP  962 H= 240:30 +CPU= 27.742
  19:13:18 STEP  963 H= 240:45 +CPU= 27.213
  19:13:46 STEP  964 H= 241:00 +CPU= 27.544
  19:14:14 STEP  965 H= 241:15 +CPU= 27.453
  19:14:42 STEP  966 H= 241:30 +CPU= 27.897
  19:15:09 STEP  967 H= 241:45 +CPU= 27.042
  19:15:37 STEP  968 H= 242:00 +CPU= 28.213
  19:16:05 STEP  969 H= 242:15 +CPU= 27.572
  19:16:32 STEP  970 H= 242:30 +CPU= 26.972
  19:16:59 STEP  971 H= 242:45 +CPU= 27.415
  19:17:33 STEP  972 H= 243:00 +CPU= 33.615
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000972
  19:18:00 STEP  973 H= 243:15 +CPU= 27.111
  19:18:28 STEP  974 H= 243:30 +CPU= 27.532
  19:18:55 STEP  975 H= 243:45 +CPU= 27.095
  19:19:23 STEP  976 H= 244:00 +CPU= 28.121
  19:19:51 STEP  977 H= 244:15 +CPU= 27.343
  19:20:18 STEP  978 H= 244:30 +CPU= 27.097
  19:20:46 STEP  979 H= 244:45 +CPU= 27.871
  19:21:14 STEP  980 H= 245:00 +CPU= 27.395
  19:21:39 STEP  981 H= 245:15 +CPU= 25.468
  19:22:06 STEP  982 H= 245:30 +CPU= 26.796
  19:22:33 STEP  983 H= 245:45 +CPU= 27.027
  19:23:06 STEP  984 H= 246:00 +CPU= 32.471
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000984
  19:23:33 STEP  985 H= 246:15 +CPU= 27.250
  19:24:00 STEP  986 H= 246:30 +CPU= 26.882
  19:24:27 STEP  987 H= 246:45 +CPU= 27.102
  19:24:55 STEP  988 H= 247:00 +CPU= 27.664
  19:25:23 STEP  989 H= 247:15 +CPU= 27.744
  19:25:51 STEP  990 H= 247:30 +CPU= 27.789
  19:26:19 STEP  991 H= 247:45 +CPU= 27.728
  19:26:47 STEP  992 H= 248:00 +CPU= 28.110
  19:27:14 STEP  993 H= 248:15 +CPU= 27.644
  19:27:42 STEP  994 H= 248:30 +CPU= 27.489
  19:28:10 STEP  995 H= 248:45 +CPU= 27.665
  19:28:44 STEP  996 H= 249:00 +CPU= 34.221
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000996
  19:29:11 STEP  997 H= 249:15 +CPU= 26.589
  19:29:38 STEP  998 H= 249:30 +CPU= 27.340
  19:30:06 STEP  999 H= 249:45 +CPU= 27.730
  19:30:34 STEP 1000 H= 250:00 +CPU= 27.526
  19:31:01 STEP 1001 H= 250:15 +CPU= 26.769
  19:31:29 STEP 1002 H= 250:30 +CPU= 27.969
  19:31:57 STEP 1003 H= 250:45 +CPU= 27.693
  19:32:24 STEP 1004 H= 251:00 +CPU= 27.383
  19:32:51 STEP 1005 H= 251:15 +CPU= 27.327
  19:33:20 STEP 1006 H= 251:30 +CPU= 27.998
  19:33:47 STEP 1007 H= 251:45 +CPU= 26.814
  19:34:24 STEP 1008 H= 252:00 +CPU= 37.783
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001008
  19:34:52 STEP 1009 H= 252:15 +CPU= 27.050
  19:35:19 STEP 1010 H= 252:30 +CPU= 27.112
  19:35:47 STEP 1011 H= 252:45 +CPU= 27.592
  19:36:15 STEP 1012 H= 253:00 +CPU= 28.042
  19:36:43 STEP 1013 H= 253:15 +CPU= 27.649
  19:37:11 STEP 1014 H= 253:30 +CPU= 27.938
  19:37:38 STEP 1015 H= 253:45 +CPU= 26.995
  19:38:07 STEP 1016 H= 254:00 +CPU= 28.630
  19:38:34 STEP 1017 H= 254:15 +CPU= 27.535
  19:39:02 STEP 1018 H= 254:30 +CPU= 27.369
  19:39:29 STEP 1019 H= 254:45 +CPU= 27.480
  19:40:03 STEP 1020 H= 255:00 +CPU= 33.209
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001020
  19:40:30 STEP 1021 H= 255:15 +CPU= 27.405
  19:40:57 STEP 1022 H= 255:30 +CPU= 26.559
  19:41:25 STEP 1023 H= 255:45 +CPU= 27.638
  19:41:53 STEP 1024 H= 256:00 +CPU= 27.925
  19:42:20 STEP 1025 H= 256:15 +CPU= 27.182
  19:42:47 STEP 1026 H= 256:30 +CPU= 27.196
  19:43:15 STEP 1027 H= 256:45 +CPU= 27.629
  19:43:42 STEP 1028 H= 257:00 +CPU= 27.425
  19:44:10 STEP 1029 H= 257:15 +CPU= 27.070
  19:44:37 STEP 1030 H= 257:30 +CPU= 27.480
  19:45:04 STEP 1031 H= 257:45 +CPU= 26.981
  19:45:38 STEP 1032 H= 258:00 +CPU= 33.944
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001032
  19:46:05 STEP 1033 H= 258:15 +CPU= 26.995
  19:46:33 STEP 1034 H= 258:30 +CPU= 27.834
  19:47:01 STEP 1035 H= 258:45 +CPU= 27.603
  19:47:29 STEP 1036 H= 259:00 +CPU= 27.920
  19:47:57 STEP 1037 H= 259:15 +CPU= 27.325
  19:48:24 STEP 1038 H= 259:30 +CPU= 26.789
  19:48:51 STEP 1039 H= 259:45 +CPU= 27.050
  19:49:20 STEP 1040 H= 260:00 +CPU= 28.244
  19:49:48 STEP 1041 H= 260:15 +CPU= 27.742
  19:50:14 STEP 1042 H= 260:30 +CPU= 26.378
  19:50:41 STEP 1043 H= 260:45 +CPU= 27.330
  19:51:16 STEP 1044 H= 261:00 +CPU= 34.273
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001044
  19:51:43 STEP 1045 H= 261:15 +CPU= 27.442
  19:52:11 STEP 1046 H= 261:30 +CPU= 27.102
  19:52:38 STEP 1047 H= 261:45 +CPU= 27.522
  19:53:06 STEP 1048 H= 262:00 +CPU= 28.106
  19:53:34 STEP 1049 H= 262:15 +CPU= 27.434
  19:54:02 STEP 1050 H= 262:30 +CPU= 27.517
  19:54:29 STEP 1051 H= 262:45 +CPU= 27.387
  19:54:58 STEP 1052 H= 263:00 +CPU= 28.557
  19:55:25 STEP 1053 H= 263:15 +CPU= 27.127
  19:55:50 STEP 1054 H= 263:30 +CPU= 25.185
  19:56:18 STEP 1055 H= 263:45 +CPU= 27.475
  19:56:55 STEP 1056 H= 264:00 +CPU= 36.611
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2dn_2016092300_15_991_12209870_0_r1706318508_10.zip
Uploading the intermediate file: upload_file_10.zip
  19:57:21 STEP 1057 H= 264:15 +CPU= 26.205
  19:57:49 STEP 1058 H= 264:30 +CPU= 27.355
  19:58:16 STEP 1059 H= 264:45 +CPU= 27.069
  19:58:44 STEP 1060 H= 265:00 +CPU= 27.859
  19:59:12 STEP 1061 H= 265:15 +CPU= 27.198
  19:59:40 STEP 1062 H= 265:30 +CPU= 27.936
  20:00:07 STEP 1063 H= 265:45 +CPU= 27.338
  20:00:36 STEP 1064 H= 266:00 +CPU= 28.238
  20:01:03 STEP 1065 H= 266:15 +CPU= 27.214
  20:01:30 STEP 1066 H= 266:30 +CPU= 27.394
  20:01:58 STEP 1067 H= 266:45 +CPU= 27.058
  20:02:32 STEP 1068 H= 267:00 +CPU= 34.383
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001068
  20:03:00 STEP 1069 H= 267:15 +CPU= 27.920
  20:03:28 STEP 1070 H= 267:30 +CPU= 27.357
  20:03:55 STEP 1071 H= 267:45 +CPU= 27.708
  20:04:24 STEP 1072 H= 268:00 +CPU= 28.559
  20:04:52 STEP 1073 H= 268:15 +CPU= 27.940
  20:05:20 STEP 1074 H= 268:30 +CPU= 27.907
  20:05:48 STEP 1075 H= 268:45 +CPU= 28.101
  20:06:17 STEP 1076 H= 269:00 +CPU= 28.625
  20:06:44 STEP 1077 H= 269:15 +CPU= 27.363
  20:07:12 STEP 1078 H= 269:30 +CPU= 27.590
  20:07:39 STEP 1079 H= 269:45 +CPU= 27.029
  20:08:14 STEP 1080 H= 270:00 +CPU= 34.433
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001080
  20:08:42 STEP 1081 H= 270:15 +CPU= 27.548
  20:09:09 STEP 1082 H= 270:30 +CPU= 27.704
  20:09:37 STEP 1083 H= 270:45 +CPU= 27.822
  20:10:06 STEP 1084 H= 271:00 +CPU= 28.307
  20:10:34 STEP 1085 H= 271:15 +CPU= 27.872
  20:11:02 STEP 1086 H= 271:30 +CPU= 28.569
  20:11:30 STEP 1087 H= 271:45 +CPU= 27.191
  20:11:58 STEP 1088 H= 272:00 +CPU= 27.901
  20:12:25 STEP 1089 H= 272:15 +CPU= 27.071
  20:12:53 STEP 1090 H= 272:30 +CPU= 27.755
  20:13:20 STEP 1091 H= 272:45 +CPU= 27.308
  20:13:54 STEP 1092 H= 273:00 +CPU= 33.165
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001092
  20:14:20 STEP 1093 H= 273:15 +CPU= 25.875
  20:14:47 STEP 1094 H= 273:30 +CPU= 26.992
  20:15:15 STEP 1095 H= 273:45 +CPU= 28.180
  20:15:43 STEP 1096 H= 274:00 +CPU= 27.653
  20:16:09 STEP 1097 H= 274:15 +CPU= 26.295
  20:16:36 STEP 1098 H= 274:30 +CPU= 26.958
  20:17:03 STEP 1099 H= 274:45 +CPU= 27.175
  20:17:32 STEP 1100 H= 275:00 +CPU= 28.010
  20:17:59 STEP 1101 H= 275:15 +CPU= 27.063
  20:18:26 STEP 1102 H= 275:30 +CPU= 27.269
  20:18:54 STEP 1103 H= 275:45 +CPU= 27.696
  20:19:32 STEP 1104 H= 276:00 +CPU= 37.860
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001104
  20:20:00 STEP 1105 H= 276:15 +CPU= 27.809
  20:20:28 STEP 1106 H= 276:30 +CPU= 27.529
  20:20:55 STEP 1107 H= 276:45 +CPU= 27.510
  20:21:23 STEP 1108 H= 277:00 +CPU= 27.745
  20:21:50 STEP 1109 H= 277:15 +CPU= 27.059
  20:22:18 STEP 1110 H= 277:30 +CPU= 27.397
  20:22:46 STEP 1111 H= 277:45 +CPU= 27.999
  20:23:14 STEP 1112 H= 278:00 +CPU= 27.456
  20:23:41 STEP 1113 H= 278:15 +CPU= 27.525
  20:24:10 STEP 1114 H= 278:30 +CPU= 28.244
  20:24:37 STEP 1115 H= 278:45 +CPU= 27.027
  20:25:11 STEP 1116 H= 279:00 +CPU= 34.499
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001116
  20:25:39 STEP 1117 H= 279:15 +CPU= 26.993
  20:26:06 STEP 1118 H= 279:30 +CPU= 27.420
  20:26:34 STEP 1119 H= 279:45 +CPU= 27.540
  20:27:01 STEP 1120 H= 280:00 +CPU= 27.712
  20:27:29 STEP 1121 H= 280:15 +CPU= 27.840
  20:27:57 STEP 1122 H= 280:30 +CPU= 27.809
  20:28:25 STEP 1123 H= 280:45 +CPU= 27.704
  20:28:54 STEP 1124 H= 281:00 +CPU= 28.518
  20:29:21 STEP 1125 H= 281:15 +CPU= 26.892
  20:29:48 STEP 1126 H= 281:30 +CPU= 27.048
  20:30:15 STEP 1127 H= 281:45 +CPU= 26.495
  20:30:48 STEP 1128 H= 282:00 +CPU= 33.464
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001128
  20:31:14 STEP 1129 H= 282:15 +CPU= 26.051
  20:31:41 STEP 1130 H= 282:30 +CPU= 26.477
  20:32:08 STEP 1131 H= 282:45 +CPU= 27.408
  20:32:36 STEP 1132 H= 283:00 +CPU= 27.605
  20:33:04 STEP 1133 H= 283:15 +CPU= 27.733
  20:33:32 STEP 1134 H= 283:30 +CPU= 27.922
  20:33:59 STEP 1135 H= 283:45 +CPU= 27.354
  20:34:28 STEP 1136 H= 284:00 +CPU= 27.948
  20:34:55 STEP 1137 H= 284:15 +CPU= 27.678
  20:35:23 STEP 1138 H= 284:30 +CPU= 27.784
  20:35:50 STEP 1139 H= 284:45 +CPU= 27.126
  20:36:25 STEP 1140 H= 285:00 +CPU= 34.896
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001140
  20:36:53 STEP 1141 H= 285:15 +CPU= 27.291
  20:37:21 STEP 1142 H= 285:30 +CPU= 28.045
  20:37:48 STEP 1143 H= 285:45 +CPU= 27.083
  20:38:16 STEP 1144 H= 286:00 +CPU= 28.171
  20:38:44 STEP 1145 H= 286:15 +CPU= 27.746
  20:39:12 STEP 1146 H= 286:30 +CPU= 28.062
  20:39:40 STEP 1147 H= 286:45 +CPU= 27.354
  20:40:08 STEP 1148 H= 287:00 +CPU= 28.115
  20:40:36 STEP 1149 H= 287:15 +CPU= 27.766
  20:41:04 STEP 1150 H= 287:30 +CPU= 27.762
  20:41:31 STEP 1151 H= 287:45 +CPU= 27.392
  20:42:09 STEP 1152 H= 288:00 +CPU= 37.077
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2dn_2016092300_15_991_12209870_0_r1706318508_11.zip
Uploading the intermediate file: upload_file_11.zip
  20:42:37 STEP 1153 H= 288:15 +CPU= 27.660
  20:43:05 STEP 1154 H= 288:30 +CPU= 27.614
  20:43:32 STEP 1155 H= 288:45 +CPU= 27.487
  20:44:01 STEP 1156 H= 289:00 +CPU= 28.179
  20:44:28 STEP 1157 H= 289:15 +CPU= 27.232
  20:44:56 STEP 1158 H= 289:30 +CPU= 27.332
  20:45:23 STEP 1159 H= 289:45 +CPU= 27.230
  20:45:52 STEP 1160 H= 290:00 +CPU= 28.607
  20:46:19 STEP 1161 H= 290:15 +CPU= 27.130
  20:46:47 STEP 1162 H= 290:30 +CPU= 27.604
  20:47:15 STEP 1163 H= 290:45 +CPU= 27.630
  20:47:49 STEP 1164 H= 291:00 +CPU= 34.351
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001164
  20:48:16 STEP 1165 H= 291:15 +CPU= 26.755
  20:48:43 STEP 1166 H= 291:30 +CPU= 26.354
  20:49:10 STEP 1167 H= 291:45 +CPU= 26.779
  20:49:39 STEP 1168 H= 292:00 +CPU= 28.516
  20:50:06 STEP 1169 H= 292:15 +CPU= 27.537
  20:50:33 STEP 1170 H= 292:30 +CPU= 27.153
  20:51:01 STEP 1171 H= 292:45 +CPU= 26.959
  20:51:29 STEP 1172 H= 293:00 +CPU= 28.268
  20:51:57 STEP 1173 H= 293:15 +CPU= 27.561
  20:52:24 STEP 1174 H= 293:30 +CPU= 27.240
  20:52:51 STEP 1175 H= 293:45 +CPU= 26.761
  20:53:25 STEP 1176 H= 294:00 +CPU= 34.383
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001176
  20:53:53 STEP 1177 H= 294:15 +CPU= 27.721
  20:54:20 STEP 1178 H= 294:30 +CPU= 27.157
  20:54:48 STEP 1179 H= 294:45 +CPU= 27.306
  20:55:16 STEP 1180 H= 295:00 +CPU= 27.692
  20:55:44 STEP 1181 H= 295:15 +CPU= 27.991
  20:56:11 STEP 1182 H= 295:30 +CPU= 27.062
  20:56:39 STEP 1183 H= 295:45 +CPU= 27.680
  20:57:08 STEP 1184 H= 296:00 +CPU= 28.886
  20:57:36 STEP 1185 H= 296:15 +CPU= 27.975
  20:58:04 STEP 1186 H= 296:30 +CPU= 28.199
  20:58:32 STEP 1187 H= 296:45 +CPU= 27.805
  20:59:06 STEP 1188 H= 297:00 +CPU= 34.049
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001188
  20:59:33 STEP 1189 H= 297:15 +CPU= 27.021
  21:00:01 STEP 1190 H= 297:30 +CPU= 27.455
  21:00:28 STEP 1191 H= 297:45 +CPU= 27.307
  21:00:57 STEP 1192 H= 298:00 +CPU= 28.892
  21:01:24 STEP 1193 H= 298:15 +CPU= 26.734
  21:01:52 STEP 1194 H= 298:30 +CPU= 27.625
  21:02:20 STEP 1195 H= 298:45 +CPU= 28.233
  21:02:48 STEP 1196 H= 299:00 +CPU= 27.922
  21:03:15 STEP 1197 H= 299:15 +CPU= 26.765
  21:03:43 STEP 1198 H= 299:30 +CPU= 27.654
  21:04:09 STEP 1199 H= 299:45 +CPU= 25.728
  21:04:46 STEP 1200 H= 300:00 +CPU= 36.881
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001200
  21:05:14 STEP 1201 H= 300:15 +CPU= 27.289
  21:05:41 STEP 1202 H= 300:30 +CPU= 26.862
  21:06:07 STEP 1203 H= 300:45 +CPU= 26.100
  21:06:35 STEP 1204 H= 301:00 +CPU= 28.315
  21:07:03 STEP 1205 H= 301:15 +CPU= 27.674
  21:07:31 STEP 1206 H= 301:30 +CPU= 27.980
  21:07:59 STEP 1207 H= 301:45 +CPU= 27.661
  21:08:28 STEP 1208 H= 302:00 +CPU= 28.762
  21:08:56 STEP 1209 H= 302:15 +CPU= 27.584
  21:09:23 STEP 1210 H= 302:30 +CPU= 27.290
  21:09:52 STEP 1211 H= 302:45 +CPU= 28.469
  21:10:26 STEP 1212 H= 303:00 +CPU= 34.372
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001212
  21:10:54 STEP 1213 H= 303:15 +CPU= 27.375
  21:11:21 STEP 1214 H= 303:30 +CPU= 27.557
  21:11:49 STEP 1215 H= 303:45 +CPU= 27.479
  21:12:17 STEP 1216 H= 304:00 +CPU= 27.617
  21:12:44 STEP 1217 H= 304:15 +CPU= 27.364
  21:13:11 STEP 1218 H= 304:30 +CPU= 27.284
  21:13:39 STEP 1219 H= 304:45 +CPU= 27.223
  21:14:07 STEP 1220 H= 305:00 +CPU= 27.950
  21:14:34 STEP 1221 H= 305:15 +CPU= 27.324
  21:15:02 STEP 1222 H= 305:30 +CPU= 28.038
  21:15:30 STEP 1223 H= 305:45 +CPU= 27.113
  21:16:04 STEP 1224 H= 306:00 +CPU= 34.208
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001224
  21:16:32 STEP 1225 H= 306:15 +CPU= 27.498
  21:16:59 STEP 1226 H= 306:30 +CPU= 27.536
  21:17:28 STEP 1227 H= 306:45 +CPU= 28.237
  21:17:56 STEP 1228 H= 307:00 +CPU= 28.664
  21:18:24 STEP 1229 H= 307:15 +CPU= 27.598
  21:18:52 STEP 1230 H= 307:30 +CPU= 27.851
  21:19:20 STEP 1231 H= 307:45 +CPU= 28.075
  21:19:48 STEP 1232 H= 308:00 +CPU= 27.904
  21:20:16 STEP 1233 H= 308:15 +CPU= 27.680
  21:20:43 STEP 1234 H= 308:30 +CPU= 27.200
  21:21:11 STEP 1235 H= 308:45 +CPU= 27.618
  21:21:45 STEP 1236 H= 309:00 +CPU= 33.795
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001236
  21:22:12 STEP 1237 H= 309:15 +CPU= 26.782
  21:22:38 STEP 1238 H= 309:30 +CPU= 25.848
  21:23:05 STEP 1239 H= 309:45 +CPU= 26.832
  21:23:33 STEP 1240 H= 310:00 +CPU= 27.765
  21:24:00 STEP 1241 H= 310:15 +CPU= 27.386
  21:24:27 STEP 1242 H= 310:30 +CPU= 27.134
  21:24:55 STEP 1243 H= 310:45 +CPU= 27.354
  21:25:23 STEP 1244 H= 311:00 +CPU= 28.196
  21:25:50 STEP 1245 H= 311:15 +CPU= 27.114
  21:26:18 STEP 1246 H= 311:30 +CPU= 27.829
  21:26:46 STEP 1247 H= 311:45 +CPU= 27.521
  21:27:24 STEP 1248 H= 312:00 +CPU= 37.516
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2dn_2016092300_15_991_12209870_0_r1706318508_12.zip
Uploading the intermediate file: upload_file_12.zip
  21:27:51 STEP 1249 H= 312:15 +CPU= 27.530
  21:28:19 STEP 1250 H= 312:30 +CPU= 27.609
  21:28:48 STEP 1251 H= 312:45 +CPU= 28.172
  21:29:16 STEP 1252 H= 313:00 +CPU= 28.550
  21:29:44 STEP 1253 H= 313:15 +CPU= 27.967
  21:30:12 STEP 1254 H= 313:30 +CPU= 27.616
  21:30:40 STEP 1255 H= 313:45 +CPU= 27.947
  21:31:09 STEP 1256 H= 314:00 +CPU= 28.451
  21:31:36 STEP 1257 H= 314:15 +CPU= 27.031
  21:32:04 STEP 1258 H= 314:30 +CPU= 27.669
  21:32:32 STEP 1259 H= 314:45 +CPU= 27.349
  21:33:06 STEP 1260 H= 315:00 +CPU= 34.421
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001260
  21:33:34 STEP 1261 H= 315:15 +CPU= 27.711
  21:34:02 STEP 1262 H= 315:30 +CPU= 27.679
  21:34:29 STEP 1263 H= 315:45 +CPU= 27.591
  21:34:58 STEP 1264 H= 316:00 +CPU= 28.184
  21:35:25 STEP 1265 H= 316:15 +CPU= 27.603
  21:35:54 STEP 1266 H= 316:30 +CPU= 28.292
  21:36:21 STEP 1267 H= 316:45 +CPU= 26.692
  21:36:49 STEP 1268 H= 317:00 +CPU= 28.532
  21:37:17 STEP 1269 H= 317:15 +CPU= 27.760
  21:37:45 STEP 1270 H= 317:30 +CPU= 27.666
  21:38:13 STEP 1271 H= 317:45 +CPU= 27.733
  21:38:43 STEP 1272 H= 318:00 +CPU= 30.312
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001272
  21:39:11 STEP 1273 H= 318:15 +CPU= 27.656
  21:39:38 STEP 1274 H= 318:30 +CPU= 27.064
  21:40:04 STEP 1275 H= 318:45 +CPU= 26.181
  21:40:32 STEP 1276 H= 319:00 +CPU= 27.434
  21:40:59 STEP 1277 H= 319:15 +CPU= 27.012
  21:41:27 STEP 1278 H= 319:30 +CPU= 27.312
  21:41:54 STEP 1279 H= 319:45 +CPU= 27.463
  21:42:23 STEP 1280 H= 320:00 +CPU= 28.300
  21:42:51 STEP 1281 H= 320:15 +CPU= 28.100
  21:43:18 STEP 1282 H= 320:30 +CPU= 27.629
  21:43:46 STEP 1283 H= 320:45 +CPU= 27.077
  21:44:20 STEP 1284 H= 321:00 +CPU= 34.012
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001284
  21:44:47 STEP 1285 H= 321:15 +CPU= 27.186
  21:45:14 STEP 1286 H= 321:30 +CPU= 27.417
  21:45:42 STEP 1287 H= 321:45 +CPU= 27.808
  21:46:10 STEP 1288 H= 322:00 +CPU= 27.045
  21:46:37 STEP 1289 H= 322:15 +CPU= 27.780
  21:47:05 STEP 1290 H= 322:30 +CPU= 27.455
  21:47:33 STEP 1291 H= 322:45 +CPU= 27.840
  21:48:01 STEP 1292 H= 323:00 +CPU= 27.670
  21:48:28 STEP 1293 H= 323:15 +CPU= 27.537
  21:48:56 STEP 1294 H= 323:30 +CPU= 27.159
  21:49:24 STEP 1295 H= 323:45 +CPU= 27.908
  21:50:02 STEP 1296 H= 324:00 +CPU= 37.975
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001296
  21:50:30 STEP 1297 H= 324:15 +CPU= 27.896
  21:50:59 STEP 1298 H= 324:30 +CPU= 28.441
  21:51:26 STEP 1299 H= 324:45 +CPU= 27.257
  21:51:54 STEP 1300 H= 325:00 +CPU= 28.078
  21:52:22 STEP 1301 H= 325:15 +CPU= 27.528
  21:52:50 STEP 1302 H= 325:30 +CPU= 28.133
  21:53:17 STEP 1303 H= 325:45 +CPU= 27.205
  21:53:46 STEP 1304 H= 326:00 +CPU= 28.269
  21:54:14 STEP 1305 H= 326:15 +CPU= 27.934
  21:54:42 STEP 1306 H= 326:30 +CPU= 27.522
  21:55:09 STEP 1307 H= 326:45 +CPU= 27.534
  21:55:44 STEP 1308 H= 327:00 +CPU= 34.396
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001308
  21:56:11 STEP 1309 H= 327:15 +CPU= 26.878
  21:56:37 STEP 1310 H= 327:30 +CPU= 26.339
  21:57:04 STEP 1311 H= 327:45 +CPU= 26.336
  21:57:31 STEP 1312 H= 328:00 +CPU= 27.820
  21:57:59 STEP 1313 H= 328:15 +CPU= 27.590
  21:58:27 STEP 1314 H= 328:30 +CPU= 28.111
  21:58:55 STEP 1315 H= 328:45 +CPU= 27.246
  21:59:23 STEP 1316 H= 329:00 +CPU= 28.148
  21:59:50 STEP 1317 H= 329:15 +CPU= 27.001
  22:00:17 STEP 1318 H= 329:30 +CPU= 27.263
  22:00:45 STEP 1319 H= 329:45 +CPU= 27.218
  22:01:19 STEP 1320 H= 330:00 +CPU= 34.319
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001320
  22:01:47 STEP 1321 H= 330:15 +CPU= 27.545
  22:02:15 STEP 1322 H= 330:30 +CPU= 28.149
  22:02:43 STEP 1323 H= 330:45 +CPU= 27.732
  22:03:11 STEP 1324 H= 331:00 +CPU= 27.940
  22:03:38 STEP 1325 H= 331:15 +CPU= 27.156
  22:04:06 STEP 1326 H= 331:30 +CPU= 27.470
  22:04:33 STEP 1327 H= 331:45 +CPU= 27.107
  22:05:01 STEP 1328 H= 332:00 +CPU= 27.825
  22:05:28 STEP 1329 H= 332:15 +CPU= 27.373
  22:05:56 STEP 1330 H= 332:30 +CPU= 27.642
  22:06:24 STEP 1331 H= 332:45 +CPU= 28.052
  22:06:59 STEP 1332 H= 333:00 +CPU= 34.947
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001332
  22:07:27 STEP 1333 H= 333:15 +CPU= 27.566
  22:07:54 STEP 1334 H= 333:30 +CPU= 27.176
  22:08:22 STEP 1335 H= 333:45 +CPU= 27.670
  22:08:50 STEP 1336 H= 334:00 +CPU= 28.073
  22:09:18 STEP 1337 H= 334:15 +CPU= 27.823
  22:09:45 STEP 1338 H= 334:30 +CPU= 26.821
  22:10:13 STEP 1339 H= 334:45 +CPU= 27.696
  22:10:41 STEP 1340 H= 335:00 +CPU= 28.024
  22:11:09 STEP 1341 H= 335:15 +CPU= 27.687
  22:11:36 STEP 1342 H= 335:30 +CPU= 27.316
  22:12:04 STEP 1343 H= 335:45 +CPU= 27.634
  22:12:40 STEP 1344 H= 336:00 +CPU= 36.134
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2dn_2016092300_15_991_12209870_0_r1706318508_13.zip
Uploading the intermediate file: upload_file_13.zip
  22:13:08 STEP 1345 H= 336:15 +CPU= 27.280
  22:13:35 STEP 1346 H= 336:30 +CPU= 27.080
  22:14:02 STEP 1347 H= 336:45 +CPU= 26.948
  22:14:30 STEP 1348 H= 337:00 +CPU= 27.167
  22:14:58 STEP 1349 H= 337:15 +CPU= 27.864
  22:15:25 STEP 1350 H= 337:30 +CPU= 27.448
  22:15:52 STEP 1351 H= 337:45 +CPU= 27.200
  22:16:21 STEP 1352 H= 338:00 +CPU= 28.237
  22:16:48 STEP 1353 H= 338:15 +CPU= 27.267
  22:17:17 STEP 1354 H= 338:30 +CPU= 28.012
  22:17:44 STEP 1355 H= 338:45 +CPU= 27.449
  22:18:18 STEP 1356 H= 339:00 +CPU= 33.946
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001356
  22:18:46 STEP 1357 H= 339:15 +CPU= 27.667
  22:19:13 STEP 1358 H= 339:30 +CPU= 27.079
  22:19:41 STEP 1359 H= 339:45 +CPU= 27.658
  22:20:09 STEP 1360 H= 340:00 +CPU= 27.979
  22:20:36 STEP 1361 H= 340:15 +CPU= 27.416
  22:21:04 STEP 1362 H= 340:30 +CPU= 27.339
  22:21:32 STEP 1363 H= 340:45 +CPU= 27.754
  22:22:00 STEP 1364 H= 341:00 +CPU= 28.457
  22:22:28 STEP 1365 H= 341:15 +CPU= 27.534
  22:22:56 STEP 1366 H= 341:30 +CPU= 27.914
  22:23:23 STEP 1367 H= 341:45 +CPU= 27.223
  22:23:58 STEP 1368 H= 342:00 +CPU= 34.862
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001368
  22:24:26 STEP 1369 H= 342:15 +CPU= 27.237
  22:24:53 STEP 1370 H= 342:30 +CPU= 27.363
  22:25:20 STEP 1371 H= 342:45 +CPU= 27.162
  22:25:49 STEP 1372 H= 343:00 +CPU= 28.587
  22:26:16 STEP 1373 H= 343:15 +CPU= 27.200
  22:26:44 STEP 1374 H= 343:30 +CPU= 27.634
  22:27:12 STEP 1375 H= 343:45 +CPU= 27.977
  22:27:41 STEP 1376 H= 344:00 +CPU= 28.609
  22:28:08 STEP 1377 H= 344:15 +CPU= 27.301
  22:28:36 STEP 1378 H= 344:30 +CPU= 27.163
  22:29:03 STEP 1379 H= 344:45 +CPU= 27.733
  22:29:38 STEP 1380 H= 345:00 +CPU= 34.337
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001380
  22:30:06 STEP 1381 H= 345:15 +CPU= 28.209
  22:30:33 STEP 1382 H= 345:30 +CPU= 26.954
  22:31:00 STEP 1383 H= 345:45 +CPU= 26.495
  22:31:27 STEP 1384 H= 346:00 +CPU= 27.306
  22:31:55 STEP 1385 H= 346:15 +CPU= 27.163
  22:32:22 STEP 1386 H= 346:30 +CPU= 27.090
  22:32:49 STEP 1387 H= 346:45 +CPU= 27.331
  22:33:17 STEP 1388 H= 347:00 +CPU= 27.467
  22:33:45 STEP 1389 H= 347:15 +CPU= 27.745
  22:34:12 STEP 1390 H= 347:30 +CPU= 27.569
  22:34:40 STEP 1391 H= 347:45 +CPU= 27.301
  22:35:18 STEP 1392 H= 348:00 +CPU= 38.001
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001392
  22:35:45 STEP 1393 H= 348:15 +CPU= 27.302
  22:36:13 STEP 1394 H= 348:30 +CPU= 27.478
  22:36:41 STEP 1395 H= 348:45 +CPU= 27.725
  22:37:09 STEP 1396 H= 349:00 +CPU= 28.220
  22:37:36 STEP 1397 H= 349:15 +CPU= 27.366
  22:38:04 STEP 1398 H= 349:30 +CPU= 27.463
  22:38:31 STEP 1399 H= 349:45 +CPU= 27.046
  22:39:00 STEP 1400 H= 350:00 +CPU= 28.273
  22:39:27 STEP 1401 H= 350:15 +CPU= 27.483
  22:39:55 STEP 1402 H= 350:30 +CPU= 27.454
  22:40:23 STEP 1403 H= 350:45 +CPU= 27.718
  22:40:57 STEP 1404 H= 351:00 +CPU= 34.539
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001404
  22:41:25 STEP 1405 H= 351:15 +CPU= 27.743
  22:41:53 STEP 1406 H= 351:30 +CPU= 27.640
  22:42:20 STEP 1407 H= 351:45 +CPU= 27.215
  22:42:48 STEP 1408 H= 352:00 +CPU= 28.083
  22:43:16 STEP 1409 H= 352:15 +CPU= 27.807
  22:43:44 STEP 1410 H= 352:30 +CPU= 27.133
  22:44:12 STEP 1411 H= 352:45 +CPU= 28.052
  22:44:40 STEP 1412 H= 353:00 +CPU= 28.512
  22:45:08 STEP 1413 H= 353:15 +CPU= 27.506
  22:45:35 STEP 1414 H= 353:30 +CPU= 27.277
  22:46:03 STEP 1415 H= 353:45 +CPU= 27.674
  22:46:38 STEP 1416 H= 354:00 +CPU= 34.978
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001416
  22:47:04 STEP 1417 H= 354:15 +CPU= 25.484
  22:47:32 STEP 1418 H= 354:30 +CPU= 27.575
  22:47:59 STEP 1419 H= 354:45 +CPU= 27.110
  22:48:26 STEP 1420 H= 355:00 +CPU= 26.800
  22:48:53 STEP 1421 H= 355:15 +CPU= 27.021
  22:49:20 STEP 1422 H= 355:30 +CPU= 27.311
  22:49:49 STEP 1423 H= 355:45 +CPU= 27.717
  22:50:17 STEP 1424 H= 356:00 +CPU= 28.506
  22:50:45 STEP 1425 H= 356:15 +CPU= 27.955
  22:51:13 STEP 1426 H= 356:30 +CPU= 27.357
  22:51:41 STEP 1427 H= 356:45 +CPU= 27.629
  22:52:15 STEP 1428 H= 357:00 +CPU= 34.099
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001428
  22:52:42 STEP 1429 H= 357:15 +CPU= 27.345
  22:53:10 STEP 1430 H= 357:30 +CPU= 27.216
  22:53:37 STEP 1431 H= 357:45 +CPU= 27.747
  22:54:06 STEP 1432 H= 358:00 +CPU= 28.615
  22:54:34 STEP 1433 H= 358:15 +CPU= 27.710
  22:55:02 STEP 1434 H= 358:30 +CPU= 27.571
  22:55:29 STEP 1435 H= 358:45 +CPU= 27.006
  22:55:57 STEP 1436 H= 359:00 +CPU= 28.607
  22:56:25 STEP 1437 H= 359:15 +CPU= 27.635
  22:56:53 STEP 1438 H= 359:30 +CPU= 28.150
  22:57:21 STEP 1439 H= 359:45 +CPU= 27.659
  22:57:57 STEP 1440 H= 360:00 +CPU= 35.611
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.3369105944E-21      I       0.7838020711E-06      I
ICloud fractionI      0.0000000000E+00      I       0.2358329728E-01      I
I  Relat. Hum. I      0.3037782569E+00      I       0.3441086998E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2063267383E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    321506321 BYTES IN      7 RECORDS TRANSFERRED IN    0.0005 SECONDS643012.6 Mbytes/s, TOTAL TIME=    0.0117( 4.3%)
 22:57:57 STEP 1440 H= 360:00 +CPU= 35.611
 END CNT3
 NSTEP =  1440 CNT0   000000000  26.567  26.567  26.699   0.995               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        42886/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    42886 ************    86.1     0.0    86.1     0.0   164.8
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    4462.7    4462.7     17.17      0.00
   9 SPCM     - SPECTRAL COMP.                    1440     819.1     819.1      2.90      0.00
  10 SCAN2M - PHYSICS                             1441   13474.3   13474.3     47.82      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121     973.2     973.2      0.29      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      45.9      45.9      0.01      0.00
  14 SUINIF                                          1    3391.5    3391.5      0.01      0.00
  17 GRIDFPOS IN CNT4                              121      28.0      28.0      0.01      0.00
  18 SUSPECG                                         1    1666.9    1666.9      0.00      0.00
  19 SUSPEC                                          1    1673.2    1673.2      0.00      0.00
  24 SUGRIDU                                         1     957.6     957.6      0.00      0.00
  25 SPECRT                                          1     305.7     305.7      0.00      0.00
  26 SUGRIDF                                         1     455.0     455.0      0.00      0.00
  27 RESTART FILES - WRITING                        30    3925.2    3925.2      0.29      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    6002.4    6002.4      1.79      0.00
  31 POSDDH IN STEPO                                 7      10.3      10.3      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    5623.7    5623.7     19.96      0.00
  39 SU0YOMB                                         1     357.3     357.3      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      31.0      31.0      0.11      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     351.5     351.5      1.25      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      52.9      52.9      0.19      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     450.3     450.3      3.47      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     266.1     266.1      1.97      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     100.3     100.3      0.74      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     144.7     144.7      1.11      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      42.3      42.3      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      48.3      48.3      0.37      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      26.5      26.5      0.20      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125      91.8      91.8      0.71      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      22.9      22.9      0.17      0.00
 400 GSTATS                                     167374       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                155706       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    40602.5 CPU TIME   40408.5 VECTOR TIME    40408.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       31.9
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client50001/slots/4/NODE.001_01
Adding to the zip: /var/lib/boinc-client50001/slots/4/ifs.stat
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209870/ICMSHh7zg+001428
Zipping up the final file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2dn_2016092300_15_991_12209870_0_r1706318508_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
23:01:28 (698334): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:26 1537295 22310072 oifs_43r3_bl_a2dn_2016092300_15_991_12209870_0 1,295,100 40,408 0.0312
09 May 2023 16:51:22 1537295 22310072 oifs_43r3_bl_a2dn_2016092300_15_991_12209870_0 864,000 26,907 0.0311


©2024 climateprediction.net