climateprediction.net home page
Task 22310140

Task 22310140

Name oifs_43r3_bl_a2fg_2016092300_15_991_12209935_0
Workunit 12209935
Created 13 Feb 2023, 17:48:18 UTC
Sent 13 Feb 2023, 17:52:23 UTC
Report deadline 14 Apr 2023, 17:52:23 UTC
Received 15 Feb 2023, 2:39:02 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1537793
Run time 18 hours 54 min 33 sec
CPU time 18 hours 48 min 19 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 3.90 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,059.32 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,353.69 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
  19:07:20 STEP  861 H= 215:15 +CPU= 44.504
  19:08:05 STEP  862 H= 215:30 +CPU= 44.722
  19:08:54 STEP  863 H= 215:45 +CPU= 49.296
  19:10:00 STEP  864 H= 216:00 +CPU= 65.889
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a2fg_2016092300_15_991_12209935_0_r1681719461_8.zip
Uploading the intermediate file: upload_file_8.zip
  19:10:47 STEP  865 H= 216:15 +CPU= 46.044
  19:11:30 STEP  866 H= 216:30 +CPU= 43.783
  19:12:16 STEP  867 H= 216:45 +CPU= 45.566
  19:13:01 STEP  868 H= 217:00 +CPU= 44.374
  19:13:44 STEP  869 H= 217:15 +CPU= 43.706
  19:14:29 STEP  870 H= 217:30 +CPU= 44.224
  19:15:14 STEP  871 H= 217:45 +CPU= 44.897
  19:15:59 STEP  872 H= 218:00 +CPU= 45.431
  19:16:44 STEP  873 H= 218:15 +CPU= 44.399
  19:17:31 STEP  874 H= 218:30 +CPU= 47.490
  19:18:17 STEP  875 H= 218:45 +CPU= 45.236
  19:19:13 STEP  876 H= 219:00 +CPU= 56.458
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+000876
  19:20:00 STEP  877 H= 219:15 +CPU= 47.195
  19:20:48 STEP  878 H= 219:30 +CPU= 47.312
  19:21:34 STEP  879 H= 219:45 +CPU= 46.655
  19:22:23 STEP  880 H= 220:00 +CPU= 48.526
  19:23:09 STEP  881 H= 220:15 +CPU= 46.348
  19:23:54 STEP  882 H= 220:30 +CPU= 44.632
  19:24:42 STEP  883 H= 220:45 +CPU= 47.523
  19:25:28 STEP  884 H= 221:00 +CPU= 46.285
  19:26:12 STEP  885 H= 221:15 +CPU= 43.893
  19:26:57 STEP  886 H= 221:30 +CPU= 45.235
  19:27:44 STEP  887 H= 221:45 +CPU= 46.590
  19:28:44 STEP  888 H= 222:00 +CPU= 60.285
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+000888
  19:29:33 STEP  889 H= 222:15 +CPU= 48.519
  19:30:19 STEP  890 H= 222:30 +CPU= 46.325
  19:31:05 STEP  891 H= 222:45 +CPU= 45.870
  19:31:52 STEP  892 H= 223:00 +CPU= 46.755
  19:32:39 STEP  893 H= 223:15 +CPU= 47.544
  19:33:26 STEP  894 H= 223:30 +CPU= 46.885
  19:34:12 STEP  895 H= 223:45 +CPU= 45.464
  19:35:00 STEP  896 H= 224:00 +CPU= 48.285
  19:35:50 STEP  897 H= 224:15 +CPU= 50.209
  19:36:36 STEP  898 H= 224:30 +CPU= 46.067
  19:37:23 STEP  899 H= 224:45 +CPU= 46.434
  19:38:21 STEP  900 H= 225:00 +CPU= 58.442
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+000900
  19:39:07 STEP  901 H= 225:15 +CPU= 45.526
  19:39:55 STEP  902 H= 225:30 +CPU= 48.147
  19:40:45 STEP  903 H= 225:45 +CPU= 49.156
  19:41:33 STEP  904 H= 226:00 +CPU= 48.251
  19:42:19 STEP  905 H= 226:15 +CPU= 46.031
  19:43:05 STEP  906 H= 226:30 +CPU= 45.830
  19:43:52 STEP  907 H= 226:45 +CPU= 46.966
  19:44:42 STEP  908 H= 227:00 +CPU= 49.868
  19:45:28 STEP  909 H= 227:15 +CPU= 46.049
  19:46:14 STEP  910 H= 227:30 +CPU= 45.998
  19:47:04 STEP  911 H= 227:45 +CPU= 49.164
  19:48:08 STEP  912 H= 228:00 +CPU= 63.624
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+000912
  19:48:54 STEP  913 H= 228:15 +CPU= 46.093
  19:49:39 STEP  914 H= 228:30 +CPU= 45.277
  19:50:24 STEP  915 H= 228:45 +CPU= 45.312
  19:51:11 STEP  916 H= 229:00 +CPU= 46.884
  19:51:58 STEP  917 H= 229:15 +CPU= 46.567
  19:52:44 STEP  918 H= 229:30 +CPU= 46.475
  19:53:33 STEP  919 H= 229:45 +CPU= 48.661
  19:54:20 STEP  920 H= 230:00 +CPU= 47.293
  19:55:11 STEP  921 H= 230:15 +CPU= 50.480
  19:55:56 STEP  922 H= 230:30 +CPU= 45.370
  19:56:42 STEP  923 H= 230:45 +CPU= 45.324
  19:57:42 STEP  924 H= 231:00 +CPU= 60.477
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+000924
  19:58:30 STEP  925 H= 231:15 +CPU= 47.259
  19:59:18 STEP  926 H= 231:30 +CPU= 47.978
  20:00:07 STEP  927 H= 231:45 +CPU= 48.704
  20:00:56 STEP  928 H= 232:00 +CPU= 49.201
  20:01:44 STEP  929 H= 232:15 +CPU= 48.154
  20:02:29 STEP  930 H= 232:30 +CPU= 45.075
  20:03:16 STEP  931 H= 232:45 +CPU= 46.713
  20:04:02 STEP  932 H= 233:00 +CPU= 45.522
  20:04:47 STEP  933 H= 233:15 +CPU= 45.225
  20:05:34 STEP  934 H= 233:30 +CPU= 46.798
  20:06:22 STEP  935 H= 233:45 +CPU= 48.265
  20:07:21 STEP  936 H= 234:00 +CPU= 58.929
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+000936
  20:08:11 STEP  937 H= 234:15 +CPU= 49.916
  20:09:02 STEP  938 H= 234:30 +CPU= 49.575
  20:09:49 STEP  939 H= 234:45 +CPU= 47.789
  20:10:39 STEP  940 H= 235:00 +CPU= 47.863
  20:11:23 STEP  941 H= 235:15 +CPU= 44.113
  20:12:10 STEP  942 H= 235:30 +CPU= 46.276
  20:12:54 STEP  943 H= 235:45 +CPU= 44.457
  20:13:39 STEP  944 H= 236:00 +CPU= 44.423
  20:14:22 STEP  945 H= 236:15 +CPU= 43.456
  20:15:05 STEP  946 H= 236:30 +CPU= 43.220
  20:15:49 STEP  947 H= 236:45 +CPU= 43.414
  20:16:43 STEP  948 H= 237:00 +CPU= 54.329
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+000948
  20:17:29 STEP  949 H= 237:15 +CPU= 46.243
  20:18:14 STEP  950 H= 237:30 +CPU= 44.277
  20:18:58 STEP  951 H= 237:45 +CPU= 44.654
  20:19:43 STEP  952 H= 238:00 +CPU= 44.925
  20:20:27 STEP  953 H= 238:15 +CPU= 43.626
  20:21:14 STEP  954 H= 238:30 +CPU= 46.379
  20:21:58 STEP  955 H= 238:45 +CPU= 44.307
  20:22:43 STEP  956 H= 239:00 +CPU= 44.885
  20:23:28 STEP  957 H= 239:15 +CPU= 45.309
  20:24:15 STEP  958 H= 239:30 +CPU= 47.044
  20:25:03 STEP  959 H= 239:45 +CPU= 47.954
  20:26:05 STEP  960 H= 240:00 +CPU= 61.210
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a2fg_2016092300_15_991_12209935_0_r1681719461_9.zip
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 864000
  20:26:50 STEP  961 H= 240:15 +CPU= 44.697
  20:27:35 STEP  962 H= 240:30 +CPU= 44.527
  20:28:19 STEP  963 H= 240:45 +CPU= 44.354
  20:29:05 STEP  964 H= 241:00 +CPU= 45.722
  20:29:51 STEP  965 H= 241:15 +CPU= 46.723
  20:30:38 STEP  966 H= 241:30 +CPU= 46.979
  20:31:23 STEP  967 H= 241:45 +CPU= 44.716
  20:32:08 STEP  968 H= 242:00 +CPU= 45.183
  20:32:57 STEP  969 H= 242:15 +CPU= 48.181
  20:33:44 STEP  970 H= 242:30 +CPU= 47.160
  20:34:30 STEP  971 H= 242:45 +CPU= 46.314
  20:35:25 STEP  972 H= 243:00 +CPU= 55.146
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+000972
  20:36:10 STEP  973 H= 243:15 +CPU= 44.389
  20:36:56 STEP  974 H= 243:30 +CPU= 46.045
  20:37:40 STEP  975 H= 243:45 +CPU= 44.012
  20:38:25 STEP  976 H= 244:00 +CPU= 45.162
  20:39:12 STEP  977 H= 244:15 +CPU= 46.895
  20:39:59 STEP  978 H= 244:30 +CPU= 47.379
  20:40:46 STEP  979 H= 244:45 +CPU= 46.897
  20:41:33 STEP  980 H= 245:00 +CPU= 46.470
  20:42:18 STEP  981 H= 245:15 +CPU= 45.164
  20:43:04 STEP  982 H= 245:30 +CPU= 46.256
  20:43:48 STEP  983 H= 245:45 +CPU= 43.938
  20:44:46 STEP  984 H= 246:00 +CPU= 58.026
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+000984
  20:45:32 STEP  985 H= 246:15 +CPU= 45.805
  20:46:16 STEP  986 H= 246:30 +CPU= 44.215
  20:47:01 STEP  987 H= 246:45 +CPU= 44.783
  20:47:47 STEP  988 H= 247:00 +CPU= 45.729
  20:48:34 STEP  989 H= 247:15 +CPU= 47.534
  20:49:20 STEP  990 H= 247:30 +CPU= 45.129
  20:50:04 STEP  991 H= 247:45 +CPU= 44.725
  20:50:50 STEP  992 H= 248:00 +CPU= 44.993
  20:51:35 STEP  993 H= 248:15 +CPU= 44.861
  20:52:22 STEP  994 H= 248:30 +CPU= 47.081
  20:53:06 STEP  995 H= 248:45 +CPU= 44.650
  20:54:04 STEP  996 H= 249:00 +CPU= 57.763
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+000996
  20:54:49 STEP  997 H= 249:15 +CPU= 44.682
  20:55:33 STEP  998 H= 249:30 +CPU= 44.232
  20:56:17 STEP  999 H= 249:45 +CPU= 44.164
  20:57:03 STEP 1000 H= 250:00 +CPU= 45.069
  20:57:48 STEP 1001 H= 250:15 +CPU= 45.626
  20:58:34 STEP 1002 H= 250:30 +CPU= 45.924
  20:59:22 STEP 1003 H= 250:45 +CPU= 47.582
  21:00:06 STEP 1004 H= 251:00 +CPU= 44.481
  21:00:50 STEP 1005 H= 251:15 +CPU= 43.580
  21:01:35 STEP 1006 H= 251:30 +CPU= 44.932
  21:02:19 STEP 1007 H= 251:45 +CPU= 44.119
  21:03:24 STEP 1008 H= 252:00 +CPU= 64.485
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001008
  21:04:10 STEP 1009 H= 252:15 +CPU= 46.021
  21:04:55 STEP 1010 H= 252:30 +CPU= 44.228
  21:05:41 STEP 1011 H= 252:45 +CPU= 45.616
  21:06:26 STEP 1012 H= 253:00 +CPU= 45.035
  21:07:11 STEP 1013 H= 253:15 +CPU= 44.999
  21:07:56 STEP 1014 H= 253:30 +CPU= 45.151
  21:08:41 STEP 1015 H= 253:45 +CPU= 44.425
  21:09:26 STEP 1016 H= 254:00 +CPU= 45.173
  21:10:11 STEP 1017 H= 254:15 +CPU= 45.367
  21:10:56 STEP 1018 H= 254:30 +CPU= 44.337
  21:11:43 STEP 1019 H= 254:45 +CPU= 47.311
  21:12:40 STEP 1020 H= 255:00 +CPU= 56.692
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001020
  21:13:29 STEP 1021 H= 255:15 +CPU= 48.840
  21:14:17 STEP 1022 H= 255:30 +CPU= 47.436
  21:15:03 STEP 1023 H= 255:45 +CPU= 46.255
  21:15:50 STEP 1024 H= 256:00 +CPU= 47.062
  21:16:37 STEP 1025 H= 256:15 +CPU= 47.202
  21:17:24 STEP 1026 H= 256:30 +CPU= 46.812
  21:18:10 STEP 1027 H= 256:45 +CPU= 45.936
  21:18:56 STEP 1028 H= 257:00 +CPU= 46.338
  21:19:41 STEP 1029 H= 257:15 +CPU= 44.890
  21:20:26 STEP 1030 H= 257:30 +CPU= 44.628
  21:21:10 STEP 1031 H= 257:45 +CPU= 43.452
  21:22:06 STEP 1032 H= 258:00 +CPU= 55.935
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001032
  21:22:52 STEP 1033 H= 258:15 +CPU= 45.889
  21:23:36 STEP 1034 H= 258:30 +CPU= 44.069
  21:24:20 STEP 1035 H= 258:45 +CPU= 44.442
  21:25:07 STEP 1036 H= 259:00 +CPU= 46.298
  21:25:51 STEP 1037 H= 259:15 +CPU= 44.697
  21:26:37 STEP 1038 H= 259:30 +CPU= 45.514
  21:27:25 STEP 1039 H= 259:45 +CPU= 47.623
  21:28:10 STEP 1040 H= 260:00 +CPU= 45.384
  21:28:55 STEP 1041 H= 260:15 +CPU= 44.678
  21:29:42 STEP 1042 H= 260:30 +CPU= 47.003
  21:30:29 STEP 1043 H= 260:45 +CPU= 46.624
  21:31:24 STEP 1044 H= 261:00 +CPU= 55.111
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001044
  21:32:10 STEP 1045 H= 261:15 +CPU= 45.080
  21:32:57 STEP 1046 H= 261:30 +CPU= 46.958
  21:33:43 STEP 1047 H= 261:45 +CPU= 45.959
  21:34:31 STEP 1048 H= 262:00 +CPU= 48.609
  21:35:19 STEP 1049 H= 262:15 +CPU= 47.350
  21:36:05 STEP 1050 H= 262:30 +CPU= 46.488
  21:36:51 STEP 1051 H= 262:45 +CPU= 45.642
  21:37:38 STEP 1052 H= 263:00 +CPU= 47.201
  21:38:24 STEP 1053 H= 263:15 +CPU= 45.358
  21:39:08 STEP 1054 H= 263:30 +CPU= 44.293
  21:39:53 STEP 1055 H= 263:45 +CPU= 45.207
  21:40:55 STEP 1056 H= 264:00 +CPU= 62.254
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a2fg_2016092300_15_991_12209935_0_r1681719461_10.zip
Uploading the intermediate file: upload_file_10.zip
  21:41:40 STEP 1057 H= 264:15 +CPU= 44.262
  21:42:24 STEP 1058 H= 264:30 +CPU= 43.391
  21:43:07 STEP 1059 H= 264:45 +CPU= 43.344
  21:43:53 STEP 1060 H= 265:00 +CPU= 45.768
  21:44:39 STEP 1061 H= 265:15 +CPU= 46.157
  21:45:24 STEP 1062 H= 265:30 +CPU= 45.092
  21:46:10 STEP 1063 H= 265:45 +CPU= 45.270
  21:46:56 STEP 1064 H= 266:00 +CPU= 45.957
  21:47:41 STEP 1065 H= 266:15 +CPU= 45.536
  21:48:26 STEP 1066 H= 266:30 +CPU= 45.027
  21:49:12 STEP 1067 H= 266:45 +CPU= 45.982
  21:50:12 STEP 1068 H= 267:00 +CPU= 59.344
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001068
  21:50:57 STEP 1069 H= 267:15 +CPU= 45.589
  21:51:43 STEP 1070 H= 267:30 +CPU= 45.713
  21:52:30 STEP 1071 H= 267:45 +CPU= 47.130
  21:53:15 STEP 1072 H= 268:00 +CPU= 44.139
  21:53:59 STEP 1073 H= 268:15 +CPU= 44.567
  21:54:45 STEP 1074 H= 268:30 +CPU= 45.636
  21:55:30 STEP 1075 H= 268:45 +CPU= 44.792
  21:56:15 STEP 1076 H= 269:00 +CPU= 44.945
  21:57:00 STEP 1077 H= 269:15 +CPU= 45.141
  21:57:44 STEP 1078 H= 269:30 +CPU= 43.780
  21:58:29 STEP 1079 H= 269:45 +CPU= 44.944
  21:59:24 STEP 1080 H= 270:00 +CPU= 54.735
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001080
  22:00:11 STEP 1081 H= 270:15 +CPU= 47.185
  22:00:58 STEP 1082 H= 270:30 +CPU= 46.913
  22:01:43 STEP 1083 H= 270:45 +CPU= 45.145
  22:02:31 STEP 1084 H= 271:00 +CPU= 47.678
  22:03:16 STEP 1085 H= 271:15 +CPU= 45.544
  22:04:02 STEP 1086 H= 271:30 +CPU= 45.618
  22:04:46 STEP 1087 H= 271:45 +CPU= 44.541
  22:05:32 STEP 1088 H= 272:00 +CPU= 45.631
  22:06:16 STEP 1089 H= 272:15 +CPU= 44.184
  22:07:01 STEP 1090 H= 272:30 +CPU= 44.282
  22:07:46 STEP 1091 H= 272:45 +CPU= 45.508
  22:08:44 STEP 1092 H= 273:00 +CPU= 57.642
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001092
  22:09:30 STEP 1093 H= 273:15 +CPU= 46.173
  22:10:16 STEP 1094 H= 273:30 +CPU= 45.508
  22:11:04 STEP 1095 H= 273:45 +CPU= 47.454
  22:11:48 STEP 1096 H= 274:00 +CPU= 44.707
  22:12:34 STEP 1097 H= 274:15 +CPU= 45.572
  22:13:18 STEP 1098 H= 274:30 +CPU= 44.487
  22:14:03 STEP 1099 H= 274:45 +CPU= 44.401
  22:14:49 STEP 1100 H= 275:00 +CPU= 46.244
  22:15:34 STEP 1101 H= 275:15 +CPU= 44.406
  22:16:19 STEP 1102 H= 275:30 +CPU= 45.213
  22:17:03 STEP 1103 H= 275:45 +CPU= 44.174
  22:18:06 STEP 1104 H= 276:00 +CPU= 62.067
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001104
  22:18:50 STEP 1105 H= 276:15 +CPU= 44.338
  22:19:35 STEP 1106 H= 276:30 +CPU= 44.424
  22:20:20 STEP 1107 H= 276:45 +CPU= 44.874
  22:21:05 STEP 1108 H= 277:00 +CPU= 45.344
  22:21:52 STEP 1109 H= 277:15 +CPU= 46.995
  22:22:39 STEP 1110 H= 277:30 +CPU= 46.229
  22:23:24 STEP 1111 H= 277:45 +CPU= 45.389
  22:24:12 STEP 1112 H= 278:00 +CPU= 48.213
  22:24:58 STEP 1113 H= 278:15 +CPU= 45.903
  22:25:44 STEP 1114 H= 278:30 +CPU= 45.689
  22:26:30 STEP 1115 H= 278:45 +CPU= 45.875
  22:27:28 STEP 1116 H= 279:00 +CPU= 58.167
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001116
  22:28:14 STEP 1117 H= 279:15 +CPU= 45.933
  22:29:03 STEP 1118 H= 279:30 +CPU= 48.945
  22:29:53 STEP 1119 H= 279:45 +CPU= 49.423
  22:30:41 STEP 1120 H= 280:00 +CPU= 48.031
  22:31:29 STEP 1121 H= 280:15 +CPU= 47.732
  22:32:16 STEP 1122 H= 280:30 +CPU= 47.258
  22:33:03 STEP 1123 H= 280:45 +CPU= 46.774
  22:33:53 STEP 1124 H= 281:00 +CPU= 49.854
  22:34:41 STEP 1125 H= 281:15 +CPU= 48.450
  22:35:29 STEP 1126 H= 281:30 +CPU= 48.000
  22:36:18 STEP 1127 H= 281:45 +CPU= 48.938
  22:37:18 STEP 1128 H= 282:00 +CPU= 59.713
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001128
  22:38:06 STEP 1129 H= 282:15 +CPU= 47.738
  22:38:53 STEP 1130 H= 282:30 +CPU= 46.773
  22:39:40 STEP 1131 H= 282:45 +CPU= 47.066
  22:40:31 STEP 1132 H= 283:00 +CPU= 51.105
  22:41:19 STEP 1133 H= 283:15 +CPU= 47.539
  22:42:05 STEP 1134 H= 283:30 +CPU= 46.101
  22:42:50 STEP 1135 H= 283:45 +CPU= 45.673
  22:43:38 STEP 1136 H= 284:00 +CPU= 47.138
  22:44:27 STEP 1137 H= 284:15 +CPU= 48.786
  22:45:17 STEP 1138 H= 284:30 +CPU= 50.324
  22:46:06 STEP 1139 H= 284:45 +CPU= 48.531
  22:47:04 STEP 1140 H= 285:00 +CPU= 58.509
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001140
  22:47:53 STEP 1141 H= 285:15 +CPU= 48.924
  22:48:41 STEP 1142 H= 285:30 +CPU= 47.371
  22:49:32 STEP 1143 H= 285:45 +CPU= 50.711
  22:50:20 STEP 1144 H= 286:00 +CPU= 48.324
  22:51:07 STEP 1145 H= 286:15 +CPU= 46.712
  22:51:55 STEP 1146 H= 286:30 +CPU= 47.705
  22:52:45 STEP 1147 H= 286:45 +CPU= 50.224
  22:53:34 STEP 1148 H= 287:00 +CPU= 48.895
  22:54:22 STEP 1149 H= 287:15 +CPU= 48.418
  22:55:09 STEP 1150 H= 287:30 +CPU= 46.501
  22:55:56 STEP 1151 H= 287:45 +CPU= 47.371
  22:57:03 STEP 1152 H= 288:00 +CPU= 66.702
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a2fg_2016092300_15_991_12209935_0_r1681719461_11.zip
Uploading the intermediate file: upload_file_11.zip
  22:57:50 STEP 1153 H= 288:15 +CPU= 46.520
  22:58:36 STEP 1154 H= 288:30 +CPU= 45.984
  22:59:22 STEP 1155 H= 288:45 +CPU= 46.237
  23:00:08 STEP 1156 H= 289:00 +CPU= 46.141
  23:00:57 STEP 1157 H= 289:15 +CPU= 49.030
  23:01:44 STEP 1158 H= 289:30 +CPU= 46.377
  23:02:31 STEP 1159 H= 289:45 +CPU= 47.736
  23:03:17 STEP 1160 H= 290:00 +CPU= 45.908
  23:04:05 STEP 1161 H= 290:15 +CPU= 47.850
  23:04:53 STEP 1162 H= 290:30 +CPU= 47.529
  23:05:40 STEP 1163 H= 290:45 +CPU= 47.436
  23:06:39 STEP 1164 H= 291:00 +CPU= 59.059
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001164
  23:07:23 STEP 1165 H= 291:15 +CPU= 43.931
  23:08:11 STEP 1166 H= 291:30 +CPU= 47.532
  23:08:57 STEP 1167 H= 291:45 +CPU= 46.167
  23:09:43 STEP 1168 H= 292:00 +CPU= 45.688
  23:10:29 STEP 1169 H= 292:15 +CPU= 46.708
  23:11:18 STEP 1170 H= 292:30 +CPU= 48.126
  23:12:03 STEP 1171 H= 292:45 +CPU= 45.191
  23:12:49 STEP 1172 H= 293:00 +CPU= 46.125
  23:13:35 STEP 1173 H= 293:15 +CPU= 46.261
  23:14:21 STEP 1174 H= 293:30 +CPU= 45.616
  23:15:07 STEP 1175 H= 293:45 +CPU= 46.097
  23:16:03 STEP 1176 H= 294:00 +CPU= 56.169
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001176
  23:16:48 STEP 1177 H= 294:15 +CPU= 44.838
  23:17:33 STEP 1178 H= 294:30 +CPU= 45.191
  23:18:21 STEP 1179 H= 294:45 +CPU= 47.138
  23:19:10 STEP 1180 H= 295:00 +CPU= 48.475
  23:19:55 STEP 1181 H= 295:15 +CPU= 45.543
  23:20:40 STEP 1182 H= 295:30 +CPU= 44.566
  23:21:26 STEP 1183 H= 295:45 +CPU= 45.881
  23:22:12 STEP 1184 H= 296:00 +CPU= 46.674
  23:22:56 STEP 1185 H= 296:15 +CPU= 44.006
  23:23:42 STEP 1186 H= 296:30 +CPU= 45.650
  23:24:27 STEP 1187 H= 296:45 +CPU= 45.235
  23:25:24 STEP 1188 H= 297:00 +CPU= 56.785
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001188
  23:26:12 STEP 1189 H= 297:15 +CPU= 47.785
  23:26:56 STEP 1190 H= 297:30 +CPU= 43.546
  23:27:43 STEP 1191 H= 297:45 +CPU= 46.628
  23:28:29 STEP 1192 H= 298:00 +CPU= 46.043
  23:29:13 STEP 1193 H= 298:15 +CPU= 43.951
  23:29:57 STEP 1194 H= 298:30 +CPU= 43.988
  23:30:40 STEP 1195 H= 298:45 +CPU= 43.603
  23:31:27 STEP 1196 H= 299:00 +CPU= 46.808
  23:32:11 STEP 1197 H= 299:15 +CPU= 44.072
  23:32:59 STEP 1198 H= 299:30 +CPU= 47.610
  23:33:45 STEP 1199 H= 299:45 +CPU= 45.471
  23:34:47 STEP 1200 H= 300:00 +CPU= 62.334
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001200
  23:35:32 STEP 1201 H= 300:15 +CPU= 44.780
  23:36:18 STEP 1202 H= 300:30 +CPU= 46.494
  23:37:03 STEP 1203 H= 300:45 +CPU= 44.092
  23:37:48 STEP 1204 H= 301:00 +CPU= 45.373
  23:38:33 STEP 1205 H= 301:15 +CPU= 44.424
  23:39:19 STEP 1206 H= 301:30 +CPU= 46.025
  23:40:06 STEP 1207 H= 301:45 +CPU= 47.070
  23:40:53 STEP 1208 H= 302:00 +CPU= 47.013
  23:41:39 STEP 1209 H= 302:15 +CPU= 45.937
  23:42:25 STEP 1210 H= 302:30 +CPU= 45.571
  23:43:09 STEP 1211 H= 302:45 +CPU= 44.622
  23:44:06 STEP 1212 H= 303:00 +CPU= 56.340
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001212
  23:44:51 STEP 1213 H= 303:15 +CPU= 44.778
  23:45:35 STEP 1214 H= 303:30 +CPU= 44.110
  23:46:19 STEP 1215 H= 303:45 +CPU= 44.189
  23:47:04 STEP 1216 H= 304:00 +CPU= 45.161
  23:47:49 STEP 1217 H= 304:15 +CPU= 44.801
  23:48:36 STEP 1218 H= 304:30 +CPU= 46.617
  23:49:21 STEP 1219 H= 304:45 +CPU= 45.249
  23:50:06 STEP 1220 H= 305:00 +CPU= 44.505
  23:50:50 STEP 1221 H= 305:15 +CPU= 44.193
  23:51:34 STEP 1222 H= 305:30 +CPU= 44.081
  23:52:19 STEP 1223 H= 305:45 +CPU= 44.382
  23:53:16 STEP 1224 H= 306:00 +CPU= 57.093
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001224
  23:54:00 STEP 1225 H= 306:15 +CPU= 44.003
  23:54:46 STEP 1226 H= 306:30 +CPU= 45.540
  23:55:31 STEP 1227 H= 306:45 +CPU= 44.537
  23:56:16 STEP 1228 H= 307:00 +CPU= 45.094
  23:57:00 STEP 1229 H= 307:15 +CPU= 44.600
  23:57:45 STEP 1230 H= 307:30 +CPU= 44.187
  23:58:29 STEP 1231 H= 307:45 +CPU= 44.722
  23:59:15 STEP 1232 H= 308:00 +CPU= 45.336
  23:59:59 STEP 1233 H= 308:15 +CPU= 44.330
  00:00:43 STEP 1234 H= 308:30 +CPU= 43.690
  00:01:27 STEP 1235 H= 308:45 +CPU= 44.227
  00:02:24 STEP 1236 H= 309:00 +CPU= 57.034
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001236
  00:03:09 STEP 1237 H= 309:15 +CPU= 44.358
  00:03:54 STEP 1238 H= 309:30 +CPU= 45.400
  00:04:39 STEP 1239 H= 309:45 +CPU= 45.030
  00:05:24 STEP 1240 H= 310:00 +CPU= 44.774
  00:06:09 STEP 1241 H= 310:15 +CPU= 45.354
  00:06:55 STEP 1242 H= 310:30 +CPU= 45.416
  00:07:44 STEP 1243 H= 310:45 +CPU= 48.607
  00:08:30 STEP 1244 H= 311:00 +CPU= 46.674
  00:09:16 STEP 1245 H= 311:15 +CPU= 45.378
  00:10:03 STEP 1246 H= 311:30 +CPU= 47.518
  00:10:49 STEP 1247 H= 311:45 +CPU= 45.692
  00:11:54 STEP 1248 H= 312:00 +CPU= 64.626
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a2fg_2016092300_15_991_12209935_0_r1681719461_12.zip
Uploading the intermediate file: upload_file_12.zip
  00:12:41 STEP 1249 H= 312:15 +CPU= 46.751
  00:13:29 STEP 1250 H= 312:30 +CPU= 48.603
  00:14:16 STEP 1251 H= 312:45 +CPU= 46.183
  00:15:05 STEP 1252 H= 313:00 +CPU= 49.174
  00:15:53 STEP 1253 H= 313:15 +CPU= 47.938
  00:16:40 STEP 1254 H= 313:30 +CPU= 46.808
  00:17:24 STEP 1255 H= 313:45 +CPU= 44.812
  00:18:10 STEP 1256 H= 314:00 +CPU= 45.136
  00:18:55 STEP 1257 H= 314:15 +CPU= 44.768
  00:19:39 STEP 1258 H= 314:30 +CPU= 44.497
  00:20:24 STEP 1259 H= 314:45 +CPU= 44.763
  00:21:20 STEP 1260 H= 315:00 +CPU= 56.279
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001260
  00:22:06 STEP 1261 H= 315:15 +CPU= 45.585
  00:22:51 STEP 1262 H= 315:30 +CPU= 44.928
  00:23:36 STEP 1263 H= 315:45 +CPU= 44.696
  00:24:21 STEP 1264 H= 316:00 +CPU= 44.966
  00:25:05 STEP 1265 H= 316:15 +CPU= 44.251
  00:25:49 STEP 1266 H= 316:30 +CPU= 44.107
  00:26:36 STEP 1267 H= 316:45 +CPU= 46.980
  00:27:25 STEP 1268 H= 317:00 +CPU= 48.828
  00:28:13 STEP 1269 H= 317:15 +CPU= 47.427
  00:28:58 STEP 1270 H= 317:30 +CPU= 45.216
  00:29:44 STEP 1271 H= 317:45 +CPU= 46.614
  00:30:44 STEP 1272 H= 318:00 +CPU= 59.658
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001272
  00:31:33 STEP 1273 H= 318:15 +CPU= 48.813
  00:32:22 STEP 1274 H= 318:30 +CPU= 48.523
  00:33:09 STEP 1275 H= 318:45 +CPU= 46.990
  00:33:57 STEP 1276 H= 319:00 +CPU= 48.350
  00:34:45 STEP 1277 H= 319:15 +CPU= 47.041
  00:35:31 STEP 1278 H= 319:30 +CPU= 45.766
  00:36:20 STEP 1279 H= 319:45 +CPU= 48.855
  00:37:08 STEP 1280 H= 320:00 +CPU= 48.197
  00:37:56 STEP 1281 H= 320:15 +CPU= 48.540
  00:38:47 STEP 1282 H= 320:30 +CPU= 50.086
  00:39:35 STEP 1283 H= 320:45 +CPU= 48.222
  00:40:31 STEP 1284 H= 321:00 +CPU= 56.194
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001284
  00:41:17 STEP 1285 H= 321:15 +CPU= 45.350
  00:42:01 STEP 1286 H= 321:30 +CPU= 44.428
  00:42:48 STEP 1287 H= 321:45 +CPU= 46.219
  00:43:35 STEP 1288 H= 322:00 +CPU= 46.806
  00:44:23 STEP 1289 H= 322:15 +CPU= 47.896
  00:45:09 STEP 1290 H= 322:30 +CPU= 45.720
  00:45:55 STEP 1291 H= 322:45 +CPU= 46.104
  00:46:42 STEP 1292 H= 323:00 +CPU= 46.594
  00:47:28 STEP 1293 H= 323:15 +CPU= 46.311
  00:48:14 STEP 1294 H= 323:30 +CPU= 45.528
  00:48:59 STEP 1295 H= 323:45 +CPU= 45.464
  00:50:04 STEP 1296 H= 324:00 +CPU= 64.793
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001296
  00:50:51 STEP 1297 H= 324:15 +CPU= 46.642
  00:51:36 STEP 1298 H= 324:30 +CPU= 44.787
  00:52:22 STEP 1299 H= 324:45 +CPU= 46.022
  00:53:12 STEP 1300 H= 325:00 +CPU= 49.415
  00:53:59 STEP 1301 H= 325:15 +CPU= 46.805
  00:54:43 STEP 1302 H= 325:30 +CPU= 44.535
  00:55:30 STEP 1303 H= 325:45 +CPU= 46.571
  00:56:16 STEP 1304 H= 326:00 +CPU= 46.496
  00:57:02 STEP 1305 H= 326:15 +CPU= 45.117
  00:57:45 STEP 1306 H= 326:30 +CPU= 43.206
  00:58:28 STEP 1307 H= 326:45 +CPU= 43.300
  00:59:24 STEP 1308 H= 327:00 +CPU= 55.677
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001308
  01:00:09 STEP 1309 H= 327:15 +CPU= 44.936
  01:00:55 STEP 1310 H= 327:30 +CPU= 45.273
  01:01:39 STEP 1311 H= 327:45 +CPU= 44.050
  01:02:23 STEP 1312 H= 328:00 +CPU= 43.298
  01:03:07 STEP 1313 H= 328:15 +CPU= 44.548
  01:03:51 STEP 1314 H= 328:30 +CPU= 43.387
  01:04:34 STEP 1315 H= 328:45 +CPU= 42.943
  01:05:18 STEP 1316 H= 329:00 +CPU= 44.348
  01:06:03 STEP 1317 H= 329:15 +CPU= 44.551
  01:06:46 STEP 1318 H= 329:30 +CPU= 43.779
  01:07:32 STEP 1319 H= 329:45 +CPU= 45.249
  01:08:28 STEP 1320 H= 330:00 +CPU= 55.683
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001320
  01:09:11 STEP 1321 H= 330:15 +CPU= 43.295
  01:09:55 STEP 1322 H= 330:30 +CPU= 43.474
  01:10:38 STEP 1323 H= 330:45 +CPU= 43.462
  01:11:25 STEP 1324 H= 331:00 +CPU= 46.856
  01:12:12 STEP 1325 H= 331:15 +CPU= 46.564
  01:12:57 STEP 1326 H= 331:30 +CPU= 44.590
  01:13:41 STEP 1327 H= 331:45 +CPU= 44.828
  01:14:26 STEP 1328 H= 332:00 +CPU= 43.942
  01:15:11 STEP 1329 H= 332:15 +CPU= 45.552
  01:15:55 STEP 1330 H= 332:30 +CPU= 44.262
  01:16:39 STEP 1331 H= 332:45 +CPU= 43.257
  01:17:34 STEP 1332 H= 333:00 +CPU= 54.983
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001332
  01:18:18 STEP 1333 H= 333:15 +CPU= 44.535
  01:19:05 STEP 1334 H= 333:30 +CPU= 46.226
  01:19:50 STEP 1335 H= 333:45 +CPU= 45.481
  01:20:36 STEP 1336 H= 334:00 +CPU= 45.857
  01:21:22 STEP 1337 H= 334:15 +CPU= 45.274
  01:22:08 STEP 1338 H= 334:30 +CPU= 46.217
  01:22:54 STEP 1339 H= 334:45 +CPU= 46.172
  01:23:40 STEP 1340 H= 335:00 +CPU= 45.326
  01:24:25 STEP 1341 H= 335:15 +CPU= 45.788
  01:25:10 STEP 1342 H= 335:30 +CPU= 44.360
  01:25:54 STEP 1343 H= 335:45 +CPU= 43.943
  01:26:57 STEP 1344 H= 336:00 +CPU= 62.876
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a2fg_2016092300_15_991_12209935_0_r1681719461_13.zip
Uploading the intermediate file: upload_file_13.zip
  01:27:44 STEP 1345 H= 336:15 +CPU= 46.853
  01:28:33 STEP 1346 H= 336:30 +CPU= 49.088
  01:29:19 STEP 1347 H= 336:45 +CPU= 45.318
  01:30:05 STEP 1348 H= 337:00 +CPU= 45.881
  01:30:48 STEP 1349 H= 337:15 +CPU= 43.266
  01:31:32 STEP 1350 H= 337:30 +CPU= 43.865
  01:32:16 STEP 1351 H= 337:45 +CPU= 44.166
  01:33:00 STEP 1352 H= 338:00 +CPU= 44.075
  01:33:44 STEP 1353 H= 338:15 +CPU= 43.584
  01:34:28 STEP 1354 H= 338:30 +CPU= 43.897
  01:35:12 STEP 1355 H= 338:45 +CPU= 43.874
  01:36:08 STEP 1356 H= 339:00 +CPU= 56.236
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001356
  01:36:52 STEP 1357 H= 339:15 +CPU= 43.981
  01:37:37 STEP 1358 H= 339:30 +CPU= 45.053
  01:38:23 STEP 1359 H= 339:45 +CPU= 45.425
  01:39:10 STEP 1360 H= 340:00 +CPU= 46.771
  01:39:55 STEP 1361 H= 340:15 +CPU= 44.620
  01:40:39 STEP 1362 H= 340:30 +CPU= 44.579
  01:41:24 STEP 1363 H= 340:45 +CPU= 44.547
  01:42:09 STEP 1364 H= 341:00 +CPU= 44.776
  01:42:56 STEP 1365 H= 341:15 +CPU= 46.981
  01:43:44 STEP 1366 H= 341:30 +CPU= 47.781
  01:44:29 STEP 1367 H= 341:45 +CPU= 45.669
  01:45:28 STEP 1368 H= 342:00 +CPU= 58.336
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001368
  01:46:14 STEP 1369 H= 342:15 +CPU= 46.320
  01:46:59 STEP 1370 H= 342:30 +CPU= 45.148
  01:47:46 STEP 1371 H= 342:45 +CPU= 46.661
  01:48:38 STEP 1372 H= 343:00 +CPU= 51.417
  01:49:25 STEP 1373 H= 343:15 +CPU= 47.603
  01:50:12 STEP 1374 H= 343:30 +CPU= 46.437
  01:51:01 STEP 1375 H= 343:45 +CPU= 48.919
  01:51:51 STEP 1376 H= 344:00 +CPU= 50.112
  01:52:40 STEP 1377 H= 344:15 +CPU= 48.977
  01:53:27 STEP 1378 H= 344:30 +CPU= 47.036
  01:54:13 STEP 1379 H= 344:45 +CPU= 46.049
  01:55:13 STEP 1380 H= 345:00 +CPU= 59.794
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001380
  01:56:02 STEP 1381 H= 345:15 +CPU= 49.230
  01:56:48 STEP 1382 H= 345:30 +CPU= 45.503
  01:57:36 STEP 1383 H= 345:45 +CPU= 47.596
  01:58:26 STEP 1384 H= 346:00 +CPU= 49.635
  01:59:09 STEP 1385 H= 346:15 +CPU= 43.460
  01:59:55 STEP 1386 H= 346:30 +CPU= 45.739
  02:00:39 STEP 1387 H= 346:45 +CPU= 43.707
  02:01:18 STEP 1388 H= 347:00 +CPU= 39.441
  02:01:55 STEP 1389 H= 347:15 +CPU= 36.400
  02:02:36 STEP 1390 H= 347:30 +CPU= 41.544
  02:03:17 STEP 1391 H= 347:45 +CPU= 41.323
  02:04:20 STEP 1392 H= 348:00 +CPU= 62.493
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001392
  02:05:05 STEP 1393 H= 348:15 +CPU= 44.954
  02:05:48 STEP 1394 H= 348:30 +CPU= 43.471
  02:06:30 STEP 1395 H= 348:45 +CPU= 41.724
  02:07:09 STEP 1396 H= 349:00 +CPU= 38.315
  02:07:51 STEP 1397 H= 349:15 +CPU= 42.288
  02:08:31 STEP 1398 H= 349:30 +CPU= 40.488
  02:09:09 STEP 1399 H= 349:45 +CPU= 37.403
  02:09:50 STEP 1400 H= 350:00 +CPU= 41.176
  02:10:31 STEP 1401 H= 350:15 +CPU= 41.494
  02:11:08 STEP 1402 H= 350:30 +CPU= 36.797
  02:11:48 STEP 1403 H= 350:45 +CPU= 39.670
  02:12:37 STEP 1404 H= 351:00 +CPU= 49.449
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001404
  02:13:17 STEP 1405 H= 351:15 +CPU= 39.321
  02:13:52 STEP 1406 H= 351:30 +CPU= 35.428
  02:14:29 STEP 1407 H= 351:45 +CPU= 37.256
  02:15:08 STEP 1408 H= 352:00 +CPU= 38.295
  02:15:47 STEP 1409 H= 352:15 +CPU= 39.206
  02:16:26 STEP 1410 H= 352:30 +CPU= 38.905
  02:17:06 STEP 1411 H= 352:45 +CPU= 40.291
  02:17:40 STEP 1412 H= 353:00 +CPU= 34.098
  02:18:17 STEP 1413 H= 353:15 +CPU= 36.444
  02:18:52 STEP 1414 H= 353:30 +CPU= 35.216
  02:19:26 STEP 1415 H= 353:45 +CPU= 33.879
  02:20:12 STEP 1416 H= 354:00 +CPU= 46.117
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001416
  02:20:49 STEP 1417 H= 354:15 +CPU= 36.751
  02:21:22 STEP 1418 H= 354:30 +CPU= 33.607
  02:21:56 STEP 1419 H= 354:45 +CPU= 33.860
  02:22:34 STEP 1420 H= 355:00 +CPU= 37.933
  02:23:16 STEP 1421 H= 355:15 +CPU= 42.055
  02:23:51 STEP 1422 H= 355:30 +CPU= 34.623
  02:24:26 STEP 1423 H= 355:45 +CPU= 35.390
  02:24:59 STEP 1424 H= 356:00 +CPU= 32.698
  02:25:35 STEP 1425 H= 356:15 +CPU= 36.198
  02:26:15 STEP 1426 H= 356:30 +CPU= 39.749
  02:26:52 STEP 1427 H= 356:45 +CPU= 37.562
  02:27:36 STEP 1428 H= 357:00 +CPU= 43.993
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001428
  02:28:13 STEP 1429 H= 357:15 +CPU= 36.890
  02:28:46 STEP 1430 H= 357:30 +CPU= 32.216
  02:29:19 STEP 1431 H= 357:45 +CPU= 33.282
  02:29:54 STEP 1432 H= 358:00 +CPU= 35.310
  02:30:30 STEP 1433 H= 358:15 +CPU= 35.649
  02:31:05 STEP 1434 H= 358:30 +CPU= 35.145
  02:31:43 STEP 1435 H= 358:45 +CPU= 38.297
  02:32:20 STEP 1436 H= 359:00 +CPU= 36.699
  02:32:59 STEP 1437 H= 359:15 +CPU= 39.246
  02:33:37 STEP 1438 H= 359:30 +CPU= 37.836
  02:34:09 STEP 1439 H= 359:45 +CPU= 32.361
  02:34:58 STEP 1440 H= 360:00 +CPU= 48.290
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.8911482154E-21      I       0.1057918789E-08      I
ICloud fractionI      0.0000000000E+00      I       0.3762010193E-01      I
I  Relat. Hum. I      0.1904288221E+00      I       0.2358300767E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1525890818E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    318090257 BYTES IN      7 RECORDS TRANSFERRED IN    0.0007 SECONDS454414.7 Mbytes/s, TOTAL TIME=    0.0151( 4.6%)
 02:34:58 STEP 1440 H= 360:00 +CPU= 48.290
 END CNT3
 NSTEP =  1440 CNT0   000000000  38.021  38.021  38.037   1.000               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        42886/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    42886 ************   120.8     0.0   120.8     0.0   256.5
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    6985.1    6985.1     16.08      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1524.6    1524.6      3.24      0.00
  10 SCAN2M - PHYSICS                             1441   23256.3   23256.3     49.39      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1493.3    1493.3      0.27      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      85.2      85.2      0.01      0.00
  14 SUINIF                                          1    5563.8    5563.8      0.01      0.00
  17 GRIDFPOS IN CNT4                              121      50.2      50.2      0.01      0.00
  18 SUSPECG                                         1    3163.3    3163.3      0.00      0.00
  19 SUSPEC                                          1    3173.4    3173.4      0.00      0.00
  24 SUGRIDU                                         1    1564.6    1564.6      0.00      0.00
  25 SPECRT                                          1     432.2     432.2      0.00      0.00
  26 SUGRIDF                                         1     393.6     393.6      0.00      0.00
  27 RESTART FILES - WRITING                        30    6022.0    6022.0      0.27      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.3       0.3      0.00      0.00
  30 DYNFPOS IN CNT4                               121   10156.2   10156.2      1.81      0.00
  31 POSDDH IN STEPO                                 7       9.4       9.4      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    8907.4    8907.4     18.92      0.00
  39 SU0YOMB                                         1     525.6     525.6      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      44.3      44.3      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     448.1     448.1      0.95      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      79.0      79.0      0.17      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       1.0       1.0      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     757.0     757.0      3.49      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     458.7     458.7      2.03      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     181.4     181.4      0.80      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     305.3     305.3      1.41      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      64.7      64.7      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      74.1      74.1      0.34      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      43.2      43.2      0.19      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     152.7     152.7      0.70      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      74.6      74.6      0.33      0.00
 400 GSTATS                                     167374       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                155706       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    67850.0 CPU TIME   67699.0 VECTOR TIME    67699.0


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       19.1
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client50002/slots/7/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client50002/slots/7/NODE.001_01
Adding to the zip: /var/lib/boinc-client50002/slots/7/ifs.stat
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_12209935/ICMSHh7zg+001344
Zipping up the final file: /var/lib/boinc-client50002/projects/climateprediction.net/oifs_43r3_bl_a2fg_2016092300_15_991_12209935_0_r1681719461_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
02:38:33 (806983): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:30 1537793 22310140 oifs_43r3_bl_a2fg_2016092300_15_991_12209935_0 1,295,100 67,699 0.0523
09 May 2023 16:51:24 1537793 22310140 oifs_43r3_bl_a2fg_2016092300_15_991_12209935_0 864,000 45,603 0.0528


©2024 climateprediction.net