climateprediction.net home page
Task 22437370

Task 22437370

Name oifs_43r3_bl_a319_2016092300_20_1017_12285760_0
Workunit 12285760
Created 7 Jun 2024, 16:31:53 UTC
Sent 7 Jun 2024, 21:40:20 UTC
Report deadline 6 Aug 2024, 21:40:20 UTC
Received 8 Jun 2024, 13:03:03 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1499547
Run time 14 hours 52 min 58 sec
CPU time 14 hours 45 min 33 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 5.47 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,025.35 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,355.24 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
.659
  00:48:14 STEP  838 H= 209:30 +CPU= 41.444
  00:48:57 STEP  839 H= 209:45 +CPU= 42.231
  00:49:49 STEP  840 H= 210:00 +CPU= 51.432
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000840
  00:50:30 STEP  841 H= 210:15 +CPU= 40.752
  00:51:11 STEP  842 H= 210:30 +CPU= 41.134
  00:51:52 STEP  843 H= 210:45 +CPU= 40.310
  00:52:34 STEP  844 H= 211:00 +CPU= 42.041
  00:53:15 STEP  845 H= 211:15 +CPU= 41.391
  00:53:56 STEP  846 H= 211:30 +CPU= 41.172
  00:54:37 STEP  847 H= 211:45 +CPU= 40.625
  00:55:20 STEP  848 H= 212:00 +CPU= 42.193
  00:56:02 STEP  849 H= 212:15 +CPU= 41.751
  00:56:39 STEP  850 H= 212:30 +CPU= 37.249
  00:57:16 STEP  851 H= 212:45 +CPU= 37.286
  00:58:03 STEP  852 H= 213:00 +CPU= 46.552
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000852
  00:58:43 STEP  853 H= 213:15 +CPU= 39.683
  00:59:24 STEP  854 H= 213:30 +CPU= 40.849
  01:00:04 STEP  855 H= 213:45 +CPU= 40.090
  01:00:41 STEP  856 H= 214:00 +CPU= 37.445
  01:01:20 STEP  857 H= 214:15 +CPU= 38.292
  01:02:00 STEP  858 H= 214:30 +CPU= 40.741
  01:02:37 STEP  859 H= 214:45 +CPU= 36.582
  01:03:17 STEP  860 H= 215:00 +CPU= 39.878
  01:03:56 STEP  861 H= 215:15 +CPU= 38.445
  01:04:37 STEP  862 H= 215:30 +CPU= 41.562
  01:05:19 STEP  863 H= 215:45 +CPU= 41.833
  01:06:15 STEP  864 H= 216:00 +CPU= 55.209
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a319_2016092300_20_1017_12285760_0_r673430607_8.zip
Uploading the intermediate file: upload_file_8.zip
  01:06:52 STEP  865 H= 216:15 +CPU= 37.463
  01:07:31 STEP  866 H= 216:30 +CPU= 38.772
  01:08:08 STEP  867 H= 216:45 +CPU= 37.200
  01:08:48 STEP  868 H= 217:00 +CPU= 40.017
  01:09:30 STEP  869 H= 217:15 +CPU= 41.211
  01:10:10 STEP  870 H= 217:30 +CPU= 40.144
  01:10:52 STEP  871 H= 217:45 +CPU= 42.067
  01:11:33 STEP  872 H= 218:00 +CPU= 40.326
  01:12:10 STEP  873 H= 218:15 +CPU= 37.040
  01:12:49 STEP  874 H= 218:30 +CPU= 39.385
  01:13:27 STEP  875 H= 218:45 +CPU= 37.924
  01:14:18 STEP  876 H= 219:00 +CPU= 50.222
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000876
  01:14:57 STEP  877 H= 219:15 +CPU= 39.425
  01:15:40 STEP  878 H= 219:30 +CPU= 42.103
  01:16:23 STEP  879 H= 219:45 +CPU= 42.954
  01:17:05 STEP  880 H= 220:00 +CPU= 42.291
  01:17:47 STEP  881 H= 220:15 +CPU= 42.198
  01:18:28 STEP  882 H= 220:30 +CPU= 40.486
  01:19:10 STEP  883 H= 220:45 +CPU= 41.656
  01:19:52 STEP  884 H= 221:00 +CPU= 42.342
  01:20:30 STEP  885 H= 221:15 +CPU= 38.251
  01:21:11 STEP  886 H= 221:30 +CPU= 39.721
  01:21:50 STEP  887 H= 221:45 +CPU= 39.042
  01:22:40 STEP  888 H= 222:00 +CPU= 49.887
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000888
  01:23:21 STEP  889 H= 222:15 +CPU= 41.509
  01:24:02 STEP  890 H= 222:30 +CPU= 41.066
  01:24:44 STEP  891 H= 222:45 +CPU= 41.487
  01:25:26 STEP  892 H= 223:00 +CPU= 41.593
  01:26:04 STEP  893 H= 223:15 +CPU= 38.225
  01:26:46 STEP  894 H= 223:30 +CPU= 41.526
  01:27:24 STEP  895 H= 223:45 +CPU= 37.948
  01:28:01 STEP  896 H= 224:00 +CPU= 37.042
  01:28:42 STEP  897 H= 224:15 +CPU= 40.839
  01:29:21 STEP  898 H= 224:30 +CPU= 38.690
  01:30:02 STEP  899 H= 224:45 +CPU= 40.956
  01:30:53 STEP  900 H= 225:00 +CPU= 51.559
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000900
  01:31:30 STEP  901 H= 225:15 +CPU= 36.952
  01:32:07 STEP  902 H= 225:30 +CPU= 36.554
  01:32:44 STEP  903 H= 225:45 +CPU= 36.514
  01:33:24 STEP  904 H= 226:00 +CPU= 39.924
  01:34:05 STEP  905 H= 226:15 +CPU= 41.493
  01:34:47 STEP  906 H= 226:30 +CPU= 41.467
  01:35:27 STEP  907 H= 226:45 +CPU= 40.359
  01:36:10 STEP  908 H= 227:00 +CPU= 41.224
  01:36:51 STEP  909 H= 227:15 +CPU= 40.068
  01:37:31 STEP  910 H= 227:30 +CPU= 39.613
  01:38:11 STEP  911 H= 227:45 +CPU= 39.871
  01:39:05 STEP  912 H= 228:00 +CPU= 53.603
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000912
  01:39:43 STEP  913 H= 228:15 +CPU= 37.267
  01:40:24 STEP  914 H= 228:30 +CPU= 40.989
  01:41:04 STEP  915 H= 228:45 +CPU= 40.594
  01:41:45 STEP  916 H= 229:00 +CPU= 40.878
  01:42:29 STEP  917 H= 229:15 +CPU= 43.160
  01:43:11 STEP  918 H= 229:30 +CPU= 42.021
  01:43:50 STEP  919 H= 229:45 +CPU= 39.443
  01:44:33 STEP  920 H= 230:00 +CPU= 42.291
  01:45:13 STEP  921 H= 230:15 +CPU= 40.018
  01:45:56 STEP  922 H= 230:30 +CPU= 42.813
  01:46:37 STEP  923 H= 230:45 +CPU= 40.467
  01:47:28 STEP  924 H= 231:00 +CPU= 51.130
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000924
  01:48:08 STEP  925 H= 231:15 +CPU= 40.321
  01:48:52 STEP  926 H= 231:30 +CPU= 42.917
  01:49:31 STEP  927 H= 231:45 +CPU= 39.028
  01:50:10 STEP  928 H= 232:00 +CPU= 39.071
  01:50:50 STEP  929 H= 232:15 +CPU= 39.121
  01:51:29 STEP  930 H= 232:30 +CPU= 39.194
  01:52:08 STEP  931 H= 232:45 +CPU= 39.487
  01:52:52 STEP  932 H= 233:00 +CPU= 43.256
  01:53:34 STEP  933 H= 233:15 +CPU= 42.031
  01:54:15 STEP  934 H= 233:30 +CPU= 41.110
  01:54:52 STEP  935 H= 233:45 +CPU= 37.132
  01:55:43 STEP  936 H= 234:00 +CPU= 50.492
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000936
  01:56:24 STEP  937 H= 234:15 +CPU= 41.508
  01:57:06 STEP  938 H= 234:30 +CPU= 41.665
  01:57:47 STEP  939 H= 234:45 +CPU= 41.069
  01:58:30 STEP  940 H= 235:00 +CPU= 42.627
  01:59:12 STEP  941 H= 235:15 +CPU= 42.274
  01:59:54 STEP  942 H= 235:30 +CPU= 41.460
  02:00:33 STEP  943 H= 235:45 +CPU= 38.876
  02:01:11 STEP  944 H= 236:00 +CPU= 38.212
  02:01:53 STEP  945 H= 236:15 +CPU= 41.094
  02:02:34 STEP  946 H= 236:30 +CPU= 40.197
  02:03:13 STEP  947 H= 236:45 +CPU= 39.319
  02:03:59 STEP  948 H= 237:00 +CPU= 45.542
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000948
  02:04:34 STEP  949 H= 237:15 +CPU= 35.628
  02:05:14 STEP  950 H= 237:30 +CPU= 39.580
  02:05:53 STEP  951 H= 237:45 +CPU= 38.691
  02:06:32 STEP  952 H= 238:00 +CPU= 39.238
  02:07:10 STEP  953 H= 238:15 +CPU= 37.742
  02:07:50 STEP  954 H= 238:30 +CPU= 39.495
  02:08:30 STEP  955 H= 238:45 +CPU= 40.485
  02:09:08 STEP  956 H= 239:00 +CPU= 37.713
  02:09:44 STEP  957 H= 239:15 +CPU= 36.005
  02:10:22 STEP  958 H= 239:30 +CPU= 38.075
  02:11:02 STEP  959 H= 239:45 +CPU= 39.465
  02:11:55 STEP  960 H= 240:00 +CPU= 51.868
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a319_2016092300_20_1017_12285760_0_r673430607_9.zip
Uploading the intermediate file: upload_file_9.zip
  02:12:34 STEP  961 H= 240:15 +CPU= 39.145
Uploading trickle at timestep: 864000
  02:13:13 STEP  962 H= 240:30 +CPU= 39.339
  02:13:53 STEP  963 H= 240:45 +CPU= 39.308
  02:14:34 STEP  964 H= 241:00 +CPU= 40.743
  02:15:11 STEP  965 H= 241:15 +CPU= 36.365
  02:15:51 STEP  966 H= 241:30 +CPU= 40.018
  02:16:29 STEP  967 H= 241:45 +CPU= 38.729
  02:17:08 STEP  968 H= 242:00 +CPU= 37.884
  02:17:45 STEP  969 H= 242:15 +CPU= 37.501
  02:18:22 STEP  970 H= 242:30 +CPU= 36.424
  02:19:01 STEP  971 H= 242:45 +CPU= 38.650
  02:19:47 STEP  972 H= 243:00 +CPU= 46.222
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000972
  02:20:26 STEP  973 H= 243:15 +CPU= 38.625
  02:21:02 STEP  974 H= 243:30 +CPU= 35.500
  02:21:41 STEP  975 H= 243:45 +CPU= 39.568
  02:22:20 STEP  976 H= 244:00 +CPU= 39.082
  02:22:58 STEP  977 H= 244:15 +CPU= 37.930
  02:23:34 STEP  978 H= 244:30 +CPU= 35.303
  02:24:09 STEP  979 H= 244:45 +CPU= 35.436
  02:24:45 STEP  980 H= 245:00 +CPU= 36.096
  02:25:25 STEP  981 H= 245:15 +CPU= 39.510
  02:26:04 STEP  982 H= 245:30 +CPU= 39.256
  02:26:44 STEP  983 H= 245:45 +CPU= 39.413
  02:27:31 STEP  984 H= 246:00 +CPU= 47.081
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000984
  02:28:06 STEP  985 H= 246:15 +CPU= 35.127
  02:28:41 STEP  986 H= 246:30 +CPU= 35.181
  02:29:18 STEP  987 H= 246:45 +CPU= 36.823
  02:29:57 STEP  988 H= 247:00 +CPU= 38.699
  02:30:35 STEP  989 H= 247:15 +CPU= 37.378
  02:31:12 STEP  990 H= 247:30 +CPU= 36.989
  02:31:50 STEP  991 H= 247:45 +CPU= 38.304
  02:32:30 STEP  992 H= 248:00 +CPU= 39.071
  02:33:08 STEP  993 H= 248:15 +CPU= 38.789
  02:33:47 STEP  994 H= 248:30 +CPU= 38.101
  02:34:26 STEP  995 H= 248:45 +CPU= 38.973
  02:35:13 STEP  996 H= 249:00 +CPU= 45.838
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+000996
  02:35:51 STEP  997 H= 249:15 +CPU= 38.279
  02:36:30 STEP  998 H= 249:30 +CPU= 38.193
  02:37:09 STEP  999 H= 249:45 +CPU= 39.480
  02:37:45 STEP 1000 H= 250:00 +CPU= 36.206
  02:38:24 STEP 1001 H= 250:15 +CPU= 38.448
  02:39:03 STEP 1002 H= 250:30 +CPU= 38.968
  02:39:43 STEP 1003 H= 250:45 +CPU= 39.613
  02:40:23 STEP 1004 H= 251:00 +CPU= 40.154
  02:40:59 STEP 1005 H= 251:15 +CPU= 36.341
  02:41:35 STEP 1006 H= 251:30 +CPU= 36.045
  02:42:14 STEP 1007 H= 251:45 +CPU= 38.208
  02:43:04 STEP 1008 H= 252:00 +CPU= 49.988
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001008
  02:43:40 STEP 1009 H= 252:15 +CPU= 35.296
  02:44:14 STEP 1010 H= 252:30 +CPU= 34.841
  02:44:50 STEP 1011 H= 252:45 +CPU= 35.078
  02:45:30 STEP 1012 H= 253:00 +CPU= 40.366
  02:46:10 STEP 1013 H= 253:15 +CPU= 39.617
  02:46:49 STEP 1014 H= 253:30 +CPU= 39.462
  02:47:29 STEP 1015 H= 253:45 +CPU= 39.565
  02:48:09 STEP 1016 H= 254:00 +CPU= 40.397
  02:48:49 STEP 1017 H= 254:15 +CPU= 39.619
  02:49:29 STEP 1018 H= 254:30 +CPU= 39.308
  02:50:04 STEP 1019 H= 254:45 +CPU= 35.560
  02:50:52 STEP 1020 H= 255:00 +CPU= 46.883
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001020
  02:51:27 STEP 1021 H= 255:15 +CPU= 35.556
  02:52:06 STEP 1022 H= 255:30 +CPU= 37.977
  02:52:41 STEP 1023 H= 255:45 +CPU= 35.290
  02:53:18 STEP 1024 H= 256:00 +CPU= 36.605
  02:53:56 STEP 1025 H= 256:15 +CPU= 37.356
  02:54:34 STEP 1026 H= 256:30 +CPU= 37.330
  02:55:12 STEP 1027 H= 256:45 +CPU= 36.913
  02:55:47 STEP 1028 H= 257:00 +CPU= 35.242
  02:56:25 STEP 1029 H= 257:15 +CPU= 38.235
  02:57:04 STEP 1030 H= 257:30 +CPU= 38.872
  02:57:43 STEP 1031 H= 257:45 +CPU= 38.437
  02:58:30 STEP 1032 H= 258:00 +CPU= 47.769
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001032
  02:59:08 STEP 1033 H= 258:15 +CPU= 37.141
  02:59:42 STEP 1034 H= 258:30 +CPU= 34.611
  03:00:19 STEP 1035 H= 258:45 +CPU= 36.990
  03:00:57 STEP 1036 H= 259:00 +CPU= 37.584
  03:01:36 STEP 1037 H= 259:15 +CPU= 38.721
  03:02:13 STEP 1038 H= 259:30 +CPU= 37.446
  03:02:52 STEP 1039 H= 259:45 +CPU= 38.518
  03:03:32 STEP 1040 H= 260:00 +CPU= 39.481
  03:04:11 STEP 1041 H= 260:15 +CPU= 38.858
  03:04:52 STEP 1042 H= 260:30 +CPU= 40.463
  03:05:28 STEP 1043 H= 260:45 +CPU= 36.053
  03:06:15 STEP 1044 H= 261:00 +CPU= 47.191
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001044
  03:06:55 STEP 1045 H= 261:15 +CPU= 40.117
  03:07:35 STEP 1046 H= 261:30 +CPU= 39.380
  03:08:13 STEP 1047 H= 261:45 +CPU= 37.977
  03:08:53 STEP 1048 H= 262:00 +CPU= 39.875
  03:09:32 STEP 1049 H= 262:15 +CPU= 38.513
  03:10:13 STEP 1050 H= 262:30 +CPU= 40.365
  03:10:52 STEP 1051 H= 262:45 +CPU= 39.467
  03:11:29 STEP 1052 H= 263:00 +CPU= 36.537
  03:12:05 STEP 1053 H= 263:15 +CPU= 36.179
  03:12:42 STEP 1054 H= 263:30 +CPU= 36.937
  03:13:21 STEP 1055 H= 263:45 +CPU= 38.585
  03:14:15 STEP 1056 H= 264:00 +CPU= 53.690
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a319_2016092300_20_1017_12285760_0_r673430607_10.zip
Uploading the intermediate file: upload_file_10.zip
  03:14:54 STEP 1057 H= 264:15 +CPU= 38.754
  03:15:31 STEP 1058 H= 264:30 +CPU= 36.692
  03:16:08 STEP 1059 H= 264:45 +CPU= 36.709
  03:16:44 STEP 1060 H= 265:00 +CPU= 36.449
  03:17:20 STEP 1061 H= 265:15 +CPU= 35.260
  03:17:57 STEP 1062 H= 265:30 +CPU= 37.508
  03:18:34 STEP 1063 H= 265:45 +CPU= 36.770
  03:19:11 STEP 1064 H= 266:00 +CPU= 36.962
  03:19:48 STEP 1065 H= 266:15 +CPU= 36.524
  03:20:29 STEP 1066 H= 266:30 +CPU= 40.750
  03:21:09 STEP 1067 H= 266:45 +CPU= 39.918
  03:21:56 STEP 1068 H= 267:00 +CPU= 46.390
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001068
  03:22:34 STEP 1069 H= 267:15 +CPU= 37.834
  03:23:09 STEP 1070 H= 267:30 +CPU= 35.479
  03:23:45 STEP 1071 H= 267:45 +CPU= 35.631
  03:24:21 STEP 1072 H= 268:00 +CPU= 36.106
  03:24:56 STEP 1073 H= 268:15 +CPU= 34.921
  03:25:35 STEP 1074 H= 268:30 +CPU= 38.935
  03:26:15 STEP 1075 H= 268:45 +CPU= 39.934
  03:26:51 STEP 1076 H= 269:00 +CPU= 36.247
  03:27:27 STEP 1077 H= 269:15 +CPU= 35.881
  03:28:04 STEP 1078 H= 269:30 +CPU= 36.089
  03:28:39 STEP 1079 H= 269:45 +CPU= 35.791
  03:29:24 STEP 1080 H= 270:00 +CPU= 44.132
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001080
  03:29:59 STEP 1081 H= 270:15 +CPU= 34.925
  03:30:34 STEP 1082 H= 270:30 +CPU= 35.193
  03:31:10 STEP 1083 H= 270:45 +CPU= 36.076
  03:31:46 STEP 1084 H= 271:00 +CPU= 36.231
  03:32:21 STEP 1085 H= 271:15 +CPU= 34.825
  03:32:57 STEP 1086 H= 271:30 +CPU= 35.956
  03:33:35 STEP 1087 H= 271:45 +CPU= 37.319
  03:34:14 STEP 1088 H= 272:00 +CPU= 38.846
  03:34:51 STEP 1089 H= 272:15 +CPU= 37.719
  03:35:31 STEP 1090 H= 272:30 +CPU= 38.915
  03:36:06 STEP 1091 H= 272:45 +CPU= 35.369
  03:36:51 STEP 1092 H= 273:00 +CPU= 44.512
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001092
  03:37:28 STEP 1093 H= 273:15 +CPU= 37.508
  03:38:08 STEP 1094 H= 273:30 +CPU= 39.028
  03:38:45 STEP 1095 H= 273:45 +CPU= 37.458
  03:39:25 STEP 1096 H= 274:00 +CPU= 39.136
  03:40:03 STEP 1097 H= 274:15 +CPU= 38.803
  03:40:43 STEP 1098 H= 274:30 +CPU= 39.027
  03:41:22 STEP 1099 H= 274:45 +CPU= 38.870
  03:41:57 STEP 1100 H= 275:00 +CPU= 35.269
  03:42:34 STEP 1101 H= 275:15 +CPU= 36.775
  03:43:09 STEP 1102 H= 275:30 +CPU= 34.596
  03:43:46 STEP 1103 H= 275:45 +CPU= 36.462
  03:44:34 STEP 1104 H= 276:00 +CPU= 47.826
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001104
  03:45:13 STEP 1105 H= 276:15 +CPU= 38.892
  03:45:52 STEP 1106 H= 276:30 +CPU= 39.520
  03:46:28 STEP 1107 H= 276:45 +CPU= 35.854
  03:47:04 STEP 1108 H= 277:00 +CPU= 35.600
  03:47:42 STEP 1109 H= 277:15 +CPU= 38.102
  03:48:19 STEP 1110 H= 277:30 +CPU= 36.531
  03:48:54 STEP 1111 H= 277:45 +CPU= 35.388
  03:49:30 STEP 1112 H= 278:00 +CPU= 35.580
  03:50:05 STEP 1113 H= 278:15 +CPU= 34.760
  03:50:42 STEP 1114 H= 278:30 +CPU= 37.364
  03:51:19 STEP 1115 H= 278:45 +CPU= 37.194
  03:52:06 STEP 1116 H= 279:00 +CPU= 46.479
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001116
  03:52:42 STEP 1117 H= 279:15 +CPU= 35.438
  03:53:18 STEP 1118 H= 279:30 +CPU= 36.519
  03:53:54 STEP 1119 H= 279:45 +CPU= 35.680
  03:54:30 STEP 1120 H= 280:00 +CPU= 35.834
  03:55:08 STEP 1121 H= 280:15 +CPU= 38.054
  03:55:46 STEP 1122 H= 280:30 +CPU= 37.626
  03:56:22 STEP 1123 H= 280:45 +CPU= 36.051
  03:56:58 STEP 1124 H= 281:00 +CPU= 36.593
  03:57:38 STEP 1125 H= 281:15 +CPU= 39.391
  03:58:14 STEP 1126 H= 281:30 +CPU= 36.297
  03:58:53 STEP 1127 H= 281:45 +CPU= 38.292
  03:59:41 STEP 1128 H= 282:00 +CPU= 48.200
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001128
  04:00:20 STEP 1129 H= 282:15 +CPU= 39.217
  04:00:57 STEP 1130 H= 282:30 +CPU= 36.765
  04:01:33 STEP 1131 H= 282:45 +CPU= 36.197
  04:02:10 STEP 1132 H= 283:00 +CPU= 36.888
  04:02:50 STEP 1133 H= 283:15 +CPU= 39.421
  04:03:29 STEP 1134 H= 283:30 +CPU= 39.124
  04:04:05 STEP 1135 H= 283:45 +CPU= 36.223
  04:04:46 STEP 1136 H= 284:00 +CPU= 40.913
  04:05:25 STEP 1137 H= 284:15 +CPU= 39.226
  04:06:05 STEP 1138 H= 284:30 +CPU= 39.914
  04:06:42 STEP 1139 H= 284:45 +CPU= 36.626
  04:07:29 STEP 1140 H= 285:00 +CPU= 45.805
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001140
  04:08:05 STEP 1141 H= 285:15 +CPU= 35.585
  04:08:40 STEP 1142 H= 285:30 +CPU= 35.248
  04:09:20 STEP 1143 H= 285:45 +CPU= 38.985
  04:10:01 STEP 1144 H= 286:00 +CPU= 40.728
  04:10:41 STEP 1145 H= 286:15 +CPU= 39.717
  04:11:19 STEP 1146 H= 286:30 +CPU= 37.715
  04:11:58 STEP 1147 H= 286:45 +CPU= 39.065
  04:12:38 STEP 1148 H= 287:00 +CPU= 40.218
  04:13:15 STEP 1149 H= 287:15 +CPU= 36.763
  04:13:54 STEP 1150 H= 287:30 +CPU= 39.027
  04:14:34 STEP 1151 H= 287:45 +CPU= 39.814
  04:15:28 STEP 1152 H= 288:00 +CPU= 53.393
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a319_2016092300_20_1017_12285760_0_r673430607_11.zip
Uploading the intermediate file: upload_file_11.zip
  04:16:06 STEP 1153 H= 288:15 +CPU= 37.853
  04:16:45 STEP 1154 H= 288:30 +CPU= 38.574
  04:17:21 STEP 1155 H= 288:45 +CPU= 36.813
  04:18:02 STEP 1156 H= 289:00 +CPU= 40.136
  04:18:40 STEP 1157 H= 289:15 +CPU= 37.637
  04:19:19 STEP 1158 H= 289:30 +CPU= 39.613
  04:19:59 STEP 1159 H= 289:45 +CPU= 39.781
  04:20:37 STEP 1160 H= 290:00 +CPU= 37.292
  04:21:14 STEP 1161 H= 290:15 +CPU= 36.874
  04:21:52 STEP 1162 H= 290:30 +CPU= 38.704
  04:22:33 STEP 1163 H= 290:45 +CPU= 40.101
  04:23:17 STEP 1164 H= 291:00 +CPU= 44.473
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001164
  04:23:54 STEP 1165 H= 291:15 +CPU= 36.846
  04:24:33 STEP 1166 H= 291:30 +CPU= 39.190
  04:25:12 STEP 1167 H= 291:45 +CPU= 38.552
  04:25:53 STEP 1168 H= 292:00 +CPU= 40.624
  04:26:31 STEP 1169 H= 292:15 +CPU= 37.733
  04:27:11 STEP 1170 H= 292:30 +CPU= 40.353
  04:27:51 STEP 1171 H= 292:45 +CPU= 39.536
  04:28:29 STEP 1172 H= 293:00 +CPU= 37.879
  04:29:10 STEP 1173 H= 293:15 +CPU= 40.527
  04:29:51 STEP 1174 H= 293:30 +CPU= 41.233
  04:30:32 STEP 1175 H= 293:45 +CPU= 40.310
  04:31:20 STEP 1176 H= 294:00 +CPU= 48.574
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001176
  04:31:57 STEP 1177 H= 294:15 +CPU= 36.971
  04:32:35 STEP 1178 H= 294:30 +CPU= 37.393
  04:33:16 STEP 1179 H= 294:45 +CPU= 40.407
  04:33:58 STEP 1180 H= 295:00 +CPU= 41.687
  04:34:35 STEP 1181 H= 295:15 +CPU= 36.724
  04:35:14 STEP 1182 H= 295:30 +CPU= 38.869
  04:35:55 STEP 1183 H= 295:45 +CPU= 41.470
  04:36:34 STEP 1184 H= 296:00 +CPU= 38.205
  04:37:11 STEP 1185 H= 296:15 +CPU= 37.032
  04:37:48 STEP 1186 H= 296:30 +CPU= 37.614
  04:38:30 STEP 1187 H= 296:45 +CPU= 41.104
  04:39:21 STEP 1188 H= 297:00 +CPU= 50.794
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001188
  04:40:01 STEP 1189 H= 297:15 +CPU= 40.202
  04:40:38 STEP 1190 H= 297:30 +CPU= 37.075
  04:41:18 STEP 1191 H= 297:45 +CPU= 39.963
  04:42:00 STEP 1192 H= 298:00 +CPU= 42.112
  04:42:42 STEP 1193 H= 298:15 +CPU= 40.948
  04:43:22 STEP 1194 H= 298:30 +CPU= 40.350
  04:43:58 STEP 1195 H= 298:45 +CPU= 36.198
  04:44:36 STEP 1196 H= 299:00 +CPU= 37.698
  04:45:15 STEP 1197 H= 299:15 +CPU= 37.990
  04:45:55 STEP 1198 H= 299:30 +CPU= 39.957
  04:46:34 STEP 1199 H= 299:45 +CPU= 38.758
  04:47:28 STEP 1200 H= 300:00 +CPU= 52.961
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001200
  04:48:09 STEP 1201 H= 300:15 +CPU= 40.951
  04:48:46 STEP 1202 H= 300:30 +CPU= 37.475
  04:49:27 STEP 1203 H= 300:45 +CPU= 40.536
  04:50:08 STEP 1204 H= 301:00 +CPU= 40.567
  04:50:46 STEP 1205 H= 301:15 +CPU= 38.859
  04:51:24 STEP 1206 H= 301:30 +CPU= 37.096
  04:52:02 STEP 1207 H= 301:45 +CPU= 38.725
  04:52:43 STEP 1208 H= 302:00 +CPU= 40.253
  04:53:22 STEP 1209 H= 302:15 +CPU= 38.778
  04:54:02 STEP 1210 H= 302:30 +CPU= 39.928
  04:54:39 STEP 1211 H= 302:45 +CPU= 37.242
  04:55:31 STEP 1212 H= 303:00 +CPU= 51.044
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001212
  04:56:11 STEP 1213 H= 303:15 +CPU= 39.288
  04:56:49 STEP 1214 H= 303:30 +CPU= 38.251
  04:57:26 STEP 1215 H= 303:45 +CPU= 37.010
  04:58:05 STEP 1216 H= 304:00 +CPU= 38.606
  04:58:46 STEP 1217 H= 304:15 +CPU= 41.065
  04:59:27 STEP 1218 H= 304:30 +CPU= 40.924
  05:00:04 STEP 1219 H= 304:45 +CPU= 37.321
  05:00:44 STEP 1220 H= 305:00 +CPU= 39.339
  05:01:23 STEP 1221 H= 305:15 +CPU= 39.514
  05:02:05 STEP 1222 H= 305:30 +CPU= 41.457
  05:02:45 STEP 1223 H= 305:45 +CPU= 40.860
  05:03:33 STEP 1224 H= 306:00 +CPU= 47.601
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001224
  05:04:13 STEP 1225 H= 306:15 +CPU= 39.310
  05:04:49 STEP 1226 H= 306:30 +CPU= 36.689
  05:05:30 STEP 1227 H= 306:45 +CPU= 40.046
  05:06:11 STEP 1228 H= 307:00 +CPU= 41.146
  05:06:48 STEP 1229 H= 307:15 +CPU= 36.753
  05:07:26 STEP 1230 H= 307:30 +CPU= 37.912
  05:08:06 STEP 1231 H= 307:45 +CPU= 40.015
  05:08:43 STEP 1232 H= 308:00 +CPU= 37.437
  05:09:20 STEP 1233 H= 308:15 +CPU= 36.574
  05:09:57 STEP 1234 H= 308:30 +CPU= 36.609
  05:10:36 STEP 1235 H= 308:45 +CPU= 39.325
  05:11:27 STEP 1236 H= 309:00 +CPU= 50.946
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001236
  05:12:05 STEP 1237 H= 309:15 +CPU= 37.756
  05:12:45 STEP 1238 H= 309:30 +CPU= 39.993
  05:13:24 STEP 1239 H= 309:45 +CPU= 38.803
  05:14:06 STEP 1240 H= 310:00 +CPU= 42.106
  05:14:48 STEP 1241 H= 310:15 +CPU= 41.577
  05:15:30 STEP 1242 H= 310:30 +CPU= 41.814
  05:16:12 STEP 1243 H= 310:45 +CPU= 41.577
  05:16:53 STEP 1244 H= 311:00 +CPU= 41.493
  05:17:31 STEP 1245 H= 311:15 +CPU= 37.970
  05:18:08 STEP 1246 H= 311:30 +CPU= 36.471
  05:18:46 STEP 1247 H= 311:45 +CPU= 36.755
  05:19:38 STEP 1248 H= 312:00 +CPU= 51.326
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a319_2016092300_20_1017_12285760_0_r673430607_12.zip
Uploading the intermediate file: upload_file_12.zip
  05:20:17 STEP 1249 H= 312:15 +CPU= 38.485
  05:20:56 STEP 1250 H= 312:30 +CPU= 39.155
  05:21:35 STEP 1251 H= 312:45 +CPU= 38.451
  05:22:14 STEP 1252 H= 313:00 +CPU= 39.140
  05:22:53 STEP 1253 H= 313:15 +CPU= 39.240
  05:23:35 STEP 1254 H= 313:30 +CPU= 41.570
  05:24:16 STEP 1255 H= 313:45 +CPU= 40.485
  05:24:57 STEP 1256 H= 314:00 +CPU= 39.796
  05:25:38 STEP 1257 H= 314:15 +CPU= 41.371
  05:26:17 STEP 1258 H= 314:30 +CPU= 38.423
  05:26:56 STEP 1259 H= 314:45 +CPU= 39.453
  05:27:44 STEP 1260 H= 315:00 +CPU= 47.620
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001260
  05:28:23 STEP 1261 H= 315:15 +CPU= 39.156
  05:29:04 STEP 1262 H= 315:30 +CPU= 40.659
  05:29:40 STEP 1263 H= 315:45 +CPU= 36.025
  05:30:17 STEP 1264 H= 316:00 +CPU= 36.814
  05:30:53 STEP 1265 H= 316:15 +CPU= 36.034
  05:31:32 STEP 1266 H= 316:30 +CPU= 38.720
  05:32:12 STEP 1267 H= 316:45 +CPU= 40.354
  05:32:53 STEP 1268 H= 317:00 +CPU= 40.938
  05:33:33 STEP 1269 H= 317:15 +CPU= 40.011
  05:34:14 STEP 1270 H= 317:30 +CPU= 40.459
  05:34:51 STEP 1271 H= 317:45 +CPU= 37.001
  05:35:38 STEP 1272 H= 318:00 +CPU= 46.300
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001272
  05:36:15 STEP 1273 H= 318:15 +CPU= 37.177
  05:36:55 STEP 1274 H= 318:30 +CPU= 40.036
  05:37:36 STEP 1275 H= 318:45 +CPU= 40.754
  05:38:14 STEP 1276 H= 319:00 +CPU= 37.854
  05:38:55 STEP 1277 H= 319:15 +CPU= 41.074
  05:39:33 STEP 1278 H= 319:30 +CPU= 37.914
  05:40:12 STEP 1279 H= 319:45 +CPU= 39.014
  05:40:53 STEP 1280 H= 320:00 +CPU= 40.530
  05:41:33 STEP 1281 H= 320:15 +CPU= 40.463
  05:42:13 STEP 1282 H= 320:30 +CPU= 40.191
  05:42:54 STEP 1283 H= 320:45 +CPU= 40.749
  05:43:44 STEP 1284 H= 321:00 +CPU= 49.314
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001284
  05:44:20 STEP 1285 H= 321:15 +CPU= 36.264
  05:44:56 STEP 1286 H= 321:30 +CPU= 36.021
  05:45:33 STEP 1287 H= 321:45 +CPU= 36.377
  05:46:13 STEP 1288 H= 322:00 +CPU= 40.497
  05:46:50 STEP 1289 H= 322:15 +CPU= 36.485
  05:47:28 STEP 1290 H= 322:30 +CPU= 38.051
  05:48:09 STEP 1291 H= 322:45 +CPU= 40.309
  05:48:47 STEP 1292 H= 323:00 +CPU= 37.914
  05:49:28 STEP 1293 H= 323:15 +CPU= 40.800
  05:50:04 STEP 1294 H= 323:30 +CPU= 36.782
  05:50:45 STEP 1295 H= 323:45 +CPU= 40.189
  05:51:40 STEP 1296 H= 324:00 +CPU= 54.228
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001296
  05:52:21 STEP 1297 H= 324:15 +CPU= 40.889
  05:52:58 STEP 1298 H= 324:30 +CPU= 36.457
  05:53:37 STEP 1299 H= 324:45 +CPU= 39.881
  05:54:15 STEP 1300 H= 325:00 +CPU= 37.193
  05:54:53 STEP 1301 H= 325:15 +CPU= 38.166
  05:55:31 STEP 1302 H= 325:30 +CPU= 37.554
  05:56:10 STEP 1303 H= 325:45 +CPU= 39.238
  05:56:51 STEP 1304 H= 326:00 +CPU= 39.666
  05:57:28 STEP 1305 H= 326:15 +CPU= 36.533
  05:58:07 STEP 1306 H= 326:30 +CPU= 39.519
  05:58:48 STEP 1307 H= 326:45 +CPU= 40.774
  05:59:38 STEP 1308 H= 327:00 +CPU= 49.708
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001308
  06:00:19 STEP 1309 H= 327:15 +CPU= 39.834
  06:01:00 STEP 1310 H= 327:30 +CPU= 40.395
  06:01:37 STEP 1311 H= 327:45 +CPU= 36.857
  06:02:16 STEP 1312 H= 328:00 +CPU= 38.121
  06:02:57 STEP 1313 H= 328:15 +CPU= 41.341
  06:03:38 STEP 1314 H= 328:30 +CPU= 40.428
  06:04:20 STEP 1315 H= 328:45 +CPU= 41.004
  06:04:59 STEP 1316 H= 329:00 +CPU= 38.250
  06:05:39 STEP 1317 H= 329:15 +CPU= 39.998
  06:06:17 STEP 1318 H= 329:30 +CPU= 37.560
  06:06:58 STEP 1319 H= 329:45 +CPU= 40.712
  06:07:45 STEP 1320 H= 330:00 +CPU= 47.434
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001320
  06:08:26 STEP 1321 H= 330:15 +CPU= 40.265
  06:09:06 STEP 1322 H= 330:30 +CPU= 39.802
  06:09:42 STEP 1323 H= 330:45 +CPU= 36.436
  06:10:23 STEP 1324 H= 331:00 +CPU= 40.556
  06:11:04 STEP 1325 H= 331:15 +CPU= 40.868
  06:11:45 STEP 1326 H= 331:30 +CPU= 41.123
  06:12:26 STEP 1327 H= 331:45 +CPU= 40.642
  06:13:09 STEP 1328 H= 332:00 +CPU= 42.689
  06:13:49 STEP 1329 H= 332:15 +CPU= 39.786
  06:14:29 STEP 1330 H= 332:30 +CPU= 39.141
  06:15:10 STEP 1331 H= 332:45 +CPU= 38.678
  06:16:00 STEP 1332 H= 333:00 +CPU= 48.618
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001332
  06:16:41 STEP 1333 H= 333:15 +CPU= 40.634
  06:17:18 STEP 1334 H= 333:30 +CPU= 37.516
  06:17:57 STEP 1335 H= 333:45 +CPU= 38.709
  06:18:37 STEP 1336 H= 334:00 +CPU= 40.134
  06:19:17 STEP 1337 H= 334:15 +CPU= 39.388
  06:19:56 STEP 1338 H= 334:30 +CPU= 37.762
  06:20:35 STEP 1339 H= 334:45 +CPU= 39.430
  06:21:16 STEP 1340 H= 335:00 +CPU= 39.786
  06:21:56 STEP 1341 H= 335:15 +CPU= 40.677
  06:22:38 STEP 1342 H= 335:30 +CPU= 41.329
  06:23:15 STEP 1343 H= 335:45 +CPU= 37.233
  06:24:10 STEP 1344 H= 336:00 +CPU= 54.699
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a319_2016092300_20_1017_12285760_0_r673430607_13.zip
Uploading the intermediate file: upload_file_13.zip
  06:24:47 STEP 1345 H= 336:15 +CPU= 37.185
  06:25:26 STEP 1346 H= 336:30 +CPU= 39.085
  06:26:07 STEP 1347 H= 336:45 +CPU= 40.588
  06:26:49 STEP 1348 H= 337:00 +CPU= 41.712
  06:27:30 STEP 1349 H= 337:15 +CPU= 41.120
  06:28:08 STEP 1350 H= 337:30 +CPU= 37.323
  06:28:44 STEP 1351 H= 337:45 +CPU= 36.183
  06:29:23 STEP 1352 H= 338:00 +CPU= 38.393
  06:30:00 STEP 1353 H= 338:15 +CPU= 36.878
  06:30:39 STEP 1354 H= 338:30 +CPU= 38.943
  06:31:19 STEP 1355 H= 338:45 +CPU= 39.417
  06:32:10 STEP 1356 H= 339:00 +CPU= 50.806
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001356
  06:32:51 STEP 1357 H= 339:15 +CPU= 40.729
  06:33:32 STEP 1358 H= 339:30 +CPU= 41.463
  06:34:13 STEP 1359 H= 339:45 +CPU= 40.597
  06:34:55 STEP 1360 H= 340:00 +CPU= 42.077
  06:35:36 STEP 1361 H= 340:15 +CPU= 40.648
  06:36:18 STEP 1362 H= 340:30 +CPU= 42.736
  06:36:59 STEP 1363 H= 340:45 +CPU= 39.733
  06:37:41 STEP 1364 H= 341:00 +CPU= 42.062
  06:38:23 STEP 1365 H= 341:15 +CPU= 41.332
  06:39:03 STEP 1366 H= 341:30 +CPU= 40.433
  06:39:41 STEP 1367 H= 341:45 +CPU= 36.988
  06:40:31 STEP 1368 H= 342:00 +CPU= 50.282
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001368
  06:41:08 STEP 1369 H= 342:15 +CPU= 36.765
  06:41:49 STEP 1370 H= 342:30 +CPU= 41.327
  06:42:30 STEP 1371 H= 342:45 +CPU= 41.106
  06:43:11 STEP 1372 H= 343:00 +CPU= 40.523
  06:43:49 STEP 1373 H= 343:15 +CPU= 37.903
  06:44:27 STEP 1374 H= 343:30 +CPU= 38.327
  06:45:09 STEP 1375 H= 343:45 +CPU= 41.528
  06:45:52 STEP 1376 H= 344:00 +CPU= 43.291
  06:46:35 STEP 1377 H= 344:15 +CPU= 42.237
  06:47:17 STEP 1378 H= 344:30 +CPU= 42.193
  06:47:54 STEP 1379 H= 344:45 +CPU= 37.508
  06:48:45 STEP 1380 H= 345:00 +CPU= 50.676
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001380
  06:49:29 STEP 1381 H= 345:15 +CPU= 43.542
  06:50:11 STEP 1382 H= 345:30 +CPU= 41.980
  06:50:52 STEP 1383 H= 345:45 +CPU= 40.752
  06:51:32 STEP 1384 H= 346:00 +CPU= 40.494
  06:52:15 STEP 1385 H= 346:15 +CPU= 42.738
  06:52:53 STEP 1386 H= 346:30 +CPU= 37.485
  06:53:30 STEP 1387 H= 346:45 +CPU= 36.999
  06:54:08 STEP 1388 H= 347:00 +CPU= 37.830
  06:54:46 STEP 1389 H= 347:15 +CPU= 37.728
  06:55:23 STEP 1390 H= 347:30 +CPU= 37.130
  06:56:03 STEP 1391 H= 347:45 +CPU= 39.274
  06:56:58 STEP 1392 H= 348:00 +CPU= 55.285
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001392
  06:57:38 STEP 1393 H= 348:15 +CPU= 39.337
  06:58:17 STEP 1394 H= 348:30 +CPU= 38.885
  06:59:00 STEP 1395 H= 348:45 +CPU= 42.953
  06:59:44 STEP 1396 H= 349:00 +CPU= 43.860
  07:00:27 STEP 1397 H= 349:15 +CPU= 42.396
  07:01:08 STEP 1398 H= 349:30 +CPU= 41.234
  07:01:50 STEP 1399 H= 349:45 +CPU= 41.792
  07:02:34 STEP 1400 H= 350:00 +CPU= 43.752
  07:03:14 STEP 1401 H= 350:15 +CPU= 39.951
  07:03:50 STEP 1402 H= 350:30 +CPU= 36.417
  07:04:27 STEP 1403 H= 350:45 +CPU= 36.879
  07:05:18 STEP 1404 H= 351:00 +CPU= 50.193
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001404
  07:05:56 STEP 1405 H= 351:15 +CPU= 37.768
  07:06:36 STEP 1406 H= 351:30 +CPU= 40.032
  07:07:14 STEP 1407 H= 351:45 +CPU= 37.802
  07:07:56 STEP 1408 H= 352:00 +CPU= 41.730
  07:08:37 STEP 1409 H= 352:15 +CPU= 41.350
  07:09:19 STEP 1410 H= 352:30 +CPU= 41.646
  07:10:02 STEP 1411 H= 352:45 +CPU= 43.082
  07:10:44 STEP 1412 H= 353:00 +CPU= 41.377
  07:11:24 STEP 1413 H= 353:15 +CPU= 39.785
  07:12:06 STEP 1414 H= 353:30 +CPU= 41.803
  07:12:44 STEP 1415 H= 353:45 +CPU= 37.875
  07:13:35 STEP 1416 H= 354:00 +CPU= 50.989
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001416
  07:14:17 STEP 1417 H= 354:15 +CPU= 41.437
  07:14:59 STEP 1418 H= 354:30 +CPU= 42.330
  07:15:40 STEP 1419 H= 354:45 +CPU= 40.948
  07:16:23 STEP 1420 H= 355:00 +CPU= 42.418
  07:17:01 STEP 1421 H= 355:15 +CPU= 37.932
  07:17:39 STEP 1422 H= 355:30 +CPU= 38.009
  07:18:20 STEP 1423 H= 355:45 +CPU= 40.784
  07:19:00 STEP 1424 H= 356:00 +CPU= 39.661
  07:19:42 STEP 1425 H= 356:15 +CPU= 41.990
  07:20:24 STEP 1426 H= 356:30 +CPU= 41.778
  07:21:06 STEP 1427 H= 356:45 +CPU= 42.129
  07:21:57 STEP 1428 H= 357:00 +CPU= 50.785
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001428
  07:22:40 STEP 1429 H= 357:15 +CPU= 42.335
  07:23:23 STEP 1430 H= 357:30 +CPU= 43.191
  07:24:05 STEP 1431 H= 357:45 +CPU= 41.395
  07:24:49 STEP 1432 H= 358:00 +CPU= 44.051
  07:25:32 STEP 1433 H= 358:15 +CPU= 43.673
  07:26:13 STEP 1434 H= 358:30 +CPU= 40.770
  07:26:55 STEP 1435 H= 358:45 +CPU= 42.063
  07:27:40 STEP 1436 H= 359:00 +CPU= 44.461
  07:28:23 STEP 1437 H= 359:15 +CPU= 43.108
  07:29:07 STEP 1438 H= 359:30 +CPU= 43.767
  07:29:50 STEP 1439 H= 359:45 +CPU= 43.453
  07:30:46 STEP 1440 H= 360:00 +CPU= 55.040
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.3304355216E-20      I       0.1000274022E-05      I
ICloud fractionI      0.0000000000E+00      I       0.8995018193E-02      I
I  Relat. Hum. I      0.4819293881E+00      I       0.4913705025E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.1565531325E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    302500500 BYTES IN      7 RECORDS TRANSFERRED IN    0.0019 SECONDS159210.8 Mbytes/s, TOTAL TIME=    0.0204( 9.3%)
 07:30:46 STEP 1440 H= 360:00 +CPU= 55.040
 END CNT3
 NSTEP =  1440 CNT0   000000000  40.364  40.364  41.069   0.983               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************    97.1     0.0    97.1     0.0   203.4
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    5897.0    5897.0     17.26      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1095.8    1095.8      2.96      0.00
  10 SCAN2M - PHYSICS                             1441   16741.7   16741.7     45.21      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1127.4    1127.4      0.26      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      59.5      59.5      0.01      0.00
  14 SUINIF                                          1    8208.1    8208.1      0.02      0.00
  17 GRIDFPOS IN CNT4                              121      36.6      36.6      0.01      0.00
  18 SUSPECG                                         1    3993.7    3993.7      0.01      0.00
  19 SUSPEC                                          1    4004.3    4004.3      0.01      0.00
  24 SUGRIDU                                         1    3223.1    3223.1      0.01      0.00
  25 SPECRT                                          1     327.2     327.2      0.00      0.00
  26 SUGRIDF                                         1     653.5     653.5      0.00      0.00
  27 RESTART FILES - WRITING                        30    4547.3    4547.3      0.26      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121    7907.7    7907.7      1.79      0.00
  31 POSDDH IN STEPO                                 7       1.0       1.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    7654.3    7654.3     20.67      0.00
  39 SU0YOMB                                         1     448.2     448.2      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      34.9      34.9      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     528.2     528.2      1.43      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440     100.6     100.6      0.27      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.4       0.4      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     733.5     733.5      4.30      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     392.0     392.0      2.21      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     135.5     135.5      0.76      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     194.3     194.3      1.14      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      44.5      44.5      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      76.4      76.4      0.45      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      38.9      38.9      0.22      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     134.1     134.1      0.79      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      78.1      78.1      0.44      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    53360.9 CPU TIME   53132.9 VECTOR TIME    53132.9


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       24.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/27/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/27/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/27/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12285760/ICMGGh7zg+001440
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a319_2016092300_20_1017_12285760_0_r673430607_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
07:34:19 (3947359): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a319_2016092300_20_1017_12285760_0_r673430607_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a319_2016092300_20_1017_12285760_0_r673430607_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a319_2016092300_20_1017_12285760_0_r673430607_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a319_2016092300_20_1017_12285760_0_r673430607_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a319_2016092300_20_1017_12285760_0_r673430607_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 13:04:05 1499547 22437370 oifs_43r3_bl_a319_2016092300_20_1017_12285760_0 1,295,100 53,133 0.0410
08 Jun 2024 08:11:44 1499547 22437370 oifs_43r3_bl_a319_2016092300_20_1017_12285760_0 864,000 34,093 0.0395


©2024 climateprediction.net