climateprediction.net home page
Task 22435136

Task 22435136

Name oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0
Workunit 12283557
Created 7 Jun 2024, 13:21:04 UTC
Sent 7 Jun 2024, 14:16:51 UTC
Report deadline 6 Aug 2024, 14:16:51 UTC
Received 8 Jun 2024, 10:01:45 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1538899
Run time 18 hours 45 min 25 sec
CPU time 18 hours 34 min 27 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 3.88 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,025.08 MB
Peak swap size 5,980.81 MB
Peak disk usage 1,348.64 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
 208:30 +CPU= 46.542
  19:33:24 STEP  835 H= 208:45 +CPU= 46.123
  19:34:11 STEP  836 H= 209:00 +CPU= 47.387
  19:34:57 STEP  837 H= 209:15 +CPU= 45.349
  19:35:44 STEP  838 H= 209:30 +CPU= 46.304
  19:36:30 STEP  839 H= 209:45 +CPU= 45.980
  19:37:27 STEP  840 H= 210:00 +CPU= 56.209
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000840
  19:38:14 STEP  841 H= 210:15 +CPU= 46.387
  19:39:00 STEP  842 H= 210:30 +CPU= 46.011
  19:39:47 STEP  843 H= 210:45 +CPU= 46.487
  19:40:33 STEP  844 H= 211:00 +CPU= 46.265
  19:41:18 STEP  845 H= 211:15 +CPU= 44.003
  19:42:03 STEP  846 H= 211:30 +CPU= 45.313
  19:42:49 STEP  847 H= 211:45 +CPU= 45.885
  19:43:36 STEP  848 H= 212:00 +CPU= 46.693
  19:44:23 STEP  849 H= 212:15 +CPU= 46.471
  19:45:08 STEP  850 H= 212:30 +CPU= 45.585
  19:45:55 STEP  851 H= 212:45 +CPU= 46.418
  19:46:52 STEP  852 H= 213:00 +CPU= 56.485
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000852
  19:47:38 STEP  853 H= 213:15 +CPU= 46.193
  19:48:24 STEP  854 H= 213:30 +CPU= 45.243
  19:49:07 STEP  855 H= 213:45 +CPU= 43.265
  19:49:53 STEP  856 H= 214:00 +CPU= 45.622
  19:50:37 STEP  857 H= 214:15 +CPU= 43.712
  19:51:23 STEP  858 H= 214:30 +CPU= 45.713
  19:52:07 STEP  859 H= 214:45 +CPU= 44.383
  19:52:55 STEP  860 H= 215:00 +CPU= 47.249
  19:53:41 STEP  861 H= 215:15 +CPU= 46.458
  19:54:28 STEP  862 H= 215:30 +CPU= 46.749
  19:55:14 STEP  863 H= 215:45 +CPU= 45.896
  19:56:18 STEP  864 H= 216:00 +CPU= 63.903
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0_r1852416443_8.zip
Uploading the intermediate file: upload_file_8.zip
  19:57:05 STEP  865 H= 216:15 +CPU= 45.495
  19:57:51 STEP  866 H= 216:30 +CPU= 45.203
  19:58:36 STEP  867 H= 216:45 +CPU= 44.976
  19:59:23 STEP  868 H= 217:00 +CPU= 46.908
  20:00:07 STEP  869 H= 217:15 +CPU= 43.695
  20:00:53 STEP  870 H= 217:30 +CPU= 45.714
  20:01:40 STEP  871 H= 217:45 +CPU= 45.808
  20:02:24 STEP  872 H= 218:00 +CPU= 43.934
  20:03:11 STEP  873 H= 218:15 +CPU= 46.515
  20:03:58 STEP  874 H= 218:30 +CPU= 46.795
  20:04:44 STEP  875 H= 218:45 +CPU= 46.035
  20:05:41 STEP  876 H= 219:00 +CPU= 57.407
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000876
  20:06:28 STEP  877 H= 219:15 +CPU= 46.599
  20:07:15 STEP  878 H= 219:30 +CPU= 46.891
  20:08:03 STEP  879 H= 219:45 +CPU= 47.165
  20:08:50 STEP  880 H= 220:00 +CPU= 46.581
  20:09:37 STEP  881 H= 220:15 +CPU= 46.195
  20:10:22 STEP  882 H= 220:30 +CPU= 45.697
  20:11:09 STEP  883 H= 220:45 +CPU= 46.857
  20:11:53 STEP  884 H= 221:00 +CPU= 43.685
  20:12:36 STEP  885 H= 221:15 +CPU= 42.649
  20:13:23 STEP  886 H= 221:30 +CPU= 46.714
  20:14:10 STEP  887 H= 221:45 +CPU= 47.176
  20:15:05 STEP  888 H= 222:00 +CPU= 54.961
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000888
  20:15:48 STEP  889 H= 222:15 +CPU= 43.391
  20:16:35 STEP  890 H= 222:30 +CPU= 46.402
  20:17:19 STEP  891 H= 222:45 +CPU= 43.741
  20:18:04 STEP  892 H= 223:00 +CPU= 45.706
  20:18:49 STEP  893 H= 223:15 +CPU= 43.887
  20:19:36 STEP  894 H= 223:30 +CPU= 46.995
  20:20:22 STEP  895 H= 223:45 +CPU= 46.581
  20:21:09 STEP  896 H= 224:00 +CPU= 46.430
  20:21:56 STEP  897 H= 224:15 +CPU= 46.198
  20:22:42 STEP  898 H= 224:30 +CPU= 45.931
  20:23:26 STEP  899 H= 224:45 +CPU= 42.921
  20:24:25 STEP  900 H= 225:00 +CPU= 58.431
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000900
  20:25:11 STEP  901 H= 225:15 +CPU= 46.640
  20:25:55 STEP  902 H= 225:30 +CPU= 43.234
  20:26:41 STEP  903 H= 225:45 +CPU= 46.338
  20:27:28 STEP  904 H= 226:00 +CPU= 47.116
  20:28:16 STEP  905 H= 226:15 +CPU= 47.488
  20:29:03 STEP  906 H= 226:30 +CPU= 47.122
  20:29:50 STEP  907 H= 226:45 +CPU= 46.919
  20:30:37 STEP  908 H= 227:00 +CPU= 47.535
  20:31:25 STEP  909 H= 227:15 +CPU= 47.275
  20:32:11 STEP  910 H= 227:30 +CPU= 46.063
  20:32:58 STEP  911 H= 227:45 +CPU= 47.054
  20:34:01 STEP  912 H= 228:00 +CPU= 62.408
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000912
  20:34:51 STEP  913 H= 228:15 +CPU= 48.242
  20:35:38 STEP  914 H= 228:30 +CPU= 47.004
  20:36:25 STEP  915 H= 228:45 +CPU= 46.233
  20:37:11 STEP  916 H= 229:00 +CPU= 45.904
  20:37:56 STEP  917 H= 229:15 +CPU= 44.302
  20:38:39 STEP  918 H= 229:30 +CPU= 42.871
  20:39:22 STEP  919 H= 229:45 +CPU= 43.056
  20:40:09 STEP  920 H= 230:00 +CPU= 46.420
  20:40:55 STEP  921 H= 230:15 +CPU= 45.535
  20:41:38 STEP  922 H= 230:30 +CPU= 41.800
  20:42:20 STEP  923 H= 230:45 +CPU= 41.515
  20:43:14 STEP  924 H= 231:00 +CPU= 53.694
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000924
  20:44:00 STEP  925 H= 231:15 +CPU= 46.312
  20:44:46 STEP  926 H= 231:30 +CPU= 45.634
  20:45:32 STEP  927 H= 231:45 +CPU= 45.788
  20:46:19 STEP  928 H= 232:00 +CPU= 46.077
  20:47:02 STEP  929 H= 232:15 +CPU= 42.282
  20:47:48 STEP  930 H= 232:30 +CPU= 45.980
  20:48:34 STEP  931 H= 232:45 +CPU= 45.869
  20:49:18 STEP  932 H= 233:00 +CPU= 44.142
  20:50:03 STEP  933 H= 233:15 +CPU= 44.553
  20:50:53 STEP  934 H= 233:30 +CPU= 48.724
  20:51:39 STEP  935 H= 233:45 +CPU= 46.482
  20:52:37 STEP  936 H= 234:00 +CPU= 56.944
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000936
  20:53:24 STEP  937 H= 234:15 +CPU= 47.344
  20:54:12 STEP  938 H= 234:30 +CPU= 47.412
  20:54:59 STEP  939 H= 234:45 +CPU= 47.678
  20:55:48 STEP  940 H= 235:00 +CPU= 49.033
  20:56:36 STEP  941 H= 235:15 +CPU= 47.651
  20:57:25 STEP  942 H= 235:30 +CPU= 48.361
  20:58:12 STEP  943 H= 235:45 +CPU= 47.552
  20:59:01 STEP  944 H= 236:00 +CPU= 48.413
  20:59:51 STEP  945 H= 236:15 +CPU= 48.611
  21:00:40 STEP  946 H= 236:30 +CPU= 48.422
  21:01:29 STEP  947 H= 236:45 +CPU= 49.482
  21:02:31 STEP  948 H= 237:00 +CPU= 61.118
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000948
  21:03:20 STEP  949 H= 237:15 +CPU= 49.198
  21:04:10 STEP  950 H= 237:30 +CPU= 49.574
  21:04:58 STEP  951 H= 237:45 +CPU= 48.357
  21:05:48 STEP  952 H= 238:00 +CPU= 48.833
  21:06:36 STEP  953 H= 238:15 +CPU= 48.479
  21:07:26 STEP  954 H= 238:30 +CPU= 49.539
  21:08:16 STEP  955 H= 238:45 +CPU= 49.386
  21:09:06 STEP  956 H= 239:00 +CPU= 50.723
  21:09:57 STEP  957 H= 239:15 +CPU= 49.862
  21:10:45 STEP  958 H= 239:30 +CPU= 48.774
  21:11:35 STEP  959 H= 239:45 +CPU= 49.301
  21:12:42 STEP  960 H= 240:00 +CPU= 66.697
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0_r1852416443_9.zip
Uploading the intermediate file: upload_file_9.zip
Uploading trickle at timestep: 864000
  21:13:33 STEP  961 H= 240:15 +CPU= 49.726
  21:14:21 STEP  962 H= 240:30 +CPU= 48.701
  21:15:11 STEP  963 H= 240:45 +CPU= 49.267
  21:16:00 STEP  964 H= 241:00 +CPU= 49.018
  21:16:49 STEP  965 H= 241:15 +CPU= 48.284
  21:17:38 STEP  966 H= 241:30 +CPU= 48.136
  21:18:27 STEP  967 H= 241:45 +CPU= 48.961
  21:19:18 STEP  968 H= 242:00 +CPU= 50.494
  21:20:06 STEP  969 H= 242:15 +CPU= 48.423
  21:20:56 STEP  970 H= 242:30 +CPU= 49.295
  21:21:46 STEP  971 H= 242:45 +CPU= 49.040
  21:22:46 STEP  972 H= 243:00 +CPU= 60.402
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000972
  21:23:34 STEP  973 H= 243:15 +CPU= 47.578
  21:24:23 STEP  974 H= 243:30 +CPU= 48.644
  21:25:11 STEP  975 H= 243:45 +CPU= 48.361
  21:26:02 STEP  976 H= 244:00 +CPU= 50.456
  21:26:51 STEP  977 H= 244:15 +CPU= 48.801
  21:27:39 STEP  978 H= 244:30 +CPU= 48.400
  21:28:29 STEP  979 H= 244:45 +CPU= 48.748
  21:29:19 STEP  980 H= 245:00 +CPU= 49.872
  21:30:07 STEP  981 H= 245:15 +CPU= 48.374
  21:30:57 STEP  982 H= 245:30 +CPU= 49.153
  21:31:46 STEP  983 H= 245:45 +CPU= 49.001
  21:32:47 STEP  984 H= 246:00 +CPU= 60.418
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000984
  21:33:35 STEP  985 H= 246:15 +CPU= 48.577
  21:34:24 STEP  986 H= 246:30 +CPU= 47.981
  21:35:12 STEP  987 H= 246:45 +CPU= 48.571
  21:36:02 STEP  988 H= 247:00 +CPU= 49.659
  21:36:51 STEP  989 H= 247:15 +CPU= 48.110
  21:37:40 STEP  990 H= 247:30 +CPU= 49.078
  21:38:30 STEP  991 H= 247:45 +CPU= 49.552
  21:39:20 STEP  992 H= 248:00 +CPU= 49.920
  21:40:09 STEP  993 H= 248:15 +CPU= 49.367
  21:40:58 STEP  994 H= 248:30 +CPU= 48.370
  21:41:48 STEP  995 H= 248:45 +CPU= 49.859
  21:42:50 STEP  996 H= 249:00 +CPU= 61.684
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+000996
  21:43:39 STEP  997 H= 249:15 +CPU= 48.840
  21:44:28 STEP  998 H= 249:30 +CPU= 49.183
  21:45:17 STEP  999 H= 249:45 +CPU= 48.417
  21:46:07 STEP 1000 H= 250:00 +CPU= 49.938
  21:46:56 STEP 1001 H= 250:15 +CPU= 49.207
  21:47:45 STEP 1002 H= 250:30 +CPU= 49.088
  21:48:34 STEP 1003 H= 250:45 +CPU= 49.053
  21:49:25 STEP 1004 H= 251:00 +CPU= 50.009
  21:50:16 STEP 1005 H= 251:15 +CPU= 49.005
  21:51:06 STEP 1006 H= 251:30 +CPU= 49.453
  21:51:55 STEP 1007 H= 251:45 +CPU= 48.549
  21:53:02 STEP 1008 H= 252:00 +CPU= 65.675
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001008
  21:53:51 STEP 1009 H= 252:15 +CPU= 48.883
  21:54:41 STEP 1010 H= 252:30 +CPU= 48.938
  21:55:30 STEP 1011 H= 252:45 +CPU= 49.226
  21:56:20 STEP 1012 H= 253:00 +CPU= 49.860
  21:57:09 STEP 1013 H= 253:15 +CPU= 48.864
  21:57:58 STEP 1014 H= 253:30 +CPU= 48.838
  21:58:47 STEP 1015 H= 253:45 +CPU= 49.530
  21:59:37 STEP 1016 H= 254:00 +CPU= 49.747
  22:00:27 STEP 1017 H= 254:15 +CPU= 49.062
  22:01:15 STEP 1018 H= 254:30 +CPU= 48.517
  22:02:04 STEP 1019 H= 254:45 +CPU= 48.599
  22:03:05 STEP 1020 H= 255:00 +CPU= 59.817
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001020
  22:03:54 STEP 1021 H= 255:15 +CPU= 49.258
  22:04:43 STEP 1022 H= 255:30 +CPU= 49.020
  22:05:33 STEP 1023 H= 255:45 +CPU= 49.348
  22:06:23 STEP 1024 H= 256:00 +CPU= 49.608
  22:07:12 STEP 1025 H= 256:15 +CPU= 49.294
  22:08:01 STEP 1026 H= 256:30 +CPU= 48.409
  22:08:50 STEP 1027 H= 256:45 +CPU= 48.898
  22:09:40 STEP 1028 H= 257:00 +CPU= 50.322
  22:10:29 STEP 1029 H= 257:15 +CPU= 48.524
  22:11:18 STEP 1030 H= 257:30 +CPU= 48.966
  22:12:07 STEP 1031 H= 257:45 +CPU= 48.950
  22:13:08 STEP 1032 H= 258:00 +CPU= 60.961
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001032
  22:13:57 STEP 1033 H= 258:15 +CPU= 48.886
  22:14:47 STEP 1034 H= 258:30 +CPU= 48.703
  22:15:35 STEP 1035 H= 258:45 +CPU= 48.669
  22:16:24 STEP 1036 H= 259:00 +CPU= 49.141
  22:17:13 STEP 1037 H= 259:15 +CPU= 48.107
  22:18:01 STEP 1038 H= 259:30 +CPU= 48.675
  22:18:50 STEP 1039 H= 259:45 +CPU= 48.716
  22:19:40 STEP 1040 H= 260:00 +CPU= 49.579
  22:20:29 STEP 1041 H= 260:15 +CPU= 48.540
  22:21:18 STEP 1042 H= 260:30 +CPU= 48.512
  22:22:08 STEP 1043 H= 260:45 +CPU= 48.717
  22:23:11 STEP 1044 H= 261:00 +CPU= 61.299
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001044
  22:24:00 STEP 1045 H= 261:15 +CPU= 48.617
  22:24:49 STEP 1046 H= 261:30 +CPU= 48.839
  22:25:37 STEP 1047 H= 261:45 +CPU= 48.259
  22:26:27 STEP 1048 H= 262:00 +CPU= 49.584
  22:27:16 STEP 1049 H= 262:15 +CPU= 48.590
  22:28:04 STEP 1050 H= 262:30 +CPU= 48.132
  22:28:53 STEP 1051 H= 262:45 +CPU= 48.672
  22:29:43 STEP 1052 H= 263:00 +CPU= 49.785
  22:30:31 STEP 1053 H= 263:15 +CPU= 48.137
  22:31:20 STEP 1054 H= 263:30 +CPU= 47.785
  22:32:08 STEP 1055 H= 263:45 +CPU= 48.155
  22:33:16 STEP 1056 H= 264:00 +CPU= 67.408
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0_r1852416443_10.zip
Uploading the intermediate file: upload_file_10.zip
  22:34:06 STEP 1057 H= 264:15 +CPU= 49.651
  22:34:56 STEP 1058 H= 264:30 +CPU= 49.373
  22:35:46 STEP 1059 H= 264:45 +CPU= 49.675
  22:36:37 STEP 1060 H= 265:00 +CPU= 50.265
  22:37:27 STEP 1061 H= 265:15 +CPU= 49.870
  22:38:17 STEP 1062 H= 265:30 +CPU= 49.847
  22:39:06 STEP 1063 H= 265:45 +CPU= 49.006
  22:39:58 STEP 1064 H= 266:00 +CPU= 49.777
  22:40:47 STEP 1065 H= 266:15 +CPU= 49.533
  22:41:37 STEP 1066 H= 266:30 +CPU= 49.011
  22:42:26 STEP 1067 H= 266:45 +CPU= 48.985
  22:43:27 STEP 1068 H= 267:00 +CPU= 60.861
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001068
  22:44:15 STEP 1069 H= 267:15 +CPU= 48.829
  22:45:05 STEP 1070 H= 267:30 +CPU= 49.138
  22:45:54 STEP 1071 H= 267:45 +CPU= 49.678
  22:46:44 STEP 1072 H= 268:00 +CPU= 49.151
  22:47:32 STEP 1073 H= 268:15 +CPU= 48.398
  22:48:21 STEP 1074 H= 268:30 +CPU= 48.637
  22:49:11 STEP 1075 H= 268:45 +CPU= 48.627
  22:50:01 STEP 1076 H= 269:00 +CPU= 50.577
  22:50:51 STEP 1077 H= 269:15 +CPU= 49.066
  22:51:40 STEP 1078 H= 269:30 +CPU= 48.416
  22:52:30 STEP 1079 H= 269:45 +CPU= 48.829
  22:53:34 STEP 1080 H= 270:00 +CPU= 61.524
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001080
  22:54:23 STEP 1081 H= 270:15 +CPU= 48.934
  22:55:12 STEP 1082 H= 270:30 +CPU= 48.493
  22:56:01 STEP 1083 H= 270:45 +CPU= 48.878
  22:56:50 STEP 1084 H= 271:00 +CPU= 49.341
  22:57:39 STEP 1085 H= 271:15 +CPU= 49.097
  22:58:28 STEP 1086 H= 271:30 +CPU= 48.913
  22:59:16 STEP 1087 H= 271:45 +CPU= 48.276
  23:00:06 STEP 1088 H= 272:00 +CPU= 49.555
  23:00:54 STEP 1089 H= 272:15 +CPU= 48.286
  23:01:43 STEP 1090 H= 272:30 +CPU= 48.520
  23:02:33 STEP 1091 H= 272:45 +CPU= 50.225
  23:03:37 STEP 1092 H= 273:00 +CPU= 61.954
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001092
  23:04:26 STEP 1093 H= 273:15 +CPU= 48.783
  23:05:15 STEP 1094 H= 273:30 +CPU= 48.753
  23:06:05 STEP 1095 H= 273:45 +CPU= 49.806
  23:06:55 STEP 1096 H= 274:00 +CPU= 49.463
  23:07:44 STEP 1097 H= 274:15 +CPU= 48.710
  23:08:34 STEP 1098 H= 274:30 +CPU= 50.381
  23:09:24 STEP 1099 H= 274:45 +CPU= 49.253
  23:10:14 STEP 1100 H= 275:00 +CPU= 50.649
  23:11:04 STEP 1101 H= 275:15 +CPU= 49.127
  23:11:53 STEP 1102 H= 275:30 +CPU= 49.342
  23:12:43 STEP 1103 H= 275:45 +CPU= 49.956
  23:13:54 STEP 1104 H= 276:00 +CPU= 67.717
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001104
  23:14:43 STEP 1105 H= 276:15 +CPU= 48.832
  23:15:33 STEP 1106 H= 276:30 +CPU= 49.921
  23:16:23 STEP 1107 H= 276:45 +CPU= 49.625
  23:17:14 STEP 1108 H= 277:00 +CPU= 50.496
  23:18:04 STEP 1109 H= 277:15 +CPU= 49.822
  23:18:55 STEP 1110 H= 277:30 +CPU= 49.808
  23:19:45 STEP 1111 H= 277:45 +CPU= 49.168
  23:20:37 STEP 1112 H= 278:00 +CPU= 51.931
  23:21:27 STEP 1113 H= 278:15 +CPU= 49.412
  23:22:17 STEP 1114 H= 278:30 +CPU= 49.846
  23:23:06 STEP 1115 H= 278:45 +CPU= 49.002
  23:24:08 STEP 1116 H= 279:00 +CPU= 61.498
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001116
  23:24:59 STEP 1117 H= 279:15 +CPU= 49.322
  23:25:49 STEP 1118 H= 279:30 +CPU= 50.035
  23:26:39 STEP 1119 H= 279:45 +CPU= 49.593
  23:27:29 STEP 1120 H= 280:00 +CPU= 50.169
  23:28:18 STEP 1121 H= 280:15 +CPU= 49.250
  23:29:07 STEP 1122 H= 280:30 +CPU= 49.112
  23:29:56 STEP 1123 H= 280:45 +CPU= 48.767
  23:30:47 STEP 1124 H= 281:00 +CPU= 50.390
  23:31:36 STEP 1125 H= 281:15 +CPU= 49.309
  23:32:25 STEP 1126 H= 281:30 +CPU= 48.646
  23:33:14 STEP 1127 H= 281:45 +CPU= 49.129
  23:34:18 STEP 1128 H= 282:00 +CPU= 62.646
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001128
  23:35:07 STEP 1129 H= 282:15 +CPU= 49.125
  23:35:57 STEP 1130 H= 282:30 +CPU= 49.211
  23:36:47 STEP 1131 H= 282:45 +CPU= 49.634
  23:37:39 STEP 1132 H= 283:00 +CPU= 51.463
  23:38:29 STEP 1133 H= 283:15 +CPU= 49.841
  23:39:18 STEP 1134 H= 283:30 +CPU= 49.021
  23:40:06 STEP 1135 H= 283:45 +CPU= 48.178
  23:40:57 STEP 1136 H= 284:00 +CPU= 50.544
  23:41:47 STEP 1137 H= 284:15 +CPU= 50.311
  23:42:37 STEP 1138 H= 284:30 +CPU= 49.551
  23:43:26 STEP 1139 H= 284:45 +CPU= 49.027
  23:44:29 STEP 1140 H= 285:00 +CPU= 61.384
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001140
  23:45:18 STEP 1141 H= 285:15 +CPU= 48.988
  23:46:09 STEP 1142 H= 285:30 +CPU= 50.162
  23:47:01 STEP 1143 H= 285:45 +CPU= 49.044
  23:47:52 STEP 1144 H= 286:00 +CPU= 50.268
  23:48:42 STEP 1145 H= 286:15 +CPU= 49.833
  23:49:33 STEP 1146 H= 286:30 +CPU= 50.004
  23:50:22 STEP 1147 H= 286:45 +CPU= 48.669
  23:51:13 STEP 1148 H= 287:00 +CPU= 50.336
  23:52:02 STEP 1149 H= 287:15 +CPU= 49.179
  23:52:51 STEP 1150 H= 287:30 +CPU= 48.345
  23:53:42 STEP 1151 H= 287:45 +CPU= 48.181
  23:54:50 STEP 1152 H= 288:00 +CPU= 64.975
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0_r1852416443_11.zip
Uploading the intermediate file: upload_file_11.zip
  23:55:39 STEP 1153 H= 288:15 +CPU= 47.677
  23:56:27 STEP 1154 H= 288:30 +CPU= 48.547
  23:57:16 STEP 1155 H= 288:45 +CPU= 48.493
  23:58:05 STEP 1156 H= 289:00 +CPU= 49.254
  23:58:53 STEP 1157 H= 289:15 +CPU= 48.316
  23:59:43 STEP 1158 H= 289:30 +CPU= 49.227
  00:00:32 STEP 1159 H= 289:45 +CPU= 49.626
  00:01:23 STEP 1160 H= 290:00 +CPU= 50.611
  00:02:13 STEP 1161 H= 290:15 +CPU= 48.463
  00:03:02 STEP 1162 H= 290:30 +CPU= 49.426
  00:03:53 STEP 1163 H= 290:45 +CPU= 50.052
  00:04:54 STEP 1164 H= 291:00 +CPU= 61.775
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001164
  00:05:44 STEP 1165 H= 291:15 +CPU= 48.829
  00:06:32 STEP 1166 H= 291:30 +CPU= 48.124
  00:07:21 STEP 1167 H= 291:45 +CPU= 48.297
  00:08:12 STEP 1168 H= 292:00 +CPU= 50.894
  00:09:01 STEP 1169 H= 292:15 +CPU= 49.270
  00:09:50 STEP 1170 H= 292:30 +CPU= 48.894
  00:10:40 STEP 1171 H= 292:45 +CPU= 49.992
  00:11:31 STEP 1172 H= 293:00 +CPU= 50.602
  00:12:21 STEP 1173 H= 293:15 +CPU= 49.080
  00:13:11 STEP 1174 H= 293:30 +CPU= 50.204
  00:14:01 STEP 1175 H= 293:45 +CPU= 49.574
  00:15:04 STEP 1176 H= 294:00 +CPU= 62.773
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001176
  00:15:53 STEP 1177 H= 294:15 +CPU= 48.832
  00:16:43 STEP 1178 H= 294:30 +CPU= 48.978
  00:17:32 STEP 1179 H= 294:45 +CPU= 48.021
  00:18:22 STEP 1180 H= 295:00 +CPU= 49.369
  00:19:12 STEP 1181 H= 295:15 +CPU= 49.444
  00:20:02 STEP 1182 H= 295:30 +CPU= 50.154
  00:20:53 STEP 1183 H= 295:45 +CPU= 49.826
  00:21:43 STEP 1184 H= 296:00 +CPU= 50.411
  00:22:33 STEP 1185 H= 296:15 +CPU= 49.313
  00:23:23 STEP 1186 H= 296:30 +CPU= 50.046
  00:24:13 STEP 1187 H= 296:45 +CPU= 49.969
  00:25:15 STEP 1188 H= 297:00 +CPU= 61.592
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001188
  00:26:05 STEP 1189 H= 297:15 +CPU= 48.943
  00:26:55 STEP 1190 H= 297:30 +CPU= 49.743
  00:27:43 STEP 1191 H= 297:45 +CPU= 48.572
  00:28:34 STEP 1192 H= 298:00 +CPU= 50.275
  00:29:22 STEP 1193 H= 298:15 +CPU= 48.489
  00:30:12 STEP 1194 H= 298:30 +CPU= 49.487
  00:31:01 STEP 1195 H= 298:45 +CPU= 48.621
  00:31:51 STEP 1196 H= 299:00 +CPU= 50.177
  00:32:42 STEP 1197 H= 299:15 +CPU= 50.602
  00:33:31 STEP 1198 H= 299:30 +CPU= 49.261
  00:34:20 STEP 1199 H= 299:45 +CPU= 49.077
  00:35:27 STEP 1200 H= 300:00 +CPU= 66.233
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001200
  00:36:16 STEP 1201 H= 300:15 +CPU= 48.158
  00:37:05 STEP 1202 H= 300:30 +CPU= 47.873
  00:37:53 STEP 1203 H= 300:45 +CPU= 47.887
  00:38:43 STEP 1204 H= 301:00 +CPU= 49.962
  00:39:32 STEP 1205 H= 301:15 +CPU= 48.059
  00:40:22 STEP 1206 H= 301:30 +CPU= 50.030
  00:41:12 STEP 1207 H= 301:45 +CPU= 49.928
  00:42:03 STEP 1208 H= 302:00 +CPU= 50.894
  00:42:53 STEP 1209 H= 302:15 +CPU= 50.182
  00:43:43 STEP 1210 H= 302:30 +CPU= 49.047
  00:44:32 STEP 1211 H= 302:45 +CPU= 49.396
  00:45:35 STEP 1212 H= 303:00 +CPU= 61.802
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001212
  00:46:26 STEP 1213 H= 303:15 +CPU= 50.017
  00:47:16 STEP 1214 H= 303:30 +CPU= 50.319
  00:48:05 STEP 1215 H= 303:45 +CPU= 49.299
  00:48:56 STEP 1216 H= 304:00 +CPU= 50.468
  00:49:46 STEP 1217 H= 304:15 +CPU= 49.274
  00:50:37 STEP 1218 H= 304:30 +CPU= 50.015
  00:51:27 STEP 1219 H= 304:45 +CPU= 49.815
  00:52:18 STEP 1220 H= 305:00 +CPU= 50.122
  00:53:07 STEP 1221 H= 305:15 +CPU= 49.120
  00:53:57 STEP 1222 H= 305:30 +CPU= 49.557
  00:54:47 STEP 1223 H= 305:45 +CPU= 49.156
  00:55:50 STEP 1224 H= 306:00 +CPU= 62.851
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001224
  00:56:39 STEP 1225 H= 306:15 +CPU= 48.586
  00:57:28 STEP 1226 H= 306:30 +CPU= 48.872
  00:58:17 STEP 1227 H= 306:45 +CPU= 48.955
  00:59:07 STEP 1228 H= 307:00 +CPU= 49.665
  00:59:55 STEP 1229 H= 307:15 +CPU= 47.679
  01:00:44 STEP 1230 H= 307:30 +CPU= 48.233
  01:01:34 STEP 1231 H= 307:45 +CPU= 50.498
  01:02:25 STEP 1232 H= 308:00 +CPU= 50.256
  01:03:14 STEP 1233 H= 308:15 +CPU= 49.190
  01:04:04 STEP 1234 H= 308:30 +CPU= 49.331
  01:04:54 STEP 1235 H= 308:45 +CPU= 49.343
  01:05:55 STEP 1236 H= 309:00 +CPU= 60.172
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001236
  01:06:44 STEP 1237 H= 309:15 +CPU= 49.034
  01:07:34 STEP 1238 H= 309:30 +CPU= 48.953
  01:08:22 STEP 1239 H= 309:45 +CPU= 47.911
  01:09:13 STEP 1240 H= 310:00 +CPU= 49.795
  01:10:01 STEP 1241 H= 310:15 +CPU= 48.129
  01:10:50 STEP 1242 H= 310:30 +CPU= 48.011
  01:11:38 STEP 1243 H= 310:45 +CPU= 47.661
  01:12:28 STEP 1244 H= 311:00 +CPU= 49.679
  01:13:17 STEP 1245 H= 311:15 +CPU= 48.447
  01:14:07 STEP 1246 H= 311:30 +CPU= 49.298
  01:14:57 STEP 1247 H= 311:45 +CPU= 49.109
  01:16:04 STEP 1248 H= 312:00 +CPU= 66.656
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0_r1852416443_12.zip
Uploading the intermediate file: upload_file_12.zip
  01:16:52 STEP 1249 H= 312:15 +CPU= 47.870
  01:17:42 STEP 1250 H= 312:30 +CPU= 49.398
  01:18:32 STEP 1251 H= 312:45 +CPU= 49.907
  01:19:22 STEP 1252 H= 313:00 +CPU= 50.071
  01:20:12 STEP 1253 H= 313:15 +CPU= 49.817
  01:21:02 STEP 1254 H= 313:30 +CPU= 49.450
  01:21:52 STEP 1255 H= 313:45 +CPU= 49.767
  01:22:44 STEP 1256 H= 314:00 +CPU= 50.800
  01:23:33 STEP 1257 H= 314:15 +CPU= 49.843
  01:24:22 STEP 1258 H= 314:30 +CPU= 48.900
  01:25:14 STEP 1259 H= 314:45 +CPU= 48.484
  01:26:15 STEP 1260 H= 315:00 +CPU= 61.312
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001260
  01:27:04 STEP 1261 H= 315:15 +CPU= 48.840
  01:27:53 STEP 1262 H= 315:30 +CPU= 48.817
  01:28:41 STEP 1263 H= 315:45 +CPU= 48.316
  01:29:32 STEP 1264 H= 316:00 +CPU= 50.187
  01:30:21 STEP 1265 H= 316:15 +CPU= 49.102
  01:31:10 STEP 1266 H= 316:30 +CPU= 49.191
  01:32:00 STEP 1267 H= 316:45 +CPU= 49.537
  01:32:51 STEP 1268 H= 317:00 +CPU= 50.738
  01:33:41 STEP 1269 H= 317:15 +CPU= 49.937
  01:34:31 STEP 1270 H= 317:30 +CPU= 50.097
  01:35:20 STEP 1271 H= 317:45 +CPU= 49.004
  01:36:22 STEP 1272 H= 318:00 +CPU= 60.654
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001272
  01:37:11 STEP 1273 H= 318:15 +CPU= 49.563
  01:38:01 STEP 1274 H= 318:30 +CPU= 50.040
  01:38:51 STEP 1275 H= 318:45 +CPU= 49.615
  01:39:43 STEP 1276 H= 319:00 +CPU= 50.383
  01:40:32 STEP 1277 H= 319:15 +CPU= 49.007
  01:41:21 STEP 1278 H= 319:30 +CPU= 49.255
  01:42:10 STEP 1279 H= 319:45 +CPU= 49.287
  01:43:01 STEP 1280 H= 320:00 +CPU= 50.179
  01:43:52 STEP 1281 H= 320:15 +CPU= 50.671
  01:44:41 STEP 1282 H= 320:30 +CPU= 49.243
  01:45:32 STEP 1283 H= 320:45 +CPU= 50.542
  01:46:33 STEP 1284 H= 321:00 +CPU= 61.048
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001284
  01:47:23 STEP 1285 H= 321:15 +CPU= 49.376
  01:48:13 STEP 1286 H= 321:30 +CPU= 50.218
  01:49:03 STEP 1287 H= 321:45 +CPU= 49.551
  01:49:54 STEP 1288 H= 322:00 +CPU= 50.645
  01:50:43 STEP 1289 H= 322:15 +CPU= 49.436
  01:51:34 STEP 1290 H= 322:30 +CPU= 50.156
  01:52:25 STEP 1291 H= 322:45 +CPU= 50.783
  01:53:16 STEP 1292 H= 323:00 +CPU= 50.981
  01:54:07 STEP 1293 H= 323:15 +CPU= 50.601
  01:54:57 STEP 1294 H= 323:30 +CPU= 49.917
  01:55:46 STEP 1295 H= 323:45 +CPU= 49.086
  01:56:54 STEP 1296 H= 324:00 +CPU= 66.693
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001296
  01:57:43 STEP 1297 H= 324:15 +CPU= 49.431
  01:58:33 STEP 1298 H= 324:30 +CPU= 49.684
  01:59:24 STEP 1299 H= 324:45 +CPU= 49.279
  02:00:14 STEP 1300 H= 325:00 +CPU= 50.606
  02:01:04 STEP 1301 H= 325:15 +CPU= 49.836
  02:01:54 STEP 1302 H= 325:30 +CPU= 49.241
  02:02:43 STEP 1303 H= 325:45 +CPU= 48.926
  02:03:33 STEP 1304 H= 326:00 +CPU= 49.583
  02:04:23 STEP 1305 H= 326:15 +CPU= 49.433
  02:05:13 STEP 1306 H= 326:30 +CPU= 49.637
  02:06:03 STEP 1307 H= 326:45 +CPU= 49.809
  02:07:06 STEP 1308 H= 327:00 +CPU= 62.190
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001308
  02:07:56 STEP 1309 H= 327:15 +CPU= 49.302
  02:08:46 STEP 1310 H= 327:30 +CPU= 50.149
  02:09:37 STEP 1311 H= 327:45 +CPU= 50.527
  02:10:28 STEP 1312 H= 328:00 +CPU= 51.258
  02:11:17 STEP 1313 H= 328:15 +CPU= 48.827
  02:12:06 STEP 1314 H= 328:30 +CPU= 48.753
  02:12:55 STEP 1315 H= 328:45 +CPU= 49.060
  02:13:45 STEP 1316 H= 329:00 +CPU= 49.517
  02:14:35 STEP 1317 H= 329:15 +CPU= 49.160
  02:15:25 STEP 1318 H= 329:30 +CPU= 49.202
  02:16:14 STEP 1319 H= 329:45 +CPU= 49.355
  02:17:17 STEP 1320 H= 330:00 +CPU= 62.497
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001320
  02:18:07 STEP 1321 H= 330:15 +CPU= 49.352
  02:18:56 STEP 1322 H= 330:30 +CPU= 49.541
  02:19:46 STEP 1323 H= 330:45 +CPU= 49.834
  02:20:37 STEP 1324 H= 331:00 +CPU= 49.923
  02:21:25 STEP 1325 H= 331:15 +CPU= 48.143
  02:22:16 STEP 1326 H= 331:30 +CPU= 50.289
  02:23:06 STEP 1327 H= 331:45 +CPU= 49.337
  02:23:56 STEP 1328 H= 332:00 +CPU= 50.506
  02:24:46 STEP 1329 H= 332:15 +CPU= 49.417
  02:25:36 STEP 1330 H= 332:30 +CPU= 49.990
  02:26:24 STEP 1331 H= 332:45 +CPU= 48.639
  02:27:27 STEP 1332 H= 333:00 +CPU= 62.660
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001332
  02:28:17 STEP 1333 H= 333:15 +CPU= 49.899
  02:29:07 STEP 1334 H= 333:30 +CPU= 49.472
  02:29:57 STEP 1335 H= 333:45 +CPU= 49.827
  02:30:48 STEP 1336 H= 334:00 +CPU= 50.705
  02:31:36 STEP 1337 H= 334:15 +CPU= 48.036
  02:32:23 STEP 1338 H= 334:30 +CPU= 47.224
  02:33:10 STEP 1339 H= 334:45 +CPU= 46.538
  02:34:00 STEP 1340 H= 335:00 +CPU= 50.868
  02:34:50 STEP 1341 H= 335:15 +CPU= 49.708
  02:35:40 STEP 1342 H= 335:30 +CPU= 49.264
  02:36:31 STEP 1343 H= 335:45 +CPU= 50.323
  02:37:39 STEP 1344 H= 336:00 +CPU= 67.180
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0_r1852416443_13.zip
Uploading the intermediate file: upload_file_13.zip
  02:38:28 STEP 1345 H= 336:15 +CPU= 49.206
  02:39:17 STEP 1346 H= 336:30 +CPU= 48.753
  02:40:06 STEP 1347 H= 336:45 +CPU= 48.498
  02:40:55 STEP 1348 H= 337:00 +CPU= 49.412
  02:41:46 STEP 1349 H= 337:15 +CPU= 50.223
  02:42:35 STEP 1350 H= 337:30 +CPU= 49.315
  02:43:26 STEP 1351 H= 337:45 +CPU= 49.480
  02:44:16 STEP 1352 H= 338:00 +CPU= 50.701
  02:45:06 STEP 1353 H= 338:15 +CPU= 49.827
  02:45:56 STEP 1354 H= 338:30 +CPU= 50.162
  02:46:46 STEP 1355 H= 338:45 +CPU= 49.976
  02:47:51 STEP 1356 H= 339:00 +CPU= 62.754
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001356
  02:48:42 STEP 1357 H= 339:15 +CPU= 50.815
  02:49:33 STEP 1358 H= 339:30 +CPU= 50.270
  02:50:23 STEP 1359 H= 339:45 +CPU= 49.732
  02:51:14 STEP 1360 H= 340:00 +CPU= 50.907
  02:52:04 STEP 1361 H= 340:15 +CPU= 49.848
  02:52:55 STEP 1362 H= 340:30 +CPU= 50.341
  02:53:46 STEP 1363 H= 340:45 +CPU= 50.711
  02:54:37 STEP 1364 H= 341:00 +CPU= 50.836
  02:55:27 STEP 1365 H= 341:15 +CPU= 50.024
  02:56:17 STEP 1366 H= 341:30 +CPU= 49.861
  02:57:07 STEP 1367 H= 341:45 +CPU= 49.908
  02:58:09 STEP 1368 H= 342:00 +CPU= 61.833
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001368
  02:58:59 STEP 1369 H= 342:15 +CPU= 49.387
  02:59:48 STEP 1370 H= 342:30 +CPU= 48.989
  03:00:36 STEP 1371 H= 342:45 +CPU= 48.531
  03:01:26 STEP 1372 H= 343:00 +CPU= 49.825
  03:02:15 STEP 1373 H= 343:15 +CPU= 48.898
  03:03:05 STEP 1374 H= 343:30 +CPU= 49.103
  03:03:55 STEP 1375 H= 343:45 +CPU= 49.799
  03:04:46 STEP 1376 H= 344:00 +CPU= 50.985
  03:05:36 STEP 1377 H= 344:15 +CPU= 49.697
  03:06:27 STEP 1378 H= 344:30 +CPU= 49.716
  03:07:15 STEP 1379 H= 344:45 +CPU= 47.742
  03:08:13 STEP 1380 H= 345:00 +CPU= 57.953
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001380
  03:08:57 STEP 1381 H= 345:15 +CPU= 43.575
  03:09:44 STEP 1382 H= 345:30 +CPU= 47.148
  03:10:31 STEP 1383 H= 345:45 +CPU= 47.354
  03:11:21 STEP 1384 H= 346:00 +CPU= 49.184
  03:12:08 STEP 1385 H= 346:15 +CPU= 47.668
  03:12:56 STEP 1386 H= 346:30 +CPU= 47.645
  03:13:46 STEP 1387 H= 346:45 +CPU= 49.349
  03:14:37 STEP 1388 H= 347:00 +CPU= 50.844
  03:15:27 STEP 1389 H= 347:15 +CPU= 50.181
  03:16:17 STEP 1390 H= 347:30 +CPU= 49.787
  03:17:07 STEP 1391 H= 347:45 +CPU= 49.450
  03:18:15 STEP 1392 H= 348:00 +CPU= 67.398
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001392
  03:19:05 STEP 1393 H= 348:15 +CPU= 50.283
  03:19:55 STEP 1394 H= 348:30 +CPU= 49.178
  03:20:46 STEP 1395 H= 348:45 +CPU= 49.717
  03:21:37 STEP 1396 H= 349:00 +CPU= 50.470
  03:22:28 STEP 1397 H= 349:15 +CPU= 51.085
  03:23:18 STEP 1398 H= 349:30 +CPU= 49.779
  03:24:08 STEP 1399 H= 349:45 +CPU= 49.384
  03:24:59 STEP 1400 H= 350:00 +CPU= 51.098
  03:25:49 STEP 1401 H= 350:15 +CPU= 49.662
  03:26:39 STEP 1402 H= 350:30 +CPU= 49.907
  03:27:29 STEP 1403 H= 350:45 +CPU= 48.822
  03:28:33 STEP 1404 H= 351:00 +CPU= 63.467
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001404
  03:29:25 STEP 1405 H= 351:15 +CPU= 51.184
  03:30:14 STEP 1406 H= 351:30 +CPU= 49.258
  03:31:05 STEP 1407 H= 351:45 +CPU= 50.364
  03:31:56 STEP 1408 H= 352:00 +CPU= 50.735
  03:32:46 STEP 1409 H= 352:15 +CPU= 49.748
  03:33:36 STEP 1410 H= 352:30 +CPU= 49.432
  03:34:25 STEP 1411 H= 352:45 +CPU= 49.466
  03:35:16 STEP 1412 H= 353:00 +CPU= 50.563
  03:36:08 STEP 1413 H= 353:15 +CPU= 50.197
  03:36:58 STEP 1414 H= 353:30 +CPU= 49.323
  03:37:49 STEP 1415 H= 353:45 +CPU= 50.334
  03:38:52 STEP 1416 H= 354:00 +CPU= 62.389
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001416
  03:39:42 STEP 1417 H= 354:15 +CPU= 49.774
  03:40:32 STEP 1418 H= 354:30 +CPU= 49.473
  03:41:21 STEP 1419 H= 354:45 +CPU= 49.702
  03:42:12 STEP 1420 H= 355:00 +CPU= 50.742
  03:43:02 STEP 1421 H= 355:15 +CPU= 49.205
  03:43:51 STEP 1422 H= 355:30 +CPU= 48.933
  03:44:42 STEP 1423 H= 355:45 +CPU= 50.397
  03:45:33 STEP 1424 H= 356:00 +CPU= 51.006
  03:46:23 STEP 1425 H= 356:15 +CPU= 49.143
  03:47:13 STEP 1426 H= 356:30 +CPU= 50.258
  03:48:03 STEP 1427 H= 356:45 +CPU= 49.705
  03:49:06 STEP 1428 H= 357:00 +CPU= 63.186
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001428
  03:49:56 STEP 1429 H= 357:15 +CPU= 49.804
  03:50:46 STEP 1430 H= 357:30 +CPU= 49.692
  03:51:35 STEP 1431 H= 357:45 +CPU= 48.176
  03:52:27 STEP 1432 H= 358:00 +CPU= 51.552
  03:53:17 STEP 1433 H= 358:15 +CPU= 50.016
  03:54:07 STEP 1434 H= 358:30 +CPU= 50.039
  03:54:58 STEP 1435 H= 358:45 +CPU= 49.580
  03:55:49 STEP 1436 H= 359:00 +CPU= 50.604
  03:56:39 STEP 1437 H= 359:15 +CPU= 49.970
  03:57:29 STEP 1438 H= 359:30 +CPU= 49.959
  03:58:20 STEP 1439 H= 359:45 +CPU= 49.740
  03:59:25 STEP 1440 H= 360:00 +CPU= 64.316
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1342190784E-20      I       0.1179008687E-05      I
ICloud fractionI      0.0000000000E+00      I       0.5747001845E-02      I
I  Relat. Hum. I      0.2203822526E-01      I       0.6924616941E-01      I
I  PASS 01     I      0.0000000000E+00      I       0.1037390223E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    298307028 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS497178.4 Mbytes/s, TOTAL TIME=    0.0209( 2.9%)
 03:59:25 STEP 1440 H= 360:00 +CPU= 64.316
 END CNT3
 NSTEP =  1440 CNT0   000000000  47.500  47.500  47.743   0.995               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************   115.5     0.0   115.5     0.0   249.3
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562    6855.4    6855.4     15.91      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1211.4    1211.4      2.59      0.00
  10 SCAN2M - PHYSICS                             1441   22414.8   22414.8     47.99      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1322.2    1322.2      0.24      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      78.9      78.9      0.01      0.00
  14 SUINIF                                          1   10881.8   10881.8      0.02      0.00
  17 GRIDFPOS IN CNT4                              121      53.6      53.6      0.01      0.00
  18 SUSPECG                                         1    4969.6    4969.6      0.01      0.00
  19 SUSPEC                                          1    4977.8    4977.8      0.01      0.00
  24 SUGRIDU                                         1    4538.8    4538.8      0.01      0.00
  25 SPECRT                                          1     348.4     348.4      0.00      0.00
  26 SUGRIDF                                         1    1016.6    1016.6      0.00      0.00
  27 RESTART FILES - WRITING                        30    5332.8    5332.8      0.24      0.00
  28 RESTART FILES - READING                         1       0.1       0.1      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               121   10256.6   10256.6      1.84      0.00
  31 POSDDH IN STEPO                                 7       6.3       6.3      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    9541.6    9541.6     20.43      0.00
  39 SU0YOMB                                         1     505.4     505.4      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      44.5      44.5      0.10      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     578.6     578.6      1.24      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440     124.9     124.9      0.27      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.4       0.4      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     861.3     861.3      4.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     451.1     451.1      2.01      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     166.0     166.0      0.74      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     253.9     253.9      1.18      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      55.0      55.0      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      79.2      79.2      0.37      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      39.8      39.8      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125     163.6     163.6      0.76      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      88.4      88.4      0.39      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    67305.7 CPU TIME   66867.6 VECTOR TIME    66867.6


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       19.3
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/3/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/3/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/3/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12283557/ICMUAh7zg+001368
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0_r1852416443_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
04:03:00 (3935560): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0_r1852416443_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0_r1852416443_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0_r1852416443_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0_r1852416443_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0_r1852416443_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 09:02:02 1538899 22435136 oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0 1,295,100 66,867 0.0516
08 Jun 2024 02:47:43 1538899 22435136 oifs_43r3_bl_a1c2_2016092300_20_1017_12283557_0 864,000 42,635 0.0493


©2024 climateprediction.net