climateprediction.net home page
Task 22440578

Task 22440578

Name oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1
Workunit 12282686
Created 8 Jun 2024, 6:45:27 UTC
Sent 8 Jun 2024, 6:49:09 UTC
Report deadline 7 Aug 2024, 6:49:09 UTC
Received 12 Jun 2024, 12:22:00 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1488917
Run time 4 days 0 hours 47 min 11 sec
CPU time 17 hours 20 min 12 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,016.17 MB
Peak swap size 5,980.85 MB
Peak disk usage 1,582.13 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
8036295:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:61bc11710756:1:1:102:102] [20240610:161815:1718036295:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:61bc11710756:1:1:102:102] [20240610:161815:1718036295:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:61bc11710756:1:1:102:102] [20240610:161815:1718036295:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:61bc11710756:1:1:102:102] [20240610:161815:1718036295:0.002] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:61bc11710756:1:1:102:102] [20240610:161815:1718036295:0.002] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  16:24:00 STEP  816 H= 204:00 +CPU= 57.254
  16:29:11 STEP  817 H= 204:15 +CPU= 56.586
  16:34:33 STEP  818 H= 204:30 +CPU= 57.921
  16:40:18 STEP  819 H= 204:45 +CPU= 61.675
  16:45:40 STEP  820 H= 205:00 +CPU= 58.759
  16:50:56 STEP  821 H= 205:15 +CPU= 57.885
  16:56:36 STEP  822 H= 205:30 +CPU= 60.727
  17:01:43 STEP  823 H= 205:45 +CPU= 57.047
  17:06:46 STEP  824 H= 206:00 +CPU= 56.024
  17:12:18 STEP  825 H= 206:15 +CPU= 60.591
  17:17:18 STEP  826 H= 206:30 +CPU= 55.384
  17:22:15 STEP  827 H= 206:45 +CPU= 54.171
  17:28:24 STEP  828 H= 207:00 +CPU= 67.029
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000828
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000828
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000828
  17:33:03 STEP  829 H= 207:15 +CPU= 51.462
  17:37:05 STEP  830 H= 207:30 +CPU= 45.226
  17:40:57 STEP  831 H= 207:45 +CPU= 42.673
  17:45:18 STEP  832 H= 208:00 +CPU= 47.976
  17:50:16 STEP  833 H= 208:15 +CPU= 53.857
  17:55:33 STEP  834 H= 208:30 +CPU= 58.213
  18:01:13 STEP  835 H= 208:45 +CPU= 61.604
  18:07:03 STEP  836 H= 209:00 +CPU= 63.422
  18:12:40 STEP  837 H= 209:15 +CPU= 60.751
  18:18:18 STEP  838 H= 209:30 +CPU= 61.676
  18:23:34 STEP  839 H= 209:45 +CPU= 57.578
  18:29:38 STEP  840 H= 210:00 +CPU= 67.618
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000840
  18:34:45 STEP  841 H= 210:15 +CPU= 56.032
  18:39:22 STEP  842 H= 210:30 +CPU= 50.491
  18:43:53 STEP  843 H= 210:45 +CPU= 49.132
  18:48:13 STEP  844 H= 211:00 +CPU= 47.047
  18:52:21 STEP  845 H= 211:15 +CPU= 45.188
  18:56:33 STEP  846 H= 211:30 +CPU= 45.546
  19:00:41 STEP  847 H= 211:45 +CPU= 44.291
  19:04:45 STEP  848 H= 212:00 +CPU= 43.664
  19:08:32 STEP  849 H= 212:15 +CPU= 40.306
  19:12:06 STEP  850 H= 212:30 +CPU= 37.583
  19:15:33 STEP  851 H= 212:45 +CPU= 36.724
  19:19:49 STEP  852 H= 213:00 +CPU= 45.393
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000852
  19:23:18 STEP  853 H= 213:15 +CPU= 37.080
  19:26:45 STEP  854 H= 213:30 +CPU= 36.795
  19:30:08 STEP  855 H= 213:45 +CPU= 36.346
  19:33:40 STEP  856 H= 214:00 +CPU= 37.682
  19:37:05 STEP  857 H= 214:15 +CPU= 36.730
  19:40:32 STEP  858 H= 214:30 +CPU= 36.730
  19:43:54 STEP  859 H= 214:45 +CPU= 36.261
  19:47:26 STEP  860 H= 215:00 +CPU= 37.366
  19:50:50 STEP  861 H= 215:15 +CPU= 36.565
  19:54:14 STEP  862 H= 215:30 +CPU= 36.316
  19:57:45 STEP  863 H= 215:45 +CPU= 37.064
  20:02:22 STEP  864 H= 216:00 +CPU= 48.566
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1_r625193024_8.zip
Uploading the intermediate file: upload_file_8.zip
  20:05:46 STEP  865 H= 216:15 +CPU= 36.380
  20:09:15 STEP  866 H= 216:30 +CPU= 36.911
  20:12:42 STEP  867 H= 216:45 +CPU= 36.642
  20:16:08 STEP  868 H= 217:00 +CPU= 37.095
  20:19:35 STEP  869 H= 217:15 +CPU= 36.780
  20:23:00 STEP  870 H= 217:30 +CPU= 36.681
  20:26:31 STEP  871 H= 217:45 +CPU= 37.419
  20:30:04 STEP  872 H= 218:00 +CPU= 37.968
  20:33:29 STEP  873 H= 218:15 +CPU= 36.776
  20:36:53 STEP  874 H= 218:30 +CPU= 36.431
  20:40:21 STEP  875 H= 218:45 +CPU= 36.893
  20:44:37 STEP  876 H= 219:00 +CPU= 45.691
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000876
  20:48:03 STEP  877 H= 219:15 +CPU= 36.842
  20:51:25 STEP  878 H= 219:30 +CPU= 36.347
  20:54:48 STEP  879 H= 219:45 +CPU= 36.407
  20:58:18 STEP  880 H= 220:00 +CPU= 37.127
  21:01:42 STEP  881 H= 220:15 +CPU= 36.242
  21:05:05 STEP  882 H= 220:30 +CPU= 36.437
  21:08:33 STEP  883 H= 220:45 +CPU= 36.888
  21:11:59 STEP  884 H= 221:00 +CPU= 37.018
  21:15:24 STEP  885 H= 221:15 +CPU= 36.375
  21:18:49 STEP  886 H= 221:30 +CPU= 36.503
  21:22:14 STEP  887 H= 221:45 +CPU= 36.514
  21:26:24 STEP  888 H= 222:00 +CPU= 44.886
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000888
  21:29:49 STEP  889 H= 222:15 +CPU= 36.423
  21:33:11 STEP  890 H= 222:30 +CPU= 36.422
  21:36:34 STEP  891 H= 222:45 +CPU= 36.253
  21:40:02 STEP  892 H= 223:00 +CPU= 37.202
  21:43:27 STEP  893 H= 223:15 +CPU= 36.605
  21:46:48 STEP  894 H= 223:30 +CPU= 35.898
  21:50:08 STEP  895 H= 223:45 +CPU= 35.887
  21:53:31 STEP  896 H= 224:00 +CPU= 36.531
  21:56:56 STEP  897 H= 224:15 +CPU= 36.110
  22:00:18 STEP  898 H= 224:30 +CPU= 36.127
  22:03:45 STEP  899 H= 224:45 +CPU= 36.673
  22:07:59 STEP  900 H= 225:00 +CPU= 45.088
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000900
  22:11:23 STEP  901 H= 225:15 +CPU= 36.552
  22:14:46 STEP  902 H= 225:30 +CPU= 36.377
  22:18:10 STEP  903 H= 225:45 +CPU= 36.391
  22:21:37 STEP  904 H= 226:00 +CPU= 36.829
  22:25:03 STEP  905 H= 226:15 +CPU= 36.340
  22:28:23 STEP  906 H= 226:30 +CPU= 36.134
  22:31:41 STEP  907 H= 226:45 +CPU= 35.783
  22:35:08 STEP  908 H= 227:00 +CPU= 36.766
  22:38:27 STEP  909 H= 227:15 +CPU= 35.806
  22:41:50 STEP  910 H= 227:30 +CPU= 36.223
  22:45:17 STEP  911 H= 227:45 +CPU= 36.829
  22:49:45 STEP  912 H= 228:00 +CPU= 47.726
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000912
  22:53:07 STEP  913 H= 228:15 +CPU= 36.260
  22:56:30 STEP  914 H= 228:30 +CPU= 36.484
  22:59:53 STEP  915 H= 228:45 +CPU= 36.366
  23:03:36 STEP  916 H= 229:00 +CPU= 41.157
  23:07:04 STEP  917 H= 229:15 +CPU= 37.787
  23:10:35 STEP  918 H= 229:30 +CPU= 38.602
  23:13:58 STEP  919 H= 229:45 +CPU= 37.959
  23:17:29 STEP  920 H= 230:00 +CPU= 38.593
  23:20:54 STEP  921 H= 230:15 +CPU= 37.891
  23:24:09 STEP  922 H= 230:30 +CPU= 36.641
  23:27:37 STEP  923 H= 230:45 +CPU= 37.942
  23:31:49 STEP  924 H= 231:00 +CPU= 46.631
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000924
  23:35:15 STEP  925 H= 231:15 +CPU= 37.936
  23:38:42 STEP  926 H= 231:30 +CPU= 37.967
  23:42:08 STEP  927 H= 231:45 +CPU= 37.843
  23:45:38 STEP  928 H= 232:00 +CPU= 38.615
  23:49:11 STEP  929 H= 232:15 +CPU= 39.766
  23:53:13 STEP  930 H= 232:30 +CPU= 44.188
  23:57:18 STEP  931 H= 232:45 +CPU= 44.896
  00:01:51 STEP  932 H= 233:00 +CPU= 48.347
  00:06:45 STEP  933 H= 233:15 +CPU= 54.226
  00:11:34 STEP  934 H= 233:30 +CPU= 52.492
  00:16:47 STEP  935 H= 233:45 +CPU= 55.323
  00:23:04 STEP  936 H= 234:00 +CPU= 65.793
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000936
  00:27:59 STEP  937 H= 234:15 +CPU= 51.821
  00:32:52 STEP  938 H= 234:30 +CPU= 51.972
  00:37:23 STEP  939 H= 234:45 +CPU= 48.227
  00:42:04 STEP  940 H= 235:00 +CPU= 49.978
  00:46:26 STEP  941 H= 235:15 +CPU= 46.358
  00:50:52 STEP  942 H= 235:30 +CPU= 47.355
  00:55:14 STEP  943 H= 235:45 +CPU= 46.914
  00:59:48 STEP  944 H= 236:00 +CPU= 50.315
  01:04:22 STEP  945 H= 236:15 +CPU= 49.334
  01:09:22 STEP  946 H= 236:30 +CPU= 53.034
  01:14:18 STEP  947 H= 236:45 +CPU= 52.569
  01:20:21 STEP  948 H= 237:00 +CPU= 63.429
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000948
  01:25:29 STEP  949 H= 237:15 +CPU= 53.657
  01:30:48 STEP  950 H= 237:30 +CPU= 55.446
  01:35:35 STEP  951 H= 237:45 +CPU= 50.146
  01:40:38 STEP  952 H= 238:00 +CPU= 53.016
  01:45:16 STEP  953 H= 238:15 +CPU= 48.780
  01:49:52 STEP  954 H= 238:30 +CPU= 47.986
  01:54:12 STEP  955 H= 238:45 +CPU= 46.100
  01:58:52 STEP  956 H= 239:00 +CPU= 48.355
  02:03:31 STEP  957 H= 239:15 +CPU= 47.028
  02:07:43 STEP  958 H= 239:30 +CPU= 43.452
  02:11:45 STEP  959 H= 239:45 +CPU= 43.155
  02:16:57 STEP  960 H= 240:00 +CPU= 55.342
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1_r625193024_9.zip
Uploading the intermediate file: upload_file_9.zip
  02:20:59 STEP  961 H= 240:15 +CPU= 41.585
  02:24:58 STEP  962 H= 240:30 +CPU= 41.970
  02:28:52 STEP  963 H= 240:45 +CPU= 41.473
  02:32:56 STEP  964 H= 241:00 +CPU= 42.374
  02:36:46 STEP  965 H= 241:15 +CPU= 40.050
  02:40:37 STEP  966 H= 241:30 +CPU= 40.226
  02:44:28 STEP  967 H= 241:45 +CPU= 39.791
  02:48:25 STEP  968 H= 242:00 +CPU= 40.912
  02:52:14 STEP  969 H= 242:15 +CPU= 40.367
  02:56:19 STEP  970 H= 242:30 +CPU= 41.987
  03:00:31 STEP  971 H= 242:45 +CPU= 43.054
  03:05:26 STEP  972 H= 243:00 +CPU= 50.927
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000972
  03:09:26 STEP  973 H= 243:15 +CPU= 41.608
  03:13:24 STEP  974 H= 243:30 +CPU= 40.623
  03:17:30 STEP  975 H= 243:45 +CPU= 42.136
  03:21:34 STEP  976 H= 244:00 +CPU= 41.537
  03:25:29 STEP  977 H= 244:15 +CPU= 40.202
  03:29:25 STEP  978 H= 244:30 +CPU= 40.547
  03:33:19 STEP  979 H= 244:45 +CPU= 40.101
  03:37:11 STEP  980 H= 245:00 +CPU= 41.283
  03:40:55 STEP  981 H= 245:15 +CPU= 39.813
  03:44:34 STEP  982 H= 245:30 +CPU= 38.806
  03:48:23 STEP  983 H= 245:45 +CPU= 40.258
  03:52:58 STEP  984 H= 246:00 +CPU= 48.628
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000984
  03:56:49 STEP  985 H= 246:15 +CPU= 40.329
  04:00:34 STEP  986 H= 246:30 +CPU= 39.547
  04:04:18 STEP  987 H= 246:45 +CPU= 39.601
  04:08:04 STEP  988 H= 247:00 +CPU= 39.734
  04:11:48 STEP  989 H= 247:15 +CPU= 39.470
  04:15:30 STEP  990 H= 247:30 +CPU= 39.570
  04:19:12 STEP  991 H= 247:45 +CPU= 39.253
  04:22:58 STEP  992 H= 248:00 +CPU= 39.722
  04:26:43 STEP  993 H= 248:15 +CPU= 39.114
  04:30:33 STEP  994 H= 248:30 +CPU= 39.142
  04:34:19 STEP  995 H= 248:45 +CPU= 38.474
  04:38:58 STEP  996 H= 249:00 +CPU= 47.488
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+000996
  04:42:46 STEP  997 H= 249:15 +CPU= 38.865
  04:46:44 STEP  998 H= 249:30 +CPU= 39.833
  04:50:39 STEP  999 H= 249:45 +CPU= 39.388
  04:54:31 STEP 1000 H= 250:00 +CPU= 39.564
  04:58:27 STEP 1001 H= 250:15 +CPU= 39.440
  05:02:33 STEP 1002 H= 250:30 +CPU= 41.719
  05:06:35 STEP 1003 H= 250:45 +CPU= 41.161
  05:10:43 STEP 1004 H= 251:00 +CPU= 41.606
  05:14:58 STEP 1005 H= 251:15 +CPU= 42.675
  05:19:12 STEP 1006 H= 251:30 +CPU= 41.872
  05:23:20 STEP 1007 H= 251:45 +CPU= 42.422
  05:28:54 STEP 1008 H= 252:00 +CPU= 56.059
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001008
  05:33:03 STEP 1009 H= 252:15 +CPU= 41.288
  05:37:14 STEP 1010 H= 252:30 +CPU= 41.249
  05:41:26 STEP 1011 H= 252:45 +CPU= 41.366
  05:45:45 STEP 1012 H= 253:00 +CPU= 42.089
  05:49:48 STEP 1013 H= 253:15 +CPU= 40.708
  05:53:48 STEP 1014 H= 253:30 +CPU= 39.839
  05:58:05 STEP 1015 H= 253:45 +CPU= 41.694
  06:02:19 STEP 1016 H= 254:00 +CPU= 42.357
  06:06:21 STEP 1017 H= 254:15 +CPU= 40.587
  06:10:31 STEP 1018 H= 254:30 +CPU= 41.367
  06:14:27 STEP 1019 H= 254:45 +CPU= 39.263
  06:19:24 STEP 1020 H= 255:00 +CPU= 50.666
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001020
  06:23:30 STEP 1021 H= 255:15 +CPU= 41.019
  06:27:32 STEP 1022 H= 255:30 +CPU= 40.896
  06:31:36 STEP 1023 H= 255:45 +CPU= 40.462
  06:35:38 STEP 1024 H= 256:00 +CPU= 40.811
  06:39:37 STEP 1025 H= 256:15 +CPU= 39.705
  06:43:42 STEP 1026 H= 256:30 +CPU= 40.578
  06:47:46 STEP 1027 H= 256:45 +CPU= 41.455
  06:52:12 STEP 1028 H= 257:00 +CPU= 42.649
  06:56:18 STEP 1029 H= 257:15 +CPU= 40.385
  07:00:30 STEP 1030 H= 257:30 +CPU= 41.580
  07:04:44 STEP 1031 H= 257:45 +CPU= 42.223
  07:09:55 STEP 1032 H= 258:00 +CPU= 52.261
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001032
  07:14:00 STEP 1033 H= 258:15 +CPU= 40.785
  07:17:53 STEP 1034 H= 258:30 +CPU= 39.927
  07:21:56 STEP 1035 H= 258:45 +CPU= 40.186
  07:26:04 STEP 1036 H= 259:00 +CPU= 41.002
  07:30:06 STEP 1037 H= 259:15 +CPU= 40.453
  07:33:57 STEP 1038 H= 259:30 +CPU= 39.543
  07:38:08 STEP 1039 H= 259:45 +CPU= 40.859
  07:42:18 STEP 1040 H= 260:00 +CPU= 41.067
  07:46:27 STEP 1041 H= 260:15 +CPU= 40.852
  07:50:33 STEP 1042 H= 260:30 +CPU= 41.072
  07:54:56 STEP 1043 H= 260:45 +CPU= 41.998
  08:00:04 STEP 1044 H= 261:00 +CPU= 50.831
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001044
  08:04:07 STEP 1045 H= 261:15 +CPU= 40.323
  08:08:31 STEP 1046 H= 261:30 +CPU= 42.025
  08:12:51 STEP 1047 H= 261:45 +CPU= 42.401
  08:17:09 STEP 1048 H= 262:00 +CPU= 41.810
  08:21:34 STEP 1049 H= 262:15 +CPU= 42.700
  08:25:52 STEP 1050 H= 262:30 +CPU= 41.423
  08:29:55 STEP 1051 H= 262:45 +CPU= 39.798
  08:34:23 STEP 1052 H= 263:00 +CPU= 42.598
  08:38:25 STEP 1053 H= 263:15 +CPU= 40.139
  08:42:33 STEP 1054 H= 263:30 +CPU= 41.726
  08:46:47 STEP 1055 H= 263:45 +CPU= 41.122
  08:52:27 STEP 1056 H= 264:00 +CPU= 54.821
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1_r625193024_10.zip
Uploading the intermediate file: upload_file_10.zip
  08:56:54 STEP 1057 H= 264:15 +CPU= 42.583
  09:01:07 STEP 1058 H= 264:30 +CPU= 41.295
  09:05:17 STEP 1059 H= 264:45 +CPU= 40.725
  09:09:35 STEP 1060 H= 265:00 +CPU= 42.272
  09:13:49 STEP 1061 H= 265:15 +CPU= 41.884
  09:17:51 STEP 1062 H= 265:30 +CPU= 40.629
  09:21:59 STEP 1063 H= 265:45 +CPU= 40.822
  09:26:11 STEP 1064 H= 266:00 +CPU= 41.752
  09:30:11 STEP 1065 H= 266:15 +CPU= 39.903
  09:34:18 STEP 1066 H= 266:30 +CPU= 40.365
  09:38:31 STEP 1067 H= 266:45 +CPU= 41.603
  09:43:28 STEP 1068 H= 267:00 +CPU= 49.259
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001068
  09:47:31 STEP 1069 H= 267:15 +CPU= 40.300
  09:51:37 STEP 1070 H= 267:30 +CPU= 41.043
  09:55:54 STEP 1071 H= 267:45 +CPU= 41.052
  10:00:11 STEP 1072 H= 268:00 +CPU= 41.037
  10:04:23 STEP 1073 H= 268:15 +CPU= 40.717
  10:08:36 STEP 1074 H= 268:30 +CPU= 41.344
  10:12:37 STEP 1075 H= 268:45 +CPU= 40.729
  10:16:48 STEP 1076 H= 269:00 +CPU= 41.136
  10:20:47 STEP 1077 H= 269:15 +CPU= 39.148
  10:24:55 STEP 1078 H= 269:30 +CPU= 40.449
  10:29:14 STEP 1079 H= 269:45 +CPU= 42.286
  10:34:33 STEP 1080 H= 270:00 +CPU= 52.276
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001080
  10:38:40 STEP 1081 H= 270:15 +CPU= 41.466
  10:42:45 STEP 1082 H= 270:30 +CPU= 40.574
  10:46:51 STEP 1083 H= 270:45 +CPU= 40.228
  10:51:28 STEP 1084 H= 271:00 +CPU= 44.625
  10:55:59 STEP 1085 H= 271:15 +CPU= 43.075
  11:00:08 STEP 1086 H= 271:30 +CPU= 41.005
  11:04:20 STEP 1087 H= 271:45 +CPU= 40.841
  11:08:48 STEP 1088 H= 272:00 +CPU= 42.603
  11:13:02 STEP 1089 H= 272:15 +CPU= 41.843
  11:17:18 STEP 1090 H= 272:30 +CPU= 42.142
  11:21:20 STEP 1091 H= 272:45 +CPU= 40.119
  11:26:35 STEP 1092 H= 273:00 +CPU= 51.268
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001092
  11:30:58 STEP 1093 H= 273:15 +CPU= 42.195
  11:35:07 STEP 1094 H= 273:30 +CPU= 41.330
  11:39:28 STEP 1095 H= 273:45 +CPU= 42.325
  11:44:03 STEP 1096 H= 274:00 +CPU= 44.295
  11:48:09 STEP 1097 H= 274:15 +CPU= 40.280
  11:52:08 STEP 1098 H= 274:30 +CPU= 39.835
  11:56:10 STEP 1099 H= 274:45 +CPU= 41.408
  12:00:36 STEP 1100 H= 275:00 +CPU= 42.770
  12:04:49 STEP 1101 H= 275:15 +CPU= 41.092
  12:08:55 STEP 1102 H= 275:30 +CPU= 40.650
  12:13:00 STEP 1103 H= 275:45 +CPU= 40.183
  12:19:00 STEP 1104 H= 276:00 +CPU= 60.259
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001104
  12:23:48 STEP 1105 H= 276:15 +CPU= 50.219
  12:28:25 STEP 1106 H= 276:30 +CPU= 49.092
  12:32:59 STEP 1107 H= 276:45 +CPU= 48.474
  12:37:35 STEP 1108 H= 277:00 +CPU= 50.053
  12:42:28 STEP 1109 H= 277:15 +CPU= 51.595
  12:47:23 STEP 1110 H= 277:30 +CPU= 50.971
  12:52:21 STEP 1111 H= 277:45 +CPU= 50.964
  12:57:11 STEP 1112 H= 278:00 +CPU= 50.963
  13:02:01 STEP 1113 H= 278:15 +CPU= 49.513
  13:07:05 STEP 1114 H= 278:30 +CPU= 51.526
  13:11:52 STEP 1115 H= 278:45 +CPU= 48.324
  13:17:22 STEP 1116 H= 279:00 +CPU= 55.905
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001116
  13:21:26 STEP 1117 H= 279:15 +CPU= 42.331
  13:25:56 STEP 1118 H= 279:30 +CPU= 46.097
  13:30:42 STEP 1119 H= 279:45 +CPU= 48.843
  13:35:36 STEP 1120 H= 280:00 +CPU= 51.063
  13:40:45 STEP 1121 H= 280:15 +CPU= 52.867
  13:46:06 STEP 1122 H= 280:30 +CPU= 54.374
  13:51:14 STEP 1123 H= 280:45 +CPU= 52.298
  13:56:47 STEP 1124 H= 281:00 +CPU= 55.101
  14:01:34 STEP 1125 H= 281:15 +CPU= 49.519
  14:06:13 STEP 1126 H= 281:30 +CPU= 47.423
  14:10:55 STEP 1127 H= 281:45 +CPU= 46.924
  14:16:50 STEP 1128 H= 282:00 +CPU= 58.455
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001128
  14:21:13 STEP 1129 H= 282:15 +CPU= 44.223
  14:25:44 STEP 1130 H= 282:30 +CPU= 44.568
  14:29:51 STEP 1131 H= 282:45 +CPU= 40.819
  14:33:51 STEP 1132 H= 283:00 +CPU= 40.188
  14:37:46 STEP 1133 H= 283:15 +CPU= 39.803
  14:41:39 STEP 1134 H= 283:30 +CPU= 39.252
  14:45:30 STEP 1135 H= 283:45 +CPU= 39.104
  14:49:24 STEP 1136 H= 284:00 +CPU= 39.680
  14:53:13 STEP 1137 H= 284:15 +CPU= 38.237
  14:56:56 STEP 1138 H= 284:30 +CPU= 38.067
  15:00:41 STEP 1139 H= 284:45 +CPU= 38.495
  15:05:40 STEP 1140 H= 285:00 +CPU= 48.531
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001140
  15:09:32 STEP 1141 H= 285:15 +CPU= 38.987
  15:13:24 STEP 1142 H= 285:30 +CPU= 38.800
  15:17:27 STEP 1143 H= 285:45 +CPU= 40.040
  15:21:44 STEP 1144 H= 286:00 +CPU= 41.873
  15:25:51 STEP 1145 H= 286:15 +CPU= 40.635
  15:29:58 STEP 1146 H= 286:30 +CPU= 40.826
  15:33:46 STEP 1147 H= 286:45 +CPU= 38.209
  15:37:35 STEP 1148 H= 287:00 +CPU= 38.850
  15:41:43 STEP 1149 H= 287:15 +CPU= 40.450
  15:45:34 STEP 1150 H= 287:30 +CPU= 38.848
  15:49:22 STEP 1151 H= 287:45 +CPU= 38.483
  15:54:27 STEP 1152 H= 288:00 +CPU= 51.430
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1_r625193024_11.zip
Uploading the intermediate file: upload_file_11.zip
  15:58:12 STEP 1153 H= 288:15 +CPU= 37.648
  16:02:09 STEP 1154 H= 288:30 +CPU= 39.055
  16:06:14 STEP 1155 H= 288:45 +CPU= 39.878
  16:10:21 STEP 1156 H= 289:00 +CPU= 40.704
  16:14:17 STEP 1157 H= 289:15 +CPU= 39.589
  16:18:13 STEP 1158 H= 289:30 +CPU= 39.593
  16:22:07 STEP 1159 H= 289:45 +CPU= 38.690
  16:26:20 STEP 1160 H= 290:00 +CPU= 41.141
  16:30:10 STEP 1161 H= 290:15 +CPU= 38.469
  16:34:11 STEP 1162 H= 290:30 +CPU= 39.512
  16:38:19 STEP 1163 H= 290:45 +CPU= 40.143
  16:43:21 STEP 1164 H= 291:00 +CPU= 49.818
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001164
  16:47:25 STEP 1165 H= 291:15 +CPU= 39.657
  16:51:32 STEP 1166 H= 291:30 +CPU= 40.266
  16:55:51 STEP 1167 H= 291:45 +CPU= 41.976
  17:00:11 STEP 1168 H= 292:00 +CPU= 41.302
  17:04:21 STEP 1169 H= 292:15 +CPU= 40.881
  17:08:28 STEP 1170 H= 292:30 +CPU= 40.159
  17:12:30 STEP 1171 H= 292:45 +CPU= 40.324
  17:16:39 STEP 1172 H= 293:00 +CPU= 40.254
  17:20:44 STEP 1173 H= 293:15 +CPU= 40.052
  17:24:52 STEP 1174 H= 293:30 +CPU= 40.328
  17:28:54 STEP 1175 H= 293:45 +CPU= 39.872
  17:33:35 STEP 1176 H= 294:00 +CPU= 47.431
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001176
  17:37:28 STEP 1177 H= 294:15 +CPU= 39.134
  17:41:39 STEP 1178 H= 294:30 +CPU= 40.794
  17:45:54 STEP 1179 H= 294:45 +CPU= 41.000
  17:50:18 STEP 1180 H= 295:00 +CPU= 41.786
  17:54:20 STEP 1181 H= 295:15 +CPU= 39.442
  17:58:37 STEP 1182 H= 295:30 +CPU= 41.364
  18:02:41 STEP 1183 H= 295:45 +CPU= 40.094
  18:07:01 STEP 1184 H= 296:00 +CPU= 41.892
  18:11:09 STEP 1185 H= 296:15 +CPU= 40.984
  18:15:17 STEP 1186 H= 296:30 +CPU= 39.899
  18:19:26 STEP 1187 H= 296:45 +CPU= 40.414
  18:24:33 STEP 1188 H= 297:00 +CPU= 50.028
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001188
  18:28:38 STEP 1189 H= 297:15 +CPU= 40.270
  18:32:36 STEP 1190 H= 297:30 +CPU= 39.029
  18:36:41 STEP 1191 H= 297:45 +CPU= 39.348
  18:40:47 STEP 1192 H= 298:00 +CPU= 40.378
  18:44:42 STEP 1193 H= 298:15 +CPU= 39.040
  18:48:37 STEP 1194 H= 298:30 +CPU= 38.753
  18:52:39 STEP 1195 H= 298:45 +CPU= 39.133
  18:56:48 STEP 1196 H= 299:00 +CPU= 41.203
  19:00:46 STEP 1197 H= 299:15 +CPU= 39.281
  19:04:47 STEP 1198 H= 299:30 +CPU= 39.922
  19:08:43 STEP 1199 H= 299:45 +CPU= 39.150
  19:13:52 STEP 1200 H= 300:00 +CPU= 51.583
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001200
  19:17:49 STEP 1201 H= 300:15 +CPU= 39.201
  19:21:55 STEP 1202 H= 300:30 +CPU= 40.040
  19:25:57 STEP 1203 H= 300:45 +CPU= 39.774
  19:30:08 STEP 1204 H= 301:00 +CPU= 41.008
  19:34:09 STEP 1205 H= 301:15 +CPU= 39.668
  19:38:02 STEP 1206 H= 301:30 +CPU= 39.353
  19:42:16 STEP 1207 H= 301:45 +CPU= 40.823
  19:46:19 STEP 1208 H= 302:00 +CPU= 40.294
  19:50:19 STEP 1209 H= 302:15 +CPU= 39.845
  19:54:30 STEP 1210 H= 302:30 +CPU= 40.483
  19:58:47 STEP 1211 H= 302:45 +CPU= 41.461
  20:03:52 STEP 1212 H= 303:00 +CPU= 50.395
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001212
  20:07:51 STEP 1213 H= 303:15 +CPU= 39.234
  20:11:46 STEP 1214 H= 303:30 +CPU= 38.950
  20:15:49 STEP 1215 H= 303:45 +CPU= 39.518
  20:19:59 STEP 1216 H= 304:00 +CPU= 40.313
  20:23:55 STEP 1217 H= 304:15 +CPU= 39.111
  20:28:06 STEP 1218 H= 304:30 +CPU= 40.360
  20:32:13 STEP 1219 H= 304:45 +CPU= 40.576
  20:36:24 STEP 1220 H= 305:00 +CPU= 40.664
  20:40:43 STEP 1221 H= 305:15 +CPU= 41.788
  20:44:55 STEP 1222 H= 305:30 +CPU= 40.743
  20:49:07 STEP 1223 H= 305:45 +CPU= 40.588
  20:54:15 STEP 1224 H= 306:00 +CPU= 49.734
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001224
  20:58:20 STEP 1225 H= 306:15 +CPU= 39.727
  21:02:15 STEP 1226 H= 306:30 +CPU= 38.758
  21:06:20 STEP 1227 H= 306:45 +CPU= 39.857
  21:10:21 STEP 1228 H= 307:00 +CPU= 39.487
  21:14:15 STEP 1229 H= 307:15 +CPU= 38.570
  21:18:13 STEP 1230 H= 307:30 +CPU= 38.947
  21:22:15 STEP 1231 H= 307:45 +CPU= 38.952
  21:26:19 STEP 1232 H= 308:00 +CPU= 39.772
  21:30:28 STEP 1233 H= 308:15 +CPU= 40.025
  21:34:24 STEP 1234 H= 308:30 +CPU= 39.026
  21:38:27 STEP 1235 H= 308:45 +CPU= 38.938
  21:43:25 STEP 1236 H= 309:00 +CPU= 48.109
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001236
  21:47:26 STEP 1237 H= 309:15 +CPU= 39.441
  21:51:23 STEP 1238 H= 309:30 +CPU= 39.348
  21:55:20 STEP 1239 H= 309:45 +CPU= 38.691
  21:59:18 STEP 1240 H= 310:00 +CPU= 39.294
  22:03:11 STEP 1241 H= 310:15 +CPU= 38.381
  22:07:14 STEP 1242 H= 310:30 +CPU= 39.132
  22:11:20 STEP 1243 H= 310:45 +CPU= 39.465
  22:15:23 STEP 1244 H= 311:00 +CPU= 40.099
  22:19:24 STEP 1245 H= 311:15 +CPU= 39.204
  22:23:22 STEP 1246 H= 311:30 +CPU= 38.820
  22:27:17 STEP 1247 H= 311:45 +CPU= 38.433
  22:32:29 STEP 1248 H= 312:00 +CPU= 50.634
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1_r625193024_12.zip
Uploading the intermediate file: upload_file_12.zip
  22:36:36 STEP 1249 H= 312:15 +CPU= 39.109
  22:40:32 STEP 1250 H= 312:30 +CPU= 39.046
  22:44:36 STEP 1251 H= 312:45 +CPU= 39.873
  22:48:38 STEP 1252 H= 313:00 +CPU= 39.736
  22:52:43 STEP 1253 H= 313:15 +CPU= 39.385
  22:56:36 STEP 1254 H= 313:30 +CPU= 38.722
  23:00:37 STEP 1255 H= 313:45 +CPU= 39.404
  23:04:41 STEP 1256 H= 314:00 +CPU= 40.159
  23:08:39 STEP 1257 H= 314:15 +CPU= 38.759
  23:12:37 STEP 1258 H= 314:30 +CPU= 39.071
  23:16:37 STEP 1259 H= 314:45 +CPU= 39.006
  23:21:27 STEP 1260 H= 315:00 +CPU= 47.746
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001260
  23:25:25 STEP 1261 H= 315:15 +CPU= 38.771
  23:29:27 STEP 1262 H= 315:30 +CPU= 39.039
  23:33:37 STEP 1263 H= 315:45 +CPU= 40.431
  23:37:43 STEP 1264 H= 316:00 +CPU= 40.218
  23:41:41 STEP 1265 H= 316:15 +CPU= 39.368
  23:45:41 STEP 1266 H= 316:30 +CPU= 39.603
  23:49:48 STEP 1267 H= 316:45 +CPU= 40.617
  23:53:49 STEP 1268 H= 317:00 +CPU= 39.454
  23:57:39 STEP 1269 H= 317:15 +CPU= 38.218
  00:01:43 STEP 1270 H= 317:30 +CPU= 39.965
  00:05:46 STEP 1271 H= 317:45 +CPU= 39.475
  00:10:45 STEP 1272 H= 318:00 +CPU= 48.446
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001272
  00:14:42 STEP 1273 H= 318:15 +CPU= 38.876
  00:18:31 STEP 1274 H= 318:30 +CPU= 37.822
  00:22:24 STEP 1275 H= 318:45 +CPU= 38.403
  00:26:21 STEP 1276 H= 319:00 +CPU= 39.780
  00:30:23 STEP 1277 H= 319:15 +CPU= 39.586
  00:34:16 STEP 1278 H= 319:30 +CPU= 38.697
  00:38:03 STEP 1279 H= 319:45 +CPU= 37.891
  00:42:00 STEP 1280 H= 320:00 +CPU= 39.033
  00:45:56 STEP 1281 H= 320:15 +CPU= 38.907
  00:49:55 STEP 1282 H= 320:30 +CPU= 38.663
  00:53:51 STEP 1283 H= 320:45 +CPU= 38.789
  00:58:40 STEP 1284 H= 321:00 +CPU= 47.898
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001284
  01:02:29 STEP 1285 H= 321:15 +CPU= 37.895
  01:06:13 STEP 1286 H= 321:30 +CPU= 38.418
  01:10:10 STEP 1287 H= 321:45 +CPU= 39.223
  01:14:16 STEP 1288 H= 322:00 +CPU= 40.218
  01:18:18 STEP 1289 H= 322:15 +CPU= 39.641
  01:22:17 STEP 1290 H= 322:30 +CPU= 38.969
  01:26:17 STEP 1291 H= 322:45 +CPU= 38.998
  01:30:24 STEP 1292 H= 323:00 +CPU= 40.244
  01:34:18 STEP 1293 H= 323:15 +CPU= 38.878
  01:38:15 STEP 1294 H= 323:30 +CPU= 38.598
  01:42:14 STEP 1295 H= 323:45 +CPU= 38.957
  01:47:21 STEP 1296 H= 324:00 +CPU= 50.491
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001296
  01:51:16 STEP 1297 H= 324:15 +CPU= 38.659
  01:55:06 STEP 1298 H= 324:30 +CPU= 37.923
  01:59:00 STEP 1299 H= 324:45 +CPU= 39.033
  02:02:55 STEP 1300 H= 325:00 +CPU= 39.252
  02:06:53 STEP 1301 H= 325:15 +CPU= 38.873
  02:10:41 STEP 1302 H= 325:30 +CPU= 38.127
  02:14:38 STEP 1303 H= 325:45 +CPU= 39.156
  02:18:36 STEP 1304 H= 326:00 +CPU= 39.561
  02:22:33 STEP 1305 H= 326:15 +CPU= 38.768
  02:26:29 STEP 1306 H= 326:30 +CPU= 38.815
  02:30:30 STEP 1307 H= 326:45 +CPU= 39.057
  02:35:17 STEP 1308 H= 327:00 +CPU= 47.326
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001308
  02:39:13 STEP 1309 H= 327:15 +CPU= 38.889
  02:43:09 STEP 1310 H= 327:30 +CPU= 39.224
  02:47:11 STEP 1311 H= 327:45 +CPU= 39.515
  02:51:08 STEP 1312 H= 328:00 +CPU= 39.485
  02:55:02 STEP 1313 H= 328:15 +CPU= 38.523
  02:58:52 STEP 1314 H= 328:30 +CPU= 37.970
  03:02:45 STEP 1315 H= 328:45 +CPU= 38.744
  03:06:46 STEP 1316 H= 329:00 +CPU= 39.431
  03:10:56 STEP 1317 H= 329:15 +CPU= 40.561
  03:15:02 STEP 1318 H= 329:30 +CPU= 40.786
  03:19:09 STEP 1319 H= 329:45 +CPU= 40.174
  03:24:21 STEP 1320 H= 330:00 +CPU= 50.306
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001320
  03:28:26 STEP 1321 H= 330:15 +CPU= 40.354
  03:32:41 STEP 1322 H= 330:30 +CPU= 41.181
  03:36:50 STEP 1323 H= 330:45 +CPU= 40.518
  03:40:56 STEP 1324 H= 331:00 +CPU= 40.930
  03:44:54 STEP 1325 H= 331:15 +CPU= 39.628
  03:49:03 STEP 1326 H= 331:30 +CPU= 41.051
  03:53:07 STEP 1327 H= 331:45 +CPU= 40.011
  03:57:08 STEP 1328 H= 332:00 +CPU= 41.296
  04:01:02 STEP 1329 H= 332:15 +CPU= 39.703
  04:04:58 STEP 1330 H= 332:30 +CPU= 39.208
  04:08:42 STEP 1331 H= 332:45 +CPU= 38.460
  04:13:41 STEP 1332 H= 333:00 +CPU= 49.511
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001332
  04:17:51 STEP 1333 H= 333:15 +CPU= 41.520
  04:22:09 STEP 1334 H= 333:30 +CPU= 41.901
  04:26:28 STEP 1335 H= 333:45 +CPU= 42.227
  04:30:53 STEP 1336 H= 334:00 +CPU= 42.571
  04:35:12 STEP 1337 H= 334:15 +CPU= 42.490
  04:39:11 STEP 1338 H= 334:30 +CPU= 40.233
  04:43:02 STEP 1339 H= 334:45 +CPU= 39.960
  04:47:10 STEP 1340 H= 335:00 +CPU= 41.820
  04:50:52 STEP 1341 H= 335:15 +CPU= 38.332
  04:54:39 STEP 1342 H= 335:30 +CPU= 38.580
  04:58:30 STEP 1343 H= 335:45 +CPU= 39.534
  05:03:47 STEP 1344 H= 336:00 +CPU= 53.822
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1_r625193024_13.zip
Uploading the intermediate file: upload_file_13.zip
  05:07:52 STEP 1345 H= 336:15 +CPU= 40.575
  05:11:44 STEP 1346 H= 336:30 +CPU= 39.123
  05:15:36 STEP 1347 H= 336:45 +CPU= 38.504
  05:19:38 STEP 1348 H= 337:00 +CPU= 40.009
  05:23:51 STEP 1349 H= 337:15 +CPU= 41.169
  05:28:02 STEP 1350 H= 337:30 +CPU= 41.222
  05:32:09 STEP 1351 H= 337:45 +CPU= 41.324
  05:36:21 STEP 1352 H= 338:00 +CPU= 41.961
  05:40:15 STEP 1353 H= 338:15 +CPU= 39.412
  05:44:12 STEP 1354 H= 338:30 +CPU= 39.285
  05:48:05 STEP 1355 H= 338:45 +CPU= 39.949
  05:53:45 STEP 1356 H= 339:00 +CPU= 56.885
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001356
  05:58:38 STEP 1357 H= 339:15 +CPU= 52.146
  06:03:35 STEP 1358 H= 339:30 +CPU= 53.010
  06:08:45 STEP 1359 H= 339:45 +CPU= 55.062
  06:13:48 STEP 1360 H= 340:00 +CPU= 55.724
  06:18:51 STEP 1361 H= 340:15 +CPU= 55.130
  06:24:09 STEP 1362 H= 340:30 +CPU= 58.013
  06:29:43 STEP 1363 H= 340:45 +CPU= 59.354
  06:35:15 STEP 1364 H= 341:00 +CPU= 59.583
  06:40:29 STEP 1365 H= 341:15 +CPU= 57.463
  06:46:13 STEP 1366 H= 341:30 +CPU= 61.371
  06:51:31 STEP 1367 H= 341:45 +CPU= 56.512
  06:57:28 STEP 1368 H= 342:00 +CPU= 65.325
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001368
  07:02:17 STEP 1369 H= 342:15 +CPU= 53.052
  07:06:47 STEP 1370 H= 342:30 +CPU= 49.574
  07:11:13 STEP 1371 H= 342:45 +CPU= 47.747
  07:15:31 STEP 1372 H= 343:00 +CPU= 47.190
  07:20:18 STEP 1373 H= 343:15 +CPU= 52.525
  07:25:34 STEP 1374 H= 343:30 +CPU= 56.301
  07:31:00 STEP 1375 H= 343:45 +CPU= 59.080
  07:36:32 STEP 1376 H= 344:00 +CPU= 60.093
  07:41:59 STEP 1377 H= 344:15 +CPU= 58.598
  07:47:24 STEP 1378 H= 344:30 +CPU= 59.830
  07:53:17 STEP 1379 H= 344:45 +CPU= 62.606
  07:59:45 STEP 1380 H= 345:00 +CPU= 69.534
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001380
  08:04:56 STEP 1381 H= 345:15 +CPU= 56.241
  08:09:45 STEP 1382 H= 345:30 +CPU= 52.258
  08:14:15 STEP 1383 H= 345:45 +CPU= 47.675
  08:18:51 STEP 1384 H= 346:00 +CPU= 49.129
  08:23:08 STEP 1385 H= 346:15 +CPU= 46.024
  08:27:33 STEP 1386 H= 346:30 +CPU= 46.327
  08:31:57 STEP 1387 H= 346:45 +CPU= 46.488
  08:36:26 STEP 1388 H= 347:00 +CPU= 45.882
  08:40:21 STEP 1389 H= 347:15 +CPU= 41.209
  08:44:14 STEP 1390 H= 347:30 +CPU= 39.948
  08:48:02 STEP 1391 H= 347:45 +CPU= 39.718
  08:53:02 STEP 1392 H= 348:00 +CPU= 52.152
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001392
  08:56:46 STEP 1393 H= 348:15 +CPU= 38.672
  09:00:26 STEP 1394 H= 348:30 +CPU= 38.417
  09:04:09 STEP 1395 H= 348:45 +CPU= 38.600
  09:07:54 STEP 1396 H= 349:00 +CPU= 39.298
  09:11:45 STEP 1397 H= 349:15 +CPU= 39.862
  09:15:35 STEP 1398 H= 349:30 +CPU= 39.261
  09:19:16 STEP 1399 H= 349:45 +CPU= 39.221
  09:23:05 STEP 1400 H= 350:00 +CPU= 40.130
  09:26:55 STEP 1401 H= 350:15 +CPU= 40.765
  09:30:44 STEP 1402 H= 350:30 +CPU= 39.571
  09:34:29 STEP 1403 H= 350:45 +CPU= 39.710
  09:39:22 STEP 1404 H= 351:00 +CPU= 50.201
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001404
  09:43:28 STEP 1405 H= 351:15 +CPU= 41.960
  09:47:32 STEP 1406 H= 351:30 +CPU= 41.883
  09:51:29 STEP 1407 H= 351:45 +CPU= 41.701
  09:55:14 STEP 1408 H= 352:00 +CPU= 40.848
  09:58:52 STEP 1409 H= 352:15 +CPU= 39.318
  10:02:38 STEP 1410 H= 352:30 +CPU= 39.790
  10:06:10 STEP 1411 H= 352:45 +CPU= 37.936
  10:09:50 STEP 1412 H= 353:00 +CPU= 39.783
  10:13:33 STEP 1413 H= 353:15 +CPU= 39.425
  10:17:06 STEP 1414 H= 353:30 +CPU= 38.906
  10:20:35 STEP 1415 H= 353:45 +CPU= 37.209
  10:25:01 STEP 1416 H= 354:00 +CPU= 46.949
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001416
  10:28:40 STEP 1417 H= 354:15 +CPU= 38.975
  10:32:33 STEP 1418 H= 354:30 +CPU= 39.826
  10:36:32 STEP 1419 H= 354:45 +CPU= 40.367
  10:40:34 STEP 1420 H= 355:00 +CPU= 41.563
  10:44:33 STEP 1421 H= 355:15 +CPU= 41.604
  10:48:36 STEP 1422 H= 355:30 +CPU= 41.677
  10:52:51 STEP 1423 H= 355:45 +CPU= 43.752
  10:57:15 STEP 1424 H= 356:00 +CPU= 45.934
  11:01:32 STEP 1425 H= 356:15 +CPU= 44.828
  11:05:36 STEP 1426 H= 356:30 +CPU= 41.902
  11:09:32 STEP 1427 H= 356:45 +CPU= 41.067
  11:14:17 STEP 1428 H= 357:00 +CPU= 50.345
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001428
  11:18:13 STEP 1429 H= 357:15 +CPU= 40.420
  11:22:02 STEP 1430 H= 357:30 +CPU= 40.945
  11:26:15 STEP 1431 H= 357:45 +CPU= 41.990
  11:30:11 STEP 1432 H= 358:00 +CPU= 40.551
  11:34:10 STEP 1433 H= 358:15 +CPU= 40.794
  11:37:52 STEP 1434 H= 358:30 +CPU= 38.750
  11:41:42 STEP 1435 H= 358:45 +CPU= 39.589
  11:45:35 STEP 1436 H= 359:00 +CPU= 40.855
  11:49:26 STEP 1437 H= 359:15 +CPU= 41.407
  11:53:41 STEP 1438 H= 359:30 +CPU= 45.024
  11:57:50 STEP 1439 H= 359:45 +CPU= 43.921
  12:02:44 STEP 1440 H= 360:00 +CPU= 52.118
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.9615694166E-21      I       0.5758910752E-05      I
ICloud fractionI      0.0000000000E+00      I       0.5584663375E-01      I
I  Relat. Hum. I      0.4716815669E+00      I       0.5014792864E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.8194709401E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    328850212 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS822125.6 Mbytes/s, TOTAL TIME=    0.1004( 0.4%)
 12:02:44 STEP 1440 H= 360:00 +CPU= 52.118
 END CNT3
 NSTEP =  1440 CNT0   000000000  39.809  39.809 222.908   0.179               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        18590/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    328    0       46      1044068    18590 ************   204.5    16.8   187.7    23.5   492.4
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  677   35940.3   35940.3     15.45      0.00
   9 SPCM     - SPECTRAL COMP.                     624    6865.1    6865.1      2.72      0.00
  10 SCAN2M - PHYSICS                              625  126765.7  126765.7     50.31      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 52    5076.0    5076.0      0.17      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 27     401.5     401.5      0.01      0.00
  17 GRIDFPOS IN CNT4                               52     224.5     224.5      0.01      0.00
  27 RESTART FILES - WRITING                        13   20303.8   20303.8      0.17      0.00
  28 RESTART FILES - READING                         1   31596.4   31596.4      0.02      0.00
  29 SU4FPOS IN CNT4                                52       0.2       0.2      0.00      0.00
  30 DYNFPOS IN CNT4                                52   50465.6   50465.6      1.67      0.00
  31 POSDDH IN STEPO                                 3      30.0      30.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    625   47598.3   47598.3     18.89      0.00
  39 SU0YOMB                                         1    2711.7    2711.7      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    625     291.0     291.0      0.12      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              624    3292.8    3292.8      1.30      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              624     630.8     630.8      0.25      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 27       6.4       6.4      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1356    4543.6    4543.6      3.91      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1300    2355.7    2355.7      1.94      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1300     834.1     834.1      0.69      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1356    1348.2    1348.2      1.16      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1     208.4     208.4      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1356     430.9     430.9      0.37      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1300     217.5     217.5      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1356     755.2     755.2      0.65      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1300     490.5     490.5      0.40      0.00
 400 GSTATS                                      73253       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 68103       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME   157469.6 CPU TIME   26866.9 VECTOR TIME    26866.9


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY        8.2
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/5/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/5/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/5/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/slots/5/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/5/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12282686/ICMGGh7zg+001440
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1_r625193024_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
12:07:44 (38): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1_r625193024_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1_r625193024_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1_r625193024_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1_r625193024_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1_r625193024_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Jun 2024 12:22:55 1488917 22440578 oifs_43r3_bl_a0nv_2016092300_20_1017_12282686_1 1,295,100 62,412 0.0482


©2024 cpdn.org