climateprediction.net home page
Task 22433413

Task 22433413

Name oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0
Workunit 12281846
Created 7 Jun 2024, 10:52:39 UTC
Sent 7 Jun 2024, 11:00:18 UTC
Report deadline 6 Aug 2024, 11:00:18 UTC
Received 8 Jun 2024, 5:04:12 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1549573
Run time 13 hours 39 min 45 sec
CPU time 13 hours 39 min 45 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 8.07 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,024.83 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,364.31 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
42 H= 210:30 +CPU= 31.803
  00:25:22 STEP  843 H= 210:45 +CPU= 31.236
  00:25:56 STEP  844 H= 211:00 +CPU= 33.243
  00:26:29 STEP  845 H= 211:15 +CPU= 32.198
  00:26:59 STEP  846 H= 211:30 +CPU= 30.018
  00:27:31 STEP  847 H= 211:45 +CPU= 31.643
  00:28:05 STEP  848 H= 212:00 +CPU= 33.229
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  00:28:46 STEP  849 H= 212:15 +CPU= 31.159
  00:29:18 STEP  850 H= 212:30 +CPU= 31.413
  00:29:51 STEP  851 H= 212:45 +CPU= 31.828
  00:30:31 STEP  852 H= 213:00 +CPU= 39.128
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000852
  00:31:03 STEP  853 H= 213:15 +CPU= 31.159
  00:31:33 STEP  854 H= 213:30 +CPU= 29.395
  00:32:05 STEP  855 H= 213:45 +CPU= 30.523
  00:32:38 STEP  856 H= 214:00 +CPU= 32.558
  00:33:10 STEP  857 H= 214:15 +CPU= 31.497
  00:33:43 STEP  858 H= 214:30 +CPU= 31.862
  00:34:18 STEP  859 H= 214:45 +CPU= 33.506
  00:34:52 STEP  860 H= 215:00 +CPU= 32.949
  00:35:24 STEP  861 H= 215:15 +CPU= 31.564
  00:35:58 STEP  862 H= 215:30 +CPU= 32.521
  00:36:30 STEP  863 H= 215:45 +CPU= 30.539
  00:37:16 STEP  864 H= 216:00 +CPU= 44.704
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0_r404034391_8.zip
Uploading the intermediate file: upload_file_8.zip
  00:37:48 STEP  865 H= 216:15 +CPU= 30.668
  00:38:20 STEP  866 H= 216:30 +CPU= 31.398
  00:38:52 STEP  867 H= 216:45 +CPU= 31.664
  00:39:25 STEP  868 H= 217:00 +CPU= 32.473
  00:39:58 STEP  869 H= 217:15 +CPU= 32.381
  00:40:30 STEP  870 H= 217:30 +CPU= 31.854
  00:41:03 STEP  871 H= 217:45 +CPU= 32.034
  00:41:35 STEP  872 H= 218:00 +CPU= 31.565
  00:42:07 STEP  873 H= 218:15 +CPU= 31.333
  00:42:39 STEP  874 H= 218:30 +CPU= 30.926
  00:43:12 STEP  875 H= 218:45 +CPU= 31.938
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  01:41:02 STEP  876 H= 219:00 +CPU= 37.665
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000876
  01:41:35 STEP  877 H= 219:15 +CPU= 32.480
  01:42:07 STEP  878 H= 219:30 +CPU= 31.258
  01:42:39 STEP  879 H= 219:45 +CPU= 31.436
  01:43:11 STEP  880 H= 220:00 +CPU= 31.422
  01:43:43 STEP  881 H= 220:15 +CPU= 31.032
  01:44:16 STEP  882 H= 220:30 +CPU= 32.435
  01:44:47 STEP  883 H= 220:45 +CPU= 30.825
  01:45:22 STEP  884 H= 221:00 +CPU= 33.878
  01:45:54 STEP  885 H= 221:15 +CPU= 31.310
  01:46:25 STEP  886 H= 221:30 +CPU= 30.651
  01:46:57 STEP  887 H= 221:45 +CPU= 31.334
  01:47:37 STEP  888 H= 222:00 +CPU= 38.682
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000888
  01:48:09 STEP  889 H= 222:15 +CPU= 31.580
  01:48:43 STEP  890 H= 222:30 +CPU= 33.049
  01:49:15 STEP  891 H= 222:45 +CPU= 31.986
  01:49:48 STEP  892 H= 223:00 +CPU= 32.411
  01:50:20 STEP  893 H= 223:15 +CPU= 31.369
  01:50:52 STEP  894 H= 223:30 +CPU= 31.162
  01:51:24 STEP  895 H= 223:45 +CPU= 30.817
  01:51:58 STEP  896 H= 224:00 +CPU= 33.511
  01:52:31 STEP  897 H= 224:15 +CPU= 31.990
  01:53:02 STEP  898 H= 224:30 +CPU= 31.440
  01:53:32 STEP  899 H= 224:45 +CPU= 29.107
  01:54:11 STEP  900 H= 225:00 +CPU= 38.195
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000900
  01:54:44 STEP  901 H= 225:15 +CPU= 32.638
  01:55:16 STEP  902 H= 225:30 +CPU= 31.502
  01:55:49 STEP  903 H= 225:45 +CPU= 32.418
  01:56:23 STEP  904 H= 226:00 +CPU= 33.277
  01:56:55 STEP  905 H= 226:15 +CPU= 31.686
  01:57:28 STEP  906 H= 226:30 +CPU= 32.090
  01:58:00 STEP  907 H= 226:45 +CPU= 31.871
  01:58:33 STEP  908 H= 227:00 +CPU= 32.584
  01:59:05 STEP  909 H= 227:15 +CPU= 30.734
  01:59:37 STEP  910 H= 227:30 +CPU= 31.115
  02:00:10 STEP  911 H= 227:45 +CPU= 31.882
  02:00:53 STEP  912 H= 228:00 +CPU= 43.084
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000912
  02:01:24 STEP  913 H= 228:15 +CPU= 30.313
  02:01:56 STEP  914 H= 228:30 +CPU= 31.492
  02:02:29 STEP  915 H= 228:45 +CPU= 31.831
  02:03:01 STEP  916 H= 229:00 +CPU= 31.781
  02:03:33 STEP  917 H= 229:15 +CPU= 30.852
  02:04:06 STEP  918 H= 229:30 +CPU= 32.384
  02:04:39 STEP  919 H= 229:45 +CPU= 32.728
  02:05:11 STEP  920 H= 230:00 +CPU= 31.534
  02:05:44 STEP  921 H= 230:15 +CPU= 32.324
  02:06:17 STEP  922 H= 230:30 +CPU= 32.617
  02:06:50 STEP  923 H= 230:45 +CPU= 32.424
  02:07:32 STEP  924 H= 231:00 +CPU= 40.422
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000924
  02:08:03 STEP  925 H= 231:15 +CPU= 30.880
  02:08:36 STEP  926 H= 231:30 +CPU= 31.855
  02:09:09 STEP  927 H= 231:45 +CPU= 32.603
  02:09:43 STEP  928 H= 232:00 +CPU= 33.546
  02:10:16 STEP  929 H= 232:15 +CPU= 32.978
  02:10:48 STEP  930 H= 232:30 +CPU= 31.070
  02:11:21 STEP  931 H= 232:45 +CPU= 32.761
  02:11:53 STEP  932 H= 233:00 +CPU= 31.724
  02:12:25 STEP  933 H= 233:15 +CPU= 30.801
  02:12:55 STEP  934 H= 233:30 +CPU= 30.364
  02:13:27 STEP  935 H= 233:45 +CPU= 31.514
  02:14:09 STEP  936 H= 234:00 +CPU= 40.708
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000936
  02:14:43 STEP  937 H= 234:15 +CPU= 32.812
  02:15:15 STEP  938 H= 234:30 +CPU= 31.653
  02:15:48 STEP  939 H= 234:45 +CPU= 32.449
  02:16:22 STEP  940 H= 235:00 +CPU= 33.908
  02:16:55 STEP  941 H= 235:15 +CPU= 32.002
  02:17:28 STEP  942 H= 235:30 +CPU= 32.167
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:18:10 STEP  943 H= 235:45 +CPU= 32.581
  02:18:42 STEP  944 H= 236:00 +CPU= 31.360
  02:19:14 STEP  945 H= 236:15 +CPU= 31.289
  02:19:49 STEP  946 H= 236:30 +CPU= 32.842
  02:20:23 STEP  947 H= 236:45 +CPU= 33.860
  02:21:04 STEP  948 H= 237:00 +CPU= 39.748
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000948
  02:21:36 STEP  949 H= 237:15 +CPU= 32.216
  02:22:08 STEP  950 H= 237:30 +CPU= 31.096
  02:22:40 STEP  951 H= 237:45 +CPU= 31.666
  02:23:14 STEP  952 H= 238:00 +CPU= 32.324
  02:23:45 STEP  953 H= 238:15 +CPU= 30.387
  02:24:20 STEP  954 H= 238:30 +CPU= 33.394
  02:24:53 STEP  955 H= 238:45 +CPU= 32.303
  02:25:28 STEP  956 H= 239:00 +CPU= 34.233
  02:26:02 STEP  957 H= 239:15 +CPU= 33.240
  02:26:36 STEP  958 H= 239:30 +CPU= 30.144
  02:27:08 STEP  959 H= 239:45 +CPU= 30.673
  02:27:54 STEP  960 H= 240:00 +CPU= 44.087
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0_r404034391_9.zip
Uploading the intermediate file: upload_file_9.zip
  02:28:28 STEP  961 H= 240:15 +CPU= 32.131
  02:29:00 STEP  962 H= 240:30 +CPU= 31.702
  02:29:32 STEP  963 H= 240:45 +CPU= 31.378
  02:30:05 STEP  964 H= 241:00 +CPU= 32.179
  02:30:37 STEP  965 H= 241:15 +CPU= 31.599
  02:31:10 STEP  966 H= 241:30 +CPU= 31.782
  02:31:42 STEP  967 H= 241:45 +CPU= 31.853
  02:32:16 STEP  968 H= 242:00 +CPU= 32.810
  02:32:46 STEP  969 H= 242:15 +CPU= 30.216
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:33:20 STEP  970 H= 242:30 +CPU= 29.119
  02:33:53 STEP  971 H= 242:45 +CPU= 32.418
  02:34:35 STEP  972 H= 243:00 +CPU= 40.531
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000972
  02:35:09 STEP  973 H= 243:15 +CPU= 33.251
  02:35:41 STEP  974 H= 243:30 +CPU= 31.712
  02:36:13 STEP  975 H= 243:45 +CPU= 31.063
  02:36:44 STEP  976 H= 244:00 +CPU= 30.869
  02:37:16 STEP  977 H= 244:15 +CPU= 31.454
  02:37:48 STEP  978 H= 244:30 +CPU= 31.431
  02:38:20 STEP  979 H= 244:45 +CPU= 31.387
  02:38:53 STEP  980 H= 245:00 +CPU= 31.481
  02:39:25 STEP  981 H= 245:15 +CPU= 31.890
  02:39:58 STEP  982 H= 245:30 +CPU= 32.318
  02:40:32 STEP  983 H= 245:45 +CPU= 33.453
  02:41:12 STEP  984 H= 246:00 +CPU= 38.727
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000984
  02:41:44 STEP  985 H= 246:15 +CPU= 31.500
  02:42:17 STEP  986 H= 246:30 +CPU= 32.499
  02:42:49 STEP  987 H= 246:45 +CPU= 31.253
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:45:06 STEP  988 H= 247:00 +CPU= 30.659
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  02:45:45 STEP  989 H= 247:15 +CPU= 31.415
  02:46:17 STEP  990 H= 247:30 +CPU= 31.376
  02:46:48 STEP  991 H= 247:45 +CPU= 30.209
  02:47:20 STEP  992 H= 248:00 +CPU= 31.276
  02:47:52 STEP  993 H= 248:15 +CPU= 31.484
  02:48:24 STEP  994 H= 248:30 +CPU= 31.777
  02:48:56 STEP  995 H= 248:45 +CPU= 31.793
  02:49:35 STEP  996 H= 249:00 +CPU= 38.498
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+000996
  02:50:09 STEP  997 H= 249:15 +CPU= 32.443
  02:50:43 STEP  998 H= 249:30 +CPU= 33.268
  02:51:15 STEP  999 H= 249:45 +CPU= 31.443
  02:51:46 STEP 1000 H= 250:00 +CPU= 30.633
  02:52:19 STEP 1001 H= 250:15 +CPU= 31.707
  02:52:51 STEP 1002 H= 250:30 +CPU= 31.696
  02:53:25 STEP 1003 H= 250:45 +CPU= 32.491
  02:53:58 STEP 1004 H= 251:00 +CPU= 32.531
  02:54:31 STEP 1005 H= 251:15 +CPU= 31.910
  02:55:04 STEP 1006 H= 251:30 +CPU= 32.079
  02:55:39 STEP 1007 H= 251:45 +CPU= 33.862
  02:56:24 STEP 1008 H= 252:00 +CPU= 44.573
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001008
  02:56:55 STEP 1009 H= 252:15 +CPU= 30.725
  02:57:27 STEP 1010 H= 252:30 +CPU= 31.573
  02:58:01 STEP 1011 H= 252:45 +CPU= 32.479
  02:58:33 STEP 1012 H= 253:00 +CPU= 31.465
  02:59:06 STEP 1013 H= 253:15 +CPU= 32.120
  02:59:39 STEP 1014 H= 253:30 +CPU= 31.559
  03:00:11 STEP 1015 H= 253:45 +CPU= 31.254
  03:00:43 STEP 1016 H= 254:00 +CPU= 31.624
  03:01:13 STEP 1017 H= 254:15 +CPU= 29.757
  03:01:42 STEP 1018 H= 254:30 +CPU= 27.917
  03:02:11 STEP 1019 H= 254:45 +CPU= 28.855
  03:02:50 STEP 1020 H= 255:00 +CPU= 38.349
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001020
  03:03:23 STEP 1021 H= 255:15 +CPU= 31.973
  03:03:55 STEP 1022 H= 255:30 +CPU= 32.119
  03:04:29 STEP 1023 H= 255:45 +CPU= 33.455
  03:05:03 STEP 1024 H= 256:00 +CPU= 32.844
  03:05:37 STEP 1025 H= 256:15 +CPU= 32.897
  03:06:08 STEP 1026 H= 256:30 +CPU= 30.624
  03:06:40 STEP 1027 H= 256:45 +CPU= 31.969
  03:07:13 STEP 1028 H= 257:00 +CPU= 32.481
  03:07:46 STEP 1029 H= 257:15 +CPU= 31.927
  03:08:17 STEP 1030 H= 257:30 +CPU= 30.672
  03:08:47 STEP 1031 H= 257:45 +CPU= 29.958
  03:09:28 STEP 1032 H= 258:00 +CPU= 39.647
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001032
  03:10:01 STEP 1033 H= 258:15 +CPU= 32.383
  03:10:35 STEP 1034 H= 258:30 +CPU= 33.529
  03:11:08 STEP 1035 H= 258:45 +CPU= 31.935
  03:11:41 STEP 1036 H= 259:00 +CPU= 32.556
  03:12:13 STEP 1037 H= 259:15 +CPU= 31.211
  03:12:48 STEP 1038 H= 259:30 +CPU= 34.420
  03:13:21 STEP 1039 H= 259:45 +CPU= 31.695
  03:13:54 STEP 1040 H= 260:00 +CPU= 31.922
  03:14:28 STEP 1041 H= 260:15 +CPU= 32.538
  03:15:01 STEP 1042 H= 260:30 +CPU= 32.214
  03:15:33 STEP 1043 H= 260:45 +CPU= 31.390
  03:16:11 STEP 1044 H= 261:00 +CPU= 38.448
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001044
  03:16:44 STEP 1045 H= 261:15 +CPU= 31.326
  03:17:17 STEP 1046 H= 261:30 +CPU= 32.006
  03:17:50 STEP 1047 H= 261:45 +CPU= 32.343
  03:18:22 STEP 1048 H= 262:00 +CPU= 31.449
  03:18:55 STEP 1049 H= 262:15 +CPU= 31.905
  03:19:27 STEP 1050 H= 262:30 +CPU= 31.155
  03:19:59 STEP 1051 H= 262:45 +CPU= 32.009
  03:20:33 STEP 1052 H= 263:00 +CPU= 32.524
  03:21:06 STEP 1053 H= 263:15 +CPU= 31.804
  03:21:37 STEP 1054 H= 263:30 +CPU= 29.660
  03:22:10 STEP 1055 H= 263:45 +CPU= 31.089
  03:22:57 STEP 1056 H= 264:00 +CPU= 44.774
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0_r404034391_10.zip
Uploading the intermediate file: upload_file_10.zip
  03:23:29 STEP 1057 H= 264:15 +CPU= 31.271
Uploading trickle at timestep: 950400
  03:24:01 STEP 1058 H= 264:30 +CPU= 31.749
  03:24:34 STEP 1059 H= 264:45 +CPU= 32.004
  03:25:09 STEP 1060 H= 265:00 +CPU= 34.013
  03:25:40 STEP 1061 H= 265:15 +CPU= 30.963
  03:26:13 STEP 1062 H= 265:30 +CPU= 31.970
  03:26:46 STEP 1063 H= 265:45 +CPU= 32.024
  03:27:20 STEP 1064 H= 266:00 +CPU= 33.452
  03:27:53 STEP 1065 H= 266:15 +CPU= 32.864
  03:28:25 STEP 1066 H= 266:30 +CPU= 31.408
  03:28:58 STEP 1067 H= 266:45 +CPU= 31.929
  03:29:38 STEP 1068 H= 267:00 +CPU= 39.397
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001068
  03:30:11 STEP 1069 H= 267:15 +CPU= 31.987
  03:30:44 STEP 1070 H= 267:30 +CPU= 32.336
  03:31:18 STEP 1071 H= 267:45 +CPU= 33.500
  03:31:52 STEP 1072 H= 268:00 +CPU= 32.724
  03:32:25 STEP 1073 H= 268:15 +CPU= 32.122
  03:32:57 STEP 1074 H= 268:30 +CPU= 31.770
  03:33:30 STEP 1075 H= 268:45 +CPU= 32.090
  03:34:02 STEP 1076 H= 269:00 +CPU= 31.436
  03:34:34 STEP 1077 H= 269:15 +CPU= 31.295
  03:35:06 STEP 1078 H= 269:30 +CPU= 31.771
  03:35:39 STEP 1079 H= 269:45 +CPU= 32.222
  03:36:19 STEP 1080 H= 270:00 +CPU= 39.592
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001080
  03:36:51 STEP 1081 H= 270:15 +CPU= 31.908
  03:37:25 STEP 1082 H= 270:30 +CPU= 33.078
  03:37:57 STEP 1083 H= 270:45 +CPU= 31.735
  03:38:30 STEP 1084 H= 271:00 +CPU= 32.012
  03:39:02 STEP 1085 H= 271:15 +CPU= 31.646
  03:39:35 STEP 1086 H= 271:30 +CPU= 32.101
  03:40:07 STEP 1087 H= 271:45 +CPU= 31.103
  03:40:40 STEP 1088 H= 272:00 +CPU= 32.556
  03:41:13 STEP 1089 H= 272:15 +CPU= 32.322
  03:41:47 STEP 1090 H= 272:30 +CPU= 32.857
  03:42:18 STEP 1091 H= 272:45 +CPU= 31.032
  03:43:00 STEP 1092 H= 273:00 +CPU= 40.606
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001092
  03:43:31 STEP 1093 H= 273:15 +CPU= 30.896
  03:44:04 STEP 1094 H= 273:30 +CPU= 32.039
  03:44:37 STEP 1095 H= 273:45 +CPU= 32.271
  03:45:11 STEP 1096 H= 274:00 +CPU= 33.174
  03:45:43 STEP 1097 H= 274:15 +CPU= 31.724
  03:46:17 STEP 1098 H= 274:30 +CPU= 32.197
  03:46:49 STEP 1099 H= 274:45 +CPU= 31.713
  03:47:23 STEP 1100 H= 275:00 +CPU= 32.317
  03:47:55 STEP 1101 H= 275:15 +CPU= 32.078
  03:48:28 STEP 1102 H= 275:30 +CPU= 32.155
  03:49:02 STEP 1103 H= 275:45 +CPU= 32.868
  03:49:47 STEP 1104 H= 276:00 +CPU= 44.969
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001104
  03:50:21 STEP 1105 H= 276:15 +CPU= 32.520
  03:50:53 STEP 1106 H= 276:30 +CPU= 31.584
  03:51:25 STEP 1107 H= 276:45 +CPU= 31.272
  03:51:57 STEP 1108 H= 277:00 +CPU= 32.069
  03:52:31 STEP 1109 H= 277:15 +CPU= 33.288
  03:53:03 STEP 1110 H= 277:30 +CPU= 31.686
  03:53:36 STEP 1111 H= 277:45 +CPU= 32.177
  03:54:10 STEP 1112 H= 278:00 +CPU= 33.275
  03:54:42 STEP 1113 H= 278:15 +CPU= 32.005
  03:55:14 STEP 1114 H= 278:30 +CPU= 31.649
  03:55:49 STEP 1115 H= 278:45 +CPU= 33.871
  03:56:29 STEP 1116 H= 279:00 +CPU= 38.670
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001116
  03:57:02 STEP 1117 H= 279:15 +CPU= 32.188
  03:57:34 STEP 1118 H= 279:30 +CPU= 31.672
  03:58:07 STEP 1119 H= 279:45 +CPU= 32.268
  03:58:39 STEP 1120 H= 280:00 +CPU= 32.188
  03:59:12 STEP 1121 H= 280:15 +CPU= 31.984
  03:59:48 STEP 1122 H= 280:30 +CPU= 34.810
  04:00:21 STEP 1123 H= 280:45 +CPU= 32.960
  04:00:54 STEP 1124 H= 281:00 +CPU= 32.367
  04:01:28 STEP 1125 H= 281:15 +CPU= 32.688
  04:02:01 STEP 1126 H= 281:30 +CPU= 32.017
  04:02:33 STEP 1127 H= 281:45 +CPU= 32.148
  04:03:13 STEP 1128 H= 282:00 +CPU= 38.590
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001128
  04:03:46 STEP 1129 H= 282:15 +CPU= 32.752
  04:04:19 STEP 1130 H= 282:30 +CPU= 32.241
  04:04:51 STEP 1131 H= 282:45 +CPU= 31.489
  04:05:22 STEP 1132 H= 283:00 +CPU= 30.719
  04:05:57 STEP 1133 H= 283:15 +CPU= 33.553
  04:06:29 STEP 1134 H= 283:30 +CPU= 31.691
  04:07:01 STEP 1135 H= 283:45 +CPU= 31.089
  04:07:34 STEP 1136 H= 284:00 +CPU= 32.815
  04:08:08 STEP 1137 H= 284:15 +CPU= 32.607
  04:08:41 STEP 1138 H= 284:30 +CPU= 32.175
  04:09:14 STEP 1139 H= 284:45 +CPU= 32.501
  04:09:53 STEP 1140 H= 285:00 +CPU= 38.149
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001140
  04:10:25 STEP 1141 H= 285:15 +CPU= 32.382
  04:11:00 STEP 1142 H= 285:30 +CPU= 33.718
  04:11:32 STEP 1143 H= 285:45 +CPU= 31.548
  04:12:07 STEP 1144 H= 286:00 +CPU= 33.133
  04:12:39 STEP 1145 H= 286:15 +CPU= 32.044
  04:13:13 STEP 1146 H= 286:30 +CPU= 31.731
  04:13:44 STEP 1147 H= 286:45 +CPU= 30.798
  04:14:17 STEP 1148 H= 287:00 +CPU= 30.680
  04:14:50 STEP 1149 H= 287:15 +CPU= 32.273
  04:15:22 STEP 1150 H= 287:30 +CPU= 31.644
  04:15:53 STEP 1151 H= 287:45 +CPU= 30.530
  04:16:38 STEP 1152 H= 288:00 +CPU= 43.952
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0_r404034391_11.zip
Uploading the intermediate file: upload_file_11.zip
  04:17:11 STEP 1153 H= 288:15 +CPU= 31.080
  04:17:43 STEP 1154 H= 288:30 +CPU= 31.972
  04:18:16 STEP 1155 H= 288:45 +CPU= 31.890
  04:18:50 STEP 1156 H= 289:00 +CPU= 32.927
  04:19:23 STEP 1157 H= 289:15 +CPU= 32.099
  04:19:55 STEP 1158 H= 289:30 +CPU= 31.571
  04:20:27 STEP 1159 H= 289:45 +CPU= 32.088
  04:21:01 STEP 1160 H= 290:00 +CPU= 32.786
  04:21:33 STEP 1161 H= 290:15 +CPU= 31.159
  04:22:06 STEP 1162 H= 290:30 +CPU= 31.862
  04:22:40 STEP 1163 H= 290:45 +CPU= 33.945
  04:23:21 STEP 1164 H= 291:00 +CPU= 39.359
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001164
  04:23:52 STEP 1165 H= 291:15 +CPU= 31.290
  04:24:24 STEP 1166 H= 291:30 +CPU= 31.570
  04:24:58 STEP 1167 H= 291:45 +CPU= 33.043
  04:25:32 STEP 1168 H= 292:00 +CPU= 33.169
  04:26:04 STEP 1169 H= 292:15 +CPU= 31.621
  04:26:36 STEP 1170 H= 292:30 +CPU= 31.390
  04:27:08 STEP 1171 H= 292:45 +CPU= 31.411
  04:27:41 STEP 1172 H= 293:00 +CPU= 32.190
  04:28:14 STEP 1173 H= 293:15 +CPU= 31.632
  04:28:46 STEP 1174 H= 293:30 +CPU= 31.875
  04:29:18 STEP 1175 H= 293:45 +CPU= 31.535
  04:29:59 STEP 1176 H= 294:00 +CPU= 40.150
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001176
  04:30:32 STEP 1177 H= 294:15 +CPU= 31.755
  04:31:03 STEP 1178 H= 294:30 +CPU= 30.702
  04:31:34 STEP 1179 H= 294:45 +CPU= 30.711
  04:32:08 STEP 1180 H= 295:00 +CPU= 33.390
  04:32:42 STEP 1181 H= 295:15 +CPU= 32.894
  04:33:14 STEP 1182 H= 295:30 +CPU= 31.521
  04:33:46 STEP 1183 H= 295:45 +CPU= 31.609
  04:34:19 STEP 1184 H= 296:00 +CPU= 32.932
  04:34:52 STEP 1185 H= 296:15 +CPU= 31.839
  04:35:23 STEP 1186 H= 296:30 +CPU= 31.101
  04:35:55 STEP 1187 H= 296:45 +CPU= 31.467
  04:36:35 STEP 1188 H= 297:00 +CPU= 39.644
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001188
  04:37:09 STEP 1189 H= 297:15 +CPU= 32.848
  04:37:41 STEP 1190 H= 297:30 +CPU= 31.059
  04:38:11 STEP 1191 H= 297:45 +CPU= 29.561
  04:38:45 STEP 1192 H= 298:00 +CPU= 33.672
  04:39:18 STEP 1193 H= 298:15 +CPU= 31.881
  04:39:53 STEP 1194 H= 298:30 +CPU= 34.119
  04:40:26 STEP 1195 H= 298:45 +CPU= 32.089
  04:40:59 STEP 1196 H= 299:00 +CPU= 33.110
  04:41:31 STEP 1197 H= 299:15 +CPU= 31.312
  04:42:03 STEP 1198 H= 299:30 +CPU= 31.476
  04:42:36 STEP 1199 H= 299:45 +CPU= 32.305
  04:43:22 STEP 1200 H= 300:00 +CPU= 44.739
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001200
  04:43:54 STEP 1201 H= 300:15 +CPU= 30.858
  04:44:28 STEP 1202 H= 300:30 +CPU= 32.334
  04:45:01 STEP 1203 H= 300:45 +CPU= 32.351
  04:45:34 STEP 1204 H= 301:00 +CPU= 32.317
  04:46:06 STEP 1205 H= 301:15 +CPU= 32.124
  04:46:38 STEP 1206 H= 301:30 +CPU= 31.178
  04:47:11 STEP 1207 H= 301:45 +CPU= 32.526
  04:47:43 STEP 1208 H= 302:00 +CPU= 31.376
  04:48:16 STEP 1209 H= 302:15 +CPU= 32.657
  04:48:48 STEP 1210 H= 302:30 +CPU= 31.556
  04:49:22 STEP 1211 H= 302:45 +CPU= 33.161
  04:50:03 STEP 1212 H= 303:00 +CPU= 39.868
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001212
  04:50:37 STEP 1213 H= 303:15 +CPU= 32.890
  04:51:08 STEP 1214 H= 303:30 +CPU= 30.775
  04:51:40 STEP 1215 H= 303:45 +CPU= 31.327
  04:52:14 STEP 1216 H= 304:00 +CPU= 33.213
  04:52:47 STEP 1217 H= 304:15 +CPU= 32.420
  04:53:19 STEP 1218 H= 304:30 +CPU= 31.627
  04:53:50 STEP 1219 H= 304:45 +CPU= 30.558
  04:54:23 STEP 1220 H= 305:00 +CPU= 32.308
  04:54:55 STEP 1221 H= 305:15 +CPU= 31.544
  04:55:27 STEP 1222 H= 305:30 +CPU= 30.748
  04:56:02 STEP 1223 H= 305:45 +CPU= 33.301
  04:56:43 STEP 1224 H= 306:00 +CPU= 39.631
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001224
  04:57:15 STEP 1225 H= 306:15 +CPU= 31.961
  04:57:48 STEP 1226 H= 306:30 +CPU= 32.096
  04:58:20 STEP 1227 H= 306:45 +CPU= 31.218
  04:58:54 STEP 1228 H= 307:00 +CPU= 32.631
  04:59:27 STEP 1229 H= 307:15 +CPU= 32.307
  04:59:57 STEP 1230 H= 307:30 +CPU= 29.801
  05:00:30 STEP 1231 H= 307:45 +CPU= 32.306
  05:01:04 STEP 1232 H= 308:00 +CPU= 33.085
  05:01:37 STEP 1233 H= 308:15 +CPU= 31.956
  05:02:11 STEP 1234 H= 308:30 +CPU= 31.050
  05:02:44 STEP 1235 H= 308:45 +CPU= 32.418
  05:03:22 STEP 1236 H= 309:00 +CPU= 37.713
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001236
  05:03:56 STEP 1237 H= 309:15 +CPU= 32.859
  05:04:29 STEP 1238 H= 309:30 +CPU= 32.632
  05:05:05 STEP 1239 H= 309:45 +CPU= 34.762
  05:05:38 STEP 1240 H= 310:00 +CPU= 32.422
  05:06:11 STEP 1241 H= 310:15 +CPU= 32.402
  05:06:43 STEP 1242 H= 310:30 +CPU= 30.356
  05:07:12 STEP 1243 H= 310:45 +CPU= 28.662
  05:07:43 STEP 1244 H= 311:00 +CPU= 30.281
  05:08:16 STEP 1245 H= 311:15 +CPU= 31.664
  05:08:50 STEP 1246 H= 311:30 +CPU= 32.445
  05:09:23 STEP 1247 H= 311:45 +CPU= 31.668
  05:10:08 STEP 1248 H= 312:00 +CPU= 42.819
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0_r404034391_12.zip
Uploading the intermediate file: upload_file_12.zip
  05:10:40 STEP 1249 H= 312:15 +CPU= 31.916
  05:11:13 STEP 1250 H= 312:30 +CPU= 32.428
  05:11:46 STEP 1251 H= 312:45 +CPU= 32.556
  05:12:20 STEP 1252 H= 313:00 +CPU= 32.605
  05:12:52 STEP 1253 H= 313:15 +CPU= 31.970
  05:13:26 STEP 1254 H= 313:30 +CPU= 33.029
  05:14:01 STEP 1255 H= 313:45 +CPU= 34.460
  05:14:37 STEP 1256 H= 314:00 +CPU= 34.940
  05:15:10 STEP 1257 H= 314:15 +CPU= 32.381
  05:15:42 STEP 1258 H= 314:30 +CPU= 31.685
  05:16:16 STEP 1259 H= 314:45 +CPU= 32.813
  05:16:55 STEP 1260 H= 315:00 +CPU= 39.038
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001260
  05:17:29 STEP 1261 H= 315:15 +CPU= 33.316
  05:18:02 STEP 1262 H= 315:30 +CPU= 32.343
  05:18:35 STEP 1263 H= 315:45 +CPU= 32.521
  05:19:07 STEP 1264 H= 316:00 +CPU= 31.277
  05:19:40 STEP 1265 H= 316:15 +CPU= 31.831
  05:20:11 STEP 1266 H= 316:30 +CPU= 30.080
  05:20:43 STEP 1267 H= 316:45 +CPU= 31.400
  05:21:15 STEP 1268 H= 317:00 +CPU= 32.299
  05:21:48 STEP 1269 H= 317:15 +CPU= 32.342
  05:22:21 STEP 1270 H= 317:30 +CPU= 31.987
  05:22:55 STEP 1271 H= 317:45 +CPU= 33.228
  05:23:37 STEP 1272 H= 318:00 +CPU= 40.239
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001272
  05:24:11 STEP 1273 H= 318:15 +CPU= 32.920
  05:24:44 STEP 1274 H= 318:30 +CPU= 32.375
  05:25:16 STEP 1275 H= 318:45 +CPU= 31.741
  05:25:49 STEP 1276 H= 319:00 +CPU= 32.375
  05:26:21 STEP 1277 H= 319:15 +CPU= 31.601
  05:26:55 STEP 1278 H= 319:30 +CPU= 33.262
  05:27:28 STEP 1279 H= 319:45 +CPU= 32.216
  05:28:01 STEP 1280 H= 320:00 +CPU= 32.583
  05:28:32 STEP 1281 H= 320:15 +CPU= 30.772
  05:29:04 STEP 1282 H= 320:30 +CPU= 31.200
  05:29:37 STEP 1283 H= 320:45 +CPU= 32.309
  05:30:18 STEP 1284 H= 321:00 +CPU= 39.980
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001284
  05:30:50 STEP 1285 H= 321:15 +CPU= 32.125
  05:31:24 STEP 1286 H= 321:30 +CPU= 32.820
  05:31:57 STEP 1287 H= 321:45 +CPU= 32.175
  05:32:32 STEP 1288 H= 322:00 +CPU= 33.893
  05:33:06 STEP 1289 H= 322:15 +CPU= 32.780
  05:33:39 STEP 1290 H= 322:30 +CPU= 32.715
  05:34:12 STEP 1291 H= 322:45 +CPU= 32.257
  05:34:45 STEP 1292 H= 323:00 +CPU= 31.749
  05:35:18 STEP 1293 H= 323:15 +CPU= 32.138
  05:35:52 STEP 1294 H= 323:30 +CPU= 32.775
  05:36:25 STEP 1295 H= 323:45 +CPU= 32.701
  05:37:09 STEP 1296 H= 324:00 +CPU= 42.015
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001296
  05:37:41 STEP 1297 H= 324:15 +CPU= 31.124
  05:38:14 STEP 1298 H= 324:30 +CPU= 32.166
  05:38:47 STEP 1299 H= 324:45 +CPU= 32.765
  05:39:21 STEP 1300 H= 325:00 +CPU= 33.183
  05:39:55 STEP 1301 H= 325:15 +CPU= 33.175
  05:40:28 STEP 1302 H= 325:30 +CPU= 32.168
  05:41:00 STEP 1303 H= 325:45 +CPU= 32.272
  05:41:35 STEP 1304 H= 326:00 +CPU= 33.889
  05:42:07 STEP 1305 H= 326:15 +CPU= 31.354
  05:42:40 STEP 1306 H= 326:30 +CPU= 32.837
  05:43:13 STEP 1307 H= 326:45 +CPU= 31.648
  05:43:53 STEP 1308 H= 327:00 +CPU= 39.287
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001308
  05:44:26 STEP 1309 H= 327:15 +CPU= 32.282
  05:45:00 STEP 1310 H= 327:30 +CPU= 32.843
  05:45:34 STEP 1311 H= 327:45 +CPU= 33.881
  05:46:08 STEP 1312 H= 328:00 +CPU= 33.366
  05:46:43 STEP 1313 H= 328:15 +CPU= 34.002
  05:47:17 STEP 1314 H= 328:30 +CPU= 33.340
  05:47:49 STEP 1315 H= 328:45 +CPU= 31.652
  05:48:20 STEP 1316 H= 329:00 +CPU= 30.874
  05:48:54 STEP 1317 H= 329:15 +CPU= 33.308
  05:49:29 STEP 1318 H= 329:30 +CPU= 33.645
  05:50:01 STEP 1319 H= 329:45 +CPU= 31.935
  05:50:41 STEP 1320 H= 330:00 +CPU= 39.373
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001320
  05:51:15 STEP 1321 H= 330:15 +CPU= 32.982
  05:51:47 STEP 1322 H= 330:30 +CPU= 31.661
  05:52:20 STEP 1323 H= 330:45 +CPU= 32.164
  05:52:53 STEP 1324 H= 331:00 +CPU= 32.428
  05:53:27 STEP 1325 H= 331:15 +CPU= 32.858
  05:53:58 STEP 1326 H= 331:30 +CPU= 30.405
  05:54:30 STEP 1327 H= 331:45 +CPU= 31.715
  05:55:04 STEP 1328 H= 332:00 +CPU= 32.897
  05:55:36 STEP 1329 H= 332:15 +CPU= 31.240
  05:56:09 STEP 1330 H= 332:30 +CPU= 32.269
  05:56:43 STEP 1331 H= 332:45 +CPU= 32.548
  05:57:24 STEP 1332 H= 333:00 +CPU= 40.259
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001332
  05:57:56 STEP 1333 H= 333:15 +CPU= 31.909
  05:58:28 STEP 1334 H= 333:30 +CPU= 30.884
  05:59:00 STEP 1335 H= 333:45 +CPU= 31.536
  05:59:34 STEP 1336 H= 334:00 +CPU= 33.263
  06:00:04 STEP 1337 H= 334:15 +CPU= 28.904
  06:00:37 STEP 1338 H= 334:30 +CPU= 31.631
  06:01:10 STEP 1339 H= 334:45 +CPU= 32.812
  06:01:43 STEP 1340 H= 335:00 +CPU= 32.317
  06:02:16 STEP 1341 H= 335:15 +CPU= 32.208
  06:02:50 STEP 1342 H= 335:30 +CPU= 31.567
  06:03:25 STEP 1343 H= 335:45 +CPU= 32.389
  06:04:11 STEP 1344 H= 336:00 +CPU= 44.895
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0_r404034391_13.zip
Uploading the intermediate file: upload_file_13.zip
  06:04:44 STEP 1345 H= 336:15 +CPU= 31.591
  06:05:17 STEP 1346 H= 336:30 +CPU= 32.041
  06:05:49 STEP 1347 H= 336:45 +CPU= 31.894
  06:06:22 STEP 1348 H= 337:00 +CPU= 32.373
  06:06:56 STEP 1349 H= 337:15 +CPU= 33.111
  06:07:30 STEP 1350 H= 337:30 +CPU= 33.049
  06:08:02 STEP 1351 H= 337:45 +CPU= 31.226
  06:08:35 STEP 1352 H= 338:00 +CPU= 31.641
  06:09:07 STEP 1353 H= 338:15 +CPU= 31.772
  06:09:40 STEP 1354 H= 338:30 +CPU= 31.880
  06:10:12 STEP 1355 H= 338:45 +CPU= 31.967
  06:10:51 STEP 1356 H= 339:00 +CPU= 38.361
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001356
  06:11:21 STEP 1357 H= 339:15 +CPU= 30.085
  06:11:53 STEP 1358 H= 339:30 +CPU= 30.954
  06:12:25 STEP 1359 H= 339:45 +CPU= 31.277
  06:12:58 STEP 1360 H= 340:00 +CPU= 31.980
  06:13:31 STEP 1361 H= 340:15 +CPU= 33.075
  06:14:04 STEP 1362 H= 340:30 +CPU= 32.204
  06:14:37 STEP 1363 H= 340:45 +CPU= 32.162
  06:15:10 STEP 1364 H= 341:00 +CPU= 33.137
  06:15:44 STEP 1365 H= 341:15 +CPU= 32.917
  06:16:17 STEP 1366 H= 341:30 +CPU= 31.994
  06:16:51 STEP 1367 H= 341:45 +CPU= 33.949
  06:17:32 STEP 1368 H= 342:00 +CPU= 39.976
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001368
  06:18:04 STEP 1369 H= 342:15 +CPU= 31.083
  06:18:35 STEP 1370 H= 342:30 +CPU= 30.602
  06:19:08 STEP 1371 H= 342:45 +CPU= 32.464
  06:19:42 STEP 1372 H= 343:00 +CPU= 32.557
  06:20:16 STEP 1373 H= 343:15 +CPU= 32.631
  06:20:49 STEP 1374 H= 343:30 +CPU= 32.752
  06:21:22 STEP 1375 H= 343:45 +CPU= 32.275
  06:21:56 STEP 1376 H= 344:00 +CPU= 33.169
  06:22:29 STEP 1377 H= 344:15 +CPU= 32.884
  06:23:02 STEP 1378 H= 344:30 +CPU= 32.205
  06:23:35 STEP 1379 H= 344:45 +CPU= 32.341
  06:24:14 STEP 1380 H= 345:00 +CPU= 38.403
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001380
  06:24:48 STEP 1381 H= 345:15 +CPU= 32.184
  06:25:18 STEP 1382 H= 345:30 +CPU= 29.707
  06:25:50 STEP 1383 H= 345:45 +CPU= 30.987
  06:26:24 STEP 1384 H= 346:00 +CPU= 33.924
  06:26:58 STEP 1385 H= 346:15 +CPU= 32.579
  06:27:32 STEP 1386 H= 346:30 +CPU= 33.272
  06:28:06 STEP 1387 H= 346:45 +CPU= 33.132
  06:28:38 STEP 1388 H= 347:00 +CPU= 31.630
  06:29:12 STEP 1389 H= 347:15 +CPU= 33.218
  06:29:44 STEP 1390 H= 347:30 +CPU= 31.838
  06:30:18 STEP 1391 H= 347:45 +CPU= 32.778
  06:31:01 STEP 1392 H= 348:00 +CPU= 42.293
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001392
  06:31:31 STEP 1393 H= 348:15 +CPU= 30.218
  06:32:02 STEP 1394 H= 348:30 +CPU= 30.734
  06:32:33 STEP 1395 H= 348:45 +CPU= 30.756
  06:33:04 STEP 1396 H= 349:00 +CPU= 30.525
  06:33:34 STEP 1397 H= 349:15 +CPU= 29.529
  06:34:06 STEP 1398 H= 349:30 +CPU= 31.449
  06:34:39 STEP 1399 H= 349:45 +CPU= 32.223
  06:35:11 STEP 1400 H= 350:00 +CPU= 31.729
  06:35:44 STEP 1401 H= 350:15 +CPU= 32.122
  06:36:16 STEP 1402 H= 350:30 +CPU= 31.892
  06:36:49 STEP 1403 H= 350:45 +CPU= 32.399
  06:37:31 STEP 1404 H= 351:00 +CPU= 40.487
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001404
  06:38:04 STEP 1405 H= 351:15 +CPU= 32.286
  06:38:34 STEP 1406 H= 351:30 +CPU= 29.838
  06:39:04 STEP 1407 H= 351:45 +CPU= 30.044
  06:39:35 STEP 1408 H= 352:00 +CPU= 30.716
  06:40:06 STEP 1409 H= 352:15 +CPU= 30.497
  06:40:37 STEP 1410 H= 352:30 +CPU= 30.009
  06:41:07 STEP 1411 H= 352:45 +CPU= 30.544
  06:41:38 STEP 1412 H= 353:00 +CPU= 30.571
  06:42:10 STEP 1413 H= 353:15 +CPU= 31.238
  06:42:44 STEP 1414 H= 353:30 +CPU= 33.297
  06:43:17 STEP 1415 H= 353:45 +CPU= 32.276
  06:43:55 STEP 1416 H= 354:00 +CPU= 38.063
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001416
  06:44:28 STEP 1417 H= 354:15 +CPU= 31.828
  06:44:59 STEP 1418 H= 354:30 +CPU= 30.867
  06:45:32 STEP 1419 H= 354:45 +CPU= 31.967
  06:46:05 STEP 1420 H= 355:00 +CPU= 33.146
  06:46:36 STEP 1421 H= 355:15 +CPU= 30.476
  06:47:06 STEP 1422 H= 355:30 +CPU= 29.822
  06:47:37 STEP 1423 H= 355:45 +CPU= 30.155
  06:48:08 STEP 1424 H= 356:00 +CPU= 31.237
  06:48:38 STEP 1425 H= 356:15 +CPU= 29.130
  06:49:09 STEP 1426 H= 356:30 +CPU= 31.319
  06:49:41 STEP 1427 H= 356:45 +CPU= 30.952
  06:50:17 STEP 1428 H= 357:00 +CPU= 36.136
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001428
  06:50:47 STEP 1429 H= 357:15 +CPU= 29.488
  06:51:12 STEP 1430 H= 357:30 +CPU= 24.806
  06:51:35 STEP 1431 H= 357:45 +CPU= 23.125
  06:51:58 STEP 1432 H= 358:00 +CPU= 23.164
  06:52:21 STEP 1433 H= 358:15 +CPU= 22.513
  06:52:43 STEP 1434 H= 358:30 +CPU= 22.347
  06:53:07 STEP 1435 H= 358:45 +CPU= 23.144
  06:53:31 STEP 1436 H= 359:00 +CPU= 24.657
  06:53:55 STEP 1437 H= 359:15 +CPU= 23.118
  06:54:16 STEP 1438 H= 359:30 +CPU= 21.326
  06:54:37 STEP 1439 H= 359:45 +CPU= 21.320
  06:55:07 STEP 1440 H= 360:00 +CPU= 29.693
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.6836917389E-21      I       0.1534047746E-05      I
ICloud fractionI      0.0000000000E+00      I       0.4780140828E-01      I
I  Relat. Hum. I      0.1203544860E-01      I       0.1715406146E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.5198767069E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    327778708 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS819446.8 Mbytes/s, TOTAL TIME=    0.0068( 5.9%)
 06:55:07 STEP 1440 H= 360:00 +CPU= 29.693
 END CNT3
 NSTEP =  1440 CNT0   000000000  21.595  21.595  21.696   0.995               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        38610/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    678    0       46      1044068    38610 ************    91.3     2.2    89.0     3.5   181.0
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.99      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1405    6455.9    6455.9     17.89      0.00
   9 SPCM     - SPECTRAL COMP.                    1296    1445.9    1445.9      3.69      0.00
  10 SCAN2M - PHYSICS                             1297   16526.5   16526.5     42.27      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                108    1348.1    1348.1      0.29      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 55      83.3      83.3      0.01      0.00
  17 GRIDFPOS IN CNT4                              108      36.4      36.4      0.01      0.00
  27 RESTART FILES - WRITING                        27    5392.5    5392.5      0.29      0.00
  28 RESTART FILES - READING                         1    4792.2    4792.2      0.01      0.00
  29 SU4FPOS IN CNT4                               108       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                               108    6355.7    6355.7      1.35      0.00
  31 POSDDH IN STEPO                                 6       0.9       0.9      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1297    9936.3    9936.3     25.41      0.00
  39 SU0YOMB                                         1     390.6     390.6      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1297      28.5      28.5      0.07      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1296     587.3     587.3      1.50      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1296      89.6      89.6      0.23      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 55       0.6       0.6      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     2812     459.1     459.1      2.55      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      2700     265.3     265.3      1.41      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       2700     102.7     102.7      0.55      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      2812     154.4     154.4      0.86      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      34.8      34.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           2812      94.2      94.2      0.52      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           2700      59.0      59.0      0.31      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           2812     128.9     128.9      0.71      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           2700      62.5      62.5      0.33      0.00
 400 GSTATS                                     150940       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                140386       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    50714.4 CPU TIME   42009.8 VECTOR TIME    42009.8


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       25.6
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/35/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/35/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/35/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12281846/ICMSHh7zg+001440
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0_r404034391_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
06:58:36 (2067): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0_r404034391_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0_r404034391_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0_r404034391_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0_r404034391_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0_r404034391_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 05:04:46 1549573 22433413 oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0 1,295,100 49,185 0.0380
08 Jun 2024 01:58:28 1549573 22433413 oifs_43r3_bl_a00j_2016092300_20_1017_12281846_0 950,400 36,730 0.0386


©2024 climateprediction.net