climateprediction.net home page
Task 22438632

Task 22438632

Name oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0
Workunit 12287004
Created 7 Jun 2024, 18:19:44 UTC
Sent 7 Jun 2024, 18:23:53 UTC
Report deadline 6 Aug 2024, 18:23:53 UTC
Received 8 Jun 2024, 9:38:09 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1539347
Run time 10 hours 48 min 10 sec
CPU time 10 hours 41 min 41 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 5.61 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,024.82 MB
Peak swap size 5,980.80 MB
Peak disk usage 2,024.61 MB
Stderr
<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
= 208:30 +CPU= 23.403
  22:17:55 STEP  835 H= 208:45 +CPU= 23.316
  22:18:18 STEP  836 H= 209:00 +CPU= 23.709
  22:18:42 STEP  837 H= 209:15 +CPU= 23.423
  22:19:05 STEP  838 H= 209:30 +CPU= 23.300
  22:19:29 STEP  839 H= 209:45 +CPU= 23.385
  22:19:58 STEP  840 H= 210:00 +CPU= 28.918
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000840
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000840
  22:20:21 STEP  841 H= 210:15 +CPU= 23.511
  22:20:45 STEP  842 H= 210:30 +CPU= 23.557
  22:21:09 STEP  843 H= 210:45 +CPU= 23.571
  22:21:33 STEP  844 H= 211:00 +CPU= 23.868
  22:21:56 STEP  845 H= 211:15 +CPU= 23.711
  22:22:20 STEP  846 H= 211:30 +CPU= 23.563
  22:22:44 STEP  847 H= 211:45 +CPU= 23.693
  22:23:08 STEP  848 H= 212:00 +CPU= 23.871
  22:23:32 STEP  849 H= 212:15 +CPU= 23.638
  22:23:55 STEP  850 H= 212:30 +CPU= 23.553
  22:24:19 STEP  851 H= 212:45 +CPU= 23.402
  22:24:48 STEP  852 H= 213:00 +CPU= 28.879
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000852
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000852
  22:25:11 STEP  853 H= 213:15 +CPU= 23.401
  22:25:35 STEP  854 H= 213:30 +CPU= 23.494
  22:25:58 STEP  855 H= 213:45 +CPU= 23.589
  22:26:23 STEP  856 H= 214:00 +CPU= 24.052
  22:26:46 STEP  857 H= 214:15 +CPU= 23.615
  22:27:10 STEP  858 H= 214:30 +CPU= 23.607
  22:27:33 STEP  859 H= 214:45 +CPU= 23.434
  22:27:57 STEP  860 H= 215:00 +CPU= 23.702
  22:28:21 STEP  861 H= 215:15 +CPU= 23.481
  22:28:44 STEP  862 H= 215:30 +CPU= 23.534
  22:29:08 STEP  863 H= 215:45 +CPU= 23.373
  22:29:41 STEP  864 H= 216:00 +CPU= 32.760
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000864
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000780
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000792
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000804
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000816
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000828
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000840
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000852
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000852
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0_r1930448109_8.zip
Uploading the intermediate file: upload_file_8.zip
  22:30:04 STEP  865 H= 216:15 +CPU= 23.446
  22:30:28 STEP  866 H= 216:30 +CPU= 23.555
  22:30:52 STEP  867 H= 216:45 +CPU= 23.598
  22:31:15 STEP  868 H= 217:00 +CPU= 23.739
  22:31:39 STEP  869 H= 217:15 +CPU= 23.394
  22:32:03 STEP  870 H= 217:30 +CPU= 23.524
  22:32:26 STEP  871 H= 217:45 +CPU= 23.596
  22:32:50 STEP  872 H= 218:00 +CPU= 23.761
  22:33:14 STEP  873 H= 218:15 +CPU= 23.552
  22:33:37 STEP  874 H= 218:30 +CPU= 23.430
  22:34:01 STEP  875 H= 218:45 +CPU= 23.549
  22:34:30 STEP  876 H= 219:00 +CPU= 28.877
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000876
  22:34:54 STEP  877 H= 219:15 +CPU= 23.647
  22:35:17 STEP  878 H= 219:30 +CPU= 23.562
  22:35:41 STEP  879 H= 219:45 +CPU= 23.421
  22:36:05 STEP  880 H= 220:00 +CPU= 23.925
  22:36:28 STEP  881 H= 220:15 +CPU= 23.493
  22:36:52 STEP  882 H= 220:30 +CPU= 23.599
  22:37:15 STEP  883 H= 220:45 +CPU= 23.436
  22:37:39 STEP  884 H= 221:00 +CPU= 23.704
  22:38:03 STEP  885 H= 221:15 +CPU= 23.409
  22:38:26 STEP  886 H= 221:30 +CPU= 23.593
  22:38:50 STEP  887 H= 221:45 +CPU= 23.447
  22:39:19 STEP  888 H= 222:00 +CPU= 29.162
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000888
  22:39:43 STEP  889 H= 222:15 +CPU= 23.723
  22:40:07 STEP  890 H= 222:30 +CPU= 23.457
  22:40:30 STEP  891 H= 222:45 +CPU= 23.523
  22:40:54 STEP  892 H= 223:00 +CPU= 23.922
  22:41:18 STEP  893 H= 223:15 +CPU= 23.433
  22:41:41 STEP  894 H= 223:30 +CPU= 23.509
  22:42:05 STEP  895 H= 223:45 +CPU= 23.398
  22:42:29 STEP  896 H= 224:00 +CPU= 23.742
  22:42:52 STEP  897 H= 224:15 +CPU= 23.495
  22:43:16 STEP  898 H= 224:30 +CPU= 23.420
  22:43:39 STEP  899 H= 224:45 +CPU= 23.341
  22:44:08 STEP  900 H= 225:00 +CPU= 28.898
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000900
  22:44:32 STEP  901 H= 225:15 +CPU= 23.520
  22:44:55 STEP  902 H= 225:30 +CPU= 23.593
  22:45:19 STEP  903 H= 225:45 +CPU= 23.585
  22:45:43 STEP  904 H= 226:00 +CPU= 23.787
  22:46:07 STEP  905 H= 226:15 +CPU= 23.635
  22:46:30 STEP  906 H= 226:30 +CPU= 23.494
  22:46:54 STEP  907 H= 226:45 +CPU= 23.419
  22:47:18 STEP  908 H= 227:00 +CPU= 23.939
  22:47:42 STEP  909 H= 227:15 +CPU= 23.620
  22:48:05 STEP  910 H= 227:30 +CPU= 23.373
  22:48:29 STEP  911 H= 227:45 +CPU= 23.561
  22:49:02 STEP  912 H= 228:00 +CPU= 32.786
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000912
  22:49:25 STEP  913 H= 228:15 +CPU= 23.500
  22:49:49 STEP  914 H= 228:30 +CPU= 23.547
  22:50:12 STEP  915 H= 228:45 +CPU= 23.608
  22:50:36 STEP  916 H= 229:00 +CPU= 23.704
  22:51:00 STEP  917 H= 229:15 +CPU= 23.409
  22:51:23 STEP  918 H= 229:30 +CPU= 23.560
  22:51:47 STEP  919 H= 229:45 +CPU= 23.509
  22:52:11 STEP  920 H= 230:00 +CPU= 23.880
  22:52:35 STEP  921 H= 230:15 +CPU= 23.449
  22:52:58 STEP  922 H= 230:30 +CPU= 23.447
  22:53:22 STEP  923 H= 230:45 +CPU= 23.413
  22:53:51 STEP  924 H= 231:00 +CPU= 29.178
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000924
  22:54:14 STEP  925 H= 231:15 +CPU= 23.551
  22:54:38 STEP  926 H= 231:30 +CPU= 23.302
  22:55:01 STEP  927 H= 231:45 +CPU= 23.365
  22:55:25 STEP  928 H= 232:00 +CPU= 23.781
  22:55:49 STEP  929 H= 232:15 +CPU= 23.424
  22:56:12 STEP  930 H= 232:30 +CPU= 23.689
  22:56:36 STEP  931 H= 232:45 +CPU= 23.624
  22:57:00 STEP  932 H= 233:00 +CPU= 23.806
  22:57:24 STEP  933 H= 233:15 +CPU= 23.509
  22:57:47 STEP  934 H= 233:30 +CPU= 23.379
  22:58:11 STEP  935 H= 233:45 +CPU= 23.405
  22:58:40 STEP  936 H= 234:00 +CPU= 28.869
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000936
  22:59:03 STEP  937 H= 234:15 +CPU= 23.612
  22:59:27 STEP  938 H= 234:30 +CPU= 23.606
  22:59:51 STEP  939 H= 234:45 +CPU= 23.710
  23:00:15 STEP  940 H= 235:00 +CPU= 23.859
  23:00:38 STEP  941 H= 235:15 +CPU= 23.423
  23:01:02 STEP  942 H= 235:30 +CPU= 23.527
  23:01:26 STEP  943 H= 235:45 +CPU= 23.775
  23:01:50 STEP  944 H= 236:00 +CPU= 23.952
  23:02:13 STEP  945 H= 236:15 +CPU= 23.640
  23:02:37 STEP  946 H= 236:30 +CPU= 23.585
  23:03:01 STEP  947 H= 236:45 +CPU= 23.573
  23:03:30 STEP  948 H= 237:00 +CPU= 28.839
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000948
  23:03:53 STEP  949 H= 237:15 +CPU= 23.316
  23:04:17 STEP  950 H= 237:30 +CPU= 23.586
  23:04:41 STEP  951 H= 237:45 +CPU= 23.611
  23:05:05 STEP  952 H= 238:00 +CPU= 23.991
  23:05:28 STEP  953 H= 238:15 +CPU= 23.459
  23:05:52 STEP  954 H= 238:30 +CPU= 23.579
  23:06:15 STEP  955 H= 238:45 +CPU= 23.471
  23:06:39 STEP  956 H= 239:00 +CPU= 23.860
  23:07:03 STEP  957 H= 239:15 +CPU= 23.410
  23:07:26 STEP  958 H= 239:30 +CPU= 23.601
  23:07:50 STEP  959 H= 239:45 +CPU= 23.434
  23:08:23 STEP  960 H= 240:00 +CPU= 32.866
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0_r1930448109_9.zip
Uploading the intermediate file: upload_file_9.zip
  23:08:47 STEP  961 H= 240:15 +CPU= 23.615
Uploading trickle at timestep: 864000
  23:09:10 STEP  962 H= 240:30 +CPU= 23.558
  23:09:34 STEP  963 H= 240:45 +CPU= 23.785
  23:09:58 STEP  964 H= 241:00 +CPU= 23.808
  23:10:22 STEP  965 H= 241:15 +CPU= 23.502
  23:10:45 STEP  966 H= 241:30 +CPU= 23.631
  23:11:09 STEP  967 H= 241:45 +CPU= 23.560
  23:11:33 STEP  968 H= 242:00 +CPU= 23.814
  23:11:57 STEP  969 H= 242:15 +CPU= 23.742
  23:12:20 STEP  970 H= 242:30 +CPU= 23.505
  23:12:44 STEP  971 H= 242:45 +CPU= 23.483
  23:13:13 STEP  972 H= 243:00 +CPU= 28.864
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000972
  23:13:36 STEP  973 H= 243:15 +CPU= 23.493
  23:14:00 STEP  974 H= 243:30 +CPU= 23.619
  23:14:24 STEP  975 H= 243:45 +CPU= 23.499
  23:14:48 STEP  976 H= 244:00 +CPU= 24.013
  23:15:12 STEP  977 H= 244:15 +CPU= 23.653
  23:15:35 STEP  978 H= 244:30 +CPU= 23.628
  23:15:59 STEP  979 H= 244:45 +CPU= 23.656
  23:16:23 STEP  980 H= 245:00 +CPU= 23.906
  23:16:47 STEP  981 H= 245:15 +CPU= 23.419
  23:17:10 STEP  982 H= 245:30 +CPU= 23.462
  23:17:34 STEP  983 H= 245:45 +CPU= 23.473
  23:18:03 STEP  984 H= 246:00 +CPU= 28.990
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000984
  23:18:26 STEP  985 H= 246:15 +CPU= 23.544
  23:18:50 STEP  986 H= 246:30 +CPU= 23.595
  23:19:14 STEP  987 H= 246:45 +CPU= 23.576
  23:19:38 STEP  988 H= 247:00 +CPU= 23.761
  23:20:01 STEP  989 H= 247:15 +CPU= 23.361
  23:20:25 STEP  990 H= 247:30 +CPU= 23.497
  23:20:48 STEP  991 H= 247:45 +CPU= 23.550
  23:21:12 STEP  992 H= 248:00 +CPU= 23.889
  23:21:36 STEP  993 H= 248:15 +CPU= 23.485
  23:21:59 STEP  994 H= 248:30 +CPU= 23.305
  23:22:23 STEP  995 H= 248:45 +CPU= 23.427
  23:22:52 STEP  996 H= 249:00 +CPU= 28.850
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000996
  23:23:15 STEP  997 H= 249:15 +CPU= 23.665
  23:23:39 STEP  998 H= 249:30 +CPU= 23.544
  23:24:03 STEP  999 H= 249:45 +CPU= 23.651
  23:24:27 STEP 1000 H= 250:00 +CPU= 23.814
  23:24:50 STEP 1001 H= 250:15 +CPU= 23.399
  23:25:14 STEP 1002 H= 250:30 +CPU= 23.628
  23:25:37 STEP 1003 H= 250:45 +CPU= 23.475
  23:26:01 STEP 1004 H= 251:00 +CPU= 23.592
  23:26:25 STEP 1005 H= 251:15 +CPU= 23.422
  23:26:48 STEP 1006 H= 251:30 +CPU= 23.271
  23:27:11 STEP 1007 H= 251:45 +CPU= 23.323
  23:27:44 STEP 1008 H= 252:00 +CPU= 32.852
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001008
  23:28:08 STEP 1009 H= 252:15 +CPU= 23.556
  23:28:31 STEP 1010 H= 252:30 +CPU= 23.427
  23:28:55 STEP 1011 H= 252:45 +CPU= 23.358
  23:29:19 STEP 1012 H= 253:00 +CPU= 23.798
  23:29:42 STEP 1013 H= 253:15 +CPU= 23.561
  23:30:06 STEP 1014 H= 253:30 +CPU= 23.430
  23:30:30 STEP 1015 H= 253:45 +CPU= 23.698
  23:30:54 STEP 1016 H= 254:00 +CPU= 23.925
  23:31:17 STEP 1017 H= 254:15 +CPU= 23.407
  23:31:41 STEP 1018 H= 254:30 +CPU= 23.635
  23:32:05 STEP 1019 H= 254:45 +CPU= 23.548
  23:32:34 STEP 1020 H= 255:00 +CPU= 28.867
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001020
  23:32:57 STEP 1021 H= 255:15 +CPU= 23.439
  23:33:21 STEP 1022 H= 255:30 +CPU= 23.638
  23:33:44 STEP 1023 H= 255:45 +CPU= 23.523
  23:34:08 STEP 1024 H= 256:00 +CPU= 23.781
  23:34:32 STEP 1025 H= 256:15 +CPU= 23.501
  23:34:55 STEP 1026 H= 256:30 +CPU= 23.473
  23:35:19 STEP 1027 H= 256:45 +CPU= 23.508
  23:35:43 STEP 1028 H= 257:00 +CPU= 23.827
  23:36:07 STEP 1029 H= 257:15 +CPU= 23.487
  23:36:30 STEP 1030 H= 257:30 +CPU= 23.572
  23:36:54 STEP 1031 H= 257:45 +CPU= 23.605
  23:37:23 STEP 1032 H= 258:00 +CPU= 28.942
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001032
  23:37:46 STEP 1033 H= 258:15 +CPU= 23.496
  23:38:10 STEP 1034 H= 258:30 +CPU= 23.514
  23:38:33 STEP 1035 H= 258:45 +CPU= 23.345
  23:38:57 STEP 1036 H= 259:00 +CPU= 23.693
  23:39:21 STEP 1037 H= 259:15 +CPU= 23.398
  23:39:44 STEP 1038 H= 259:30 +CPU= 23.311
  23:40:08 STEP 1039 H= 259:45 +CPU= 23.571
  23:40:32 STEP 1040 H= 260:00 +CPU= 23.800
  23:40:55 STEP 1041 H= 260:15 +CPU= 23.374
  23:41:19 STEP 1042 H= 260:30 +CPU= 23.417
  23:41:42 STEP 1043 H= 260:45 +CPU= 23.522
  23:42:11 STEP 1044 H= 261:00 +CPU= 28.946
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001044
  23:42:35 STEP 1045 H= 261:15 +CPU= 23.398
  23:42:58 STEP 1046 H= 261:30 +CPU= 23.308
  23:43:22 STEP 1047 H= 261:45 +CPU= 23.437
  23:43:46 STEP 1048 H= 262:00 +CPU= 23.760
  23:44:09 STEP 1049 H= 262:15 +CPU= 23.611
  23:44:33 STEP 1050 H= 262:30 +CPU= 23.512
  23:44:57 STEP 1051 H= 262:45 +CPU= 23.619
  23:45:20 STEP 1052 H= 263:00 +CPU= 23.774
  23:45:44 STEP 1053 H= 263:15 +CPU= 23.556
  23:46:08 STEP 1054 H= 263:30 +CPU= 23.523
  23:46:31 STEP 1055 H= 263:45 +CPU= 23.513
  23:47:04 STEP 1056 H= 264:00 +CPU= 32.638
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0_r1930448109_10.zip
Uploading the intermediate file: upload_file_10.zip
  23:47:28 STEP 1057 H= 264:15 +CPU= 23.556
  23:47:51 STEP 1058 H= 264:30 +CPU= 23.520
  23:48:15 STEP 1059 H= 264:45 +CPU= 23.490
  23:48:39 STEP 1060 H= 265:00 +CPU= 23.736
  23:49:02 STEP 1061 H= 265:15 +CPU= 23.339
  23:49:26 STEP 1062 H= 265:30 +CPU= 23.589
  23:49:49 STEP 1063 H= 265:45 +CPU= 23.451
  23:50:13 STEP 1064 H= 266:00 +CPU= 23.718
  23:50:37 STEP 1065 H= 266:15 +CPU= 23.388
  23:51:00 STEP 1066 H= 266:30 +CPU= 23.565
  23:51:24 STEP 1067 H= 266:45 +CPU= 23.568
  23:51:53 STEP 1068 H= 267:00 +CPU= 28.999
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001068
  23:52:17 STEP 1069 H= 267:15 +CPU= 23.585
  23:52:40 STEP 1070 H= 267:30 +CPU= 23.574
  23:53:04 STEP 1071 H= 267:45 +CPU= 23.523
  23:53:28 STEP 1072 H= 268:00 +CPU= 23.995
  23:53:52 STEP 1073 H= 268:15 +CPU= 23.494
  23:54:15 STEP 1074 H= 268:30 +CPU= 23.456
  23:54:39 STEP 1075 H= 268:45 +CPU= 23.582
  23:55:03 STEP 1076 H= 269:00 +CPU= 23.731
  23:55:26 STEP 1077 H= 269:15 +CPU= 23.432
  23:55:50 STEP 1078 H= 269:30 +CPU= 23.637
  23:56:13 STEP 1079 H= 269:45 +CPU= 23.442
  23:56:42 STEP 1080 H= 270:00 +CPU= 28.947
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001080
  23:57:06 STEP 1081 H= 270:15 +CPU= 23.463
  23:57:30 STEP 1082 H= 270:30 +CPU= 23.745
  23:57:53 STEP 1083 H= 270:45 +CPU= 23.529
  23:58:17 STEP 1084 H= 271:00 +CPU= 23.900
  23:58:41 STEP 1085 H= 271:15 +CPU= 23.420
  23:59:05 STEP 1086 H= 271:30 +CPU= 23.680
  23:59:28 STEP 1087 H= 271:45 +CPU= 23.610
  23:59:52 STEP 1088 H= 272:00 +CPU= 23.872
  00:00:16 STEP 1089 H= 272:15 +CPU= 23.565
  00:00:39 STEP 1090 H= 272:30 +CPU= 23.413
  00:01:03 STEP 1091 H= 272:45 +CPU= 23.421
  00:01:32 STEP 1092 H= 273:00 +CPU= 28.957
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001092
  00:01:56 STEP 1093 H= 273:15 +CPU= 23.632
  00:02:20 STEP 1094 H= 273:30 +CPU= 23.785
  00:02:43 STEP 1095 H= 273:45 +CPU= 23.496
  00:03:07 STEP 1096 H= 274:00 +CPU= 23.569
  00:03:31 STEP 1097 H= 274:15 +CPU= 23.759
  00:03:54 STEP 1098 H= 274:30 +CPU= 23.596
  00:04:18 STEP 1099 H= 274:45 +CPU= 23.458
  00:04:42 STEP 1100 H= 275:00 +CPU= 23.764
  00:05:05 STEP 1101 H= 275:15 +CPU= 23.593
  00:05:29 STEP 1102 H= 275:30 +CPU= 23.455
  00:05:53 STEP 1103 H= 275:45 +CPU= 23.501
  00:06:26 STEP 1104 H= 276:00 +CPU= 32.864
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001104
  00:06:49 STEP 1105 H= 276:15 +CPU= 23.374
  00:07:13 STEP 1106 H= 276:30 +CPU= 23.640
  00:07:36 STEP 1107 H= 276:45 +CPU= 23.381
  00:08:00 STEP 1108 H= 277:00 +CPU= 23.813
  00:08:24 STEP 1109 H= 277:15 +CPU= 23.661
  00:08:47 STEP 1110 H= 277:30 +CPU= 23.567
  00:09:11 STEP 1111 H= 277:45 +CPU= 23.603
  00:09:35 STEP 1112 H= 278:00 +CPU= 23.745
  00:09:59 STEP 1113 H= 278:15 +CPU= 23.563
  00:10:22 STEP 1114 H= 278:30 +CPU= 23.388
  00:10:46 STEP 1115 H= 278:45 +CPU= 23.435
  00:11:15 STEP 1116 H= 279:00 +CPU= 29.036
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001116
  00:11:38 STEP 1117 H= 279:15 +CPU= 23.576
  00:12:02 STEP 1118 H= 279:30 +CPU= 23.615
  00:12:26 STEP 1119 H= 279:45 +CPU= 23.459
  00:12:50 STEP 1120 H= 280:00 +CPU= 23.881
  00:13:13 STEP 1121 H= 280:15 +CPU= 23.563
  00:13:37 STEP 1122 H= 280:30 +CPU= 23.422
  00:14:00 STEP 1123 H= 280:45 +CPU= 23.568
  00:14:24 STEP 1124 H= 281:00 +CPU= 23.928
  00:14:48 STEP 1125 H= 281:15 +CPU= 23.405
  00:15:12 STEP 1126 H= 281:30 +CPU= 23.578
  00:15:35 STEP 1127 H= 281:45 +CPU= 23.440
  00:16:04 STEP 1128 H= 282:00 +CPU= 29.145
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001128
  00:16:28 STEP 1129 H= 282:15 +CPU= 23.564
  00:16:52 STEP 1130 H= 282:30 +CPU= 23.528
  00:17:15 STEP 1131 H= 282:45 +CPU= 23.512
  00:17:39 STEP 1132 H= 283:00 +CPU= 23.963
  00:18:03 STEP 1133 H= 283:15 +CPU= 23.568
  00:18:27 STEP 1134 H= 283:30 +CPU= 23.622
  00:18:50 STEP 1135 H= 283:45 +CPU= 23.522
  00:19:15 STEP 1136 H= 284:00 +CPU= 24.117
  00:19:38 STEP 1137 H= 284:15 +CPU= 23.630
  00:20:02 STEP 1138 H= 284:30 +CPU= 23.588
  00:20:26 STEP 1139 H= 284:45 +CPU= 23.500
  00:20:55 STEP 1140 H= 285:00 +CPU= 29.084
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001140
  00:21:19 STEP 1141 H= 285:15 +CPU= 23.752
  00:21:42 STEP 1142 H= 285:30 +CPU= 23.490
  00:22:06 STEP 1143 H= 285:45 +CPU= 23.687
  00:22:30 STEP 1144 H= 286:00 +CPU= 23.974
  00:22:54 STEP 1145 H= 286:15 +CPU= 23.704
  00:23:18 STEP 1146 H= 286:30 +CPU= 23.616
  00:23:41 STEP 1147 H= 286:45 +CPU= 23.489
  00:24:05 STEP 1148 H= 287:00 +CPU= 23.804
  00:24:29 STEP 1149 H= 287:15 +CPU= 23.644
  00:24:53 STEP 1150 H= 287:30 +CPU= 23.673
  00:25:16 STEP 1151 H= 287:45 +CPU= 23.501
  00:25:49 STEP 1152 H= 288:00 +CPU= 32.871
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0_r1930448109_11.zip
Uploading the intermediate file: upload_file_11.zip
  00:26:13 STEP 1153 H= 288:15 +CPU= 23.554
  00:26:36 STEP 1154 H= 288:30 +CPU= 23.633
  00:27:00 STEP 1155 H= 288:45 +CPU= 23.432
  00:27:24 STEP 1156 H= 289:00 +CPU= 23.801
  00:27:47 STEP 1157 H= 289:15 +CPU= 23.505
  00:28:11 STEP 1158 H= 289:30 +CPU= 23.509
  00:28:35 STEP 1159 H= 289:45 +CPU= 23.454
  00:28:58 STEP 1160 H= 290:00 +CPU= 23.669
  00:29:22 STEP 1161 H= 290:15 +CPU= 23.503
  00:29:45 STEP 1162 H= 290:30 +CPU= 23.413
  00:30:09 STEP 1163 H= 290:45 +CPU= 23.405
  00:30:38 STEP 1164 H= 291:00 +CPU= 29.015
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001164
  00:31:02 STEP 1165 H= 291:15 +CPU= 23.486
  00:31:25 STEP 1166 H= 291:30 +CPU= 23.645
  00:31:49 STEP 1167 H= 291:45 +CPU= 23.406
  00:32:13 STEP 1168 H= 292:00 +CPU= 23.812
  00:32:37 STEP 1169 H= 292:15 +CPU= 23.672
  00:33:00 STEP 1170 H= 292:30 +CPU= 23.502
  00:33:24 STEP 1171 H= 292:45 +CPU= 23.766
  00:33:48 STEP 1172 H= 293:00 +CPU= 23.869
  00:34:12 STEP 1173 H= 293:15 +CPU= 23.566
  00:34:35 STEP 1174 H= 293:30 +CPU= 23.428
  00:34:59 STEP 1175 H= 293:45 +CPU= 23.627
  00:35:28 STEP 1176 H= 294:00 +CPU= 28.753
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001176
  00:35:51 STEP 1177 H= 294:15 +CPU= 23.397
  00:36:15 STEP 1178 H= 294:30 +CPU= 23.641
  00:36:39 STEP 1179 H= 294:45 +CPU= 23.703
  00:37:02 STEP 1180 H= 295:00 +CPU= 23.777
  00:37:26 STEP 1181 H= 295:15 +CPU= 23.597
  00:37:50 STEP 1182 H= 295:30 +CPU= 23.446
  00:38:13 STEP 1183 H= 295:45 +CPU= 23.636
  00:38:37 STEP 1184 H= 296:00 +CPU= 23.688
  00:39:01 STEP 1185 H= 296:15 +CPU= 23.635
  00:39:25 STEP 1186 H= 296:30 +CPU= 23.568
  00:39:48 STEP 1187 H= 296:45 +CPU= 23.727
  00:40:18 STEP 1188 H= 297:00 +CPU= 29.113
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001188
  00:40:41 STEP 1189 H= 297:15 +CPU= 23.756
  00:41:05 STEP 1190 H= 297:30 +CPU= 23.615
  00:41:29 STEP 1191 H= 297:45 +CPU= 23.581
  00:41:53 STEP 1192 H= 298:00 +CPU= 24.004
  00:42:17 STEP 1193 H= 298:15 +CPU= 23.610
  00:42:40 STEP 1194 H= 298:30 +CPU= 23.647
  00:43:04 STEP 1195 H= 298:45 +CPU= 23.532
  00:43:28 STEP 1196 H= 299:00 +CPU= 23.855
  00:43:52 STEP 1197 H= 299:15 +CPU= 23.533
  00:44:15 STEP 1198 H= 299:30 +CPU= 23.546
  00:44:39 STEP 1199 H= 299:45 +CPU= 23.594
  00:45:12 STEP 1200 H= 300:00 +CPU= 33.088
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001200
  00:45:36 STEP 1201 H= 300:15 +CPU= 23.730
  00:46:00 STEP 1202 H= 300:30 +CPU= 23.673
  00:46:23 STEP 1203 H= 300:45 +CPU= 23.662
  00:46:47 STEP 1204 H= 301:00 +CPU= 23.946
  00:47:11 STEP 1205 H= 301:15 +CPU= 23.612
  00:47:35 STEP 1206 H= 301:30 +CPU= 23.514
  00:47:58 STEP 1207 H= 301:45 +CPU= 23.656
  00:48:23 STEP 1208 H= 302:00 +CPU= 23.982
  00:48:46 STEP 1209 H= 302:15 +CPU= 23.545
  00:49:10 STEP 1210 H= 302:30 +CPU= 23.507
  00:49:33 STEP 1211 H= 302:45 +CPU= 23.603
  00:50:03 STEP 1212 H= 303:00 +CPU= 29.113
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001212
  00:50:26 STEP 1213 H= 303:15 +CPU= 23.633
  00:50:50 STEP 1214 H= 303:30 +CPU= 23.528
  00:51:14 STEP 1215 H= 303:45 +CPU= 23.465
  00:51:38 STEP 1216 H= 304:00 +CPU= 24.049
  00:52:01 STEP 1217 H= 304:15 +CPU= 23.442
  00:52:25 STEP 1218 H= 304:30 +CPU= 23.754
  00:52:49 STEP 1219 H= 304:45 +CPU= 23.843
  00:53:13 STEP 1220 H= 305:00 +CPU= 24.018
  00:53:37 STEP 1221 H= 305:15 +CPU= 23.564
  00:54:00 STEP 1222 H= 305:30 +CPU= 23.566
  00:54:24 STEP 1223 H= 305:45 +CPU= 23.870
  00:54:53 STEP 1224 H= 306:00 +CPU= 28.891
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001224
  00:55:17 STEP 1225 H= 306:15 +CPU= 23.648
  00:55:41 STEP 1226 H= 306:30 +CPU= 23.471
  00:56:04 STEP 1227 H= 306:45 +CPU= 23.663
  00:56:28 STEP 1228 H= 307:00 +CPU= 23.687
  00:56:52 STEP 1229 H= 307:15 +CPU= 23.567
  00:57:16 STEP 1230 H= 307:30 +CPU= 23.775
  00:57:39 STEP 1231 H= 307:45 +CPU= 23.459
  00:58:03 STEP 1232 H= 308:00 +CPU= 23.848
  00:58:27 STEP 1233 H= 308:15 +CPU= 23.423
  00:58:50 STEP 1234 H= 308:30 +CPU= 23.648
  00:59:14 STEP 1235 H= 308:45 +CPU= 23.654
  00:59:43 STEP 1236 H= 309:00 +CPU= 28.913
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001236
  01:00:07 STEP 1237 H= 309:15 +CPU= 23.506
  01:00:30 STEP 1238 H= 309:30 +CPU= 23.442
  01:00:54 STEP 1239 H= 309:45 +CPU= 23.565
  01:01:18 STEP 1240 H= 310:00 +CPU= 23.838
  01:01:41 STEP 1241 H= 310:15 +CPU= 23.496
  01:02:05 STEP 1242 H= 310:30 +CPU= 23.628
  01:02:28 STEP 1243 H= 310:45 +CPU= 23.305
  01:02:52 STEP 1244 H= 311:00 +CPU= 23.736
  01:03:16 STEP 1245 H= 311:15 +CPU= 23.506
  01:03:40 STEP 1246 H= 311:30 +CPU= 23.685
  01:04:03 STEP 1247 H= 311:45 +CPU= 23.486
  01:04:36 STEP 1248 H= 312:00 +CPU= 32.794
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0_r1930448109_12.zip
Uploading the intermediate file: upload_file_12.zip
  01:05:00 STEP 1249 H= 312:15 +CPU= 23.710
  01:05:23 STEP 1250 H= 312:30 +CPU= 23.434
  01:05:47 STEP 1251 H= 312:45 +CPU= 23.549
  01:06:11 STEP 1252 H= 313:00 +CPU= 23.656
  01:06:34 STEP 1253 H= 313:15 +CPU= 23.472
  01:06:58 STEP 1254 H= 313:30 +CPU= 23.637
  01:07:22 STEP 1255 H= 313:45 +CPU= 23.567
  01:07:46 STEP 1256 H= 314:00 +CPU= 23.941
  01:08:10 STEP 1257 H= 314:15 +CPU= 23.730
  01:08:33 STEP 1258 H= 314:30 +CPU= 23.692
  01:08:57 STEP 1259 H= 314:45 +CPU= 23.673
  01:09:26 STEP 1260 H= 315:00 +CPU= 28.876
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001260
  01:09:50 STEP 1261 H= 315:15 +CPU= 23.462
  01:10:13 STEP 1262 H= 315:30 +CPU= 23.551
  01:10:37 STEP 1263 H= 315:45 +CPU= 23.528
  01:11:01 STEP 1264 H= 316:00 +CPU= 23.955
  01:11:25 STEP 1265 H= 316:15 +CPU= 23.725
  01:11:48 STEP 1266 H= 316:30 +CPU= 23.556
  01:12:12 STEP 1267 H= 316:45 +CPU= 23.618
  01:12:36 STEP 1268 H= 317:00 +CPU= 23.642
  01:12:59 STEP 1269 H= 317:15 +CPU= 23.565
  01:13:23 STEP 1270 H= 317:30 +CPU= 23.545
  01:13:47 STEP 1271 H= 317:45 +CPU= 23.591
  01:14:16 STEP 1272 H= 318:00 +CPU= 29.242
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001272
  01:14:40 STEP 1273 H= 318:15 +CPU= 23.534
  01:15:03 STEP 1274 H= 318:30 +CPU= 23.519
  01:15:27 STEP 1275 H= 318:45 +CPU= 23.367
  01:15:51 STEP 1276 H= 319:00 +CPU= 23.836
  01:16:14 STEP 1277 H= 319:15 +CPU= 23.485
  01:16:38 STEP 1278 H= 319:30 +CPU= 23.367
  01:17:01 STEP 1279 H= 319:45 +CPU= 23.603
  01:17:25 STEP 1280 H= 320:00 +CPU= 23.877
  01:17:49 STEP 1281 H= 320:15 +CPU= 23.446
  01:18:13 STEP 1282 H= 320:30 +CPU= 23.715
  01:18:36 STEP 1283 H= 320:45 +CPU= 23.616
  01:19:06 STEP 1284 H= 321:00 +CPU= 29.251
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001284
  01:19:29 STEP 1285 H= 321:15 +CPU= 23.521
  01:19:53 STEP 1286 H= 321:30 +CPU= 23.636
  01:20:17 STEP 1287 H= 321:45 +CPU= 23.558
  01:20:41 STEP 1288 H= 322:00 +CPU= 23.821
  01:21:04 STEP 1289 H= 322:15 +CPU= 23.593
  01:21:28 STEP 1290 H= 322:30 +CPU= 23.528
  01:21:52 STEP 1291 H= 322:45 +CPU= 23.649
  01:22:16 STEP 1292 H= 323:00 +CPU= 23.870
  01:22:39 STEP 1293 H= 323:15 +CPU= 23.702
  01:23:03 STEP 1294 H= 323:30 +CPU= 23.559
  01:23:27 STEP 1295 H= 323:45 +CPU= 23.595
  01:24:00 STEP 1296 H= 324:00 +CPU= 32.950
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001296
  01:24:23 STEP 1297 H= 324:15 +CPU= 23.592
  01:24:47 STEP 1298 H= 324:30 +CPU= 23.709
  01:25:11 STEP 1299 H= 324:45 +CPU= 23.498
  01:25:35 STEP 1300 H= 325:00 +CPU= 23.922
  01:25:58 STEP 1301 H= 325:15 +CPU= 23.594
  01:26:22 STEP 1302 H= 325:30 +CPU= 23.592
  01:26:46 STEP 1303 H= 325:45 +CPU= 23.669
  01:27:10 STEP 1304 H= 326:00 +CPU= 23.813
  01:27:34 STEP 1305 H= 326:15 +CPU= 23.697
  01:27:57 STEP 1306 H= 326:30 +CPU= 23.486
  01:28:21 STEP 1307 H= 326:45 +CPU= 23.646
  01:28:50 STEP 1308 H= 327:00 +CPU= 29.045
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001308
  01:29:14 STEP 1309 H= 327:15 +CPU= 23.685
  01:29:38 STEP 1310 H= 327:30 +CPU= 23.821
  01:30:01 STEP 1311 H= 327:45 +CPU= 23.431
  01:30:25 STEP 1312 H= 328:00 +CPU= 24.045
  01:30:49 STEP 1313 H= 328:15 +CPU= 23.610
  01:31:13 STEP 1314 H= 328:30 +CPU= 23.582
  01:31:36 STEP 1315 H= 328:45 +CPU= 23.470
  01:32:00 STEP 1316 H= 329:00 +CPU= 24.002
  01:32:24 STEP 1317 H= 329:15 +CPU= 23.637
  01:32:48 STEP 1318 H= 329:30 +CPU= 23.613
  01:33:12 STEP 1319 H= 329:45 +CPU= 23.612
  01:33:41 STEP 1320 H= 330:00 +CPU= 29.121
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001320
  01:34:04 STEP 1321 H= 330:15 +CPU= 23.544
  01:34:28 STEP 1322 H= 330:30 +CPU= 23.619
  01:34:52 STEP 1323 H= 330:45 +CPU= 23.694
  01:35:16 STEP 1324 H= 331:00 +CPU= 23.977
  01:35:40 STEP 1325 H= 331:15 +CPU= 23.664
  01:36:03 STEP 1326 H= 331:30 +CPU= 23.614
  01:36:27 STEP 1327 H= 331:45 +CPU= 23.638
  01:36:51 STEP 1328 H= 332:00 +CPU= 23.985
  01:37:15 STEP 1329 H= 332:15 +CPU= 23.597
  01:37:38 STEP 1330 H= 332:30 +CPU= 23.479
  01:38:02 STEP 1331 H= 332:45 +CPU= 23.724
  01:38:31 STEP 1332 H= 333:00 +CPU= 29.097
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001332
  01:38:55 STEP 1333 H= 333:15 +CPU= 23.575
  01:39:19 STEP 1334 H= 333:30 +CPU= 23.504
  01:39:42 STEP 1335 H= 333:45 +CPU= 23.481
  01:40:06 STEP 1336 H= 334:00 +CPU= 23.857
  01:40:30 STEP 1337 H= 334:15 +CPU= 23.606
  01:40:53 STEP 1338 H= 334:30 +CPU= 23.440
  01:41:17 STEP 1339 H= 334:45 +CPU= 23.777
  01:41:41 STEP 1340 H= 335:00 +CPU= 23.836
  01:42:05 STEP 1341 H= 335:15 +CPU= 23.675
  01:42:29 STEP 1342 H= 335:30 +CPU= 23.644
  01:42:52 STEP 1343 H= 335:45 +CPU= 23.617
  01:43:25 STEP 1344 H= 336:00 +CPU= 32.914
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0_r1930448109_13.zip
Uploading the intermediate file: upload_file_13.zip
  01:43:49 STEP 1345 H= 336:15 +CPU= 23.441
  01:44:13 STEP 1346 H= 336:30 +CPU= 23.646
  01:44:37 STEP 1347 H= 336:45 +CPU= 23.760
  01:45:01 STEP 1348 H= 337:00 +CPU= 23.850
  01:45:24 STEP 1349 H= 337:15 +CPU= 23.514
  01:45:48 STEP 1350 H= 337:30 +CPU= 23.364
  01:46:11 STEP 1351 H= 337:45 +CPU= 23.563
  01:46:35 STEP 1352 H= 338:00 +CPU= 23.758
  01:46:59 STEP 1353 H= 338:15 +CPU= 23.610
  01:47:23 STEP 1354 H= 338:30 +CPU= 23.712
  01:47:46 STEP 1355 H= 338:45 +CPU= 23.546
  01:48:15 STEP 1356 H= 339:00 +CPU= 29.113
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001356
  01:48:39 STEP 1357 H= 339:15 +CPU= 23.409
  01:49:02 STEP 1358 H= 339:30 +CPU= 23.445
  01:49:26 STEP 1359 H= 339:45 +CPU= 23.707
  01:49:50 STEP 1360 H= 340:00 +CPU= 23.874
  01:50:14 STEP 1361 H= 340:15 +CPU= 23.662
  01:50:37 STEP 1362 H= 340:30 +CPU= 23.491
  01:51:01 STEP 1363 H= 340:45 +CPU= 23.531
  01:51:25 STEP 1364 H= 341:00 +CPU= 24.025
  01:51:49 STEP 1365 H= 341:15 +CPU= 23.689
  01:52:13 STEP 1366 H= 341:30 +CPU= 23.526
  01:52:36 STEP 1367 H= 341:45 +CPU= 23.605
  01:53:06 STEP 1368 H= 342:00 +CPU= 29.177
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001368
  01:53:29 STEP 1369 H= 342:15 +CPU= 23.692
  01:53:53 STEP 1370 H= 342:30 +CPU= 23.796
  01:54:17 STEP 1371 H= 342:45 +CPU= 23.782
  01:54:41 STEP 1372 H= 343:00 +CPU= 24.135
  01:55:05 STEP 1373 H= 343:15 +CPU= 23.797
  01:55:29 STEP 1374 H= 343:30 +CPU= 23.837
  01:55:53 STEP 1375 H= 343:45 +CPU= 23.726
  01:56:17 STEP 1376 H= 344:00 +CPU= 24.012
  01:56:41 STEP 1377 H= 344:15 +CPU= 23.991
  01:57:05 STEP 1378 H= 344:30 +CPU= 23.584
  01:57:29 STEP 1379 H= 344:45 +CPU= 23.667
  01:57:58 STEP 1380 H= 345:00 +CPU= 29.001
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001380
  01:58:22 STEP 1381 H= 345:15 +CPU= 23.879
  01:58:45 STEP 1382 H= 345:30 +CPU= 23.764
  01:59:10 STEP 1383 H= 345:45 +CPU= 23.969
  01:59:34 STEP 1384 H= 346:00 +CPU= 23.986
  01:59:57 STEP 1385 H= 346:15 +CPU= 23.645
  02:00:21 STEP 1386 H= 346:30 +CPU= 23.661
  02:00:45 STEP 1387 H= 346:45 +CPU= 23.750
  02:01:09 STEP 1388 H= 347:00 +CPU= 24.017
  02:01:33 STEP 1389 H= 347:15 +CPU= 23.576
  02:01:56 STEP 1390 H= 347:30 +CPU= 23.628
  02:02:20 STEP 1391 H= 347:45 +CPU= 23.703
  02:02:54 STEP 1392 H= 348:00 +CPU= 33.284
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001392
  02:03:17 STEP 1393 H= 348:15 +CPU= 23.734
  02:03:41 STEP 1394 H= 348:30 +CPU= 23.781
  02:04:05 STEP 1395 H= 348:45 +CPU= 23.711
  02:04:29 STEP 1396 H= 349:00 +CPU= 24.130
  02:04:53 STEP 1397 H= 349:15 +CPU= 23.710
  02:05:17 STEP 1398 H= 349:30 +CPU= 23.728
  02:05:41 STEP 1399 H= 349:45 +CPU= 23.777
  02:06:05 STEP 1400 H= 350:00 +CPU= 23.983
  02:06:29 STEP 1401 H= 350:15 +CPU= 23.705
  02:06:52 STEP 1402 H= 350:30 +CPU= 23.795
  02:07:16 STEP 1403 H= 350:45 +CPU= 23.672
  02:07:45 STEP 1404 H= 351:00 +CPU= 28.947
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001404
  02:08:09 STEP 1405 H= 351:15 +CPU= 23.521
  02:08:33 STEP 1406 H= 351:30 +CPU= 23.657
  02:08:56 STEP 1407 H= 351:45 +CPU= 23.413
  02:09:20 STEP 1408 H= 352:00 +CPU= 23.972
  02:09:44 STEP 1409 H= 352:15 +CPU= 23.644
  02:10:08 STEP 1410 H= 352:30 +CPU= 23.569
  02:10:31 STEP 1411 H= 352:45 +CPU= 23.419
  02:10:55 STEP 1412 H= 353:00 +CPU= 24.169
  02:11:19 STEP 1413 H= 353:15 +CPU= 23.900
  02:11:43 STEP 1414 H= 353:30 +CPU= 23.853
  02:12:07 STEP 1415 H= 353:45 +CPU= 23.672
  02:12:36 STEP 1416 H= 354:00 +CPU= 28.757
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001416
  02:12:59 STEP 1417 H= 354:15 +CPU= 23.174
  02:13:22 STEP 1418 H= 354:30 +CPU= 23.258
  02:13:46 STEP 1419 H= 354:45 +CPU= 23.146
  02:14:09 STEP 1420 H= 355:00 +CPU= 23.419
  02:14:32 STEP 1421 H= 355:15 +CPU= 22.809
  02:14:55 STEP 1422 H= 355:30 +CPU= 22.908
  02:15:18 STEP 1423 H= 355:45 +CPU= 23.069
  02:15:42 STEP 1424 H= 356:00 +CPU= 23.261
  02:16:05 STEP 1425 H= 356:15 +CPU= 23.147
  02:16:28 STEP 1426 H= 356:30 +CPU= 23.280
  02:16:52 STEP 1427 H= 356:45 +CPU= 23.438
  02:17:20 STEP 1428 H= 357:00 +CPU= 28.729
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001428
  02:17:44 STEP 1429 H= 357:15 +CPU= 23.644
  02:18:08 STEP 1430 H= 357:30 +CPU= 23.614
  02:18:32 STEP 1431 H= 357:45 +CPU= 23.646
  02:18:55 STEP 1432 H= 358:00 +CPU= 23.773
  02:19:19 STEP 1433 H= 358:15 +CPU= 23.677
  02:19:43 STEP 1434 H= 358:30 +CPU= 23.824
  02:20:07 STEP 1435 H= 358:45 +CPU= 23.771
  02:20:31 STEP 1436 H= 359:00 +CPU= 24.064
  02:20:55 STEP 1437 H= 359:15 +CPU= 23.814
  02:21:19 STEP 1438 H= 359:30 +CPU= 23.609
  02:21:43 STEP 1439 H= 359:45 +CPU= 23.826
  02:22:13 STEP 1440 H= 360:00 +CPU= 30.304
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.8521119261E-22      I       0.1312496904E-05      I
ICloud fractionI      0.0000000000E+00      I       0.3482821126E-01      I
I  Relat. Hum. I      0.5792709349E+00      I       0.5901941545E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.4407844510E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    308104148 BYTES IN      7 RECORDS TRANSFERRED IN    0.0002 SECONDS******** Mbytes/s, TOTAL TIME=    0.0089( 2.2%)
 02:22:13 STEP 1440 H= 360:00 +CPU= 30.304
 END CNT3
 NSTEP =  1440 CNT0   000000000  21.462  21.462  21.549   0.996               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ            0/           0 WRITTEN        43246/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    758    0        0            0    43246 ************    89.8     0.0    89.8     0.0   160.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                 1562   13913.9   13913.9     40.36      0.00
   9 SPCM     - SPECTRAL COMP.                    1440    1548.4    1548.4      4.14      0.00
  10 SCAN2M - PHYSICS                             1441   11822.1   11822.1     31.63      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                121    1008.9    1008.9      0.23      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 63      66.9      66.9      0.01      0.00
  14 SUINIF                                          1    7464.3    7464.3      0.01      0.00
  17 GRIDFPOS IN CNT4                              121      26.2      26.2      0.01      0.00
  18 SUSPECG                                         1    3623.8    3623.8      0.01      0.00
  19 SUSPEC                                          1    3635.9    3635.9      0.01      0.00
  24 SUGRIDU                                         1    3222.0    3222.0      0.01      0.00
  25 SPECRT                                          1     417.4     417.4      0.00      0.00
  26 SUGRIDF                                         1     189.0     189.0      0.00      0.00
  27 RESTART FILES - WRITING                        30    4069.2    4069.2      0.23      0.00
  28 RESTART FILES - READING                         1       0.0       0.0      0.00      0.00
  29 SU4FPOS IN CNT4                               121       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                               121    5327.1    5327.1      1.20      0.00
  31 POSDDH IN STEPO                                 7       2.6       2.6      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                   1441    5831.8    5831.8     15.60      0.00
  39 SU0YOMB                                         1     322.6     322.6      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                   1441      20.5      20.5      0.05      0.00
  54 SPCM     - M TO S/S TO M TRANSP.             1440     318.3     318.3      0.85      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.             1440      51.0      51.0      0.14      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 63       0.3       0.3      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     3125     348.9     348.9      2.02      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      3006     191.7     191.7      1.07      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       3006     100.8     100.8      0.56      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      3125     142.6     142.6      0.83      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      54.8      54.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           3125      43.0      43.0      0.25      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           3006      26.5      26.5      0.15      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           3125      87.4      87.4      0.51      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           3006      46.8      46.8      0.26      0.00
 400 GSTATS                                     167734       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                156066       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    53854.6 CPU TIME   38501.6 VECTOR TIME    38501.6


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       24.1
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/9/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/9/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12287004/ICMSHh7zg+001428
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0_r1930448109_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
02:25:41 (367753): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0_r1930448109_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0_r1930448109_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0_r1930448109_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0_r1930448109_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0_r1930448109_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
08 Jun 2024 09:38:49 1539347 22438632 oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0 1,295,100 38,501 0.0297
08 Jun 2024 06:53:11 1539347 22438632 oifs_43r3_bl_a3zt_2016092300_20_1017_12287004_0 864,000 26,914 0.0312


©2024 climateprediction.net