climateprediction.net home page
Task 22435482

Task 22435482

Name oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0
Workunit 12283903
Created 7 Jun 2024, 13:51:03 UTC
Sent 8 Jun 2024, 6:49:09 UTC
Report deadline 7 Aug 2024, 6:49:09 UTC
Received 12 Jun 2024, 9:11:24 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1488917
Run time 3 days 23 hours 34 min 32 sec
CPU time 16 hours 30 min 24 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 1.00 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,014.60 MB
Peak swap size 5,980.85 MB
Peak disk usage 2,222.70 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
s_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.079] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.079] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.079] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.079] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.079] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.079] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:61bc11710756:1:1:98:98] [20240610:161813:1718036293:0.080] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+000864
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0_r1918213124_8.zip
Uploading the intermediate file: upload_file_8.zip
  16:24:19 STEP  864 H= 216:00 +CPU= 59.240
  16:29:37 STEP  865 H= 216:15 +CPU= 55.229
  16:34:43 STEP  866 H= 216:30 +CPU= 57.316
  16:40:22 STEP  867 H= 216:45 +CPU= 62.025
  16:45:34 STEP  868 H= 217:00 +CPU= 57.167
  16:50:34 STEP  869 H= 217:15 +CPU= 55.515
  16:55:56 STEP  870 H= 217:30 +CPU= 58.944
  17:01:22 STEP  871 H= 217:45 +CPU= 58.688
  17:06:18 STEP  872 H= 218:00 +CPU= 52.861
  17:11:38 STEP  873 H= 218:15 +CPU= 57.552
  17:17:05 STEP  874 H= 218:30 +CPU= 58.761
  17:21:46 STEP  875 H= 218:45 +CPU= 50.857
  17:27:58 STEP  876 H= 219:00 +CPU= 65.588
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+000876
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+000876
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+000876
  17:32:59 STEP  877 H= 219:15 +CPU= 52.414
  17:37:42 STEP  878 H= 219:30 +CPU= 49.807
  17:41:49 STEP  879 H= 219:45 +CPU= 43.946
  17:45:49 STEP  880 H= 220:00 +CPU= 43.317
  17:50:16 STEP  881 H= 220:15 +CPU= 47.447
  17:56:02 STEP  882 H= 220:30 +CPU= 60.473
  18:02:01 STEP  883 H= 220:45 +CPU= 63.606
  18:08:11 STEP  884 H= 221:00 +CPU= 64.466
  18:14:08 STEP  885 H= 221:15 +CPU= 62.225
  18:19:59 STEP  886 H= 221:30 +CPU= 62.264
  18:25:56 STEP  887 H= 221:45 +CPU= 62.761
  18:32:18 STEP  888 H= 222:00 +CPU= 66.940
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+000888
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+000888
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+000888
  18:37:21 STEP  889 H= 222:15 +CPU= 54.022
  18:42:31 STEP  890 H= 222:30 +CPU= 55.216
  18:47:14 STEP  891 H= 222:45 +CPU= 50.251
  18:51:26 STEP  892 H= 223:00 +CPU= 44.873
  18:55:54 STEP  893 H= 223:15 +CPU= 47.670
  19:00:06 STEP  894 H= 223:30 +CPU= 45.353
  19:04:38 STEP  895 H= 223:45 +CPU= 47.583
  19:08:51 STEP  896 H= 224:00 +CPU= 44.511
  19:12:23 STEP  897 H= 224:15 +CPU= 37.309
  19:15:54 STEP  898 H= 224:30 +CPU= 37.240
  19:19:21 STEP  899 H= 224:45 +CPU= 36.178
  19:23:42 STEP  900 H= 225:00 +CPU= 45.337
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+000900
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+000900
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+000900
  19:27:15 STEP  901 H= 225:15 +CPU= 36.889
  19:30:42 STEP  902 H= 225:30 +CPU= 36.375
  19:34:13 STEP  903 H= 225:45 +CPU= 36.606
  19:37:46 STEP  904 H= 226:00 +CPU= 37.157
  19:41:13 STEP  905 H= 226:15 +CPU= 36.457
  19:44:45 STEP  906 H= 226:30 +CPU= 37.117
  19:48:17 STEP  907 H= 226:45 +CPU= 37.417
  19:51:55 STEP  908 H= 227:00 +CPU= 38.003
  19:55:31 STEP  909 H= 227:15 +CPU= 38.312
  19:59:05 STEP  910 H= 227:30 +CPU= 37.454
  20:02:39 STEP  911 H= 227:45 +CPU= 37.154
  20:07:20 STEP  912 H= 228:00 +CPU= 49.485
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+000912
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+000912
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+000912
  20:10:52 STEP  913 H= 228:15 +CPU= 37.065
  20:14:17 STEP  914 H= 228:30 +CPU= 36.128
  20:17:43 STEP  915 H= 228:45 +CPU= 36.376
  20:21:13 STEP  916 H= 229:00 +CPU= 36.884
  20:24:40 STEP  917 H= 229:15 +CPU= 36.491
  20:28:07 STEP  918 H= 229:30 +CPU= 36.526
  20:31:31 STEP  919 H= 229:45 +CPU= 36.088
  20:34:59 STEP  920 H= 230:00 +CPU= 36.659
  20:38:23 STEP  921 H= 230:15 +CPU= 35.982
  20:41:49 STEP  922 H= 230:30 +CPU= 36.367
  20:45:17 STEP  923 H= 230:45 +CPU= 36.809
  20:49:36 STEP  924 H= 231:00 +CPU= 45.646
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+000924
  20:53:06 STEP  925 H= 231:15 +CPU= 37.004
  20:56:41 STEP  926 H= 231:30 +CPU= 37.724
  21:00:14 STEP  927 H= 231:45 +CPU= 37.419
  21:03:51 STEP  928 H= 232:00 +CPU= 38.437
  21:07:24 STEP  929 H= 232:15 +CPU= 37.269
  21:10:47 STEP  930 H= 232:30 +CPU= 36.094
  21:14:16 STEP  931 H= 232:45 +CPU= 36.789
  21:17:48 STEP  932 H= 233:00 +CPU= 37.428
  21:21:17 STEP  933 H= 233:15 +CPU= 37.097
  21:24:46 STEP  934 H= 233:30 +CPU= 36.758
  21:28:12 STEP  935 H= 233:45 +CPU= 36.586
  21:32:29 STEP  936 H= 234:00 +CPU= 45.640
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+000936
  21:35:56 STEP  937 H= 234:15 +CPU= 36.503
  21:39:23 STEP  938 H= 234:30 +CPU= 36.423
  21:42:49 STEP  939 H= 234:45 +CPU= 36.467
  21:46:22 STEP  940 H= 235:00 +CPU= 37.810
  21:49:54 STEP  941 H= 235:15 +CPU= 37.656
  21:53:29 STEP  942 H= 235:30 +CPU= 37.842
  21:56:57 STEP  943 H= 235:45 +CPU= 37.353
  22:00:31 STEP  944 H= 236:00 +CPU= 37.987
  22:03:59 STEP  945 H= 236:15 +CPU= 37.191
  22:07:30 STEP  946 H= 236:30 +CPU= 37.167
  22:10:55 STEP  947 H= 236:45 +CPU= 36.778
  22:15:15 STEP  948 H= 237:00 +CPU= 45.893
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+000948
  22:18:47 STEP  949 H= 237:15 +CPU= 37.198
  22:22:13 STEP  950 H= 237:30 +CPU= 36.571
  22:25:40 STEP  951 H= 237:45 +CPU= 36.718
  22:29:10 STEP  952 H= 238:00 +CPU= 37.194
  22:32:39 STEP  953 H= 238:15 +CPU= 36.833
  22:36:05 STEP  954 H= 238:30 +CPU= 36.512
  22:39:36 STEP  955 H= 238:45 +CPU= 37.139
  22:43:11 STEP  956 H= 239:00 +CPU= 38.221
  22:46:36 STEP  957 H= 239:15 +CPU= 36.804
  22:50:05 STEP  958 H= 239:30 +CPU= 37.208
  22:53:31 STEP  959 H= 239:45 +CPU= 36.660
  22:58:09 STEP  960 H= 240:00 +CPU= 49.291
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+000960
  23:01:35 STEP  961 H= 240:15 +CPU= 36.720
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+000948
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+000960
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0_r1918213124_9.zip
Uploading the intermediate file: upload_file_9.zip
  23:05:12 STEP  962 H= 240:30 +CPU= 38.015
  23:08:40 STEP  963 H= 240:45 +CPU= 37.169
  23:12:16 STEP  964 H= 241:00 +CPU= 37.976
  23:15:42 STEP  965 H= 241:15 +CPU= 36.667
  23:19:12 STEP  966 H= 241:30 +CPU= 37.370
  23:22:41 STEP  967 H= 241:45 +CPU= 36.915
  23:26:07 STEP  968 H= 242:00 +CPU= 37.183
  23:29:38 STEP  969 H= 242:15 +CPU= 37.471
  23:33:06 STEP  970 H= 242:30 +CPU= 37.023
  23:36:44 STEP  971 H= 242:45 +CPU= 38.015
  23:41:07 STEP  972 H= 243:00 +CPU= 46.582
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+000972
  23:44:37 STEP  973 H= 243:15 +CPU= 37.310
  23:48:19 STEP  974 H= 243:30 +CPU= 38.837
  23:52:06 STEP  975 H= 243:45 +CPU= 39.910
  23:56:04 STEP  976 H= 244:00 +CPU= 42.377
  00:00:12 STEP  977 H= 244:15 +CPU= 43.367
  00:05:05 STEP  978 H= 244:30 +CPU= 51.264
  00:10:00 STEP  979 H= 244:45 +CPU= 51.617
  00:15:09 STEP  980 H= 245:00 +CPU= 53.920
  00:20:05 STEP  981 H= 245:15 +CPU= 52.020
  00:24:52 STEP  982 H= 245:30 +CPU= 50.378
  00:29:26 STEP  983 H= 245:45 +CPU= 47.560
  00:35:02 STEP  984 H= 246:00 +CPU= 59.016
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+000984
  00:39:35 STEP  985 H= 246:15 +CPU= 48.752
  00:43:50 STEP  986 H= 246:30 +CPU= 45.210
  00:47:54 STEP  987 H= 246:45 +CPU= 43.112
  00:52:03 STEP  988 H= 247:00 +CPU= 45.038
  00:56:16 STEP  989 H= 247:15 +CPU= 44.817
  01:00:31 STEP  990 H= 247:30 +CPU= 45.652
  01:04:59 STEP  991 H= 247:45 +CPU= 47.511
  01:09:48 STEP  992 H= 248:00 +CPU= 51.237
  01:14:37 STEP  993 H= 248:15 +CPU= 50.910
  01:19:16 STEP  994 H= 248:30 +CPU= 49.496
  01:23:58 STEP  995 H= 248:45 +CPU= 49.433
  01:30:28 STEP  996 H= 249:00 +CPU= 67.435
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+000996
  01:35:13 STEP  997 H= 249:15 +CPU= 48.804
  01:39:58 STEP  998 H= 249:30 +CPU= 49.691
  01:44:21 STEP  999 H= 249:45 +CPU= 46.219
  01:48:42 STEP 1000 H= 250:00 +CPU= 45.552
  01:52:59 STEP 1001 H= 250:15 +CPU= 44.682
  01:57:13 STEP 1002 H= 250:30 +CPU= 44.080
  02:01:38 STEP 1003 H= 250:45 +CPU= 44.880
  02:06:02 STEP 1004 H= 251:00 +CPU= 44.850
  02:09:58 STEP 1005 H= 251:15 +CPU= 41.245
  02:14:01 STEP 1006 H= 251:30 +CPU= 42.021
  02:17:58 STEP 1007 H= 251:45 +CPU= 40.713
  02:23:13 STEP 1008 H= 252:00 +CPU= 53.863
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001008
  02:27:15 STEP 1009 H= 252:15 +CPU= 41.373
  02:31:11 STEP 1010 H= 252:30 +CPU= 40.001
  02:35:07 STEP 1011 H= 252:45 +CPU= 39.787
  02:39:05 STEP 1012 H= 253:00 +CPU= 40.210
  02:43:04 STEP 1013 H= 253:15 +CPU= 39.970
  02:46:53 STEP 1014 H= 253:30 +CPU= 38.751
  02:50:42 STEP 1015 H= 253:45 +CPU= 38.996
  02:54:46 STEP 1016 H= 254:00 +CPU= 41.317
  02:58:46 STEP 1017 H= 254:15 +CPU= 40.293
  03:02:40 STEP 1018 H= 254:30 +CPU= 40.004
  03:06:42 STEP 1019 H= 254:45 +CPU= 40.364
  03:11:39 STEP 1020 H= 255:00 +CPU= 49.850
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001020
  03:15:40 STEP 1021 H= 255:15 +CPU= 39.887
  03:19:37 STEP 1022 H= 255:30 +CPU= 39.585
  03:23:32 STEP 1023 H= 255:45 +CPU= 39.191
  03:27:29 STEP 1024 H= 256:00 +CPU= 39.999
  03:31:24 STEP 1025 H= 256:15 +CPU= 39.455
  03:35:16 STEP 1026 H= 256:30 +CPU= 38.938
  03:39:09 STEP 1027 H= 256:45 +CPU= 39.522
  03:43:01 STEP 1028 H= 257:00 +CPU= 39.524
  03:46:44 STEP 1029 H= 257:15 +CPU= 37.610
  03:50:26 STEP 1030 H= 257:30 +CPU= 38.085
  03:54:23 STEP 1031 H= 257:45 +CPU= 39.470
  03:59:06 STEP 1032 H= 258:00 +CPU= 48.293
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001032
  04:02:59 STEP 1033 H= 258:15 +CPU= 39.271
  04:06:49 STEP 1034 H= 258:30 +CPU= 38.832
  04:10:37 STEP 1035 H= 258:45 +CPU= 38.647
  04:14:35 STEP 1036 H= 259:00 +CPU= 39.818
  04:18:28 STEP 1037 H= 259:15 +CPU= 39.105
  04:22:19 STEP 1038 H= 259:30 +CPU= 38.527
  04:26:13 STEP 1039 H= 259:45 +CPU= 38.964
  04:30:07 STEP 1040 H= 260:00 +CPU= 38.710
  04:34:06 STEP 1041 H= 260:15 +CPU= 38.670
  04:38:04 STEP 1042 H= 260:30 +CPU= 38.428
  04:42:03 STEP 1043 H= 260:45 +CPU= 38.879
  04:46:55 STEP 1044 H= 261:00 +CPU= 47.416
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001044
  04:50:55 STEP 1045 H= 261:15 +CPU= 38.548
  04:54:58 STEP 1046 H= 261:30 +CPU= 39.116
  04:59:05 STEP 1047 H= 261:45 +CPU= 39.497
  05:03:15 STEP 1048 H= 262:00 +CPU= 40.946
  05:07:23 STEP 1049 H= 262:15 +CPU= 40.131
  05:11:36 STEP 1050 H= 262:30 +CPU= 40.600
  05:16:01 STEP 1051 H= 262:45 +CPU= 41.384
  05:20:16 STEP 1052 H= 263:00 +CPU= 41.280
  05:24:35 STEP 1053 H= 263:15 +CPU= 41.313
  05:28:57 STEP 1054 H= 263:30 +CPU= 41.494
  05:33:10 STEP 1055 H= 263:45 +CPU= 40.383
  05:38:59 STEP 1056 H= 264:00 +CPU= 54.127
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001056
  05:43:32 STEP 1057 H= 264:15 +CPU= 41.406
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001044
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001056
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0_r1918213124_10.zip
Uploading the intermediate file: upload_file_10.zip
  05:47:53 STEP 1058 H= 264:30 +CPU= 39.906
  05:52:12 STEP 1059 H= 264:45 +CPU= 39.142
  05:56:41 STEP 1060 H= 265:00 +CPU= 41.361
  06:00:51 STEP 1061 H= 265:15 +CPU= 39.952
  06:04:59 STEP 1062 H= 265:30 +CPU= 39.482
  06:09:09 STEP 1063 H= 265:45 +CPU= 39.674
  06:13:30 STEP 1064 H= 266:00 +CPU= 40.756
  06:17:44 STEP 1065 H= 266:15 +CPU= 39.884
  06:22:09 STEP 1066 H= 266:30 +CPU= 41.496
  06:26:28 STEP 1067 H= 266:45 +CPU= 40.144
  06:31:31 STEP 1068 H= 267:00 +CPU= 48.422
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001068
  06:35:44 STEP 1069 H= 267:15 +CPU= 39.164
  06:39:56 STEP 1070 H= 267:30 +CPU= 39.296
  06:44:15 STEP 1071 H= 267:45 +CPU= 40.861
  06:48:37 STEP 1072 H= 268:00 +CPU= 41.930
  06:53:03 STEP 1073 H= 268:15 +CPU= 41.163
  06:57:15 STEP 1074 H= 268:30 +CPU= 39.655
  07:01:32 STEP 1075 H= 268:45 +CPU= 40.458
  07:06:01 STEP 1076 H= 269:00 +CPU= 41.425
  07:10:28 STEP 1077 H= 269:15 +CPU= 41.833
  07:14:51 STEP 1078 H= 269:30 +CPU= 40.696
  07:19:00 STEP 1079 H= 269:45 +CPU= 38.900
  07:24:16 STEP 1080 H= 270:00 +CPU= 49.190
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001080
  07:28:32 STEP 1081 H= 270:15 +CPU= 40.445
  07:32:50 STEP 1082 H= 270:30 +CPU= 40.156
  07:37:01 STEP 1083 H= 270:45 +CPU= 39.333
  07:40:57 STEP 1084 H= 271:00 +CPU= 39.177
  07:45:17 STEP 1085 H= 271:15 +CPU= 39.566
  07:49:46 STEP 1086 H= 271:30 +CPU= 41.019
  07:54:17 STEP 1087 H= 271:45 +CPU= 41.124
  07:58:46 STEP 1088 H= 272:00 +CPU= 41.345
  08:03:06 STEP 1089 H= 272:15 +CPU= 39.906
  08:07:29 STEP 1090 H= 272:30 +CPU= 41.834
  08:11:06 STEP 1091 H= 272:45 +CPU= 38.575
  08:15:35 STEP 1092 H= 273:00 +CPU= 46.875
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001092
  08:19:12 STEP 1093 H= 273:15 +CPU= 37.502
  08:22:54 STEP 1094 H= 273:30 +CPU= 38.049
  08:26:42 STEP 1095 H= 273:45 +CPU= 37.529
  08:30:26 STEP 1096 H= 274:00 +CPU= 38.010
  08:34:20 STEP 1097 H= 274:15 +CPU= 39.066
  08:38:04 STEP 1098 H= 274:30 +CPU= 37.669
  08:41:45 STEP 1099 H= 274:45 +CPU= 37.308
  08:45:43 STEP 1100 H= 275:00 +CPU= 38.987
  08:49:22 STEP 1101 H= 275:15 +CPU= 37.149
  08:53:10 STEP 1102 H= 275:30 +CPU= 37.662
  08:57:04 STEP 1103 H= 275:45 +CPU= 38.269
  09:02:17 STEP 1104 H= 276:00 +CPU= 51.001
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001104
  09:06:11 STEP 1105 H= 276:15 +CPU= 38.248
  09:09:59 STEP 1106 H= 276:30 +CPU= 37.839
  09:13:42 STEP 1107 H= 276:45 +CPU= 37.646
  09:17:36 STEP 1108 H= 277:00 +CPU= 38.618
  09:21:28 STEP 1109 H= 277:15 +CPU= 38.471
  09:25:18 STEP 1110 H= 277:30 +CPU= 38.025
  09:29:02 STEP 1111 H= 277:45 +CPU= 37.646
  09:32:54 STEP 1112 H= 278:00 +CPU= 38.724
  09:36:42 STEP 1113 H= 278:15 +CPU= 38.196
  09:40:42 STEP 1114 H= 278:30 +CPU= 39.030
  09:44:31 STEP 1115 H= 278:45 +CPU= 38.428
  09:49:21 STEP 1116 H= 279:00 +CPU= 47.643
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001116
  09:53:21 STEP 1117 H= 279:15 +CPU= 39.436
  09:57:08 STEP 1118 H= 279:30 +CPU= 37.527
  10:00:51 STEP 1119 H= 279:45 +CPU= 37.295
  10:04:58 STEP 1120 H= 280:00 +CPU= 39.706
  10:08:55 STEP 1121 H= 280:15 +CPU= 38.688
  10:12:46 STEP 1122 H= 280:30 +CPU= 37.448
  10:16:37 STEP 1123 H= 280:45 +CPU= 37.556
  10:20:27 STEP 1124 H= 281:00 +CPU= 37.758
  10:24:17 STEP 1125 H= 281:15 +CPU= 37.326
  10:28:18 STEP 1126 H= 281:30 +CPU= 39.193
  10:32:28 STEP 1127 H= 281:45 +CPU= 39.788
  10:37:29 STEP 1128 H= 282:00 +CPU= 48.461
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001128
  10:41:25 STEP 1129 H= 282:15 +CPU= 38.275
  10:45:31 STEP 1130 H= 282:30 +CPU= 39.602
  10:49:30 STEP 1131 H= 282:45 +CPU= 38.796
  10:53:38 STEP 1132 H= 283:00 +CPU= 40.110
  10:57:36 STEP 1133 H= 283:15 +CPU= 38.669
  11:01:37 STEP 1134 H= 283:30 +CPU= 38.460
  11:05:27 STEP 1135 H= 283:45 +CPU= 37.810
  11:09:34 STEP 1136 H= 284:00 +CPU= 39.562
  11:13:28 STEP 1137 H= 284:15 +CPU= 38.659
  11:17:30 STEP 1138 H= 284:30 +CPU= 39.214
  11:21:25 STEP 1139 H= 284:45 +CPU= 38.663
  11:26:20 STEP 1140 H= 285:00 +CPU= 47.374
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001140
  11:30:30 STEP 1141 H= 285:15 +CPU= 39.107
  11:34:33 STEP 1142 H= 285:30 +CPU= 38.626
  11:38:41 STEP 1143 H= 285:45 +CPU= 39.526
  11:42:43 STEP 1144 H= 286:00 +CPU= 39.173
  11:46:56 STEP 1145 H= 286:15 +CPU= 39.433
  11:50:55 STEP 1146 H= 286:30 +CPU= 38.212
  11:54:51 STEP 1147 H= 286:45 +CPU= 38.070
  11:58:57 STEP 1148 H= 287:00 +CPU= 39.571
  12:03:02 STEP 1149 H= 287:15 +CPU= 38.997
  12:07:07 STEP 1150 H= 287:30 +CPU= 38.556
  12:11:11 STEP 1151 H= 287:45 +CPU= 38.740
  12:16:20 STEP 1152 H= 288:00 +CPU= 51.603
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001152
  12:20:20 STEP 1153 H= 288:15 +CPU= 41.859
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001140
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001152
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0_r1918213124_11.zip
Uploading the intermediate file: upload_file_11.zip
  12:24:53 STEP 1154 H= 288:30 +CPU= 47.214
  12:29:46 STEP 1155 H= 288:45 +CPU= 50.685
  12:34:54 STEP 1156 H= 289:00 +CPU= 52.600
  12:39:58 STEP 1157 H= 289:15 +CPU= 52.381
  12:44:48 STEP 1158 H= 289:30 +CPU= 50.232
  12:49:59 STEP 1159 H= 289:45 +CPU= 51.928
  12:55:01 STEP 1160 H= 290:00 +CPU= 51.206
  12:59:43 STEP 1161 H= 290:15 +CPU= 48.372
  13:04:46 STEP 1162 H= 290:30 +CPU= 51.103
  13:09:09 STEP 1163 H= 290:45 +CPU= 46.054
  13:14:40 STEP 1164 H= 291:00 +CPU= 57.214
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001164
  13:18:46 STEP 1165 H= 291:15 +CPU= 42.638
  13:22:54 STEP 1166 H= 291:30 +CPU= 42.826
  13:27:00 STEP 1167 H= 291:45 +CPU= 43.271
  13:31:25 STEP 1168 H= 292:00 +CPU= 46.489
  13:36:07 STEP 1169 H= 292:15 +CPU= 49.674
  13:40:31 STEP 1170 H= 292:30 +CPU= 46.069
  13:45:01 STEP 1171 H= 292:45 +CPU= 46.883
  13:49:28 STEP 1172 H= 293:00 +CPU= 46.433
  13:53:47 STEP 1173 H= 293:15 +CPU= 45.492
  13:57:59 STEP 1174 H= 293:30 +CPU= 43.867
  14:02:12 STEP 1175 H= 293:45 +CPU= 43.673
  14:07:00 STEP 1176 H= 294:00 +CPU= 51.098
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001176
  14:10:48 STEP 1177 H= 294:15 +CPU= 40.487
  14:14:57 STEP 1178 H= 294:30 +CPU= 42.718
  14:19:08 STEP 1179 H= 294:45 +CPU= 42.280
  14:23:08 STEP 1180 H= 295:00 +CPU= 41.987
  14:27:05 STEP 1181 H= 295:15 +CPU= 40.217
  14:30:56 STEP 1182 H= 295:30 +CPU= 38.842
  14:34:43 STEP 1183 H= 295:45 +CPU= 39.068
  14:38:41 STEP 1184 H= 296:00 +CPU= 39.833
  14:42:35 STEP 1185 H= 296:15 +CPU= 39.111
  14:46:36 STEP 1186 H= 296:30 +CPU= 39.109
  14:50:33 STEP 1187 H= 296:45 +CPU= 38.788
  14:55:25 STEP 1188 H= 297:00 +CPU= 47.791
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001188
  14:59:18 STEP 1189 H= 297:15 +CPU= 38.619
  15:03:08 STEP 1190 H= 297:30 +CPU= 38.448
  15:06:53 STEP 1191 H= 297:45 +CPU= 38.997
  15:10:39 STEP 1192 H= 298:00 +CPU= 39.529
  15:14:32 STEP 1193 H= 298:15 +CPU= 39.010
  15:18:12 STEP 1194 H= 298:30 +CPU= 38.171
  15:21:47 STEP 1195 H= 298:45 +CPU= 37.549
  15:25:31 STEP 1196 H= 299:00 +CPU= 38.725
  15:29:16 STEP 1197 H= 299:15 +CPU= 39.177
  15:33:17 STEP 1198 H= 299:30 +CPU= 39.526
  15:37:02 STEP 1199 H= 299:45 +CPU= 38.592
  15:42:21 STEP 1200 H= 300:00 +CPU= 53.243
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001200
  15:46:18 STEP 1201 H= 300:15 +CPU= 39.462
  15:50:14 STEP 1202 H= 300:30 +CPU= 38.726
  15:54:01 STEP 1203 H= 300:45 +CPU= 37.958
  15:57:57 STEP 1204 H= 301:00 +CPU= 39.195
  16:01:36 STEP 1205 H= 301:15 +CPU= 37.792
  16:05:19 STEP 1206 H= 301:30 +CPU= 38.101
  16:08:53 STEP 1207 H= 301:45 +CPU= 37.758
  16:12:33 STEP 1208 H= 302:00 +CPU= 38.412
  16:16:14 STEP 1209 H= 302:15 +CPU= 38.057
  16:19:56 STEP 1210 H= 302:30 +CPU= 37.598
  16:23:47 STEP 1211 H= 302:45 +CPU= 38.413
  16:28:34 STEP 1212 H= 303:00 +CPU= 48.587
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001212
  16:32:27 STEP 1213 H= 303:15 +CPU= 38.840
  16:36:23 STEP 1214 H= 303:30 +CPU= 39.071
  16:40:08 STEP 1215 H= 303:45 +CPU= 38.985
  16:43:53 STEP 1216 H= 304:00 +CPU= 38.085
  16:47:28 STEP 1217 H= 304:15 +CPU= 37.664
  16:51:07 STEP 1218 H= 304:30 +CPU= 37.607
  16:54:58 STEP 1219 H= 304:45 +CPU= 38.797
  16:58:47 STEP 1220 H= 305:00 +CPU= 39.148
  17:02:35 STEP 1221 H= 305:15 +CPU= 38.617
  17:06:16 STEP 1222 H= 305:30 +CPU= 37.781
  17:09:59 STEP 1223 H= 305:45 +CPU= 38.369
  17:14:39 STEP 1224 H= 306:00 +CPU= 47.554
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001224
  17:18:27 STEP 1225 H= 306:15 +CPU= 38.852
  17:22:14 STEP 1226 H= 306:30 +CPU= 38.517
  17:25:52 STEP 1227 H= 306:45 +CPU= 38.081
  17:29:41 STEP 1228 H= 307:00 +CPU= 38.674
  17:33:29 STEP 1229 H= 307:15 +CPU= 37.518
  17:37:25 STEP 1230 H= 307:30 +CPU= 38.972
  17:41:02 STEP 1231 H= 307:45 +CPU= 37.599
  17:44:52 STEP 1232 H= 308:00 +CPU= 38.896
  17:48:44 STEP 1233 H= 308:15 +CPU= 38.421
  17:52:29 STEP 1234 H= 308:30 +CPU= 38.076
  17:56:06 STEP 1235 H= 308:45 +CPU= 37.269
  18:00:42 STEP 1236 H= 309:00 +CPU= 47.036
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001236
  18:04:18 STEP 1237 H= 309:15 +CPU= 37.493
  18:08:05 STEP 1238 H= 309:30 +CPU= 38.354
  18:11:48 STEP 1239 H= 309:45 +CPU= 37.911
  18:15:30 STEP 1240 H= 310:00 +CPU= 37.925
  18:19:06 STEP 1241 H= 310:15 +CPU= 37.324
  18:22:42 STEP 1242 H= 310:30 +CPU= 37.545
  18:26:23 STEP 1243 H= 310:45 +CPU= 37.863
  18:30:09 STEP 1244 H= 311:00 +CPU= 38.729
  18:33:48 STEP 1245 H= 311:15 +CPU= 37.491
  18:37:31 STEP 1246 H= 311:30 +CPU= 37.509
  18:41:15 STEP 1247 H= 311:45 +CPU= 37.811
  18:46:13 STEP 1248 H= 312:00 +CPU= 50.351
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001248
  18:50:02 STEP 1249 H= 312:15 +CPU= 38.652
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001236
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001248
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0_r1918213124_12.zip
Uploading the intermediate file: upload_file_12.zip
  18:53:45 STEP 1250 H= 312:30 +CPU= 37.734
  18:57:26 STEP 1251 H= 312:45 +CPU= 36.808
  19:01:10 STEP 1252 H= 313:00 +CPU= 37.937
  19:04:57 STEP 1253 H= 313:15 +CPU= 38.549
  19:08:46 STEP 1254 H= 313:30 +CPU= 38.699
  19:12:44 STEP 1255 H= 313:45 +CPU= 39.672
  19:16:41 STEP 1256 H= 314:00 +CPU= 39.447
  19:20:30 STEP 1257 H= 314:15 +CPU= 38.733
  19:24:18 STEP 1258 H= 314:30 +CPU= 38.246
  19:28:17 STEP 1259 H= 314:45 +CPU= 39.382
  19:33:01 STEP 1260 H= 315:00 +CPU= 48.726
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001260
  19:37:08 STEP 1261 H= 315:15 +CPU= 40.529
  19:41:02 STEP 1262 H= 315:30 +CPU= 39.844
  19:44:49 STEP 1263 H= 315:45 +CPU= 38.769
  19:48:49 STEP 1264 H= 316:00 +CPU= 39.739
  19:52:28 STEP 1265 H= 316:15 +CPU= 37.800
  19:56:08 STEP 1266 H= 316:30 +CPU= 37.746
  19:59:58 STEP 1267 H= 316:45 +CPU= 38.782
  20:03:49 STEP 1268 H= 317:00 +CPU= 39.392
  20:07:30 STEP 1269 H= 317:15 +CPU= 37.683
  20:11:08 STEP 1270 H= 317:30 +CPU= 37.582
  20:14:52 STEP 1271 H= 317:45 +CPU= 38.000
  20:19:20 STEP 1272 H= 318:00 +CPU= 45.905
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001272
  20:23:02 STEP 1273 H= 318:15 +CPU= 37.804
  20:26:40 STEP 1274 H= 318:30 +CPU= 37.372
  20:30:25 STEP 1275 H= 318:45 +CPU= 38.572
  20:34:12 STEP 1276 H= 319:00 +CPU= 38.608
  20:37:49 STEP 1277 H= 319:15 +CPU= 36.998
  20:41:39 STEP 1278 H= 319:30 +CPU= 38.738
  20:45:23 STEP 1279 H= 319:45 +CPU= 37.679
  20:49:13 STEP 1280 H= 320:00 +CPU= 39.088
  20:52:55 STEP 1281 H= 320:15 +CPU= 38.169
  20:56:47 STEP 1282 H= 320:30 +CPU= 38.278
  21:00:22 STEP 1283 H= 320:45 +CPU= 37.082
  21:05:06 STEP 1284 H= 321:00 +CPU= 47.149
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001284
  21:09:03 STEP 1285 H= 321:15 +CPU= 39.129
  21:12:40 STEP 1286 H= 321:30 +CPU= 37.896
  21:16:18 STEP 1287 H= 321:45 +CPU= 37.013
  21:20:02 STEP 1288 H= 322:00 +CPU= 38.102
  21:23:45 STEP 1289 H= 322:15 +CPU= 37.384
  21:27:34 STEP 1290 H= 322:30 +CPU= 38.129
  21:31:20 STEP 1291 H= 322:45 +CPU= 37.865
  21:35:14 STEP 1292 H= 323:00 +CPU= 38.668
  21:38:54 STEP 1293 H= 323:15 +CPU= 37.174
  21:42:47 STEP 1294 H= 323:30 +CPU= 38.070
  21:46:39 STEP 1295 H= 323:45 +CPU= 38.481
  21:51:38 STEP 1296 H= 324:00 +CPU= 50.446
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001296
  21:55:27 STEP 1297 H= 324:15 +CPU= 37.886
  21:59:07 STEP 1298 H= 324:30 +CPU= 37.478
  22:02:57 STEP 1299 H= 324:45 +CPU= 37.853
  22:06:47 STEP 1300 H= 325:00 +CPU= 38.321
  22:10:38 STEP 1301 H= 325:15 +CPU= 38.272
  22:14:26 STEP 1302 H= 325:30 +CPU= 38.388
  22:18:01 STEP 1303 H= 325:45 +CPU= 37.284
  22:21:59 STEP 1304 H= 326:00 +CPU= 39.248
  22:25:46 STEP 1305 H= 326:15 +CPU= 37.800
  22:29:30 STEP 1306 H= 326:30 +CPU= 37.310
  22:33:17 STEP 1307 H= 326:45 +CPU= 37.893
  22:38:00 STEP 1308 H= 327:00 +CPU= 46.886
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001308
  22:41:49 STEP 1309 H= 327:15 +CPU= 38.570
  22:45:34 STEP 1310 H= 327:30 +CPU= 37.918
  22:49:20 STEP 1311 H= 327:45 +CPU= 38.097
  22:53:07 STEP 1312 H= 328:00 +CPU= 38.592
  22:56:48 STEP 1313 H= 328:15 +CPU= 37.840
  23:00:37 STEP 1314 H= 328:30 +CPU= 38.386
  23:04:24 STEP 1315 H= 328:45 +CPU= 38.263
  23:08:09 STEP 1316 H= 329:00 +CPU= 38.051
  23:11:56 STEP 1317 H= 329:15 +CPU= 37.892
  23:15:48 STEP 1318 H= 329:30 +CPU= 38.289
  23:19:33 STEP 1319 H= 329:45 +CPU= 37.877
  23:24:11 STEP 1320 H= 330:00 +CPU= 47.114
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001320
  23:27:58 STEP 1321 H= 330:15 +CPU= 37.837
  23:31:43 STEP 1322 H= 330:30 +CPU= 37.910
  23:35:29 STEP 1323 H= 330:45 +CPU= 38.189
  23:39:25 STEP 1324 H= 331:00 +CPU= 39.843
  23:43:06 STEP 1325 H= 331:15 +CPU= 39.006
  23:46:55 STEP 1326 H= 331:30 +CPU= 38.582
  23:50:39 STEP 1327 H= 331:45 +CPU= 37.875
  23:54:31 STEP 1328 H= 332:00 +CPU= 38.542
  23:58:25 STEP 1329 H= 332:15 +CPU= 38.261
  00:02:09 STEP 1330 H= 332:30 +CPU= 37.836
  00:05:49 STEP 1331 H= 332:45 +CPU= 37.814
  00:10:29 STEP 1332 H= 333:00 +CPU= 47.040
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001332
  00:14:10 STEP 1333 H= 333:15 +CPU= 37.968
  00:17:58 STEP 1334 H= 333:30 +CPU= 37.824
  00:21:39 STEP 1335 H= 333:45 +CPU= 37.562
  00:25:32 STEP 1336 H= 334:00 +CPU= 38.740
  00:29:25 STEP 1337 H= 334:15 +CPU= 38.431
  00:33:20 STEP 1338 H= 334:30 +CPU= 38.928
  00:37:21 STEP 1339 H= 334:45 +CPU= 39.037
  00:41:17 STEP 1340 H= 335:00 +CPU= 39.079
  00:45:11 STEP 1341 H= 335:15 +CPU= 38.441
  00:49:08 STEP 1342 H= 335:30 +CPU= 38.696
  00:52:57 STEP 1343 H= 335:45 +CPU= 37.935
  00:58:06 STEP 1344 H= 336:00 +CPU= 50.496
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001344
  01:01:56 STEP 1345 H= 336:15 +CPU= 37.627
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001332
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001344
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0_r1918213124_13.zip
Uploading the intermediate file: upload_file_13.zip
  01:05:49 STEP 1346 H= 336:30 +CPU= 38.285
  01:09:51 STEP 1347 H= 336:45 +CPU= 39.037
  01:13:51 STEP 1348 H= 337:00 +CPU= 39.522
  01:17:45 STEP 1349 H= 337:15 +CPU= 38.691
  01:21:37 STEP 1350 H= 337:30 +CPU= 38.418
  01:25:31 STEP 1351 H= 337:45 +CPU= 38.640
  01:29:26 STEP 1352 H= 338:00 +CPU= 39.623
  01:33:05 STEP 1353 H= 338:15 +CPU= 37.100
  01:36:48 STEP 1354 H= 338:30 +CPU= 37.706
  01:40:38 STEP 1355 H= 338:45 +CPU= 38.451
  01:45:18 STEP 1356 H= 339:00 +CPU= 46.963
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001356
  01:49:18 STEP 1357 H= 339:15 +CPU= 38.957
  01:53:15 STEP 1358 H= 339:30 +CPU= 38.605
  01:57:20 STEP 1359 H= 339:45 +CPU= 40.414
  02:01:29 STEP 1360 H= 340:00 +CPU= 41.522
  02:05:31 STEP 1361 H= 340:15 +CPU= 39.684
  02:09:23 STEP 1362 H= 340:30 +CPU= 38.561
  02:13:17 STEP 1363 H= 340:45 +CPU= 38.801
  02:17:05 STEP 1364 H= 341:00 +CPU= 38.514
  02:20:55 STEP 1365 H= 341:15 +CPU= 37.837
  02:24:53 STEP 1366 H= 341:30 +CPU= 39.278
  02:28:48 STEP 1367 H= 341:45 +CPU= 38.568
  02:33:21 STEP 1368 H= 342:00 +CPU= 46.279
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001368
  02:37:13 STEP 1369 H= 342:15 +CPU= 38.080
  02:41:11 STEP 1370 H= 342:30 +CPU= 38.984
  02:45:16 STEP 1371 H= 342:45 +CPU= 40.253
  02:49:27 STEP 1372 H= 343:00 +CPU= 40.707
  02:53:24 STEP 1373 H= 343:15 +CPU= 39.357
  02:57:23 STEP 1374 H= 343:30 +CPU= 39.175
  03:01:21 STEP 1375 H= 343:45 +CPU= 40.266
  03:05:28 STEP 1376 H= 344:00 +CPU= 40.774
  03:09:27 STEP 1377 H= 344:15 +CPU= 39.983
  03:13:27 STEP 1378 H= 344:30 +CPU= 40.518
  03:17:27 STEP 1379 H= 344:45 +CPU= 39.662
  03:22:13 STEP 1380 H= 345:00 +CPU= 48.078
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001380
  03:26:07 STEP 1381 H= 345:15 +CPU= 38.828
  03:29:44 STEP 1382 H= 345:30 +CPU= 37.510
  03:33:44 STEP 1383 H= 345:45 +CPU= 39.846
  03:37:51 STEP 1384 H= 346:00 +CPU= 40.899
  03:41:53 STEP 1385 H= 346:15 +CPU= 40.387
  03:45:50 STEP 1386 H= 346:30 +CPU= 39.269
  03:49:48 STEP 1387 H= 346:45 +CPU= 39.277
  03:53:58 STEP 1388 H= 347:00 +CPU= 40.790
  03:58:09 STEP 1389 H= 347:15 +CPU= 40.832
  04:02:06 STEP 1390 H= 347:30 +CPU= 39.060
  04:06:11 STEP 1391 H= 347:45 +CPU= 39.690
  04:11:27 STEP 1392 H= 348:00 +CPU= 51.584
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001392
  04:15:05 STEP 1393 H= 348:15 +CPU= 37.682
  04:18:49 STEP 1394 H= 348:30 +CPU= 38.182
  04:22:38 STEP 1395 H= 348:45 +CPU= 38.685
  04:26:28 STEP 1396 H= 349:00 +CPU= 38.241
  04:30:17 STEP 1397 H= 349:15 +CPU= 37.766
  04:34:02 STEP 1398 H= 349:30 +CPU= 38.713
  04:37:49 STEP 1399 H= 349:45 +CPU= 39.128
  04:41:45 STEP 1400 H= 350:00 +CPU= 40.024
  04:45:50 STEP 1401 H= 350:15 +CPU= 40.443
  04:49:58 STEP 1402 H= 350:30 +CPU= 40.813
  04:53:52 STEP 1403 H= 350:45 +CPU= 38.786
  04:58:53 STEP 1404 H= 351:00 +CPU= 48.794
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001404
  05:02:54 STEP 1405 H= 351:15 +CPU= 39.757
  05:06:57 STEP 1406 H= 351:30 +CPU= 39.579
  05:10:56 STEP 1407 H= 351:45 +CPU= 39.591
  05:15:01 STEP 1408 H= 352:00 +CPU= 40.146
  05:18:52 STEP 1409 H= 352:15 +CPU= 38.417
  05:22:50 STEP 1410 H= 352:30 +CPU= 38.905
  05:26:38 STEP 1411 H= 352:45 +CPU= 37.941
  05:30:23 STEP 1412 H= 353:00 +CPU= 38.846
  05:34:21 STEP 1413 H= 353:15 +CPU= 39.192
  05:38:20 STEP 1414 H= 353:30 +CPU= 39.286
  05:42:06 STEP 1415 H= 353:45 +CPU= 38.399
  05:47:05 STEP 1416 H= 354:00 +CPU= 48.481
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001416
  05:51:41 STEP 1417 H= 354:15 +CPU= 44.779
  05:56:33 STEP 1418 H= 354:30 +CPU= 48.451
  06:02:22 STEP 1419 H= 354:45 +CPU= 58.230
  06:08:54 STEP 1420 H= 355:00 +CPU= 66.777
  06:15:00 STEP 1421 H= 355:15 +CPU= 61.873
  06:21:11 STEP 1422 H= 355:30 +CPU= 61.717
  06:27:21 STEP 1423 H= 355:45 +CPU= 62.404
  06:33:51 STEP 1424 H= 356:00 +CPU= 66.049
  06:40:11 STEP 1425 H= 356:15 +CPU= 64.193
  06:45:53 STEP 1426 H= 356:30 +CPU= 57.204
  06:51:30 STEP 1427 H= 356:45 +CPU= 57.171
  06:58:53 STEP 1428 H= 357:00 +CPU= 73.531
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001428
  07:04:04 STEP 1429 H= 357:15 +CPU= 51.783
  07:09:12 STEP 1430 H= 357:30 +CPU= 50.913
  07:14:34 STEP 1431 H= 357:45 +CPU= 53.804
  07:20:13 STEP 1432 H= 358:00 +CPU= 54.960
  07:25:23 STEP 1433 H= 358:15 +CPU= 51.437
  07:30:21 STEP 1434 H= 358:30 +CPU= 49.760
  07:36:04 STEP 1435 H= 358:45 +CPU= 56.676
  07:41:44 STEP 1436 H= 359:00 +CPU= 57.123
  07:47:15 STEP 1437 H= 359:15 +CPU= 55.668
  07:52:47 STEP 1438 H= 359:30 +CPU= 55.027
  07:58:30 STEP 1439 H= 359:45 +CPU= 58.279
  08:05:42 STEP 1440 H= 360:00 +CPU= 72.277
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1332643523E-22      I       0.1849954456E-05      I
ICloud fractionI      0.0000000000E+00      I       0.3225007362E-01      I
I  Relat. Hum. I      0.4947825946E-01      I       0.1539996211E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3305312415E+03      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    298445604 BYTES IN      7 RECORDS TRANSFERRED IN    0.0014 SECONDS213175.4 Mbytes/s, TOTAL TIME=    0.2086( 0.7%)
 08:05:42 STEP 1440 H= 360:00 +CPU= 72.277
 END CNT3
 NSTEP =  1440 CNT0   000000000  53.934  53.934 325.484   0.166               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN        17160/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    303    0       46      1044068    17160 ************   182.4    16.5   165.9    21.8   432.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.98      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  625   35520.0   35520.0     15.50      0.00
   9 SPCM     - SPECTRAL COMP.                     576    6851.3    6851.3      2.75      0.00
  10 SCAN2M - PHYSICS                              577  124690.5  124690.5     50.22      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 48    4931.6    4931.6      0.17      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 25     368.9     368.9      0.01      0.00
  17 GRIDFPOS IN CNT4                               48     220.7     220.7      0.01      0.00
  27 RESTART FILES - WRITING                        12   19726.3   19726.3      0.17      0.00
  28 RESTART FILES - READING                         1   29297.2   29297.2      0.02      0.00
  29 SU4FPOS IN CNT4                                48       1.9       1.9      0.00      0.00
  30 DYNFPOS IN CNT4                                48   50554.6   50554.6      1.69      0.00
  31 POSDDH IN STEPO                                 3       3.6       3.6      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    577   46462.6   46462.6     18.71      0.00
  39 SU0YOMB                                         1    2999.5    2999.5      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    577     289.9     289.9      0.12      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              576    3321.9    3321.9      1.34      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              576     636.7     636.7      0.26      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 25       3.7       3.7      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1252    4521.3    4521.3      3.95      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1200    2382.4    2382.4      2.00      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1200     810.3     810.3      0.68      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1252    1354.8    1354.8      1.18      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1     366.4     366.4      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1252     413.2     413.2      0.36      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1200     218.5     218.5      0.18      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1252     749.7     749.7      0.66      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1200     507.1     507.1      0.42      0.00
 400 GSTATS                                      67705       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 62941       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME   143249.7 CPU TIME   24206.1 VECTOR TIME    24206.1


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY        9.0
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc/slots/0/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/0/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc/slots/0/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/slots/0/NODE.001_01
Adding to the zip: /var/lib/boinc/slots/0/ifs.stat
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_12283903/ICMGGh7zg+001356
Zipping up the final file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0_r1918213124_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
08:10:23 (35): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0_r1918213124_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0_r1918213124_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0_r1918213124_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0_r1918213124_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0_r1918213124_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
12 Jun 2024 08:10:01 1488917 22435482 oifs_43r3_bl_a1lo_2016092300_20_1017_12283903_0 1,295,100 59,424 0.0459


©2024 cpdn.org