climateprediction.net home page
Task 22310735

Task 22310735

Name oifs_43r3_bl_a2ac_2016092300_15_991_12209751_1
Workunit 12209751
Created 13 Feb 2023, 18:52:50 UTC
Sent 14 Feb 2023, 0:17:56 UTC
Report deadline 15 Apr 2023, 0:17:56 UTC
Received 16 Feb 2023, 11:04:06 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1528653
Run time 14 hours 59 min 56 sec
CPU time 14 hours 59 min 56 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 4.77 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,064.74 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,368.35 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
 [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:epyc7v12:1:1:1192959:1192959] [20230216:060842:1676527722:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  06:09:13 STEP  912 H= 228:00 +CPU= 27.038
  06:09:39 STEP  913 H= 228:15 +CPU= 25.699
  06:10:05 STEP  914 H= 228:30 +CPU= 25.686
  06:10:30 STEP  915 H= 228:45 +CPU= 25.511
  06:10:57 STEP  916 H= 229:00 +CPU= 26.905
  06:11:22 STEP  917 H= 229:15 +CPU= 24.816
  06:11:47 STEP  918 H= 229:30 +CPU= 25.318
  06:12:12 STEP  919 H= 229:45 +CPU= 24.887
  06:12:38 STEP  920 H= 230:00 +CPU= 25.212
  06:13:01 STEP  921 H= 230:15 +CPU= 23.663
  06:13:26 STEP  922 H= 230:30 +CPU= 24.698
  06:13:52 STEP  923 H= 230:45 +CPU= 25.215
  06:14:24 STEP  924 H= 231:00 +CPU= 32.377
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000924
  06:14:48 STEP  925 H= 231:15 +CPU= 24.215
  06:15:14 STEP  926 H= 231:30 +CPU= 25.143
  06:15:38 STEP  927 H= 231:45 +CPU= 24.354
  06:16:04 STEP  928 H= 232:00 +CPU= 26.280
  06:16:30 STEP  929 H= 232:15 +CPU= 25.951
  06:16:57 STEP  930 H= 232:30 +CPU= 26.091
  06:17:23 STEP  931 H= 232:45 +CPU= 25.842
  06:17:50 STEP  932 H= 233:00 +CPU= 27.182
  06:18:17 STEP  933 H= 233:15 +CPU= 26.924
  06:18:43 STEP  934 H= 233:30 +CPU= 25.814
  06:19:09 STEP  935 H= 233:45 +CPU= 25.776
  06:19:43 STEP  936 H= 234:00 +CPU= 33.928
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000936
  06:20:08 STEP  937 H= 234:15 +CPU= 25.675
  06:20:35 STEP  938 H= 234:30 +CPU= 25.974
  06:21:01 STEP  939 H= 234:45 +CPU= 26.250
  06:21:27 STEP  940 H= 235:00 +CPU= 26.356
  06:21:54 STEP  941 H= 235:15 +CPU= 26.185
  06:22:20 STEP  942 H= 235:30 +CPU= 26.096
  06:22:44 STEP  943 H= 235:45 +CPU= 24.085
  06:23:11 STEP  944 H= 236:00 +CPU= 26.849
  06:23:37 STEP  945 H= 236:15 +CPU= 26.358
  06:24:03 STEP  946 H= 236:30 +CPU= 25.574
  06:24:28 STEP  947 H= 236:45 +CPU= 25.183
  06:25:01 STEP  948 H= 237:00 +CPU= 32.883
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000948
  06:25:28 STEP  949 H= 237:15 +CPU= 26.071
  06:25:54 STEP  950 H= 237:30 +CPU= 26.363
  06:26:21 STEP  951 H= 237:45 +CPU= 26.686
  06:26:49 STEP  952 H= 238:00 +CPU= 27.901
  06:27:16 STEP  953 H= 238:15 +CPU= 26.672
  06:27:43 STEP  954 H= 238:30 +CPU= 26.860
  06:28:09 STEP  955 H= 238:45 +CPU= 26.566
  06:28:36 STEP  956 H= 239:00 +CPU= 26.999
  06:29:03 STEP  957 H= 239:15 +CPU= 26.381
  06:29:29 STEP  958 H= 239:30 +CPU= 26.097
  06:29:56 STEP  959 H= 239:45 +CPU= 26.644
  06:30:34 STEP  960 H= 240:00 +CPU= 38.156
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2ac_2016092300_15_991_12209751_1_r1073680400_9.zip
Uploading the intermediate file: upload_file_9.zip
  06:31:01 STEP  961 H= 240:15 +CPU= 26.472
  06:31:28 STEP  962 H= 240:30 +CPU= 27.266
  06:31:54 STEP  963 H= 240:45 +CPU= 25.576
  06:32:22 STEP  964 H= 241:00 +CPU= 27.807
  06:32:48 STEP  965 H= 241:15 +CPU= 25.795
  06:33:14 STEP  966 H= 241:30 +CPU= 26.433
  06:33:41 STEP  967 H= 241:45 +CPU= 26.846
  06:34:08 STEP  968 H= 242:00 +CPU= 26.480
  06:34:33 STEP  969 H= 242:15 +CPU= 25.523
  06:34:58 STEP  970 H= 242:30 +CPU= 24.976
  06:35:23 STEP  971 H= 242:45 +CPU= 25.060
  06:35:57 STEP  972 H= 243:00 +CPU= 33.543
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000972
  06:36:24 STEP  973 H= 243:15 +CPU= 26.467
  06:36:49 STEP  974 H= 243:30 +CPU= 25.505
  06:37:15 STEP  975 H= 243:45 +CPU= 25.812
  06:37:42 STEP  976 H= 244:00 +CPU= 26.992
  06:38:08 STEP  977 H= 244:15 +CPU= 25.510
  06:38:35 STEP  978 H= 244:30 +CPU= 26.759
  06:39:01 STEP  979 H= 244:45 +CPU= 26.704
  06:39:29 STEP  980 H= 245:00 +CPU= 27.458
  06:39:55 STEP  981 H= 245:15 +CPU= 25.984
  06:40:21 STEP  982 H= 245:30 +CPU= 26.121
  06:40:47 STEP  983 H= 245:45 +CPU= 25.714
  06:41:21 STEP  984 H= 246:00 +CPU= 33.298
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000984
  06:41:47 STEP  985 H= 246:15 +CPU= 25.884
  06:42:13 STEP  986 H= 246:30 +CPU= 26.657
  06:42:39 STEP  987 H= 246:45 +CPU= 25.072
  06:43:06 STEP  988 H= 247:00 +CPU= 27.060
  06:43:32 STEP  989 H= 247:15 +CPU= 26.621
  06:43:58 STEP  990 H= 247:30 +CPU= 25.533
  06:44:24 STEP  991 H= 247:45 +CPU= 25.539
  06:44:51 STEP  992 H= 248:00 +CPU= 27.250
  06:45:18 STEP  993 H= 248:15 +CPU= 26.921
  06:45:45 STEP  994 H= 248:30 +CPU= 26.993
  06:46:11 STEP  995 H= 248:45 +CPU= 26.014
  06:46:46 STEP  996 H= 249:00 +CPU= 34.222
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+000996
  06:47:12 STEP  997 H= 249:15 +CPU= 25.982
  06:47:38 STEP  998 H= 249:30 +CPU= 26.410
  06:48:05 STEP  999 H= 249:45 +CPU= 26.773
  06:48:33 STEP 1000 H= 250:00 +CPU= 27.534
  06:49:00 STEP 1001 H= 250:15 +CPU= 27.290
  06:49:27 STEP 1002 H= 250:30 +CPU= 26.795
  06:49:53 STEP 1003 H= 250:45 +CPU= 26.260
  06:50:20 STEP 1004 H= 251:00 +CPU= 26.439
  06:50:46 STEP 1005 H= 251:15 +CPU= 26.326
  06:51:12 STEP 1006 H= 251:30 +CPU= 25.709
  06:51:39 STEP 1007 H= 251:45 +CPU= 26.331
  06:52:18 STEP 1008 H= 252:00 +CPU= 38.924
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001008
  06:52:43 STEP 1009 H= 252:15 +CPU= 25.654
  06:53:10 STEP 1010 H= 252:30 +CPU= 26.589
  06:53:36 STEP 1011 H= 252:45 +CPU= 26.068
  06:54:03 STEP 1012 H= 253:00 +CPU= 26.558
  06:54:29 STEP 1013 H= 253:15 +CPU= 25.554
  06:54:54 STEP 1014 H= 253:30 +CPU= 25.606
  06:55:21 STEP 1015 H= 253:45 +CPU= 26.223
  06:55:48 STEP 1016 H= 254:00 +CPU= 27.371
  06:56:15 STEP 1017 H= 254:15 +CPU= 26.768
  06:56:41 STEP 1018 H= 254:30 +CPU= 25.848
  06:57:07 STEP 1019 H= 254:45 +CPU= 25.615
  06:57:40 STEP 1020 H= 255:00 +CPU= 33.160
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001020
  06:58:07 STEP 1021 H= 255:15 +CPU= 26.678
  06:58:33 STEP 1022 H= 255:30 +CPU= 26.040
  06:59:00 STEP 1023 H= 255:45 +CPU= 26.968
  06:59:28 STEP 1024 H= 256:00 +CPU= 27.817
  06:59:55 STEP 1025 H= 256:15 +CPU= 26.990
  07:00:21 STEP 1026 H= 256:30 +CPU= 25.586
  07:00:47 STEP 1027 H= 256:45 +CPU= 26.308
  07:01:14 STEP 1028 H= 257:00 +CPU= 26.760
  07:01:40 STEP 1029 H= 257:15 +CPU= 25.569
  07:02:07 STEP 1030 H= 257:30 +CPU= 26.869
  07:02:33 STEP 1031 H= 257:45 +CPU= 25.826
  07:03:07 STEP 1032 H= 258:00 +CPU= 33.863
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001032
  07:03:33 STEP 1033 H= 258:15 +CPU= 26.440
  07:04:00 STEP 1034 H= 258:30 +CPU= 26.622
  07:04:26 STEP 1035 H= 258:45 +CPU= 26.004
  07:04:53 STEP 1036 H= 259:00 +CPU= 26.543
  07:05:20 STEP 1037 H= 259:15 +CPU= 26.572
  07:05:46 STEP 1038 H= 259:30 +CPU= 25.768
  07:06:12 STEP 1039 H= 259:45 +CPU= 26.843
  07:06:40 STEP 1040 H= 260:00 +CPU= 27.538
  07:07:07 STEP 1041 H= 260:15 +CPU= 26.409
  07:07:33 STEP 1042 H= 260:30 +CPU= 25.786
  07:07:59 STEP 1043 H= 260:45 +CPU= 26.005
  07:08:33 STEP 1044 H= 261:00 +CPU= 34.244
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001044
  07:08:59 STEP 1045 H= 261:15 +CPU= 26.075
  07:09:25 STEP 1046 H= 261:30 +CPU= 25.997
  07:09:52 STEP 1047 H= 261:45 +CPU= 26.566
  07:10:20 STEP 1048 H= 262:00 +CPU= 27.437
  07:10:46 STEP 1049 H= 262:15 +CPU= 25.877
  07:11:12 STEP 1050 H= 262:30 +CPU= 25.913
  07:11:38 STEP 1051 H= 262:45 +CPU= 26.508
  07:12:06 STEP 1052 H= 263:00 +CPU= 27.272
  07:12:32 STEP 1053 H= 263:15 +CPU= 25.969
  07:12:57 STEP 1054 H= 263:30 +CPU= 24.985
  07:13:22 STEP 1055 H= 263:45 +CPU= 25.206
  07:14:01 STEP 1056 H= 264:00 +CPU= 38.553
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2ac_2016092300_15_991_12209751_1_r1073680400_10.zip
Uploading the intermediate file: upload_file_10.zip
  07:14:27 STEP 1057 H= 264:15 +CPU= 26.545
  07:14:55 STEP 1058 H= 264:30 +CPU= 26.956
  07:15:22 STEP 1059 H= 264:45 +CPU= 26.892
  07:15:50 STEP 1060 H= 265:00 +CPU= 27.969
  07:16:17 STEP 1061 H= 265:15 +CPU= 26.938
  07:16:43 STEP 1062 H= 265:30 +CPU= 26.084
  07:17:08 STEP 1063 H= 265:45 +CPU= 25.166
  07:17:35 STEP 1064 H= 266:00 +CPU= 26.890
  07:18:01 STEP 1065 H= 266:15 +CPU= 25.582
  07:18:26 STEP 1066 H= 266:30 +CPU= 25.078
  07:18:52 STEP 1067 H= 266:45 +CPU= 25.410
  07:19:27 STEP 1068 H= 267:00 +CPU= 34.939
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001068
  07:19:52 STEP 1069 H= 267:15 +CPU= 25.615
  07:20:19 STEP 1070 H= 267:30 +CPU= 26.629
  07:20:46 STEP 1071 H= 267:45 +CPU= 26.535
  07:21:13 STEP 1072 H= 268:00 +CPU= 27.409
  07:21:40 STEP 1073 H= 268:15 +CPU= 26.757
  07:22:07 STEP 1074 H= 268:30 +CPU= 26.396
  07:22:34 STEP 1075 H= 268:45 +CPU= 26.899
  07:23:01 STEP 1076 H= 269:00 +CPU= 27.127
  07:23:26 STEP 1077 H= 269:15 +CPU= 25.414
  07:23:54 STEP 1078 H= 269:30 +CPU= 26.971
  07:24:20 STEP 1079 H= 269:45 +CPU= 26.027
  07:24:54 STEP 1080 H= 270:00 +CPU= 33.901
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001080
  07:25:21 STEP 1081 H= 270:15 +CPU= 26.450
  07:25:46 STEP 1082 H= 270:30 +CPU= 25.827
  07:26:12 STEP 1083 H= 270:45 +CPU= 25.132
  07:26:39 STEP 1084 H= 271:00 +CPU= 27.197
  07:27:06 STEP 1085 H= 271:15 +CPU= 26.935
  07:27:32 STEP 1086 H= 271:30 +CPU= 25.726
  07:27:58 STEP 1087 H= 271:45 +CPU= 26.263
  07:28:25 STEP 1088 H= 272:00 +CPU= 26.680
  07:28:51 STEP 1089 H= 272:15 +CPU= 26.056
  07:29:17 STEP 1090 H= 272:30 +CPU= 25.569
  07:29:42 STEP 1091 H= 272:45 +CPU= 25.463
  07:30:16 STEP 1092 H= 273:00 +CPU= 33.598
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001092
  07:30:43 STEP 1093 H= 273:15 +CPU= 27.032
  07:31:10 STEP 1094 H= 273:30 +CPU= 27.134
  07:31:37 STEP 1095 H= 273:45 +CPU= 26.105
  07:32:04 STEP 1096 H= 274:00 +CPU= 27.190
  07:32:31 STEP 1097 H= 274:15 +CPU= 26.855
  07:32:57 STEP 1098 H= 274:30 +CPU= 25.995
  07:33:23 STEP 1099 H= 274:45 +CPU= 26.007
  07:33:49 STEP 1100 H= 275:00 +CPU= 25.661
  07:34:14 STEP 1101 H= 275:15 +CPU= 25.604
  07:34:40 STEP 1102 H= 275:30 +CPU= 25.585
  07:35:06 STEP 1103 H= 275:45 +CPU= 25.885
  07:35:44 STEP 1104 H= 276:00 +CPU= 37.494
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001104
  07:36:10 STEP 1105 H= 276:15 +CPU= 26.576
  07:36:36 STEP 1106 H= 276:30 +CPU= 25.686
  07:37:03 STEP 1107 H= 276:45 +CPU= 26.309
  07:37:31 STEP 1108 H= 277:00 +CPU= 28.180
  07:37:57 STEP 1109 H= 277:15 +CPU= 25.744
  07:38:23 STEP 1110 H= 277:30 +CPU= 25.762
  07:38:49 STEP 1111 H= 277:45 +CPU= 26.183
  07:39:16 STEP 1112 H= 278:00 +CPU= 27.063
  07:39:43 STEP 1113 H= 278:15 +CPU= 26.446
  07:40:09 STEP 1114 H= 278:30 +CPU= 26.556
  07:40:36 STEP 1115 H= 278:45 +CPU= 26.397
  07:41:10 STEP 1116 H= 279:00 +CPU= 34.091
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001116
  07:41:36 STEP 1117 H= 279:15 +CPU= 25.890
  07:42:03 STEP 1118 H= 279:30 +CPU= 26.380
  07:42:30 STEP 1119 H= 279:45 +CPU= 26.807
  07:42:57 STEP 1120 H= 280:00 +CPU= 27.170
  07:43:24 STEP 1121 H= 280:15 +CPU= 26.615
  07:43:49 STEP 1122 H= 280:30 +CPU= 25.713
  07:44:16 STEP 1123 H= 280:45 +CPU= 26.652
  07:44:43 STEP 1124 H= 281:00 +CPU= 26.669
  07:45:09 STEP 1125 H= 281:15 +CPU= 26.309
  07:45:36 STEP 1126 H= 281:30 +CPU= 26.163
  07:46:02 STEP 1127 H= 281:45 +CPU= 25.762
  07:46:37 STEP 1128 H= 282:00 +CPU= 35.048
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001128
  07:47:04 STEP 1129 H= 282:15 +CPU= 26.752
  07:47:30 STEP 1130 H= 282:30 +CPU= 26.395
  07:47:56 STEP 1131 H= 282:45 +CPU= 25.813
  07:48:23 STEP 1132 H= 283:00 +CPU= 27.156
  07:48:51 STEP 1133 H= 283:15 +CPU= 27.290
  07:49:17 STEP 1134 H= 283:30 +CPU= 26.467
  07:49:44 STEP 1135 H= 283:45 +CPU= 26.775
  07:50:12 STEP 1136 H= 284:00 +CPU= 27.337
  07:50:38 STEP 1137 H= 284:15 +CPU= 26.560
  07:51:05 STEP 1138 H= 284:30 +CPU= 26.465
  07:51:31 STEP 1139 H= 284:45 +CPU= 26.319
  07:52:05 STEP 1140 H= 285:00 +CPU= 33.590
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001140
  07:52:32 STEP 1141 H= 285:15 +CPU= 26.692
  07:52:58 STEP 1142 H= 285:30 +CPU= 26.542
  07:53:24 STEP 1143 H= 285:45 +CPU= 25.234
  07:53:51 STEP 1144 H= 286:00 +CPU= 26.802
  07:54:17 STEP 1145 H= 286:15 +CPU= 26.150
  07:54:43 STEP 1146 H= 286:30 +CPU= 25.968
  07:55:09 STEP 1147 H= 286:45 +CPU= 25.756
  07:55:35 STEP 1148 H= 287:00 +CPU= 26.202
  07:56:02 STEP 1149 H= 287:15 +CPU= 26.202
  07:56:27 STEP 1150 H= 287:30 +CPU= 25.399
  07:56:53 STEP 1151 H= 287:45 +CPU= 25.612
  07:57:32 STEP 1152 H= 288:00 +CPU= 39.301
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2ac_2016092300_15_991_12209751_1_r1073680400_11.zip
Uploading the intermediate file: upload_file_11.zip
  07:57:58 STEP 1153 H= 288:15 +CPU= 26.164
  07:58:25 STEP 1154 H= 288:30 +CPU= 26.523
  07:58:51 STEP 1155 H= 288:45 +CPU= 25.531
  07:59:18 STEP 1156 H= 289:00 +CPU= 27.315
  07:59:44 STEP 1157 H= 289:15 +CPU= 26.366
  08:00:12 STEP 1158 H= 289:30 +CPU= 26.942
  08:00:38 STEP 1159 H= 289:45 +CPU= 26.510
  08:01:06 STEP 1160 H= 290:00 +CPU= 27.507
  08:01:32 STEP 1161 H= 290:15 +CPU= 25.759
  08:01:57 STEP 1162 H= 290:30 +CPU= 25.101
  08:02:22 STEP 1163 H= 290:45 +CPU= 25.361
  08:02:56 STEP 1164 H= 291:00 +CPU= 33.530
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001164
  08:03:23 STEP 1165 H= 291:15 +CPU= 26.448
  08:03:49 STEP 1166 H= 291:30 +CPU= 26.316
  08:04:16 STEP 1167 H= 291:45 +CPU= 27.106
  08:04:44 STEP 1168 H= 292:00 +CPU= 27.302
  08:05:10 STEP 1169 H= 292:15 +CPU= 26.673
  08:05:36 STEP 1170 H= 292:30 +CPU= 25.177
  08:06:01 STEP 1171 H= 292:45 +CPU= 25.671
  08:06:28 STEP 1172 H= 293:00 +CPU= 27.088
  08:06:55 STEP 1173 H= 293:15 +CPU= 26.540
  08:07:22 STEP 1174 H= 293:30 +CPU= 26.509
  08:07:48 STEP 1175 H= 293:45 +CPU= 26.142
  08:08:20 STEP 1176 H= 294:00 +CPU= 31.860
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001176
  08:08:45 STEP 1177 H= 294:15 +CPU= 24.593
  08:09:09 STEP 1178 H= 294:30 +CPU= 24.597
  08:09:35 STEP 1179 H= 294:45 +CPU= 25.010
  08:10:01 STEP 1180 H= 295:00 +CPU= 26.019
  08:10:26 STEP 1181 H= 295:15 +CPU= 24.952
  08:10:50 STEP 1182 H= 295:30 +CPU= 24.413
  08:11:15 STEP 1183 H= 295:45 +CPU= 24.721
  08:11:40 STEP 1184 H= 296:00 +CPU= 24.864
  08:12:05 STEP 1185 H= 296:15 +CPU= 25.179
  08:12:31 STEP 1186 H= 296:30 +CPU= 25.137
  08:12:56 STEP 1187 H= 296:45 +CPU= 25.050
  08:13:28 STEP 1188 H= 297:00 +CPU= 31.689
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001188
  08:13:52 STEP 1189 H= 297:15 +CPU= 24.403
  08:14:16 STEP 1190 H= 297:30 +CPU= 24.171
  08:14:41 STEP 1191 H= 297:45 +CPU= 25.035
  08:15:07 STEP 1192 H= 298:00 +CPU= 25.414
  08:15:31 STEP 1193 H= 298:15 +CPU= 24.396
  08:15:56 STEP 1194 H= 298:30 +CPU= 24.379
  08:16:21 STEP 1195 H= 298:45 +CPU= 24.703
  08:16:46 STEP 1196 H= 299:00 +CPU= 24.994
  08:17:11 STEP 1197 H= 299:15 +CPU= 24.837
  08:17:35 STEP 1198 H= 299:30 +CPU= 24.384
  08:18:01 STEP 1199 H= 299:45 +CPU= 25.505
  08:18:37 STEP 1200 H= 300:00 +CPU= 36.397
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001200
  08:19:02 STEP 1201 H= 300:15 +CPU= 24.873
  08:19:27 STEP 1202 H= 300:30 +CPU= 24.096
  08:19:51 STEP 1203 H= 300:45 +CPU= 24.569
  08:20:17 STEP 1204 H= 301:00 +CPU= 25.744
  08:20:42 STEP 1205 H= 301:15 +CPU= 24.726
  08:21:07 STEP 1206 H= 301:30 +CPU= 24.930
  08:21:32 STEP 1207 H= 301:45 +CPU= 24.813
  08:21:58 STEP 1208 H= 302:00 +CPU= 26.085
  08:22:23 STEP 1209 H= 302:15 +CPU= 25.086
  08:22:47 STEP 1210 H= 302:30 +CPU= 23.514
  08:23:11 STEP 1211 H= 302:45 +CPU= 24.421
  08:23:44 STEP 1212 H= 303:00 +CPU= 32.169
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001212
  08:24:09 STEP 1213 H= 303:15 +CPU= 25.556
  08:24:35 STEP 1214 H= 303:30 +CPU= 25.204
  08:24:59 STEP 1215 H= 303:45 +CPU= 24.470
  08:25:25 STEP 1216 H= 304:00 +CPU= 25.823
  08:25:50 STEP 1217 H= 304:15 +CPU= 24.995
  08:26:15 STEP 1218 H= 304:30 +CPU= 24.847
  08:26:40 STEP 1219 H= 304:45 +CPU= 24.755
  08:27:05 STEP 1220 H= 305:00 +CPU= 25.202
  08:27:30 STEP 1221 H= 305:15 +CPU= 23.984
  08:27:54 STEP 1222 H= 305:30 +CPU= 24.469
  08:28:19 STEP 1223 H= 305:45 +CPU= 24.552
  08:28:51 STEP 1224 H= 306:00 +CPU= 32.222
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001224
  08:29:16 STEP 1225 H= 306:15 +CPU= 24.514
  08:29:40 STEP 1226 H= 306:30 +CPU= 24.383
  08:30:05 STEP 1227 H= 306:45 +CPU= 24.341
  08:30:30 STEP 1228 H= 307:00 +CPU= 25.073
  08:30:55 STEP 1229 H= 307:15 +CPU= 24.763
  08:31:19 STEP 1230 H= 307:30 +CPU= 24.292
  08:31:43 STEP 1231 H= 307:45 +CPU= 24.218
  08:32:10 STEP 1232 H= 308:00 +CPU= 26.122
  08:32:34 STEP 1233 H= 308:15 +CPU= 23.978
  08:32:55 STEP 1234 H= 308:30 +CPU= 21.068
  08:33:17 STEP 1235 H= 308:45 +CPU= 22.261
  08:33:48 STEP 1236 H= 309:00 +CPU= 31.198
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001236
  08:34:13 STEP 1237 H= 309:15 +CPU= 24.669
  08:34:38 STEP 1238 H= 309:30 +CPU= 24.920
  08:35:02 STEP 1239 H= 309:45 +CPU= 24.141
  08:35:28 STEP 1240 H= 310:00 +CPU= 25.212
  08:35:53 STEP 1241 H= 310:15 +CPU= 24.786
  08:36:17 STEP 1242 H= 310:30 +CPU= 23.996
  08:36:41 STEP 1243 H= 310:45 +CPU= 24.452
  08:37:07 STEP 1244 H= 311:00 +CPU= 25.520
  08:37:32 STEP 1245 H= 311:15 +CPU= 24.617
  08:37:55 STEP 1246 H= 311:30 +CPU= 23.776
  08:38:20 STEP 1247 H= 311:45 +CPU= 24.697
  08:38:57 STEP 1248 H= 312:00 +CPU= 36.150
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2ac_2016092300_15_991_12209751_1_r1073680400_12.zip
Uploading the intermediate file: upload_file_12.zip
  08:39:22 STEP 1249 H= 312:15 +CPU= 25.110
  08:39:46 STEP 1250 H= 312:30 +CPU= 24.499
  08:40:11 STEP 1251 H= 312:45 +CPU= 24.662
  08:40:36 STEP 1252 H= 313:00 +CPU= 25.093
  08:41:01 STEP 1253 H= 313:15 +CPU= 24.634
  08:41:27 STEP 1254 H= 313:30 +CPU= 25.351
  08:41:51 STEP 1255 H= 313:45 +CPU= 24.793
  08:42:16 STEP 1256 H= 314:00 +CPU= 24.709
  08:42:41 STEP 1257 H= 314:15 +CPU= 24.959
  08:43:05 STEP 1258 H= 314:30 +CPU= 23.807
  08:43:30 STEP 1259 H= 314:45 +CPU= 24.595
  08:44:02 STEP 1260 H= 315:00 +CPU= 32.041
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001260
  08:44:27 STEP 1261 H= 315:15 +CPU= 24.367
  08:44:51 STEP 1262 H= 315:30 +CPU= 24.476
  08:45:16 STEP 1263 H= 315:45 +CPU= 24.623
  08:45:41 STEP 1264 H= 316:00 +CPU= 25.131
  08:46:06 STEP 1265 H= 316:15 +CPU= 24.684
  08:46:30 STEP 1266 H= 316:30 +CPU= 24.364
  08:46:56 STEP 1267 H= 316:45 +CPU= 25.080
  08:47:21 STEP 1268 H= 317:00 +CPU= 25.319
  08:47:46 STEP 1269 H= 317:15 +CPU= 24.472
  08:48:11 STEP 1270 H= 317:30 +CPU= 25.253
  08:48:35 STEP 1271 H= 317:45 +CPU= 23.645
  08:49:06 STEP 1272 H= 318:00 +CPU= 31.411
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001272
  08:49:31 STEP 1273 H= 318:15 +CPU= 24.971
  08:49:57 STEP 1274 H= 318:30 +CPU= 25.574
  08:50:21 STEP 1275 H= 318:45 +CPU= 24.277
  08:50:46 STEP 1276 H= 319:00 +CPU= 24.014
  08:51:10 STEP 1277 H= 319:15 +CPU= 24.727
  08:51:35 STEP 1278 H= 319:30 +CPU= 24.208
  08:51:59 STEP 1279 H= 319:45 +CPU= 24.783
  08:52:25 STEP 1280 H= 320:00 +CPU= 25.668
  08:52:50 STEP 1281 H= 320:15 +CPU= 24.283
  08:53:14 STEP 1282 H= 320:30 +CPU= 24.236
  08:53:39 STEP 1283 H= 320:45 +CPU= 25.162
  08:54:10 STEP 1284 H= 321:00 +CPU= 30.776
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001284
  08:54:35 STEP 1285 H= 321:15 +CPU= 25.138
  08:55:00 STEP 1286 H= 321:30 +CPU= 24.417
  08:55:24 STEP 1287 H= 321:45 +CPU= 24.399
  08:55:50 STEP 1288 H= 322:00 +CPU= 25.707
  08:56:15 STEP 1289 H= 322:15 +CPU= 24.752
  08:56:40 STEP 1290 H= 322:30 +CPU= 24.457
  08:57:05 STEP 1291 H= 322:45 +CPU= 25.337
  08:57:31 STEP 1292 H= 323:00 +CPU= 26.072
  08:57:56 STEP 1293 H= 323:15 +CPU= 24.339
  08:58:21 STEP 1294 H= 323:30 +CPU= 25.053
  08:58:45 STEP 1295 H= 323:45 +CPU= 23.726
  08:59:20 STEP 1296 H= 324:00 +CPU= 35.461
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001296
  08:59:45 STEP 1297 H= 324:15 +CPU= 24.394
  09:00:08 STEP 1298 H= 324:30 +CPU= 23.624
  09:00:33 STEP 1299 H= 324:45 +CPU= 24.184
  09:00:58 STEP 1300 H= 325:00 +CPU= 24.691
  09:01:22 STEP 1301 H= 325:15 +CPU= 24.685
  09:01:48 STEP 1302 H= 325:30 +CPU= 25.782
  09:02:12 STEP 1303 H= 325:45 +CPU= 24.114
  09:02:38 STEP 1304 H= 326:00 +CPU= 25.374
  09:03:02 STEP 1305 H= 326:15 +CPU= 24.008
  09:03:27 STEP 1306 H= 326:30 +CPU= 25.078
  09:03:53 STEP 1307 H= 326:45 +CPU= 25.577
  09:04:25 STEP 1308 H= 327:00 +CPU= 32.267
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001308
  09:04:51 STEP 1309 H= 327:15 +CPU= 25.577
  09:05:16 STEP 1310 H= 327:30 +CPU= 24.913
  09:05:41 STEP 1311 H= 327:45 +CPU= 24.695
  09:06:06 STEP 1312 H= 328:00 +CPU= 25.356
  09:06:31 STEP 1313 H= 328:15 +CPU= 24.437
  09:06:55 STEP 1314 H= 328:30 +CPU= 24.437
  09:07:20 STEP 1315 H= 328:45 +CPU= 24.150
  09:07:45 STEP 1316 H= 329:00 +CPU= 25.599
  09:08:10 STEP 1317 H= 329:15 +CPU= 24.447
  09:08:35 STEP 1318 H= 329:30 +CPU= 25.126
  09:09:00 STEP 1319 H= 329:45 +CPU= 24.571
  09:09:33 STEP 1320 H= 330:00 +CPU= 32.697
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001320
  09:09:58 STEP 1321 H= 330:15 +CPU= 25.125
  09:10:22 STEP 1322 H= 330:30 +CPU= 24.043
  09:10:47 STEP 1323 H= 330:45 +CPU= 24.611
  09:11:13 STEP 1324 H= 331:00 +CPU= 26.135
  09:11:37 STEP 1325 H= 331:15 +CPU= 24.243
  09:12:02 STEP 1326 H= 331:30 +CPU= 24.693
  09:12:27 STEP 1327 H= 331:45 +CPU= 24.468
  09:12:52 STEP 1328 H= 332:00 +CPU= 25.729
  09:13:17 STEP 1329 H= 332:15 +CPU= 24.575
  09:13:42 STEP 1330 H= 332:30 +CPU= 24.953
  09:14:07 STEP 1331 H= 332:45 +CPU= 24.259
  09:14:39 STEP 1332 H= 333:00 +CPU= 32.177
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001332
  09:15:04 STEP 1333 H= 333:15 +CPU= 24.997
  09:15:29 STEP 1334 H= 333:30 +CPU= 25.099
  09:15:54 STEP 1335 H= 333:45 +CPU= 24.819
  09:16:20 STEP 1336 H= 334:00 +CPU= 25.307
  09:16:44 STEP 1337 H= 334:15 +CPU= 24.285
  09:17:09 STEP 1338 H= 334:30 +CPU= 25.348
  09:17:35 STEP 1339 H= 334:45 +CPU= 25.404
  09:18:00 STEP 1340 H= 335:00 +CPU= 24.867
  09:18:25 STEP 1341 H= 335:15 +CPU= 24.746
  09:18:50 STEP 1342 H= 335:30 +CPU= 24.798
  09:19:14 STEP 1343 H= 335:45 +CPU= 24.752
  09:19:50 STEP 1344 H= 336:00 +CPU= 35.769
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2ac_2016092300_15_991_12209751_1_r1073680400_13.zip
Uploading the intermediate file: upload_file_13.zip
  09:20:14 STEP 1345 H= 336:15 +CPU= 23.595
  09:20:38 STEP 1346 H= 336:30 +CPU= 24.276
  09:21:03 STEP 1347 H= 336:45 +CPU= 24.302
  09:21:29 STEP 1348 H= 337:00 +CPU= 25.646
  09:21:53 STEP 1349 H= 337:15 +CPU= 24.070
  09:22:17 STEP 1350 H= 337:30 +CPU= 23.834
  09:22:41 STEP 1351 H= 337:45 +CPU= 24.291
  09:23:06 STEP 1352 H= 338:00 +CPU= 25.163
  09:23:31 STEP 1353 H= 338:15 +CPU= 24.527
  09:23:56 STEP 1354 H= 338:30 +CPU= 24.652
  09:24:20 STEP 1355 H= 338:45 +CPU= 24.561
  09:24:53 STEP 1356 H= 339:00 +CPU= 32.531
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001356
  09:25:18 STEP 1357 H= 339:15 +CPU= 24.823
  09:25:42 STEP 1358 H= 339:30 +CPU= 23.936
  09:26:07 STEP 1359 H= 339:45 +CPU= 24.967
  09:26:33 STEP 1360 H= 340:00 +CPU= 25.571
  09:26:58 STEP 1361 H= 340:15 +CPU= 24.845
  09:27:23 STEP 1362 H= 340:30 +CPU= 24.892
  09:27:49 STEP 1363 H= 340:45 +CPU= 25.814
  09:28:14 STEP 1364 H= 341:00 +CPU= 24.823
  09:28:39 STEP 1365 H= 341:15 +CPU= 24.920
  09:29:04 STEP 1366 H= 341:30 +CPU= 24.953
  09:29:28 STEP 1367 H= 341:45 +CPU= 23.957
  09:30:00 STEP 1368 H= 342:00 +CPU= 32.036
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001368
  09:30:24 STEP 1369 H= 342:15 +CPU= 24.033
  09:30:49 STEP 1370 H= 342:30 +CPU= 24.952
  09:31:14 STEP 1371 H= 342:45 +CPU= 25.134
  09:31:39 STEP 1372 H= 343:00 +CPU= 24.967
  09:32:04 STEP 1373 H= 343:15 +CPU= 24.469
  09:32:29 STEP 1374 H= 343:30 +CPU= 24.643
  09:32:54 STEP 1375 H= 343:45 +CPU= 24.960
  09:33:20 STEP 1376 H= 344:00 +CPU= 25.775
  09:33:44 STEP 1377 H= 344:15 +CPU= 24.133
  09:34:08 STEP 1378 H= 344:30 +CPU= 24.557
  09:34:33 STEP 1379 H= 344:45 +CPU= 24.680
  09:35:05 STEP 1380 H= 345:00 +CPU= 31.313
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001380
  09:35:29 STEP 1381 H= 345:15 +CPU= 24.382
  09:35:55 STEP 1382 H= 345:30 +CPU= 25.533
  09:36:20 STEP 1383 H= 345:45 +CPU= 24.960
  09:36:45 STEP 1384 H= 346:00 +CPU= 25.537
  09:37:10 STEP 1385 H= 346:15 +CPU= 24.202
  09:37:34 STEP 1386 H= 346:30 +CPU= 24.177
  09:37:59 STEP 1387 H= 346:45 +CPU= 25.220
  09:38:25 STEP 1388 H= 347:00 +CPU= 25.157
  09:38:49 STEP 1389 H= 347:15 +CPU= 24.177
  09:39:14 STEP 1390 H= 347:30 +CPU= 24.565
  09:39:38 STEP 1391 H= 347:45 +CPU= 24.119
  09:40:14 STEP 1392 H= 348:00 +CPU= 35.798
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001392
  09:40:39 STEP 1393 H= 348:15 +CPU= 24.716
  09:41:03 STEP 1394 H= 348:30 +CPU= 24.135
  09:41:27 STEP 1395 H= 348:45 +CPU= 24.497
  09:41:52 STEP 1396 H= 349:00 +CPU= 24.474
  09:42:17 STEP 1397 H= 349:15 +CPU= 24.868
  09:42:42 STEP 1398 H= 349:30 +CPU= 24.787
  09:43:06 STEP 1399 H= 349:45 +CPU= 23.894
  09:43:31 STEP 1400 H= 350:00 +CPU= 25.161
  09:43:55 STEP 1401 H= 350:15 +CPU= 23.545
  09:44:20 STEP 1402 H= 350:30 +CPU= 25.011
  09:44:46 STEP 1403 H= 350:45 +CPU= 25.828
  09:45:18 STEP 1404 H= 351:00 +CPU= 31.730
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001404
  09:45:41 STEP 1405 H= 351:15 +CPU= 23.665
  09:46:06 STEP 1406 H= 351:30 +CPU= 24.264
  09:46:30 STEP 1407 H= 351:45 +CPU= 24.687
  09:46:55 STEP 1408 H= 352:00 +CPU= 24.804
  09:47:20 STEP 1409 H= 352:15 +CPU= 25.009
  09:47:45 STEP 1410 H= 352:30 +CPU= 24.164
  09:48:10 STEP 1411 H= 352:45 +CPU= 24.828
  09:48:35 STEP 1412 H= 353:00 +CPU= 24.827
  09:49:00 STEP 1413 H= 353:15 +CPU= 24.968
  09:49:25 STEP 1414 H= 353:30 +CPU= 24.838
  09:49:50 STEP 1415 H= 353:45 +CPU= 25.030
  09:50:22 STEP 1416 H= 354:00 +CPU= 32.314
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001416
  09:50:48 STEP 1417 H= 354:15 +CPU= 25.253
  09:51:13 STEP 1418 H= 354:30 +CPU= 25.202
  09:51:38 STEP 1419 H= 354:45 +CPU= 24.687
  09:52:03 STEP 1420 H= 355:00 +CPU= 25.413
  09:52:29 STEP 1421 H= 355:15 +CPU= 25.480
  09:52:54 STEP 1422 H= 355:30 +CPU= 25.002
  09:53:18 STEP 1423 H= 355:45 +CPU= 24.208
  09:53:44 STEP 1424 H= 356:00 +CPU= 25.759
  09:54:09 STEP 1425 H= 356:15 +CPU= 24.720
  09:54:34 STEP 1426 H= 356:30 +CPU= 24.740
  09:54:58 STEP 1427 H= 356:45 +CPU= 24.402
  09:55:30 STEP 1428 H= 357:00 +CPU= 31.577
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001428
  09:55:55 STEP 1429 H= 357:15 +CPU= 25.233
  09:56:20 STEP 1430 H= 357:30 +CPU= 24.749
  09:56:45 STEP 1431 H= 357:45 +CPU= 24.315
  09:57:10 STEP 1432 H= 358:00 +CPU= 25.339
  09:57:35 STEP 1433 H= 358:15 +CPU= 24.828
  09:58:00 STEP 1434 H= 358:30 +CPU= 24.751
  09:58:25 STEP 1435 H= 358:45 +CPU= 25.394
  09:58:51 STEP 1436 H= 359:00 +CPU= 25.516
  09:59:16 STEP 1437 H= 359:15 +CPU= 24.735
  09:59:41 STEP 1438 H= 359:30 +CPU= 25.493
  10:00:07 STEP 1439 H= 359:45 +CPU= 24.989
  10:00:41 STEP 1440 H= 360:00 +CPU= 34.483
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

  ---------------------------------------------------------------------------------------------------------- I ----------------
 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1379444831E-21      I       0.1422919197E-06      I
ICloud fractionI      0.0000000000E+00      I       0.1621460109E-01      I
I  Relat. Hum. I      0.4676753386E+00      I       0.4877654799E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.4491094018E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    295448545 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS492414.2 Mbytes/s, TOTAL TIME=    0.0120( 5.0%)
 10:00:41 STEP 1440 H= 360:00 +CPU= 34.483
 END CNT3
 NSTEP =  1440 CNT0   000000000  23.857  23.857  23.956   0.996               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN        15598/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    278    0       34      1044068    15598 ************    34.5     1.8    32.7     2.6    61.1
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 *********       0.0    100.00   -100.00
   1 CNT4     - FORWARD INTEGRATION                  1 *********       0.0    100.00   -100.00
   8 SCAN2M - GRID-POINT DYNAMICS                  573    4622.8    4622.8      0.00      0.00
   9 SPCM     - SPECTRAL COMP.                     528     747.0     747.0      0.00      0.00
  10 SCAN2M - PHYSICS                              529   11990.4   11990.4      0.00      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 44    1010.6    1010.6      0.00      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 23      62.2      62.2      0.00      0.00
  17 GRIDFPOS IN CNT4                               44      29.9      29.9      0.00      0.00
  27 RESTART FILES - WRITING                        11    4042.2    4042.2      0.00      0.00
  28 RESTART FILES - READING                         1    3562.4    3562.4      0.00      0.00
  29 SU4FPOS IN CNT4                                44       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                44    6492.4    6492.4      0.00      0.00
  31 POSDDH IN STEPO                                 3       1.1       1.1      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    529 -400614.2       0.0    105.53   -105.53
  39 SU0YOMB                                         1     402.1     402.1      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    529      24.9      24.9      0.00      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              528     196.5     196.5      0.00      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              528      54.1      54.1      0.00      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 23       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1148     428.1     428.1      0.00      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1100     254.2     254.2      0.00      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1100      95.7      95.7      0.00      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1148     138.4     138.4      0.00      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      50.8      50.8      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1148      54.1      54.1      0.00      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1100      27.9      27.9      0.00      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1148      78.0      78.0      0.00      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1100      37.9      37.9      0.00      0.00
 400 GSTATS                                      61989       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 57623       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME  -200828.5 CPU TIME   13863.1 VECTOR TIME    13863.1


===-=== END   OF TIMING STATISTICS ===-===
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client50001/slots/4/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client50001/slots/4/NODE.001_01
Adding to the zip: /var/lib/boinc-client50001/slots/4/ifs.stat
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMUAh7zg+001416
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_12209751/ICMSHh7zg+001368
Zipping up the final file: /var/lib/boinc-client50001/projects/climateprediction.net/oifs_43r3_bl_a2ac_2016092300_15_991_12209751_1_r1073680400_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
10:04:13 (1192953): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:51:53 1528653 22310735 oifs_43r3_bl_a2ac_2016092300_15_991_12209751_1 1,295,100 53,996 0.0417


©2024 climateprediction.net