climateprediction.net home page
Task 22311507

Task 22311507

Name oifs_43r3_bl_a3gj_2016092300_15_991_12211270_0
Workunit 12211270
Created 13 Feb 2023, 20:15:46 UTC
Sent 13 Feb 2023, 20:21:12 UTC
Report deadline 14 Apr 2023, 20:21:12 UTC
Received 26 Feb 2023, 15:42:16 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1522441
Run time 11 hours 37 min 48 sec
CPU time 11 hours 37 min 48 sec
Validate state Valid
Credit 1,813.14
Device peak FLOPS 7.94 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 5,062.36 MB
Peak swap size 5,930.78 MB
Peak disk usage 1,382.09 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
 progress file ok : /var/lib/boinc-client/slots/39/progress_file_12211270.xml
-- Model is restarting --
Adjusting last_iter, 952, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/39/progress_file_12211270.xml
last_cpu_time: 20241
upload_file_number: 9
last_iter: 913
last_upload: 777600
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a3gj_2016092300_15_991_12211270_0_r487705645
The child process has been launched with process id: 10978
Executing the command: /var/lib/boinc-client/slots/39/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:emu:1:1:10978:10978] [20230226:200548:1677402348:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  20:06:49 STEP  912 H= 228:00 +CPU= 50.487
  20:07:36 STEP  913 H= 228:15 +CPU= 46.157
  20:08:22 STEP  914 H= 228:30 +CPU= 45.654
  20:09:05 STEP  915 H= 228:45 +CPU= 43.182
  20:09:51 STEP  916 H= 229:00 +CPU= 45.010
  20:10:33 STEP  917 H= 229:15 +CPU= 42.178
  20:11:13 STEP  918 H= 229:30 +CPU= 39.826
  20:11:54 STEP  919 H= 229:45 +CPU= 40.631
  20:12:34 STEP  920 H= 230:00 +CPU= 39.799
  20:13:12 STEP  921 H= 230:15 +CPU= 37.192
  20:13:48 STEP  922 H= 230:30 +CPU= 36.407
  20:14:26 STEP  923 H= 230:45 +CPU= 37.340
  20:15:14 STEP  924 H= 231:00 +CPU= 47.359
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+000924
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+000924
  20:15:50 STEP  925 H= 231:15 +CPU= 36.188
  20:16:25 STEP  926 H= 231:30 +CPU= 34.720
  20:17:01 STEP  927 H= 231:45 +CPU= 35.203
  20:17:40 STEP  928 H= 232:00 +CPU= 38.746
  20:18:16 STEP  929 H= 232:15 +CPU= 36.385
  20:18:53 STEP  930 H= 232:30 +CPU= 36.680
  20:19:37 STEP  931 H= 232:45 +CPU= 43.395
  20:20:21 STEP  932 H= 233:00 +CPU= 43.764
  20:21:02 STEP  933 H= 233:15 +CPU= 40.383
  20:21:43 STEP  934 H= 233:30 +CPU= 40.720
  20:22:22 STEP  935 H= 233:45 +CPU= 39.138
  20:23:11 STEP  936 H= 234:00 +CPU= 48.633
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+000936
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+000936
  20:23:50 STEP  937 H= 234:15 +CPU= 38.607
  20:24:28 STEP  938 H= 234:30 +CPU= 37.896
  20:25:08 STEP  939 H= 234:45 +CPU= 39.078
  20:25:46 STEP  940 H= 235:00 +CPU= 38.088
  20:26:24 STEP  941 H= 235:15 +CPU= 37.239
  20:27:02 STEP  942 H= 235:30 +CPU= 37.641
  20:27:41 STEP  943 H= 235:45 +CPU= 39.004
  20:28:19 STEP  944 H= 236:00 +CPU= 38.114
  20:28:57 STEP  945 H= 236:15 +CPU= 37.730
  20:29:36 STEP  946 H= 236:30 +CPU= 38.086
  20:30:14 STEP  947 H= 236:45 +CPU= 38.498
  20:31:00 STEP  948 H= 237:00 +CPU= 45.491
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+000948
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+000948
  20:31:40 STEP  949 H= 237:15 +CPU= 39.279
  20:32:19 STEP  950 H= 237:30 +CPU= 38.792
  20:32:58 STEP  951 H= 237:45 +CPU= 39.174
  20:33:38 STEP  952 H= 238:00 +CPU= 39.574
  20:34:16 STEP  953 H= 238:15 +CPU= 37.832
  20:34:55 STEP  954 H= 238:30 +CPU= 38.035
  20:35:34 STEP  955 H= 238:45 +CPU= 38.986
  20:36:13 STEP  956 H= 239:00 +CPU= 38.790
  20:36:53 STEP  957 H= 239:15 +CPU= 39.469
  20:37:32 STEP  958 H= 239:30 +CPU= 38.595
  20:38:10 STEP  959 H= 239:45 +CPU= 37.931
  20:39:04 STEP  960 H= 240:00 +CPU= 53.110
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+000960
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+000864
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+000876
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+000888
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+000900
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+000912
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+000924
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+000936
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+000948
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+000948
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3gj_2016092300_15_991_12211270_0_r487705645_9.zip
Uploading the intermediate file: upload_file_9.zip
  20:39:42 STEP  961 H= 240:15 +CPU= 38.020
  20:40:21 STEP  962 H= 240:30 +CPU= 38.338
  20:40:59 STEP  963 H= 240:45 +CPU= 38.111
  20:41:37 STEP  964 H= 241:00 +CPU= 37.760
  20:42:15 STEP  965 H= 241:15 +CPU= 37.235
  20:42:52 STEP  966 H= 241:30 +CPU= 37.483
  20:43:30 STEP  967 H= 241:45 +CPU= 37.263
  20:44:08 STEP  968 H= 242:00 +CPU= 37.968
  20:44:45 STEP  969 H= 242:15 +CPU= 36.899
  20:45:23 STEP  970 H= 242:30 +CPU= 37.243
  20:46:00 STEP  971 H= 242:45 +CPU= 36.726
  20:46:45 STEP  972 H= 243:00 +CPU= 45.317
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+000972
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+000972
  20:47:23 STEP  973 H= 243:15 +CPU= 36.800
  20:47:59 STEP  974 H= 243:30 +CPU= 36.405
  20:48:36 STEP  975 H= 243:45 +CPU= 36.517
  20:49:14 STEP  976 H= 244:00 +CPU= 38.133
  20:49:52 STEP  977 H= 244:15 +CPU= 37.493
  20:50:30 STEP  978 H= 244:30 +CPU= 37.896
  20:51:08 STEP  979 H= 244:45 +CPU= 37.020
  20:51:46 STEP  980 H= 245:00 +CPU= 38.251
  20:52:25 STEP  981 H= 245:15 +CPU= 38.709
  20:53:03 STEP  982 H= 245:30 +CPU= 37.346
  20:53:41 STEP  983 H= 245:45 +CPU= 37.573
  20:54:26 STEP  984 H= 246:00 +CPU= 45.236
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+000984
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+000984
  20:55:04 STEP  985 H= 246:15 +CPU= 37.822
  20:55:41 STEP  986 H= 246:30 +CPU= 36.484
  20:56:18 STEP  987 H= 246:45 +CPU= 36.929
  20:56:56 STEP  988 H= 247:00 +CPU= 37.839
  20:57:34 STEP  989 H= 247:15 +CPU= 37.315
  20:58:12 STEP  990 H= 247:30 +CPU= 37.341
  20:58:49 STEP  991 H= 247:45 +CPU= 36.816
  20:59:27 STEP  992 H= 248:00 +CPU= 37.432
  21:00:03 STEP  993 H= 248:15 +CPU= 36.644
  21:00:42 STEP  994 H= 248:30 +CPU= 38.189
  21:01:19 STEP  995 H= 248:45 +CPU= 36.738
  21:02:04 STEP  996 H= 249:00 +CPU= 44.385
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+000996
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+000996
  21:02:42 STEP  997 H= 249:15 +CPU= 37.641
  21:03:18 STEP  998 H= 249:30 +CPU= 36.616
  21:03:55 STEP  999 H= 249:45 +CPU= 36.466
  21:04:34 STEP 1000 H= 250:00 +CPU= 38.756
  21:05:12 STEP 1001 H= 250:15 +CPU= 37.591
  21:05:49 STEP 1002 H= 250:30 +CPU= 36.564
  21:06:26 STEP 1003 H= 250:45 +CPU= 36.842
  21:07:05 STEP 1004 H= 251:00 +CPU= 38.268
  21:07:42 STEP 1005 H= 251:15 +CPU= 37.531
  21:08:19 STEP 1006 H= 251:30 +CPU= 36.152
  21:08:56 STEP 1007 H= 251:45 +CPU= 37.077
  21:09:50 STEP 1008 H= 252:00 +CPU= 51.974
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001008
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001008
  21:10:28 STEP 1009 H= 252:15 +CPU= 38.200
  21:11:07 STEP 1010 H= 252:30 +CPU= 37.897
  21:11:43 STEP 1011 H= 252:45 +CPU= 36.556
  21:12:23 STEP 1012 H= 253:00 +CPU= 38.828
  21:13:00 STEP 1013 H= 253:15 +CPU= 37.300
  21:13:38 STEP 1014 H= 253:30 +CPU= 37.306
  21:14:16 STEP 1015 H= 253:45 +CPU= 37.562
  21:14:53 STEP 1016 H= 254:00 +CPU= 37.463
  21:15:31 STEP 1017 H= 254:15 +CPU= 37.743
  21:16:08 STEP 1018 H= 254:30 +CPU= 36.765
  21:16:45 STEP 1019 H= 254:45 +CPU= 36.586
  21:17:31 STEP 1020 H= 255:00 +CPU= 45.256
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001020
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001020
  21:18:08 STEP 1021 H= 255:15 +CPU= 37.106
  21:18:46 STEP 1022 H= 255:30 +CPU= 37.189
  21:19:23 STEP 1023 H= 255:45 +CPU= 37.066
  21:20:02 STEP 1024 H= 256:00 +CPU= 38.408
  21:20:39 STEP 1025 H= 256:15 +CPU= 37.100
  21:21:18 STEP 1026 H= 256:30 +CPU= 38.222
  21:21:56 STEP 1027 H= 256:45 +CPU= 38.048
  21:22:34 STEP 1028 H= 257:00 +CPU= 37.422
  21:23:12 STEP 1029 H= 257:15 +CPU= 37.743
  21:23:50 STEP 1030 H= 257:30 +CPU= 37.575
  21:24:27 STEP 1031 H= 257:45 +CPU= 37.383
  21:25:13 STEP 1032 H= 258:00 +CPU= 45.204
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001032
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001032
  21:25:50 STEP 1033 H= 258:15 +CPU= 37.184
  21:26:29 STEP 1034 H= 258:30 +CPU= 37.731
  21:27:05 STEP 1035 H= 258:45 +CPU= 35.679
  21:27:43 STEP 1036 H= 259:00 +CPU= 38.137
  21:28:21 STEP 1037 H= 259:15 +CPU= 37.253
  21:28:58 STEP 1038 H= 259:30 +CPU= 37.583
  21:29:35 STEP 1039 H= 259:45 +CPU= 36.051
  21:30:14 STEP 1040 H= 260:00 +CPU= 38.546
  21:30:51 STEP 1041 H= 260:15 +CPU= 37.381
  21:31:28 STEP 1042 H= 260:30 +CPU= 36.670
  21:32:05 STEP 1043 H= 260:45 +CPU= 36.671
  21:32:52 STEP 1044 H= 261:00 +CPU= 45.961
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001044
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001044
  21:33:29 STEP 1045 H= 261:15 +CPU= 36.982
  21:34:06 STEP 1046 H= 261:30 +CPU= 36.768
  21:34:43 STEP 1047 H= 261:45 +CPU= 37.049
  21:35:21 STEP 1048 H= 262:00 +CPU= 37.926
  21:35:59 STEP 1049 H= 262:15 +CPU= 37.481
  21:36:39 STEP 1050 H= 262:30 +CPU= 39.274
  21:37:17 STEP 1051 H= 262:45 +CPU= 37.942
  21:37:57 STEP 1052 H= 263:00 +CPU= 39.335
  21:38:35 STEP 1053 H= 263:15 +CPU= 37.919
  21:39:13 STEP 1054 H= 263:30 +CPU= 37.494
  21:39:49 STEP 1055 H= 263:45 +CPU= 36.257
  21:40:42 STEP 1056 H= 264:00 +CPU= 52.440
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001056
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+000960
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+000972
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+000984
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+000996
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001008
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001020
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001032
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001044
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001044
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3gj_2016092300_15_991_12211270_0_r487705645_10.zip
Uploading the intermediate file: upload_file_10.zip
  21:41:22 STEP 1057 H= 264:15 +CPU= 39.135
  21:42:00 STEP 1058 H= 264:30 +CPU= 37.971
  21:42:39 STEP 1059 H= 264:45 +CPU= 38.495
  21:43:18 STEP 1060 H= 265:00 +CPU= 39.315
  21:43:56 STEP 1061 H= 265:15 +CPU= 37.630
  21:44:32 STEP 1062 H= 265:30 +CPU= 35.833
  21:45:09 STEP 1063 H= 265:45 +CPU= 36.945
  21:45:48 STEP 1064 H= 266:00 +CPU= 38.737
  21:46:27 STEP 1065 H= 266:15 +CPU= 38.304
  21:47:06 STEP 1066 H= 266:30 +CPU= 38.542
  21:47:44 STEP 1067 H= 266:45 +CPU= 37.943
  21:48:32 STEP 1068 H= 267:00 +CPU= 47.325
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001068
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001068
  21:49:10 STEP 1069 H= 267:15 +CPU= 38.201
  21:49:47 STEP 1070 H= 267:30 +CPU= 36.884
  21:50:26 STEP 1071 H= 267:45 +CPU= 38.412
  21:51:05 STEP 1072 H= 268:00 +CPU= 38.671
  21:51:44 STEP 1073 H= 268:15 +CPU= 38.853
  21:52:23 STEP 1074 H= 268:30 +CPU= 38.895
  21:53:02 STEP 1075 H= 268:45 +CPU= 38.338
  21:53:41 STEP 1076 H= 269:00 +CPU= 38.409
  21:54:16 STEP 1077 H= 269:15 +CPU= 35.400
  21:54:55 STEP 1078 H= 269:30 +CPU= 37.984
  21:55:34 STEP 1079 H= 269:45 +CPU= 38.637
  21:56:21 STEP 1080 H= 270:00 +CPU= 46.810
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001080
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001080
  21:57:00 STEP 1081 H= 270:15 +CPU= 39.312
  21:57:38 STEP 1082 H= 270:30 +CPU= 37.596
  21:58:17 STEP 1083 H= 270:45 +CPU= 38.209
  21:58:55 STEP 1084 H= 271:00 +CPU= 37.489
  21:59:32 STEP 1085 H= 271:15 +CPU= 36.979
  22:00:10 STEP 1086 H= 271:30 +CPU= 37.615
  22:00:48 STEP 1087 H= 271:45 +CPU= 38.130
  22:01:27 STEP 1088 H= 272:00 +CPU= 38.838
  22:02:06 STEP 1089 H= 272:15 +CPU= 38.074
  22:02:44 STEP 1090 H= 272:30 +CPU= 37.661
  22:03:21 STEP 1091 H= 272:45 +CPU= 36.851
  22:04:05 STEP 1092 H= 273:00 +CPU= 44.105
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001092
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001092
  22:04:44 STEP 1093 H= 273:15 +CPU= 38.151
  22:05:23 STEP 1094 H= 273:30 +CPU= 39.001
  22:06:02 STEP 1095 H= 273:45 +CPU= 38.247
  22:06:41 STEP 1096 H= 274:00 +CPU= 38.687
  22:07:19 STEP 1097 H= 274:15 +CPU= 37.749
  22:07:58 STEP 1098 H= 274:30 +CPU= 39.030
  22:08:35 STEP 1099 H= 274:45 +CPU= 36.418
  22:09:11 STEP 1100 H= 275:00 +CPU= 36.556
  22:09:50 STEP 1101 H= 275:15 +CPU= 38.128
  22:10:28 STEP 1102 H= 275:30 +CPU= 37.494
  22:11:06 STEP 1103 H= 275:45 +CPU= 37.578
  22:11:59 STEP 1104 H= 276:00 +CPU= 52.868
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001104
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001104
  22:12:37 STEP 1105 H= 276:15 +CPU= 38.125
  22:13:16 STEP 1106 H= 276:30 +CPU= 38.548
  22:13:53 STEP 1107 H= 276:45 +CPU= 36.376
  22:14:32 STEP 1108 H= 277:00 +CPU= 39.220
  22:15:10 STEP 1109 H= 277:15 +CPU= 37.740
  22:15:49 STEP 1110 H= 277:30 +CPU= 38.041
  22:16:27 STEP 1111 H= 277:45 +CPU= 38.081
  22:17:06 STEP 1112 H= 278:00 +CPU= 38.807
  22:17:45 STEP 1113 H= 278:15 +CPU= 38.878
  22:18:21 STEP 1114 H= 278:30 +CPU= 35.666
  22:19:00 STEP 1115 H= 278:45 +CPU= 38.175
  22:19:46 STEP 1116 H= 279:00 +CPU= 45.867
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001116
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001116
  22:20:25 STEP 1117 H= 279:15 +CPU= 38.484
  22:21:03 STEP 1118 H= 279:30 +CPU= 38.234
  22:21:42 STEP 1119 H= 279:45 +CPU= 38.718
  22:22:20 STEP 1120 H= 280:00 +CPU= 38.174
  22:22:57 STEP 1121 H= 280:15 +CPU= 36.173
  22:23:35 STEP 1122 H= 280:30 +CPU= 37.666
  22:24:13 STEP 1123 H= 280:45 +CPU= 37.736
  22:24:52 STEP 1124 H= 281:00 +CPU= 38.466
  22:25:30 STEP 1125 H= 281:15 +CPU= 38.424
  22:26:09 STEP 1126 H= 281:30 +CPU= 38.657
  22:26:48 STEP 1127 H= 281:45 +CPU= 38.525
  22:27:35 STEP 1128 H= 282:00 +CPU= 46.769
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001128
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001128
  22:28:14 STEP 1129 H= 282:15 +CPU= 38.684
  22:28:53 STEP 1130 H= 282:30 +CPU= 38.507
  22:29:32 STEP 1131 H= 282:45 +CPU= 38.648
  22:30:11 STEP 1132 H= 283:00 +CPU= 38.813
  22:30:49 STEP 1133 H= 283:15 +CPU= 37.451
  22:31:27 STEP 1134 H= 283:30 +CPU= 37.600
  22:32:04 STEP 1135 H= 283:45 +CPU= 36.814
  22:32:44 STEP 1136 H= 284:00 +CPU= 39.957
  22:33:23 STEP 1137 H= 284:15 +CPU= 38.370
  22:34:00 STEP 1138 H= 284:30 +CPU= 37.177
  22:34:38 STEP 1139 H= 284:45 +CPU= 37.793
  22:35:26 STEP 1140 H= 285:00 +CPU= 47.720
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001140
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001140
  22:36:04 STEP 1141 H= 285:15 +CPU= 38.057
  22:36:42 STEP 1142 H= 285:30 +CPU= 37.056
  22:37:20 STEP 1143 H= 285:45 +CPU= 38.076
  22:38:00 STEP 1144 H= 286:00 +CPU= 39.444
  22:38:39 STEP 1145 H= 286:15 +CPU= 38.713
  22:39:18 STEP 1146 H= 286:30 +CPU= 38.419
  22:39:57 STEP 1147 H= 286:45 +CPU= 39.240
  22:40:36 STEP 1148 H= 287:00 +CPU= 39.144
  22:41:15 STEP 1149 H= 287:15 +CPU= 38.140
  22:41:52 STEP 1150 H= 287:30 +CPU= 37.329
  22:42:31 STEP 1151 H= 287:45 +CPU= 38.371
  22:43:23 STEP 1152 H= 288:00 +CPU= 51.575
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001152
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001068
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001080
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001092
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001104
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001116
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001128
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001140
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001140
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3gj_2016092300_15_991_12211270_0_r487705645_11.zip
Uploading the intermediate file: upload_file_11.zip
  22:44:03 STEP 1153 H= 288:15 +CPU= 39.600
  22:44:41 STEP 1154 H= 288:30 +CPU= 38.126
  22:45:20 STEP 1155 H= 288:45 +CPU= 38.638
  22:46:00 STEP 1156 H= 289:00 +CPU= 39.222
  22:46:37 STEP 1157 H= 289:15 +CPU= 37.147
  22:47:16 STEP 1158 H= 289:30 +CPU= 38.640
  22:47:55 STEP 1159 H= 289:45 +CPU= 38.112
  22:48:34 STEP 1160 H= 290:00 +CPU= 39.416
  22:49:13 STEP 1161 H= 290:15 +CPU= 38.380
  22:49:52 STEP 1162 H= 290:30 +CPU= 38.678
  22:50:30 STEP 1163 H= 290:45 +CPU= 37.533
  22:51:17 STEP 1164 H= 291:00 +CPU= 46.356
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001164
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001164
  22:51:56 STEP 1165 H= 291:15 +CPU= 38.830
  22:52:35 STEP 1166 H= 291:30 +CPU= 38.576
  22:53:13 STEP 1167 H= 291:45 +CPU= 37.643
  22:53:52 STEP 1168 H= 292:00 +CPU= 38.594
  22:54:31 STEP 1169 H= 292:15 +CPU= 38.419
  22:55:09 STEP 1170 H= 292:30 +CPU= 37.879
  22:55:47 STEP 1171 H= 292:45 +CPU= 37.607
  22:56:26 STEP 1172 H= 293:00 +CPU= 38.768
  22:57:04 STEP 1173 H= 293:15 +CPU= 37.794
  22:57:42 STEP 1174 H= 293:30 +CPU= 37.677
  22:58:21 STEP 1175 H= 293:45 +CPU= 37.909
  22:59:07 STEP 1176 H= 294:00 +CPU= 45.725
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001176
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001176
  22:59:45 STEP 1177 H= 294:15 +CPU= 38.101
  23:00:24 STEP 1178 H= 294:30 +CPU= 38.556
  23:01:04 STEP 1179 H= 294:45 +CPU= 38.907
  23:01:43 STEP 1180 H= 295:00 +CPU= 39.046
  23:02:23 STEP 1181 H= 295:15 +CPU= 39.562
  23:03:02 STEP 1182 H= 295:30 +CPU= 38.050
  23:03:41 STEP 1183 H= 295:45 +CPU= 38.326
  23:04:20 STEP 1184 H= 296:00 +CPU= 38.959
  23:04:58 STEP 1185 H= 296:15 +CPU= 38.152
  23:05:36 STEP 1186 H= 296:30 +CPU= 37.422
  23:06:15 STEP 1187 H= 296:45 +CPU= 38.233
  23:07:02 STEP 1188 H= 297:00 +CPU= 46.715
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001188
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001188
  23:07:42 STEP 1189 H= 297:15 +CPU= 39.153
  23:08:21 STEP 1190 H= 297:30 +CPU= 38.695
  23:09:01 STEP 1191 H= 297:45 +CPU= 39.265
  23:09:41 STEP 1192 H= 298:00 +CPU= 39.653
  23:10:21 STEP 1193 H= 298:15 +CPU= 39.841
  23:11:01 STEP 1194 H= 298:30 +CPU= 39.973
  23:11:41 STEP 1195 H= 298:45 +CPU= 39.547
  23:12:22 STEP 1196 H= 299:00 +CPU= 40.409
  23:13:00 STEP 1197 H= 299:15 +CPU= 37.768
  23:13:40 STEP 1198 H= 299:30 +CPU= 38.808
  23:14:19 STEP 1199 H= 299:45 +CPU= 39.389
  23:15:14 STEP 1200 H= 300:00 +CPU= 54.393
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001200
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001200
  23:15:55 STEP 1201 H= 300:15 +CPU= 40.239
  23:16:36 STEP 1202 H= 300:30 +CPU= 40.039
  23:17:15 STEP 1203 H= 300:45 +CPU= 39.294
  23:17:55 STEP 1204 H= 301:00 +CPU= 39.040
  23:18:34 STEP 1205 H= 301:15 +CPU= 38.828
  23:19:15 STEP 1206 H= 301:30 +CPU= 40.405
  23:19:55 STEP 1207 H= 301:45 +CPU= 40.124
  23:20:36 STEP 1208 H= 302:00 +CPU= 40.404
  23:21:17 STEP 1209 H= 302:15 +CPU= 40.166
  23:21:57 STEP 1210 H= 302:30 +CPU= 40.028
  23:22:37 STEP 1211 H= 302:45 +CPU= 39.154
  23:23:25 STEP 1212 H= 303:00 +CPU= 47.513
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001212
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001212
  23:24:04 STEP 1213 H= 303:15 +CPU= 39.469
  23:24:44 STEP 1214 H= 303:30 +CPU= 39.238
  23:25:25 STEP 1215 H= 303:45 +CPU= 40.372
  23:26:05 STEP 1216 H= 304:00 +CPU= 39.672
  23:26:45 STEP 1217 H= 304:15 +CPU= 39.763
  23:27:24 STEP 1218 H= 304:30 +CPU= 38.445
  23:28:03 STEP 1219 H= 304:45 +CPU= 38.099
  23:28:44 STEP 1220 H= 305:00 +CPU= 41.130
  23:29:24 STEP 1221 H= 305:15 +CPU= 40.037
  23:30:04 STEP 1222 H= 305:30 +CPU= 38.861
  23:30:44 STEP 1223 H= 305:45 +CPU= 39.555
  23:31:32 STEP 1224 H= 306:00 +CPU= 48.387
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001224
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001224
  23:32:14 STEP 1225 H= 306:15 +CPU= 40.688
  23:32:52 STEP 1226 H= 306:30 +CPU= 38.290
  23:33:31 STEP 1227 H= 306:45 +CPU= 38.542
  23:34:12 STEP 1228 H= 307:00 +CPU= 40.794
  23:34:52 STEP 1229 H= 307:15 +CPU= 39.639
  23:35:32 STEP 1230 H= 307:30 +CPU= 39.518
  23:36:13 STEP 1231 H= 307:45 +CPU= 39.711
  23:36:53 STEP 1232 H= 308:00 +CPU= 40.169
  23:37:33 STEP 1233 H= 308:15 +CPU= 39.609
  23:38:11 STEP 1234 H= 308:30 +CPU= 37.591
  23:38:50 STEP 1235 H= 308:45 +CPU= 38.937
  23:39:38 STEP 1236 H= 309:00 +CPU= 47.046
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001236
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001236
  23:40:18 STEP 1237 H= 309:15 +CPU= 39.508
  23:40:58 STEP 1238 H= 309:30 +CPU= 39.567
  23:41:37 STEP 1239 H= 309:45 +CPU= 39.144
  23:42:17 STEP 1240 H= 310:00 +CPU= 39.882
  23:42:58 STEP 1241 H= 310:15 +CPU= 39.720
  23:43:37 STEP 1242 H= 310:30 +CPU= 38.927
  23:44:16 STEP 1243 H= 310:45 +CPU= 39.141
  23:44:57 STEP 1244 H= 311:00 +CPU= 39.821
  23:45:37 STEP 1245 H= 311:15 +CPU= 39.896
  23:46:17 STEP 1246 H= 311:30 +CPU= 39.698
  23:46:58 STEP 1247 H= 311:45 +CPU= 40.253
  23:47:49 STEP 1248 H= 312:00 +CPU= 51.260
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001248
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001152
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001164
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001176
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001188
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001200
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001212
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001224
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001236
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001236
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3gj_2016092300_15_991_12211270_0_r487705645_12.zip
Uploading the intermediate file: upload_file_12.zip
  23:48:28 STEP 1249 H= 312:15 +CPU= 38.521
  23:49:09 STEP 1250 H= 312:30 +CPU= 39.770
  23:49:49 STEP 1251 H= 312:45 +CPU= 40.178
  23:50:30 STEP 1252 H= 313:00 +CPU= 40.405
  23:51:11 STEP 1253 H= 313:15 +CPU= 40.851
  23:51:52 STEP 1254 H= 313:30 +CPU= 40.911
  23:52:34 STEP 1255 H= 313:45 +CPU= 40.929
  23:53:13 STEP 1256 H= 314:00 +CPU= 38.666
  23:53:53 STEP 1257 H= 314:15 +CPU= 39.773
  23:54:34 STEP 1258 H= 314:30 +CPU= 40.646
  23:55:15 STEP 1259 H= 314:45 +CPU= 40.740
  23:56:04 STEP 1260 H= 315:00 +CPU= 48.014
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001260
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001260
  23:56:44 STEP 1261 H= 315:15 +CPU= 40.220
  23:57:26 STEP 1262 H= 315:30 +CPU= 40.829
  23:58:06 STEP 1263 H= 315:45 +CPU= 40.469
  23:58:47 STEP 1264 H= 316:00 +CPU= 40.194
  23:59:27 STEP 1265 H= 316:15 +CPU= 39.945
  00:00:08 STEP 1266 H= 316:30 +CPU= 40.345
  00:00:47 STEP 1267 H= 316:45 +CPU= 38.931
  00:01:28 STEP 1268 H= 317:00 +CPU= 40.098
  00:02:09 STEP 1269 H= 317:15 +CPU= 41.169
  00:02:51 STEP 1270 H= 317:30 +CPU= 40.808
  00:03:32 STEP 1271 H= 317:45 +CPU= 41.304
  00:04:23 STEP 1272 H= 318:00 +CPU= 50.209
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001272
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001272
  00:05:05 STEP 1273 H= 318:15 +CPU= 41.352
  00:05:45 STEP 1274 H= 318:30 +CPU= 39.483
  00:06:25 STEP 1275 H= 318:45 +CPU= 39.698
  00:07:08 STEP 1276 H= 319:00 +CPU= 42.536
  00:07:49 STEP 1277 H= 319:15 +CPU= 40.318
  00:08:30 STEP 1278 H= 319:30 +CPU= 41.425
  00:09:12 STEP 1279 H= 319:45 +CPU= 40.781
  00:09:54 STEP 1280 H= 320:00 +CPU= 42.302
  00:10:37 STEP 1281 H= 320:15 +CPU= 42.277
  00:11:17 STEP 1282 H= 320:30 +CPU= 39.728
  00:11:57 STEP 1283 H= 320:45 +CPU= 39.641
  00:12:50 STEP 1284 H= 321:00 +CPU= 52.491
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001284
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001284
  00:13:34 STEP 1285 H= 321:15 +CPU= 42.780
  00:14:16 STEP 1286 H= 321:30 +CPU= 42.525
  00:15:00 STEP 1287 H= 321:45 +CPU= 42.906
  00:15:44 STEP 1288 H= 322:00 +CPU= 43.890
  00:16:25 STEP 1289 H= 322:15 +CPU= 40.719
  00:17:06 STEP 1290 H= 322:30 +CPU= 40.109
  00:17:48 STEP 1291 H= 322:45 +CPU= 41.454
  00:18:31 STEP 1292 H= 323:00 +CPU= 43.325
  00:19:15 STEP 1293 H= 323:15 +CPU= 42.661
  00:19:57 STEP 1294 H= 323:30 +CPU= 41.568
  00:20:39 STEP 1295 H= 323:45 +CPU= 42.513
  00:21:39 STEP 1296 H= 324:00 +CPU= 58.619
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001296
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001296
  00:22:20 STEP 1297 H= 324:15 +CPU= 40.695
  00:23:02 STEP 1298 H= 324:30 +CPU= 41.891
  00:23:46 STEP 1299 H= 324:45 +CPU= 43.122
  00:24:29 STEP 1300 H= 325:00 +CPU= 43.457
  00:25:12 STEP 1301 H= 325:15 +CPU= 42.524
  00:25:55 STEP 1302 H= 325:30 +CPU= 42.160
  00:26:38 STEP 1303 H= 325:45 +CPU= 42.296
  00:27:21 STEP 1304 H= 326:00 +CPU= 42.653
  00:28:01 STEP 1305 H= 326:15 +CPU= 39.953
  00:28:43 STEP 1306 H= 326:30 +CPU= 41.277
  00:29:27 STEP 1307 H= 326:45 +CPU= 43.428
  00:30:19 STEP 1308 H= 327:00 +CPU= 51.713
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001308
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001308
  00:31:03 STEP 1309 H= 327:15 +CPU= 43.437
  00:31:47 STEP 1310 H= 327:30 +CPU= 43.355
  00:32:30 STEP 1311 H= 327:45 +CPU= 43.593
  00:33:12 STEP 1312 H= 328:00 +CPU= 41.080
  00:33:52 STEP 1313 H= 328:15 +CPU= 39.974
  00:34:35 STEP 1314 H= 328:30 +CPU= 42.623
  00:35:19 STEP 1315 H= 328:45 +CPU= 43.153
  00:36:02 STEP 1316 H= 329:00 +CPU= 42.710
  00:36:45 STEP 1317 H= 329:15 +CPU= 43.013
  00:37:28 STEP 1318 H= 329:30 +CPU= 42.171
  00:38:11 STEP 1319 H= 329:45 +CPU= 42.534
  00:39:01 STEP 1320 H= 330:00 +CPU= 49.329
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001320
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001320
  00:39:41 STEP 1321 H= 330:15 +CPU= 39.684
  00:40:20 STEP 1322 H= 330:30 +CPU= 39.176
  00:41:01 STEP 1323 H= 330:45 +CPU= 39.820
  00:41:42 STEP 1324 H= 331:00 +CPU= 40.650
  00:42:22 STEP 1325 H= 331:15 +CPU= 39.520
  00:43:02 STEP 1326 H= 331:30 +CPU= 39.805
  00:43:44 STEP 1327 H= 331:45 +CPU= 41.538
  00:44:26 STEP 1328 H= 332:00 +CPU= 41.795
  00:45:09 STEP 1329 H= 332:15 +CPU= 42.729
  00:45:53 STEP 1330 H= 332:30 +CPU= 43.280
  00:46:38 STEP 1331 H= 332:45 +CPU= 43.933
  00:47:31 STEP 1332 H= 333:00 +CPU= 52.694
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001332
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001332
  00:48:15 STEP 1333 H= 333:15 +CPU= 43.814
  00:48:59 STEP 1334 H= 333:30 +CPU= 42.991
  00:49:42 STEP 1335 H= 333:45 +CPU= 42.969
  00:50:25 STEP 1336 H= 334:00 +CPU= 42.726
  00:51:09 STEP 1337 H= 334:15 +CPU= 42.939
  00:51:52 STEP 1338 H= 334:30 +CPU= 42.546
  00:52:36 STEP 1339 H= 334:45 +CPU= 43.599
  00:53:20 STEP 1340 H= 335:00 +CPU= 44.020
  00:54:03 STEP 1341 H= 335:15 +CPU= 42.615
  00:54:47 STEP 1342 H= 335:30 +CPU= 43.549
  00:55:30 STEP 1343 H= 335:45 +CPU= 42.539
  00:56:29 STEP 1344 H= 336:00 +CPU= 58.183
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001344
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001248
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001260
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001272
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001284
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001296
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001308
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001320
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001332
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001332
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3gj_2016092300_15_991_12211270_0_r487705645_13.zip
Uploading the intermediate file: upload_file_13.zip
  00:57:13 STEP 1345 H= 336:15 +CPU= 43.782
  00:57:58 STEP 1346 H= 336:30 +CPU= 43.993
  00:58:42 STEP 1347 H= 336:45 +CPU= 43.825
  00:59:27 STEP 1348 H= 337:00 +CPU= 44.244
  01:00:10 STEP 1349 H= 337:15 +CPU= 43.015
  01:00:54 STEP 1350 H= 337:30 +CPU= 43.168
  01:01:36 STEP 1351 H= 337:45 +CPU= 41.673
  01:02:16 STEP 1352 H= 338:00 +CPU= 40.206
  01:02:56 STEP 1353 H= 338:15 +CPU= 39.268
  01:03:34 STEP 1354 H= 338:30 +CPU= 37.704
  01:04:11 STEP 1355 H= 338:45 +CPU= 36.401
  01:04:55 STEP 1356 H= 339:00 +CPU= 43.971
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001356
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001356
  01:05:34 STEP 1357 H= 339:15 +CPU= 38.390
  01:06:13 STEP 1358 H= 339:30 +CPU= 38.990
  01:06:52 STEP 1359 H= 339:45 +CPU= 38.580
  01:07:36 STEP 1360 H= 340:00 +CPU= 43.133
  01:08:20 STEP 1361 H= 340:15 +CPU= 44.028
  01:09:04 STEP 1362 H= 340:30 +CPU= 43.454
  01:09:48 STEP 1363 H= 340:45 +CPU= 42.826
  01:10:33 STEP 1364 H= 341:00 +CPU= 45.141
  01:11:18 STEP 1365 H= 341:15 +CPU= 44.740
  01:12:03 STEP 1366 H= 341:30 +CPU= 44.617
  01:12:48 STEP 1367 H= 341:45 +CPU= 44.535
  01:13:42 STEP 1368 H= 342:00 +CPU= 53.739
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001368
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001368
  01:14:26 STEP 1369 H= 342:15 +CPU= 43.064
  01:15:11 STEP 1370 H= 342:30 +CPU= 44.573
  01:15:56 STEP 1371 H= 342:45 +CPU= 44.925
  01:16:41 STEP 1372 H= 343:00 +CPU= 44.832
  01:17:26 STEP 1373 H= 343:15 +CPU= 44.153
  01:18:10 STEP 1374 H= 343:30 +CPU= 43.932
  01:18:56 STEP 1375 H= 343:45 +CPU= 46.141
  01:19:42 STEP 1376 H= 344:00 +CPU= 44.976
  01:20:27 STEP 1377 H= 344:15 +CPU= 44.875
  01:21:11 STEP 1378 H= 344:30 +CPU= 43.642
  01:21:57 STEP 1379 H= 344:45 +CPU= 45.350
  01:22:51 STEP 1380 H= 345:00 +CPU= 53.615
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001380
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001380
  01:23:35 STEP 1381 H= 345:15 +CPU= 43.486
  01:24:19 STEP 1382 H= 345:30 +CPU= 43.899
  01:25:05 STEP 1383 H= 345:45 +CPU= 45.103
  01:25:50 STEP 1384 H= 346:00 +CPU= 45.526
  01:26:36 STEP 1385 H= 346:15 +CPU= 44.751
  01:27:21 STEP 1386 H= 346:30 +CPU= 45.026
  01:28:06 STEP 1387 H= 346:45 +CPU= 44.204
  01:28:51 STEP 1388 H= 347:00 +CPU= 45.484
  01:29:36 STEP 1389 H= 347:15 +CPU= 44.623
  01:30:22 STEP 1390 H= 347:30 +CPU= 45.666
  01:31:08 STEP 1391 H= 347:45 +CPU= 45.407
  01:32:10 STEP 1392 H= 348:00 +CPU= 61.317
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001392
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001392
  01:32:56 STEP 1393 H= 348:15 +CPU= 45.795
  01:33:42 STEP 1394 H= 348:30 +CPU= 45.425
  01:34:28 STEP 1395 H= 348:45 +CPU= 45.175
  01:35:13 STEP 1396 H= 349:00 +CPU= 45.255
  01:36:00 STEP 1397 H= 349:15 +CPU= 46.181
  01:36:45 STEP 1398 H= 349:30 +CPU= 45.075
  01:37:31 STEP 1399 H= 349:45 +CPU= 44.940
  01:38:17 STEP 1400 H= 350:00 +CPU= 46.211
  01:39:03 STEP 1401 H= 350:15 +CPU= 45.604
  01:39:48 STEP 1402 H= 350:30 +CPU= 44.445
  01:40:33 STEP 1403 H= 350:45 +CPU= 44.082
  01:41:28 STEP 1404 H= 351:00 +CPU= 54.857
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001404
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001404
  01:42:15 STEP 1405 H= 351:15 +CPU= 46.468
  01:43:01 STEP 1406 H= 351:30 +CPU= 46.306
  01:43:49 STEP 1407 H= 351:45 +CPU= 46.930
  01:44:36 STEP 1408 H= 352:00 +CPU= 46.289
  01:45:23 STEP 1409 H= 352:15 +CPU= 46.937
  01:46:08 STEP 1410 H= 352:30 +CPU= 45.080
  01:46:54 STEP 1411 H= 352:45 +CPU= 45.074
  01:47:41 STEP 1412 H= 353:00 +CPU= 47.327
  01:48:28 STEP 1413 H= 353:15 +CPU= 45.990
  01:49:14 STEP 1414 H= 353:30 +CPU= 46.161
  01:49:57 STEP 1415 H= 353:45 +CPU= 41.897
  01:50:48 STEP 1416 H= 354:00 +CPU= 51.412
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001416
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001416
  01:51:28 STEP 1417 H= 354:15 +CPU= 39.770
  01:52:10 STEP 1418 H= 354:30 +CPU= 41.014
  01:52:54 STEP 1419 H= 354:45 +CPU= 44.063
  01:53:40 STEP 1420 H= 355:00 +CPU= 45.671
  01:54:26 STEP 1421 H= 355:15 +CPU= 45.440
  01:55:13 STEP 1422 H= 355:30 +CPU= 46.331
  01:56:00 STEP 1423 H= 355:45 +CPU= 46.714
  01:56:45 STEP 1424 H= 356:00 +CPU= 45.009
  01:57:31 STEP 1425 H= 356:15 +CPU= 45.279
  01:58:17 STEP 1426 H= 356:30 +CPU= 46.113
  01:59:02 STEP 1427 H= 356:45 +CPU= 44.147
  01:59:58 STEP 1428 H= 357:00 +CPU= 55.147
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001428
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001428
  02:00:44 STEP 1429 H= 357:15 +CPU= 46.191
  02:01:30 STEP 1430 H= 357:30 +CPU= 45.580
  02:02:18 STEP 1431 H= 357:45 +CPU= 47.817
  02:03:04 STEP 1432 H= 358:00 +CPU= 45.599
  02:03:50 STEP 1433 H= 358:15 +CPU= 45.679
  02:04:37 STEP 1434 H= 358:30 +CPU= 46.183
  02:05:25 STEP 1435 H= 358:45 +CPU= 47.496
  02:06:12 STEP 1436 H= 359:00 +CPU= 47.059
  02:06:58 STEP 1437 H= 359:15 +CPU= 45.402
  02:07:43 STEP 1438 H= 359:30 +CPU= 44.310
  02:08:30 STEP 1439 H= 359:45 +CPU= 46.837
  02:09:26 STEP 1440 H= 360:00 +CPU= 55.106
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.1040623515E-20      I       0.3166925655E-06      I
ICloud fractionI      0.0000000000E+00      I       0.5051509040E-02      I
I  Relat. Hum. I      0.2797197883E+00      I       0.3120466610E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.9651640468E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    313500145 BYTES IN      7 RECORDS TRANSFERRED IN    0.0008 SECONDS391875.2 Mbytes/s, TOTAL TIME=    0.0186( 4.3%)
 02:09:26 STEP 1440 H= 360:00 +CPU= 55.106
 END CNT3
 NSTEP =  1440 CNT0   000000000  40.238  40.238  40.486   0.994               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           34/  1069125708 WRITTEN        15598/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1    278    0       34      1044068    15598 ************    49.7     4.0    45.7     7.1    90.9
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 ********* *********    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 ********* *********     99.95      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  573    8755.4    8755.4     22.99      0.00
   9 SPCM     - SPECTRAL COMP.                     528    2187.8    2187.8      5.29      0.00
  10 SCAN2M - PHYSICS                              529   16270.7   16270.7     39.45      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                 44    1668.7    1668.7      0.34      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                 23     119.5     119.5      0.01      0.00
  17 GRIDFPOS IN CNT4                               44      44.3      44.3      0.01      0.00
  27 RESTART FILES - WRITING                        11    6674.8    6674.8      0.34      0.00
  28 RESTART FILES - READING                         1    9613.5    9613.5      0.04      0.00
  29 SU4FPOS IN CNT4                                44       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                44    7288.2    7288.2      1.47      0.00
  31 POSDDH IN STEPO                                 3       3.0       3.0      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                    529    7646.9    7646.9     18.54      0.00
  39 SU0YOMB                                         1     550.2     550.2      0.00      0.00
  51 SCAN2M   - SL COMM. PART 1                    529      56.3      56.3      0.14      0.00
  54 SPCM     - M TO S/S TO M TRANSP.              528    1148.3    1148.3      2.78      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.              528     127.8     127.8      0.31      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                 23       0.9       0.9      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM     1148     489.5     489.5      2.58      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM      1100     274.2     274.2      1.38      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM       1100     134.3     134.3      0.68      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM      1148     188.7     188.7      0.99      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      42.1      42.1      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION           1148     135.3     135.3      0.71      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION           1100      88.0      88.0      0.44      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION           1148     214.4     214.4      1.13      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION           1100     105.2     105.2      0.53      0.00
 400 GSTATS                                      61989       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 57623       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME    21817.5 CPU TIME   21627.5 VECTOR TIME    21627.5


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY       59.4
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHh7zg+001440
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/slots/39/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/39/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001344
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001404
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001356
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001416
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001380
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001428
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001392
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMGGh7zg+001440
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMSHh7zg+001368
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12211270/ICMUAh7zg+001416
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3gj_2016092300_15_991_12211270_0_r487705645_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
02:12:55 (10975): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 May 2023 16:54:31 1522441 22311507 oifs_43r3_bl_a3gj_2016092300_15_991_12211270_0 1,295,100 41,868 0.0323


©2024 climateprediction.net