climateprediction.net home page
Task 22313065

Task 22313065

Name oifs_43r3_bl_a4mo_2016092300_15_991_12212787_0
Workunit 12212787
Created 13 Feb 2023, 23:02:59 UTC
Sent 13 Feb 2023, 23:05:11 UTC
Report deadline 14 Apr 2023, 23:05:11 UTC
Received 24 Feb 2023, 11:13:04 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1534084
Run time 38 min 57 sec
CPU time 35 min 6 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 3.15 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 4,980.34 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,291.21 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4mo
(argv4) batchid: 991
(argv5) wuid: 12212787
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/0
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12212787
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/0/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/0/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_cddb9bb7cb6473c9bbf63e4a0fd3adc4 to: /var/lib/boinc-client/slots/0/oifs_43r3_bl_a4mo_2016092300_15_991_12212787.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/0/oifs_43r3_bl_a4mo_2016092300_15_991_12212787.zip
ic_ancil_file: ic_ancil_12212787
ifsdata_file: ifsdata_12212787
climate_data_file: clim_data_12212787
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/0/ic_ancil_12212787.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/0/ic_ancil_12212787.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_2eb6ed3534167c3ebdda49c0115a493c to: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12212787.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/0/ifsdata/ifsdata_12212787.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/0/159l_2/clim_data_12212787.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/0/159l_2/clim_data_12212787.zip
Checking for progress XML file: /var/lib/boinc-client/slots/0/progress_file_12212787.xml
Creating progress file: /var/lib/boinc-client/slots/0/progress_file_12212787.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a4mo_2016092300_15_991_12212787_0_r1604608404
The child process has been launched with process id: 10058
Executing the command: /var/lib/boinc-client/slots/0/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:boinc-climate:1:1:10058:10058] [20230224:093730:1677231450:0.000] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  09:37:54 STEP    0 H=   0:00 +CPU= 21.353
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000000
  09:38:12 STEP    1 H=   0:15 +CPU= 17.678
  09:38:32 STEP    2 H=   0:30 +CPU= 18.763
  09:38:50 STEP    3 H=   0:45 +CPU= 17.957
  09:39:09 STEP    4 H=   1:00 +CPU= 18.788
  09:39:29 STEP    5 H=   1:15 +CPU= 19.955
  09:39:50 STEP    6 H=   1:30 +CPU= 20.642
  09:40:11 STEP    7 H=   1:45 +CPU= 21.343
  09:40:40 STEP    8 H=   2:00 +CPU= 27.121
  09:41:11 STEP    9 H=   2:15 +CPU= 28.917
  09:41:44 STEP   10 H=   2:30 +CPU= 30.082
  09:42:14 STEP   11 H=   2:45 +CPU= 28.719
  09:42:53 STEP   12 H=   3:00 +CPU= 36.430
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000012
  09:43:24 STEP   13 H=   3:15 +CPU= 28.849
  09:43:53 STEP   14 H=   3:30 +CPU= 28.910
  09:44:21 STEP   15 H=   3:45 +CPU= 27.424
  09:44:53 STEP   16 H=   4:00 +CPU= 29.847
  09:45:24 STEP   17 H=   4:15 +CPU= 29.533
  09:46:02 STEP   18 H=   4:30 +CPU= 35.488
  09:46:34 STEP   19 H=   4:45 +CPU= 29.949
  09:47:05 STEP   20 H=   5:00 +CPU= 29.789
  09:47:35 STEP   21 H=   5:15 +CPU= 29.183
  09:48:08 STEP   22 H=   5:30 +CPU= 29.539
  09:48:41 STEP   23 H=   5:45 +CPU= 30.155
  09:49:18 STEP   24 H=   6:00 +CPU= 35.473
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000024
  09:49:46 STEP   25 H=   6:15 +CPU= 27.359
  09:50:28 STEP   26 H=   6:30 +CPU= 28.717
  09:51:01 STEP   27 H=   6:45 +CPU= 29.272
  09:51:36 STEP   28 H=   7:00 +CPU= 31.460
  09:52:10 STEP   29 H=   7:15 +CPU= 28.189
  09:52:45 STEP   30 H=   7:30 +CPU= 33.257
  09:53:17 STEP   31 H=   7:45 +CPU= 29.472
  09:53:47 STEP   32 H=   8:00 +CPU= 28.955
  09:54:17 STEP   33 H=   8:15 +CPU= 28.154
  09:54:47 STEP   34 H=   8:30 +CPU= 28.025
  09:55:19 STEP   35 H=   8:45 +CPU= 27.443
  09:56:04 STEP   36 H=   9:00 +CPU= 40.381
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000036
  09:56:36 STEP   37 H=   9:15 +CPU= 29.774
  09:57:08 STEP   38 H=   9:30 +CPU= 29.155
  09:57:47 STEP   39 H=   9:45 +CPU= 29.080
  09:58:26 STEP   40 H=  10:00 +CPU= 30.304
  09:58:58 STEP   41 H=  10:15 +CPU= 29.894
  09:59:31 STEP   42 H=  10:30 +CPU= 29.883
  10:00:06 STEP   43 H=  10:45 +CPU= 30.274
  10:00:39 STEP   44 H=  11:00 +CPU= 30.628
  10:01:12 STEP   45 H=  11:15 +CPU= 30.075
  10:01:40 STEP   46 H=  11:30 +CPU= 27.528
  10:02:07 STEP   47 H=  11:45 +CPU= 26.664
  10:02:48 STEP   48 H=  12:00 +CPU= 38.551
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000048
  10:03:17 STEP   49 H=  12:15 +CPU= 27.708
  10:03:46 STEP   50 H=  12:30 +CPU= 27.844
  10:04:16 STEP   51 H=  12:45 +CPU= 28.351
  10:04:48 STEP   52 H=  13:00 +CPU= 29.242
  10:05:20 STEP   53 H=  13:15 +CPU= 29.527
  10:05:51 STEP   54 H=  13:30 +CPU= 29.071
  10:06:21 STEP   55 H=  13:45 +CPU= 27.801
  10:06:52 STEP   56 H=  14:00 +CPU= 29.133
  10:07:22 STEP   57 H=  14:15 +CPU= 28.541
  10:07:52 STEP   58 H=  14:30 +CPU= 28.292
  10:08:21 STEP   59 H=  14:45 +CPU= 27.673
  10:08:55 STEP   60 H=  15:00 +CPU= 33.648
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000060
  10:09:24 STEP   61 H=  15:15 +CPU= 27.398
  10:09:54 STEP   62 H=  15:30 +CPU= 27.673
  10:10:24 STEP   63 H=  15:45 +CPU= 28.149
  10:10:53 STEP   64 H=  16:00 +CPU= 28.294
  10:11:21 STEP   65 H=  16:15 +CPU= 27.326
  10:11:51 STEP   66 H=  16:30 +CPU= 28.622
  10:12:21 STEP   67 H=  16:45 +CPU= 29.084
  10:12:51 STEP   68 H=  17:00 +CPU= 29.153
  10:13:20 STEP   69 H=  17:15 +CPU= 28.686
  10:13:53 STEP   70 H=  17:30 +CPU= 29.860
  10:14:26 STEP   71 H=  17:45 +CPU= 29.612
  10:15:05 STEP   72 H=  18:00 +CPU= 35.959
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMGGh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMSHh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/0/ICMUAh7zg+000072
..The child process has been killed with signal: 9
>>> Printing last 70 lines from file: NODE.001_01

 SPECTRAL NORMS -   LOG(PREHYDS)    0.115129254488412E+02
 LEV     VORTICITY             DIVERGENCE           TEMPERATURE           KINETIC ENERGY    
 AVE 0.381597838976899E-05 0.436755376350570E-07 0.201132609901874E+03 0.287712763090892E+02
 GPNORM  HUMIDITY            AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.760135713280320E-03 0.999999999999999E-08 0.820293490628867E-02
 GPNORM  LIQUID WATER        AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM  ICE WATER           AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.222143781050541E-07 0.000000000000000E+00 0.181681787103224E-06
 GPNORM SNOW                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM RAIN                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.145177202098628E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.221153240448497E-07 0.000000000000000E+00 0.181284858791799E-06
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.144923929758331E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.939290380230551E-10 0.000000000000000E+00 0.124428349458995E-08
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.113935686489613E-01 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =    72 STEPO   A00000000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    72 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000072 MODE=w
 IO-STREAM CLOSED - ICMGGh7zg+000072
 MPI-TASK:   1 -    323750186 BYTES IN      6 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0071( 4.2%)
 NSTEP =    72 STEPO   0AA000000
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMSHh7zg+000072 MODE=a
 IO-STREAM CLOSED - ./ICMSHh7zg+000072
 MPI-TASK:   1 -    707765250 BYTES IN    202 RECORDS TRANSFERRED IN    0.0100 SECONDS 70776.5 Mbytes/s, TOTAL TIME=    0.3104( 3.2%)
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000072 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000072
 MPI-TASK:   1 -   5180002967 BYTES IN    125 RECORDS TRANSFERRED IN    0.0039 SECONDS******** Mbytes/s, TOTAL TIME=    0.1663( 2.3%)
 STEPO_FPOS WAS : B00000F00E
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000072 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000072
 MPI-TASK:   1 -    315176553 BYTES IN      2 RECORDS TRANSFERRED IN    0.0001 SECONDS******** Mbytes/s, TOTAL TIME=    0.0030( 3.3%)
 STEPO_FPOS WAS : V00000000Y
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ./ICMUAh7zg+000072 MODE=a
 IO-STREAM CLOSED - ./ICMUAh7zg+000072
 MPI-TASK:   1 -    323750186 BYTES IN      4 RECORDS TRANSFERRED IN    0.0003 SECONDS******** Mbytes/s, TOTAL TIME=    0.0080( 3.7%)
 STEPO_FPOS WAS : T00000000M
 NSTEP =    72 STEPO   0AAA00AAA
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =    72 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+000072 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+000072
 MPI-TASK:   1 -    323750177 BYTES IN      7 RECORDS TRANSFERRED IN    0.0006 SECONDS539583.6 Mbytes/s, TOTAL TIME=    0.0150( 4.0%)
 10:15:05 STEP   72 H=  18:00 +CPU= 35.959
 NSTEP =    73 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 10:14:26 A00000000 STEPO       72    29.761   29.761   33.119     34:17     36:56 0.43675537635057E-07       2GB       0MB
 10:14:26 0AA000000 STEPO       72     0.025    0.025    0.025     34:17     36:56 0.43675537635057E-07       2GB       0MB
 10:14:28 FULLPOS-B DYNFPOS     72     1.460    1.460    1.470     34:19     36:57 0.43675537635057E-07       2GB       0MB
 10:14:31 FULLPOS-V DYNFPOS     72     3.365    3.365    3.391     34:22     37:01 0.43675537635057E-07       2GB       0MB
 10:14:31 FULLPOS-T DYNFPOS     72     0.496    0.496    0.498     34:23     37:01 0.43675537635057E-07       2GB       0MB
 10:14:32 0AAA00AAA STEPO       72     0.537    0.537    0.540     34:23     37:02 0.43675537635057E-07       2GB       0MB
 10:15:05 0AAA00AAA STEPO       73    29.926   29.926   33.341     34:53     37:35 0.43675537635057E-07       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "      48",
 CTIME   = "00001200      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,          36, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/0/progress_file_12212787.xml

<running_values>
  <last_cpu_time>2103.040000</last_cpu_time>
  <upload_file_number>0</upload_file_number>
  <last_iter>73</last_iter>
  <last_upload>0</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net