climateprediction.net home page
Task 22315655

Task 22315655

Name oifs_43r3_00ns_2019110100_123_993_12214294_0
Workunit 12214294
Created 24 Feb 2023, 14:29:58 UTC
Sent 24 Feb 2023, 14:41:37 UTC
Report deadline 25 Apr 2023, 14:41:37 UTC
Received 24 Feb 2023, 23:02:34 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1533736
Run time 13 min 30 sec
CPU time 10 min 58 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 3.95 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 3,809.94 MB
Peak swap size 4,974.26 MB
Peak disk usage 1,246.66 MB
Stderr
<core_client_version>7.16.11</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_1.21_x86_64-pc-linux-gnu
(argv1) start_date: 2019110100
(argv2) exptid: hnw4
(argv3) unique_member_id: 00ns
(argv4) batchid: 993
(argv5) wuid: 12214294
(argv6) fclen: 123
(argv7) app_name: oifs_43r3
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/1
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3
version: 1.21
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214294
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/1/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/1/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_d69ef3e780ea4f9d33f2a28aca66e431 to: /var/lib/boinc/slots/1/oifs_43r3_00ns_2019110100_123_993_12214294.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/1/oifs_43r3_00ns_2019110100_123_993_12214294.zip
ic_ancil_file: ic_ancil_12214294
ifsdata_file: ifsdata_12214294
climate_data_file: clim_data_12214294
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_57e4439c83e07464206981112fda6995 to: /var/lib/boinc/slots/1/ic_ancil_12214294.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/1/ic_ancil_12214294.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_1771bca796c894ca74754c2474bff371 to: /var/lib/boinc/slots/1/ifsdata/ifsdata_12214294.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/1/ifsdata/ifsdata_12214294.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/1/159l_2/clim_data_12214294.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/1/159l_2/clim_data_12214294.zip
Checking for progress XML file: /var/lib/boinc/slots/1/progress_file_12214294.xml
Creating progress file: /var/lib/boinc/slots/1/progress_file_12214294.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_00ns_2019110100_123_993_12214294_0_r1398181305
The child process has been launched with process id: 551
Executing the command: /var/lib/boinc/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x3124020
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [ignore_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [restore_default_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x810730 (old at (nil))
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x810730 (old at (nil))
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [trapfpe_treatment@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x810730 (old at (nil))
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x810730 (old at (nil))
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x810730 (old at (nil))
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x810730 (old at (nil))
[EC_DRHOOK:Optiplex3060AD-CentOS79a:1:1:551:551] [20230225:033835:1677263915:0.001] [catch_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  03:39:29 STEP    0 H=   0:00 +CPU= 23.559
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000000
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000000
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000000
  03:39:47 STEP    1 H=   1:00 +CPU= 17.226
  03:40:01 STEP    2 H=   2:00 +CPU= 14.285
  03:40:38 STEP    3 H=   3:00 +CPU= 25.187
  03:40:57 STEP    4 H=   4:00 +CPU= 16.194
  03:41:13 STEP    5 H=   5:00 +CPU= 14.851
  03:41:42 STEP    6 H=   6:00 +CPU= 26.197
  03:41:58 STEP    7 H=   7:00 +CPU= 16.054
  03:42:14 STEP    8 H=   8:00 +CPU= 15.299
  03:42:41 STEP    9 H=   9:00 +CPU= 27.897
  03:43:02 STEP   10 H=  10:00 +CPU= 20.596
  03:43:19 STEP   11 H=  11:00 +CPU= 17.053
  03:43:52 STEP   12 H=  12:00 +CPU= 32.722
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000012
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000012
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000012
  03:44:07 STEP   13 H=  13:00 +CPU= 14.849
  03:44:24 STEP   14 H=  14:00 +CPU= 16.648
  03:44:46 STEP   15 H=  15:00 +CPU= 21.805
  03:45:00 STEP   16 H=  16:00 +CPU= 14.322
  03:45:17 STEP   17 H=  17:00 +CPU= 16.800
  03:45:40 STEP   18 H=  18:00 +CPU= 23.669
  03:45:54 STEP   19 H=  19:00 +CPU= 13.868
  03:46:09 STEP   20 H=  20:00 +CPU= 14.921
  03:46:39 STEP   21 H=  21:00 +CPU= 29.895
  03:46:53 STEP   22 H=  22:00 +CPU= 14.194
  03:47:16 STEP   23 H=  23:00 +CPU= 15.203
  03:48:13 STEP   24 H=  24:00 +CPU= 32.689
Moving to projects directory: /var/lib/boinc/slots/1/ICMGGhnw4+000024
Moving to projects directory: /var/lib/boinc/slots/1/ICMSHhnw4+000024
Moving to projects directory: /var/lib/boinc/slots/1/ICMUAhnw4+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214294/ICMGGhnw4+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214294/ICMSHhnw4+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214294/ICMUAhnw4+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214294/ICMGGhnw4+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214294/ICMSHhnw4+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214294/ICMUAhnw4+000012
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00ns_2019110100_123_993_12214294_0_r1398181305_0.zip
Uploading the intermediate file: upload_file_0.zip
  03:48:32 STEP   25 H=  25:00 +CPU= 14.492
  03:48:47 STEP   26 H=  26:00 +CPU= 15.163
  03:49:14 STEP   27 H=  27:00 +CPU= 26.864
  03:49:29 STEP   28 H=  28:00 +CPU= 14.432
  03:49:44 STEP   29 H=  29:00 +CPU= 15.005
  03:50:13 STEP   30 H=  30:00 +CPU= 29.728
  03:50:34 STEP   31 H=  31:00 +CPU= 16.740
  03:50:57 STEP   32 H=  32:00 +CPU= 16.503
forrtl: severe (41): insufficient virtual memory
Image              PC                Routine            Line        Source             
oifs_43r3_model.e  0000000001D2B25B  Unknown               Unknown  Unknown
oifs_43r3_model.e  00000000012BF983  call_sl_heap_              92  call_sl_heap.F90
oifs_43r3_model.e  0000000000C95708  gp_model_                 533  gp_model.F90
oifs_43r3_model.e  000000000138E0F2  gp_model_heap_             74  gp_model_heap.F90
oifs_43r3_model.e  000000000139C38E  scan2m_                   535  scan2m.F90
oifs_43r3_model.e  00000000004D61C4  stepo_                    327  stepo.F90
oifs_43r3_model.e  00000000004339DC  cnt4_                    1133  cnt4.F90
oifs_43r3_model.e  000000000041D979  cnt3_                     267  cnt3.F90
oifs_43r3_model.e  000000000041C8F2  cnt2_                      88  cnt2.F90
oifs_43r3_model.e  0000000000407BD8  cnt1_                      92  cnt1.F90
oifs_43r3_model.e  000000000040734D  cnt0_                     146  cnt0.F90
oifs_43r3_model.e  000000000040220F  MAIN__                     96  master.F90
oifs_43r3_model.e  00000000004021A2  Unknown               Unknown  Unknown
oifs_43r3_model.e  0000000001DC9C50  Unknown               Unknown  Unknown
oifs_43r3_model.e  000000000040206E  Unknown               Unknown  Unknown
..The child process terminated with status: 41
>>> Printing last 70 lines from file: NODE.001_01

SUECSO4: USE AVAILABLE FILES FOR DECADES:   2010 2020
 SUBROUTINE SUECSO4:, UNWEIGHTED AVERAGE:   2.318548376519975E-003
 NSTEP =    30 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.144857052483E-01 1.970660721775E-01 7.076838461015E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.386752660891E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  2.51138327333197E-02 -1.92457801565357E+00  2.44238543946940E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  2.33467789179043E-02 -1.00000000000000E+00  1.00000000000000E+00
  STEPO: evolving YSPSDT_AR1(  1)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191102051500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191102053000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191102054500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191102060000  !!!!!!!!!!!! 
 03:50:13 STEP   30 H=  30:00 +CPU= 29.728
 NSTEP =    31 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.084500113128E-01 1.980482619460E-01 7.122677076310E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.438213547025E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  2.06557470877039E-02 -2.09731620211884E+00  2.54658802906826E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  1.81995385339754E-02 -1.00000000000000E+00  1.00000000000000E+00
  STEPO: evolving YSPSDT_AR1(  1)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191102061500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191102063000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191102064500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191102070000  !!!!!!!!!!!! 
 03:50:34 STEP   31 H=  31:00 +CPU= 16.740
 NSTEP =    32 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.038584850031E-01 1.997784290946E-01 7.166055116459E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.407455128998E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  1.62608230814749E-02 -1.70187077442784E+00  2.16281079374697E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  1.09995925774064E-02 -1.00000000000000E+00  1.00000000000000E+00
  STEPO: evolving YSPSDT_AR1(  1)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191102071500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191102073000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191102074500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191102080000  !!!!!!!!!!!! 
 03:50:57 STEP   32 H=  32:00 +CPU= 16.503
  DATE= 2019   11    2
ISTEP=      33: Reset RSOLINC= 1361.0304 RIP0= 1382.5914
 SU_GHGCLIM, RCARDI,RCH4,RN2O,RCFC11,RCFC12,RNO2:   6.240006412635001E-004
  9.628461857022168E-007  4.996611132045250E-007  9.607432727722499E-010
  2.027017283006666E-009  7.940283000000001E-011
 SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT)     20191101
        2070  9.999999999999998E-005
SUECSO4: USE AVAILABLE FILES FOR DECADES:   2010 2020
 SUBROUTINE SUECSO4:, UNWEIGHTED AVERAGE:   2.317845668331562E-003
 NSTEP =    33 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.195230082755E-01 2.000494845981E-01 7.065658213727E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.521246070460E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  2.63251806811208E-02 -2.11606331949582E+00  2.08596285575537E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  2.25410725564848E-02 -1.00000000000000E+00  1.00000000000000E+00
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 03:48:47 0AAA00AAA STEPO       27    15.165   15.165   15.199      8:47     10:12 0.11724057876641E-04       2GB       0MB
 03:49:14 0AAA00AAA STEPO       28    26.862   26.862   26.962      9:14     10:39 0.11724057876641E-04       2GB       0MB
 03:49:29 0AAA00AAA STEPO       29    14.432   14.432   14.436      9:29     10:53 0.11724057876641E-04       2GB       0MB
 03:49:44 0AAA00AAA STEPO       30    15.103   15.103   15.107      9:44     11:08 0.11724057876641E-04       2GB       0MB
 03:50:13 0AAA00AAA STEPO       31    29.631   29.631   29.648     10:13     11:38 0.11724057876641E-04       2GB       0MB
 03:50:34 0AAA00AAA STEPO       32    16.740   16.740   21.139     10:30     11:59 0.11724057876641E-04       2GB       0MB
 03:50:57 0AAA00AAA STEPO       33    16.504   16.504   22.653     10:47     12:22 0.11724057876641E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "      24",
 CTIME   = "00010000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 5*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =   98321.4320376468     ,
 GMASSI  =   98321.0757161544     
 /
------------------------------------------------
>>> Printing last 17 lines from file: waminfo

PARAM=10U/10V,                                                          
REPRES=GG,                                                              
ANALYSIS PERIOD =       0                                               
FORECAST PERIOD =   10544400                                            
WIND TIME STEP IN SECONDS =    3600                                     
ANALYSIS FROM 20191101000000 TO 20191101000000                          
ASSIMILATION NO                                                         
NEW FORECAST NO                                                         
STATUS STORM1= UNFINISHED                                               
STATUS STORM2= UNFINISHED                                               
STATUS STORM3= UNFINISHED                                               
DATE FOR OUTPUT OF BOTH RESTART FILES = 00000000000000                  
LAST DATE FOR SPECTRA FILE OUTPUT = 20200303000000                      
BEGIN DATE FOR USING SURFACE CURRENT = 20191101000000                   
PARALLEL RESTART = YES                                                  
NUMBER OF MPI TASKS USED =          1                                   
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc/slots/1/progress_file_12214294.xml

<running_values>
  <last_cpu_time>653.360000</last_cpu_time>
  <upload_file_number>1</upload_file_number>
  <last_iter>33</last_iter>
  <last_upload>86400</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net