climateprediction.net home page
Task 22317144

Task 22317144

Name oifs_43r3_00kj_2019110100_123_993_12214177_1
Workunit 12214177
Created 26 Feb 2023, 14:35:43 UTC
Sent 26 Feb 2023, 14:35:49 UTC
Report deadline 27 Apr 2023, 14:35:49 UTC
Received 26 Feb 2023, 15:36:31 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1534746
Run time 23 min 54 sec
CPU time 20 min 52 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 5.61 GFLOPS
Application version OpenIFS 43r3 v1.21
x86_64-pc-linux-gnu
Peak working set size 4,382.73 MB
Peak swap size 4,974.23 MB
Peak disk usage 1,246.73 MB
Stderr
<core_client_version>7.20.5</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_1.21_x86_64-pc-linux-gnu
(argv1) start_date: 2019110100
(argv2) exptid: hnw4
(argv3) unique_member_id: 00kj
(argv4) batchid: 993
(argv5) wuid: 12214177
(argv6) fclen: 123
(argv7) app_name: oifs_43r3
(argv8) nthreads: 1
Working directory is: /var/lib/boinc/slots/25
Project directory is: /var/lib/boinc/projects/climateprediction.net/
app name: oifs_43r3
version: 1.21
Location of temp folder: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177
Copying: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip to: /var/lib/boinc/slots/25/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc/slots/25/oifs_43r3_app_1.21_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_14d571ac94ee705fa78d92834887bbe3 to: /var/lib/boinc/slots/25/oifs_43r3_00kj_2019110100_123_993_12214177.zip
Unzipping the namelist zip file: /var/lib/boinc/slots/25/oifs_43r3_00kj_2019110100_123_993_12214177.zip
ic_ancil_file: ic_ancil_12214177
ifsdata_file: ifsdata_12214177
climate_data_file: clim_data_12214177
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_753388fe1bc3438d558437989cca31e2 to: /var/lib/boinc/slots/25/ic_ancil_12214177.zip
Unzipping the IC ancils zip file: /var/lib/boinc/slots/25/ic_ancil_12214177.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_548947edb7d2aa4a012009d883ad212b to: /var/lib/boinc/slots/25/ifsdata/ifsdata_12214177.zip
Unzipping the ifsdata_zip file: /var/lib/boinc/slots/25/ifsdata/ifsdata_12214177.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc/slots/25/159l_2/clim_data_12214177.zip
Unzipping the climate data zip file: /var/lib/boinc/slots/25/159l_2/clim_data_12214177.zip
Checking for progress XML file: /var/lib/boinc/slots/25/progress_file_12214177.xml
Creating progress file: /var/lib/boinc/slots/25/progress_file_12214177.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_00kj_2019110100_123_993_12214177_1_r341759924
The child process has been launched with process id: 26015
Executing the command: /var/lib/boinc/slots/25/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2091] fp = 0x3124020
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [process_options@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [ignore_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [restore_default_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x810730 (old at (nil))
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.000] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x810730 (old at (nil))
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.001] [trapfpe_treatment@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x810730 (old at (nil))
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x810730 (old at 0x1ce8440)
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x810730 (old at (nil))
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x810730 (old at (nil))
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.001] [signal_drhook_init@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x810730 (old at (nil))
[EC_DRHOOK:vm9:1:1:26015:26015] [20230226:213814:1677422294:0.001] [catch_signals@/home/glenn/github/gc_oifs43r3/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:38:45 STEP    0 H=   0:00 +CPU= 27.001
Moving to projects directory: /var/lib/boinc/slots/25/ICMGGhnw4+000000
Moving to projects directory: /var/lib/boinc/slots/25/ICMSHhnw4+000000
Moving to projects directory: /var/lib/boinc/slots/25/ICMUAhnw4+000000
  21:39:04 STEP    1 H=   1:00 +CPU= 19.093
  21:39:18 STEP    2 H=   2:00 +CPU= 14.094
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:39:46 STEP    3 H=   3:00 +CPU= 25.740
  21:40:03 STEP    4 H=   4:00 +CPU= 16.695
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:40:20 STEP    5 H=   5:00 +CPU= 15.423
  21:40:45 STEP    6 H=   6:00 +CPU= 24.953
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:41:04 STEP    7 H=   7:00 +CPU= 16.910
  21:41:24 STEP    8 H=   8:00 +CPU= 19.634
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:41:52 STEP    9 H=   9:00 +CPU= 26.248
  21:42:08 STEP   10 H=  10:00 +CPU= 16.364
  21:42:22 STEP   11 H=  11:00 +CPU= 13.888
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:42:52 STEP   12 H=  12:00 +CPU= 27.518
Moving to projects directory: /var/lib/boinc/slots/25/ICMGGhnw4+000012
Moving to projects directory: /var/lib/boinc/slots/25/ICMSHhnw4+000012
Moving to projects directory: /var/lib/boinc/slots/25/ICMUAhnw4+000012
  21:43:06 STEP   13 H=  13:00 +CPU= 14.478
  21:43:21 STEP   14 H=  14:00 +CPU= 14.717
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:43:59 STEP   15 H=  15:00 +CPU= 28.388
  21:44:15 STEP   16 H=  16:00 +CPU= 16.045
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:44:35 STEP   17 H=  17:00 +CPU= 17.320
  21:44:58 STEP   18 H=  18:00 +CPU= 23.047
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:45:14 STEP   19 H=  19:00 +CPU= 14.746
  21:45:30 STEP   20 H=  20:00 +CPU= 15.766
  21:45:53 STEP   21 H=  21:00 +CPU= 22.562
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:46:11 STEP   22 H=  22:00 +CPU= 15.932
  21:46:27 STEP   23 H=  23:00 +CPU= 16.172
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:46:58 STEP   24 H=  24:00 +CPU= 29.276
Moving to projects directory: /var/lib/boinc/slots/25/ICMGGhnw4+000024
Moving to projects directory: /var/lib/boinc/slots/25/ICMSHhnw4+000024
Moving to projects directory: /var/lib/boinc/slots/25/ICMUAhnw4+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177/ICMGGhnw4+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177/ICMSHhnw4+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177/ICMUAhnw4+000000
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177/ICMGGhnw4+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177/ICMSHhnw4+000012
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177/ICMUAhnw4+000012
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00kj_2019110100_123_993_12214177_1_r341759924_0.zip
Uploading the intermediate file: upload_file_0.zip
  21:47:13 STEP   25 H=  25:00 +CPU= 15.054
  21:47:31 STEP   26 H=  26:00 +CPU= 17.552
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:47:58 STEP   27 H=  27:00 +CPU= 25.009
  21:48:15 STEP   28 H=  28:00 +CPU= 16.910
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:48:33 STEP   29 H=  29:00 +CPU= 15.907
  21:48:57 STEP   30 H=  30:00 +CPU= 24.094
  21:49:12 STEP   31 H=  31:00 +CPU= 15.333
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:49:31 STEP   32 H=  32:00 +CPU= 17.218
  21:49:57 STEP   33 H=  33:00 +CPU= 25.772
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:50:17 STEP   34 H=  34:00 +CPU= 17.384
  21:50:31 STEP   35 H=  35:00 +CPU= 14.271
  21:50:57 STEP   36 H=  36:00 +CPU= 25.693
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /var/lib/boinc/slots/25/ICMGGhnw4+000036
Moving to projects directory: /var/lib/boinc/slots/25/ICMSHhnw4+000036
Moving to projects directory: /var/lib/boinc/slots/25/ICMUAhnw4+000036
  21:51:14 STEP   37 H=  37:00 +CPU= 15.591
  21:51:29 STEP   38 H=  38:00 +CPU= 14.538
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:51:56 STEP   39 H=  39:00 +CPU= 24.661
  21:52:13 STEP   40 H=  40:00 +CPU= 17.480
  21:52:29 STEP   41 H=  41:00 +CPU= 16.034
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:55:42 STEP   42 H=  42:00 +CPU= 28.943
  21:55:56 STEP   43 H=  43:00 +CPU= 14.183
  21:56:14 STEP   44 H=  44:00 +CPU= 18.073
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:56:41 STEP   45 H=  45:00 +CPU= 24.917
  21:56:56 STEP   46 H=  46:00 +CPU= 15.370
  21:57:13 STEP   47 H=  47:00 +CPU= 16.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:57:42 STEP   48 H=  48:00 +CPU= 26.936
Moving to projects directory: /var/lib/boinc/slots/25/ICMGGhnw4+000048
Moving to projects directory: /var/lib/boinc/slots/25/ICMSHhnw4+000048
Moving to projects directory: /var/lib/boinc/slots/25/ICMUAhnw4+000048
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177/ICMGGhnw4+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177/ICMSHhnw4+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177/ICMUAhnw4+000024
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177/ICMGGhnw4+000036
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177/ICMSHhnw4+000036
Adding to the zip: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_12214177/ICMUAhnw4+000036
Zipping up the intermediate file: /var/lib/boinc/projects/climateprediction.net/oifs_43r3_00kj_2019110100_123_993_12214177_1_r341759924_1.zip
Uploading the intermediate file: upload_file_1.zip
  21:57:56 STEP   49 H=  49:00 +CPU= 13.992
  21:58:11 STEP   50 H=  50:00 +CPU= 15.654
  21:58:33 STEP   51 H=  51:00 +CPU= 22.084
  21:58:47 STEP   52 H=  52:00 +CPU= 13.604
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:59:03 STEP   53 H=  53:00 +CPU= 13.758
  21:59:26 STEP   54 H=  54:00 +CPU= 22.690
  21:59:39 STEP   55 H=  55:00 +CPU= 13.810
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:59:57 STEP   56 H=  56:00 +CPU= 15.100
  22:00:21 STEP   57 H=  57:00 +CPU= 23.866
  22:00:35 STEP   58 H=  58:00 +CPU= 14.252
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:00:51 STEP   59 H=  59:00 +CPU= 14.320
  22:01:15 STEP   60 H=  60:00 +CPU= 24.155
Moving to projects directory: /var/lib/boinc/slots/25/ICMGGhnw4+000060
Moving to projects directory: /var/lib/boinc/slots/25/ICMSHhnw4+000060
Moving to projects directory: /var/lib/boinc/slots/25/ICMUAhnw4+000060
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:01:33 STEP   61 H=  61:00 +CPU= 15.216
  22:01:53 STEP   62 H=  62:00 +CPU= 20.383
  22:02:17 STEP   63 H=  63:00 +CPU= 23.851
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:02:35 STEP   64 H=  64:00 +CPU= 15.723
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
..The child process has been killed with signal: 9
>>> Printing last 70 lines from file: NODE.001_01

 NSTEP =    62 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 4.937164021719E-01 1.874594550079E-01 6.848218571621E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.308220555222E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  3.72140156029109E-03 -1.85684446543986E+00  1.92463592076142E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  6.22526386122944E-03 -1.00000000000000E+00  1.00000000000000E+00
  STEPO: evolving YSPSDT_AR1(  1)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191103131500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191103133000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191103134500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191103140000  !!!!!!!!!!!! 
 22:01:53 STEP   62 H=  62:00 +CPU= 20.383
  DATE= 2019   11    3
ISTEP=      63: Reset RSOLINC= 1361.0304 RIP0= 1383.4685
 SU_GHGCLIM, RCARDI,RCH4,RN2O,RCFC11,RCFC12,RNO2:   6.240006412635001E-004
  9.628461857022168E-007  4.996611132045250E-007  9.607432727722499E-010
  2.027017283006666E-009  7.940283000000001E-011
 SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT)     20191101
        3870  9.999999999999998E-005
SUECSO4: USE AVAILABLE FILES FOR DECADES:   2010 2020
 SUBROUTINE SUECSO4:, UNWEIGHTED AVERAGE:   2.310818581253709E-003
 NSTEP =    63 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.063843510447E-01 1.863970160496E-01 6.914220615694E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.462538683819E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  6.60917415715881E-03 -1.84149159731158E+00  1.83170474930163E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  9.04348206316083E-03 -1.00000000000000E+00  1.00000000000000E+00
  STEPO: evolving YSPSDT_AR1(  1)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191103141500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191103143000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191103144500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191103150000  !!!!!!!!!!!! 
 22:02:17 STEP   63 H=  63:00 +CPU= 23.851
 NSTEP =    64 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.079268937700E-01 1.853726801016E-01 6.924686581408E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.466559878576E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  9.36285420284340E-03 -2.11844312388971E+00  2.07387011906118E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  8.92079051452598E-03 -1.00000000000000E+00  1.00000000000000E+00
  STEPO: evolving YSPSDT_AR1(  1)
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191103151500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191103153000  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191103154500  !!!!!!!!!!!! 
   !!!!!!!!!!!!!! WAVE FIELDS INTEGRATED.  DATE IS: 20191103160000  !!!!!!!!!!!! 
 22:02:35 STEP   64 H=  64:00 +CPU= 15.723
ISTEP=      65 RSOLINC= 1361.0304 RI0= 1366.0000 ZI0= 1361.0304 RIP0= 1383.5266
ISTEP=      65 ZI0= 1361.0304 ZSEASON= 1.016528848 REA=149597870000.00 RDEASO=148376648139.18
 NSTEP =    65 STEPO   0AAA00AAA
  SPECTRAL NORMS: Pattern  1
 STEPO, YSPSDT_AR1     (  1,...), SP NORMS 2D: 5.026628670033E-01 1.861859624297E-01 7.010513640521E-02
 STEPO, YSPSDT_AR1     (SUM,...), SP NORMS 2D: 5.276839074174E-01
 STEPO, YGPSDT         (  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  4.33639156603737E-02 -1.87039671897411E+00  1.95899511197933E+00
 STEPO, YGPSDT[clipped](  1,...), Grid Point Norms
  FIELD LEV        AVERAGE               MINIMUM               MAXIMUM       
    101  60  4.04012976395413E-02 -1.00000000000000E+00  1.00000000000000E+00
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat

 22:00:52 FULLPOS-B DYNFPOS     60     0.482    0.482    0.482     19:00     22:37 0.11028011791102E-04       2GB       0MB
 22:00:53 0AAA00AAA STEPO       60     0.847    0.847    0.848     19:01     22:38 0.11028011791102E-04       2GB       0MB
 22:01:15 0AAA00AAA STEPO       61    22.650   22.650   22.651     19:24     23:01 0.11028011791102E-04       2GB       0MB
 22:01:33 0AAA00AAA STEPO       62    15.216   15.216   17.222     19:39     23:18 0.11028011791102E-04       2GB       0MB
 22:01:53 0AAA00AAA STEPO       63    20.383   20.383   20.400     19:59     23:38 0.11028011791102E-04       2GB       0MB
 22:02:17 0AAA00AAA STEPO       64    23.851   23.851   23.853     20:23     24:02 0.11028011791102E-04       2GB       0MB
 22:02:35 0AAA00AAA STEPO       65    15.723   15.723   17.727     20:39     24:20 0.11028011791102E-04       2GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "      48",
 CTIME   = "00020000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 5*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =   98321.7124727241     ,
 GMASSI  =   98321.2205467707     
 /
------------------------------------------------
>>> Printing last 17 lines from file: waminfo

PARAM=10U/10V,                                                          
REPRES=GG,                                                              
ANALYSIS PERIOD =       0                                               
FORECAST PERIOD =   10458000                                            
WIND TIME STEP IN SECONDS =    3600                                     
ANALYSIS FROM 20191101000000 TO 20191101000000                          
ASSIMILATION NO                                                         
NEW FORECAST NO                                                         
STATUS STORM1= UNFINISHED                                               
STATUS STORM2= UNFINISHED                                               
STATUS STORM3= UNFINISHED                                               
DATE FOR OUTPUT OF BOTH RESTART FILES = 00000000000000                  
LAST DATE FOR SPECTRA FILE OUTPUT = 20200303000000                      
BEGIN DATE FOR USING SURFACE CURRENT = 20191101000000                   
PARALLEL RESTART = YES                                                  
NUMBER OF MPI TASKS USED =          1                                   
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc/slots/25/progress_file_12214177.xml

<running_values>
  <last_cpu_time>1243.330000</last_cpu_time>
  <upload_file_number>2</upload_file_number>
  <last_iter>65</last_iter>
  <last_upload>172800</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net