climateprediction.net home page
Task 22307718

Task 22307718

Name oifs_43r3_bl_a0l1_2016092300_15_991_12207544_0
Workunit 12207544
Created 13 Feb 2023, 13:24:41 UTC
Sent 13 Feb 2023, 13:46:10 UTC
Report deadline 14 Apr 2023, 13:46:10 UTC
Received 13 Feb 2023, 16:08:02 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 1 (0x00000001) Unknown error code
Computer ID 1509857
Run time 43 min 36 sec
CPU time 43 min 36 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 5.50 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.11
x86_64-pc-linux-gnu
Peak working set size 4,929.32 MB
Peak swap size 5,930.79 MB
Peak disk usage 1,341.66 MB
Stderr
<core_client_version>7.16.6</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a0l1
(argv4) batchid: 991
(argv5) wuid: 12207544
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/9
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/9/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/9/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_3108b011cd199b830d31d22d2e3b4267 to: /var/lib/boinc-client/slots/9/oifs_43r3_bl_a0l1_2016092300_15_991_12207544.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/9/oifs_43r3_bl_a0l1_2016092300_15_991_12207544.zip
ic_ancil_file: ic_ancil_12207544
ifsdata_file: ifsdata_12207544
climate_data_file: clim_data_12207544
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/9/ic_ancil_12207544.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/9/ic_ancil_12207544.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_50c3207a6eca8b019399284f86c8fad4 to: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12207544.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12207544.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/9/159l_2/clim_data_12207544.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/9/159l_2/clim_data_12207544.zip
Checking for progress XML file: /var/lib/boinc-client/slots/9/progress_file_12207544.xml
Creating progress file: /var/lib/boinc-client/slots/9/progress_file_12207544.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a0l1_2016092300_15_991_12207544_0_r1999157906
The child process has been launched with process id: 329888
Executing the command: /var/lib/boinc-client/slots/9/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:bart-MintII:1:1:329888:329888] [20230213:145252:1676296372:0.001] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  15:22:43 STEP    0 H=   0:00 +CPU= 51.999
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000000
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000000
  15:23:12 STEP    1 H=   0:15 +CPU= 27.866
  15:23:38 STEP    2 H=   0:30 +CPU= 25.504
  15:24:06 STEP    3 H=   0:45 +CPU= 27.510
  15:24:30 STEP    4 H=   1:00 +CPU= 24.017
  15:24:55 STEP    5 H=   1:15 +CPU= 25.665
  15:25:23 STEP    6 H=   1:30 +CPU= 27.537
  15:25:50 STEP    7 H=   1:45 +CPU= 27.141
  15:26:16 STEP    8 H=   2:00 +CPU= 25.833
  15:26:39 STEP    9 H=   2:15 +CPU= 23.018
  15:27:01 STEP   10 H=   2:30 +CPU= 21.868
  15:27:22 STEP   11 H=   2:45 +CPU= 21.125
  15:27:49 STEP   12 H=   3:00 +CPU= 27.311
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000012
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000012
  15:28:09 STEP   13 H=   3:15 +CPU= 19.257
  15:28:32 STEP   14 H=   3:30 +CPU= 23.619
  15:28:55 STEP   15 H=   3:45 +CPU= 23.060
  15:29:17 STEP   16 H=   4:00 +CPU= 22.071
  15:29:41 STEP   17 H=   4:15 +CPU= 23.617
  15:30:02 STEP   18 H=   4:30 +CPU= 21.386
  15:30:27 STEP   19 H=   4:45 +CPU= 24.328
  15:30:52 STEP   20 H=   5:00 +CPU= 24.772
  15:31:16 STEP   21 H=   5:15 +CPU= 24.009
  15:31:41 STEP   22 H=   5:30 +CPU= 25.208
  15:32:05 STEP   23 H=   5:45 +CPU= 23.946
  15:32:36 STEP   24 H=   6:00 +CPU= 31.601
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000024
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000024
  15:33:04 STEP   25 H=   6:15 +CPU= 27.449
  15:33:29 STEP   26 H=   6:30 +CPU= 25.335
  15:33:54 STEP   27 H=   6:45 +CPU= 24.599
  15:34:21 STEP   28 H=   7:00 +CPU= 27.552
  15:34:45 STEP   29 H=   7:15 +CPU= 23.497
  15:35:10 STEP   30 H=   7:30 +CPU= 24.867
  15:35:35 STEP   31 H=   7:45 +CPU= 25.365
  15:35:59 STEP   32 H=   8:00 +CPU= 23.964
  15:36:23 STEP   33 H=   8:15 +CPU= 23.879
  15:36:46 STEP   34 H=   8:30 +CPU= 23.189
  15:37:11 STEP   35 H=   8:45 +CPU= 24.501
  15:37:41 STEP   36 H=   9:00 +CPU= 29.924
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000036
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000036
  15:38:05 STEP   37 H=   9:15 +CPU= 24.535
  15:38:29 STEP   38 H=   9:30 +CPU= 23.416
  15:38:54 STEP   39 H=   9:45 +CPU= 25.022
  15:39:20 STEP   40 H=  10:00 +CPU= 26.637
  15:39:43 STEP   41 H=  10:15 +CPU= 22.891
  15:40:07 STEP   42 H=  10:30 +CPU= 23.450
  15:40:30 STEP   43 H=  10:45 +CPU= 23.301
  15:40:53 STEP   44 H=  11:00 +CPU= 22.530
  15:41:16 STEP   45 H=  11:15 +CPU= 23.103
  15:41:41 STEP   46 H=  11:30 +CPU= 25.174
  15:42:06 STEP   47 H=  11:45 +CPU= 24.597
  15:42:39 STEP   48 H=  12:00 +CPU= 32.749
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000048
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000048
  15:43:04 STEP   49 H=  12:15 +CPU= 25.741
  15:43:31 STEP   50 H=  12:30 +CPU= 26.463
  15:43:55 STEP   51 H=  12:45 +CPU= 24.340
  15:44:21 STEP   52 H=  13:00 +CPU= 25.655
  15:44:46 STEP   53 H=  13:15 +CPU= 25.408
  15:45:10 STEP   54 H=  13:30 +CPU= 23.779
  15:45:32 STEP   55 H=  13:45 +CPU= 22.107
  15:45:56 STEP   56 H=  14:00 +CPU= 23.777
  15:46:19 STEP   57 H=  14:15 +CPU= 22.936
  15:46:44 STEP   58 H=  14:30 +CPU= 24.536
  15:47:06 STEP   59 H=  14:45 +CPU= 22.171
  15:47:33 STEP   60 H=  15:00 +CPU= 27.340
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000060
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000060
  15:47:54 STEP   61 H=  15:15 +CPU= 21.029
  15:48:19 STEP   62 H=  15:30 +CPU= 24.962
  15:48:42 STEP   63 H=  15:45 +CPU= 22.803
  15:49:07 STEP   64 H=  16:00 +CPU= 25.355
  15:49:32 STEP   65 H=  16:15 +CPU= 24.545
  15:49:56 STEP   66 H=  16:30 +CPU= 24.089
  15:50:19 STEP   67 H=  16:45 +CPU= 23.026
  15:50:44 STEP   68 H=  17:00 +CPU= 24.829
  15:51:07 STEP   69 H=  17:15 +CPU= 23.051
  15:51:30 STEP   70 H=  17:30 +CPU= 23.340
  15:51:51 STEP   71 H=  17:45 +CPU= 20.757
  15:52:20 STEP   72 H=  18:00 +CPU= 28.826
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000072
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000072
  15:52:42 STEP   73 H=  18:15 +CPU= 22.436
  15:53:04 STEP   74 H=  18:30 +CPU= 21.202
  15:53:27 STEP   75 H=  18:45 +CPU= 23.193
  15:53:50 STEP   76 H=  19:00 +CPU= 23.766
  15:54:15 STEP   77 H=  19:15 +CPU= 24.969
  15:54:40 STEP   78 H=  19:30 +CPU= 24.710
  15:54:58 STEP   79 H=  19:45 +CPU= 18.104
  15:55:24 STEP   80 H=  20:00 +CPU= 25.999
  15:55:46 STEP   81 H=  20:15 +CPU= 21.255
  15:56:11 STEP   82 H=  20:30 +CPU= 24.901
  15:56:34 STEP   83 H=  20:45 +CPU= 23.158
  15:57:02 STEP   84 H=  21:00 +CPU= 27.776
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000084
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000084
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000084
  15:57:23 STEP   85 H=  21:15 +CPU= 21.625
  15:57:45 STEP   86 H=  21:30 +CPU= 21.525
  15:58:07 STEP   87 H=  21:45 +CPU= 22.642
  15:58:33 STEP   88 H=  22:00 +CPU= 25.180
  15:58:53 STEP   89 H=  22:15 +CPU= 20.833
  15:59:16 STEP   90 H=  22:30 +CPU= 22.253
  15:59:41 STEP   91 H=  22:45 +CPU= 25.601
  16:00:07 STEP   92 H=  23:00 +CPU= 25.761
  16:00:31 STEP   93 H=  23:15 +CPU= 24.171
  16:00:54 STEP   94 H=  23:30 +CPU= 23.155
  16:01:19 STEP   95 H=  23:45 +CPU= 24.655
  16:01:54 STEP   96 H=  24:00 +CPU= 35.103
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMGGh7zg+000096
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMSHh7zg+000096
Moving to projects directory: /var/lib/boinc-client/slots/9/ICMUAh7zg+000096
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMGGh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMSHh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMUAh7zg+000000
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMGGh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMSHh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMUAh7zg+000012
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMGGh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMSHh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMUAh7zg+000024
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMGGh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMSHh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMUAh7zg+000036
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMGGh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMSHh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMUAh7zg+000048
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMGGh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMSHh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMUAh7zg+000060
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMGGh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMSHh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMUAh7zg+000072
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMGGh7zg+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMSHh7zg+000084
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544/ICMUAh7zg+000084
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0l1_2016092300_15_991_12207544_0_r1999157906_0.zip
Uploading the intermediate file: upload_file_0.zip
  16:02:19 STEP   97 H=  24:15 +CPU= 24.227
  16:02:37 STEP   98 H=  24:30 +CPU= 18.227
  16:02:59 STEP   99 H=  24:45 +CPU= 22.166
  16:03:25 STEP  100 H=  25:00 +CPU= 26.105
  16:03:48 STEP  101 H=  25:15 +CPU= 22.426
  16:04:08 STEP  102 H=  25:30 +CPU= 20.488
  16:04:32 STEP  103 H=  25:45 +CPU= 23.946
  16:04:57 STEP  104 H=  26:00 +CPU= 25.204
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.11_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a0l1
(argv4) batchid: 991
(argv5) wuid: 12207544
(argv6) fclen: 15
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/9
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.11
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12207544
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/9/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/9/oifs_43r3_bl_app_1.11_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_3108b011cd199b830d31d22d2e3b4267 to: /var/lib/boinc-client/slots/9/oifs_43r3_bl_a0l1_2016092300_15_991_12207544.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/9/oifs_43r3_bl_a0l1_2016092300_15_991_12207544.zip
ic_ancil_file: ic_ancil_12207544
ifsdata_file: ifsdata_12207544
climate_data_file: clim_data_12207544
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/9/ic_ancil_12207544.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/9/ic_ancil_12207544.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_50c3207a6eca8b019399284f86c8fad4 to: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12207544.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/9/ifsdata/ifsdata_12207544.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/9/159l_2/clim_data_12207544.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/9/159l_2/clim_data_12207544.zip
Checking for progress XML file: /var/lib/boinc-client/slots/9/progress_file_12207544.xml
Opened progress file ok : /var/lib/boinc-client/slots/9/progress_file_12207544.xml
-- Model is restarting --
Adjusting last_iter, 105, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/9/progress_file_12207544.xml
last_cpu_time: 2597
upload_file_number: 1
last_iter: 97
last_upload: 86400
model_completed: 0
total_length_of_simulation: 1296000
result_base_name: oifs_43r3_bl_a0l1_2016092300_15_991_12207544_0_r1999157906
The child process has been launched with process id: 331349
Executing the command: /var/lib/boinc-client/slots/9/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2091] fp = 0x30e4a00
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [process_options@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [ignore_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [restore_default_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f520 (old at (nil))
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f520 (old at (nil))
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [trapfpe_treatment@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f520 (old at (nil))
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f520 (old at 0x401140)
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f520 (old at (nil))
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.000] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f520 (old at (nil))
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.001] [signal_drhook_init@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f520 (old at (nil))
[EC_DRHOOK:bart-MintII:1:1:331349:331349] [20230213:160628:1676300788:0.001] [catch_signals@/home/abowery/Desktop/OpenIFS/oifs_43r3_bl/gc_oifs43r3-feature-cpdn/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
..The child process has been killed with signal: 9
>>> Printing last 70 lines from file: NODE.001_01

  Reading Black_Carbon_hydrophobic(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
  Reading Organic_Matter_hydrophilic(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
  Reading Organic_Matter_hydrophobic(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
  Reading Mineral_Dust_bin1(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
  Reading Mineral_Dust_bin2(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
  Reading Mineral_Dust_bin3(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
  Reading Sea_Salt_bin1(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
  Reading Sea_Salt_bin2(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
  Reading Sea_Salt_bin3(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
Reading NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
  Reading Sulfates(120,61,12)
Closing NetCDF file ifsdata/aerosol_cams_climatology_43R3a.nc
 UPDTIM MACC AEROSOL CLIMATOLOGY IS LOADED
SUECAEC: INLEV,ISYEAR,IEYEAR=  0  1957  2010
 suecaec NAERMACC =  1
 UPDT RAESHDU =  2000.0
 SUECAEC: GLOBAL AVERAGE VOLCANIC SULPHATE FOR (KINDAT,KMINUT)     20160923
          90  9.999999999999998E-005
  DATE= 2016    9   24
 NORMS AT NSTEP CNT4   96
 SPECTRAL NORMS -    LOG(PREHYDS)    0.115129254605639E+02     OROGRAPHY      0.000000000000000E+00
 LEV     VORTICITY             DIVERGENCE           TEMPERATURE           KINETIC ENERGY    
 AVE 0.112636683675254E-05 0.213375738911425E-07 0.198980990986125E+03 0.199170507466405E+01
 GPNORM  HUMIDITY            AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.277059192986535E-03 0.999999999999999E-08 0.324589659057636E-02
 GPNORM  LIQUID WATER        AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM  ICE WATER           AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.204027838108105E-07 0.000000000000000E+00 0.180778631836673E-06
 GPNORM SNOW                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM RAIN                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM  CLOUD FRACTION      AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.133349278512960E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM CLW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM CIW                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.203454766842521E-07 0.000000000000000E+00 0.180691714355926E-06
 GPNORM CC                   AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.133386914075873E+00 0.000000000000000E+00 0.100000000000000E+01
 GPNORM RFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM SFL                  AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.754294548582566E-10 0.000000000000000E+00 0.104508169938743E-08
 GPNORM CRFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM CSFL                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
 GPNORM PFRC                 AVERAGE               MINIMUM               MAXIMUM        
         AVE   0.100168112496729E-01 0.000000000000000E+00 0.100000000000000E+01
 NSTEP =    96 STEPO   0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 2 lines from file: ifs.stat
 16:06:29 000000000 CNT3      -999     0.655    0.655    0.656      0:00      0:00 0.00000000000000E+00       1GB       0MB
 16:06:33 0AAA00AAA STEPO       96     5.101    5.101    5.280      0:05      0:05 0.21337573891142E-07       1GB       0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf

 CSTEP   = "      96",
 CTIME   = "00010000      ",
 NSTEPLPP        =         201,         202,          49,      228226,      228227, 2*0,          84, 2*0,
 IPRGPNSRES      =           1,
 IPRGPEWRES      =           1,
 IPRTRWRES       =           1,
 IPRTRVRES       =           1,
 GMASS0  =  0.000000000000000E+000,
 GMASSI  =  0.000000000000000E+000
 /
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/9/progress_file_12207544.xml

<running_values>
  <last_cpu_time>2615.390000</last_cpu_time>
  <upload_file_number>1</upload_file_number>
  <last_iter>96</last_iter>
  <last_upload>86400</last_upload>
  <model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully

</stderr_txt>
]]>
No trickles!


©2024 climateprediction.net