<core_client_version>8.0.2</core_client_version>
<![CDATA[
<message>
process exited with code 1 (0x1, -255)</message>
<stderr_txt>
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a3fz
(argv4) batchid: 1017
(argv5) wuid: 12286290
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /config/slots/4
Project directory is: /config/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /config/projects/climateprediction.net/oifs_43r3_bl_12286290
Copying: /config/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /config/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /config/slots/4/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_18d6d07fb951d114d15fb7469ae68049 to: /config/slots/4/oifs_43r3_bl_a3fz_2016092300_20_1017_12286290.zip
Unzipping the namelist zip file: /config/slots/4/oifs_43r3_bl_a3fz_2016092300_20_1017_12286290.zip
ic_ancil_file: ic_ancil_12286290
ifsdata_file: ifsdata_12286290
climate_data_file: clim_data_12286290
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /config/slots/4/ic_ancil_12286290.zip
Unzipping the IC ancils zip file: /config/slots/4/ic_ancil_12286290.zip
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_b50584c3d15dd4c5ad45c2bdeafe00ca to: /config/slots/4/ifsdata/ifsdata_12286290.zip
Unzipping the ifsdata_zip file: /config/slots/4/ifsdata/ifsdata_12286290.zip
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /config/slots/4/159l_2/clim_data_12286290.zip
Unzipping the climate data zip file: /config/slots/4/159l_2/clim_data_12286290.zip
Checking for progress XML file: /config/slots/4/progress_file_12286290.xml
Creating progress file: /config/slots/4/progress_file_12286290.xml
last_cpu_time: 0
upload_file_number: 0
last_iter: 0
last_upload: 0
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a3fz_2016092300_20_1017_12286290_0_r1131555978
The child process has been launched with process id: 5929
Executing the command: /config/slots/4/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:boinc-648c58ffd-75q9k:1:1:5929:5929] [20240608:044114:1717836074:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
04:42:10 STEP 0 H= 0:00 +CPU= 26.652
Moving to projects directory: /config/slots/4/ICMGGh7zg+000000
Moving to projects directory: /config/slots/4/ICMSHh7zg+000000
Moving to projects directory: /config/slots/4/ICMUAh7zg+000000
04:42:30 STEP 1 H= 0:15 +CPU= 20.291
04:42:50 STEP 2 H= 0:30 +CPU= 20.009
04:43:11 STEP 3 H= 0:45 +CPU= 20.751
04:43:33 STEP 4 H= 1:00 +CPU= 21.706
04:43:54 STEP 5 H= 1:15 +CPU= 20.738
04:44:16 STEP 6 H= 1:30 +CPU= 21.161
04:44:36 STEP 7 H= 1:45 +CPU= 20.336
04:44:57 STEP 8 H= 2:00 +CPU= 20.837
04:45:19 STEP 9 H= 2:15 +CPU= 20.789
04:45:39 STEP 10 H= 2:30 +CPU= 20.425
04:46:00 STEP 11 H= 2:45 +CPU= 20.552
04:46:27 STEP 12 H= 3:00 +CPU= 26.289
Moving to projects directory: /config/slots/4/ICMGGh7zg+000012
Moving to projects directory: /config/slots/4/ICMSHh7zg+000012
Moving to projects directory: /config/slots/4/ICMUAh7zg+000012
04:46:47 STEP 13 H= 3:15 +CPU= 20.291
04:47:08 STEP 14 H= 3:30 +CPU= 20.287
04:47:28 STEP 15 H= 3:45 +CPU= 20.361
04:47:49 STEP 16 H= 4:00 +CPU= 20.817
04:48:10 STEP 17 H= 4:15 +CPU= 20.706
04:48:31 STEP 18 H= 4:30 +CPU= 20.264
04:48:52 STEP 19 H= 4:45 +CPU= 20.524
04:49:14 STEP 20 H= 5:00 +CPU= 21.839
04:49:35 STEP 21 H= 5:15 +CPU= 20.717
04:49:56 STEP 22 H= 5:30 +CPU= 20.732
04:50:18 STEP 23 H= 5:45 +CPU= 21.899
04:50:45 STEP 24 H= 6:00 +CPU= 27.070
Moving to projects directory: /config/slots/4/ICMGGh7zg+000024
Moving to projects directory: /config/slots/4/ICMSHh7zg+000024
Moving to projects directory: /config/slots/4/ICMUAh7zg+000024
04:51:06 STEP 25 H= 6:15 +CPU= 20.253
04:51:27 STEP 26 H= 6:30 +CPU= 20.294
04:51:48 STEP 27 H= 6:45 +CPU= 20.854
04:52:10 STEP 28 H= 7:00 +CPU= 21.829
04:52:31 STEP 29 H= 7:15 +CPU= 20.662
04:52:51 STEP 30 H= 7:30 +CPU= 20.166
04:53:12 STEP 31 H= 7:45 +CPU= 20.139
04:53:33 STEP 32 H= 8:00 +CPU= 20.787
04:53:54 STEP 33 H= 8:15 +CPU= 20.613
04:54:15 STEP 34 H= 8:30 +CPU= 20.828
04:54:36 STEP 35 H= 8:45 +CPU= 20.859
04:55:03 STEP 36 H= 9:00 +CPU= 26.344
Moving to projects directory: /config/slots/4/ICMGGh7zg+000036
Moving to projects directory: /config/slots/4/ICMSHh7zg+000036
Moving to projects directory: /config/slots/4/ICMUAh7zg+000036
04:55:24 STEP 37 H= 9:15 +CPU= 21.099
04:55:45 STEP 38 H= 9:30 +CPU= 20.506
04:56:06 STEP 39 H= 9:45 +CPU= 20.997
04:56:27 STEP 40 H= 10:00 +CPU= 21.128
04:56:48 STEP 41 H= 10:15 +CPU= 20.386
04:57:09 STEP 42 H= 10:30 +CPU= 20.803
04:57:30 STEP 43 H= 10:45 +CPU= 20.602
04:57:52 STEP 44 H= 11:00 +CPU= 21.319
04:58:13 STEP 45 H= 11:15 +CPU= 20.787
04:58:34 STEP 46 H= 11:30 +CPU= 20.713
04:58:55 STEP 47 H= 11:45 +CPU= 20.740
04:59:25 STEP 48 H= 12:00 +CPU= 29.279
Moving to projects directory: /config/slots/4/ICMGGh7zg+000048
Moving to projects directory: /config/slots/4/ICMSHh7zg+000048
Moving to projects directory: /config/slots/4/ICMUAh7zg+000048
04:59:46 STEP 49 H= 12:15 +CPU= 20.975
05:00:07 STEP 50 H= 12:30 +CPU= 20.523
05:00:27 STEP 51 H= 12:45 +CPU= 20.064
05:00:48 STEP 52 H= 13:00 +CPU= 20.553
05:01:08 STEP 53 H= 13:15 +CPU= 20.208
05:01:28 STEP 54 H= 13:30 +CPU= 20.063
05:01:48 STEP 55 H= 13:45 +CPU= 19.740
05:02:09 STEP 56 H= 14:00 +CPU= 20.668
05:02:29 STEP 57 H= 14:15 +CPU= 19.742
05:02:50 STEP 58 H= 14:30 +CPU= 20.163
05:03:11 STEP 59 H= 14:45 +CPU= 20.878
05:03:37 STEP 60 H= 15:00 +CPU= 25.638
Moving to projects directory: /config/slots/4/ICMGGh7zg+000060
Moving to projects directory: /config/slots/4/ICMSHh7zg+000060
Moving to projects directory: /config/slots/4/ICMUAh7zg+000060
05:03:57 STEP 61 H= 15:15 +CPU= 20.124
05:04:18 STEP 62 H= 15:30 +CPU= 21.071
05:04:38 STEP 63 H= 15:45 +CPU= 19.479
05:04:59 STEP 64 H= 16:00 +CPU= 20.547
05:05:20 STEP 65 H= 16:15 +CPU= 20.541
05:05:40 STEP 66 H= 16:30 +CPU= 20.325
05:06:01 STEP 67 H= 16:45 +CPU= 20.213
05:06:22 STEP 68 H= 17:00 +CPU= 21.406
05:06:42 STEP 69 H= 17:15 +CPU= 19.874
05:07:02 STEP 70 H= 17:30 +CPU= 19.783
05:07:23 STEP 71 H= 17:45 +CPU= 20.455
05:07:49 STEP 72 H= 18:00 +CPU= 26.288
Moving to projects directory: /config/slots/4/ICMGGh7zg+000072
Moving to projects directory: /config/slots/4/ICMSHh7zg+000072
Moving to projects directory: /config/slots/4/ICMUAh7zg+000072
05:08:11 STEP 73 H= 18:15 +CPU= 21.727
05:08:33 STEP 74 H= 18:30 +CPU= 21.133
05:08:54 STEP 75 H= 18:45 +CPU= 21.224
05:09:16 STEP 76 H= 19:00 +CPU= 21.845
05:09:37 STEP 77 H= 19:15 +CPU= 20.230
05:09:57 STEP 78 H= 19:30 +CPU= 20.040
05:10:17 STEP 79 H= 19:45 +CPU= 20.258
05:10:38 STEP 80 H= 20:00 +CPU= 20.324
05:10:59 STEP 81 H= 20:15 +CPU= 20.258
05:11:19 STEP 82 H= 20:30 +CPU= 20.520
05:11:40 STEP 83 H= 20:45 +CPU= 20.839
05:12:08 STEP 84 H= 21:00 +CPU= 27.629
Moving to projects directory: /config/slots/4/ICMGGh7zg+000084
Moving to projects directory: /config/slots/4/ICMSHh7zg+000084
Moving to projects directory: /config/slots/4/ICMUAh7zg+000084
05:12:29 STEP 85 H= 21:15 +CPU= 20.727
05:12:51 STEP 86 H= 21:30 +CPU= 21.179
05:13:12 STEP 87 H= 21:45 +CPU= 20.808
05:13:34 STEP 88 H= 22:00 +CPU= 21.972
05:13:55 STEP 89 H= 22:15 +CPU= 21.316
05:14:18 STEP 90 H= 22:30 +CPU= 22.340
05:14:40 STEP 91 H= 22:45 +CPU= 21.440
05:15:03 STEP 92 H= 23:00 +CPU= 23.022
05:15:25 STEP 93 H= 23:15 +CPU= 22.054
05:15:47 STEP 94 H= 23:30 +CPU= 21.663
05:16:09 STEP 95 H= 23:45 +CPU= 21.471
05:16:39 STEP 96 H= 24:00 +CPU= 29.561
Moving to projects directory: /config/slots/4/ICMGGh7zg+000096
Moving to projects directory: /config/slots/4/ICMSHh7zg+000096
Moving to projects directory: /config/slots/4/ICMUAh7zg+000096
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMGGh7zg+000000
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMSHh7zg+000000
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMUAh7zg+000000
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMGGh7zg+000012
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMSHh7zg+000012
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMUAh7zg+000012
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMGGh7zg+000024
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMSHh7zg+000024
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMUAh7zg+000024
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMGGh7zg+000036
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMSHh7zg+000036
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMUAh7zg+000036
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMGGh7zg+000048
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMSHh7zg+000048
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMUAh7zg+000048
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMGGh7zg+000060
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMSHh7zg+000060
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMUAh7zg+000060
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMGGh7zg+000072
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMSHh7zg+000072
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMUAh7zg+000072
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMGGh7zg+000084
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMSHh7zg+000084
Adding to the zip: /config/projects/climateprediction.net/oifs_43r3_bl_12286290/ICMUAh7zg+000084
Zipping up the intermediate file: /config/projects/climateprediction.net/oifs_43r3_bl_a3fz_2016092300_20_1017_12286290_0_r1131555978_0.zip
Uploading the intermediate file: upload_file_0.zip
05:17:03 STEP 97 H= 24:15 +CPU= 21.900
05:17:25 STEP 98 H= 24:30 +CPU= 21.151
05:17:45 STEP 99 H= 24:45 +CPU= 20.074
05:18:07 STEP 100 H= 25:00 +CPU= 21.355
05:18:28 STEP 101 H= 25:15 +CPU= 20.531
05:18:48 STEP 102 H= 25:30 +CPU= 20.652
05:19:10 STEP 103 H= 25:45 +CPU= 20.831
05:19:31 STEP 104 H= 26:00 +CPU= 21.558
05:19:52 STEP 105 H= 26:15 +CPU= 20.575
05:20:14 STEP 106 H= 26:30 +CPU= 21.217
05:20:35 STEP 107 H= 26:45 +CPU= 21.557
05:21:02 STEP 108 H= 27:00 +CPU= 26.611
Moving to projects directory: /config/slots/4/ICMGGh7zg+000108
Moving to projects directory: /config/slots/4/ICMSHh7zg+000108
Moving to projects directory: /config/slots/4/ICMUAh7zg+000108
05:21:23 STEP 109 H= 27:15 +CPU= 20.600
05:21:44 STEP 110 H= 27:30 +CPU= 20.183
05:22:04 STEP 111 H= 27:45 +CPU= 20.445
05:22:26 STEP 112 H= 28:00 +CPU= 21.611
05:22:47 STEP 113 H= 28:15 +CPU= 20.747
05:23:09 STEP 114 H= 28:30 +CPU= 21.469
05:23:31 STEP 115 H= 28:45 +CPU= 21.562
05:23:53 STEP 116 H= 29:00 +CPU= 21.938
05:24:15 STEP 117 H= 29:15 +CPU= 21.762
05:24:37 STEP 118 H= 29:30 +CPU= 21.443
05:24:58 STEP 119 H= 29:45 +CPU= 21.340
05:25:26 STEP 120 H= 30:00 +CPU= 27.455
Moving to projects directory: /config/slots/4/ICMGGh7zg+000120
Moving to projects directory: /config/slots/4/ICMSHh7zg+000120
Moving to projects directory: /config/slots/4/ICMUAh7zg+000120
05:25:47 STEP 121 H= 30:15 +CPU= 21.154
05:26:09 STEP 122 H= 30:30 +CPU= 21.100
05:26:31 STEP 123 H= 30:45 +CPU= 21.807
05:26:53 STEP 124 H= 31:00 +CPU= 21.534
05:27:15 STEP 125 H= 31:15 +CPU= 21.780
05:27:36 STEP 126 H= 31:30 +CPU= 21.271
05:27:57 STEP 127 H= 31:45 +CPU= 20.934
05:28:19 STEP 128 H= 32:00 +CPU= 21.708
05:28:41 STEP 129 H= 32:15 +CPU= 21.597
05:29:03 STEP 130 H= 32:30 +CPU= 21.709
05:29:25 STEP 131 H= 32:45 +CPU= 21.635
05:29:52 STEP 132 H= 33:00 +CPU= 27.155
Moving to projects directory: /config/slots/4/ICMGGh7zg+000132
Moving to projects directory: /config/slots/4/ICMSHh7zg+000132
Moving to projects directory: /config/slots/4/ICMUAh7zg+000132
05:30:15 STEP 133 H= 33:15 +CPU= 22.267
05:30:37 STEP 134 H= 33:30 +CPU= 21.274
05:30:57 STEP 135 H= 33:45 +CPU= 20.606
05:31:19 STEP 136 H= 34:00 +CPU= 21.821
05:31:41 STEP 137 H= 34:15 +CPU= 21.405
05:32:03 STEP 138 H= 34:30 +CPU= 21.460
05:32:25 STEP 139 H= 34:45 +CPU= 21.971
05:32:47 STEP 140 H= 35:00 +CPU= 21.974
05:33:09 STEP 141 H= 35:15 +CPU= 21.626
05:33:31 STEP 142 H= 35:30 +CPU= 21.132
05:33:52 STEP 143 H= 35:45 +CPU= 21.438
05:34:23 STEP 144 H= 36:00 +CPU= 30.195
Moving to projects directory: /config/slots/4/ICMGGh7zg+000144
Moving to projects directory: /config/slots/4/ICMSHh7zg+000144
Moving to projects directory: /config/slots/4/ICMUAh7zg+000144
05:34:45 STEP 145 H= 36:15 +CPU= 21.436
05:35:07 STEP 146 H= 36:30 +CPU= 21.962
05:35:30 STEP 147 H= 36:45 +CPU= 22.597
05:35:52 STEP 148 H= 37:00 +CPU= 21.568
05:36:13 STEP 149 H= 37:15 +CPU= 21.302
05:36:34 STEP 150 H= 37:30 +CPU= 20.826
05:36:55 STEP 151 H= 37:45 +CPU= 20.767
05:37:17 STEP 152 H= 38:00 +CPU= 21.454
05:37:38 STEP 153 H= 38:15 +CPU= 21.220
05:38:00 STEP 154 H= 38:30 +CPU= 21.039
05:38:22 STEP 155 H= 38:45 +CPU= 21.625
05:38:48 STEP 156 H= 39:00 +CPU= 26.533
Moving to projects directory: /config/slots/4/ICMGGh7zg+000156
Moving to projects directory: /config/slots/4/ICMSHh7zg+000156
Moving to projects directory: /config/slots/4/ICMUAh7zg+000156
05:39:11 STEP 157 H= 39:15 +CPU= 21.830
05:39:32 STEP 158 H= 39:30 +CPU= 20.889
05:39:53 STEP 159 H= 39:45 +CPU= 20.882
05:40:15 STEP 160 H= 40:00 +CPU= 21.523
05:40:35 STEP 161 H= 40:15 +CPU= 20.349
05:40:56 STEP 162 H= 40:30 +CPU= 20.828
05:41:18 STEP 163 H= 40:45 +CPU= 21.128
05:41:40 STEP 164 H= 41:00 +CPU= 21.920
05:42:02 STEP 165 H= 41:15 +CPU= 21.692
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
..The child process has been killed with signal: 9
>>> Printing last 70 lines from file: NODE.001_01
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM SFL AVERAGE MINIMUM MAXIMUM
AVE 0.556823511709487E-14 0.000000000000000E+00 0.259858449325782E-12
GPNORM CRFL AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM CSFL AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
GPNORM PFRC AVERAGE MINIMUM MAXIMUM
AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00
NSTEP = 156 STEPO A00000000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 156 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+000156 MODE=w
IO-STREAM CLOSED - ICMGGh7zg+000156
MPI-TASK: 1 - 306037476 BYTES IN 6 RECORDS TRANSFERRED IN 0.0001 SECONDS******** Mbytes/s, TOTAL TIME= 0.0072( 1.4%)
NSTEP = 156 STEPO 0AA000000
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMSHh7zg+000156 MODE=w
IO-STREAM CLOSED - ./ICMSHh7zg+000156
MPI-TASK: 1 - 707399250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0036 SECONDS196499.8 Mbytes/s, TOTAL TIME= 0.2116( 1.7%)
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+000156 MODE=w
IO-STREAM CLOSED - ./ICMUAh7zg+000156
MPI-TASK: 1 - 4896599616 BYTES IN 125 RECORDS TRANSFERRED IN 0.0013 SECONDS******** Mbytes/s, TOTAL TIME= 0.0962( 1.4%)
STEPO_FPOS WAS : B00000F00E
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+000156 MODE=a
IO-STREAM CLOSED - ./ICMUAh7zg+000156
MPI-TASK: 1 - 10 BYTES IN 2 RECORDS TRANSFERRED IN 0.0001 SECONDS 0.1 Mbytes/s, TOTAL TIME= 0.0030( 3.3%)
STEPO_FPOS WAS : V00000000Y
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+000156 MODE=a
IO-STREAM CLOSED - ./ICMUAh7zg+000156
MPI-TASK: 1 - 297457747 BYTES IN 4 RECORDS TRANSFERRED IN 0.0001 SECONDS******** Mbytes/s, TOTAL TIME= 0.0047( 2.1%)
STEPO_FPOS WAS : T00000000M
NSTEP = 156 STEPO 0AAA00AAA
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 156 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+000156 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+000156
MPI-TASK: 1 - 306037476 BYTES IN 7 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.0093( 2.2%)
05:38:48 STEP 156 H= 39:00 +CPU= 26.533
NSTEP = 157 STEPO 0AAA00AAA
05:39:11 STEP 157 H= 39:15 +CPU= 21.830
NSTEP = 158 STEPO 0AAA00AAA
05:39:32 STEP 158 H= 39:30 +CPU= 20.889
NSTEP = 159 STEPO 0AAA00AAA
05:39:53 STEP 159 H= 39:45 +CPU= 20.882
ISTEP= 160 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP= 160 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
NSTEP = 160 STEPO 0AAA00AAA
05:40:15 STEP 160 H= 40:00 +CPU= 21.523
NSTEP = 161 STEPO 0AAA00AAA
05:40:35 STEP 161 H= 40:15 +CPU= 20.349
NSTEP = 162 STEPO 0AAA00AAA
05:40:56 STEP 162 H= 40:30 +CPU= 20.828
NSTEP = 163 STEPO 0AAA00AAA
05:41:18 STEP 163 H= 40:45 +CPU= 21.128
NSTEP = 164 STEPO 0AAA00AAA
05:41:40 STEP 164 H= 41:00 +CPU= 21.920
ISTEP= 165 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP= 165 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
NSTEP = 165 STEPO 0AAA00AAA
05:42:02 STEP 165 H= 41:15 +CPU= 21.692
NSTEP = 166 STEPO 0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat
05:39:53 0AAA00AAA STEPO 160 20.882 20.882 21.097 57:32 58:39 0.22472350084650E-07 2GB 0MB
05:40:15 0AAA00AAA STEPO 161 21.523 21.523 21.778 57:53 59:00 0.22472350084650E-07 2GB 0MB
05:40:35 0AAA00AAA STEPO 162 20.349 20.349 20.565 58:14 59:21 0.22472350084650E-07 2GB 0MB
05:40:56 0AAA00AAA STEPO 163 20.829 20.829 21.092 58:34 59:42 0.22472350084650E-07 2GB 0MB
05:41:18 0AAA00AAA STEPO 164 21.128 21.128 21.346 58:55 60:03 0.22472350084650E-07 2GB 0MB
05:41:40 0AAA00AAA STEPO 165 21.920 21.920 22.158 59:17 60:26 0.22472350084650E-07 2GB 0MB
05:42:02 0AAA00AAA STEPO 166 21.692 21.692 22.213 59:39 60:48 0.22472350084650E-07 2GB 0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf
CSTEP = " 144",
CTIME = "00011200 ",
NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 132, 2*0,
IPRGPNSRES = 1,
IPRGPEWRES = 1,
IPRTRWRES = 1,
IPRTRVRES = 1,
GMASS0 = 0.000000000000000E+000,
GMASSI = 0.000000000000000E+000
/
------------------------------------------------
>>> Printing last 8 lines from file: /config/slots/4/progress_file_12286290.xml
<running_values>
<last_cpu_time>3598.040000</last_cpu_time>
<upload_file_number>1</upload_file_number>
<last_iter>166</last_iter>
<last_upload>86400</last_upload>
<model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
</stderr_txt>
]]>
