<core_client_version>7.20.5</core_client_version>
<![CDATA[
<stderr_txt>
pping the climate data zip file: /data/boinc/boinc-client/slots/12/159l_2/clim_data_12282936.zip
Checking for progress XML file: /data/boinc/boinc-client/slots/12/progress_file_12282936.xml
Opened progress file ok : /data/boinc/boinc-client/slots/12/progress_file_12282936.xml
-- Model is restarting --
Adjusting last_iter, 1156, to previous model restart step.
Creating progress file: /data/boinc/boinc-client/slots/12/progress_file_12282936.xml
last_cpu_time: 41734
upload_file_number: 12
last_iter: 1153
last_upload: 1036800
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a0ut_2016092300_20_1017_12282936_0_r1414758141
The child process has been launched with process id: 107290
Executing the command: /data/boinc/boinc-client/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:140142:1718197302:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
14:02:24 STEP 1152 H= 288:00 +CPU= 33.450
14:02:56 STEP 1153 H= 288:15 +CPU= 31.171
14:03:28 STEP 1154 H= 288:30 +CPU= 31.674
14:03:59 STEP 1155 H= 288:45 +CPU= 31.059
14:04:32 STEP 1156 H= 289:00 +CPU= 32.131
14:05:04 STEP 1157 H= 289:15 +CPU= 31.370
14:05:35 STEP 1158 H= 289:30 +CPU= 31.510
14:06:08 STEP 1159 H= 289:45 +CPU= 31.767
14:06:40 STEP 1160 H= 290:00 +CPU= 31.712
14:07:10 STEP 1161 H= 290:15 +CPU= 30.495
14:07:43 STEP 1162 H= 290:30 +CPU= 32.008
14:08:15 STEP 1163 H= 290:45 +CPU= 31.801
14:08:55 STEP 1164 H= 291:00 +CPU= 39.187
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001164
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001164
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001164
14:09:27 STEP 1165 H= 291:15 +CPU= 32.146
14:10:00 STEP 1166 H= 291:30 +CPU= 32.343
14:10:33 STEP 1167 H= 291:45 +CPU= 32.531
14:11:06 STEP 1168 H= 292:00 +CPU= 32.593
14:11:39 STEP 1169 H= 292:15 +CPU= 32.807
14:12:12 STEP 1170 H= 292:30 +CPU= 32.842
14:12:45 STEP 1171 H= 292:45 +CPU= 32.451
14:13:18 STEP 1172 H= 293:00 +CPU= 32.606
14:13:50 STEP 1173 H= 293:15 +CPU= 31.722
14:14:22 STEP 1174 H= 293:30 +CPU= 31.611
14:14:54 STEP 1175 H= 293:45 +CPU= 32.255
14:15:34 STEP 1176 H= 294:00 +CPU= 39.203
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001176
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001176
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001176
14:16:06 STEP 1177 H= 294:15 +CPU= 31.789
14:16:40 STEP 1178 H= 294:30 +CPU= 32.957
14:17:12 STEP 1179 H= 294:45 +CPU= 31.996
14:17:45 STEP 1180 H= 295:00 +CPU= 32.238
14:18:17 STEP 1181 H= 295:15 +CPU= 32.187
14:18:49 STEP 1182 H= 295:30 +CPU= 31.583
14:19:22 STEP 1183 H= 295:45 +CPU= 32.150
14:19:55 STEP 1184 H= 296:00 +CPU= 32.392
14:20:26 STEP 1185 H= 296:15 +CPU= 31.399
14:20:58 STEP 1186 H= 296:30 +CPU= 31.667
14:21:30 STEP 1187 H= 296:45 +CPU= 31.550
14:22:10 STEP 1188 H= 297:00 +CPU= 39.397
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001188
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001188
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001188
14:22:43 STEP 1189 H= 297:15 +CPU= 32.346
14:23:16 STEP 1190 H= 297:30 +CPU= 32.341
14:23:48 STEP 1191 H= 297:45 +CPU= 31.826
14:24:22 STEP 1192 H= 298:00 +CPU= 33.019
14:24:55 STEP 1193 H= 298:15 +CPU= 32.368
14:25:27 STEP 1194 H= 298:30 +CPU= 31.911
14:25:59 STEP 1195 H= 298:45 +CPU= 31.544
14:26:33 STEP 1196 H= 299:00 +CPU= 33.183
14:27:06 STEP 1197 H= 299:15 +CPU= 32.524
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
14:35:01 STEP 1198 H= 299:30 +CPU= 31.165
14:35:34 STEP 1199 H= 299:45 +CPU= 32.640
14:36:19 STEP 1200 H= 300:00 +CPU= 43.925
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001200
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001200
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001200
14:36:52 STEP 1201 H= 300:15 +CPU= 32.719
14:37:25 STEP 1202 H= 300:30 +CPU= 32.757
14:37:58 STEP 1203 H= 300:45 +CPU= 31.935
14:38:31 STEP 1204 H= 301:00 +CPU= 32.641
14:39:04 STEP 1205 H= 301:15 +CPU= 33.005
14:39:37 STEP 1206 H= 301:30 +CPU= 32.751
14:40:09 STEP 1207 H= 301:45 +CPU= 31.600
14:40:43 STEP 1208 H= 302:00 +CPU= 32.869
14:41:15 STEP 1209 H= 302:15 +CPU= 32.509
14:41:48 STEP 1210 H= 302:30 +CPU= 32.097
14:42:20 STEP 1211 H= 302:45 +CPU= 31.985
14:43:01 STEP 1212 H= 303:00 +CPU= 40.557
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001212
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001212
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001212
14:43:34 STEP 1213 H= 303:15 +CPU= 32.226
14:44:07 STEP 1214 H= 303:30 +CPU= 32.609
14:44:39 STEP 1215 H= 303:45 +CPU= 32.360
14:45:12 STEP 1216 H= 304:00 +CPU= 32.491
14:45:45 STEP 1217 H= 304:15 +CPU= 32.623
14:46:19 STEP 1218 H= 304:30 +CPU= 33.057
14:46:52 STEP 1219 H= 304:45 +CPU= 32.844
14:47:25 STEP 1220 H= 305:00 +CPU= 33.071
14:47:58 STEP 1221 H= 305:15 +CPU= 32.043
14:48:31 STEP 1222 H= 305:30 +CPU= 33.094
14:49:04 STEP 1223 H= 305:45 +CPU= 32.499
14:49:44 STEP 1224 H= 306:00 +CPU= 39.848
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001224
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001224
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001224
14:50:17 STEP 1225 H= 306:15 +CPU= 32.492
14:50:50 STEP 1226 H= 306:30 +CPU= 32.171
14:51:22 STEP 1227 H= 306:45 +CPU= 31.964
14:51:55 STEP 1228 H= 307:00 +CPU= 32.852
14:52:28 STEP 1229 H= 307:15 +CPU= 32.635
14:53:02 STEP 1230 H= 307:30 +CPU= 32.802
14:53:34 STEP 1231 H= 307:45 +CPU= 31.981
14:54:07 STEP 1232 H= 308:00 +CPU= 32.861
14:54:40 STEP 1233 H= 308:15 +CPU= 32.118
14:55:13 STEP 1234 H= 308:30 +CPU= 32.613
14:55:46 STEP 1235 H= 308:45 +CPU= 32.518
14:56:27 STEP 1236 H= 309:00 +CPU= 40.122
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001236
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001236
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001236
14:57:00 STEP 1237 H= 309:15 +CPU= 32.287
14:57:32 STEP 1238 H= 309:30 +CPU= 31.731
14:58:05 STEP 1239 H= 309:45 +CPU= 32.741
14:58:38 STEP 1240 H= 310:00 +CPU= 32.396
14:59:10 STEP 1241 H= 310:15 +CPU= 31.491
14:59:42 STEP 1242 H= 310:30 +CPU= 32.108
15:00:15 STEP 1243 H= 310:45 +CPU= 31.684
15:00:48 STEP 1244 H= 311:00 +CPU= 32.624
15:01:20 STEP 1245 H= 311:15 +CPU= 32.127
15:01:53 STEP 1246 H= 311:30 +CPU= 32.499
15:02:26 STEP 1247 H= 311:45 +CPU= 32.367
15:03:11 STEP 1248 H= 312:00 +CPU= 44.676
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001248
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001248
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001152
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001164
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001176
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001188
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001200
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001212
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001224
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001236
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001236
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0ut_2016092300_20_1017_12282936_0_r1414758141_12.zip
Uploading the intermediate file: upload_file_12.zip
15:03:44 STEP 1249 H= 312:15 +CPU= 32.901
15:04:17 STEP 1250 H= 312:30 +CPU= 32.576
15:04:51 STEP 1251 H= 312:45 +CPU= 32.923
15:05:24 STEP 1252 H= 313:00 +CPU= 32.908
15:05:58 STEP 1253 H= 313:15 +CPU= 33.396
15:06:31 STEP 1254 H= 313:30 +CPU= 32.934
15:07:03 STEP 1255 H= 313:45 +CPU= 31.768
15:07:36 STEP 1256 H= 314:00 +CPU= 33.159
15:08:09 STEP 1257 H= 314:15 +CPU= 32.685
15:08:42 STEP 1258 H= 314:30 +CPU= 31.986
15:09:15 STEP 1259 H= 314:45 +CPU= 32.952
15:09:56 STEP 1260 H= 315:00 +CPU= 40.516
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001260
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001260
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001260
15:10:29 STEP 1261 H= 315:15 +CPU= 32.492
15:11:01 STEP 1262 H= 315:30 +CPU= 32.117
15:11:34 STEP 1263 H= 315:45 +CPU= 32.258
15:12:07 STEP 1264 H= 316:00 +CPU= 33.044
15:12:40 STEP 1265 H= 316:15 +CPU= 32.188
15:13:12 STEP 1266 H= 316:30 +CPU= 31.934
15:13:45 STEP 1267 H= 316:45 +CPU= 32.014
15:14:18 STEP 1268 H= 317:00 +CPU= 33.274
15:14:51 STEP 1269 H= 317:15 +CPU= 32.842
15:15:24 STEP 1270 H= 317:30 +CPU= 32.650
15:15:57 STEP 1271 H= 317:45 +CPU= 32.202
15:16:39 STEP 1272 H= 318:00 +CPU= 40.939
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001272
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001272
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001272
15:17:12 STEP 1273 H= 318:15 +CPU= 33.201
15:17:45 STEP 1274 H= 318:30 +CPU= 31.917
15:18:18 STEP 1275 H= 318:45 +CPU= 32.850
15:18:52 STEP 1276 H= 319:00 +CPU= 33.126
15:19:24 STEP 1277 H= 319:15 +CPU= 32.176
15:19:56 STEP 1278 H= 319:30 +CPU= 31.780
15:20:29 STEP 1279 H= 319:45 +CPU= 32.249
15:21:03 STEP 1280 H= 320:00 +CPU= 33.333
15:21:36 STEP 1281 H= 320:15 +CPU= 32.633
15:22:09 STEP 1282 H= 320:30 +CPU= 32.856
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
21:35:28 STEP 1283 H= 320:45 +CPU= 32.188
21:36:09 STEP 1284 H= 321:00 +CPU= 40.523
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001284
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001284
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001284
21:36:42 STEP 1285 H= 321:15 +CPU= 32.353
21:37:14 STEP 1286 H= 321:30 +CPU= 31.883
21:37:47 STEP 1287 H= 321:45 +CPU= 33.103
21:38:20 STEP 1288 H= 322:00 +CPU= 32.714
21:38:53 STEP 1289 H= 322:15 +CPU= 32.066
21:39:25 STEP 1290 H= 322:30 +CPU= 31.930
21:39:59 STEP 1291 H= 322:45 +CPU= 33.390
21:40:32 STEP 1292 H= 323:00 +CPU= 32.975
21:41:05 STEP 1293 H= 323:15 +CPU= 32.605
21:41:38 STEP 1294 H= 323:30 +CPU= 32.668
21:42:10 STEP 1295 H= 323:45 +CPU= 32.233
21:42:56 STEP 1296 H= 324:00 +CPU= 44.861
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001296
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001296
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001296
21:43:28 STEP 1297 H= 324:15 +CPU= 32.345
21:44:00 STEP 1298 H= 324:30 +CPU= 31.994
21:44:33 STEP 1299 H= 324:45 +CPU= 32.153
21:45:06 STEP 1300 H= 325:00 +CPU= 33.117
21:45:40 STEP 1301 H= 325:15 +CPU= 33.292
21:46:12 STEP 1302 H= 325:30 +CPU= 31.640
21:46:45 STEP 1303 H= 325:45 +CPU= 32.725
21:47:18 STEP 1304 H= 326:00 +CPU= 32.923
21:47:50 STEP 1305 H= 326:15 +CPU= 31.873
21:48:23 STEP 1306 H= 326:30 +CPU= 32.451
21:48:56 STEP 1307 H= 326:45 +CPU= 32.423
21:49:36 STEP 1308 H= 327:00 +CPU= 39.496
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001308
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001308
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001308
21:50:09 STEP 1309 H= 327:15 +CPU= 32.403
21:50:41 STEP 1310 H= 327:30 +CPU= 31.760
21:51:14 STEP 1311 H= 327:45 +CPU= 32.658
21:51:46 STEP 1312 H= 328:00 +CPU= 31.989
21:52:18 STEP 1313 H= 328:15 +CPU= 31.742
21:52:51 STEP 1314 H= 328:30 +CPU= 32.641
21:53:23 STEP 1315 H= 328:45 +CPU= 31.969
21:53:57 STEP 1316 H= 329:00 +CPU= 33.252
21:54:30 STEP 1317 H= 329:15 +CPU= 32.339
21:55:03 STEP 1318 H= 329:30 +CPU= 32.603
21:55:35 STEP 1319 H= 329:45 +CPU= 32.352
21:56:16 STEP 1320 H= 330:00 +CPU= 40.326
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001320
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001320
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001320
21:56:49 STEP 1321 H= 330:15 +CPU= 32.689
21:57:22 STEP 1322 H= 330:30 +CPU= 32.512
21:57:55 STEP 1323 H= 330:45 +CPU= 32.091
21:58:28 STEP 1324 H= 331:00 +CPU= 33.216
21:59:01 STEP 1325 H= 331:15 +CPU= 32.460
21:59:34 STEP 1326 H= 331:30 +CPU= 32.164
22:00:05 STEP 1327 H= 331:45 +CPU= 31.224
22:00:38 STEP 1328 H= 332:00 +CPU= 31.557
22:01:09 STEP 1329 H= 332:15 +CPU= 31.313
22:01:40 STEP 1330 H= 332:30 +CPU= 31.054
22:02:11 STEP 1331 H= 332:45 +CPU= 30.676
22:02:51 STEP 1332 H= 333:00 +CPU= 39.198
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001332
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001332
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001332
22:03:22 STEP 1333 H= 333:15 +CPU= 31.431
22:03:55 STEP 1334 H= 333:30 +CPU= 32.202
22:04:28 STEP 1335 H= 333:45 +CPU= 32.818
22:05:02 STEP 1336 H= 334:00 +CPU= 33.755
22:05:35 STEP 1337 H= 334:15 +CPU= 32.783
22:06:08 STEP 1338 H= 334:30 +CPU= 32.766
22:06:41 STEP 1339 H= 334:45 +CPU= 33.115
22:07:15 STEP 1340 H= 335:00 +CPU= 32.965
22:07:47 STEP 1341 H= 335:15 +CPU= 32.527
22:08:20 STEP 1342 H= 335:30 +CPU= 32.702
22:08:53 STEP 1343 H= 335:45 +CPU= 32.426
22:09:39 STEP 1344 H= 336:00 +CPU= 45.156
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001344
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001344
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001248
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001260
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001272
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001284
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001296
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001308
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001320
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001332
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001332
Zipping up the intermediate file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0ut_2016092300_20_1017_12282936_0_r1414758141_13.zip
Uploading the intermediate file: upload_file_13.zip
22:10:13 STEP 1345 H= 336:15 +CPU= 33.542
22:10:45 STEP 1346 H= 336:30 +CPU= 32.139
22:11:18 STEP 1347 H= 336:45 +CPU= 32.294
22:11:52 STEP 1348 H= 337:00 +CPU= 33.584
22:12:24 STEP 1349 H= 337:15 +CPU= 32.622
22:12:57 STEP 1350 H= 337:30 +CPU= 32.198
22:13:29 STEP 1351 H= 337:45 +CPU= 32.022
22:14:03 STEP 1352 H= 338:00 +CPU= 33.197
22:14:36 STEP 1353 H= 338:15 +CPU= 32.333
22:15:08 STEP 1354 H= 338:30 +CPU= 32.438
22:15:41 STEP 1355 H= 338:45 +CPU= 32.367
22:16:23 STEP 1356 H= 339:00 +CPU= 41.399
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001356
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001356
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001356
22:16:56 STEP 1357 H= 339:15 +CPU= 32.731
22:17:29 STEP 1358 H= 339:30 +CPU= 32.358
22:18:02 STEP 1359 H= 339:45 +CPU= 32.933
22:18:36 STEP 1360 H= 340:00 +CPU= 33.030
22:19:09 STEP 1361 H= 340:15 +CPU= 32.934
22:19:42 STEP 1362 H= 340:30 +CPU= 33.013
22:20:16 STEP 1363 H= 340:45 +CPU= 33.003
22:20:49 STEP 1364 H= 341:00 +CPU= 32.903
22:21:22 STEP 1365 H= 341:15 +CPU= 32.257
22:21:55 STEP 1366 H= 341:30 +CPU= 33.142
22:22:29 STEP 1367 H= 341:45 +CPU= 32.799
22:23:11 STEP 1368 H= 342:00 +CPU= 41.645
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001368
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001368
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001368
22:23:44 STEP 1369 H= 342:15 +CPU= 33.230
22:24:18 STEP 1370 H= 342:30 +CPU= 33.031
22:24:52 STEP 1371 H= 342:45 +CPU= 33.441
22:25:25 STEP 1372 H= 343:00 +CPU= 33.526
22:25:58 STEP 1373 H= 343:15 +CPU= 32.542
22:26:31 STEP 1374 H= 343:30 +CPU= 32.624
22:27:04 STEP 1375 H= 343:45 +CPU= 32.938
22:27:39 STEP 1376 H= 344:00 +CPU= 34.072
22:28:12 STEP 1377 H= 344:15 +CPU= 32.952
22:28:45 STEP 1378 H= 344:30 +CPU= 32.953
22:29:19 STEP 1379 H= 344:45 +CPU= 33.210
22:30:00 STEP 1380 H= 345:00 +CPU= 40.610
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001380
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001380
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001380
22:30:33 STEP 1381 H= 345:15 +CPU= 32.757
22:31:07 STEP 1382 H= 345:30 +CPU= 33.863
22:31:40 STEP 1383 H= 345:45 +CPU= 32.833
22:32:15 STEP 1384 H= 346:00 +CPU= 34.415
22:32:48 STEP 1385 H= 346:15 +CPU= 33.231
22:33:22 STEP 1386 H= 346:30 +CPU= 33.168
22:33:55 STEP 1387 H= 346:45 +CPU= 32.588
22:34:29 STEP 1388 H= 347:00 +CPU= 33.780
22:35:02 STEP 1389 H= 347:15 +CPU= 33.251
22:35:36 STEP 1390 H= 347:30 +CPU= 33.273
22:36:09 STEP 1391 H= 347:45 +CPU= 32.815
22:36:54 STEP 1392 H= 348:00 +CPU= 44.791
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001392
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001392
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001392
22:37:27 STEP 1393 H= 348:15 +CPU= 33.044
22:38:02 STEP 1394 H= 348:30 +CPU= 33.920
22:38:35 STEP 1395 H= 348:45 +CPU= 33.503
22:39:08 STEP 1396 H= 349:00 +CPU= 32.193
22:39:41 STEP 1397 H= 349:15 +CPU= 32.354
22:40:12 STEP 1398 H= 349:30 +CPU= 31.540
22:40:44 STEP 1399 H= 349:45 +CPU= 30.835
22:41:16 STEP 1400 H= 350:00 +CPU= 32.286
22:41:48 STEP 1401 H= 350:15 +CPU= 32.138
22:42:21 STEP 1402 H= 350:30 +CPU= 32.060
22:42:53 STEP 1403 H= 350:45 +CPU= 31.789
22:43:33 STEP 1404 H= 351:00 +CPU= 39.695
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001404
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001404
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001404
22:44:06 STEP 1405 H= 351:15 +CPU= 32.677
22:44:39 STEP 1406 H= 351:30 +CPU= 32.723
22:45:11 STEP 1407 H= 351:45 +CPU= 31.723
22:45:44 STEP 1408 H= 352:00 +CPU= 32.611
22:46:16 STEP 1409 H= 352:15 +CPU= 31.496
22:46:48 STEP 1410 H= 352:30 +CPU= 31.591
22:47:20 STEP 1411 H= 352:45 +CPU= 32.197
22:47:53 STEP 1412 H= 353:00 +CPU= 32.149
22:48:24 STEP 1413 H= 353:15 +CPU= 31.529
22:48:56 STEP 1414 H= 353:30 +CPU= 31.731
22:49:29 STEP 1415 H= 353:45 +CPU= 32.448
Suspend request received from the BOINC client, suspending the child process
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.062] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3555MB (heap), 4792MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.062] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.062] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x820890 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.062] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3843] 3555 MB (maxheap), 4792 MB (maxrss), 0 MB (maxstack)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : MASTER
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT2
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT3
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CNT4
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : STEPO
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : SCAN2M
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GP_MODEL
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CPG_DRV
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : >OMP-CPG (1025)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CPG
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : CPG_GP
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : GPXX
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231112:1718230272:32970.063] [c_drhook_print_@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:3897] : VERDER
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231113:1718230273:32971.063] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:107290:107290] [20240612:231113:1718230273:32971.063] [signal_drhook@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1cf8da0 for signal#15, nsigs = 1
forrtl: error (78): process killed (SIGTERM)
Image PC Routine Line Source
oifs_43r3_model.e 0000000001CF935B Unknown Unknown Unknown
oifs_43r3_model.e 00000000008214C1 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DD5490 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001783F49 Unknown Unknown Unknown
oifs_43r3_model.e 0000000000C7047C verder_ 106 verder.F90
oifs_43r3_model.e 0000000000D25971 gpxx_ 162 gpxx.F90
oifs_43r3_model.e 0000000000D18EA1 cpg_gp_ 923 cpg_gp.F90
oifs_43r3_model.e 0000000000C2432E cpg_ 627 cpg.F90
oifs_43r3_model.e 0000000000C22238 cpg_drv_ 351 cpg_drv.F90
oifs_43r3_model.e 0000000000BCC914 gp_model_ 419 gp_model.F90
oifs_43r3_model.e 00000000012C5002 gp_model_heap_ 74 gp_model_heap.F90
oifs_43r3_model.e 0000000000BACBAE scan2m_ 535 scan2m.F90
oifs_43r3_model.e 0000000000688153 stepo_ 327 stepo.F90
oifs_43r3_model.e 00000000004CD1DC cnt4_ 1133 cnt4.F90
oifs_43r3_model.e 00000000004B5D85 cnt3_ 267 cnt3.F90
oifs_43r3_model.e 00000000004B4F52 cnt2_ 88 cnt2.F90
oifs_43r3_model.e 000000000049D638 cnt1_ 92 cnt1.F90
oifs_43r3_model.e 0000000000406FBD cnt0_ 146 cnt0.F90
oifs_43r3_model.e 0000000000401E7F MAIN__ 96 master.F90
oifs_43r3_model.e 0000000000401E12 Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCC34A Unknown Unknown Unknown
oifs_43r3_model.e 0000000001DCDBE7 Unknown Unknown Unknown
oifs_43r3_model.e 0000000000401CD5 Unknown Unknown Unknown
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a0ut
(argv4) batchid: 1017
(argv5) wuid: 12282936
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /data/boinc/boinc-client/slots/12
Project directory is: /data/boinc/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936
..mkdir for temp folder for results failed
Copying: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /data/boinc/boinc-client/slots/12/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /data/boinc/boinc-client/slots/12/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_849e3646ec4c932b2018a999f80dac7a to: /data/boinc/boinc-client/slots/12/oifs_43r3_bl_a0ut_2016092300_20_1017_12282936.zip
Unzipping the namelist zip file: /data/boinc/boinc-client/slots/12/oifs_43r3_bl_a0ut_2016092300_20_1017_12282936.zip
ic_ancil_file: ic_ancil_12282936
ifsdata_file: ifsdata_12282936
climate_data_file: clim_data_12282936
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /data/boinc/boinc-client/slots/12/ic_ancil_12282936.zip
Unzipping the IC ancils zip file: /data/boinc/boinc-client/slots/12/ic_ancil_12282936.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_3120f634f52738f9a3759dcdc725eef6 to: /data/boinc/boinc-client/slots/12/ifsdata/ifsdata_12282936.zip
Unzipping the ifsdata_zip file: /data/boinc/boinc-client/slots/12/ifsdata/ifsdata_12282936.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /data/boinc/boinc-client/slots/12/159l_2/clim_data_12282936.zip
Unzipping the climate data zip file: /data/boinc/boinc-client/slots/12/159l_2/clim_data_12282936.zip
Checking for progress XML file: /data/boinc/boinc-client/slots/12/progress_file_12282936.xml
Opened progress file ok : /data/boinc/boinc-client/slots/12/progress_file_12282936.xml
-- Model is restarting --
Adjusting last_iter, 1416, to previous model restart step.
Creating progress file: /data/boinc/boinc-client/slots/12/progress_file_12282936.xml
last_cpu_time: 50500
upload_file_number: 14
last_iter: 1393
last_upload: 1209600
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a0ut_2016092300_20_1017_12282936_0_r1414758141
The child process has been launched with process id: 14184
Executing the command: /data/boinc/boinc-client/slots/12/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:victor-Precision-7920-Tower:1:1:14184:14184] [20240613:063240:1718256760:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
06:40:16 STEP 1392 H= 348:00 +CPU= 28.356
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
07:18:48 STEP 1393 H= 348:15 +CPU= 26.307
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:06:48 STEP 1394 H= 348:30 +CPU= 30.306
08:07:21 STEP 1395 H= 348:45 +CPU= 31.794
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
08:51:17 STEP 1396 H= 349:00 +CPU= 32.157
08:51:50 STEP 1397 H= 349:15 +CPU= 32.439
08:52:24 STEP 1398 H= 349:30 +CPU= 32.750
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:04:33 STEP 1399 H= 349:45 +CPU= 33.596
09:05:09 STEP 1400 H= 350:00 +CPU= 34.268
09:05:43 STEP 1401 H= 350:15 +CPU= 33.380
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
09:26:25 STEP 1402 H= 350:30 +CPU= 34.466
09:27:00 STEP 1403 H= 350:45 +CPU= 33.780
09:27:45 STEP 1404 H= 351:00 +CPU= 42.681
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001404
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001404
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001404
09:28:20 STEP 1405 H= 351:15 +CPU= 34.120
09:28:56 STEP 1406 H= 351:30 +CPU= 34.495
09:29:32 STEP 1407 H= 351:45 +CPU= 34.165
09:30:08 STEP 1408 H= 352:00 +CPU= 34.675
09:30:44 STEP 1409 H= 352:15 +CPU= 34.197
09:31:20 STEP 1410 H= 352:30 +CPU= 34.381
09:31:56 STEP 1411 H= 352:45 +CPU= 34.289
09:32:32 STEP 1412 H= 353:00 +CPU= 34.638
09:33:08 STEP 1413 H= 353:15 +CPU= 34.370
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:11:59 STEP 1414 H= 353:30 +CPU= 34.813
10:12:36 STEP 1415 H= 353:45 +CPU= 35.095
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:21:49 STEP 1416 H= 354:00 +CPU= 45.438
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001416
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001416
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001416
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:27:19 STEP 1417 H= 354:15 +CPU= 37.219
10:28:00 STEP 1418 H= 354:30 +CPU= 38.115
10:28:39 STEP 1419 H= 354:45 +CPU= 37.788
10:29:20 STEP 1420 H= 355:00 +CPU= 38.888
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
10:34:02 STEP 1421 H= 355:15 +CPU= 37.126
10:34:41 STEP 1422 H= 355:30 +CPU= 37.120
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:13:46 STEP 1423 H= 355:45 +CPU= 32.337
11:14:18 STEP 1424 H= 356:00 +CPU= 32.191
11:14:50 STEP 1425 H= 356:15 +CPU= 31.327
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
11:22:54 STEP 1426 H= 356:30 +CPU= 32.417
11:23:29 STEP 1427 H= 356:45 +CPU= 33.261
11:24:12 STEP 1428 H= 357:00 +CPU= 41.773
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001428
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001428
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001428
11:24:47 STEP 1429 H= 357:15 +CPU= 34.535
11:25:23 STEP 1430 H= 357:30 +CPU= 34.561
11:25:59 STEP 1431 H= 357:45 +CPU= 34.364
11:26:34 STEP 1432 H= 358:00 +CPU= 34.332
11:27:09 STEP 1433 H= 358:15 +CPU= 33.841
11:27:45 STEP 1434 H= 358:30 +CPU= 34.778
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:03:32 STEP 1435 H= 358:45 +CPU= 35.453
12:04:10 STEP 1436 H= 359:00 +CPU= 36.213
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
12:07:19 STEP 1437 H= 359:15 +CPU= 35.770
12:07:56 STEP 1438 H= 359:30 +CPU= 35.576
12:08:34 STEP 1439 H= 359:45 +CPU= 35.495
12:09:22 STEP 1440 H= 360:00 +CPU= 45.946
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01
DDH------------------------------------------------------------------------
I I
I TIME = 360.000H DDH * Diagnostic Var., AREA GLOBAL I
I I
I-------------------------------------------------------------------------I
I VARIABLE I Initial value I Current value I
I-------------------------------------------------------------------------I
I OMEGA (P/S) I -0.4243853710E-21 I 0.1685311028E-04 I
ICloud fractionI 0.0000000000E+00 I 0.4669885576E-01 I
I Relat. Hum. I 0.9118592431E-01 I 0.2518436028E+00 I
I PASS 01 I 0.0000000000E+00 I 0.7719308124E+03 I
DDH------------------------------------------------------------------------
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 1440 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+001440 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+001440
MPI-TASK: 1 - 300793828 BYTES IN 7 RECORDS TRANSFERRED IN 0.0009 SECONDS334215.4 Mbytes/s, TOTAL TIME= 0.0141( 6.4%)
12:09:22 STEP 1440 H= 360:00 +CPU= 45.946
END CNT3
NSTEP = 1440 CNT0 000000000 33.685 33.685 35.464 0.950 0 0 0 0 0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 46/ 1069125708 WRITTEN 1430/************
-TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL
OU-TOT IN -TOT OUT
1 28 0 46 1044068 1430 ************ 25.0 21.3 3.7 426.6 7.3
===-=== START OF TIMING STATISTICS ===-===
STATS FOR ALL TASKS
NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%)
0 CNT0 - COMPLETE EXECUTION 1 ********* ********* 100.00 0.00
1 CNT4 - FORWARD INTEGRATION 1 ********* ********* 97.88 0.00
8 SCAN2M - GRID-POINT DYNAMICS 53 77391.4 77391.4 20.30 0.00
9 SPCM - SPECTRAL COMP. 48 4091.8 4091.8 0.97 0.00
10 SCAN2M - PHYSICS 49 235201.3 235201.3 57.05 0.00
11 IOPACK - OUTPUT P.P. RESULTS 4 1178.8 1178.8 0.02 0.00
12 SPNORM - SPECTRAL NORM COMP. 3 47.6 47.6 0.00 0.00
17 GRIDFPOS IN CNT4 4 37.1 37.1 0.00 0.00
27 RESTART FILES - WRITING 1 4705.3 4705.3 0.02 0.00
28 RESTART FILES - READING 1 427546.7 427546.7 2.12 0.00
29 SU4FPOS IN CNT4 4 0.1 0.1 0.00 0.00
30 DYNFPOS IN CNT4 4 7657.1 7657.1 0.15 0.00
31 POSDDH IN STEPO 1 16.9 16.9 0.00 0.00
37 CPGLAG - SL COMPUTATIONS 49 59349.3 59349.3 14.39 0.00
39 SU0YOMB 1 489.5 489.5 0.00 0.00
51 SCAN2M - SL COMM. PART 1 49 24.5 24.5 0.01 0.00
54 SPCM - M TO S/S TO M TRANSP. 48 324.2 324.2 0.08 0.00
55 SPCIMPF - S TO M/M TO S TRANSP. 48 76.6 76.6 0.02 0.00
56 SPNORM - SPECTRAL NORM COMM. 3 0.2 0.2 0.00 0.00
102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 108 8389.2 8389.2 4.48 0.00
103 LTDIR_CTL - DIRECT LEGENDRE TRANSFORM 100 336.6 336.6 0.17 0.00
106 FTDIR_CTL - DIRECT FOURIER TRANSFORM 100 119.4 119.4 0.06 0.00
107 FTINV_CTL - INVERSE FOURIER TRANSFORM 108 165.0 165.0 0.09 0.00
140 SULEG - COMP. OF LEGENDRE POL. 1 45.4 45.4 0.00 0.00
152 LTINV_CTL - M TO L TRANSPOSITION 108 85.1 85.1 0.05 0.00
153 LTDIR_CTL - L TO M TRANSPOSITION 100 40.1 40.1 0.02 0.00
157 FTINV_CTL - L TO G TRANSPOSITION 108 71.0 71.0 0.04 0.00
158 FTDIR_CTL - G TO L TRANSPOSITION 100 21.0 21.0 0.01 0.00
400 GSTATS 6667 0.0 0.0 0.00 0.00
401 GSTATS HOOK 6149 0.0 0.0 0.00 0.00
TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT
TOTAL WALLCLOCK TIME 20202.7 CPU TIME 1717.4 VECTOR TIME 1717.4
===-=== END OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY 65.5
*** END CNT0 ***
------------------------------------------------
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMGGh7zg+001440
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMSHh7zg+001440
Moving to projects directory: /data/boinc/boinc-client/slots/12/ICMUAh7zg+001440
Adding to the zip: /data/boinc/boinc-client/slots/12/NODE.001_01
Adding to the zip: /data/boinc/boinc-client/slots/12/ifs.stat
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001368
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001380
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001404
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001392
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001416
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001428
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001344
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMUAh7zg+001440
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMGGh7zg+001356
Adding to the zip: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12282936/ICMSHh7zg+001344
Zipping up the final file: /data/boinc/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a0ut_2016092300_20_1017_12282936_0_r1414758141_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
12:12:59 (14140): called boinc_finish(0)
</stderr_txt>
<message>
upload failure: <file_xfer_error>
<file_name>oifs_43r3_bl_a0ut_2016092300_20_1017_12282936_0_r1414758141_15.zip</file_name>
<error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>oifs_43r3_bl_a0ut_2016092300_20_1017_12282936_0_r1414758141_16.zip</file_name>
<error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>oifs_43r3_bl_a0ut_2016092300_20_1017_12282936_0_r1414758141_17.zip</file_name>
<error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>oifs_43r3_bl_a0ut_2016092300_20_1017_12282936_0_r1414758141_18.zip</file_name>
<error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
<file_name>oifs_43r3_bl_a0ut_2016092300_20_1017_12282936_0_r1414758141_19.zip</file_name>
<error_code>-161 (not found)</error_code>
</file
