climateprediction.net home page
Task 22257071

Task 22257071

Name oifs_43r3_ps_0935_1986050100_123_955_12172579_0
Workunit 12172579
Created 21 Dec 2022, 9:55:57 UTC
Sent 21 Dec 2022, 10:03:44 UTC
Report deadline 20 Jan 2023, 10:03:44 UTC
Received 22 Dec 2022, 12:11:57 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 196 (0x000000C4) EXIT_DISK_LIMIT_EXCEEDED
Computer ID 1535357
Run time 13 hours 42 min 38 sec
CPU time 12 hours 23 min 13 sec
Validate state Invalid
Credit 0.00
Device peak FLOPS 2.80 GFLOPS
Application version OpenIFS 43r3 Perturbed Surface v1.05
x86_64-pc-linux-gnu
Peak working set size 4,409.45 MB
Peak swap size 4,978.08 MB
Peak disk usage 7,436.41 MB
Stderr
<core_client_version>7.18.1</core_client_version>
<![CDATA[
<message>
Disk usage limit exceeded</message>
<stderr_txt>
x/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.003] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.003] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.003] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.004] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7271:7271] [20221221:230401:1671681841:0.004] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  23:05:37 STEP  288 H= 288:00 +CPU= 82.435
  23:06:26 STEP  289 H= 289:00 +CPU= 45.327
  23:07:16 STEP  290 H= 290:00 +CPU= 46.903
  23:08:33 STEP  291 H= 291:00 +CPU= 71.606
  23:09:22 STEP  292 H= 292:00 +CPU= 46.210
  23:10:11 STEP  293 H= 293:00 +CPU= 45.837
  23:11:32 STEP  294 H= 294:00 +CPU= 74.112
  23:12:21 STEP  295 H= 295:00 +CPU= 46.743
  23:13:11 STEP  296 H= 296:00 +CPU= 46.664
  23:14:28 STEP  297 H= 297:00 +CPU= 72.158
  23:15:25 STEP  298 H= 298:00 +CPU= 53.485
  23:16:15 STEP  299 H= 299:00 +CPU= 47.989
  23:17:45 STEP  300 H= 300:00 +CPU= 82.588
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000300
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000300
  23:18:36 STEP  301 H= 301:00 +CPU= 47.687
  23:19:27 STEP  302 H= 302:00 +CPU= 48.653
  23:20:46 STEP  303 H= 303:00 +CPU= 74.903
  23:21:36 STEP  304 H= 304:00 +CPU= 47.982
  23:22:24 STEP  305 H= 305:00 +CPU= 46.226
  23:23:44 STEP  306 H= 306:00 +CPU= 75.704
  23:24:33 STEP  307 H= 307:00 +CPU= 45.736
  23:25:23 STEP  308 H= 308:00 +CPU= 48.039
  23:26:42 STEP  309 H= 309:00 +CPU= 74.083
  23:27:32 STEP  310 H= 310:00 +CPU= 46.919
  23:28:24 STEP  311 H= 311:00 +CPU= 47.311
  23:29:57 STEP  312 H= 312:00 +CPU= 85.314
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000312
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000288
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000300
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000300
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_12.zip
Uploading the intermediate file: upload_file_12.zip
  23:30:46 STEP  313 H= 313:00 +CPU= 46.587
  23:31:37 STEP  314 H= 314:00 +CPU= 47.906
  23:32:55 STEP  315 H= 315:00 +CPU= 74.182
  23:33:45 STEP  316 H= 316:00 +CPU= 47.709
  23:34:36 STEP  317 H= 317:00 +CPU= 47.619
  23:35:56 STEP  318 H= 318:00 +CPU= 76.726
  23:36:46 STEP  319 H= 319:00 +CPU= 47.215
  23:37:36 STEP  320 H= 320:00 +CPU= 48.356
  23:38:54 STEP  321 H= 321:00 +CPU= 74.297
  23:39:44 STEP  322 H= 322:00 +CPU= 47.906
  23:40:30 STEP  323 H= 323:00 +CPU= 45.267
  23:41:55 STEP  324 H= 324:00 +CPU= 80.926
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000324
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000324
  23:42:43 STEP  325 H= 325:00 +CPU= 45.813
  23:43:33 STEP  326 H= 326:00 +CPU= 47.564
  23:44:49 STEP  327 H= 327:00 +CPU= 72.804
  23:45:38 STEP  328 H= 328:00 +CPU= 47.470
  23:46:26 STEP  329 H= 329:00 +CPU= 45.438
  23:47:43 STEP  330 H= 330:00 +CPU= 72.715
  23:48:30 STEP  331 H= 331:00 +CPU= 45.249
  23:49:20 STEP  332 H= 332:00 +CPU= 47.200
  23:50:36 STEP  333 H= 333:00 +CPU= 71.804
  23:51:25 STEP  334 H= 334:00 +CPU= 45.168
  23:52:12 STEP  335 H= 335:00 +CPU= 45.478
  23:53:42 STEP  336 H= 336:00 +CPU= 84.063
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000336
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000312
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000324
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000324
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_13.zip
Uploading the intermediate file: upload_file_13.zip
  23:54:31 STEP  337 H= 337:00 +CPU= 44.910
  23:55:20 STEP  338 H= 338:00 +CPU= 46.000
  23:56:34 STEP  339 H= 339:00 +CPU= 71.404
  23:57:21 STEP  340 H= 340:00 +CPU= 45.664
  23:58:09 STEP  341 H= 341:00 +CPU= 45.800
  23:59:25 STEP  342 H= 342:00 +CPU= 73.535
  00:00:13 STEP  343 H= 343:00 +CPU= 44.678
  00:01:02 STEP  344 H= 344:00 +CPU= 46.490
  00:02:17 STEP  345 H= 345:00 +CPU= 71.687
  00:03:07 STEP  346 H= 346:00 +CPU= 47.647
  00:03:59 STEP  347 H= 347:00 +CPU= 47.424
  00:05:30 STEP  348 H= 348:00 +CPU= 84.189
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000348
  00:06:20 STEP  349 H= 349:00 +CPU= 46.555
  00:07:13 STEP  350 H= 350:00 +CPU= 48.594
  00:08:34 STEP  351 H= 351:00 +CPU= 75.227
  00:09:25 STEP  352 H= 352:00 +CPU= 48.742
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1986050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0935
(argv4) batchid: 955
(argv5) wuid: 12172579
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/39
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/39/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/39/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ae1757528ccfa0ce3c624f06c4efe42c to: /var/lib/boinc-client/slots/39/oifs_43r3_ps_0935_1986050100_123_955_12172579.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/39/oifs_43r3_ps_0935_1986050100_123_955_12172579.zip
ic_ancil_file: ic_ancil_12172579
ifsdata_file: ifsdata_12172579
climate_data_file: clim_data_12172579
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_57c44770a9e9e35518c37c04a4f8cf1a to: /var/lib/boinc-client/slots/39/ic_ancil_12172579.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/39/ic_ancil_12172579.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_25f2f1739a91eeb079c934f395f1681a to: /var/lib/boinc-client/slots/39/ifsdata/ifsdata_12172579.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/39/ifsdata/ifsdata_12172579.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/39/159l_2/clim_data_12172579.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/39/159l_2/clim_data_12172579.zip
Checking for progress XML file: /var/lib/boinc-client/slots/39/progress_file_12172579.xml
Opened progress file ok : /var/lib/boinc-client/slots/39/progress_file_12172579.xml
-- Model is restarting --
Adjusting last_iter, 352, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/39/progress_file_12172579.xml
last_cpu_time: 24057
upload_file_number: 14
last_iter: 335
last_upload: 1209600
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445
The child process has been launched with process id: 7493
Executing the command: /var/lib/boinc-client/slots/39/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.003] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7493:7493] [20221222:001146:1671685906:0.003] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  00:13:18 STEP  336 H= 336:00 +CPU= 81.252
  00:14:05 STEP  337 H= 337:00 +CPU= 44.332
  00:14:53 STEP  338 H= 338:00 +CPU= 44.980
  00:16:08 STEP  339 H= 339:00 +CPU= 71.626
  00:16:56 STEP  340 H= 340:00 +CPU= 45.670
  00:17:43 STEP  341 H= 341:00 +CPU= 43.938
  00:19:01 STEP  342 H= 342:00 +CPU= 71.571
  00:19:47 STEP  343 H= 343:00 +CPU= 44.095
  00:20:34 STEP  344 H= 344:00 +CPU= 45.464
  00:21:49 STEP  345 H= 345:00 +CPU= 71.147
  00:22:37 STEP  346 H= 346:00 +CPU= 45.757
  00:23:24 STEP  347 H= 347:00 +CPU= 44.444
  00:24:47 STEP  348 H= 348:00 +CPU= 78.398
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000348
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000348
  00:25:35 STEP  349 H= 349:00 +CPU= 44.443
  00:26:24 STEP  350 H= 350:00 +CPU= 46.011
  00:27:39 STEP  351 H= 351:00 +CPU= 71.626
  00:28:27 STEP  352 H= 352:00 +CPU= 45.984
  00:29:16 STEP  353 H= 353:00 +CPU= 45.797
  00:30:33 STEP  354 H= 354:00 +CPU= 72.632
  00:31:20 STEP  355 H= 355:00 +CPU= 44.988
  00:32:07 STEP  356 H= 356:00 +CPU= 45.319
  00:33:21 STEP  357 H= 357:00 +CPU= 71.026
  00:34:08 STEP  358 H= 358:00 +CPU= 44.187
  00:34:58 STEP  359 H= 359:00 +CPU= 45.919
  00:36:32 STEP  360 H= 360:00 +CPU= 82.071
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000360
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000360
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000336
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000348
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000348
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_14.zip
Uploading the intermediate file: upload_file_14.zip
  00:37:20 STEP  361 H= 361:00 +CPU= 43.082
  00:38:08 STEP  362 H= 362:00 +CPU= 44.769
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           14  MAX ETADOT VERTICAL VEL.=   2.374974229678404E-006
  LON  =    127.500000000000       degrees
  LAT  =   -37.5698795904715       degrees
  00:39:34 STEP  363 H= 363:00 +CPU= 78.056
  00:40:30 STEP  364 H= 364:00 +CPU= 48.720
  00:41:19 STEP  365 H= 365:00 +CPU= 45.738
  00:42:41 STEP  366 H= 366:00 +CPU= 75.147
  00:43:30 STEP  367 H= 367:00 +CPU= 45.497
  00:44:21 STEP  368 H= 368:00 +CPU= 47.240
 SMILAG TRAJECTORY UNDERGROUND      1 TIMES.
  POINT=           15  MAX ETADOT VERTICAL VEL.=   3.856648947407458E-008
  LON  =    126.250000000000       degrees
  LAT  =   -40.9343383242788       degrees
  00:45:42 STEP  369 H= 369:00 +CPU= 73.589
  00:46:34 STEP  370 H= 370:00 +CPU= 47.429
  00:47:26 STEP  371 H= 371:00 +CPU= 46.558
  00:48:58 STEP  372 H= 372:00 +CPU= 81.447
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000372
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000372
  00:49:47 STEP  373 H= 373:00 +CPU= 44.948
  00:50:38 STEP  374 H= 374:00 +CPU= 46.557
  00:52:03 STEP  375 H= 375:00 +CPU= 76.159
  00:52:55 STEP  376 H= 376:00 +CPU= 47.226
  00:53:44 STEP  377 H= 377:00 +CPU= 44.779
  00:55:10 STEP  378 H= 378:00 +CPU= 77.816
  00:56:00 STEP  379 H= 379:00 +CPU= 45.867
  00:56:49 STEP  380 H= 380:00 +CPU= 46.601
  00:58:06 STEP  381 H= 381:00 +CPU= 73.835
  00:58:56 STEP  382 H= 382:00 +CPU= 46.837
  00:59:46 STEP  383 H= 383:00 +CPU= 46.516
  01:01:23 STEP  384 H= 384:00 +CPU= 88.274
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000384
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000360
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000372
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000372
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_15.zip
Uploading the intermediate file: upload_file_15.zip
  01:02:12 STEP  385 H= 385:00 +CPU= 45.251
  01:03:04 STEP  386 H= 386:00 +CPU= 47.251
  01:04:21 STEP  387 H= 387:00 +CPU= 71.708
  01:05:12 STEP  388 H= 388:00 +CPU= 46.851
  01:06:02 STEP  389 H= 389:00 +CPU= 44.111
  01:07:28 STEP  390 H= 390:00 +CPU= 73.769
  01:08:18 STEP  391 H= 391:00 +CPU= 45.486
  01:09:17 STEP  392 H= 392:00 +CPU= 49.045
  01:10:36 STEP  393 H= 393:00 +CPU= 74.747
  01:11:31 STEP  394 H= 394:00 +CPU= 51.725
  01:12:20 STEP  395 H= 395:00 +CPU= 46.193
  01:13:54 STEP  396 H= 396:00 +CPU= 85.868
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000396
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000396
  01:14:42 STEP  397 H= 397:00 +CPU= 46.320
  01:15:32 STEP  398 H= 398:00 +CPU= 47.118
  01:16:46 STEP  399 H= 399:00 +CPU= 71.685
  01:17:36 STEP  400 H= 400:00 +CPU= 46.946
  01:18:23 STEP  401 H= 401:00 +CPU= 45.275
  01:19:42 STEP  402 H= 402:00 +CPU= 75.239
  01:20:29 STEP  403 H= 403:00 +CPU= 44.609
  01:21:18 STEP  404 H= 404:00 +CPU= 46.889
  01:22:34 STEP  405 H= 405:00 +CPU= 72.853
  01:23:23 STEP  406 H= 406:00 +CPU= 46.797
  01:24:16 STEP  407 H= 407:00 +CPU= 50.569
  01:25:54 STEP  408 H= 408:00 +CPU= 90.727
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000408
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000384
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000396
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000396
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_16.zip
Uploading the intermediate file: upload_file_16.zip
  01:26:46 STEP  409 H= 409:00 +CPU= 47.368
  01:27:35 STEP  410 H= 410:00 +CPU= 46.473
  01:28:54 STEP  411 H= 411:00 +CPU= 73.129
  01:29:43 STEP  412 H= 412:00 +CPU= 46.232
  01:30:33 STEP  413 H= 413:00 +CPU= 45.898
  01:31:52 STEP  414 H= 414:00 +CPU= 74.105
  01:32:41 STEP  415 H= 415:00 +CPU= 45.480
  01:33:31 STEP  416 H= 416:00 +CPU= 46.884
  01:34:50 STEP  417 H= 417:00 +CPU= 72.787
  01:35:39 STEP  418 H= 418:00 +CPU= 46.406
  01:36:28 STEP  419 H= 419:00 +CPU= 45.128
  01:37:55 STEP  420 H= 420:00 +CPU= 80.700
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000420
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000420
  01:38:42 STEP  421 H= 421:00 +CPU= 45.357
  01:39:32 STEP  422 H= 422:00 +CPU= 46.127
  01:40:49 STEP  423 H= 423:00 +CPU= 72.471
  01:41:37 STEP  424 H= 424:00 +CPU= 46.137
  01:42:22 STEP  425 H= 425:00 +CPU= 44.047
  01:43:40 STEP  426 H= 426:00 +CPU= 73.921
  01:44:27 STEP  427 H= 427:00 +CPU= 44.789
  01:45:15 STEP  428 H= 428:00 +CPU= 46.160
  01:46:31 STEP  429 H= 429:00 +CPU= 72.236
  01:47:19 STEP  430 H= 430:00 +CPU= 46.353
  01:48:09 STEP  431 H= 431:00 +CPU= 46.662
  01:49:41 STEP  432 H= 432:00 +CPU= 88.716
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000432
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000408
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000420
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000420
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_17.zip
Uploading the intermediate file: upload_file_17.zip
  01:50:30 STEP  433 H= 433:00 +CPU= 47.547
  01:51:19 STEP  434 H= 434:00 +CPU= 48.119
  01:52:38 STEP  435 H= 435:00 +CPU= 76.294
  01:53:34 STEP  436 H= 436:00 +CPU= 46.936
  01:54:21 STEP  437 H= 437:00 +CPU= 45.139
  01:55:37 STEP  438 H= 438:00 +CPU= 73.160
  01:56:23 STEP  439 H= 439:00 +CPU= 44.004
  01:57:11 STEP  440 H= 440:00 +CPU= 45.844
  01:58:23 STEP  441 H= 441:00 +CPU= 70.912
  01:59:10 STEP  442 H= 442:00 +CPU= 46.415
  01:59:58 STEP  443 H= 443:00 +CPU= 45.156
  02:01:32 STEP  444 H= 444:00 +CPU= 90.567
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000444
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000444
  02:02:24 STEP  445 H= 445:00 +CPU= 49.528
  02:03:13 STEP  446 H= 446:00 +CPU= 46.590
  02:04:32 STEP  447 H= 447:00 +CPU= 72.449
  02:05:23 STEP  448 H= 448:00 +CPU= 46.992
  02:06:14 STEP  449 H= 449:00 +CPU= 46.133
  02:07:35 STEP  450 H= 450:00 +CPU= 74.695
  02:08:27 STEP  451 H= 451:00 +CPU= 45.622
  02:09:18 STEP  452 H= 452:00 +CPU= 46.036
  02:10:35 STEP  453 H= 453:00 +CPU= 71.635
  02:11:28 STEP  454 H= 454:00 +CPU= 47.988
  02:12:21 STEP  455 H= 455:00 +CPU= 46.557
  02:13:57 STEP  456 H= 456:00 +CPU= 87.808
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000456
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000432
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000444
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000444
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_18.zip
Uploading the intermediate file: upload_file_18.zip
  02:14:48 STEP  457 H= 457:00 +CPU= 45.519
  02:15:40 STEP  458 H= 458:00 +CPU= 46.897
  02:17:00 STEP  459 H= 459:00 +CPU= 71.915
  02:17:51 STEP  460 H= 460:00 +CPU= 46.958
  02:18:40 STEP  461 H= 461:00 +CPU= 44.815
  02:20:03 STEP  462 H= 462:00 +CPU= 73.065
  02:20:52 STEP  463 H= 463:00 +CPU= 44.791
  02:21:45 STEP  464 H= 464:00 +CPU= 46.773
  02:23:13 STEP  465 H= 465:00 +CPU= 73.536
  02:24:10 STEP  466 H= 466:00 +CPU= 46.971
  02:25:09 STEP  467 H= 467:00 +CPU= 52.822
  02:26:50 STEP  468 H= 468:00 +CPU= 91.142
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000468
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000468
  02:27:44 STEP  469 H= 469:00 +CPU= 50.133
  02:28:41 STEP  470 H= 470:00 +CPU= 51.874
  02:30:13 STEP  471 H= 471:00 +CPU= 79.868
  02:31:23 STEP  472 H= 472:00 +CPU= 52.898
  02:32:26 STEP  473 H= 473:00 +CPU= 50.417
  02:34:10 STEP  474 H= 474:00 +CPU= 82.456
  02:35:11 STEP  475 H= 475:00 +CPU= 50.286
  02:36:13 STEP  476 H= 476:00 +CPU= 51.287
  02:37:58 STEP  477 H= 477:00 +CPU= 83.064
  02:39:00 STEP  478 H= 478:00 +CPU= 49.329
  02:40:00 STEP  479 H= 479:00 +CPU= 48.750
  02:41:44 STEP  480 H= 480:00 +CPU= 85.952
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000480
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000456
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000468
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000468
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_19.zip
Uploading the intermediate file: upload_file_19.zip
  02:42:43 STEP  481 H= 481:00 +CPU= 50.301
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu
(argv1) start_date: 1986050100
(argv2) exptid: hq0f
(argv3) unique_member_id: 0935
(argv4) batchid: 955
(argv5) wuid: 12172579
(argv6) fclen: 123
(argv7) app_name: oifs_43r3_ps
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/39
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_ps
version: 1.05
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/39/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/39/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_ae1757528ccfa0ce3c624f06c4efe42c to: /var/lib/boinc-client/slots/39/oifs_43r3_ps_0935_1986050100_123_955_12172579.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/39/oifs_43r3_ps_0935_1986050100_123_955_12172579.zip
ic_ancil_file: ic_ancil_12172579
ifsdata_file: ifsdata_12172579
climate_data_file: clim_data_12172579
horiz_resolution: 159
vert_resolution: 60
grid_type: l_2
upload_interval: 24
utstep: 3600
nfrres: restart dump frequency (steps) 24
Copying IC ancils from: ../../projects/climateprediction.net/jf_57c44770a9e9e35518c37c04a4f8cf1a to: /var/lib/boinc-client/slots/39/ic_ancil_12172579.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/39/ic_ancil_12172579.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_25f2f1739a91eeb079c934f395f1681a to: /var/lib/boinc-client/slots/39/ifsdata/ifsdata_12172579.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/39/ifsdata/ifsdata_12172579.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/39/159l_2/clim_data_12172579.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/39/159l_2/clim_data_12172579.zip
Checking for progress XML file: /var/lib/boinc-client/slots/39/progress_file_12172579.xml
Opened progress file ok : /var/lib/boinc-client/slots/39/progress_file_12172579.xml
-- Model is restarting --
Adjusting last_iter, 482, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/39/progress_file_12172579.xml
last_cpu_time: 32395
upload_file_number: 20
last_iter: 479
last_upload: 1728000
model_completed: 0
total_length_of_simulation: 10627200
result_base_name: oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445
The child process has been launched with process id: 7865
Executing the command: /var/lib/boinc-client/slots/39/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.001] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0)
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil))
[EC_DRHOOK:BOINC:1:1:7865:7865] [20221222:024526:1671695126:0.002] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
  02:47:08 STEP  480 H= 480:00 +CPU= 82.030
  02:48:01 STEP  481 H= 481:00 +CPU= 45.209
  02:48:55 STEP  482 H= 482:00 +CPU= 47.450
  02:50:18 STEP  483 H= 483:00 +CPU= 72.735
  02:51:13 STEP  484 H= 484:00 +CPU= 47.539
  02:52:02 STEP  485 H= 485:00 +CPU= 45.063
  02:53:28 STEP  486 H= 486:00 +CPU= 75.244
  02:54:19 STEP  487 H= 487:00 +CPU= 45.358
  02:55:12 STEP  488 H= 488:00 +CPU= 46.029
  02:56:36 STEP  489 H= 489:00 +CPU= 72.601
  02:57:27 STEP  490 H= 490:00 +CPU= 46.464
  02:58:21 STEP  491 H= 491:00 +CPU= 45.388
  02:59:53 STEP  492 H= 492:00 +CPU= 81.179
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000492
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000492
  03:00:44 STEP  493 H= 493:00 +CPU= 45.659
  03:01:36 STEP  494 H= 494:00 +CPU= 47.758
  03:02:58 STEP  495 H= 495:00 +CPU= 73.417
  03:03:49 STEP  496 H= 496:00 +CPU= 47.504
  03:04:40 STEP  497 H= 497:00 +CPU= 47.580
  03:06:04 STEP  498 H= 498:00 +CPU= 75.411
  03:06:53 STEP  499 H= 499:00 +CPU= 45.419
  03:07:46 STEP  500 H= 500:00 +CPU= 49.595
  03:09:08 STEP  501 H= 501:00 +CPU= 74.913
  03:09:59 STEP  502 H= 502:00 +CPU= 48.221
  03:10:52 STEP  503 H= 503:00 +CPU= 50.431
  03:12:37 STEP  504 H= 504:00 +CPU= 91.249
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000504
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000480
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000492
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000492
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_20.zip
Uploading the intermediate file: upload_file_20.zip
  03:13:38 STEP  505 H= 505:00 +CPU= 49.118
  03:14:36 STEP  506 H= 506:00 +CPU= 47.342
  03:16:02 STEP  507 H= 507:00 +CPU= 72.094
  03:16:54 STEP  508 H= 508:00 +CPU= 45.667
  03:17:46 STEP  509 H= 509:00 +CPU= 44.855
  03:19:10 STEP  510 H= 510:00 +CPU= 72.729
  03:20:03 STEP  511 H= 511:00 +CPU= 45.992
  03:21:07 STEP  512 H= 512:00 +CPU= 52.471
  03:22:30 STEP  513 H= 513:00 +CPU= 73.555
  03:23:25 STEP  514 H= 514:00 +CPU= 49.181
  03:24:17 STEP  515 H= 515:00 +CPU= 46.508
  03:25:47 STEP  516 H= 516:00 +CPU= 80.634
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000516
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000516
  03:26:38 STEP  517 H= 517:00 +CPU= 44.795
  03:27:34 STEP  518 H= 518:00 +CPU= 47.760
  03:28:54 STEP  519 H= 519:00 +CPU= 73.987
  03:29:47 STEP  520 H= 520:00 +CPU= 48.055
  03:30:42 STEP  521 H= 521:00 +CPU= 48.369
  03:32:04 STEP  522 H= 522:00 +CPU= 74.536
  03:32:55 STEP  523 H= 523:00 +CPU= 45.528
  03:33:46 STEP  524 H= 524:00 +CPU= 46.498
  03:35:06 STEP  525 H= 525:00 +CPU= 72.202
  03:36:03 STEP  526 H= 526:00 +CPU= 47.910
  03:37:01 STEP  527 H= 527:00 +CPU= 52.164
  03:38:37 STEP  528 H= 528:00 +CPU= 84.524
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000528
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000504
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000516
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000516
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_21.zip
Uploading the intermediate file: upload_file_21.zip
  03:39:28 STEP  529 H= 529:00 +CPU= 45.102
  03:40:20 STEP  530 H= 530:00 +CPU= 46.813
  03:41:41 STEP  531 H= 531:00 +CPU= 71.740
  03:42:41 STEP  532 H= 532:00 +CPU= 50.377
  03:43:38 STEP  533 H= 533:00 +CPU= 49.195
  03:44:58 STEP  534 H= 534:00 +CPU= 74.854
  03:45:52 STEP  535 H= 535:00 +CPU= 45.410
  03:46:44 STEP  536 H= 536:00 +CPU= 46.473
  03:48:09 STEP  537 H= 537:00 +CPU= 72.736
  03:49:02 STEP  538 H= 538:00 +CPU= 47.931
  03:49:57 STEP  539 H= 539:00 +CPU= 49.704
  03:51:25 STEP  540 H= 540:00 +CPU= 81.422
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000540
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000540
  03:52:14 STEP  541 H= 541:00 +CPU= 45.304
  03:53:05 STEP  542 H= 542:00 +CPU= 47.674
  03:54:26 STEP  543 H= 543:00 +CPU= 74.099
  03:55:22 STEP  544 H= 544:00 +CPU= 50.128
  03:56:20 STEP  545 H= 545:00 +CPU= 50.855
  03:57:55 STEP  546 H= 546:00 +CPU= 78.559
  03:58:54 STEP  547 H= 547:00 +CPU= 47.072
  03:59:52 STEP  548 H= 548:00 +CPU= 47.185
  04:01:25 STEP  549 H= 549:00 +CPU= 73.840
  04:02:25 STEP  550 H= 550:00 +CPU= 48.009
  04:03:19 STEP  551 H= 551:00 +CPU= 47.297
  04:05:03 STEP  552 H= 552:00 +CPU= 84.581
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000552
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000528
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000540
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000540
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_22.zip
Uploading the intermediate file: upload_file_22.zip
  04:05:58 STEP  553 H= 553:00 +CPU= 46.840
  04:06:59 STEP  554 H= 554:00 +CPU= 48.458
  04:08:29 STEP  555 H= 555:00 +CPU= 79.476
  04:09:20 STEP  556 H= 556:00 +CPU= 47.041
  04:10:08 STEP  557 H= 557:00 +CPU= 45.555
  04:11:30 STEP  558 H= 558:00 +CPU= 75.918
  04:12:23 STEP  559 H= 559:00 +CPU= 50.711
  04:13:16 STEP  560 H= 560:00 +CPU= 48.136
  04:14:32 STEP  561 H= 561:00 +CPU= 71.977
  04:15:27 STEP  562 H= 562:00 +CPU= 48.880
  04:16:14 STEP  563 H= 563:00 +CPU= 44.326
  04:17:38 STEP  564 H= 564:00 +CPU= 78.301
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000564
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000564
  04:18:25 STEP  565 H= 565:00 +CPU= 44.061
  04:19:14 STEP  566 H= 566:00 +CPU= 45.969
  04:20:32 STEP  567 H= 567:00 +CPU= 72.866
  04:21:29 STEP  568 H= 568:00 +CPU= 49.004
  04:22:20 STEP  569 H= 569:00 +CPU= 46.498
  04:23:40 STEP  570 H= 570:00 +CPU= 73.946
  04:24:33 STEP  571 H= 571:00 +CPU= 47.303
  04:25:24 STEP  572 H= 572:00 +CPU= 47.921
  04:26:41 STEP  573 H= 573:00 +CPU= 72.101
  04:27:30 STEP  574 H= 574:00 +CPU= 47.084
  04:28:22 STEP  575 H= 575:00 +CPU= 47.656
  04:30:11 STEP  576 H= 576:00 +CPU= 90.754
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000576
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000552
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000564
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000564
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_23.zip
Uploading the intermediate file: upload_file_23.zip
  04:31:09 STEP  577 H= 577:00 +CPU= 47.259
  04:32:06 STEP  578 H= 578:00 +CPU= 46.406
  04:33:31 STEP  579 H= 579:00 +CPU= 72.000
  04:34:27 STEP  580 H= 580:00 +CPU= 46.907
  04:35:19 STEP  581 H= 581:00 +CPU= 45.010
  04:36:47 STEP  582 H= 582:00 +CPU= 75.006
  04:37:42 STEP  583 H= 583:00 +CPU= 49.263
  04:38:35 STEP  584 H= 584:00 +CPU= 46.840
  04:39:57 STEP  585 H= 585:00 +CPU= 73.570
  04:40:55 STEP  586 H= 586:00 +CPU= 50.033
  04:41:50 STEP  587 H= 587:00 +CPU= 46.440
  04:43:23 STEP  588 H= 588:00 +CPU= 80.940
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000588
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000588
  04:44:16 STEP  589 H= 589:00 +CPU= 49.199
  04:45:06 STEP  590 H= 590:00 +CPU= 47.052
  04:46:20 STEP  591 H= 591:00 +CPU= 70.174
  04:47:09 STEP  592 H= 592:00 +CPU= 45.977
  04:47:57 STEP  593 H= 593:00 +CPU= 44.434
  04:49:17 STEP  594 H= 594:00 +CPU= 72.705
  04:50:08 STEP  595 H= 595:00 +CPU= 45.887
  04:50:58 STEP  596 H= 596:00 +CPU= 46.399
  04:52:16 STEP  597 H= 597:00 +CPU= 72.215
  04:53:05 STEP  598 H= 598:00 +CPU= 46.163
  04:53:55 STEP  599 H= 599:00 +CPU= 46.965
  04:55:26 STEP  600 H= 600:00 +CPU= 83.805
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000600
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000576
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000588
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000588
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_24.zip
Uploading the intermediate file: upload_file_24.zip
  04:56:15 STEP  601 H= 601:00 +CPU= 45.703
  04:57:05 STEP  602 H= 602:00 +CPU= 45.430
  04:58:21 STEP  603 H= 603:00 +CPU= 69.934
  04:59:09 STEP  604 H= 604:00 +CPU= 45.887
  04:59:57 STEP  605 H= 605:00 +CPU= 43.318
  05:01:22 STEP  606 H= 606:00 +CPU= 72.637
  05:02:13 STEP  607 H= 607:00 +CPU= 44.870
  05:03:12 STEP  608 H= 608:00 +CPU= 48.746
  05:04:42 STEP  609 H= 609:00 +CPU= 72.347
  05:05:32 STEP  610 H= 610:00 +CPU= 44.901
  05:06:21 STEP  611 H= 611:00 +CPU= 44.134
  05:07:50 STEP  612 H= 612:00 +CPU= 78.946
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000612
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000612
  05:08:42 STEP  613 H= 613:00 +CPU= 44.559
  05:09:35 STEP  614 H= 614:00 +CPU= 46.449
  05:10:54 STEP  615 H= 615:00 +CPU= 70.413
  05:11:46 STEP  616 H= 616:00 +CPU= 45.207
  05:12:32 STEP  617 H= 617:00 +CPU= 43.693
  05:13:52 STEP  618 H= 618:00 +CPU= 71.671
  05:14:53 STEP  619 H= 619:00 +CPU= 47.915
  05:15:46 STEP  620 H= 620:00 +CPU= 46.220
  05:17:12 STEP  621 H= 621:00 +CPU= 71.249
  05:18:05 STEP  622 H= 622:00 +CPU= 45.604
  05:19:00 STEP  623 H= 623:00 +CPU= 46.782
  05:20:35 STEP  624 H= 624:00 +CPU= 82.986
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000624
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000600
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000612
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000612
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_25.zip
Uploading the intermediate file: upload_file_25.zip
  05:21:33 STEP  625 H= 625:00 +CPU= 46.767
  05:22:32 STEP  626 H= 626:00 +CPU= 47.072
  05:23:59 STEP  627 H= 627:00 +CPU= 72.251
  05:24:52 STEP  628 H= 628:00 +CPU= 45.801
  05:25:41 STEP  629 H= 629:00 +CPU= 44.308
  05:27:05 STEP  630 H= 630:00 +CPU= 73.626
  05:27:54 STEP  631 H= 631:00 +CPU= 45.372
  05:28:48 STEP  632 H= 632:00 +CPU= 46.545
  05:30:12 STEP  633 H= 633:00 +CPU= 72.226
  05:31:02 STEP  634 H= 634:00 +CPU= 45.637
  05:31:51 STEP  635 H= 635:00 +CPU= 44.184
  05:33:18 STEP  636 H= 636:00 +CPU= 78.558
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000636
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000636
  05:34:09 STEP  637 H= 637:00 +CPU= 44.164
  05:35:01 STEP  638 H= 638:00 +CPU= 45.698
  05:36:29 STEP  639 H= 639:00 +CPU= 75.206
  05:37:31 STEP  640 H= 640:00 +CPU= 51.129
  05:38:21 STEP  641 H= 641:00 +CPU= 45.299
  05:39:54 STEP  642 H= 642:00 +CPU= 77.021
  05:40:47 STEP  643 H= 643:00 +CPU= 46.176
  05:41:44 STEP  644 H= 644:00 +CPU= 47.861
  05:43:03 STEP  645 H= 645:00 +CPU= 71.752
  05:43:54 STEP  646 H= 646:00 +CPU= 46.318
  05:44:55 STEP  647 H= 647:00 +CPU= 49.100
  05:46:31 STEP  648 H= 648:00 +CPU= 84.589
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000648
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000624
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000636
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000636
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_26.zip
Uploading the intermediate file: upload_file_26.zip
  05:47:27 STEP  649 H= 649:00 +CPU= 45.512
  05:48:21 STEP  650 H= 650:00 +CPU= 46.573
  05:49:44 STEP  651 H= 651:00 +CPU= 72.033
  05:50:36 STEP  652 H= 652:00 +CPU= 46.657
  05:51:31 STEP  653 H= 653:00 +CPU= 47.468
  05:52:53 STEP  654 H= 654:00 +CPU= 74.489
  05:53:43 STEP  655 H= 655:00 +CPU= 45.178
  05:54:33 STEP  656 H= 656:00 +CPU= 45.933
  05:55:54 STEP  657 H= 657:00 +CPU= 74.726
  05:56:49 STEP  658 H= 658:00 +CPU= 50.050
  05:57:37 STEP  659 H= 659:00 +CPU= 45.448
  05:59:04 STEP  660 H= 660:00 +CPU= 81.306
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000660
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000660
  05:59:53 STEP  661 H= 661:00 +CPU= 45.700
  06:00:47 STEP  662 H= 662:00 +CPU= 46.730
  06:02:07 STEP  663 H= 663:00 +CPU= 73.785
  06:02:58 STEP  664 H= 664:00 +CPU= 46.374
  06:03:49 STEP  665 H= 665:00 +CPU= 46.851
  06:05:12 STEP  666 H= 666:00 +CPU= 77.137
  06:06:01 STEP  667 H= 667:00 +CPU= 45.945
  06:06:53 STEP  668 H= 668:00 +CPU= 47.194
  06:08:15 STEP  669 H= 669:00 +CPU= 71.527
  06:09:13 STEP  670 H= 670:00 +CPU= 46.882
  06:10:03 STEP  671 H= 671:00 +CPU= 45.983
  06:11:35 STEP  672 H= 672:00 +CPU= 82.867
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000672
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000672
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000648
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMGGhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMSHhq0f+000660
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12172579/ICMUAhq0f+000660
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_ps_0935_1986050100_123_955_12172579_0_r1216231445_27.zip
Uploading the intermediate file: upload_file_27.zip
  06:12:25 STEP  673 H= 673:00 +CPU= 44.521
  06:13:18 STEP  674 H= 674:00 +CPU= 46.963
  06:14:40 STEP  675 H= 675:00 +CPU= 72.152
  06:15:35 STEP  676 H= 676:00 +CPU= 48.185
  06:16:23 STEP  677 H= 677:00 +CPU= 45.245
  06:17:47 STEP  678 H= 678:00 +CPU= 74.425
  06:18:50 STEP  679 H= 679:00 +CPU= 49.589
  06:19:50 STEP  680 H= 680:00 +CPU= 47.955
  06:21:21 STEP  681 H= 681:00 +CPU= 72.647
  06:22:14 STEP  682 H= 682:00 +CPU= 46.424
  06:23:06 STEP  683 H= 683:00 +CPU= 44.885
  06:24:41 STEP  684 H= 684:00 +CPU= 79.615
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMGGhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMSHhq0f+000684
Moving to projects directory: /var/lib/boinc-client/slots/39/ICMUAhq0f+000684
  06:25:34 STEP  685 H= 685:00 +CPU= 44.073
  06:26:27 STEP  686 H= 686:00 +CPU= 45.136
  06:27:56 STEP  687 H= 687:00 +CPU= 72.891
  06:28:55 STEP  688 H= 688:00 +CPU= 46.828
  06:29:50 STEP  689 H= 689:00 +CPU= 46.173
  06:31:22 STEP  690 H= 690:00 +CPU= 77.441
  06:32:19 STEP  691 H= 691:00 +CPU= 46.315
  06:33:07 STEP  692 H= 692:00 +CPU= 44.517
  06:34:20 STEP  693 H= 693:00 +CPU= 69.018
  06:35:08 STEP  694 H= 694:00 +CPU= 44.663
  06:35:55 STEP  695 H= 695:00 +CPU= 45.658
Abort request received from BOINC client, ending the child process

</stderr_txt>
]]>
No trickles!


©2024 cpdn.org