climateprediction.net home page
Task 22435476

Task 22435476

Name oifs_43r3_bl_a1li_2016092300_20_1017_12283897_0
Workunit 12283897
Created 7 Jun 2024, 13:50:33 UTC
Sent 7 Jun 2024, 14:09:17 UTC
Report deadline 6 Aug 2024, 14:09:17 UTC
Received 9 Jun 2024, 8:12:07 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1548968
Run time 11 hours 39 min 48 sec
CPU time 10 hours 47 min 13 sec
Validate state Invalid
Credit 1,976.32
Device peak FLOPS 7.55 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,011.36 MB
Peak swap size 5,980.80 MB
Peak disk usage 1,345.52 MB
Stderr
<core_client_version>7.22.1</core_client_version>
<![CDATA[
<stderr_txt>
3:16 STEP 1370 H= 342:30 +CPU= 24.901
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:53:47 STEP 1371 H= 342:45 +CPU= 24.485
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:54:17 STEP 1372 H= 343:00 +CPU= 24.599
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:54:47 STEP 1373 H= 343:15 +CPU= 23.348
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:55:16 STEP 1374 H= 343:30 +CPU= 23.015
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:55:44 STEP 1375 H= 343:45 +CPU= 22.413
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:56:13 STEP 1376 H= 344:00 +CPU= 22.559
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:56:40 STEP 1377 H= 344:15 +CPU= 23.146
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:57:07 STEP 1378 H= 344:30 +CPU= 20.540
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:57:36 STEP 1379 H= 344:45 +CPU= 22.732
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:58:15 STEP 1380 H= 345:00 +CPU= 30.616
Moving to projects directory: /home/karl_neu/slots/8/ICMGGh7zg+001380
Moving to projects directory: /home/karl_neu/slots/8/ICMSHh7zg+001380
Moving to projects directory: /home/karl_neu/slots/8/ICMUAh7zg+001380
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:58:45 STEP 1381 H= 345:15 +CPU= 24.104
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:59:15 STEP 1382 H= 345:30 +CPU= 23.791
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  19:59:44 STEP 1383 H= 345:45 +CPU= 23.493
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:00:14 STEP 1384 H= 346:00 +CPU= 23.441
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:00:41 STEP 1385 H= 346:15 +CPU= 22.771
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:01:10 STEP 1386 H= 346:30 +CPU= 23.055
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:01:37 STEP 1387 H= 346:45 +CPU= 20.729
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:02:09 STEP 1388 H= 347:00 +CPU= 25.749
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:02:39 STEP 1389 H= 347:15 +CPU= 24.722
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:03:10 STEP 1390 H= 347:30 +CPU= 24.583
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:03:40 STEP 1391 H= 347:45 +CPU= 23.800
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:04:19 STEP 1392 H= 348:00 +CPU= 30.708
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/karl_neu/slots/8/ICMGGh7zg+001392
Moving to projects directory: /home/karl_neu/slots/8/ICMSHh7zg+001392
Moving to projects directory: /home/karl_neu/slots/8/ICMUAh7zg+001392
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:04:47 STEP 1393 H= 348:15 +CPU= 21.910
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:05:19 STEP 1394 H= 348:30 +CPU= 25.445
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:05:50 STEP 1395 H= 348:45 +CPU= 24.874
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:06:20 STEP 1396 H= 349:00 +CPU= 24.669
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:06:51 STEP 1397 H= 349:15 +CPU= 24.030
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:07:20 STEP 1398 H= 349:30 +CPU= 23.731
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:07:50 STEP 1399 H= 349:45 +CPU= 23.429
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:08:19 STEP 1400 H= 350:00 +CPU= 22.464
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:08:46 STEP 1401 H= 350:15 +CPU= 21.455
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:09:10 STEP 1402 H= 350:30 +CPU= 22.195
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:09:37 STEP 1403 H= 350:45 +CPU= 20.702
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:10:17 STEP 1404 H= 351:00 +CPU= 31.249
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/karl_neu/slots/8/ICMGGh7zg+001404
Moving to projects directory: /home/karl_neu/slots/8/ICMSHh7zg+001404
Moving to projects directory: /home/karl_neu/slots/8/ICMUAh7zg+001404
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:10:47 STEP 1405 H= 351:15 +CPU= 24.250
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:11:16 STEP 1406 H= 351:30 +CPU= 23.308
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:11:44 STEP 1407 H= 351:45 +CPU= 21.874
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:12:10 STEP 1408 H= 352:00 +CPU= 23.906
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:12:40 STEP 1409 H= 352:15 +CPU= 23.599
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:13:11 STEP 1410 H= 352:30 +CPU= 24.926
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:13:41 STEP 1411 H= 352:45 +CPU= 23.967
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:14:31 STEP 1412 H= 353:00 +CPU= 23.537
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:15:01 STEP 1413 H= 353:15 +CPU= 23.805
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:15:31 STEP 1414 H= 353:30 +CPU= 24.000
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:16:00 STEP 1415 H= 353:45 +CPU= 22.594
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:16:36 STEP 1416 H= 354:00 +CPU= 27.891
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/karl_neu/slots/8/ICMGGh7zg+001416
Moving to projects directory: /home/karl_neu/slots/8/ICMSHh7zg+001416
Moving to projects directory: /home/karl_neu/slots/8/ICMUAh7zg+001416
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:17:02 STEP 1417 H= 354:15 +CPU= 22.097
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:17:31 STEP 1418 H= 354:30 +CPU= 22.812
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:18:00 STEP 1419 H= 354:45 +CPU= 23.132
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:18:34 STEP 1420 H= 355:00 +CPU= 25.635
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:19:05 STEP 1421 H= 355:15 +CPU= 25.415
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:19:35 STEP 1422 H= 355:30 +CPU= 23.759
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:20:05 STEP 1423 H= 355:45 +CPU= 24.006
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:20:36 STEP 1424 H= 356:00 +CPU= 23.693
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:21:04 STEP 1425 H= 356:15 +CPU= 22.219
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:21:31 STEP 1426 H= 356:30 +CPU= 23.229
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:21:59 STEP 1427 H= 356:45 +CPU= 20.613
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:22:45 STEP 1428 H= 357:00 +CPU= 19.865
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/karl_neu/slots/8/ICMGGh7zg+001428
Moving to projects directory: /home/karl_neu/slots/8/ICMSHh7zg+001428
Moving to projects directory: /home/karl_neu/slots/8/ICMUAh7zg+001428
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  20:23:38 STEP 1429 H= 357:15 +CPU= 14.240
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Quit request received from the BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a1li
(argv4) batchid: 1017
(argv5) wuid: 12283897
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /home/karl_neu/slots/8
Project directory is: /home/karl_neu/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897
..mkdir for temp folder for results failed
Copying: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /home/karl_neu/slots/8/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /home/karl_neu/slots/8/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_dcef92e9c323e16b60606f0678e83a8b to: /home/karl_neu/slots/8/oifs_43r3_bl_a1li_2016092300_20_1017_12283897.zip
Unzipping the namelist zip file: /home/karl_neu/slots/8/oifs_43r3_bl_a1li_2016092300_20_1017_12283897.zip
ic_ancil_file: ic_ancil_12283897
ifsdata_file: ifsdata_12283897
climate_data_file: clim_data_12283897
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /home/karl_neu/slots/8/ic_ancil_12283897.zip
Unzipping the IC ancils zip file: /home/karl_neu/slots/8/ic_ancil_12283897.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_63a56d264118aedb9d95a70becfe5eda to: /home/karl_neu/slots/8/ifsdata/ifsdata_12283897.zip
Unzipping the ifsdata_zip file: /home/karl_neu/slots/8/ifsdata/ifsdata_12283897.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/karl_neu/slots/8/159l_2/clim_data_12283897.zip
Unzipping the climate data zip file: /home/karl_neu/slots/8/159l_2/clim_data_12283897.zip
Checking for progress XML file: /home/karl_neu/slots/8/progress_file_12283897.xml
Opened progress file ok : /home/karl_neu/slots/8/progress_file_12283897.xml
-- Model is restarting --
Adjusting last_iter, 1429, to previous model restart step.
Creating progress file: /home/karl_neu/slots/8/progress_file_12283897.xml
last_cpu_time: 37732
upload_file_number: 14
last_iter: 1393
last_upload: 1209600
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a1li_2016092300_20_1017_12283897_0_r1928123104
The child process has been launched with process id: 88
Executing the command: /home/karl_neu/slots/8/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:karl-Micro-Star:1:1:88:88] [20240609:091114:1717917074:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:12:04 STEP 1392 H= 348:00 +CPU= 14.776
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:12:37 STEP 1393 H= 348:15 +CPU= 13.895
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:13:11 STEP 1394 H= 348:30 +CPU= 13.918
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:13:42 STEP 1395 H= 348:45 +CPU= 14.087
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:14:19 STEP 1396 H= 349:00 +CPU= 17.020
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:14:49 STEP 1397 H= 349:15 +CPU= 23.612
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:15:19 STEP 1398 H= 349:30 +CPU= 23.783
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:15:48 STEP 1399 H= 349:45 +CPU= 22.898
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:16:17 STEP 1400 H= 350:00 +CPU= 22.879
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:16:46 STEP 1401 H= 350:15 +CPU= 22.395
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:17:11 STEP 1402 H= 350:30 +CPU= 21.459
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:17:37 STEP 1403 H= 350:45 +CPU= 21.737
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:18:11 STEP 1404 H= 351:00 +CPU= 27.671
Moving to projects directory: /home/karl_neu/slots/8/ICMGGh7zg+001404
Moving to projects directory: /home/karl_neu/slots/8/ICMSHh7zg+001404
Moving to projects directory: /home/karl_neu/slots/8/ICMUAh7zg+001404
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:18:38 STEP 1405 H= 351:15 +CPU= 22.547
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:19:06 STEP 1406 H= 351:30 +CPU= 22.626
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:19:31 STEP 1407 H= 351:45 +CPU= 21.998
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:19:58 STEP 1408 H= 352:00 +CPU= 21.186
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:20:24 STEP 1409 H= 352:15 +CPU= 20.222
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:20:51 STEP 1410 H= 352:30 +CPU= 22.392
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:21:21 STEP 1411 H= 352:45 +CPU= 22.828
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:21:56 STEP 1412 H= 353:00 +CPU= 24.750
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:22:27 STEP 1413 H= 353:15 +CPU= 24.068
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:22:58 STEP 1414 H= 353:30 +CPU= 23.614
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:23:28 STEP 1415 H= 353:45 +CPU= 23.128
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:24:06 STEP 1416 H= 354:00 +CPU= 28.434
Moving to projects directory: /home/karl_neu/slots/8/ICMGGh7zg+001416
Moving to projects directory: /home/karl_neu/slots/8/ICMSHh7zg+001416
Moving to projects directory: /home/karl_neu/slots/8/ICMUAh7zg+001416
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:24:35 STEP 1417 H= 354:15 +CPU= 22.309
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:25:02 STEP 1418 H= 354:30 +CPU= 21.705
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:25:31 STEP 1419 H= 354:45 +CPU= 22.363
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:25:59 STEP 1420 H= 355:00 +CPU= 20.401
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:26:28 STEP 1421 H= 355:15 +CPU= 21.677
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:26:59 STEP 1422 H= 355:30 +CPU= 24.348
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:27:30 STEP 1423 H= 355:45 +CPU= 23.956
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:28:00 STEP 1424 H= 356:00 +CPU= 23.615
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:28:29 STEP 1425 H= 356:15 +CPU= 23.029
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:28:57 STEP 1426 H= 356:30 +CPU= 22.332
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:29:25 STEP 1427 H= 356:45 +CPU= 22.153
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:29:59 STEP 1428 H= 357:00 +CPU= 27.129
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Moving to projects directory: /home/karl_neu/slots/8/ICMGGh7zg+001428
Moving to projects directory: /home/karl_neu/slots/8/ICMSHh7zg+001428
Moving to projects directory: /home/karl_neu/slots/8/ICMUAh7zg+001428
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:30:26 STEP 1429 H= 357:15 +CPU= 20.831
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:30:56 STEP 1430 H= 357:30 +CPU= 24.651
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:31:27 STEP 1431 H= 357:45 +CPU= 24.345
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:31:57 STEP 1432 H= 358:00 +CPU= 24.402
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:32:26 STEP 1433 H= 358:15 +CPU= 23.092
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:32:55 STEP 1434 H= 358:30 +CPU= 22.580
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:33:25 STEP 1435 H= 358:45 +CPU= 23.312
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:33:55 STEP 1436 H= 359:00 +CPU= 23.953
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:34:22 STEP 1437 H= 359:15 +CPU= 23.357
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:34:52 STEP 1438 H= 359:30 +CPU= 23.481
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:35:20 STEP 1439 H= 359:45 +CPU= 22.510
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  09:35:57 STEP 1440 H= 360:00 +CPU= 28.122
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  360.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I     -0.6297402700E-21      I       0.1461874295E-06      I
ICloud fractionI      0.0000000000E+00      I       0.9440086917E-03      I
I  Relat. Hum. I      0.4422519227E+00      I       0.4492544287E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.2101845157E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1440 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001440 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001440
 MPI-TASK:   1 -    629008484 BYTES IN      7 RECORDS TRANSFERRED IN    0.0004 SECONDS******** Mbytes/s, TOTAL TIME=    0.0100( 4.0%)
 09:35:57 STEP 1440 H= 360:00 +CPU= 28.122
 END CNT3
 NSTEP =  1440 CNT0   000000000  20.027  20.027  26.155   0.766               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         1430/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1     28    0       46      1044068     1430 ************    17.3    13.5     3.8    14.2     5.7
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 1483086.2 1483086.2    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 1467861.4 1467861.4     98.97      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                   53    5818.2    5818.2     20.79      0.00
   9 SPCM     - SPECTRAL COMP.                      48     860.8     860.8      2.79      0.00
  10 SCAN2M - PHYSICS                               49   13084.3   13084.3     43.23      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                  4    1178.8    1178.8      0.32      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  3      56.6      56.6      0.01      0.00
  17 GRIDFPOS IN CNT4                                4      25.4      25.4      0.01      0.00
  27 RESTART FILES - WRITING                         1    4715.1    4715.1      0.32      0.00
  28 RESTART FILES - READING                         1   14730.0   14730.0      0.99      0.00
  29 SU4FPOS IN CNT4                                 4       0.1       0.1      0.00      0.00
  30 DYNFPOS IN CNT4                                 4    6081.6    6081.6      1.64      0.00
  31 POSDDH IN STEPO                                 1       1.4       1.4      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                     49    6417.5    6417.5     21.20      0.00
  39 SU0YOMB                                         1     263.9     263.9      0.02      0.00
  51 SCAN2M   - SL COMM. PART 1                     49      20.2      20.2      0.07      0.00
  54 SPCM     - M TO S/S TO M TRANSP.               48     246.7     246.7      0.80      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.               48      58.7      58.7      0.19      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  3       0.2       0.2      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      108     401.5     401.5      2.92      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       100     274.9     274.9      1.85      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        100      88.5      88.5      0.60      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       108     137.6     137.6      1.00      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      19.3      19.3      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            108     103.6     103.6      0.75      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            100      35.2      35.2      0.24      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            108      77.6      77.6      0.57      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            100      36.8      36.8      0.25      0.00
 400 GSTATS                                       6667       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                  6149       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     1483.1 CPU TIME    1100.9 VECTOR TIME     1100.9


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      882.9
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /home/karl_neu/slots/8/ICMGGh7zg+001440
Moving to projects directory: /home/karl_neu/slots/8/ICMSHh7zg+001440
Moving to projects directory: /home/karl_neu/slots/8/ICMUAh7zg+001440
Adding to the zip: /home/karl_neu/slots/8/NODE.001_01
Adding to the zip: /home/karl_neu/slots/8/ifs.stat
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMGGh7zg+001344
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMSHh7zg+001344
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMUAh7zg+001344
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMGGh7zg+001356
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMSHh7zg+001356
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMUAh7zg+001356
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMGGh7zg+001368
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMSHh7zg+001368
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMUAh7zg+001368
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMGGh7zg+001380
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMSHh7zg+001380
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMUAh7zg+001380
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMGGh7zg+001392
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMSHh7zg+001392
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMUAh7zg+001392
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMGGh7zg+001404
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMSHh7zg+001404
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMUAh7zg+001404
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMGGh7zg+001416
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMSHh7zg+001416
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMUAh7zg+001416
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMGGh7zg+001428
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMSHh7zg+001428
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMUAh7zg+001428
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMGGh7zg+001440
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMSHh7zg+001440
Adding to the zip: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_12283897/ICMUAh7zg+001440
Zipping up the final file: /home/karl_neu/projects/climateprediction.net/oifs_43r3_bl_a1li_2016092300_20_1017_12283897_0_r1928123104_14.zip
Uploading the final file: upload_file_14.zip
Uploading trickle at timestep: 1295100
09:39:25 (69): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>oifs_43r3_bl_a1li_2016092300_20_1017_12283897_0_r1928123104_15.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1li_2016092300_20_1017_12283897_0_r1928123104_16.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1li_2016092300_20_1017_12283897_0_r1928123104_17.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1li_2016092300_20_1017_12283897_0_r1928123104_18.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>oifs_43r3_bl_a1li_2016092300_20_1017_12283897_0_r1928123104_19.zip</file_name>
  <error_code>-161 (not found)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
09 Jun 2024 08:12:53 1548968 22435476 oifs_43r3_bl_a1li_2016092300_20_1017_12283897_0 1,295,100 38,833 0.0300
08 Jun 2024 15:35:30 1548968 22435476 oifs_43r3_bl_a1li_2016092300_20_1017_12283897_0 950,400 28,674 0.0302


©2024 cpdn.org