climateprediction.net home page
Task 22507349

Task 22507349

Name oifs_43r3_bl_a4ho_2016092300_20_1018_12294147_2
Workunit 12294147
Created 18 Aug 2024, 14:23:06 UTC
Sent 18 Aug 2024, 14:23:14 UTC
Report deadline 17 Oct 2024, 14:23:14 UTC
Received 19 Aug 2024, 4:59:13 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1534256
Run time 11 hours 34 min 21 sec
CPU time 11 hours 25 min 50 sec
Validate state Valid
Credit 2,635.55
Device peak FLOPS 3.12 GFLOPS
Application version OpenIFS 43r3 Baroclinic Lifecycle v1.13
x86_64-pc-linux-gnu
Peak working set size 5,003.09 MB
Peak swap size 5,981.13 MB
Peak disk usage 1,348.76 MB
Stderr
<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
ory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001608
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001608
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:46:31 STEP 1609 H= 402:15 +CPU= 21.077
  21:46:54 STEP 1610 H= 402:30 +CPU= 21.566
  21:47:15 STEP 1611 H= 402:45 +CPU= 21.368
  21:47:36 STEP 1612 H= 403:00 +CPU= 20.652
  21:47:56 STEP 1613 H= 403:15 +CPU= 19.371
  21:48:15 STEP 1614 H= 403:30 +CPU= 19.085
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:48:56 STEP 1615 H= 403:45 +CPU= 19.678
  21:49:18 STEP 1616 H= 404:00 +CPU= 21.554
  21:49:40 STEP 1617 H= 404:15 +CPU= 21.008
  21:50:01 STEP 1618 H= 404:30 +CPU= 21.532
  21:50:23 STEP 1619 H= 404:45 +CPU= 20.865
  21:50:47 STEP 1620 H= 405:00 +CPU= 23.890
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001620
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001620
  21:51:06 STEP 1621 H= 405:15 +CPU= 19.101
  21:51:27 STEP 1622 H= 405:30 +CPU= 19.876
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:52:09 STEP 1623 H= 405:45 +CPU= 21.194
  21:52:30 STEP 1624 H= 406:00 +CPU= 20.109
  21:52:49 STEP 1625 H= 406:15 +CPU= 19.011
  21:53:08 STEP 1626 H= 406:30 +CPU= 19.178
  21:53:29 STEP 1627 H= 406:45 +CPU= 20.198
  21:53:50 STEP 1628 H= 407:00 +CPU= 20.768
  21:54:09 STEP 1629 H= 407:15 +CPU= 18.862
  21:54:28 STEP 1630 H= 407:30 +CPU= 18.984
  21:54:48 STEP 1631 H= 407:45 +CPU= 20.018
  21:55:18 STEP 1632 H= 408:00 +CPU= 28.881
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001632
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001632
  21:55:40 STEP 1633 H= 408:15 +CPU= 21.364
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001548
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001560
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001572
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001584
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001596
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001608
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001620
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001632
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001632
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4ho_2016092300_20_1018_12294147_2_r1607478237_16.zip
Uploading the intermediate file: upload_file_16.zip
  21:56:00 STEP 1634 H= 408:30 +CPU= 19.544
  21:56:19 STEP 1635 H= 408:45 +CPU= 19.243
  21:56:39 STEP 1636 H= 409:00 +CPU= 19.529
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:57:22 STEP 1637 H= 409:15 +CPU= 21.447
  21:57:43 STEP 1638 H= 409:30 +CPU= 20.890
  21:58:03 STEP 1639 H= 409:45 +CPU= 19.741
  21:58:23 STEP 1640 H= 410:00 +CPU= 19.922
  21:58:43 STEP 1641 H= 410:15 +CPU= 19.638
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  21:59:25 STEP 1642 H= 410:30 +CPU= 20.016
  21:59:44 STEP 1643 H= 410:45 +CPU= 19.445
  22:00:09 STEP 1644 H= 411:00 +CPU= 23.796
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001644
  22:00:28 STEP 1645 H= 411:15 +CPU= 19.136
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:01:09 STEP 1646 H= 411:30 +CPU= 19.953
  22:01:29 STEP 1647 H= 411:45 +CPU= 19.155
  22:01:49 STEP 1648 H= 412:00 +CPU= 19.845
  22:02:10 STEP 1649 H= 412:15 +CPU= 20.356
  22:02:32 STEP 1650 H= 412:30 +CPU= 21.624
  22:02:53 STEP 1651 H= 412:45 +CPU= 21.171
  22:03:15 STEP 1652 H= 413:00 +CPU= 21.175
  22:03:34 STEP 1653 H= 413:15 +CPU= 19.083
  22:03:54 STEP 1654 H= 413:30 +CPU= 19.414
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:04:35 STEP 1655 H= 413:45 +CPU= 19.054
  22:05:02 STEP 1656 H= 414:00 +CPU= 26.225
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001656
  22:05:24 STEP 1657 H= 414:15 +CPU= 21.130
  22:05:44 STEP 1658 H= 414:30 +CPU= 19.993
  22:06:03 STEP 1659 H= 414:45 +CPU= 19.352
  22:06:23 STEP 1660 H= 415:00 +CPU= 19.176
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:07:04 STEP 1661 H= 415:15 +CPU= 19.652
  22:07:25 STEP 1662 H= 415:30 +CPU= 20.947
  22:07:46 STEP 1663 H= 415:45 +CPU= 21.147
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:08:28 STEP 1664 H= 416:00 +CPU= 20.220
  22:08:47 STEP 1665 H= 416:15 +CPU= 18.938
  22:09:06 STEP 1666 H= 416:30 +CPU= 18.483
  22:09:25 STEP 1667 H= 416:45 +CPU= 19.030
  22:09:50 STEP 1668 H= 417:00 +CPU= 24.281
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001668
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:10:32 STEP 1669 H= 417:15 +CPU= 21.008
  22:10:54 STEP 1670 H= 417:30 +CPU= 21.278
  22:11:15 STEP 1671 H= 417:45 +CPU= 21.134
  22:11:37 STEP 1672 H= 418:00 +CPU= 21.347
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:12:18 STEP 1673 H= 418:15 +CPU= 19.242
  22:12:36 STEP 1674 H= 418:30 +CPU= 18.483
  22:12:56 STEP 1675 H= 418:45 +CPU= 19.033
  22:13:15 STEP 1676 H= 419:00 +CPU= 19.373
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:13:57 STEP 1677 H= 419:15 +CPU= 20.503
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:14:41 STEP 1678 H= 419:30 +CPU= 21.212
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:15:21 STEP 1679 H= 419:45 +CPU= 19.499
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4ho
(argv4) batchid: 1018
(argv5) wuid: 12294147
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_caadeaa001339c4022e7cddccab55a11 to: /var/lib/boinc-client/slots/1/oifs_43r3_bl_a4ho_2016092300_20_1018_12294147.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_bl_a4ho_2016092300_20_1018_12294147.zip
ic_ancil_file: ic_ancil_12294147
ifsdata_file: ifsdata_12294147
climate_data_file: clim_data_12294147
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/1/ic_ancil_12294147.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12294147.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0c3dc51cebba71c7166f5f2c7cf49578 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12294147.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12294147.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12294147.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12294147.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12294147.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12294147.xml
-- Model is restarting --
Adjusting last_iter, 1680, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12294147.xml
last_cpu_time: 36091
upload_file_number: 17
last_iter: 1681
last_upload: 1469700
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a4ho_2016092300_20_1018_12294147_2_r1607478237
The child process has been launched with process id: 1993942
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:optimus:1:1:1993942:1993942] [20240818:221640:1724033800:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:17:26 STEP 1680 H= 420:00 +CPU= 21.795
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001680
  22:17:47 STEP 1681 H= 420:15 +CPU= 20.932
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:18:31 STEP 1682 H= 420:30 +CPU= 20.878
  22:18:49 STEP 1683 H= 420:45 +CPU= 18.531
  22:19:09 STEP 1684 H= 421:00 +CPU= 19.168
  22:19:28 STEP 1685 H= 421:15 +CPU= 19.188
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:20:10 STEP 1686 H= 421:30 +CPU= 20.421
  22:20:31 STEP 1687 H= 421:45 +CPU= 20.348
  22:20:50 STEP 1688 H= 422:00 +CPU= 18.677
  22:21:08 STEP 1689 H= 422:15 +CPU= 17.970
  22:21:26 STEP 1690 H= 422:30 +CPU= 17.733
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:22:07 STEP 1691 H= 422:45 +CPU= 20.165
  22:22:34 STEP 1692 H= 423:00 +CPU= 26.605
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001692
  22:22:56 STEP 1693 H= 423:15 +CPU= 20.878
  22:23:17 STEP 1694 H= 423:30 +CPU= 21.061
  22:23:39 STEP 1695 H= 423:45 +CPU= 21.201
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:24:22 STEP 1696 H= 424:00 +CPU= 20.817
  22:24:42 STEP 1697 H= 424:15 +CPU= 19.697
  22:25:01 STEP 1698 H= 424:30 +CPU= 18.772
  22:25:21 STEP 1699 H= 424:45 +CPU= 19.662
  22:25:40 STEP 1700 H= 425:00 +CPU= 19.288
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:26:24 STEP 1701 H= 425:15 +CPU= 21.205
  22:26:46 STEP 1702 H= 425:30 +CPU= 21.080
  22:27:07 STEP 1703 H= 425:45 +CPU= 20.808
  22:27:31 STEP 1704 H= 426:00 +CPU= 23.729
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001704
  22:27:50 STEP 1705 H= 426:15 +CPU= 19.008
  22:28:10 STEP 1706 H= 426:30 +CPU= 19.998
  22:28:32 STEP 1707 H= 426:45 +CPU= 21.383
  22:28:54 STEP 1708 H= 427:00 +CPU= 21.658
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:29:37 STEP 1709 H= 427:15 +CPU= 20.020
  22:29:56 STEP 1710 H= 427:30 +CPU= 19.462
  22:30:16 STEP 1711 H= 427:45 +CPU= 19.628
  22:30:36 STEP 1712 H= 428:00 +CPU= 19.754
  22:30:56 STEP 1713 H= 428:15 +CPU= 19.519
  22:31:17 STEP 1714 H= 428:30 +CPU= 20.612
  22:31:38 STEP 1715 H= 428:45 +CPU= 20.981
  22:32:04 STEP 1716 H= 429:00 +CPU= 25.527
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001716
  22:32:24 STEP 1717 H= 429:15 +CPU= 19.190
  22:32:43 STEP 1718 H= 429:30 +CPU= 19.239
  22:33:04 STEP 1719 H= 429:45 +CPU= 19.861
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:33:46 STEP 1720 H= 430:00 +CPU= 21.573
  22:34:08 STEP 1721 H= 430:15 +CPU= 20.821
  22:34:28 STEP 1722 H= 430:30 +CPU= 19.843
  22:34:47 STEP 1723 H= 430:45 +CPU= 19.062
  22:35:07 STEP 1724 H= 431:00 +CPU= 19.513
  22:35:27 STEP 1725 H= 431:15 +CPU= 20.089
  22:35:48 STEP 1726 H= 431:30 +CPU= 20.843
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:36:30 STEP 1727 H= 431:45 +CPU= 19.595
  22:36:56 STEP 1728 H= 432:00 +CPU= 25.170
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001728
  22:37:15 STEP 1729 H= 432:15 +CPU= 19.099
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001728
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4ho_2016092300_20_1018_12294147_2_r1607478237_17.zip
Uploading the intermediate file: upload_file_17.zip
  22:37:36 STEP 1730 H= 432:30 +CPU= 20.267
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:38:20 STEP 1731 H= 432:45 +CPU= 21.151
  22:38:41 STEP 1732 H= 433:00 +CPU= 21.273
  22:39:00 STEP 1733 H= 433:15 +CPU= 19.012
  22:39:19 STEP 1734 H= 433:30 +CPU= 18.971
  22:39:39 STEP 1735 H= 433:45 +CPU= 19.184
  22:40:00 STEP 1736 H= 434:00 +CPU= 20.990
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:40:42 STEP 1737 H= 434:15 +CPU= 19.973
  22:41:01 STEP 1738 H= 434:30 +CPU= 19.307
  22:41:21 STEP 1739 H= 434:45 +CPU= 19.374
  22:41:45 STEP 1740 H= 435:00 +CPU= 24.080
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001740
  22:42:06 STEP 1741 H= 435:15 +CPU= 20.491
  22:42:28 STEP 1742 H= 435:30 +CPU= 21.196
  22:42:49 STEP 1743 H= 435:45 +CPU= 21.184
  22:43:10 STEP 1744 H= 436:00 +CPU= 20.491
  22:43:29 STEP 1745 H= 436:15 +CPU= 19.106
  22:43:49 STEP 1746 H= 436:30 +CPU= 19.609
  22:44:09 STEP 1747 H= 436:45 +CPU= 19.737
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:44:52 STEP 1748 H= 437:00 +CPU= 21.357
  22:45:14 STEP 1749 H= 437:15 +CPU= 21.412
  22:45:34 STEP 1750 H= 437:30 +CPU= 19.936
  22:45:53 STEP 1751 H= 437:45 +CPU= 19.127
  22:46:17 STEP 1752 H= 438:00 +CPU= 23.817
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001752
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:46:59 STEP 1753 H= 438:15 +CPU= 19.932
  22:47:19 STEP 1754 H= 438:30 +CPU= 20.090
  22:47:38 STEP 1755 H= 438:45 +CPU= 19.046
  22:47:58 STEP 1756 H= 439:00 +CPU= 19.464
  22:48:18 STEP 1757 H= 439:15 +CPU= 19.637
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:49:00 STEP 1758 H= 439:30 +CPU= 20.851
  22:49:22 STEP 1759 H= 439:45 +CPU= 21.509
  22:49:43 STEP 1760 H= 440:00 +CPU= 20.560
  22:50:03 STEP 1761 H= 440:15 +CPU= 19.261
  22:50:22 STEP 1762 H= 440:30 +CPU= 19.499
  22:50:43 STEP 1763 H= 440:45 +CPU= 20.161
  22:51:09 STEP 1764 H= 441:00 +CPU= 26.023
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001764
  22:51:31 STEP 1765 H= 441:15 +CPU= 21.444
  22:51:53 STEP 1766 H= 441:30 +CPU= 21.212
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:52:34 STEP 1767 H= 441:45 +CPU= 20.077
  22:52:54 STEP 1768 H= 442:00 +CPU= 19.599
  22:53:12 STEP 1769 H= 442:15 +CPU= 18.199
  22:53:31 STEP 1770 H= 442:30 +CPU= 18.767
  22:53:51 STEP 1771 H= 442:45 +CPU= 19.452
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:54:34 STEP 1772 H= 443:00 +CPU= 21.240
  22:54:55 STEP 1773 H= 443:15 +CPU= 20.918
  22:55:16 STEP 1774 H= 443:30 +CPU= 20.929
  22:55:36 STEP 1775 H= 443:45 +CPU= 19.165
  22:56:00 STEP 1776 H= 444:00 +CPU= 24.222
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001776
  22:56:19 STEP 1777 H= 444:15 +CPU= 18.127
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:57:20 STEP 1778 H= 444:30 +CPU= 19.502
  22:57:41 STEP 1779 H= 444:45 +CPU= 20.999
  22:58:03 STEP 1780 H= 445:00 +CPU= 21.542
  22:58:25 STEP 1781 H= 445:15 +CPU= 21.335
  22:58:45 STEP 1782 H= 445:30 +CPU= 20.149
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  22:59:25 STEP 1783 H= 445:45 +CPU= 18.605
  22:59:44 STEP 1784 H= 446:00 +CPU= 18.630
  23:00:03 STEP 1785 H= 446:15 +CPU= 19.172
  23:00:23 STEP 1786 H= 446:30 +CPU= 19.540
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:01:06 STEP 1787 H= 446:45 +CPU= 21.063
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:01:53 STEP 1788 H= 447:00 +CPU= 25.939
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001788
  23:02:11 STEP 1789 H= 447:15 +CPU= 18.242
  23:02:29 STEP 1790 H= 447:30 +CPU= 17.772
  23:02:47 STEP 1791 H= 447:45 +CPU= 17.707
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:03:28 STEP 1792 H= 448:00 +CPU= 19.281
  23:03:49 STEP 1793 H= 448:15 +CPU= 21.175
  23:04:11 STEP 1794 H= 448:30 +CPU= 21.272
  23:04:33 STEP 1795 H= 448:45 +CPU= 21.436
  23:04:54 STEP 1796 H= 449:00 +CPU= 20.942
  23:05:14 STEP 1797 H= 449:15 +CPU= 19.387
  23:05:33 STEP 1798 H= 449:30 +CPU= 19.128
  23:05:53 STEP 1799 H= 449:45 +CPU= 19.708
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:06:41 STEP 1800 H= 450:00 +CPU= 26.532
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001800
  23:07:03 STEP 1801 H= 450:15 +CPU= 21.474
  23:07:24 STEP 1802 H= 450:30 +CPU= 20.505
  23:07:43 STEP 1803 H= 450:45 +CPU= 19.238
  23:08:03 STEP 1804 H= 451:00 +CPU= 19.361
  23:08:22 STEP 1805 H= 451:15 +CPU= 19.216
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:09:05 STEP 1806 H= 451:30 +CPU= 20.751
  23:09:25 STEP 1807 H= 451:45 +CPU= 20.346
  23:09:45 STEP 1808 H= 452:00 +CPU= 19.197
  23:10:04 STEP 1809 H= 452:15 +CPU= 19.260
  23:10:24 STEP 1810 H= 452:30 +CPU= 19.315
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:11:06 STEP 1811 H= 452:45 +CPU= 20.717
  23:11:33 STEP 1812 H= 453:00 +CPU= 26.413
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001812
  23:11:54 STEP 1813 H= 453:15 +CPU= 21.276
  23:12:15 STEP 1814 H= 453:30 +CPU= 20.585
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:12:56 STEP 1815 H= 453:45 +CPU= 18.964
  23:13:15 STEP 1816 H= 454:00 +CPU= 19.258
  23:13:34 STEP 1817 H= 454:15 +CPU= 19.039
  23:13:54 STEP 1818 H= 454:30 +CPU= 19.629
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:14:36 STEP 1819 H= 454:45 +CPU= 20.591
  23:14:58 STEP 1820 H= 455:00 +CPU= 21.396
  23:15:20 STEP 1821 H= 455:15 +CPU= 21.530
  23:15:42 STEP 1822 H= 455:30 +CPU= 21.540
  23:16:04 STEP 1823 H= 455:45 +CPU= 21.348
  23:16:33 STEP 1824 H= 456:00 +CPU= 28.760
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001824
  23:16:55 STEP 1825 H= 456:15 +CPU= 20.916
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001824
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4ho_2016092300_20_1018_12294147_2_r1607478237_18.zip
Uploading the intermediate file: upload_file_18.zip
  23:17:14 STEP 1826 H= 456:30 +CPU= 19.537
  23:17:34 STEP 1827 H= 456:45 +CPU= 18.978
  23:17:53 STEP 1828 H= 457:00 +CPU= 19.314
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
Quit request received from BOINC client, ending the child process
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a4ho
(argv4) batchid: 1018
(argv5) wuid: 12294147
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/1
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/1/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_caadeaa001339c4022e7cddccab55a11 to: /var/lib/boinc-client/slots/1/oifs_43r3_bl_a4ho_2016092300_20_1018_12294147.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/1/oifs_43r3_bl_a4ho_2016092300_20_1018_12294147.zip
ic_ancil_file: ic_ancil_12294147
ifsdata_file: ifsdata_12294147
climate_data_file: clim_data_12294147
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/1/ic_ancil_12294147.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/1/ic_ancil_12294147.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_0c3dc51cebba71c7166f5f2c7cf49578 to: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12294147.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/1/ifsdata/ifsdata_12294147.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/1/159l_2/clim_data_12294147.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/1/159l_2/clim_data_12294147.zip
Checking for progress XML file: /var/lib/boinc-client/slots/1/progress_file_12294147.xml
Opened progress file ok : /var/lib/boinc-client/slots/1/progress_file_12294147.xml
-- Model is restarting --
Adjusting last_iter, 1829, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/1/progress_file_12294147.xml
last_cpu_time: 39148
upload_file_number: 19
last_iter: 1825
last_upload: 1642500
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a4ho_2016092300_20_1018_12294147_2_r1607478237
The child process has been launched with process id: 2027115
Executing the command: /var/lib/boinc-client/slots/1/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0  (RAND_MAX=2147483647)
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:optimus:1:1:2027115:2027115] [20240818:231926:1724037566:0.001] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:20:13 STEP 1824 H= 456:00 +CPU= 22.373
  23:20:35 STEP 1825 H= 456:15 +CPU= 21.355
  23:20:56 STEP 1826 H= 456:30 +CPU= 20.867
  23:21:15 STEP 1827 H= 456:45 +CPU= 19.084
  23:21:35 STEP 1828 H= 457:00 +CPU= 19.469
  23:21:54 STEP 1829 H= 457:15 +CPU= 18.975
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:22:37 STEP 1830 H= 457:30 +CPU= 20.997
  23:22:58 STEP 1831 H= 457:45 +CPU= 20.591
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:23:39 STEP 1832 H= 458:00 +CPU= 20.532
  23:23:59 STEP 1833 H= 458:15 +CPU= 19.210
  23:24:19 STEP 1834 H= 458:30 +CPU= 19.327
  23:24:38 STEP 1835 H= 458:45 +CPU= 19.325
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:25:25 STEP 1836 H= 459:00 +CPU= 25.072
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001836
  23:25:46 STEP 1837 H= 459:15 +CPU= 21.116
  23:26:08 STEP 1838 H= 459:30 +CPU= 21.328
  23:26:27 STEP 1839 H= 459:45 +CPU= 19.261
  23:26:47 STEP 1840 H= 460:00 +CPU= 19.234
  23:27:06 STEP 1841 H= 460:15 +CPU= 18.860
  23:27:27 STEP 1842 H= 460:30 +CPU= 20.400
  23:27:48 STEP 1843 H= 460:45 +CPU= 20.946
  23:28:10 STEP 1844 H= 461:00 +CPU= 21.737
  23:28:31 STEP 1845 H= 461:15 +CPU= 20.034
  23:28:49 STEP 1846 H= 461:30 +CPU= 18.331
  23:29:07 STEP 1847 H= 461:45 +CPU= 18.030
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:29:52 STEP 1848 H= 462:00 +CPU= 22.660
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001848
  23:30:15 STEP 1849 H= 462:15 +CPU= 21.503
  23:30:39 STEP 1850 H= 462:30 +CPU= 22.317
  23:31:00 STEP 1851 H= 462:45 +CPU= 20.180
  23:31:21 STEP 1852 H= 463:00 +CPU= 20.570
  23:31:42 STEP 1853 H= 463:15 +CPU= 20.681
  23:32:03 STEP 1854 H= 463:30 +CPU= 20.518
  23:32:25 STEP 1855 H= 463:45 +CPU= 20.863
  23:32:46 STEP 1856 H= 464:00 +CPU= 21.428
  23:33:08 STEP 1857 H= 464:15 +CPU= 21.362
  23:33:30 STEP 1858 H= 464:30 +CPU= 21.586
  23:33:52 STEP 1859 H= 464:45 +CPU= 21.684
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:34:39 STEP 1860 H= 465:00 +CPU= 25.014
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001860
  23:34:59 STEP 1861 H= 465:15 +CPU= 20.404
  23:35:22 STEP 1862 H= 465:30 +CPU= 21.497
  23:35:41 STEP 1863 H= 465:45 +CPU= 19.165
  23:36:01 STEP 1864 H= 466:00 +CPU= 19.834
  23:36:21 STEP 1865 H= 466:15 +CPU= 19.506
  23:36:41 STEP 1866 H= 466:30 +CPU= 20.156
  23:37:01 STEP 1867 H= 466:45 +CPU= 19.839
  23:37:21 STEP 1868 H= 467:00 +CPU= 19.592
  23:37:41 STEP 1869 H= 467:15 +CPU= 19.223
  23:38:01 STEP 1870 H= 467:30 +CPU= 19.773
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:38:43 STEP 1871 H= 467:45 +CPU= 21.189
  23:39:12 STEP 1872 H= 468:00 +CPU= 28.505
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001872
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:39:54 STEP 1873 H= 468:15 +CPU= 19.866
  23:40:14 STEP 1874 H= 468:30 +CPU= 19.657
  23:40:32 STEP 1875 H= 468:45 +CPU= 18.599
  23:40:52 STEP 1876 H= 469:00 +CPU= 18.941
  23:41:11 STEP 1877 H= 469:15 +CPU= 19.348
  23:41:32 STEP 1878 H= 469:30 +CPU= 20.166
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:42:14 STEP 1879 H= 469:45 +CPU= 21.156
  23:42:35 STEP 1880 H= 470:00 +CPU= 20.209
  23:42:54 STEP 1881 H= 470:15 +CPU= 19.044
  23:43:14 STEP 1882 H= 470:30 +CPU= 19.169
  23:43:34 STEP 1883 H= 470:45 +CPU= 20.191
  23:44:01 STEP 1884 H= 471:00 +CPU= 26.688
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001884
  23:44:23 STEP 1885 H= 471:15 +CPU= 21.503
  23:44:44 STEP 1886 H= 471:30 +CPU= 20.101
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:45:24 STEP 1887 H= 471:45 +CPU= 18.813
  23:45:43 STEP 1888 H= 472:00 +CPU= 19.019
  23:46:02 STEP 1889 H= 472:15 +CPU= 19.014
  23:46:22 STEP 1890 H= 472:30 +CPU= 19.540
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:47:05 STEP 1891 H= 472:45 +CPU= 21.012
  23:47:26 STEP 1892 H= 473:00 +CPU= 21.617
  23:47:47 STEP 1893 H= 473:15 +CPU= 20.730
  23:48:07 STEP 1894 H= 473:30 +CPU= 19.125
  23:48:26 STEP 1895 H= 473:45 +CPU= 19.161
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:49:13 STEP 1896 H= 474:00 +CPU= 24.801
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001896
  23:49:34 STEP 1897 H= 474:15 +CPU= 21.193
  23:49:55 STEP 1898 H= 474:30 +CPU= 21.059
  23:50:16 STEP 1899 H= 474:45 +CPU= 20.322
  23:50:36 STEP 1900 H= 475:00 +CPU= 19.545
  23:50:56 STEP 1901 H= 475:15 +CPU= 19.179
  23:51:15 STEP 1902 H= 475:30 +CPU= 19.537
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:51:57 STEP 1903 H= 475:45 +CPU= 20.224
  23:52:19 STEP 1904 H= 476:00 +CPU= 21.574
  23:52:40 STEP 1905 H= 476:15 +CPU= 21.164
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:53:21 STEP 1906 H= 476:30 +CPU= 19.646
  23:53:40 STEP 1907 H= 476:45 +CPU= 18.170
  23:54:04 STEP 1908 H= 477:00 +CPU= 23.843
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001908
  23:54:24 STEP 1909 H= 477:15 +CPU= 19.516
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:55:06 STEP 1910 H= 477:30 +CPU= 21.206
  23:55:27 STEP 1911 H= 477:45 +CPU= 20.255
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:56:09 STEP 1912 H= 478:00 +CPU= 20.451
  23:56:29 STEP 1913 H= 478:15 +CPU= 20.253
  23:56:48 STEP 1914 H= 478:30 +CPU= 18.977
  23:57:08 STEP 1915 H= 478:45 +CPU= 18.885
  23:57:28 STEP 1916 H= 479:00 +CPU= 20.210
Suspend request received from the BOINC client, suspending the child process
Resuming the child process
  23:58:10 STEP 1917 H= 479:15 +CPU= 20.958
  23:58:32 STEP 1918 H= 479:30 +CPU= 21.202
  23:58:54 STEP 1919 H= 479:45 +CPU= 21.687
  23:59:22 STEP 1920 H= 480:00 +CPU= 27.031
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01

 
DDH------------------------------------------------------------------------
I                                                                         I
I TIME =  480.000H DDH * Diagnostic Var.,     AREA                GLOBAL  I
I                                                                         I
I-------------------------------------------------------------------------I
I   VARIABLE   I      Initial value         I        Current value        I
I-------------------------------------------------------------------------I
I  OMEGA (P/S) I      0.2631140527E-21      I       0.3097968243E-06      I
ICloud fractionI      0.0000000000E+00      I       0.1678213576E-02      I
I  Relat. Hum. I      0.2891162378E+00      I       0.3048528649E+00      I
I  PASS 01     I      0.0000000000E+00      I       0.3372773750E+02      I
DDH------------------------------------------------------------------------
  
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
  MAXGPFV : MAX. VALUE =   0.000000000000000E+000
 NSTEP =  1920 SCAN2M_HPOS  P
 IO-STREAM SETUP - IOTYPE =           2  NUMIOPROCS =           1  CPATH =
 ICMGGh7zg+001920 MODE=a
 IO-STREAM CLOSED - ICMGGh7zg+001920
 MPI-TASK:   1 -    298329796 BYTES IN      7 RECORDS TRANSFERRED IN    0.0003 SECONDS994432.7 Mbytes/s, TOTAL TIME=    0.0136( 2.2%)
 23:59:22 STEP 1920 H= 480:00 +CPU= 27.031
 END CNT3
 NSTEP =  1920 CNT0   000000000  20.407  20.407  20.969   0.973               0               0               0               0               0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ           46/  1069125708 WRITTEN         2860/************
 -TASK-OPENED-OPEN-RECS IN -KBYTE IN    -RECS OUT-KBYTE OUT-WALL   -WALL IN-WALL
  OU-TOT IN -TOT OUT
   1     53    0       46      1044068     2860 ************     4.0     1.2     2.8     1.9     7.3
===-=== START OF TIMING STATISTICS ===-===
 
STATS FOR ALL TASKS
 NUM ROUTINE                                     CALLS  MEAN(ms)   MAX(ms)   FRAC(%)  UNBAL(%)
   0 CNT0     - COMPLETE EXECUTION                   1 2395948.4 2395948.4    100.00      0.00
   1 CNT4     - FORWARD INTEGRATION                  1 2392911.2 2392911.2     99.87      0.00
   8 SCAN2M - GRID-POINT DYNAMICS                  105    4068.8    4068.8     17.83      0.00
   9 SPCM     - SPECTRAL COMP.                      96     565.0     565.0      2.26      0.00
  10 SCAN2M - PHYSICS                               97   10327.5   10327.5     41.81      0.00
  11 IOPACK   - OUTPUT P.P. RESULTS                  8     528.3     528.3      0.18      0.00
  12 SPNORM   - SPECTRAL NORM COMP.                  5      19.9      19.9      0.00      0.00
  17 GRIDFPOS IN CNT4                                8      22.2      22.2      0.01      0.00
  27 RESTART FILES - WRITING                         2    2113.2    2113.2      0.18      0.00
  28 RESTART FILES - READING                         1    2497.2    2497.2      0.10      0.00
  29 SU4FPOS IN CNT4                                 8       0.0       0.0      0.00      0.00
  30 DYNFPOS IN CNT4                                 8    4537.6    4537.6      1.52      0.00
  31 POSDDH IN STEPO                                 1      16.5      16.5      0.00      0.00
  37 CPGLAG   - SL COMPUTATIONS                     97    5336.6    5336.6     21.61      0.00
  39 SU0YOMB                                         1     336.7     336.7      0.01      0.00
  51 SCAN2M   - SL COMM. PART 1                     97      22.4      22.4      0.09      0.00
  54 SPCM     - M TO S/S TO M TRANSP.               96     336.8     336.8      1.35      0.00
  55 SPCIMPF  - S TO M/M TO S TRANSP.               96      67.6      67.6      0.27      0.00
  56 SPNORM   - SPECTRAL NORM COMM.                  5       0.1       0.1      0.00      0.00
 102 LTINV_CTL   - INVERSE LEGENDRE TRANSFORM      212     803.8     803.8      7.11      0.00
 103 LTDIR_CTL   - DIRECT LEGENDRE TRANSFORM       200     287.6     287.6      2.40      0.00
 106 FTDIR_CTL   - DIRECT FOURIER TRANSFORM        200      80.7      80.7      0.67      0.00
 107 FTINV_CTL   - INVERSE FOURIER TRANSFORM       212     193.6     193.6      1.71      0.00
 140 SULEG       - COMP. OF LEGENDRE POL.            1      40.0      40.0      0.00      0.00
 152 LTINV_CTL   - M TO L TRANSPOSITION            212      54.1      54.1      0.48      0.00
 153 LTDIR_CTL   - L TO M TRANSPOSITION            200      26.3      26.3      0.22      0.00
 157 FTINV_CTL   - L TO G TRANSPOSITION            212      43.2      43.2      0.38      0.00
 158 FTDIR_CTL   - G TO L TRANSPOSITION            200      16.0      16.0      0.13      0.00
 400 GSTATS                                      12215       0.0       0.0      0.00      0.00
 401 GSTATS HOOK                                 11311       0.0       0.0      0.00      0.00
TOTAL MEASURED IMBALANCE =       0.0 SECONDS,  0.0 PERCENT
TOTAL WALLCLOCK TIME     2395.9 CPU TIME    2002.0 VECTOR TIME     2002.0


===-=== END   OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY      722.1
  *** END CNT0 *** 
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/1/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/1/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/1/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+000768
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12294147/ICMSHh7zg+001908
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a4ho_2016092300_20_1018_12294147_2_r1607478237_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
00:02:52 (2027087): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
19 Aug 2024 04:59:16 1534256 22507349 oifs_43r3_bl_a4ho_2016092300_20_1018_12294147_2 1,727,100 41,150 0.0238


©2024 cpdn.org