<core_client_version>7.18.1</core_client_version>
<![CDATA[
<stderr_txt>
01644
MPI-TASK: 1 - 286171555 BYTES IN 4 RECORDS TRANSFERRED IN 0.0003 SECONDS953905.2 Mbytes/s, TOTAL TIME= 0.0057( 5.3%)
STEPO_FPOS WAS : T00000000M
NSTEP = 1644 STEPO 0AAA00AAA
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 1644 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+001644 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+001644
MPI-TASK: 1 - 294751284 BYTES IN 7 RECORDS TRANSFERRED IN 0.0006 SECONDS491252.1 Mbytes/s, TOTAL TIME= 0.0096( 6.2%)
20:34:03 STEP 1644 H= 411:00 +CPU= 35.506
ISTEP= 1645 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP= 1645 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
NSTEP = 1645 STEPO 0AAA00AAA
20:34:33 STEP 1645 H= 411:15 +CPU= 29.286
NSTEP = 1646 STEPO 0AAA00AAA
20:35:03 STEP 1646 H= 411:30 +CPU= 29.247
NSTEP = 1647 STEPO 0AAA00AAA
20:35:33 STEP 1647 H= 411:45 +CPU= 29.468
NSTEP = 1648 STEPO 0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat
20:33:32 FULLPOS-V DYNFPOS 1644 3.082 3.082 3.119 74:11 75:12 0.47637195063318E-06 2GB 0MB
20:33:32 FULLPOS-T DYNFPOS 1644 0.462 0.462 0.462 74:12 75:12 0.47637195063318E-06 2GB 0MB
20:33:33 0AAA00AAA STEPO 1644 0.456 0.456 0.456 74:12 75:13 0.47637195063318E-06 2GB 0MB
20:34:03 0AAA00AAA STEPO 1645 29.906 29.906 30.412 74:42 75:43 0.47637195063318E-06 2GB 0MB
20:34:33 0AAA00AAA STEPO 1646 29.287 29.287 30.025 75:11 76:13 0.47637195063318E-06 2GB 0MB
20:35:03 0AAA00AAA STEPO 1647 29.247 29.247 29.444 75:41 76:42 0.47637195063318E-06 2GB 0MB
20:35:33 0AAA00AAA STEPO 1648 29.468 29.468 30.094 76:10 77:13 0.47637195063318E-06 2GB 0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf
CSTEP = " 1632",
CTIME = "00170000 ",
NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 1620, 2*0,
IPRGPNSRES = 1,
IPRGPEWRES = 1,
IPRTRWRES = 1,
IPRTRVRES = 1,
GMASS0 = 0.000000000000000E+000,
GMASSI = 0.000000000000000E+000
/
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/22/progress_file_12293506.xml
<running_values>
<last_cpu_time>51679.360000</last_cpu_time>
<upload_file_number>17</upload_file_number>
<last_iter>1648</last_iter>
<last_upload>1469700</last_upload>
<model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a3zv
(argv4) batchid: 1018
(argv5) wuid: 12293506
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/22
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/22/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/22/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_79730a220e4e1da216bb4b3e49758392 to: /var/lib/boinc-client/slots/22/oifs_43r3_bl_a3zv_2016092300_20_1018_12293506.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/22/oifs_43r3_bl_a3zv_2016092300_20_1018_12293506.zip
ic_ancil_file: ic_ancil_12293506
ifsdata_file: ifsdata_12293506
climate_data_file: clim_data_12293506
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/22/ic_ancil_12293506.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/22/ic_ancil_12293506.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_f16491b996b2f90ecf58a03381e2b0d9 to: /var/lib/boinc-client/slots/22/ifsdata/ifsdata_12293506.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/22/ifsdata/ifsdata_12293506.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/22/159l_2/clim_data_12293506.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/22/159l_2/clim_data_12293506.zip
Checking for progress XML file: /var/lib/boinc-client/slots/22/progress_file_12293506.xml
Opened progress file ok : /var/lib/boinc-client/slots/22/progress_file_12293506.xml
-- Model is restarting --
Adjusting last_iter, 1648, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/22/progress_file_12293506.xml
last_cpu_time: 51679
upload_file_number: 17
last_iter: 1633
last_upload: 1469700
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a3zv_2016092300_20_1018_12293506_0_r1473335914
The child process has been launched with process id: 864541
Executing the command: /var/lib/boinc-client/slots/22/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:864541:864541] [20240614:203714:1718397434:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
20:37:44 STEP 1632 H= 408:00 +CPU= 26.722
20:38:11 STEP 1633 H= 408:15 +CPU= 27.317
20:38:36 STEP 1634 H= 408:30 +CPU= 25.334
20:39:05 STEP 1635 H= 408:45 +CPU= 27.856
20:39:34 STEP 1636 H= 409:00 +CPU= 29.370
20:40:03 STEP 1637 H= 409:15 +CPU= 28.634
20:40:32 STEP 1638 H= 409:30 +CPU= 28.940
20:41:02 STEP 1639 H= 409:45 +CPU= 29.326
20:41:32 STEP 1640 H= 410:00 +CPU= 29.889
20:42:01 STEP 1641 H= 410:15 +CPU= 28.582
20:42:30 STEP 1642 H= 410:30 +CPU= 28.991
20:42:59 STEP 1643 H= 410:45 +CPU= 28.683
20:43:35 STEP 1644 H= 411:00 +CPU= 35.354
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001644
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001644
20:44:04 STEP 1645 H= 411:15 +CPU= 28.745
20:44:33 STEP 1646 H= 411:30 +CPU= 28.723
20:45:02 STEP 1647 H= 411:45 +CPU= 28.639
20:45:32 STEP 1648 H= 412:00 +CPU= 29.539
20:46:01 STEP 1649 H= 412:15 +CPU= 28.775
20:46:30 STEP 1650 H= 412:30 +CPU= 28.989
20:46:58 STEP 1651 H= 412:45 +CPU= 28.491
20:47:28 STEP 1652 H= 413:00 +CPU= 29.644
20:47:58 STEP 1653 H= 413:15 +CPU= 29.111
20:48:27 STEP 1654 H= 413:30 +CPU= 29.037
20:48:57 STEP 1655 H= 413:45 +CPU= 28.949
20:49:32 STEP 1656 H= 414:00 +CPU= 35.285
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001656
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001656
20:50:01 STEP 1657 H= 414:15 +CPU= 28.880
20:50:30 STEP 1658 H= 414:30 +CPU= 28.353
20:50:59 STEP 1659 H= 414:45 +CPU= 28.868
20:51:28 STEP 1660 H= 415:00 +CPU= 29.401
20:51:58 STEP 1661 H= 415:15 +CPU= 28.634
20:52:26 STEP 1662 H= 415:30 +CPU= 28.795
20:52:56 STEP 1663 H= 415:45 +CPU= 28.820
20:53:25 STEP 1664 H= 416:00 +CPU= 29.294
20:53:52 STEP 1665 H= 416:15 +CPU= 27.544
20:54:13 STEP 1666 H= 416:30 +CPU= 20.431
20:54:38 STEP 1667 H= 416:45 +CPU= 24.975
20:55:09 STEP 1668 H= 417:00 +CPU= 30.856
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001668
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001668
20:55:34 STEP 1669 H= 417:15 +CPU= 24.715
20:55:59 STEP 1670 H= 417:30 +CPU= 25.432
20:56:25 STEP 1671 H= 417:45 +CPU= 25.614
20:56:51 STEP 1672 H= 418:00 +CPU= 26.177
20:57:20 STEP 1673 H= 418:15 +CPU= 28.754
20:57:49 STEP 1674 H= 418:30 +CPU= 28.432
20:58:20 STEP 1675 H= 418:45 +CPU= 29.052
20:58:49 STEP 1676 H= 419:00 +CPU= 28.871
20:59:16 STEP 1677 H= 419:15 +CPU= 26.680
20:59:42 STEP 1678 H= 419:30 +CPU= 26.218
21:00:08 STEP 1679 H= 419:45 +CPU= 25.621
21:00:43 STEP 1680 H= 420:00 +CPU= 34.048
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001680
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001680
21:01:10 STEP 1681 H= 420:15 +CPU= 27.477
21:01:37 STEP 1682 H= 420:30 +CPU= 26.951
21:02:03 STEP 1683 H= 420:45 +CPU= 26.024
21:02:31 STEP 1684 H= 421:00 +CPU= 27.826
21:03:02 STEP 1685 H= 421:15 +CPU= 29.418
21:03:31 STEP 1686 H= 421:30 +CPU= 29.134
21:04:00 STEP 1687 H= 421:45 +CPU= 28.932
21:04:30 STEP 1688 H= 422:00 +CPU= 29.727
21:05:00 STEP 1689 H= 422:15 +CPU= 29.013
21:05:29 STEP 1690 H= 422:30 +CPU= 29.030
21:05:58 STEP 1691 H= 422:45 +CPU= 28.492
21:06:34 STEP 1692 H= 423:00 +CPU= 35.985
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001692
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001692
21:07:03 STEP 1693 H= 423:15 +CPU= 28.785
21:07:32 STEP 1694 H= 423:30 +CPU= 29.110
21:08:02 STEP 1695 H= 423:45 +CPU= 29.071
21:08:32 STEP 1696 H= 424:00 +CPU= 29.779
21:09:00 STEP 1697 H= 424:15 +CPU= 28.322
21:09:23 STEP 1698 H= 424:30 +CPU= 22.363
21:09:42 STEP 1699 H= 424:45 +CPU= 19.741
21:10:04 STEP 1700 H= 425:00 +CPU= 22.142
21:10:29 STEP 1701 H= 425:15 +CPU= 24.189
21:10:52 STEP 1702 H= 425:30 +CPU= 23.388
21:11:17 STEP 1703 H= 425:45 +CPU= 24.254
21:11:48 STEP 1704 H= 426:00 +CPU= 31.066
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001704
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001704
21:12:14 STEP 1705 H= 426:15 +CPU= 26.019
21:12:43 STEP 1706 H= 426:30 +CPU= 28.599
21:13:12 STEP 1707 H= 426:45 +CPU= 28.996
21:13:42 STEP 1708 H= 427:00 +CPU= 29.545
21:14:11 STEP 1709 H= 427:15 +CPU= 29.167
21:14:41 STEP 1710 H= 427:30 +CPU= 29.146
21:15:10 STEP 1711 H= 427:45 +CPU= 29.584
21:15:39 STEP 1712 H= 428:00 +CPU= 27.921
21:15:59 STEP 1713 H= 428:15 +CPU= 20.270
21:16:19 STEP 1714 H= 428:30 +CPU= 20.182
21:16:42 STEP 1715 H= 428:45 +CPU= 22.589
21:17:13 STEP 1716 H= 429:00 +CPU= 30.618
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001716
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001716
21:17:37 STEP 1717 H= 429:15 +CPU= 24.236
21:18:01 STEP 1718 H= 429:30 +CPU= 23.673
21:18:26 STEP 1719 H= 429:45 +CPU= 24.594
21:18:53 STEP 1720 H= 430:00 +CPU= 27.163
21:19:22 STEP 1721 H= 430:15 +CPU= 28.941
21:19:51 STEP 1722 H= 430:30 +CPU= 29.086
21:20:21 STEP 1723 H= 430:45 +CPU= 29.113
21:20:51 STEP 1724 H= 431:00 +CPU= 29.078
21:21:20 STEP 1725 H= 431:15 +CPU= 29.115
21:21:49 STEP 1726 H= 431:30 +CPU= 28.782
21:22:18 STEP 1727 H= 431:45 +CPU= 29.091
21:22:58 STEP 1728 H= 432:00 +CPU= 38.824
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001728
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001728
21:23:28 STEP 1729 H= 432:15 +CPU= 29.087
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001644
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001656
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001668
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001680
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001692
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001704
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001716
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001728
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001728
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zv_2016092300_20_1018_12293506_0_r1473335914_17.zip
Uploading the intermediate file: upload_file_17.zip
21:23:57 STEP 1730 H= 432:30 +CPU= 28.819
21:24:27 STEP 1731 H= 432:45 +CPU= 29.198
21:24:56 STEP 1732 H= 433:00 +CPU= 29.466
21:25:25 STEP 1733 H= 433:15 +CPU= 28.632
21:25:54 STEP 1734 H= 433:30 +CPU= 29.469
21:26:24 STEP 1735 H= 433:45 +CPU= 29.310
21:26:55 STEP 1736 H= 434:00 +CPU= 30.073
21:27:24 STEP 1737 H= 434:15 +CPU= 29.199
21:27:53 STEP 1738 H= 434:30 +CPU= 29.332
21:28:23 STEP 1739 H= 434:45 +CPU= 29.731
21:28:59 STEP 1740 H= 435:00 +CPU= 35.863
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001740
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001740
21:29:29 STEP 1741 H= 435:15 +CPU= 29.170
21:29:59 STEP 1742 H= 435:30 +CPU= 29.377
21:30:28 STEP 1743 H= 435:45 +CPU= 28.824
21:30:57 STEP 1744 H= 436:00 +CPU= 29.146
21:31:27 STEP 1745 H= 436:15 +CPU= 28.901
21:31:56 STEP 1746 H= 436:30 +CPU= 29.106
21:32:26 STEP 1747 H= 436:45 +CPU= 29.840
21:32:56 STEP 1748 H= 437:00 +CPU= 29.730
21:33:26 STEP 1749 H= 437:15 +CPU= 28.901
21:33:56 STEP 1750 H= 437:30 +CPU= 29.559
21:34:25 STEP 1751 H= 437:45 +CPU= 29.069
21:35:01 STEP 1752 H= 438:00 +CPU= 35.327
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001752
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001752
21:35:30 STEP 1753 H= 438:15 +CPU= 28.531
21:35:59 STEP 1754 H= 438:30 +CPU= 28.853
21:36:27 STEP 1755 H= 438:45 +CPU= 28.399
21:36:57 STEP 1756 H= 439:00 +CPU= 29.761
21:37:27 STEP 1757 H= 439:15 +CPU= 29.349
21:37:57 STEP 1758 H= 439:30 +CPU= 29.010
21:38:26 STEP 1759 H= 439:45 +CPU= 29.342
21:38:56 STEP 1760 H= 440:00 +CPU= 29.889
21:39:26 STEP 1761 H= 440:15 +CPU= 29.137
21:39:55 STEP 1762 H= 440:30 +CPU= 29.053
21:40:24 STEP 1763 H= 440:45 +CPU= 28.883
21:41:00 STEP 1764 H= 441:00 +CPU= 35.023
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001764
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001764
21:41:28 STEP 1765 H= 441:15 +CPU= 28.205
21:41:57 STEP 1766 H= 441:30 +CPU= 28.707
21:42:26 STEP 1767 H= 441:45 +CPU= 28.886
21:42:56 STEP 1768 H= 442:00 +CPU= 29.568
21:43:26 STEP 1769 H= 442:15 +CPU= 29.159
21:43:55 STEP 1770 H= 442:30 +CPU= 28.860
21:44:24 STEP 1771 H= 442:45 +CPU= 28.848
21:44:54 STEP 1772 H= 443:00 +CPU= 29.418
21:45:25 STEP 1773 H= 443:15 +CPU= 29.058
21:45:54 STEP 1774 H= 443:30 +CPU= 28.621
21:46:25 STEP 1775 H= 443:45 +CPU= 28.949
21:47:04 STEP 1776 H= 444:00 +CPU= 38.968
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001776
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001776
21:47:33 STEP 1777 H= 444:15 +CPU= 27.823
21:48:01 STEP 1778 H= 444:30 +CPU= 27.169
21:48:31 STEP 1779 H= 444:45 +CPU= 28.821
21:49:01 STEP 1780 H= 445:00 +CPU= 30.070
21:49:30 STEP 1781 H= 445:15 +CPU= 28.944
21:50:00 STEP 1782 H= 445:30 +CPU= 28.884
21:50:29 STEP 1783 H= 445:45 +CPU= 29.023
21:50:59 STEP 1784 H= 446:00 +CPU= 29.814
21:51:29 STEP 1785 H= 446:15 +CPU= 29.465
21:51:58 STEP 1786 H= 446:30 +CPU= 28.757
21:52:28 STEP 1787 H= 446:45 +CPU= 29.188
21:53:03 STEP 1788 H= 447:00 +CPU= 34.842
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001788
21:53:32 STEP 1789 H= 447:15 +CPU= 28.930
21:54:01 STEP 1790 H= 447:30 +CPU= 29.162
21:54:31 STEP 1791 H= 447:45 +CPU= 28.737
21:55:01 STEP 1792 H= 448:00 +CPU= 29.676
Quit request received from BOINC client, ending the child process
>>> Printing last 70 lines from file: NODE.001_01
AVE 0.233493207048864E-07 0.000000000000000E+00 0.704140407588130E-04
GPNORM RAIN AVERAGE MINIMUM MAXIMUM
AVE 0.537164500716584E-08 0.000000000000000E+00 0.404072234269730E-04
GPNORM CLOUD FRACTION AVERAGE MINIMUM MAXIMUM
AVE 0.494595829518548E-02 0.000000000000000E+00 0.100000000000000E+01
GPNORM CLW AVERAGE MINIMUM MAXIMUM
AVE 0.531415793291007E-06 0.000000000000000E+00 0.625288710642134E-03
GPNORM CIW AVERAGE MINIMUM MAXIMUM
AVE 0.358220867890712E-07 0.000000000000000E+00 0.423526050066694E-04
GPNORM CC AVERAGE MINIMUM MAXIMUM
AVE 0.493702946635020E-02 0.000000000000000E+00 0.100000000000000E+01
GPNORM RFL AVERAGE MINIMUM MAXIMUM
AVE 0.248055703413372E-07 0.000000000000000E+00 0.182868174414901E-03
GPNORM SFL AVERAGE MINIMUM MAXIMUM
AVE 0.319986550196875E-07 0.000000000000000E+00 0.897818426997067E-04
GPNORM CRFL AVERAGE MINIMUM MAXIMUM
AVE 0.265205399596165E-07 0.000000000000000E+00 0.128837582785556E-03
GPNORM CSFL AVERAGE MINIMUM MAXIMUM
AVE 0.310396614587710E-09 0.000000000000000E+00 0.444248550341578E-04
GPNORM PFRC AVERAGE MINIMUM MAXIMUM
AVE 0.146234488236617E-01 0.000000000000000E+00 0.100000000000000E+01
NSTEP = 1788 STEPO A00000000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 1788 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+001788 MODE=w
IO-STREAM CLOSED - ICMGGh7zg+001788
MPI-TASK: 1 - 309525556 BYTES IN 6 RECORDS TRANSFERRED IN 0.0005 SECONDS619051.1 Mbytes/s, TOTAL TIME= 0.0100( 5.0%)
NSTEP = 1788 STEPO 0AA000000
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMSHh7zg+001788 MODE=w
IO-STREAM CLOSED - ./ICMSHh7zg+001788
MPI-TASK: 1 - 707399250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0087 SECONDS 81310.3 Mbytes/s, TOTAL TIME= 0.2232( 3.9%)
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+001788 MODE=w
IO-STREAM CLOSED - ./ICMUAh7zg+001788
MPI-TASK: 1 - 4952408896 BYTES IN 125 RECORDS TRANSFERRED IN 0.0058 SECONDS853863.6 Mbytes/s, TOTAL TIME= 0.1580( 3.7%)
STEPO_FPOS WAS : B00000F00E
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+001788 MODE=a
IO-STREAM CLOSED - ./ICMUAh7zg+001788
MPI-TASK: 1 - 10 BYTES IN 2 RECORDS TRANSFERRED IN 0.0002 SECONDS 0.0 Mbytes/s, TOTAL TIME= 0.0042( 4.8%)
STEPO_FPOS WAS : V00000000Y
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
./ICMUAh7zg+001788 MODE=a
IO-STREAM CLOSED - ./ICMUAh7zg+001788
MPI-TASK: 1 - 300945827 BYTES IN 4 RECORDS TRANSFERRED IN 0.0003 SECONDS******** Mbytes/s, TOTAL TIME= 0.0063( 4.8%)
STEPO_FPOS WAS : T00000000M
NSTEP = 1788 STEPO 0AAA00AAA
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 1788 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+001788 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+001788
MPI-TASK: 1 - 309525556 BYTES IN 7 RECORDS TRANSFERRED IN 0.0006 SECONDS515875.9 Mbytes/s, TOTAL TIME= 0.0095( 6.3%)
21:53:03 STEP 1788 H= 447:00 +CPU= 34.842
NSTEP = 1789 STEPO 0AAA00AAA
21:53:32 STEP 1789 H= 447:15 +CPU= 28.930
ISTEP= 1790 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482
ISTEP= 1790 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00
NSTEP = 1790 STEPO 0AAA00AAA
21:54:01 STEP 1790 H= 447:30 +CPU= 29.162
NSTEP = 1791 STEPO 0AAA00AAA
21:54:31 STEP 1791 H= 447:45 +CPU= 28.737
NSTEP = 1792 STEPO 0AAA00AAA
21:55:01 STEP 1792 H= 448:00 +CPU= 29.676
NSTEP = 1793 STEPO 0AAA00AAA
------------------------------------------------
CNT0 not found; string returned was: 'STEPO'
>>> Printing last 8 lines from file: ifs.stat
21:52:33 FULLPOS-T DYNFPOS 1788 0.455 0.455 0.455 74:31 75:19 0.48337829429524E-06 2GB 0MB
21:52:34 0AAA00AAA STEPO 1788 0.450 0.450 0.451 74:31 75:19 0.48337829429524E-06 2GB 0MB
21:53:03 0AAA00AAA STEPO 1789 29.458 29.458 29.534 75:01 75:49 0.48337829429524E-06 2GB 0MB
21:53:32 0AAA00AAA STEPO 1790 28.930 28.930 29.001 75:30 76:18 0.48337829429524E-06 2GB 0MB
21:54:01 0AAA00AAA STEPO 1791 29.162 29.162 29.217 75:59 76:47 0.48337829429524E-06 2GB 0MB
21:54:31 0AAA00AAA STEPO 1792 28.737 28.737 29.468 76:28 77:16 0.48337829429524E-06 2GB 0MB
21:55:01 0AAA00AAA STEPO 1793 29.676 29.676 29.826 76:57 77:46 0.48337829429524E-06 2GB 0MB
------------------------------------------------
>>> Printing last 11 lines from file: rcf
CSTEP = " 1776",
CTIME = "00181200 ",
NSTEPLPP = 201, 202, 49, 228226, 228227, 2*0, 1764, 2*0,
IPRGPNSRES = 1,
IPRGPEWRES = 1,
IPRTRWRES = 1,
IPRTRVRES = 1,
GMASS0 = 0.000000000000000E+000,
GMASSI = 0.000000000000000E+000
/
------------------------------------------------
>>> Printing last 8 lines from file: /var/lib/boinc-client/slots/22/progress_file_12293506.xml
<running_values>
<last_cpu_time>56304.490000</last_cpu_time>
<upload_file_number>18</upload_file_number>
<last_iter>1793</last_iter>
<last_upload>1556100</last_upload>
<model_completed>0</model_completed>
</running_values>
------------------------------------------------
..Failed, model did not complete successfully
(argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu
(argv1) start_date: 2016092300
(argv2) exptid: h7zg
(argv3) unique_member_id: a3zv
(argv4) batchid: 1018
(argv5) wuid: 12293506
(argv6) fclen: 20
(argv7) app_name: oifs_43r3_bl
(argv8) nthreads: 1
Working directory is: /var/lib/boinc-client/slots/22
Project directory is: /var/lib/boinc-client/projects/climateprediction.net/
app name: oifs_43r3_bl
version: 1.13
Location of temp folder: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506
..mkdir for temp folder for results failed
Copying: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /var/lib/boinc-client/slots/22/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Unzipping the app zip file: /var/lib/boinc-client/slots/22/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip
Copying the namelist files from: ../../projects/climateprediction.net/jf_79730a220e4e1da216bb4b3e49758392 to: /var/lib/boinc-client/slots/22/oifs_43r3_bl_a3zv_2016092300_20_1018_12293506.zip
Unzipping the namelist zip file: /var/lib/boinc-client/slots/22/oifs_43r3_bl_a3zv_2016092300_20_1018_12293506.zip
ic_ancil_file: ic_ancil_12293506
ifsdata_file: ifsdata_12293506
climate_data_file: clim_data_12293506
horiz_resolution: 159
vert_resolution: 91
grid_type: l_2
upload_interval: 96
utstep: 900
nfrres: restart dump frequency (steps) 48
Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /var/lib/boinc-client/slots/22/ic_ancil_12293506.zip
Unzipping the IC ancils zip file: /var/lib/boinc-client/slots/22/ic_ancil_12293506.zip
..mkdir for ifsdata folder failed
Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_f16491b996b2f90ecf58a03381e2b0d9 to: /var/lib/boinc-client/slots/22/ifsdata/ifsdata_12293506.zip
Unzipping the ifsdata_zip file: /var/lib/boinc-client/slots/22/ifsdata/ifsdata_12293506.zip
..mkdir for the climate data folder failed
Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /var/lib/boinc-client/slots/22/159l_2/clim_data_12293506.zip
Unzipping the climate data zip file: /var/lib/boinc-client/slots/22/159l_2/clim_data_12293506.zip
Checking for progress XML file: /var/lib/boinc-client/slots/22/progress_file_12293506.xml
Opened progress file ok : /var/lib/boinc-client/slots/22/progress_file_12293506.xml
-- Model is restarting --
Adjusting last_iter, 1793, to previous model restart step.
Creating progress file: /var/lib/boinc-client/slots/22/progress_file_12293506.xml
last_cpu_time: 56304
upload_file_number: 18
last_iter: 1777
last_upload: 1556100
model_completed: 0
total_length_of_simulation: 1728000
result_base_name: oifs_43r3_bl_a3zv_2016092300_20_1018_12293506_0_r1473335914
The child process has been launched with process id: 866684
Executing the command: /var/lib/boinc-client/slots/22/oifs_43r3_model.exe
[EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0)
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647)
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef>
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef>
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0)
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil))
[EC_DRHOOK:box.zenlime.org:1:1:866684:866684] [20240614:215620:1718402180:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef>
21:56:52 STEP 1776 H= 444:00 +CPU= 27.184
21:57:17 STEP 1777 H= 444:15 +CPU= 25.352
21:57:43 STEP 1778 H= 444:30 +CPU= 24.729
21:58:09 STEP 1779 H= 444:45 +CPU= 26.196
21:58:38 STEP 1780 H= 445:00 +CPU= 28.588
21:59:07 STEP 1781 H= 445:15 +CPU= 28.918
21:59:36 STEP 1782 H= 445:30 +CPU= 29.297
22:00:07 STEP 1783 H= 445:45 +CPU= 29.782
22:00:38 STEP 1784 H= 446:00 +CPU= 30.386
22:01:07 STEP 1785 H= 446:15 +CPU= 28.883
22:01:36 STEP 1786 H= 446:30 +CPU= 29.041
22:02:05 STEP 1787 H= 446:45 +CPU= 28.524
22:02:40 STEP 1788 H= 447:00 +CPU= 35.383
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001788
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001788
22:03:09 STEP 1789 H= 447:15 +CPU= 28.908
22:03:39 STEP 1790 H= 447:30 +CPU= 29.135
22:04:08 STEP 1791 H= 447:45 +CPU= 28.949
22:04:38 STEP 1792 H= 448:00 +CPU= 29.003
22:05:09 STEP 1793 H= 448:15 +CPU= 28.498
22:05:37 STEP 1794 H= 448:30 +CPU= 28.378
22:06:07 STEP 1795 H= 448:45 +CPU= 29.075
22:06:31 STEP 1796 H= 449:00 +CPU= 24.346
22:06:53 STEP 1797 H= 449:15 +CPU= 21.244
22:07:14 STEP 1798 H= 449:30 +CPU= 21.860
22:07:39 STEP 1799 H= 449:45 +CPU= 24.262
22:08:11 STEP 1800 H= 450:00 +CPU= 32.629
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001800
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001800
22:08:39 STEP 1801 H= 450:15 +CPU= 27.304
22:09:04 STEP 1802 H= 450:30 +CPU= 25.043
22:09:31 STEP 1803 H= 450:45 +CPU= 26.798
22:10:02 STEP 1804 H= 451:00 +CPU= 29.390
22:10:32 STEP 1805 H= 451:15 +CPU= 29.126
22:11:01 STEP 1806 H= 451:30 +CPU= 28.763
22:11:31 STEP 1807 H= 451:45 +CPU= 28.982
22:11:59 STEP 1808 H= 452:00 +CPU= 27.254
22:12:20 STEP 1809 H= 452:15 +CPU= 21.384
22:12:41 STEP 1810 H= 452:30 +CPU= 21.554
22:13:07 STEP 1811 H= 452:45 +CPU= 25.065
22:13:35 STEP 1812 H= 453:00 +CPU= 27.898
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001812
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001812
22:13:56 STEP 1813 H= 453:15 +CPU= 21.542
22:14:22 STEP 1814 H= 453:30 +CPU= 25.578
22:14:48 STEP 1815 H= 453:45 +CPU= 26.057
22:15:17 STEP 1816 H= 454:00 +CPU= 28.772
22:15:46 STEP 1817 H= 454:15 +CPU= 28.995
22:16:16 STEP 1818 H= 454:30 +CPU= 29.676
22:16:46 STEP 1819 H= 454:45 +CPU= 29.063
22:17:16 STEP 1820 H= 455:00 +CPU= 30.099
22:17:48 STEP 1821 H= 455:15 +CPU= 30.146
22:18:15 STEP 1822 H= 455:30 +CPU= 27.499
22:18:37 STEP 1823 H= 455:45 +CPU= 21.745
22:19:11 STEP 1824 H= 456:00 +CPU= 33.861
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001824
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001824
22:19:38 STEP 1825 H= 456:15 +CPU= 26.684
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001740
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001752
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001764
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001776
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001788
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001800
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001812
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001824
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001824
Zipping up the intermediate file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zv_2016092300_20_1018_12293506_0_r1473335914_18.zip
Uploading the intermediate file: upload_file_18.zip
22:20:03 STEP 1826 H= 456:30 +CPU= 25.293
22:20:29 STEP 1827 H= 456:45 +CPU= 25.100
22:20:55 STEP 1828 H= 457:00 +CPU= 26.442
22:21:22 STEP 1829 H= 457:15 +CPU= 27.011
22:21:51 STEP 1830 H= 457:30 +CPU= 28.510
22:22:20 STEP 1831 H= 457:45 +CPU= 29.033
22:22:50 STEP 1832 H= 458:00 +CPU= 29.667
22:23:20 STEP 1833 H= 458:15 +CPU= 29.680
22:23:50 STEP 1834 H= 458:30 +CPU= 29.470
22:24:15 STEP 1835 H= 458:45 +CPU= 24.714
22:24:39 STEP 1836 H= 459:00 +CPU= 24.273
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001836
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001836
22:24:58 STEP 1837 H= 459:15 +CPU= 18.770
22:25:22 STEP 1838 H= 459:30 +CPU= 23.971
22:25:46 STEP 1839 H= 459:45 +CPU= 24.320
22:26:10 STEP 1840 H= 460:00 +CPU= 24.186
22:26:36 STEP 1841 H= 460:15 +CPU= 25.590
22:27:03 STEP 1842 H= 460:30 +CPU= 26.705
22:27:32 STEP 1843 H= 460:45 +CPU= 28.514
22:28:03 STEP 1844 H= 461:00 +CPU= 30.653
22:28:33 STEP 1845 H= 461:15 +CPU= 29.842
22:29:03 STEP 1846 H= 461:30 +CPU= 29.318
22:29:33 STEP 1847 H= 461:45 +CPU= 29.161
22:30:08 STEP 1848 H= 462:00 +CPU= 34.240
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001848
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001848
22:30:29 STEP 1849 H= 462:15 +CPU= 20.709
22:30:49 STEP 1850 H= 462:30 +CPU= 20.097
22:31:12 STEP 1851 H= 462:45 +CPU= 23.295
22:31:39 STEP 1852 H= 463:00 +CPU= 27.174
22:32:03 STEP 1853 H= 463:15 +CPU= 23.878
22:32:28 STEP 1854 H= 463:30 +CPU= 24.696
22:32:54 STEP 1855 H= 463:45 +CPU= 25.710
22:33:23 STEP 1856 H= 464:00 +CPU= 29.416
22:33:53 STEP 1857 H= 464:15 +CPU= 29.428
22:34:22 STEP 1858 H= 464:30 +CPU= 29.017
22:34:52 STEP 1859 H= 464:45 +CPU= 29.397
22:35:28 STEP 1860 H= 465:00 +CPU= 35.176
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001860
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001860
22:35:57 STEP 1861 H= 465:15 +CPU= 29.141
22:36:25 STEP 1862 H= 465:30 +CPU= 28.432
22:36:55 STEP 1863 H= 465:45 +CPU= 29.070
22:37:24 STEP 1864 H= 466:00 +CPU= 29.763
22:37:54 STEP 1865 H= 466:15 +CPU= 28.977
22:38:23 STEP 1866 H= 466:30 +CPU= 28.942
22:38:52 STEP 1867 H= 466:45 +CPU= 28.742
22:39:21 STEP 1868 H= 467:00 +CPU= 29.187
22:39:51 STEP 1869 H= 467:15 +CPU= 29.044
22:40:19 STEP 1870 H= 467:30 +CPU= 28.204
22:40:49 STEP 1871 H= 467:45 +CPU= 29.557
22:41:28 STEP 1872 H= 468:00 +CPU= 38.697
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001872
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001872
22:41:52 STEP 1873 H= 468:15 +CPU= 23.801
22:42:12 STEP 1874 H= 468:30 +CPU= 20.437
22:42:34 STEP 1875 H= 468:45 +CPU= 21.984
22:43:00 STEP 1876 H= 469:00 +CPU= 24.536
22:43:25 STEP 1877 H= 469:15 +CPU= 24.696
22:43:49 STEP 1878 H= 469:30 +CPU= 24.800
22:44:15 STEP 1879 H= 469:45 +CPU= 24.974
22:44:43 STEP 1880 H= 470:00 +CPU= 28.012
22:45:12 STEP 1881 H= 470:15 +CPU= 28.818
22:45:42 STEP 1882 H= 470:30 +CPU= 29.723
22:46:11 STEP 1883 H= 470:45 +CPU= 28.919
22:46:48 STEP 1884 H= 471:00 +CPU= 35.704
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001884
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001884
22:47:18 STEP 1885 H= 471:15 +CPU= 29.096
22:47:47 STEP 1886 H= 471:30 +CPU= 29.000
22:48:16 STEP 1887 H= 471:45 +CPU= 29.394
22:48:46 STEP 1888 H= 472:00 +CPU= 29.572
22:49:15 STEP 1889 H= 472:15 +CPU= 28.958
22:49:45 STEP 1890 H= 472:30 +CPU= 29.748
22:50:14 STEP 1891 H= 472:45 +CPU= 28.980
22:50:43 STEP 1892 H= 473:00 +CPU= 28.951
22:51:13 STEP 1893 H= 473:15 +CPU= 29.056
22:51:42 STEP 1894 H= 473:30 +CPU= 29.462
22:52:13 STEP 1895 H= 473:45 +CPU= 29.384
22:52:48 STEP 1896 H= 474:00 +CPU= 35.362
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001896
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001896
22:53:15 STEP 1897 H= 474:15 +CPU= 26.195
22:53:37 STEP 1898 H= 474:30 +CPU= 21.971
22:53:59 STEP 1899 H= 474:45 +CPU= 21.938
22:54:22 STEP 1900 H= 475:00 +CPU= 23.662
22:54:47 STEP 1901 H= 475:15 +CPU= 24.815
22:55:11 STEP 1902 H= 475:30 +CPU= 23.347
22:55:36 STEP 1903 H= 475:45 +CPU= 25.050
22:56:03 STEP 1904 H= 476:00 +CPU= 27.324
22:56:33 STEP 1905 H= 476:15 +CPU= 29.241
22:57:02 STEP 1906 H= 476:30 +CPU= 28.619
22:57:31 STEP 1907 H= 476:45 +CPU= 28.823
22:58:07 STEP 1908 H= 477:00 +CPU= 35.658
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001908
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001908
22:58:36 STEP 1909 H= 477:15 +CPU= 29.178
22:59:06 STEP 1910 H= 477:30 +CPU= 29.182
22:59:35 STEP 1911 H= 477:45 +CPU= 28.785
23:00:04 STEP 1912 H= 478:00 +CPU= 29.519
23:00:33 STEP 1913 H= 478:15 +CPU= 28.828
23:01:03 STEP 1914 H= 478:30 +CPU= 29.052
23:01:32 STEP 1915 H= 478:45 +CPU= 28.969
23:02:02 STEP 1916 H= 479:00 +CPU= 29.183
23:02:31 STEP 1917 H= 479:15 +CPU= 28.651
23:03:00 STEP 1918 H= 479:30 +CPU= 28.808
23:03:30 STEP 1919 H= 479:45 +CPU= 29.594
23:04:07 STEP 1920 H= 480:00 +CPU= 35.768
..The child process terminated with status: 0
>>> Printing last 70 lines from file: NODE.001_01
DDH------------------------------------------------------------------------
I I
I TIME = 480.000H DDH * Diagnostic Var., AREA GLOBAL I
I I
I-------------------------------------------------------------------------I
I VARIABLE I Initial value I Current value I
I-------------------------------------------------------------------------I
I OMEGA (P/S) I 0.7955238048E-21 I 0.6994776856E-06 I
ICloud fractionI 0.0000000000E+00 I 0.8824428894E-02 I
I Relat. Hum. I 0.2346263535E+00 I 0.2798338276E+00 I
I PASS 01 I 0.0000000000E+00 I 0.1564291611E+03 I
DDH------------------------------------------------------------------------
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
MAXGPFV : MAX. VALUE = 0.000000000000000E+000
NSTEP = 1920 SCAN2M_HPOS P
IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH =
ICMGGh7zg+001920 MODE=a
IO-STREAM CLOSED - ICMGGh7zg+001920
MPI-TASK: 1 - 298023988 BYTES IN 7 RECORDS TRANSFERRED IN 0.0004 SECONDS745060.0 Mbytes/s, TOTAL TIME= 0.0080( 5.0%)
23:04:07 STEP 1920 H= 480:00 +CPU= 35.768
END CNT3
NSTEP = 1920 CNT0 000000000 27.340 27.340 28.097 0.973 0 0 0 0 0
IO-STREAM STATISTICS, TOTAL NO OF REC/BYTES READ 46/ 1069125708 WRITTEN 4290/************
-TASK-OPENED-OPEN-RECS IN -KBYTE IN -RECS OUT-KBYTE OUT-WALL -WALL IN-WALL
OU-TOT IN -TOT OUT
1 78 0 46 1044068 4290 ************ 7.7 1.5 6.2 2.6 13.3
===-=== START OF TIMING STATISTICS ===-===
STATS FOR ALL TASKS
NUM ROUTINE CALLS MEAN(ms) MAX(ms) FRAC(%) UNBAL(%)
0 CNT0 - COMPLETE EXECUTION 1 4066642.1 4066642.1 100.00 0.00
1 CNT4 - FORWARD INTEGRATION 1 4062191.7 4062191.7 99.89 0.00
8 SCAN2M - GRID-POINT DYNAMICS 157 5100.1 5100.1 19.69 0.00
9 SPCM - SPECTRAL COMP. 144 899.9 899.9 3.19 0.00
10 SCAN2M - PHYSICS 145 12491.9 12491.9 44.54 0.00
11 IOPACK - OUTPUT P.P. RESULTS 12 724.9 724.9 0.21 0.00
12 SPNORM - SPECTRAL NORM COMP. 7 91.8 91.8 0.02 0.00
17 GRIDFPOS IN CNT4 12 30.1 30.1 0.01 0.00
27 RESTART FILES - WRITING 3 2896.8 2896.8 0.21 0.00
28 RESTART FILES - READING 1 3861.6 3861.6 0.09 0.00
29 SU4FPOS IN CNT4 12 0.0 0.0 0.00 0.00
30 DYNFPOS IN CNT4 12 5448.6 5448.6 1.61 0.00
31 POSDDH IN STEPO 1 9.8 9.8 0.00 0.00
37 CPGLAG - SL COMPUTATIONS 145 5675.3 5675.3 20.24 0.00
39 SU0YOMB 1 374.0 374.0 0.01 0.00
51 SCAN2M - SL COMM. PART 1 145 29.0 29.0 0.10 0.00
54 SPCM - M TO S/S TO M TRANSP. 144 553.5 553.5 1.96 0.00
55 SPCIMPF - S TO M/M TO S TRANSP. 144 67.7 67.7 0.24 0.00
56 SPNORM - SPECTRAL NORM COMM. 7 0.4 0.4 0.00 0.00
102 LTINV_CTL - INVERSE LEGENDRE TRANSFORM 316 385.7 385.7 3.00 0.00
103 LTDIR_CTL - DIRECT LEGENDRE TRANSFORM 300 222.0 222.0 1.64 0.00
106 FTDIR_CTL - DIRECT FOURIER TRANSFORM 300 74.1 74.1 0.55 0.00
107 FTINV_CTL - INVERSE FOURIER TRANSFORM 316 109.2 109.2 0.85 0.00
140 SULEG - COMP. OF LEGENDRE POL. 1 44.2 44.2 0.00 0.00
152 LTINV_CTL - M TO L TRANSPOSITION 316 59.7 59.7 0.46 0.00
153 LTDIR_CTL - L TO M TRANSPOSITION 300 34.6 34.6 0.26 0.00
157 FTINV_CTL - L TO G TRANSPOSITION 316 129.1 129.1 1.00 0.00
158 FTDIR_CTL - G TO L TRANSPOSITION 300 58.8 58.8 0.43 0.00
400 GSTATS 17763 0.0 0.0 0.00 0.00
401 GSTATS HOOK 16473 0.0 0.0 0.00 0.00
TOTAL MEASURED IMBALANCE = 0.0 SECONDS, 0.0 PERCENT
TOTAL WALLCLOCK TIME 4066.6 CPU TIME 4027.0 VECTOR TIME 4027.0
===-=== END OF TIMING STATISTICS ===-===
FORECAST DAYS PER DAY 425.4
*** END CNT0 ***
------------------------------------------------
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMGGh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMSHh7zg+001920
Moving to projects directory: /var/lib/boinc-client/slots/22/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/slots/22/NODE.001_01
Adding to the zip: /var/lib/boinc-client/slots/22/ifs.stat
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001884
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001908
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001848
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001872
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001896
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001920
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001860
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMSHh7zg+001836
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMGGh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001056
Adding to the zip: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_12293506/ICMUAh7zg+001848
Zipping up the final file: /var/lib/boinc-client/projects/climateprediction.net/oifs_43r3_bl_a3zv_2016092300_20_1018_12293506_0_r1473335914_19.zip
Uploading the final file: upload_file_19.zip
Uploading trickle at timestep: 1727100
23:07:35 (866670): called boinc_finish(0)
</stderr_txt>
]]>
