Name | oifs_43r3_bl_a0fb_2016092300_20_1018_12288878_0 |
Workunit | 12288878 |
Created | 12 Jun 2024, 20:46:23 UTC |
Sent | 13 Jun 2024, 18:25:32 UTC |
Report deadline | 12 Aug 2024, 18:25:32 UTC |
Received | 13 Jun 2024, 21:52:11 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 1 (0x00000001) Unknown error code |
Computer ID | 1548614 |
Run time | 8 min 15 sec |
CPU time | 8 min 15 sec |
Validate state | Invalid |
Credit | 0.00 |
Device peak FLOPS | 6.71 GFLOPS |
Application version | OpenIFS 43r3 Baroclinic Lifecycle v1.13 x86_64-pc-linux-gnu |
Peak working set size | 4,971.45 MB |
Peak swap size | 5,981.07 MB |
Peak disk usage | 248.99 MB |
Stderr | <core_client_version>7.22.1</core_client_version> <![CDATA[ <message> process exited with code 1 (0x1, -255)</message> <stderr_txt> (argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu (argv1) start_date: 2016092300 (argv2) exptid: h7zg (argv3) unique_member_id: a0fb (argv4) batchid: 1018 (argv5) wuid: 12288878 (argv6) fclen: 20 (argv7) app_name: oifs_43r3_bl (argv8) nthreads: 1 Working directory is: /home/robbie/slots/5 Project directory is: /home/robbie/projects/climateprediction.net/ app name: oifs_43r3_bl version: 1.13 Location of temp folder: /home/robbie/projects/climateprediction.net/oifs_43r3_bl_12288878 Copying: /home/robbie/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /home/robbie/slots/5/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /home/robbie/slots/5/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_1e5aa4784f27260ca4bcc48e7b058ce1 to: /home/robbie/slots/5/oifs_43r3_bl_a0fb_2016092300_20_1018_12288878.zip Unzipping the namelist zip file: /home/robbie/slots/5/oifs_43r3_bl_a0fb_2016092300_20_1018_12288878.zip ic_ancil_file: ic_ancil_12288878 ifsdata_file: ifsdata_12288878 climate_data_file: clim_data_12288878 horiz_resolution: 159 vert_resolution: 91 grid_type: l_2 upload_interval: 96 utstep: 900 nfrres: restart dump frequency (steps) 48 Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /home/robbie/slots/5/ic_ancil_12288878.zip Unzipping the IC ancils zip file: /home/robbie/slots/5/ic_ancil_12288878.zip Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_dd3e7c7402eaad96e67e7207fb62cc96 to: /home/robbie/slots/5/ifsdata/ifsdata_12288878.zip Unzipping the ifsdata_zip file: /home/robbie/slots/5/ifsdata/ifsdata_12288878.zip Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/robbie/slots/5/159l_2/clim_data_12288878.zip Unzipping the climate data zip file: /home/robbie/slots/5/159l_2/clim_data_12288878.zip Checking for progress XML file: /home/robbie/slots/5/progress_file_12288878.xml Creating progress file: /home/robbie/slots/5/progress_file_12288878.xml last_cpu_time: 0 upload_file_number: 0 last_iter: 0 last_upload: 0 model_completed: 0 total_length_of_simulation: 1728000 result_base_name: oifs_43r3_bl_a0fb_2016092300_20_1018_12288878_0_r37921816 The child process has been launched with process id: 1526 Executing the command: /home/robbie/slots/5/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil)) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil)) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil)) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at 0x1) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:robbie-Intel-Z490:1:1:1526:1526] [20240613:192656:1718303216:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process 19:27:49 STEP 0 H= 0:00 +CPU= 26.441 Moving to projects directory: /home/robbie/slots/5/ICMGGh7zg+000000 Moving to projects directory: /home/robbie/slots/5/ICMSHh7zg+000000 Moving to projects directory: /home/robbie/slots/5/ICMUAh7zg+000000 19:28:11 STEP 1 H= 0:15 +CPU= 21.881 19:28:32 STEP 2 H= 0:30 +CPU= 20.693 19:28:52 STEP 3 H= 0:45 +CPU= 19.722 19:29:12 STEP 4 H= 1:00 +CPU= 20.295 Suspend request received from the BOINC client, suspending the child process Resuming the child process 19:29:55 STEP 5 H= 1:15 +CPU= 20.507 19:30:58 STEP 6 H= 1:30 +CPU= 21.581 19:31:20 STEP 7 H= 1:45 +CPU= 21.847 19:31:42 STEP 8 H= 2:00 +CPU= 22.031 19:32:04 STEP 9 H= 2:15 +CPU= 21.769 19:32:29 STEP 10 H= 2:30 +CPU= 24.318 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 19:33:28 STEP 11 H= 2:45 +CPU= 15.335 19:33:53 STEP 12 H= 3:00 +CPU= 24.182 Moving to projects directory: /home/robbie/slots/5/ICMGGh7zg+000012 Moving to projects directory: /home/robbie/slots/5/ICMSHh7zg+000012 Moving to projects directory: /home/robbie/slots/5/ICMUAh7zg+000012 19:34:15 STEP 13 H= 3:15 +CPU= 21.915 19:34:35 STEP 14 H= 3:30 +CPU= 19.638 19:34:56 STEP 15 H= 3:45 +CPU= 21.596 19:35:14 STEP 16 H= 4:00 +CPU= 17.377 Suspend request received from the BOINC client, suspending the child process Resuming the child process 19:35:56 STEP 17 H= 4:15 +CPU= 20.650 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Quit request received from the BOINC client, ending the child process (argv0) ../../projects/climateprediction.net/oifs_43r3_bl_1.13_x86_64-pc-linux-gnu (argv1) start_date: 2016092300 (argv2) exptid: h7zg (argv3) unique_member_id: a0fb (argv4) batchid: 1018 (argv5) wuid: 12288878 (argv6) fclen: 20 (argv7) app_name: oifs_43r3_bl (argv8) nthreads: 1 Working directory is: /home/robbie/slots/5 Project directory is: /home/robbie/projects/climateprediction.net/ app name: oifs_43r3_bl version: 1.13 Location of temp folder: /home/robbie/projects/climateprediction.net/oifs_43r3_bl_12288878 ..mkdir for temp folder for results failed Copying: /home/robbie/projects/climateprediction.net/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip to: /home/robbie/slots/5/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /home/robbie/slots/5/oifs_43r3_bl_app_1.13_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_1e5aa4784f27260ca4bcc48e7b058ce1 to: /home/robbie/slots/5/oifs_43r3_bl_a0fb_2016092300_20_1018_12288878.zip Unzipping the namelist zip file: /home/robbie/slots/5/oifs_43r3_bl_a0fb_2016092300_20_1018_12288878.zip ic_ancil_file: ic_ancil_12288878 ifsdata_file: ifsdata_12288878 climate_data_file: clim_data_12288878 horiz_resolution: 159 vert_resolution: 91 grid_type: l_2 upload_interval: 96 utstep: 900 nfrres: restart dump frequency (steps) 48 Copying IC ancils from: ../../projects/climateprediction.net/jf_f7ecfd27aa1e68bbe7e8d19800e25c73 to: /home/robbie/slots/5/ic_ancil_12288878.zip Unzipping the IC ancils zip file: /home/robbie/slots/5/ic_ancil_12288878.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_dd3e7c7402eaad96e67e7207fb62cc96 to: /home/robbie/slots/5/ifsdata/ifsdata_12288878.zip Unzipping the ifsdata_zip file: /home/robbie/slots/5/ifsdata/ifsdata_12288878.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/robbie/slots/5/159l_2/clim_data_12288878.zip Unzipping the climate data zip file: /home/robbie/slots/5/159l_2/clim_data_12288878.zip Checking for progress XML file: /home/robbie/slots/5/progress_file_12288878.xml Opened progress file ok : /home/robbie/slots/5/progress_file_12288878.xml -- Model is restarting -- Adjusting last_iter, 18, to previous model restart step. Creating progress file: /home/robbie/slots/5/progress_file_12288878.xml last_cpu_time: 394 upload_file_number: 0 last_iter: 1 last_upload: 0 model_completed: 0 total_length_of_simulation: 1728000 result_base_name: oifs_43r3_bl_a0fb_2016092300_20_1018_12288878_0_r37921816 The child process has been launched with process id: 1571 Executing the command: /home/robbie/slots/5/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2091] fp = 0x314f440 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [process_options@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [ignore_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [restore_default_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x820cf0 (old at (nil)) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [trapfpe_treatment@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x820cf0 (old at (nil)) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x820cf0 (old at 0x1cf8da0) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x820cf0 (old at (nil)) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x820cf0 (old at 0x1) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [signal_drhook_init@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x820cf0 (old at (nil)) [EC_DRHOOK:robbie-Intel-Z490:1:1:1571:1571] [20240613:201103:1718305863:0.000] [catch_signals@/home/abowery/Working_folder/OpenIFS/oifs_43r3_bl/gc_oifs43r3_2/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process 20:13:55 STEP 0 H= 0:00 +CPU= 24.033 Moving to projects directory: /home/robbie/slots/5/ICMGGh7zg+000000 Moving to projects directory: /home/robbie/slots/5/ICMSHh7zg+000000 Moving to projects directory: /home/robbie/slots/5/ICMUAh7zg+000000 20:14:12 STEP 1 H= 0:15 +CPU= 16.639 20:16:21 STEP 2 H= 0:30 +CPU= 14.659 20:16:50 STEP 3 H= 0:45 +CPU= 11.607 20:17:08 STEP 4 H= 1:00 +CPU= 11.989 20:17:20 STEP 5 H= 1:15 +CPU= 11.584 20:17:32 STEP 6 H= 1:30 +CPU= 11.919 ..The child process has been killed with signal: 9 >>> Printing last 70 lines from file: NODE.001_01 AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM CLW AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM CIW AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM CC AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM RFL AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM SFL AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM CRFL AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM CSFL AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 GPNORM PFRC AVERAGE MINIMUM MAXIMUM AVE 0.000000000000000E+00 0.000000000000000E+00 0.000000000000000E+00 NSTEP = 0 STEPO A00000000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 0 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000000 MODE=w IO-STREAM CLOSED - ICMGGh7zg+000000 MPI-TASK: 1 - 352373508 BYTES IN 6 RECORDS TRANSFERRED IN 0.0002 SECONDS******** Mbytes/s, TOTAL TIME= 0.1614( 0.1%) NSTEP = 0 STEPO 0AA000000 IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMSHh7zg+000000 MODE=w IO-STREAM CLOSED - ./ICMSHh7zg+000000 MPI-TASK: 1 - 707399250 BYTES IN 202 RECORDS TRANSFERRED IN 0.0207 SECONDS 34173.9 Mbytes/s, TOTAL TIME= 0.2328( 8.9%) IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000000 MODE=w IO-STREAM CLOSED - ./ICMUAh7zg+000000 MPI-TASK: 1 - 4810669632 BYTES IN 125 RECORDS TRANSFERRED IN 0.0056 SECONDS859048.2 Mbytes/s, TOTAL TIME= 0.0832( 6.7%) STEPO_FPOS WAS : B00000F00E IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000000 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000000 MPI-TASK: 1 - 10 BYTES IN 2 RECORDS TRANSFERRED IN 0.0003 SECONDS 0.0 Mbytes/s, TOTAL TIME= 0.0034( 8.8%) STEPO_FPOS WAS : V00000000Y IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ./ICMUAh7zg+000000 MODE=a IO-STREAM CLOSED - ./ICMUAh7zg+000000 MPI-TASK: 1 - 292087123 BYTES IN 4 RECORDS TRANSFERRED IN 0.0006 SECONDS486811.9 Mbytes/s, TOTAL TIME= 0.0061( 9.8%) STEPO_FPOS WAS : T00000000M NSTEP = 0 STEPO 0AAA00AAA MAXGPFV : MAX. VALUE = 0.000000000000000E+000 MAXGPFV : MAX. VALUE = 0.000000000000000E+000 NSTEP = 0 SCAN2M_HPOS P IO-STREAM SETUP - IOTYPE = 2 NUMIOPROCS = 1 CPATH = ICMGGh7zg+000000 MODE=a IO-STREAM CLOSED - ICMGGh7zg+000000 MPI-TASK: 1 - 300666852 BYTES IN 7 RECORDS TRANSFERRED IN 0.0011 SECONDS273333.5 Mbytes/s, TOTAL TIME= 0.0094(11.7%) 20:13:55 STEP 0 H= 0:00 +CPU= 24.033 NSTEP = 1 STEPO 0AAA00AAA 20:14:12 STEP 1 H= 0:15 +CPU= 16.639 NSTEP = 2 STEPO 0AAA00AAA 20:16:21 STEP 2 H= 0:30 +CPU= 14.659 NSTEP = 3 STEPO 0AAA00AAA 20:16:50 STEP 3 H= 0:45 +CPU= 11.607 NSTEP = 4 STEPO 0AAA00AAA 20:17:08 STEP 4 H= 1:00 +CPU= 11.989 ISTEP= 5 RSOLINC= 1361.4482 RI0= 1365.0000 ZI0= 1361.4482 RIP0= 1361.4482 ISTEP= 5 ZI0= 1361.4482 ZSEASON= 1.000000000 REA=149597870000.00 RDEASO=149597870000.00 NSTEP = 5 STEPO 0AAA00AAA 20:17:20 STEP 5 H= 1:15 +CPU= 11.584 NSTEP = 6 STEPO 0AAA00AAA 20:17:32 STEP 6 H= 1:30 +CPU= 11.919 NSTEP = 7 STEPO 0AAA00AAA ------------------------------------------------ CNT0 not found; string returned was: 'STEPO' >>> Printing last 8 lines from file: ifs.stat 20:13:55 0AAA00AAA STEPO 1 19.882 19.882 40.957 0:27 2:51 0.55515332309566E-07 2GB 0MB 20:14:12 0AAA00AAA STEPO 2 16.639 16.639 16.778 0:44 3:08 0.55515332309566E-07 2GB 0MB 20:16:22 0AAA00AAA STEPO 3 14.661 14.661 130.784 0:59 5:19 0.55515332309566E-07 2GB 0MB 20:16:50 0AAA00AAA STEPO 4 11.607 11.607 27.692 1:10 5:47 0.55515332309566E-07 2GB 0MB 20:17:08 0AAA00AAA STEPO 5 11.990 11.990 18.030 1:22 6:05 0.55515332309566E-07 2GB 0MB 20:17:20 0AAA00AAA STEPO 6 11.584 11.584 11.587 1:34 6:16 0.55515332309566E-07 2GB 0MB 20:17:32 0AAA00AAA STEPO 7 11.919 11.919 11.922 1:46 6:28 0.55515332309566E-07 2GB 0MB ------------------------------------------------ >>> Printing last 8 lines from file: /home/robbie/slots/5/progress_file_12288878.xml <running_values> <last_cpu_time>514.500000</last_cpu_time> <upload_file_number>0</upload_file_number> <last_iter>7</last_iter> <last_upload>0</last_upload> <model_completed>0</model_completed> </running_values> ------------------------------------------------ ..Failed, model did not complete successfully </stderr_txt> ]]> |
No trickles! |
---|
©2024 climateprediction.net