Name | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 |
Workunit | 12165908 |
Created | 17 Dec 2022, 19:32:09 UTC |
Sent | 17 Dec 2022, 19:34:13 UTC |
Report deadline | 16 Jan 2023, 19:34:13 UTC |
Received | 19 Dec 2022, 17:52:17 UTC |
Server state | Over |
Outcome | Success |
Client state | Done |
Exit status | 0 (0x00000000) |
Computer ID | 1495924 |
Run time | 17 hours 40 min 35 sec |
CPU time | 14 hours 41 min 25 sec |
Validate state | Valid |
Credit | 14,873.04 |
Device peak FLOPS | 6.32 GFLOPS |
Application version | OpenIFS 43r3 Perturbed Surface v1.05 x86_64-pc-linux-gnu |
Peak working set size | 4,418.64 MB |
Peak swap size | 4,978.07 MB |
Peak disk usage | 2,873.71 MB |
Stderr | <core_client_version>7.16.6</core_client_version> <![CDATA[ <stderr_txt> 09:10 STEP 2710 H=2710:00 +CPU= 12.577 23:09:24 STEP 2711 H=2711:00 +CPU= 12.851 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:09:52 STEP 2712 H=2712:00 +CPU= 22.759 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002712 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002712 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002712 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002688 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002688 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002688 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002700 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002700 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002700 Zipping up the intermediate file: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2819_2021050100_123_947_12165908_1_r1298760569_112.zip Uploading the intermediate file: upload_file_112.zip 23:10:07 STEP 2713 H=2713:00 +CPU= 13.056 23:10:20 STEP 2714 H=2714:00 +CPU= 12.275 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:10:43 STEP 2715 H=2715:00 +CPU= 19.046 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:10:58 STEP 2716 H=2716:00 +CPU= 12.275 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:11:14 STEP 2717 H=2717:00 +CPU= 12.099 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:11:36 STEP 2718 H=2718:00 +CPU= 18.713 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:11:52 STEP 2719 H=2719:00 +CPU= 12.695 23:12:04 STEP 2720 H=2720:00 +CPU= 11.960 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:12:27 STEP 2721 H=2721:00 +CPU= 18.930 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:12:43 STEP 2722 H=2722:00 +CPU= 12.617 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:12:57 STEP 2723 H=2723:00 +CPU= 11.799 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:13:22 STEP 2724 H=2724:00 +CPU= 20.873 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002724 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002724 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002724 23:13:37 STEP 2725 H=2725:00 +CPU= 11.703 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:13:52 STEP 2726 H=2726:00 +CPU= 12.480 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:14:15 STEP 2727 H=2727:00 +CPU= 18.915 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:14:30 STEP 2728 H=2728:00 +CPU= 12.048 23:14:43 STEP 2729 H=2729:00 +CPU= 12.067 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:15:06 STEP 2730 H=2730:00 +CPU= 19.717 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:15:22 STEP 2731 H=2731:00 +CPU= 12.208 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:15:37 STEP 2732 H=2732:00 +CPU= 12.307 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:16:00 STEP 2733 H=2733:00 +CPU= 18.942 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:16:15 STEP 2734 H=2734:00 +CPU= 12.268 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:16:31 STEP 2735 H=2735:00 +CPU= 12.825 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:16:56 STEP 2736 H=2736:00 +CPU= 21.523 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002736 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002736 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002736 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002712 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002712 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002712 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002724 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002724 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002724 Zipping up the intermediate file: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2819_2021050100_123_947_12165908_1_r1298760569_113.zip Uploading the intermediate file: upload_file_113.zip 23:17:09 STEP 2737 H=2737:00 +CPU= 12.001 23:17:22 STEP 2738 H=2738:00 +CPU= 12.310 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:17:44 STEP 2739 H=2739:00 +CPU= 18.407 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:17:59 STEP 2740 H=2740:00 +CPU= 12.196 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:18:14 STEP 2741 H=2741:00 +CPU= 12.186 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:18:37 STEP 2742 H=2742:00 +CPU= 18.923 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:18:51 STEP 2743 H=2743:00 +CPU= 11.824 23:19:05 STEP 2744 H=2744:00 +CPU= 12.393 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:19:30 STEP 2745 H=2745:00 +CPU= 19.050 23:19:43 STEP 2746 H=2746:00 +CPU= 12.316 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:19:58 STEP 2747 H=2747:00 +CPU= 11.974 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:20:24 STEP 2748 H=2748:00 +CPU= 21.807 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002748 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002748 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002748 23:20:39 STEP 2749 H=2749:00 +CPU= 12.434 Suspend request received from the BOINC client, suspending the child process Resuming the child process 23:20:55 STEP 2750 H=2750:00 +CPU= 12.486 Suspend request received from the BOINC client, suspending the child process Resuming the child process [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232115:1671402075:44719.251] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1538] Received signal#15 (SIGTERM) :: 3869MB (heap), 4419MB (maxrss), 0MB (maxstack), 0 (paging), nsigs = 1 [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.328] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1542] Also activating Harakiri-alarm (SIGALRM=14) to expire after 500s elapsed to prevent hangs, nsigs = 1 [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.328] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1544] Harakiri signal handler 'signal_harakiri' for signal#14 (SIGALRM) installed at 0x81f3c0 (old at (nil)) [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.328] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1617] Signal#15 was caused by unrecognized si_code [memaddr=0x1], nsigs = 1 [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.328] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1686] Starting DrHook backtrace for signal#15, nsigs = 1 [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3843] 3869 MB (maxheap), 4419 MB (maxrss), 0 MB (maxstack) [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : MASTER [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT0 [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT1 [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT2 [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT3 [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CNT4 [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : STEPO [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : SCAN2M [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : GP_MODEL_HEAP [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : GP_MODEL [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : EC_PHYS_DRV [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : >OMP-CPQTUV (1064) [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232116:1671402076:44719.329] [c_drhook_print_@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:3897] : CPQTUV [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232117:1671402077:44720.338] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1734] DrHook backtrace done for signal#15, nsigs = 1 [EC_DRHOOK:paw-Computer:1:1:3290:3290] [20221218:232117:1671402077:44720.338] [signal_drhook@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1785] Calling previous signal handler at 0x1ce8bb0 for signal#15, nsigs = 1 forrtl: error (78): process killed (SIGTERM) Image PC Routine Line Source oifs_43r3_model.e 0000000001CE916B Unknown Unknown Unknown oifs_43r3_model.e 000000000081FFF1 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DC9090 Unknown Unknown Unknown oifs_43r3_model.e 0000000000E3EAD6 cpqtuv_ 89 cpqtuv.F90 oifs_43r3_model.e 0000000000E2F4FD ec_phys_drv_ 676 ec_phys_drv.F90 oifs_43r3_model.e 0000000000BFA3D3 gp_model_ 613 gp_model.F90 oifs_43r3_model.e 00000000012E9482 gp_model_heap_ 74 gp_model_heap.F90 oifs_43r3_model.e 0000000000BBC1CE scan2m_ 535 scan2m.F90 oifs_43r3_model.e 000000000057A664 stepo_ 327 stepo.F90 oifs_43r3_model.e 000000000055DEEC cnt4_ 1133 cnt4.F90 oifs_43r3_model.e 00000000005471C9 cnt3_ 267 cnt3.F90 oifs_43r3_model.e 0000000000546412 cnt2_ 88 cnt2.F90 oifs_43r3_model.e 0000000000545E28 cnt1_ 92 cnt1.F90 oifs_43r3_model.e 000000000040708D cnt0_ 146 cnt0.F90 oifs_43r3_model.e 000000000040220F MAIN__ 96 master.F90 oifs_43r3_model.e 00000000004021A2 Unknown Unknown Unknown oifs_43r3_model.e 0000000001DCA390 Unknown Unknown Unknown oifs_43r3_model.e 000000000040206E Unknown Unknown Unknown (argv0) ../../projects/climateprediction.net/oifs_43r3_ps_1.05_x86_64-pc-linux-gnu (argv1) start_date: 2021050100 (argv2) exptid: hpi1 (argv3) unique_member_id: 2819 (argv4) batchid: 947 (argv5) wuid: 12165908 (argv6) fclen: 123 (argv7) app_name: oifs_43r3_ps (argv8) nthreads: 1 Working directory is: /home/boinc-client/slots/16 Project directory is: /home/boinc-client/projects/climateprediction.net/ app name: oifs_43r3_ps version: 1.05 Location of temp folder: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908 ..mkdir for temp folder for results failed Copying: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip to: /home/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Unzipping the app zip file: /home/boinc-client/slots/16/oifs_43r3_ps_app_1.05_x86_64-pc-linux-gnu.zip Copying the namelist files from: ../../projects/climateprediction.net/jf_e1ca49380552b8343885efb5f8ca35ac to: /home/boinc-client/slots/16/oifs_43r3_ps_2819_2021050100_123_947_12165908.zip Unzipping the namelist zip file: /home/boinc-client/slots/16/oifs_43r3_ps_2819_2021050100_123_947_12165908.zip ic_ancil_file: ic_ancil_12165908 ifsdata_file: ifsdata_12165908 climate_data_file: clim_data_12165908 horiz_resolution: 159 vert_resolution: 60 grid_type: l_2 upload_interval: 24 utstep: 3600 nfrres: restart dump frequency (steps) 24 Copying IC ancils from: ../../projects/climateprediction.net/jf_3778f9e87199420dfc26cf61d466e121 to: /home/boinc-client/slots/16/ic_ancil_12165908.zip Unzipping the IC ancils zip file: /home/boinc-client/slots/16/ic_ancil_12165908.zip ..mkdir for ifsdata folder failed Copying the ifsdata_file from: ../../projects/climateprediction.net/jf_272d933c5ec3c3b5ede74783f4d7e9e4 to: /home/boinc-client/slots/16/ifsdata/ifsdata_12165908.zip Unzipping the ifsdata_zip file: /home/boinc-client/slots/16/ifsdata/ifsdata_12165908.zip ..mkdir for the climate data folder failed Copying the climate data file from: ../../projects/climateprediction.net/jf_f32c668cf7829426ffd94699b48b9a2e to: /home/boinc-client/slots/16/159l_2/clim_data_12165908.zip Unzipping the climate data zip file: /home/boinc-client/slots/16/159l_2/clim_data_12165908.zip Checking for progress XML file: /home/boinc-client/slots/16/progress_file_12165908.xml Opened progress file ok : /home/boinc-client/slots/16/progress_file_12165908.xml -- Model is restarting -- Adjusting last_iter, 2751, to previous model restart step. Creating progress file: /home/boinc-client/slots/16/progress_file_12165908.xml last_cpu_time: 49642 upload_file_number: 114 last_iter: 2735 last_upload: 9849600 model_completed: 0 total_length_of_simulation: 10627200 result_base_name: oifs_43r3_ps_2819_2021050100_123_947_12165908_1_r1298760569 The child process has been launched with process id: 3409 Executing the command: /home/boinc-client/slots/16/oifs_43r3_model.exe [EC_DRHOOK:hostname:myproc:omptid:pid:unixtid] [YYYYMMDD:HHMMSS:epoch:walltime] [function@file:lineno] -- Max OpenMP threads = 1 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2091] fp = 0x3129fe0 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2098] DR_HOOK_ALLOW_COREDUMP=-1 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2104] Hardlimit for core file is now 0 (0x0) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2122] DR_HOOK_PROFILE_PROC=-1 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2128] DR_HOOK_PROFILE_LIMIT=-10.000 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2194] DR_HOOK_RANDOM_MEMSTAT=0 (RAND_MAX=2147483647) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2205] DR_HOOK_HASHBITS=16 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2213] DR_HOOK_NCALLSTACK=0 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2221] DR_HOOK_HARAKIRI_TIMEOUT=500 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2228] DR_HOOK_TRAPFPE=1 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2235] DR_HOOK_TRAPFPE_INVALID=1 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2242] DR_HOOK_TRAPFPE_DIVBYZERO=1 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [process_options@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:2249] DR_HOOK_TRAPFPE_OVERFLOW=1 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [ignore_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1227] DR_HOOK_IGNORE_SIGNALS=<undef> [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [restore_default_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1178] DR_HOOK_RESTORE_DEFAULT_SIGNALS=<undef> [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1937] New signal handler 'signal_drhook' for signal#6 (SIGABRT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1938] New signal handler 'signal_drhook' for signal#7 (SIGBUS) at 0x81f820 (old at (nil)) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1939] New signal handler 'signal_drhook' for signal#11 (SIGSEGV) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1944] New signal handler 'signal_drhook' for signal#16 (SIGSTKFLT) at 0x81f820 (old at (nil)) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [trapfpe_treatment@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1149] DR_HOOK enables SIGFPE-related floating point trapping since DRHOOK_TRAPFPE=1 [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1948] New signal handler 'signal_drhook' for signal#8 (SIGFPE) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1949] New signal handler 'signal_drhook' for signal#4 (SIGILL) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1951] New signal handler 'signal_drhook' for signal#5 (SIGTRAP) at 0x81f820 (old at (nil)) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1952] New signal handler 'signal_drhook' for signal#2 (SIGINT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1960] New signal handler 'signal_drhook' for signal#3 (SIGQUIT) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1961] New signal handler 'signal_drhook' for signal#15 (SIGTERM) at 0x81f820 (old at 0x1ce8bb0) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1966] New signal handler 'signal_drhook' for signal#24 (SIGXCPU) at 0x81f820 (old at (nil)) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1968] New signal handler 'signal_drhook' for signal#25 (SIGXFSZ) at 0x81f820 (old at (nil)) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [signal_drhook_init@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1973] New signal handler 'signal_drhook' for signal#31 (SIGSYS) at 0x81f820 (old at (nil)) [EC_DRHOOK:paw-Computer:1:1:3409:3409] [20221219:165132:1671465092:0.000] [catch_signals@/home/glenn/github/jamie_oifs43r3.git/src/ifsaux/support/drhook.c:1111] DR_HOOK_CATCH_SIGNALS=<undef> Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:52:11 STEP 2736 H=2736:00 +CPU= 17.558 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:52:23 STEP 2737 H=2737:00 +CPU= 9.821 16:52:36 STEP 2738 H=2738:00 +CPU= 11.335 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:53:15 STEP 2739 H=2739:00 +CPU= 23.615 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:53:42 STEP 2740 H=2740:00 +CPU= 15.748 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:54:01 STEP 2741 H=2741:00 +CPU= 13.180 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:54:23 STEP 2742 H=2742:00 +CPU= 18.621 16:54:35 STEP 2743 H=2743:00 +CPU= 11.272 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:54:50 STEP 2744 H=2744:00 +CPU= 12.280 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:55:12 STEP 2745 H=2745:00 +CPU= 18.137 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:55:27 STEP 2746 H=2746:00 +CPU= 12.275 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:55:41 STEP 2747 H=2747:00 +CPU= 11.229 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:56:05 STEP 2748 H=2748:00 +CPU= 20.153 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002748 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002748 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002748 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:56:20 STEP 2749 H=2749:00 +CPU= 11.687 16:56:33 STEP 2750 H=2750:00 +CPU= 12.144 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:56:55 STEP 2751 H=2751:00 +CPU= 18.229 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:57:10 STEP 2752 H=2752:00 +CPU= 11.966 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:57:24 STEP 2753 H=2753:00 +CPU= 11.610 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:57:47 STEP 2754 H=2754:00 +CPU= 18.968 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:58:01 STEP 2755 H=2755:00 +CPU= 11.433 16:58:14 STEP 2756 H=2756:00 +CPU= 12.223 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:58:36 STEP 2757 H=2757:00 +CPU= 18.507 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:58:51 STEP 2758 H=2758:00 +CPU= 12.079 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:59:07 STEP 2759 H=2759:00 +CPU= 12.332 Suspend request received from the BOINC client, suspending the child process Resuming the child process 16:59:33 STEP 2760 H=2760:00 +CPU= 22.186 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002760 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002760 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002760 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002736 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002736 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002736 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002748 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002748 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002748 Zipping up the intermediate file: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2819_2021050100_123_947_12165908_1_r1298760569_114.zip Uploading the intermediate file: upload_file_114.zip 16:59:48 STEP 2761 H=2761:00 +CPU= 11.945 17:00:01 STEP 2762 H=2762:00 +CPU= 12.199 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:00:23 STEP 2763 H=2763:00 +CPU= 18.463 17:00:36 STEP 2764 H=2764:00 +CPU= 12.345 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:00:51 STEP 2765 H=2765:00 +CPU= 11.450 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:01:13 STEP 2766 H=2766:00 +CPU= 18.701 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:01:27 STEP 2767 H=2767:00 +CPU= 11.255 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:01:42 STEP 2768 H=2768:00 +CPU= 11.912 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:02:03 STEP 2769 H=2769:00 +CPU= 18.217 17:02:16 STEP 2770 H=2770:00 +CPU= 11.967 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:02:31 STEP 2771 H=2771:00 +CPU= 11.610 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:02:55 STEP 2772 H=2772:00 +CPU= 20.323 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002772 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002772 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002772 17:03:09 STEP 2773 H=2773:00 +CPU= 11.547 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:03:24 STEP 2774 H=2774:00 +CPU= 11.730 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:03:45 STEP 2775 H=2775:00 +CPU= 18.255 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:04:00 STEP 2776 H=2776:00 +CPU= 11.687 17:04:12 STEP 2777 H=2777:00 +CPU= 11.681 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:04:34 STEP 2778 H=2778:00 +CPU= 18.125 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:04:48 STEP 2779 H=2779:00 +CPU= 11.574 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:05:03 STEP 2780 H=2780:00 +CPU= 11.814 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:05:24 STEP 2781 H=2781:00 +CPU= 17.989 17:05:37 STEP 2782 H=2782:00 +CPU= 12.005 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:05:52 STEP 2783 H=2783:00 +CPU= 11.755 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:06:18 STEP 2784 H=2784:00 +CPU= 21.971 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002784 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002784 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002784 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002760 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002760 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002760 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002772 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002772 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002772 Zipping up the intermediate file: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2819_2021050100_123_947_12165908_1_r1298760569_115.zip Uploading the intermediate file: upload_file_115.zip 17:06:33 STEP 2785 H=2785:00 +CPU= 12.507 17:06:47 STEP 2786 H=2786:00 +CPU= 12.245 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:07:10 STEP 2787 H=2787:00 +CPU= 19.559 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:07:26 STEP 2788 H=2788:00 +CPU= 12.473 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:07:41 STEP 2789 H=2789:00 +CPU= 12.095 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:08:05 STEP 2790 H=2790:00 +CPU= 19.854 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:08:20 STEP 2791 H=2791:00 +CPU= 12.241 17:08:34 STEP 2792 H=2792:00 +CPU= 12.833 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:08:58 STEP 2793 H=2793:00 +CPU= 19.497 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:09:13 STEP 2794 H=2794:00 +CPU= 12.287 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:09:28 STEP 2795 H=2795:00 +CPU= 12.414 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:09:54 STEP 2796 H=2796:00 +CPU= 21.487 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002796 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002796 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002796 17:10:09 STEP 2797 H=2797:00 +CPU= 12.084 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:10:25 STEP 2798 H=2798:00 +CPU= 12.968 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:10:48 STEP 2799 H=2799:00 +CPU= 19.036 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:11:04 STEP 2800 H=2800:00 +CPU= 12.716 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:11:20 STEP 2801 H=2801:00 +CPU= 12.432 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:11:44 STEP 2802 H=2802:00 +CPU= 20.007 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:12:00 STEP 2803 H=2803:00 +CPU= 12.492 17:12:14 STEP 2804 H=2804:00 +CPU= 12.701 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:12:37 STEP 2805 H=2805:00 +CPU= 19.548 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:12:53 STEP 2806 H=2806:00 +CPU= 12.597 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:13:09 STEP 2807 H=2807:00 +CPU= 12.471 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:13:36 STEP 2808 H=2808:00 +CPU= 23.204 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002808 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002808 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002808 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002784 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002784 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002784 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002796 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002796 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002796 Zipping up the intermediate file: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2819_2021050100_123_947_12165908_1_r1298760569_116.zip Uploading the intermediate file: upload_file_116.zip 17:13:49 STEP 2809 H=2809:00 +CPU= 11.894 17:14:02 STEP 2810 H=2810:00 +CPU= 12.497 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:14:26 STEP 2811 H=2811:00 +CPU= 19.418 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:14:42 STEP 2812 H=2812:00 +CPU= 12.912 17:14:55 STEP 2813 H=2813:00 +CPU= 12.171 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:15:21 STEP 2814 H=2814:00 +CPU= 19.813 17:15:34 STEP 2815 H=2815:00 +CPU= 12.325 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:15:50 STEP 2816 H=2816:00 +CPU= 12.682 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:16:13 STEP 2817 H=2817:00 +CPU= 19.415 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:16:29 STEP 2818 H=2818:00 +CPU= 12.722 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:16:45 STEP 2819 H=2819:00 +CPU= 12.383 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:17:11 STEP 2820 H=2820:00 +CPU= 21.565 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002820 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002820 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002820 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:17:27 STEP 2821 H=2821:00 +CPU= 12.496 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:17:43 STEP 2822 H=2822:00 +CPU= 13.078 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:18:06 STEP 2823 H=2823:00 +CPU= 19.095 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:18:22 STEP 2824 H=2824:00 +CPU= 12.590 17:18:35 STEP 2825 H=2825:00 +CPU= 12.368 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:19:01 STEP 2826 H=2826:00 +CPU= 20.098 17:19:15 STEP 2827 H=2827:00 +CPU= 12.364 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:19:31 STEP 2828 H=2828:00 +CPU= 12.690 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:19:54 STEP 2829 H=2829:00 +CPU= 19.659 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:20:10 STEP 2830 H=2830:00 +CPU= 12.855 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:20:26 STEP 2831 H=2831:00 +CPU= 12.404 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:20:52 STEP 2832 H=2832:00 +CPU= 22.506 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002832 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002832 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002832 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002808 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002808 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002808 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002820 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002820 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002820 Zipping up the intermediate file: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2819_2021050100_123_947_12165908_1_r1298760569_117.zip Uploading the intermediate file: upload_file_117.zip 17:21:06 STEP 2833 H=2833:00 +CPU= 12.269 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:21:21 STEP 2834 H=2834:00 +CPU= 12.477 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:21:45 STEP 2835 H=2835:00 +CPU= 19.527 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:22:00 STEP 2836 H=2836:00 +CPU= 12.426 17:22:14 STEP 2837 H=2837:00 +CPU= 12.443 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:22:38 STEP 2838 H=2838:00 +CPU= 19.827 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:22:53 STEP 2839 H=2839:00 +CPU= 12.112 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:23:09 STEP 2840 H=2840:00 +CPU= 12.660 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:23:32 STEP 2841 H=2841:00 +CPU= 19.560 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:23:48 STEP 2842 H=2842:00 +CPU= 12.517 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:24:03 STEP 2843 H=2843:00 +CPU= 12.074 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:24:28 STEP 2844 H=2844:00 +CPU= 21.088 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002844 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002844 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002844 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:24:44 STEP 2845 H=2845:00 +CPU= 12.567 17:24:58 STEP 2846 H=2846:00 +CPU= 12.802 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:25:23 STEP 2847 H=2847:00 +CPU= 19.456 17:25:37 STEP 2848 H=2848:00 +CPU= 13.073 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:25:53 STEP 2849 H=2849:00 +CPU= 12.217 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:26:16 STEP 2850 H=2850:00 +CPU= 19.838 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:26:32 STEP 2851 H=2851:00 +CPU= 12.207 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:26:48 STEP 2852 H=2852:00 +CPU= 12.740 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:27:12 STEP 2853 H=2853:00 +CPU= 20.288 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:27:30 STEP 2854 H=2854:00 +CPU= 14.005 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:27:47 STEP 2855 H=2855:00 +CPU= 13.415 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:28:13 STEP 2856 H=2856:00 +CPU= 22.582 Suspend request received from the BOINC client, suspending the child process Resuming the child process Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002856 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002856 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002856 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002832 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002832 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002832 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002844 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002844 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002844 Zipping up the intermediate file: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2819_2021050100_123_947_12165908_1_r1298760569_118.zip Uploading the intermediate file: upload_file_118.zip 17:28:28 STEP 2857 H=2857:00 +CPU= 12.037 17:28:42 STEP 2858 H=2858:00 +CPU= 12.474 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:29:05 STEP 2859 H=2859:00 +CPU= 19.104 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:29:20 STEP 2860 H=2860:00 +CPU= 12.622 17:29:35 STEP 2861 H=2861:00 +CPU= 12.862 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:30:00 STEP 2862 H=2862:00 +CPU= 19.649 17:30:14 STEP 2863 H=2863:00 +CPU= 12.405 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:30:29 STEP 2864 H=2864:00 +CPU= 12.636 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:30:53 STEP 2865 H=2865:00 +CPU= 19.230 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:31:08 STEP 2866 H=2866:00 +CPU= 12.604 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:31:24 STEP 2867 H=2867:00 +CPU= 12.491 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:31:49 STEP 2868 H=2868:00 +CPU= 21.302 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002868 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002868 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002868 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:32:05 STEP 2869 H=2869:00 +CPU= 12.368 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:32:20 STEP 2870 H=2870:00 +CPU= 12.479 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:32:43 STEP 2871 H=2871:00 +CPU= 19.187 17:32:57 STEP 2872 H=2872:00 +CPU= 12.854 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:33:13 STEP 2873 H=2873:00 +CPU= 12.575 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:33:37 STEP 2874 H=2874:00 +CPU= 19.904 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:33:52 STEP 2875 H=2875:00 +CPU= 12.196 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:34:08 STEP 2876 H=2876:00 +CPU= 12.813 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:34:31 STEP 2877 H=2877:00 +CPU= 19.242 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:34:47 STEP 2878 H=2878:00 +CPU= 12.950 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:35:03 STEP 2879 H=2879:00 +CPU= 12.476 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:35:30 STEP 2880 H=2880:00 +CPU= 22.748 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002880 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002880 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002880 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002856 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002856 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002856 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002868 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002868 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002868 Zipping up the intermediate file: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2819_2021050100_123_947_12165908_1_r1298760569_119.zip Uploading the intermediate file: upload_file_119.zip 17:35:43 STEP 2881 H=2881:00 +CPU= 11.961 17:35:56 STEP 2882 H=2882:00 +CPU= 12.641 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:36:21 STEP 2883 H=2883:00 +CPU= 19.285 17:36:36 STEP 2884 H=2884:00 +CPU= 12.773 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:36:51 STEP 2885 H=2885:00 +CPU= 12.210 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:37:15 STEP 2886 H=2886:00 +CPU= 19.940 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:37:30 STEP 2887 H=2887:00 +CPU= 12.330 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:37:47 STEP 2888 H=2888:00 +CPU= 13.219 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:38:10 STEP 2889 H=2889:00 +CPU= 19.403 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:38:26 STEP 2890 H=2890:00 +CPU= 12.351 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:38:42 STEP 2891 H=2891:00 +CPU= 12.736 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:39:07 STEP 2892 H=2892:00 +CPU= 21.564 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002892 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002892 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002892 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:39:23 STEP 2893 H=2893:00 +CPU= 12.426 17:39:37 STEP 2894 H=2894:00 +CPU= 12.799 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:40:03 STEP 2895 H=2895:00 +CPU= 19.712 17:40:17 STEP 2896 H=2896:00 +CPU= 12.790 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:40:32 STEP 2897 H=2897:00 +CPU= 12.023 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:40:55 STEP 2898 H=2898:00 +CPU= 19.658 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:41:10 STEP 2899 H=2899:00 +CPU= 12.030 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:41:27 STEP 2900 H=2900:00 +CPU= 12.948 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:41:50 STEP 2901 H=2901:00 +CPU= 19.433 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:42:07 STEP 2902 H=2902:00 +CPU= 13.190 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:42:22 STEP 2903 H=2903:00 +CPU= 12.624 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:42:49 STEP 2904 H=2904:00 +CPU= 22.765 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002904 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002904 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002904 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002880 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002880 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002880 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002892 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002892 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002892 Zipping up the intermediate file: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2819_2021050100_123_947_12165908_1_r1298760569_120.zip Uploading the intermediate file: upload_file_120.zip 17:43:01 STEP 2905 H=2905:00 +CPU= 11.451 17:43:15 STEP 2906 H=2906:00 +CPU= 12.374 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:43:40 STEP 2907 H=2907:00 +CPU= 19.324 17:43:54 STEP 2908 H=2908:00 +CPU= 12.565 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:44:09 STEP 2909 H=2909:00 +CPU= 12.371 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:44:33 STEP 2910 H=2910:00 +CPU= 19.801 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:44:48 STEP 2911 H=2911:00 +CPU= 12.237 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:45:04 STEP 2912 H=2912:00 +CPU= 12.661 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:45:27 STEP 2913 H=2913:00 +CPU= 19.043 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:45:43 STEP 2914 H=2914:00 +CPU= 12.771 17:45:56 STEP 2915 H=2915:00 +CPU= 12.287 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:46:24 STEP 2916 H=2916:00 +CPU= 21.444 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002916 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002916 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002916 17:46:37 STEP 2917 H=2917:00 +CPU= 12.450 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:46:53 STEP 2918 H=2918:00 +CPU= 12.609 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:47:16 STEP 2919 H=2919:00 +CPU= 19.043 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:47:32 STEP 2920 H=2920:00 +CPU= 12.847 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:47:47 STEP 2921 H=2921:00 +CPU= 12.072 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:48:10 STEP 2922 H=2922:00 +CPU= 19.577 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:48:26 STEP 2923 H=2923:00 +CPU= 12.641 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:48:43 STEP 2924 H=2924:00 +CPU= 12.805 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:49:05 STEP 2925 H=2925:00 +CPU= 19.283 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:49:21 STEP 2926 H=2926:00 +CPU= 12.489 17:49:35 STEP 2927 H=2927:00 +CPU= 12.445 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:50:03 STEP 2928 H=2928:00 +CPU= 22.755 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002928 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002928 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002928 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002904 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002904 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002904 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002916 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002916 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002916 Zipping up the intermediate file: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2819_2021050100_123_947_12165908_1_r1298760569_121.zip Uploading the intermediate file: upload_file_121.zip 17:50:17 STEP 2929 H=2929:00 +CPU= 12.180 17:50:29 STEP 2930 H=2930:00 +CPU= 11.959 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:50:53 STEP 2931 H=2931:00 +CPU= 19.649 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:51:09 STEP 2932 H=2932:00 +CPU= 12.522 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:51:24 STEP 2933 H=2933:00 +CPU= 12.219 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:51:48 STEP 2934 H=2934:00 +CPU= 19.723 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:52:03 STEP 2935 H=2935:00 +CPU= 12.221 17:52:17 STEP 2936 H=2936:00 +CPU= 12.868 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:52:42 STEP 2937 H=2937:00 +CPU= 19.107 17:52:56 STEP 2938 H=2938:00 +CPU= 12.808 17:53:09 STEP 2939 H=2939:00 +CPU= 12.468 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:53:35 STEP 2940 H=2940:00 +CPU= 21.462 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002940 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002940 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002940 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:53:51 STEP 2941 H=2941:00 +CPU= 12.941 17:54:05 STEP 2942 H=2942:00 +CPU= 12.755 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:54:28 STEP 2943 H=2943:00 +CPU= 19.066 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:54:44 STEP 2944 H=2944:00 +CPU= 12.731 17:54:57 STEP 2945 H=2945:00 +CPU= 12.395 Suspend request received from the BOINC client, suspending the child process Resuming the child process Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:55:23 STEP 2946 H=2946:00 +CPU= 19.586 17:55:36 STEP 2947 H=2947:00 +CPU= 12.517 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:55:53 STEP 2948 H=2948:00 +CPU= 12.946 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:56:15 STEP 2949 H=2949:00 +CPU= 19.103 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:56:32 STEP 2950 H=2950:00 +CPU= 12.923 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:56:48 STEP 2951 H=2951:00 +CPU= 12.744 Suspend request received from the BOINC client, suspending the child process Resuming the child process 17:57:14 STEP 2952 H=2952:00 +CPU= 22.069 The child process terminated with status: 0 Moving to projects directory: /home/boinc-client/slots/16/ICMGGhpi1+002952 Moving to projects directory: /home/boinc-client/slots/16/ICMSHhpi1+002952 Moving to projects directory: /home/boinc-client/slots/16/ICMUAhpi1+002952 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002928 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002952 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002952 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002928 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002952 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002928 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMSHhpi1+002940 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMGGhpi1+002940 Adding to the zip: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_12165908/ICMUAhpi1+002940 Zipping up the final file: /home/boinc-client/projects/climateprediction.net/oifs_43r3_ps_2819_2021050100_123_947_12165908_1_r1298760569_122.zip Uploading the final file: upload_file_122.zip Uploading trickle at timestep: 10623600 18:00:37 (3193): called boinc_finish(0) </stderr_txt> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
09 May 2023 15:44:48 | 1495924 | 22250737 | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 | 10,623,600 | 52,885 | 0.0050 |
09 May 2023 15:44:31 | 1495924 | 22250737 | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 | 9,676,800 | 48,726 | 0.0050 |
09 May 2023 15:44:30 | 1495924 | 22250737 | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 | 8,812,800 | 44,951 | 0.0051 |
09 May 2023 15:44:29 | 1495924 | 22250737 | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 | 7,948,800 | 40,995 | 0.0052 |
09 May 2023 15:44:28 | 1495924 | 22250737 | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 | 7,084,800 | 37,168 | 0.0052 |
09 May 2023 15:44:27 | 1495924 | 22250737 | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 | 6,220,800 | 33,568 | 0.0054 |
09 May 2023 15:44:25 | 1495924 | 22250737 | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 | 5,356,800 | 29,729 | 0.0055 |
09 May 2023 15:44:24 | 1495924 | 22250737 | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 | 4,492,800 | 25,998 | 0.0058 |
09 May 2023 15:44:24 | 1495924 | 22250737 | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 | 3,628,800 | 22,370 | 0.0062 |
09 May 2023 15:44:22 | 1495924 | 22250737 | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 | 2,764,800 | 18,304 | 0.0066 |
09 May 2023 15:44:20 | 1495924 | 22250737 | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 | 1,728,000 | 11,313 | 0.0065 |
09 May 2023 15:44:10 | 1495924 | 22250737 | oifs_43r3_ps_2819_2021050100_123_947_12165908_1 | 864,000 | 5,682 | 0.0066 |
©2024 cpdn.org