climateprediction.net home page
Task 22503487

Task 22503487

Name wah2_eas25_h424_201912_24_1021_012311387_1
Workunit 12311387
Created 2 Aug 2024, 11:46:04 UTC
Sent 15 Aug 2024, 1:50:26 UTC
Report deadline 23 Nov 2024, 1:50:26 UTC
Received 10 Oct 2024, 13:54:36 UTC
Server state Over
Outcome Success
Client state Done
Exit status 0 (0x00000000)
Computer ID 1524589
Run time 29 days 7 hours 57 min 44 sec
CPU time 25 days 20 hours 25 min 16 sec
Validate state Valid
Credit 19,901.44
Device peak FLOPS 5.67 GFLOPS
Application version Weather At Home 2 (wah2) (region independent) v8.32
windows_intelx86
Peak working set size 349.17 MB
Peak swap size 311.02 MB
Peak disk usage 200.72 MB
Stderr 
<core_client_version>8.0.2</core_client_version>
<![CDATA[
<stderr_txt>
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
modelGetExecutables: unzipping control files : strInput & strTmp 
wah2_eas25_h424_201912_24_1021_012311387.zip
wah2_eas25_h424_201912_24_1021_012311387/jobs
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
03:27:38 (15324): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=14852, GCM_PID=15324, RCM_PID=25504
Suspended CPDN Monitor - Suspend request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
21:38:31 (5204): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
executeModelProcess: MonID=31292, GCM_PID=5204, RCM_PID=6152
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
21:47:26 (22368): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=31064, GCM_PID=22368, RCM_PID=19988

Global Worker:: CPDN process is not running, exiting, bRetVal = T, checkPID = 22368, selfPID = 22368, iMonCtr = 1
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
21:21:25 (11144): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
executeModelProcess: MonID=31824, GCM_PID=11144, RCM_PID=17928
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 17928, selfPID = 31824, iMonCtr = 2
Model crash detected, will try to restart...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
22:24:26 (21860): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=29964, GCM_PID=21860, RCM_PID=5916

Queuing intermediate upload for CPDN/BOINC: cpdnout1.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout2.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
00:08:16 (22792): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
executeModelProcess: MonID=6932, GCM_PID=22792, RCM_PID=1656
Queuing intermediate upload for CPDN/BOINC: cpdnout3.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout4.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
22:42:33 (23140): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
executeModelProcess: MonID=3140, GCM_PID=23140, RCM_PID=14656
Regional Worker:: CPDN process is not running, exiting, bRetVal = T, checkPID = 23140, selfPID = 14656, iMonCtr = 1
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
21:00:39 (6412): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=31628, GCM_PID=6412, RCM_PID=18384
Global Worker:: CPDN process is not running, exiting, bRetVal = T, checkPID = 6412, selfPID = 6412, iMonCtr = 1
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
22:10:45 (25644): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=27180, GCM_PID=25644, RCM_PID=17452
Queuing intermediate upload for CPDN/BOINC: cpdnout5.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
00:04:07 (23932): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=21200, GCM_PID=23932, RCM_PID=29376
Queuing intermediate upload for CPDN/BOINC: cpdnout6.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
23:41:13 (29152): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
executeModelProcess: MonID=27976, GCM_PID=29152, RCM_PID=23540
Queuing intermediate upload for CPDN/BOINC: cpdnout7.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout8.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
07:52:53 (9520): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=26692, GCM_PID=9520, RCM_PID=28912
Queuing intermediate upload for CPDN/BOINC: cpdnout9.zip
Global Worker:: CPDN process is not running, exiting, bRetVal = T, checkPID = 9520, selfPID = 9520, iMonCtr = 1
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
00:16:35 (25204): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=23596, GCM_PID=25204, RCM_PID=29344
Queuing intermediate upload for CPDN/BOINC: cpdnout10.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout11.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout_restart.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout12.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
00:09:15 (29944): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=30528, GCM_PID=29944, RCM_PID=27704
Global Worker:: CPDN process is not running, exiting, bRetVal = T, checkPID = 29944, selfPID = 29944, iMonCtr = 1
No Process Handle
Regional Worker:: CPDN process is not running, exiting, bRetVal = T, checkPID = 29944, selfPID = 27704, iMonCtr = 1
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
23:03:36 (30564): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
executeModelProcess: MonID=29484, GCM_PID=30564, RCM_PID=3384
Queuing intermediate upload for CPDN/BOINC: cpdnout13.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
22:12:37 (10840): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=30456, GCM_PID=10840, RCM_PID=16968
Queuing intermediate upload for CPDN/BOINC: cpdnout14.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout15.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
20:59:25 (14456): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
executeModelProcess: MonID=31560, GCM_PID=14456, RCM_PID=14936
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
17:31:40 (30132): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=33384, GCM_PID=30132, RCM_PID=5160
Queuing intermediate upload for CPDN/BOINC: cpdnout16.zip
Global Worker:: CPDN process is not running, exiting, bRetVal = T, checkPID = 30132, selfPID = 30132, iMonCtr = 1
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
23:35:31 (22132): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=10484, GCM_PID=22132, RCM_PID=27960
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Queuing intermediate upload for CPDN/BOINC: cpdnout17.zip
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
01:08:47 (7544): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=11128, GCM_PID=7544, RCM_PID=29568
Suspended CPDN Monitor - Suspend request from BOINC...
Queuing intermediate upload for CPDN/BOINC: cpdnout18.zip
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
21:44:55 (36572): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. execu
teModelProcess: MonID=15396, GCM_PID=36572, RCM_PID=15056
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
22:17:41 (31400): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
executeModelProcess: MonID=14760, GCM_PID=31400, RCM_PID=19968
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Queuing intermediate upload for CPDN/BOINC: cpdnout19.zip
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Regional Worker:: CPDN process is not running, exiting, bRetVal = T, checkPID = 31400, selfPID = 19968, iMonCtr = 1
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
21:33:43 (30600): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=32484, GCM_PID=30600, RCM_PID=31120
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Queuing intermediate upload for CPDN/BOINC: cpdnout20.zip
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
22:38:04 (7592): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=5148, GCM_PID=7592, RCM_PID=17528
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Suspended CPDN Monitor - Suspend request from BOINC...
Queuing intermediate upload for CPDN/BOINC: cpdnout21.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
12:20:57 (27512): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=21800, GCM_PID=27512, RCM_PID=14828
Queuing intermediate upload for CPDN/BOINC: cpdnout22.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout23.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xadae.namelists
C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_h424_201912_24_1021_012311387/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387 generic_phase1_spinup_eas25_global_aabaka_f ic19611212_16_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6ssp245_2019-2030 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
10:51:36 (9196): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_h424_201912_24_1021_012311387
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=11776, GCM_PID=9196, RCM_PID=26764
Queuing intermediate upload for CPDN/BOINC: cpdnout24.zip
Leaving CPDN_Main::Monitor...
monitor:finished called ... tidying up.
monitor:finished: Uploading out files...
Queuing intermediate upload for CPDN/BOINC: cpdnout_out.zip
Detaching shared memory... Done.
monitor:finished: Closed output file : stdout_<>.txt
modelResultFiles : Removing : wah2_eas25_h424_201912_24_1021_012311387 in C:\ProgramData\BOINC/projects/climateprediction.net
monitor:finished: handing over to boinc_finish(RetVal=0)
14:15:49 (11776): called boinc_finish(0)

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
10 Oct 2024 13:55:59 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 276,779 2,233,317 8.0690
10 Oct 2024 03:01:57 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 265,259 2,204,913 8.3123
09 Oct 2024 12:43:41 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 253,739 2,167,642 8.5428
08 Oct 2024 15:58:06 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 242,219 2,112,513 8.7215
05 Oct 2024 19:16:02 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 230,699 2,028,464 8.7927
03 Oct 2024 05:12:32 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 219,179 1,938,077 8.8424
23 Sep 2024 08:41:32 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 207,659 1,861,855 8.9659
21 Sep 2024 09:28:37 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 196,139 1,776,772 9.0587
19 Sep 2024 20:33:12 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 184,619 1,696,559 9.1895
19 Sep 2024 16:32:05 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 173,099 1,591,336 9.1932
19 Sep 2024 16:32:05 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 161,579 1,487,243 9.2044
12 Sep 2024 13:19:07 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 150,059 1,383,307 9.2184
10 Sep 2024 20:03:55 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 138,539 1,277,277 9.2196
09 Sep 2024 12:19:30 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 127,019 1,171,439 9.2225
08 Sep 2024 02:43:50 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 115,499 1,064,716 9.2184
06 Sep 2024 14:55:19 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 103,979 957,120 9.2049
03 Sep 2024 18:55:44 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 92,459 849,278 9.1855
02 Sep 2024 09:19:04 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 80,939 740,819 9.1528
31 Aug 2024 20:09:54 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 69,419 631,670 9.0994
30 Aug 2024 06:53:38 1524589 22503487 wah2_eas25_h424_201912_24_1021_012311387_1 57,899 523,505 9.0417


©2024 cpdn.org