Name | wah2_eas25_12hj_209512_24_1025_012330518_0 |
Workunit | 12330518 |
Created | 25 Jul 2024, 11:34:52 UTC |
Sent | 1 Aug 2024, 12:03:51 UTC |
Report deadline | 9 Nov 2024, 12:03:51 UTC |
Received | 11 Nov 2024, 15:06:35 UTC |
Server state | Over |
Outcome | Computation error |
Client state | Compute error |
Exit status | 0 (0x00000000) |
Computer ID | 1548299 |
Run time | 74 days 12 hours 36 min 42 sec |
CPU time | 68 days 14 hours 21 min 38 sec |
Validate state | Invalid |
Credit | 19,073.11 |
Device peak FLOPS | 4.33 GFLOPS |
Application version | Weather At Home 2 (wah2) (region independent) v8.32 windows_intelx86 |
Peak working set size | 342.46 MB |
Peak swap size | 310.89 MB |
Peak disk usage | 200.60 MB |
Stderr | <core_client_version>8.0.2</core_client_version> <![CDATA[ <stderr_txt> C/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 06:32:29 (11364): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=9828, GCM_PID=11364, RCM_PID=13472 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 09:36:28 (8728): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=12708, GCM_PID=8728, RCM_PID=14504 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 16:03:57 (9380): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=11524, GCM_PID=9380, RCM_PID=3496 CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 20:45:22 (12480): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. ecpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. xecuteModelProcess: MonID=4708, GCM_PID=12480, RCM_ D=3120 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 05:44:51 (10848): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=14896, GCM_PID=10848, RCM_PID=15192 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 18:55:00 (10180): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=3988, GCM_P =10180, RCM_PID=1532 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout10.zip Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 00:19:02 (6796): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=10444, GCM_PID=6796, RCM_PID=4028 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 16:17:54 (10280): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=14844, GCM_PID=10280, RCM_PID=6108 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 06:20:48 (13456): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=13896, GCM_PID=13456, RCM_PID=10524 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 07:31:13 (15928): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=16180, GCM_PID=15928, RCM_PID=12408 Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 07:32:45 (15148): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=13912, GCM_PID=15148, RCM_PID=15756 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 11:42:40 (15656): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=6864, GCM_PID=15656, RCM_PID=608 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 01:47:11 (3376): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=848, GCM_PID=3376, RCM_PID=5884 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists Suspended CPDN Monitor - Suspend request from BOINC... gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 06:38:25 (14000): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=8992, GCM_PID=14000, RCM_PID=11056 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 13:12:49 (2652): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=4824, GCM_PID=2652, RCM_PID=4344 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout11.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 22:19:57 (540): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 executeModelProcess: MonID=12636, GCM_PID=540, RCM_PID=8596 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout_restart.zip Queuing intermediate upload for CPDN/BOINC: cpdnout12.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout13.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout14.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout15.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout16.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout17.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout18.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout19.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout20.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout21.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xadae.namelists C:\ProgramData\BOINC/projects/climateprediction.net/wah2_eas25_12hj_209512_24_1025_012330518/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 generic_phase1_spinup_eas25_global_aabaka_f ic19610516_12_N96 P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P15clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp119_2089-2101 oxi.addfa ozone_cmip6_ssp119_N96_2079_2101 17:30:57 (14364): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "C:\ProgramData\BOINC/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_12hj_209512_24_1025_012330518 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=15336, GCM_PID=14364, RCM_PID=7816 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout22.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Queuing intermediate upload for CPDN/BOINC: cpdnout23.zip Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... 10:04:45 (14364): called boinc_finish(193) Regional Worker:: CPDN process is not running, exiting, bRetVal = T, checkPID = 7816, selfPID = 7816, iMonCtr = 2 Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 14364, selfPID = 15336, iMonCtr = 1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... monitor:finished called ... tidying up. monitor:finished: Uploading out files... Queuing intermediate upload for CPDN/BOINC: cpdnout_out.zip Detaching shared memory... Done. monitor:finished: Closed output file : stdout_<>.txt modelResultFiles : Removing : wah2_eas25_12hj_209512_24_1025_012330518 in C:\ProgramData\BOINC/projects/climateprediction.net monitor:finished: handing over to boinc_finish(RetVal=0) 10:04:51 (15336): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>wah2_eas25_12hj_209512_24_1025_012330518_0_r1673268344_24.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> </message> ]]> |
Latest Trickles Received | ||||||
---|---|---|---|---|---|---|
Time Sent (UTC) | Host ID | Result ID | Result Name | Timestep | CPU Time (sec) | Average (sec/TS) |
10 Nov 2024 22:12:06 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 265,259 | 5,872,321 | 22.1381 |
07 Nov 2024 17:40:10 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 253,739 | 5,624,087 | 22.1649 |
04 Nov 2024 21:07:22 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 242,219 | 5,398,499 | 22.2877 |
03 Nov 2024 14:19:27 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 230,699 | 5,142,923 | 22.2928 |
29 Oct 2024 16:55:56 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 219,179 | 4,909,270 | 22.3985 |
26 Oct 2024 20:02:09 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 207,659 | 4,678,203 | 22.5283 |
24 Oct 2024 00:21:42 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 196,139 | 4,451,369 | 22.6950 |
20 Oct 2024 20:16:44 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 184,619 | 4,196,833 | 22.7324 |
17 Oct 2024 13:53:49 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 173,099 | 3,934,682 | 22.7308 |
14 Oct 2024 20:39:21 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 161,579 | 3,716,426 | 23.0007 |
12 Oct 2024 02:21:15 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 150,059 | 3,494,304 | 23.2862 |
09 Oct 2024 15:50:37 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 138,539 | 3,295,841 | 23.7900 |
06 Oct 2024 20:44:41 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 127,019 | 3,074,595 | 24.2058 |
24 Sep 2024 09:20:30 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 115,499 | 2,803,628 | 24.2740 |
12 Sep 2024 21:34:29 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 103,979 | 2,530,756 | 24.3391 |
04 Sep 2024 21:49:36 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 92,459 | 2,254,551 | 24.3843 |
31 Aug 2024 01:05:30 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 80,939 | 1,965,806 | 24.2875 |
26 Aug 2024 02:47:05 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 69,419 | 1,696,396 | 24.4371 |
22 Aug 2024 15:30:22 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 57,899 | 1,423,625 | 24.5881 |
17 Aug 2024 14:57:40 | 1548299 | 22488421 | wah2_eas25_12hj_209512_24_1025_012330518_0 | 46,379 | 1,121,239 | 24.1756 |
©2025 cpdn.org