climateprediction.net (CPDN) home page
Task 22531383

Task 22531383

Name wah2_eas25_22vi_209612_24_1026_012336565_2
Workunit 12336565
Created 19 Nov 2024, 5:14:00 UTC
Sent 19 Nov 2024, 5:14:26 UTC
Report deadline 27 Feb 2025, 5:14:26 UTC
Received 26 Dec 2024, 15:23:16 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 0 (0x00000000)
Computer ID 1485269
Run time 17 days 11 hours 31 min 7 sec
CPU time 11 days 8 hours 16 min 58 sec
Validate state Invalid
Credit 13,274.79
Device peak FLOPS 4.13 GFLOPS
Application version Weather At Home 2 (wah2) (region independent) v8.32
windows_intelx86
Peak working set size 363.16 MB
Peak swap size 309.30 MB
Peak disk usage 494.98 MB
Stderr 
<core_client_version>7.14.2</core_client_version>
<![CDATA[
<stderr_txt>
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
modelGetExecutables: unzipping control files : strInput & strTmp 
wah2_eas25_22vi_209612_24_1026_012336565.zip
wah2_eas25_22vi_209612_24_1026_012336565/jobs
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=98172, GCM_PID=93364, RCM_PID=97932
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=176476, GCM_PID=183172, RCM_PID=173420
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=192368, GCM_PID=132252, RCM_PID=131136
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=297136, GCM_PID=129368, RCM_PID=126220
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=221400, GCM_PID=278512, RCM_PID=271344
Queuing intermediate upload for CPDN/BOINC: cpdnout1.zip
ControllermodelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=8240, GCM_PID=4736, RCM_PID=19260
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=15980, GCM_PID=14780, RCM_PID=28328
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=119504, GCM_PID=127352, RCM_PID=127388
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
10:43:44 (7620): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=24220, GCM_PID=7620, RCM_PID=18792
Queuing intermediate upload for CPDN/BOINC: cpdnout2.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
19:24:50 (3188): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=21964, GCM_PID=3188, RCM_PID=13320
Queuing intermediate upload for CPDN/BOINC: cpdnout3.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
23:08:00 (15532): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=56432, GCM_PID=15532, RCM_PID=18968
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 15532, selfPID = 56432, iMonCtr = 1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
monitor:finished called ... tidying up.
monitor:finished: Uploading out files...
Queuing intermediate upload for CPDN/BOINC: cpdnout_out.zip
Detaching shared memory... Done.
monitor:finished: Closed output file : stdout_<>.txt
modelResultFiles : Removing : wah2_eas25_22vi_209612_24_1026_012336565 in D:\Boinc\Data/projects/climateprediction.net
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
modelGetExecutables: unzipping control files : strInput & strTmp 
wah2_eas25_22vi_209612_24_1026_012336565.zip
wah2_eas25_22vi_209612_24_1026_012336565/jobs
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
04:49:21 (27436): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=20268, GCM_PID=27436, RCM_PID=27132
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=7368, GCM_PID=15992, RCM_PID=5432
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
18:37:47 (66436): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=62468, GCM_PID=66436, RCM_PID=51484
Queuing intermediate upload for CPDN/BOINC: cpdnout1.zip
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 66436, selfPID = 62468, iMonCtr = 1
Model crash detected, will try to restart...
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
17:31:11 (21664): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=23264, GCM_PID=21664, RCM_PID=21964
Queuing intermediate upload for CPDN/BOINC: cpdnout2.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout3.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout4.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
20:05:05 (10100): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=10860, GCM_PID=10100, RCM_PID=7592
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 10100, selfPID = 10860, iMonCtr = 1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
20:09:07 (15308): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=21548, GCM_PID=15308, RCM_PID=12620
Queuing intermediate upload for CPDN/BOINC: cpdnout5.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
19:08:32 (60228): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=26
264, GCM_PID=60228, RCM_PID=60208
Queuing intermediate upload for CPDN/BOINC: cpdnout6.zip
CPDN Monitor - QumodelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
18:23:19 (2900): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelPro
cess: MonID=21568, GCM_PID=2900, RCM_PID=61692
Queuing intermediate upload for CPDN/BOINC: cpdnout7.zip
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=40252, GCM_PID=70816, RCM_PID=63868
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 70816, selfPID = 40252, iMonCtr = 1
Model crash detected, will try to restart...
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
04:12:29 (17916): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=28304, GCM_PID=17916, RCM_PID=19660
Queuing intermediate upload for CPDN/BOINC: cpdnout8.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
17:39:03 (140416): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=136108, GCM_PID=140416, RCM_PID=123040
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
18:04:18 (22480): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=19824, GCM_PID=22480, RCM_PID=24592
Queuing intermediate upload for CPDN/BOINC: cpdnout9.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
05:47:06 (49472): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=59228, GCM_PID=49472, RCM_PID=57580
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
10:09:54 (20404): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=57636, GCM_PID=20404, RCM_PID=24828
Global Worker:: CPDN process is not running, exiting, bRetVal = T, checkPID = 20404, selfPID = 20404, iMonCtr = 1
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
19:12:05 (15556): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=35056, GCM_PID=15556, RCM_PID=39268

Queuing intermediate upload for CPDN/BOINC: cpdnout10.zip
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 15556, selfPID = 35056, iMonCtr = 1
Model crash detected, will try to restart...
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
17:48:06 (15508): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=44324, GCM_PID=15508, RCM_PID=49376
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 15508, selfPID = 44324, iMonCtr = 1
Model crash detected, will try to restart...
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
18:07:51 (25216): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=17380, GCM_PID=25216, RCM_PID=24980
Queuing intermediate upload for CPDN/BOINC: cpdnout11.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
19:12:20 (11104): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=15972, GCM_PID=11104, RCM_PID=6328
Global Worker:: CPDN process is not running, exiting, bRetVal = TRegional Worker, checkPID = :: CPDN process is not running, exiting, bRetVal = 11104T, selfPID = , checkPID = 11104, iMonCtr = 1
11104, selfPID = 6328, iMonCtr = 1
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
20:18:55 (12324): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=26812, GCM_PID=12324, RCM_PID=27588
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=26396, GCM_PID=34572, RCM_PID=34240
Queuing intermediate upload for CPDN/BOINC: cpdnout_restart.zip
Queuing intermediate upload for CPDN/BOINC: cpdnout12.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=20488, GCM_PID=24584, RCM_PID=25184
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
04:52:25 (13164): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=13688, GCM_PID=13164, RCM_PID=17564
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 13164, selfPID = 13688, iMonCtr = 1
Model crash detected, will try to restart...
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
22:06:43 (48848): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=1484, GCM_PID=48848, RCM_PID=48028
Queuing intermediate upload for CPDN/BOINC: cpdnout13.zip
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 48848, selfPID = 1484, iMonCtr = 1
Model crash detected, will try to restart...
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=15048, GCM_PID=27272, RCM_PID=16804
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
19:19:06 (61432): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. e
xecuteModelProcess: MonID=57012, GCM_PID=61432, RCM_PID=43660
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=64344, GCM_PID=41088, RCM_PID=43904
Queuing intermediate upload for CPDN/BOINC: cpdnout14.zip
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 41088, selfPID = 64344, iMonCtr = 1
Model crash detected, will try to restart...
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
executeModelProcess: MonID=26156, GCM_PID=20092, RCM_PID=15432
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
16:37:59 (26764): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=15644, GCM_PID=26764, RCM_PID=26824
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
22:35:44 (119404): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=117724, GCM_PID=119404, RCM_PID=119048
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
19:51:45 (53396): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: Mon
ID=173420, GCM_PID=53396, RCM_PID=173760
Queuing intermediate upload for CPDN/BOINC: cpdnout15.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=204656, GCM_PID=209616, RCM_PID=215192
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
11:06:23 (10812): start_timer_thread(): CreateThread() failed, errno 0
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=23284, GCM_PID=10812, RCM_PID=23148
Queuing intermediate upload for CPDN/BOINC: cpdnout16.zip
CPDN Monitor - Quit request from BOINC...
Detaching shared memory... Done.
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=22188, GCM_PID=22384, RCM_PID=26000
Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 22384, selfPID = 22188, iMonCtr = 1
Model crash detected, will try to restart...
Leaving CPDN_Main::Monitor...
monitor:finished called ... tidying up.
monitor:finished: Uploading out files...
Queuing intermediate upload for CPDN/BOINC: cpdnout_out.zip
Detaching shared memory... Done.
monitor:finished: Closed output file : stdout_<>.txt
modelResultFiles : Removing : wah2_eas25_22vi_209612_24_1026_012336565 in D:\Boinc\Data/projects/climateprediction.net
modelGetExecutables: check control files, strTemp0 & 1 : 
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xadae.namelists
D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/jobs/xacxf.namelists
modelGetExecutables: unzipping control files : strInput & strTmp 
wah2_eas25_22vi_209612_24_1026_012336565.zip
wah2_eas25_22vi_209612_24_1026_012336565/jobs
cpdnmonitor: cannot open input file D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/dataout/atmos_restart.day after 11 attempts
cpdnmonitor: cannot open input file D:\Boinc\Data/projects/climateprediction.net/wah2_eas25_22vi_209612_24_1026_012336565/dataout/region_restart.day after 11 attempts
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f
global model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565 generic_phase1_spinup_eas25_global_aabaka_f ic19611121_14_N96 P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SST_2089-01-01_2102-12-30_v2404b P20clim_ancil_168months_CMIP6-EC-Earth3-Veg_SIC_2089-01-01_2102-12-30_v2404b SO2DMS_N96_cmip6ssp126_2089-2101 oxi.addfa ozone_cmip6_ssp126_N96_2079_2101
16:12:41 (17244): start_timer_thread(): CreateThread() failed, errno 0

Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO                                                                                                                                                                                           tmp/xadae.pipe_dummy                                                            
regional model: command string: "D:\Boinc\Data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_22vi_209612_24_1026_012336565

Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO                                                                                                                                                                                           tmp/xacxf.pipe_dummy                                                            
executeModelProcess: MonID=24940, GCM_PID=17244, RCM_PID=24800
Leaving CPDN_Main::Monitor...
monitor:finished called ... tidying up.
monitor:finished: Uploading out files...
Queuing intermediate upload for CPDN/BOINC: cpdnout_out.zip
Detaching shared memory... Done.
monitor:finished: Closed output file : stdout_<>.txt
modelResultFiles : Removing : wah2_eas25_22vi_209612_24_1026_012336565 in D:\Boinc\Data/projects/climateprediction.net
monitor:finished: handing over to boinc_finish(RetVal=0)
16:12:51 (24940): called boinc_finish(0)

</stderr_txt>
<message>
upload failure: <file_xfer_error>
  <file_name>wah2_eas25_22vi_209612_24_1026_012336565_2_r2084848253_17.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_22vi_209612_24_1026_012336565_2_r2084848253_18.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_22vi_209612_24_1026_012336565_2_r2084848253_19.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_22vi_209612_24_1026_012336565_2_r2084848253_20.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_22vi_209612_24_1026_012336565_2_r2084848253_21.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_22vi_209612_24_1026_012336565_2_r2084848253_22.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_22vi_209612_24_1026_012336565_2_r2084848253_23.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
<file_xfer_error>
  <file_name>wah2_eas25_22vi_209612_24_1026_012336565_2_r2084848253_24.zip</file_name>
  <error_code>-240 (stat() failed)</error_code>
</file_xfer_error>
</message>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
26 Dec 2024 00:04:59 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 184,619 972,133 5.2656
22 Dec 2024 23:48:42 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 173,099 896,966 5.1818
19 Dec 2024 22:00:24 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 161,579 808,386 5.0030
17 Dec 2024 06:27:14 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 150,059 719,601 4.7955
12 Dec 2024 18:38:00 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 138,539 632,830 4.5679
11 Dec 2024 00:11:14 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 127,019 581,221 4.5759
09 Dec 2024 22:13:50 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 115,499 531,804 4.6044
08 Dec 2024 19:03:44 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 103,979 483,658 4.6515
07 Dec 2024 20:32:47 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 92,459 437,972 4.7369
06 Dec 2024 06:30:01 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 80,939 387,593 4.7887
05 Dec 2024 01:24:39 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 69,419 336,729 4.8507
03 Dec 2024 22:54:45 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 57,899 286,676 4.9513
02 Dec 2024 16:30:37 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 46,379 232,793 5.0194
01 Dec 2024 04:31:50 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 34,859 177,110 5.0808
26 Nov 2024 02:18:29 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 34,859 237,464 6.8121
30 Nov 2024 03:44:10 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 23,339 120,378 5.1578
24 Nov 2024 12:10:35 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 23,339 155,411 6.6589
28 Nov 2024 23:11:41 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 11,819 61,659 5.2169
22 Nov 2024 06:31:45 1485269 22531383 wah2_eas25_22vi_209612_24_1026_012336565_2 11,819 78,977 6.6822


©2025 cpdn.org