Task 22402009

Name	wah2_eas25_h3gh_201712_24_1006_012263289_0
Workunit	12263289
Created	12 Feb 2024, 13:43:04 UTC
Sent	13 Feb 2024, 7:31:09 UTC
Report deadline	12 Jun 2024, 7:31:09 UTC
Received	23 Feb 2024, 12:08:03 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	-226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID	1307591
Run time	6 days 22 hours 30 min 7 sec
CPU time	6 days 8 hours 58 min 51 sec
Validate state	Invalid
Credit	14,103.12
Device peak FLOPS	5.05 GFLOPS
Application version	Weather At Home 2 (wah2) (region independent) v8.29 windows_intelx86
Peak working set size	347.93 MB
Peak swap size	310.14 MB
Peak disk usage	189.83 MB
Stderr	<core_client_version>7.24.1</core_client_version> <![CDATA[ <message> too many boinc_temporary_exit()s</message> <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists modelGetExecutables: unzipping control files : strInput & strTmp wah2_eas25_h3gh_201712_24_1006_012263289.zip wah2_eas25_h3gh_201712_24_1006_012263289/jobs gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=260616, GCM_PID=261076, RCM_PID=257700 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=262056, GCM_PID=261844, RCM_PID=253996 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=264496, GCM_PID=265252, RCM_PID=20924 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=20348, GCM_PID=8484, RCM_PID=21992 modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=20808, GCM_PID=23052, RCM_PID=23180 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=29096, GCM_PID=22920, RCM_PID=33004 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=28968, GCM_PID=5212, RCM_PID=31912 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=40156, GCM_PID=44424, RCM_PID=37224 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=53068, GCM_PID=36768, RCM_PID=11672 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=55652, GCM_PID=72080, RCM_PID=72140 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=71824, GCM_PID=78192, RCM_PID=78224 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=67936, GCM_PID=54976, RCM_PID=75580 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=79400, GCM_PID=62416, RCM_PID=76272 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=74180, GCM_PID=74692, RCM_PID=79744 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=96692, GCM_PID=96336, RCM_PID=71124 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=114184, GCM_PID=112824, RCM_PID=116656 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=114420, GCM_PID=97788, RCM_PID=117016 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=124688, GCM_PID=93732, RCM_PID=107132 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=11124, GCM_PID=124132, RCM_PID=124816 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=113060, GCM_PID=135380, RCM_PID=143816 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=39224, GCM_PID=132872, RCM_PID=146112 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=147180, GCM_PID=139336, RCM_PID=107092 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=168752, GCM_PID=167596, RCM_PID=132996 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=157748, GCM_PID=167116, RCM_PID=168816 CPDN Monitor - Quit request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xadae.namelists C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_h3gh_201712_24_1006_012263289/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 generic_phase1_spinup_eas25_global_aabaka ic19611118_10_N96 ALLclim_ancil_82months_OSTIA_temp_2017-01-01_2023-10-30 ALLclim_ancil_82months_OSTIA_ice_2017-01-01_2023-10-30 SO2DMS_N96_cmip6hist-ssp245_2009-2020 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031 regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_h3gh_201712_24_1006_012263289 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=197832, GCM_PID=197884, RCM_PID=18984 16:49:24 (196816): Can't acquire lockfile (32) - waiting 35s 16:49:59 (196816): Can't acquire lockfile (32) - exiting 16:49:59 (196816): Error: 17:50:18 (198232): Can't acquire lockfile (32) - waiting 35s 17:50:53 (198232): Can't acquire lockfile (32) - exiting 17:50:53 (198232): Error: 18:00:57 (201156): Can't acquire lockfile (32) - waiting 35s 18:01:32 (201156): Can't acquire lockfile (32) - exiting 18:01:32 (201156): Error: 18:36:03 (192092): Can't acquire lockfile (32) - waiting 35s 18:36:38 (192092): Can't acquire lockfile (32) - exiting 18:36:38 (192092): Error: 18:52:15 (189560): Can't acquire lockfile (32) - waiting 35s 18:52:50 (189560): Can't acquire lockfile (32) - exiting 18:52:50 (189560): Error: 19:07:10 (199652): Can't acquire lockfile (32) - waiting 35s 19:07:45 (199652): Can't acquire lockfile (32) - exiting 19:07:45 (199652): Error: 19:20:09 (201704): Can't acquire lockfile (32) - waiting 35s 19:20:44 (201704): Can't acquire lockfile (32) - exiting 19:20:44 (201704): Error: 19:35:05 (201640): Can't acquire lockfile (32) - waiting 35s 19:35:40 (201640): Can't acquire lockfile (32) - exiting 19:35:40 (201640): Error: 19:50:13 (186336): Can't acquire lockfile (32) - waiting 35s 19:50:48 (186336): Can't acquire lockfile (32) - exiting 19:50:48 (186336): Error: 20:05:15 (200404): Can't acquire lockfile (32) - waiting 35s 20:05:50 (200404): Can't acquire lockfile (32) - exiting 20:05:50 (200404): Error: 20:20:41 (202088): Can't acquire lockfile (32) - waiting 35s 20:21:16 (202088): Can't acquire lockfile (32) - exiting 20:21:16 (202088): Error: 20:35:52 (174420): Can't acquire lockfile (32) - waiting 35s 20:36:27 (174420): Can't acquire lockfile (32) - exiting 20:36:27 (174420): Error: 20:50:24 (198356): Can't acquire lockfile (32) - waiting 35s 20:50:59 (198356): Can't acquire lockfile (32) - exiting 20:50:59 (198356): Error: 21:05:41 (200236): Can't acquire lockfile (32) - waiting 35s 21:06:16 (200236): Can't acquire lockfile (32) - exiting 21:06:16 (200236): Error: 21:21:12 (200784): Can't acquire lockfile (32) - waiting 35s 21:21:47 (200784): Can't acquire lockfile (32) - exiting 21:21:47 (200784): Error: 21:36:26 (203048): Can't acquire lockfile (32) - waiting 35s 21:37:01 (203048): Can't acquire lockfile (32) - exiting 21:37:01 (203048): Error: 21:48:14 (192368): Can't acquire lockfile (32) - waiting 35s 21:48:49 (192368): Can't acquire lockfile (32) - exiting 21:48:49 (192368): Error: 22:05:41 (202156): Can't acquire lockfile (32) - waiting 35s 22:06:16 (202156): Can't acquire lockfile (32) - exiting 22:06:16 (202156): Error: 22:19:48 (189516): Can't acquire lockfile (32) - waiting 35s 22:20:23 (189516): Can't acquire lockfile (32) - exiting 22:20:23 (189516): Error: 22:35:40 (200836): Can't acquire lockfile (32) - waiting 35s 22:36:15 (200836): Can't acquire lockfile (32) - exiting 22:36:15 (200836): Error: 22:49:07 (203204): Can't acquire lockfile (32) - waiting 35s 22:49:42 (203204): Can't acquire lockfile (32) - exiting 22:49:42 (203204): Error: 00:19:43 (204688): Can't acquire lockfile (32) - waiting 35s 00:20:18 (204688): Can't acquire lockfile (32) - exiting 00:20:18 (204688): Error: 00:31:41 (205744): Can't acquire lockfile (32) - waiting 35s 00:32:16 (205744): Can't acquire lockfile (32) - exiting 00:32:16 (205744): Error: 00:46:11 (205916): Can't acquire lockfile (32) - waiting 35s 00:46:46 (205916): Can't acquire lockfile (32) - exiting 00:46:46 (205916): Error: 01:02:45 (205776): Can't acquire lockfile (32) - waiting 35s 01:03:20 (205776): Can't acquire lockfile (32) - exiting 01:03:20 (205776): Error: 01:18:28 (195156): Can't acquire lockfile (32) - waiting 35s 01:19:03 (195156): Can't acquire lockfile (32) - exiting 01:19:03 (195156): Error: 01:29:13 (200648): Can't acquire lockfile (32) - waiting 35s 01:29:48 (200648): Can't acquire lockfile (32) - exiting 01:29:48 (200648): Error: 01:39:54 (203812): Can't acquire lockfile (32) - waiting 35s 01:40:29 (203812): Can't acquire lockfile (32) - exiting 01:40:29 (203812): Error: 01:50:41 (204832): Can't acquire lockfile (32) - waiting 35s 01:51:16 (204832): Can't acquire lockfile (32) - exiting 01:51:16 (204832): Error: 02:04:13 (198296): Can't acquire lockfile (32) - waiting 35s 02:04:48 (198296): Can't acquire lockfile (32) - exiting 02:04:48 (198296): Error: 02:20:15 (207360): Can't acquire lockfile (32) - waiting 35s 02:20:50 (207360): Can't acquire lockfile (32) - exiting 02:20:50 (207360): Error: 02:31:01 (203560): Can't acquire lockfile (32) - waiting 35s 02:31:36 (203560): Can't acquire lockfile (32) - exiting 02:31:36 (203560): Error: 02:42:00 (202056): Can't acquire lockfile (32) - waiting 35s 02:42:35 (202056): Can't acquire lockfile (32) - exiting 02:42:35 (202056): Error: 02:52:50 (208596): Can't acquire lockfile (32) - waiting 35s 02:53:25 (208596): Can't acquire lockfile (32) - exiting 02:53:25 (208596): Error: 03:03:34 (200008): Can't acquire lockfile (32) - waiting 35s 03:04:09 (200008): Can't acquire lockfile (32) - exiting 03:04:09 (200008): Error: 03:14:24 (208808): Can't acquire lockfile (32) - waiting 35s 03:14:59 (208808): Can't acquire lockfile (32) - exiting 03:14:59 (208808): Error: 03:25:18 (208888): Can't acquire lockfile (32) - waiting 35s 03:25:54 (208888): Can't acquire lockfile (32) - exiting 03:25:54 (208888): Error: 03:36:23 (206724): Can't acquire lockfile (32) - waiting 35s 03:36:58 (206724): Can't acquire lockfile (32) - exiting 03:36:58 (206724): Error: 03:46:59 (206700): Can't acquire lockfile (32) - waiting 35s 03:47:34 (206700): Can't acquire lockfile (32) - exiting 03:47:34 (206700): Error: 03:57:36 (205240): Can't acquire lockfile (32) - waiting 35s 03:58:11 (205240): Can't acquire lockfile (32) - exiting 03:58:11 (205240): Error: 04:08:19 (208964): Can't acquire lockfile (32) - waiting 35s 04:08:54 (208964): Can't acquire lockfile (32) - exiting 04:08:54 (208964): Error: 04:19:28 (209544): Can't acquire lockfile (32) - waiting 35s 04:20:03 (209544): Can't acquire lockfile (32) - exiting 04:20:03 (209544): Error: 04:30:10 (209572): Can't acquire lockfile (32) - waiting 35s 04:30:45 (209572): Can't acquire lockfile (32) - exiting 04:30:45 (209572): Error: 04:41:20 (208428): Can't acquire lockfile (32) - waiting 35s 04:41:55 (208428): Can't acquire lockfile (32) - exiting 04:41:55 (208428): Error: 04:57:15 (209836): Can't acquire lockfile (32) - waiting 35s 04:57:50 (209836): Can't acquire lockfile (32) - exiting 04:57:50 (209836): Error: 05:07:54 (197244): Can't acquire lockfile (32) - waiting 35s 05:08:29 (197244): Can't acquire lockfile (32) - exiting 05:08:29 (197244): Error: 05:18:31 (204632): Can't acquire lockfile (32) - waiting 35s 05:19:06 (204632): Can't acquire lockfile (32) - exiting 05:19:06 (204632): Error: 05:29:44 (209252): Can't acquire lockfile (32) - waiting 35s 05:30:19 (209252): Can't acquire lockfile (32) - exiting 05:30:19 (209252): Error: 05:40:20 (210520): Can't acquire lockfile (32) - waiting 35s 05:40:55 (210520): Can't acquire lockfile (32) - exiting 05:40:55 (210520): Error: 09:57:53 (211732): Can't acquire lockfile (32) - waiting 35s 09:58:29 (211732): Can't acquire lockfile (32) - exiting 09:58:29 (211732): Error: 10:08:55 (210208): Can't acquire lockfile (32) - waiting 35s 10:09:30 (210208): Can't acquire lockfile (32) - exiting 10:09:30 (210208): Error: 10:24:18 (211236): Can't acquire lockfile (32) - waiting 35s 10:24:53 (211236): Can't acquire lockfile (32) - exiting 10:24:53 (211236): Error: 10:35:00 (192100): Can't acquire lockfile (32) - waiting 35s 10:35:35 (192100): Can't acquire lockfile (32) - exiting 10:35:35 (192100): Error: 10:49:05 (193296): Can't acquire lockfile (32) - waiting 35s 10:49:40 (193296): Can't acquire lockfile (32) - exiting 10:49:40 (193296): Error: 11:04:19 (213816): Can't acquire lockfile (32) - waiting 35s 11:04:54 (213816): Can't acquire lockfile (32) - exiting 11:04:54 (213816): Error: 11:20:12 (213680): Can't acquire lockfile (32) - waiting 35s 11:20:47 (213680): Can't acquire lockfile (32) - exiting 11:20:47 (213680): Error: 11:35:11 (216672): Can't acquire lockfile (32) - waiting 35s 11:35:46 (216672): Can't acquire lockfile (32) - exiting 11:35:46 (216672): Error: 11:45:56 (203436): Can't acquire lockfile (32) - waiting 35s 11:46:31 (203436): Can't acquire lockfile (32) - exiting 11:46:31 (203436): Error: 11:57:14 (201956): Can't acquire lockfile (32) - waiting 35s 11:57:49 (201956): Can't acquire lockfile (32) - exiting 11:57:49 (201956): Error: 12:08:32 (192168): Can't acquire lockfile (32) - waiting 35s 12:09:07 (192168): Can't acquire lockfile (32) - exiting 12:09:07 (192168): Error: 12:19:14 (180540): Can't acquire lockfile (32) - waiting 35s 12:19:49 (180540): Can't acquire lockfile (32) - exiting 12:19:49 (180540): Error: 12:30:32 (187888): Can't acquire lockfile (32) - waiting 35s 12:31:07 (187888): Can't acquire lockfile (32) - exiting 12:31:07 (187888): Error: 12:41:26 (209976): Can't acquire lockfile (32) - waiting 35s 12:42:01 (209976): Can't acquire lockfile (32) - exiting 12:42:01 (209976): Error: 12:52:36 (174684): Can't acquire lockfile (32) - waiting 35s 12:53:11 (174684): Can't acquire lockfile (32) - exiting 12:53:11 (174684): Error: 13:03:36 (213956): Can't acquire lockfile (32) - waiting 35s 13:04:11 (213956): Can't acquire lockfile (32) - exiting 13:04:11 (213956): Error: 13:14:28 (214472): Can't acquire lockfile (32) - waiting 35s 13:15:03 (214472): Can't acquire lockfile (32) - exiting 13:15:03 (214472): Error: 13:25:12 (191592): Can't acquire lockfile (32) - waiting 35s 13:25:47 (191592): Can't acquire lockfile (32) - exiting 13:25:47 (191592): Error: 13:36:10 (208540): Can't acquire lockfile (32) - waiting 35s 13:36:45 (208540): Can't acquire lockfile (32) - exiting 13:36:45 (208540): Error: 13:53:52 (214336): Can't acquire lockfile (32) - waiting 35s 13:54:27 (214336): Can't acquire lockfile (32) - exiting 13:54:27 (214336): Error: 14:04:39 (197196): Can't acquire lockfile (32) - waiting 35s 14:05:14 (197196): Can't acquire lockfile (32) - exiting 14:05:14 (197196): Error: 14:15:18 (209212): Can't acquire lockfile (32) - waiting 35s 14:15:53 (209212): Can't acquire lockfile (32) - exiting 14:15:53 (209212): Error: 14:25:57 (204332): Can't acquire lockfile (32) - waiting 35s 14:26:32 (204332): Can't acquire lockfile (32) - exiting 14:26:32 (204332): Error: 14:36:44 (191664): Can't acquire lockfile (32) - waiting 35s 14:37:19 (191664): Can't acquire lockfile (32) - exiting 14:37:19 (191664): Error: 14:47:58 (211940): Can't acquire lockfile (32) - waiting 35s 14:48:33 (211940): Can't acquire lockfile (32) - exiting 14:48:33 (211940): Error: 14:58:38 (176716): Can't acquire lockfile (32) - waiting 35s 14:59:13 (176716): Can't acquire lockfile (32) - exiting 14:59:13 (176716): Error: 15:09:24 (215684): Can't acquire lockfile (32) - waiting 35s 15:09:59 (215684): Can't acquire lockfile (32) - exiting 15:09:59 (215684): Error: 15:20:05 (211476): Can't acquire lockfile (32) - waiting 35s 15:20:40 (211476): Can't acquire lockfile (32) - exiting 15:20:40 (211476): Error: 15:30:42 (215380): Can't acquire lockfile (32) - waiting 35s 15:31:17 (215380): Can't acquire lockfile (32) - exiting 15:31:17 (215380): Error: 15:41:28 (214228): Can't acquire lockfile (32) - waiting 35s 15:42:03 (214228): Can't acquire lockfile (32) - exiting 15:42:03 (214228): Error: 15:52:56 (218368): Can't acquire lockfile (32) - waiting 35s 15:53:31 (218368): Can't acquire lockfile (32) - exiting 15:53:31 (218368): Error: 16:03:48 (213404): Can't acquire lockfile (32) - waiting 35s 16:04:23 (213404): Can't acquire lockfile (32) - exiting 16:04:23 (213404): Error: 16:14:58 (217256): Can't acquire lockfile (32) - waiting 35s 16:15:33 (217256): Can't acquire lockfile (32) - exiting 16:15:33 (217256): Error: 16:28:45 (218364): Can't acquire lockfile (32) - waiting 35s 16:29:20 (218364): Can't acquire lockfile (32) - exiting 16:29:20 (218364): Error: 16:39:28 (198980): Can't acquire lockfile (32) - waiting 35s 16:40:03 (198980): Can't acquire lockfile (32) - exiting 16:40:03 (198980): Error: 16:50:33 (218940): Can't acquire lockfile (32) - waiting 35s 16:51:08 (218940): Can't acquire lockfile (32) - exiting 16:51:08 (218940): Error: 17:01:52 (218696): Can't acquire lockfile (32) - waiting 35s 17:02:27 (218696): Can't acquire lockfile (32) - exiting 17:02:27 (218696): Error: 17:12:43 (200468): Can't acquire lockfile (32) - waiting 35s 17:13:18 (200468): Can't acquire lockfile (32) - exiting 17:13:18 (200468): Error: 17:23:26 (217680): Can't acquire lockfile (32) - waiting 35s 17:24:01 (217680): Can't acquire lockfile (32) - exiting 17:24:01 (217680): Error: 17:34:08 (221092): Can't acquire lockfile (32) - waiting 35s 17:34:43 (221092): Can't acquire lockfile (32) - exiting 17:34:43 (221092): Error: 17:44:55 (213428): Can't acquire lockfile (32) - waiting 35s 17:45:30 (213428): Can't acquire lockfile (32) - exiting 17:45:30 (213428): Error: 17:56:11 (199768): Can't acquire lockfile (32) - waiting 35s 17:56:46 (199768): Can't acquire lockfile (32) - exiting 17:56:46 (199768): Error: 18:07:21 (216216): Can't acquire lockfile (32) - waiting 35s 18:07:56 (216216): Can't acquire lockfile (32) - exiting 18:07:56 (216216): Error: 18:18:23 (215396): Can't acquire lockfile (32) - waiting 35s 18:18:58 (215396): Can't acquire lockfile (32) - exiting 18:18:58 (215396): Error: 18:29:24 (208764): Can't acquire lockfile (32) - waiting 35s 18:29:59 (208764): Can't acquire lockfile (32) - exiting 18:29:59 (208764): Error: 18:40:10 (213760): Can't acquire lockfile (32) - waiting 35s 18:40:45 (213760): Can't acquire lockfile (32) - exiting 18:40:45 (213760): Error: 18:51:31 (217748): Can't acquire lockfile (32) - waiting 35s 18:52:06 (217748): Can't acquire lockfile (32) - exiting 18:52:06 (217748): Error: 19:02:14 (217628): Can't acquire lockfile (32) - waiting 35s 19:02:49 (217628): Can't acquire lockfile (32) - exiting 19:02:49 (217628): Error: 19:12:56 (219596): Can't acquire lockfile (32) - waiting 35s 19:13:31 (219596): Can't acquire lockfile (32) - exiting 19:13:31 (219596): Error: 19:23:38 (151328): Can't acquire lockfile (32) - waiting 35s 19:24:13 (151328): Can't acquire lockfile (32) - exiting 19:24:13 (151328): Error: 19:34:32 (212580): Can't acquire lockfile (32) - waiting 35s 19:35:07 (212580): Can't acquire lockfile (32) - exiting 19:35:07 (212580): Error: 19:45:09 (212692): Can't acquire lockfile (32) - waiting 35s 19:45:44 (212692): Can't acquire lockfile (32) - exiting 19:45:44 (212692): Error: 19:56:02 (219372): Can't acquire lockfile (32) - waiting 35s 19:56:37 (219372): Can't acquire lockfile (32) - exiting 19:56:37 (219372): Error: 20:06:41 (220780): Can't acquire lockfile (32) - waiting 35s 20:07:16 (220780): Can't acquire lockfile (32) - exiting 20:07:16 (220780): Error: </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
22 Feb 2024 06:48:26	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	196,139	548,385	2.7959
21 Feb 2024 12:00:08	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	184,619	516,665	2.7985
21 Feb 2024 01:17:17	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	173,099	483,227	2.7916
20 Feb 2024 13:53:44	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	161,579	451,008	2.7913
20 Feb 2024 04:07:46	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	150,059	419,647	2.7965
19 Feb 2024 12:54:03	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	138,539	388,020	2.8008
19 Feb 2024 02:43:09	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	127,019	354,705	2.7925
18 Feb 2024 14:12:13	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	115,499	322,074	2.7885
18 Feb 2024 03:02:02	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	103,979	289,657	2.7857
17 Feb 2024 17:15:22	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	92,459	256,902	2.7786
17 Feb 2024 07:36:34	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	80,939	224,606	2.7750
16 Feb 2024 20:43:57	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	69,419	192,003	2.7659
16 Feb 2024 10:59:51	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	57,899	159,153	2.7488
15 Feb 2024 18:50:51	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	46,379	126,741	2.7327
15 Feb 2024 09:52:34	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	34,859	96,008	2.7542
14 Feb 2024 23:58:41	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	23,339	63,512	2.7213
14 Feb 2024 11:40:23	1307591	22402009	wah2_eas25_h3gh_201712_24_1006_012263289_0	11,819	32,187	2.7233