climateprediction.net home page
Task 22405385

Task 22405385

Name wah2_eas25_a0d6_198712_24_1007_012265330_0
Workunit 12265330
Created 15 Feb 2024, 23:38:01 UTC
Sent 16 Feb 2024, 4:46:55 UTC
Report deadline 15 Jun 2024, 4:46:55 UTC
Received 23 Feb 2024, 12:08:03 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status -226 (0xFFFFFF1E) ERR_TOO_MANY_EXITS
Computer ID 1307591
Run time 5 days 3 hours 56 min 6 sec
CPU time 4 days 16 hours 58 min 45 sec
Validate state Invalid
Credit 9,961.47
Device peak FLOPS 5.05 GFLOPS
Application version Weather At Home 2 (wah2) (region independent) v8.29
windows_intelx86
Peak working set size 348.11 MB
Peak swap size 310.23 MB
Peak disk usage 283.68 MB
Stderr
<core_client_version>7.24.1</core_client_version>
<![CDATA[
<message>
too many boinc_temporary_exit()s</message>
<stderr_txt>
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
modelGetExecutables: unzipping control files : strInput & strTmp 
wah2_eas25_a0d6_198712_24_1007_012265330.zip
wah2_eas25_a0d6_198712_24_1007_012265330/jobs
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=78536, GCM_PID=78880, RCM_PID=17548
CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=77576, GCM_PID=26484, RCM_PID=67360

CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=84040, GCM_PID=71608, RCM_PID=82132
CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=97348, GCM_PID=97836, RCM_PID=95012
CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=96688, GCM_PID=113836, RCM_PID=113276
CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=116428, GCM_PID=113324, RCM_PID=91396
CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=79264, GCM_PID=114200, RCM_PID=120648
CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=123824, GCM_PID=115296, RCM_PID=86584
CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=123520, GCM_PID=132876, RCM_PID=142248
CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=144912, GCM_PID=28228, RCM_PID=146048
CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=144544, GCM_PID=104444, RCM_PID=145080
CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=167836, GCM_PID=165484, RCM_PID=163976
CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=140552, GCM_PID=148776, RCM_PID=130576
CPDN Monitor - Quit request from BOINC...
modelGetExecutables: check control files, strTemp0 & 1 : 
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xadae.namelists
C:\BOINC\DATA/projects/climateprediction.net/wah2_eas25_a0d6_198712_24_1007_012265330/jobs/xacxf.namelists
gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka
gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka
global model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2am3m2_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330 generic_phase1_spinup_eas25_global_aabaka ic19610102_12_N96 ALLclim_ancil_134months_OSTIA_sst_1985-12-01_1997-01-30 ALLclim_ancil_134months_OSTIA_ice_1985-12-01_1997-01-30 SO2DMS_N96_cmip6hist_1979-1990 oxi.addfa ozone_cmip6hist-ssp245_N96_1979_2031
regional model: command string: "C:\BOINC\DATA/projects/climateprediction.net/wah2rm3m2t_um_8.29_windows_intelx86.exe" wah2_eas25_a0d6_198712_24_1007_012265330
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. 
executeModelProcess: MonID=182252, GCM_PID=187336, RCM_PID=197648
16:49:24 (193460): Can't acquire lockfile (32) - waiting 35s
16:49:59 (193460): Can't acquire lockfile (32) - exiting
16:49:59 (193460): Error: 
17:50:53 (194900): Can't acquire lockfile (32) - waiting 35s
17:51:28 (194900): Can't acquire lockfile (32) - exiting
17:51:28 (194900): Error: 
18:00:57 (201072): Can't acquire lockfile (32) - waiting 35s
18:01:32 (201072): Can't acquire lockfile (32) - exiting
18:01:32 (201072): Error: 
18:36:38 (197776): Can't acquire lockfile (32) - waiting 35s
18:37:13 (197776): Can't acquire lockfile (32) - exiting
18:37:13 (197776): Error: 
18:52:50 (192096): Can't acquire lockfile (32) - waiting 35s
18:53:25 (192096): Can't acquire lockfile (32) - exiting
18:53:25 (192096): Error: 
19:07:45 (198868): Can't acquire lockfile (32) - waiting 35s
19:08:20 (198868): Can't acquire lockfile (32) - exiting
19:08:20 (198868): Error: 
19:20:25 (189568): Can't acquire lockfile (32) - waiting 35s
19:21:01 (189568): Can't acquire lockfile (32) - exiting
19:21:01 (189568): Error: 
19:35:15 (186320): Can't acquire lockfile (32) - waiting 35s
19:35:50 (186320): Can't acquire lockfile (32) - exiting
19:35:50 (186320): Error: 
19:50:20 (191572): Can't acquire lockfile (32) - waiting 35s
19:50:55 (191572): Can't acquire lockfile (32) - exiting
19:50:55 (191572): Error: 
20:05:38 (202544): Can't acquire lockfile (32) - waiting 35s
20:06:13 (202544): Can't acquire lockfile (32) - exiting
20:06:13 (202544): Error: 
20:20:47 (191628): Can't acquire lockfile (32) - waiting 35s
20:21:22 (191628): Can't acquire lockfile (32) - exiting
20:21:22 (191628): Error: 
20:36:01 (196192): Can't acquire lockfile (32) - waiting 35s
20:36:36 (196192): Can't acquire lockfile (32) - exiting
20:36:36 (196192): Error: 
20:50:47 (161120): Can't acquire lockfile (32) - waiting 35s
20:51:22 (161120): Can't acquire lockfile (32) - exiting
20:51:22 (161120): Error: 
21:06:01 (140092): Can't acquire lockfile (32) - waiting 35s
21:06:36 (140092): Can't acquire lockfile (32) - exiting
21:06:36 (140092): Error: 
21:21:24 (191124): Can't acquire lockfile (32) - waiting 35s
21:21:59 (191124): Can't acquire lockfile (32) - exiting
21:21:59 (191124): Error: 
21:36:39 (195868): Can't acquire lockfile (32) - waiting 35s
21:37:14 (195868): Can't acquire lockfile (32) - exiting
21:37:14 (195868): Error: 
21:48:50 (190408): Can't acquire lockfile (32) - waiting 35s
21:49:25 (190408): Can't acquire lockfile (32) - exiting
21:49:25 (190408): Error: 
22:06:16 (182832): Can't acquire lockfile (32) - waiting 35s
22:06:51 (182832): Can't acquire lockfile (32) - exiting
22:06:51 (182832): Error: 
22:20:23 (203964): Can't acquire lockfile (32) - waiting 35s
22:20:58 (203964): Can't acquire lockfile (32) - exiting
22:20:58 (203964): Error: 
22:36:15 (204616): Can't acquire lockfile (32) - waiting 35s
22:36:50 (204616): Can't acquire lockfile (32) - exiting
22:36:50 (204616): Error: 
22:49:42 (203308): Can't acquire lockfile (32) - waiting 35s
22:50:17 (203308): Can't acquire lockfile (32) - exiting
22:50:17 (203308): Error: 
00:19:43 (186128): Can't acquire lockfile (32) - waiting 35s
00:20:18 (186128): Can't acquire lockfile (32) - exiting
00:20:18 (186128): Error: 
00:32:16 (204592): Can't acquire lockfile (32) - waiting 35s
00:32:51 (204592): Can't acquire lockfile (32) - exiting
00:32:51 (204592): Error: 
00:46:46 (203480): Can't acquire lockfile (32) - waiting 35s
00:47:21 (203480): Can't acquire lockfile (32) - exiting
00:47:21 (203480): Error: 
01:03:20 (202524): Can't acquire lockfile (32) - waiting 35s
01:03:55 (202524): Can't acquire lockfile (32) - exiting
01:03:55 (202524): Error: 
01:19:03 (207176): Can't acquire lockfile (32) - waiting 35s
01:19:38 (207176): Can't acquire lockfile (32) - exiting
01:19:38 (207176): Error: 
01:29:49 (207504): Can't acquire lockfile (32) - waiting 35s
01:30:24 (207504): Can't acquire lockfile (32) - exiting
01:30:24 (207504): Error: 
01:40:29 (203848): Can't acquire lockfile (32) - waiting 35s
01:41:04 (203848): Can't acquire lockfile (32) - exiting
01:41:04 (203848): Error: 
01:51:17 (208688): Can't acquire lockfile (32) - waiting 35s
01:51:52 (208688): Can't acquire lockfile (32) - exiting
01:51:52 (208688): Error: 
02:04:48 (208176): Can't acquire lockfile (32) - waiting 35s
02:05:23 (208176): Can't acquire lockfile (32) - exiting
02:05:23 (208176): Error: 
02:20:15 (178648): Can't acquire lockfile (32) - waiting 35s
02:20:50 (178648): Can't acquire lockfile (32) - exiting
02:20:50 (178648): Error: 
02:31:01 (200396): Can't acquire lockfile (32) - waiting 35s
02:31:36 (200396): Can't acquire lockfile (32) - exiting
02:31:36 (200396): Error: 
02:42:35 (205588): Can't acquire lockfile (32) - waiting 35s
02:43:10 (205588): Can't acquire lockfile (32) - exiting
02:43:10 (205588): Error: 
02:53:26 (177296): Can't acquire lockfile (32) - waiting 35s
02:54:01 (177296): Can't acquire lockfile (32) - exiting
02:54:01 (177296): Error: 
03:04:09 (194964): Can't acquire lockfile (32) - waiting 35s
03:04:44 (194964): Can't acquire lockfile (32) - exiting
03:04:44 (194964): Error: 
03:15:00 (207768): Can't acquire lockfile (32) - waiting 35s
03:15:35 (207768): Can't acquire lockfile (32) - exiting
03:15:35 (207768): Error: 
03:25:46 (208776): Can't acquire lockfile (32) - waiting 35s
03:26:21 (208776): Can't acquire lockfile (32) - exiting
03:26:21 (208776): Error: 
03:36:58 (208296): Can't acquire lockfile (32) - waiting 35s
03:37:33 (208296): Can't acquire lockfile (32) - exiting
03:37:33 (208296): Error: 
03:47:35 (207428): Can't acquire lockfile (32) - waiting 35s
03:48:10 (207428): Can't acquire lockfile (32) - exiting
03:48:10 (207428): Error: 
03:58:11 (202560): Can't acquire lockfile (32) - waiting 35s
03:58:46 (202560): Can't acquire lockfile (32) - exiting
03:58:46 (202560): Error: 
04:08:55 (192516): Can't acquire lockfile (32) - waiting 35s
04:09:30 (192516): Can't acquire lockfile (32) - exiting
04:09:30 (192516): Error: 
04:19:33 (193820): Can't acquire lockfile (32) - waiting 35s
04:20:08 (193820): Can't acquire lockfile (32) - exiting
04:20:08 (193820): Error: 
04:30:46 (203808): Can't acquire lockfile (32) - waiting 35s
04:31:21 (203808): Can't acquire lockfile (32) - exiting
04:31:21 (203808): Error: 
04:41:55 (203820): Can't acquire lockfile (32) - waiting 35s
04:42:30 (203820): Can't acquire lockfile (32) - exiting
04:42:30 (203820): Error: 
04:57:51 (209740): Can't acquire lockfile (32) - waiting 35s
04:58:26 (209740): Can't acquire lockfile (32) - exiting
04:58:26 (209740): Error: 
05:08:29 (143424): Can't acquire lockfile (32) - waiting 35s
05:09:04 (143424): Can't acquire lockfile (32) - exiting
05:09:04 (143424): Error: 
05:19:07 (205052): Can't acquire lockfile (32) - waiting 35s
05:19:42 (205052): Can't acquire lockfile (32) - exiting
05:19:42 (205052): Error: 
05:29:44 (210200): Can't acquire lockfile (32) - waiting 35s
05:30:19 (210200): Can't acquire lockfile (32) - exiting
05:30:19 (210200): Error: 
05:40:56 (210032): Can't acquire lockfile (32) - waiting 35s
05:41:31 (210032): Can't acquire lockfile (32) - exiting
05:41:31 (210032): Error: 
09:57:54 (183684): Can't acquire lockfile (32) - waiting 35s
09:58:29 (183684): Can't acquire lockfile (32) - exiting
09:58:29 (183684): Error: 
10:09:01 (211896): Can't acquire lockfile (32) - waiting 35s
10:09:36 (211896): Can't acquire lockfile (32) - exiting
10:09:36 (211896): Error: 
10:35:00 (210756): Can't acquire lockfile (32) - waiting 35s
10:35:35 (210756): Can't acquire lockfile (32) - exiting
10:35:35 (210756): Error: 
10:49:41 (212412): Can't acquire lockfile (32) - waiting 35s
10:50:16 (212412): Can't acquire lockfile (32) - exiting
10:50:16 (212412): Error: 
11:04:55 (202068): Can't acquire lockfile (32) - waiting 35s
11:05:30 (202068): Can't acquire lockfile (32) - exiting
11:05:30 (202068): Error: 
11:20:47 (207228): Can't acquire lockfile (32) - waiting 35s
11:21:22 (207228): Can't acquire lockfile (32) - exiting
11:21:22 (207228): Error: 
11:35:26 (205584): Can't acquire lockfile (32) - waiting 35s
11:36:01 (205584): Can't acquire lockfile (32) - exiting
11:36:01 (205584): Error: 
11:46:32 (215816): Can't acquire lockfile (32) - waiting 35s
11:47:07 (215816): Can't acquire lockfile (32) - exiting
11:47:07 (215816): Error: 
11:57:14 (149100): Can't acquire lockfile (32) - waiting 35s
11:57:49 (149100): Can't acquire lockfile (32) - exiting
11:57:49 (149100): Error: 
12:08:32 (180924): Can't acquire lockfile (32) - waiting 35s
12:09:07 (180924): Can't acquire lockfile (32) - exiting
12:09:07 (180924): Error: 
12:19:14 (199772): Can't acquire lockfile (32) - waiting 35s
12:19:49 (199772): Can't acquire lockfile (32) - exiting
12:19:49 (199772): Error: 
12:30:32 (216776): Can't acquire lockfile (32) - waiting 35s
12:31:07 (216776): Can't acquire lockfile (32) - exiting
12:31:07 (216776): Error: 
12:41:26 (204760): Can't acquire lockfile (32) - waiting 35s
12:42:01 (204760): Can't acquire lockfile (32) - exiting
12:42:01 (204760): Error: 
12:52:36 (199388): Can't acquire lockfile (32) - waiting 35s
12:53:11 (199388): Can't acquire lockfile (32) - exiting
12:53:11 (199388): Error: 
13:03:36 (182884): Can't acquire lockfile (32) - waiting 35s
13:04:11 (182884): Can't acquire lockfile (32) - exiting
13:04:11 (182884): Error: 
13:15:04 (212336): Can't acquire lockfile (32) - waiting 35s
13:15:39 (212336): Can't acquire lockfile (32) - exiting
13:15:39 (212336): Error: 
13:25:48 (216896): Can't acquire lockfile (32) - waiting 35s
13:26:23 (216896): Can't acquire lockfile (32) - exiting
13:26:23 (216896): Error: 
13:36:28 (206476): Can't acquire lockfile (32) - waiting 35s
13:37:03 (206476): Can't acquire lockfile (32) - exiting
13:37:03 (206476): Error: 
13:54:27 (215560): Can't acquire lockfile (32) - waiting 35s
13:55:02 (215560): Can't acquire lockfile (32) - exiting
13:55:02 (215560): Error: 
14:05:14 (205952): Can't acquire lockfile (32) - waiting 35s
14:05:49 (205952): Can't acquire lockfile (32) - exiting
14:05:49 (205952): Error: 
14:15:54 (217876): Can't acquire lockfile (32) - waiting 35s
14:16:29 (217876): Can't acquire lockfile (32) - exiting
14:16:29 (217876): Error: 
14:26:33 (214672): Can't acquire lockfile (32) - waiting 35s
14:27:08 (214672): Can't acquire lockfile (32) - exiting
14:27:08 (214672): Error: 
14:37:19 (211808): Can't acquire lockfile (32) - waiting 35s
14:37:54 (211808): Can't acquire lockfile (32) - exiting
14:37:54 (211808): Error: 
14:47:58 (217808): Can't acquire lockfile (32) - waiting 35s
14:48:33 (217808): Can't acquire lockfile (32) - exiting
14:48:33 (217808): Error: 
14:58:38 (213392): Can't acquire lockfile (32) - waiting 35s
14:59:13 (213392): Can't acquire lockfile (32) - exiting
14:59:13 (213392): Error: 
15:09:24 (203492): Can't acquire lockfile (32) - waiting 35s
15:09:59 (203492): Can't acquire lockfile (32) - exiting
15:09:59 (203492): Error: 
15:20:05 (183312): Can't acquire lockfile (32) - waiting 35s
15:20:40 (183312): Can't acquire lockfile (32) - exiting
15:20:40 (183312): Error: 
15:30:42 (198432): Can't acquire lockfile (32) - waiting 35s
15:31:17 (198432): Can't acquire lockfile (32) - exiting
15:31:17 (198432): Error: 
15:41:28 (211984): Can't acquire lockfile (32) - waiting 35s
15:42:03 (211984): Can't acquire lockfile (32) - exiting
15:42:03 (211984): Error: 
15:52:56 (218396): Can't acquire lockfile (32) - waiting 35s
15:53:31 (218396): Can't acquire lockfile (32) - exiting
15:53:31 (218396): Error: 
16:03:48 (141616): Can't acquire lockfile (32) - waiting 35s
16:04:23 (141616): Can't acquire lockfile (32) - exiting
16:04:23 (141616): Error: 
16:14:58 (204888): Can't acquire lockfile (32) - waiting 35s
16:15:33 (204888): Can't acquire lockfile (32) - exiting
16:15:33 (204888): Error: 
16:29:21 (209552): Can't acquire lockfile (32) - waiting 35s
16:29:56 (209552): Can't acquire lockfile (32) - exiting
16:29:56 (209552): Error: 
16:40:03 (218544): Can't acquire lockfile (32) - waiting 35s
16:40:38 (218544): Can't acquire lockfile (32) - exiting
16:40:38 (218544): Error: 
16:51:08 (204660): Can't acquire lockfile (32) - waiting 35s
16:51:43 (204660): Can't acquire lockfile (32) - exiting
16:51:43 (204660): Error: 
17:01:52 (215572): Can't acquire lockfile (32) - waiting 35s
17:02:27 (215572): Can't acquire lockfile (32) - exiting
17:02:27 (215572): Error: 
17:12:43 (220016): Can't acquire lockfile (32) - waiting 35s
17:13:19 (220016): Can't acquire lockfile (32) - exiting
17:13:19 (220016): Error: 
17:23:26 (220324): Can't acquire lockfile (32) - waiting 35s
17:24:01 (220324): Can't acquire lockfile (32) - exiting
17:24:01 (220324): Error: 
17:34:08 (219388): Can't acquire lockfile (32) - waiting 35s
17:34:44 (219388): Can't acquire lockfile (32) - exiting
17:34:44 (219388): Error: 
17:44:55 (216244): Can't acquire lockfile (32) - waiting 35s
17:45:30 (216244): Can't acquire lockfile (32) - exiting
17:45:30 (216244): Error: 
17:56:11 (218980): Can't acquire lockfile (32) - waiting 35s
17:56:46 (218980): Can't acquire lockfile (32) - exiting
17:56:46 (218980): Error: 
18:07:21 (219628): Can't acquire lockfile (32) - waiting 35s
18:07:56 (219628): Can't acquire lockfile (32) - exiting
18:07:56 (219628): Error: 
18:18:59 (195724): Can't acquire lockfile (32) - waiting 35s
18:19:34 (195724): Can't acquire lockfile (32) - exiting
18:19:34 (195724): Error: 
18:29:57 (218972): Can't acquire lockfile (32) - waiting 35s
18:30:32 (218972): Can't acquire lockfile (32) - exiting
18:30:32 (218972): Error: 
18:40:45 (217532): Can't acquire lockfile (32) - waiting 35s
18:41:20 (217532): Can't acquire lockfile (32) - exiting
18:41:20 (217532): Error: 
18:51:31 (212752): Can't acquire lockfile (32) - waiting 35s
18:52:06 (212752): Can't acquire lockfile (32) - exiting
18:52:06 (212752): Error: 
19:02:14 (220148): Can't acquire lockfile (32) - waiting 35s
19:02:49 (220148): Can't acquire lockfile (32) - exiting
19:02:49 (220148): Error: 
19:12:56 (214476): Can't acquire lockfile (32) - waiting 35s
19:13:31 (214476): Can't acquire lockfile (32) - exiting
19:13:31 (214476): Error: 
19:23:38 (217612): Can't acquire lockfile (32) - waiting 35s
19:24:13 (217612): Can't acquire lockfile (32) - exiting
19:24:13 (217612): Error: 
19:34:32 (218492): Can't acquire lockfile (32) - waiting 35s
19:35:07 (218492): Can't acquire lockfile (32) - exiting
19:35:07 (218492): Error: 
19:45:09 (218276): Can't acquire lockfile (32) - waiting 35s
19:45:44 (218276): Can't acquire lockfile (32) - exiting
19:45:44 (218276): Error: 
19:56:37 (204412): Can't acquire lockfile (32) - waiting 35s
19:57:12 (204412): Can't acquire lockfile (32) - exiting
19:57:12 (204412): Error: 
20:07:23 (180684): Can't acquire lockfile (32) - waiting 35s
20:07:58 (180684): Can't acquire lockfile (32) - exiting
20:07:58 (180684): Error: 
20:18:01 (189292): Can't acquire lockfile (32) - waiting 35s
20:18:36 (189292): Can't acquire lockfile (32) - exiting
20:18:36 (189292): Error: 

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
21 Feb 2024 17:18:03 1307591 22405385 wah2_eas25_a0d6_198712_24_1007_012265330_0 138,539 390,889 2.8215
21 Feb 2024 07:18:15 1307591 22405385 wah2_eas25_a0d6_198712_24_1007_012265330_0 127,019 358,312 2.8209
20 Feb 2024 20:30:22 1307591 22405385 wah2_eas25_a0d6_198712_24_1007_012265330_0 115,499 324,676 2.8111
20 Feb 2024 09:14:17 1307591 22405385 wah2_eas25_a0d6_198712_24_1007_012265330_0 103,979 292,390 2.8120
19 Feb 2024 23:27:15 1307591 22405385 wah2_eas25_a0d6_198712_24_1007_012265330_0 92,459 260,580 2.8183
19 Feb 2024 07:39:15 1307591 22405385 wah2_eas25_a0d6_198712_24_1007_012265330_0 80,939 227,252 2.8077
18 Feb 2024 21:13:16 1307591 22405385 wah2_eas25_a0d6_198712_24_1007_012265330_0 69,419 193,194 2.7830
18 Feb 2024 09:03:48 1307591 22405385 wah2_eas25_a0d6_198712_24_1007_012265330_0 57,899 161,056 2.7817
17 Feb 2024 21:44:26 1307591 22405385 wah2_eas25_a0d6_198712_24_1007_012265330_0 46,379 128,519 2.7711
17 Feb 2024 12:15:03 1307591 22405385 wah2_eas25_a0d6_198712_24_1007_012265330_0 34,859 96,654 2.7727
17 Feb 2024 01:48:23 1307591 22405385 wah2_eas25_a0d6_198712_24_1007_012265330_0 23,339 65,096 2.7892
16 Feb 2024 16:12:26 1307591 22405385 wah2_eas25_a0d6_198712_24_1007_012265330_0 11,819 33,110 2.8014


©2024 climateprediction.net