Task 22473663

Name	wah2_eas25_n2xm_201812_24_1022_012315977_0
Workunit	12315977
Created	24 Jul 2024, 13:55:26 UTC
Sent	1 Aug 2024, 0:12:14 UTC
Report deadline	9 Nov 2024, 0:12:14 UTC
Received	5 Aug 2024, 7:36:14 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	0 (0x00000000)
Computer ID	1538744
Run time	2 hours 40 min 20 sec
CPU time	1 hours 29 min 28 sec
Validate state	Invalid
Credit	0.00
Device peak FLOPS	6.65 GFLOPS
Application version	Weather At Home 2 (wah2) (region independent) v8.32 windows_intelx86
Peak working set size	344.62 MB
Peak swap size	306.63 MB
Peak disk usage	0.02 MB
Stderr	<core_client_version>8.0.2</core_client_version> <![CDATA[ <stderr_txt> Suspended CPDN Monitor - Suspend request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists modelGetExecutables: unzipping control files : strInput & strTmp wah2_eas25_n2xm_201812_24_1022_012315977.zip wah2_eas25_n2xm_201812_24_1022_012315977/jobs gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 10:18:01 (8432): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=39608, GCM_PID=8432, RCM_PID=41336 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 20:16:27 (12600): start_timer_thread(): CreateThread() failed, errno 0 regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=25364, GCM_PID=12600, RCM_PID=3132 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 21:13:12 (2312): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xadae.pipe_dummy regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=23196, GCM_PID=2312, RCM_PID=17396 Suspended CPDN Monitor - Suspend request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 21:19:57 (9904): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xadae.pipe_dummy regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=26924, GCM_PID=9904, RCM_PID=14040 Suspended CPDN Monitor - Suspend request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 21:26:15 (23556): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xadae.pipe_dummy regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=20656, GCM_PID=23556, RCM_PID=17052 Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 23556, selfPID = 20656, iMonCtr = 1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... monitor:finished called ... tidying up. monitor:finished: Uploading out files... modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 21:31:00 (12296): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xadae.pipe_dummy regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=24708, GCM_PID=12296, RCM_PID=24532 modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 05:24:09 (17372): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xadae.pipe_dummy regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=24644, GCM_PID=17372, RCM_PID=20004 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 15:46:57 (25768): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xadae.pipe_dummy regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=12060, GCM_PID=25768, RCM_PID=21224 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 16:26:29 (8052): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xadae.pipe_dummy regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=25624, GCM_PID=8052, RCM_PID=9136 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 20:07:51 (23124): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xadae.pipe_dummy regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=22196, GCM_PID=23124, RCM_PID=7128 modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 20:44:31 (10164): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xadae.pipe_dummy regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=25736, GCM_PID=10164, RCM_PID=18960 Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 10164, selfPID = 25736, iMonCtr = 1 Model crash detected, will try to restart... CPDN Monitor - Quit request from BOINC... Detaching shared memory... Done. modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 20:57:00 (24084): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xadae.pipe_dummy regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=4688, GCM_PID=24084, RCM_PID=25904 Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 24084, selfPID = 4688, iMonCtr = 1 Model crash detected, will try to restart... modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists modelGetExecutables: check control files, strTemp0 & 1 : G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xadae.namelists G:\BOINC\data/projects/climateprediction.net/wah2_eas25_n2xm_201812_24_1022_012315977/jobs/xacxf.namelists gstrDump[0] = generic_phase1_spinup_eas25_global_aabaka_f gstrDump[1] = generic_phase1_spinup_eas25_regional_aabaka_f global model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2am3m2_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 generic_phase1_spinup_eas25_global_aabaka_f ic19610206_14_N96 NATclim_ancil_168months_CMIP6-9MME_SST_2009-01-01_2022-12-30_v2404b NATclim_ancil_168months_CMIP6-9MME_SIC_2009-01-01_2022-12-30_v2404b so2dms_prei_N96_1855_0000P oxi.addfa ozone_preind_N96_1879_0000Pv5 21:06:38 (11668): start_timer_thread(): CreateThread() failed, errno 0 Model crashed: READHIST: End of file in READ from history file for namelist NLIHISTO tmp/xadae.pipe_dummy regional model: command string: "G:\BOINC\data/projects/climateprediction.net/wah2rm3m2t_um_8.32_windows_intelx86.exe" wah2_eas25_n2xm_201812_24_1022_012315977 cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. cpdn_check_running: got RM PID of zero; ignoring this call and waiting for PID via shMem. executeModelProcess: MonID=22460, GCM_PID=11668, RCM_PID=21136 Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Suspended CPDN Monitor - Suspend request from BOINC... Controller:: CPDN process is not running, exiting, bRetVal = T, checkPID = 11668, selfPID = 22460, iMonCtr = 1 Model crash detected, will try to restart... Leaving CPDN_Main::Monitor... monitor:finished called ... tidying up. monitor:finished: Uploading out files... Queuing intermediate upload for CPDN/BOINC: cpdnout_out.zip Detaching shared memory... Done. monitor:finished: Closed output file : stdout_<>.txt modelResultFiles : Removing : wah2_eas25_n2xm_201812_24_1022_012315977 in G:\BOINC\data/projects/climateprediction.net monitor:finished: handing over to boinc_finish(RetVal=0) 00:33:25 (22460): called boinc_finish(0) </stderr_txt> <message> upload failure: <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_1.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_2.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_3.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_4.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_5.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_6.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_7.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_8.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_9.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_10.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_11.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_12.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_13.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_14.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_15.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_16.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_17.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_18.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_19.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_20.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_21.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_22.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_23.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_24.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> <file_xfer_error> <file_name>wah2_eas25_n2xm_201812_24_1022_012315977_0_r1336986603_restart.zip</file_name> <error_code>-240 (stat() failed)</error_code> </file_xfer_error> </message> ]]>