climateprediction.net home page
Task 12712688

Task 12712688

Name hadcm3igeo_w374_2000_80_07192964_1
Workunit 7391245
Created 24 Mar 2011, 15:03:11 UTC
Sent 26 Mar 2011, 23:19:15 UTC
Report deadline 24 Sep 2012, 20:02:24 UTC
Received 20 May 2011, 13:45:18 UTC
Server state Over
Outcome Computation error
Client state Compute error
Exit status 22 (0x00000016) Unknown error code
Computer ID 1014331
Run time 21 days 12 hours 26 min 25 sec
CPU time 21 days 7 hours 2 min 59 sec
Validate state Invalid
Credit 11,757.31
Device peak FLOPS 2.45 GFLOPS
Application version HadCM3L Coupled Model Experiment Optimised File I/O v6.04
windows_intelx86
Stderr 
<core_client_version>6.6.38</core_client_version>
<![CDATA[
<message>
The device does not recognize the command. (0x16) - exit code 22 (0x16)
</message>
<stderr_txt>
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
CPDN Monitor - Quit request from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/jobs/yafbg.PRESM_O
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/basin.index
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=4816, selfPID=4816, iMonCtr=1
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error in converting file dataout/w374fo.pjk7c10 to netcdf format.
Error in converting file dataout/w374fo.pik7c10 to netcdf format.
Error in converting file dataout/w374fo.pfk7c10 to netcdf format.
Error in converting file dataout/w374fa.phk7c10 to netcdf format.
Error in converting file dataout/w374fa.pgk7c10 to netcdf format.
Error in converting file dataout/w374fa.pek7c10 to netcdf format.
Error in converting file dataout/w374fa.pdk7c10 to netcdf format.
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
CPDN NetCDF Err #2 - No such file or directory
CPDN NetCDF Err #2 - No such file or directory
CPDN NetCDF Err #2 - No such file or directory
CPDN NetCDF Err #2 - No such file or directory
MainError:	03:16:34 PM	No files match the supplied pattern.
MainError:	03:16:34 PM	No files match the supplied pattern.
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5972, selfPID=5972, iMonCtr=1
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error in converting file dataout/w374fo.pjk8c10 to netcdf format.
Error in converting file dataout/w374fo.pik8c10 to netcdf format.
Error in converting file dataout/w374fo.pfk8c10 to netcdf format.
Error in converting file dataout/w374fa.phk8c10 to netcdf format.
Error in converting file dataout/w374fa.pgk8c10 to netcdf format.
Error in converting file dataout/w374fa.pek8c10 to netcdf format.
Error in converting file dataout/w374fa.pdk8c10 to netcdf format.
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
CPDN Monitor - Quit request from BOINC...
CPDN NetCDF Err #2 - No such file or directory
CPDN NetCDF Err #2 - No such file or directory
CPDN NetCDF Err #2 - No such file or directory
CPDN NetCDF Err #2 - No such file or directory
MainError:	12:31:07 AM	No files match the supplied pattern.
MainError:	12:31:07 AM	No files match the supplied pattern.
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
CPDN Monitor - Quit request from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: boinc_ufs_cpdnout1.zip
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
No Process Handle
CPDN process is not running, exiting, bRetVal = 1, checkPID=5712, selfPID=5712, iMonCtr=1
BUFFIN: C I/O Error feof - Unit 63 - Return code = 16
BUFFIN: C I/O Error feof - Unit 64 - Return code = 16
BUFFIN: C I/O Error feof - Unit 65 - Return code = 16
BUFFIN: C I/O Error feof - Unit 66 - Return code = 16
BUFFIN: C I/O Error feof - Unit 67 - Return code = 16
BUFFIN: C I/O Error feof - Unit 68 - Return code = 16
BUFFIN: C I/O Error feof - Unit 69 - Return code = 16
Error in converting file dataout/w374fo.pjl2c10 to netcdf format.
Error in converting file dataout/w374fo.pil2c10 to netcdf format.
Error in converting file dataout/w374fo.pfl2c10 to netcdf format.
Error in converting file dataout/w374fa.phl2c10 to netcdf format.
Error in converting file dataout/w374fa.pgl2c10 to netcdf format.
Error in converting file dataout/w374fa.pel2c10 to netcdf format.
Error in converting file dataout/w374fa.pdl2c10 to netcdf format.
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: boinc_ufs_cpdnout1.zip
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...

CreateFile error 32 when trying set file time
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/jobs/yafbg.PRESM_A
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/jobs/yafbg.PRESM_O
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/jobs/yafbg.stashc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/basin.index
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01001218
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01002207
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003236
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003237
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003254
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003255
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003274
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003275
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003276
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003277
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003278
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003279
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003280
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003281
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01003286
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01005207
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01005208
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01005222
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01005223
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/stasets/X01010206
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/STASHmaster/STASHmaster_A
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/STASHmaster/STASHmaster_O
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/STASHmaster/STASHmaster_S
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/ctldata/STASHmaster/STASHmaster_W
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/ancil/qrclim.hadisst.sss_l94_ni
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/lats
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_arctic_0.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_arctic_300.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_arctic_3000.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_arctic_700.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_global_0.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_global_300.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_global_3000.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_global_700.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_n_atl_0.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_n_atl_300.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_n_atl_3000.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_n_atl_700.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_n_ind_0.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_n_ind_300.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_n_ind_3000.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_n_ind_700.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_n_pac_0.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_n_pac_300.nc
error:  cannot delete old hadcm3igeo_w374_2000_80_07192964/datain/masks/cpdn_omsk_n_pac_3000.nc
CPDN NetCDF Err #2 - No such file or directory
CPDN NetCDF Err #2 - No such file or directory
CPDN NetCDF Err #2 - No such file or directory
CPDN NetCDF Err #2 - No such file or directory
MainError:	05:42:53 PM	No files match the supplied pattern.
MainError:	05:42:53 PM	No files match the supplied pattern.
CPDN process is not running, exiting, bRetVal = 1, checkPID=0, selfPID=1352, iMonCtr=1
Model crash detected, will try to restart...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: boinc_ufs_cpdnout1.zip
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
CPDN Monitor - Quit request from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: boinc_ufs_cpdnout1.zip
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
CPDN Monitor - Quit request from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: boinc_ufs_cpdnout1.zip
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
Suspended CPDN Monitor - Quit request from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: boinc_ufs_cpdnout1.zip
scan: boinc_ufs_cpdnout2.zip
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
CPDN Monitor - Quit request from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: boinc_ufs_cpdnout1.zip
scan: boinc_ufs_cpdnout2.zip
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
Suspended CPDN Monitor - Quit request from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: boinc_ufs_cpdnout1.zip
scan: boinc_ufs_cpdnout2.zip
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
CPDN Monitor - Quit request from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: boinc_ufs_cpdnout1.zip
scan: boinc_ufs_cpdnout2.zip
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
CPDN Monitor - Quit request from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: boinc_ufs_cpdnout1.zip
scan: boinc_ufs_cpdnout2.zip
scan: boinc_ufs_cpdnout3.zip
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz
No heartbeat from core client for 30 sec - exiting
CPDN Monitor - No 'heartbeat' from BOINC...
scan: 0s1c_25990205_atmos.day.gz
scan: 0s1c_25990205_ocean.day.gz
scan: 1045_flux_corr.anc.gz
scan: boinc_lockfile
scan: boinc_ufs_cpdnout1.zip
scan: boinc_ufs_cpdnout2.zip
scan: boinc_ufs_cpdnout3.zip
scan: cpdnout1.zip
scan: cpdnout2.zip
scan: cpdnout3.zip
scan: cpdnout4.zip
scan: cpdnout5.zip
scan: cpdnout6.zip
scan: cpdnout7.zip
scan: cpdnout8.zip
scan: DMSNH3SO2A1B_19182082N.gz
scan: DMSNH3SO2A1B_19182082N.mod.gz
scan: fobthdck_0208_nickfluxcorr.anc.gz
scan: ghg_a1b.gz
scan: graphics_app
scan: hadcm3igeo_w374_2000_80_07192964.zip
scan: hadcm3trans_6.04_windows_intelx86.exe
scan: hadcm3trans_data_6.04_windows_intelx86.zip
scan: hadcm3trans_se_6.04_windows_intelx86.zip
scan: hadcm3trans_um_6.04_windows_intelx86.zip
scan: init_data.xml
scan: NAT_VOLC.gz
scan: ozone_hadcm3_1919_2082.gz
scan: ozone_hadcm3_1919_2082.mod.gz
scan: solar_v01.gz
scan: spec3a_lw_3_asol2c_hadcm3.gz
scan: spec3a_sw_3_asol2b_hadcm3.gz
scan: stderr.txt
scan: SULPC_OXIDANTS_19_A2_1990.gz
scan: SULPC_OXIDANTS_19_A2_1990.mod.gz
scan: volc_geo2_3.gz

Model crashed: 

Model crashed: 

Model crashed: 

Model crashed: 

Model crashed: 

Model crashed: 
Sorry, too many model crashes! :-(
called boinc_finish

</stderr_txt>
]]>
Latest Trickles Received
Time Sent (UTC) Host ID Result ID Result Name Timestep CPU Time (sec) Average (sec/TS)
20 May 2011 05:12:29 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 933,120 1,815,106 1.9452
19 May 2011 11:56:19 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 907,200 1,766,317 1.9470
18 May 2011 18:50:23 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 881,280 1,717,067 1.9484
18 May 2011 01:43:47 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 855,360 1,667,932 1.9500
17 May 2011 08:44:36 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 829,440 1,618,897 1.9518
16 May 2011 15:36:46 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 803,520 1,569,793 1.9536
06 May 2011 05:46:44 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 777,600 1,520,158 1.9549
05 May 2011 11:46:50 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 751,680 1,470,136 1.9558
04 May 2011 18:58:26 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 725,760 1,420,590 1.9574
04 May 2011 01:18:02 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 699,840 1,371,824 1.9602
29 Apr 2011 15:58:14 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 673,920 1,323,178 1.9634
28 Apr 2011 23:00:51 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 648,000 1,274,589 1.9670
28 Apr 2011 06:07:40 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 622,080 1,225,906 1.9707
23 Apr 2011 06:06:11 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 596,160 1,177,058 1.9744
22 Apr 2011 13:03:16 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 570,240 1,128,217 1.9785
21 Apr 2011 19:36:47 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 544,320 1,079,421 1.9831
21 Apr 2011 03:43:55 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 518,400 1,030,720 1.9883
20 Apr 2011 15:50:00 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 492,480 981,384 1.9927
20 Apr 2011 15:49:59 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 466,560 931,670 1.9969
20 Apr 2011 15:49:59 1014331 12712688 hadcm3igeo_w374_2000_80_07192964_1 440,640 881,651 2.0008


©2024 climateprediction.net