Task 12019137

Name	hadcm3igeo_w153_2000_80_06761578_4
Workunit	6964894
Created	12 Nov 2010, 15:32:43 UTC
Sent	13 Nov 2010, 6:25:48 UTC
Report deadline	14 May 2012, 3:08:57 UTC
Received	4 Jan 2011, 7:59:57 UTC
Server state	Over
Outcome	Computation error
Client state	Compute error
Exit status	22 (0x00000016) Unknown error code
Computer ID	1024632
Run time	37 days 14 hours 12 min 19 sec
CPU time	37 days 0 hours 15 min 4 sec
Validate state	Invalid
Credit	16,329.60
Device peak FLOPS	2.24 GFLOPS
Application version	HadCM3L Coupled Model Experiment Optimised File I/O v6.04 windows_intelx86
Stderr	<core_client_version>6.10.58</core_client_version> <![CDATA[ <message> The device does not recognize the command. (0x16) - exit code 22 (0x16) </message> <stderr_txt> scan: 09ue_07_2000_atmos.gz scan: 09ue_07_2000_ocean.gz scan: 1085_flux_corr.anc.gz scan: boinc_lockfile scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w153_2000_80_06761578.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: hdmjhdck_0208_nickfluxcorr.anc.gz scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_1.gz error: cannot delete old hadcm3igeo_w153_2000_80_06761578/jobs/yafbg.PRESM_O error: cannot delete old hadcm3igeo_w153_2000_80_06761578/datain/ancil/basin.index error: cannot delete old hadcm3igeo_w153_2000_80_06761578/jobs/yafbg.namelists CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error in converting file dataout/w153fo.pjk2c10 to netcdf format. Error in converting file dataout/w153fo.pik2c10 to netcdf format. Error in converting file dataout/w153fo.pfk2c10 to netcdf format. Error in converting file dataout/w153fa.phk2c10 to netcdf format. Error in converting file dataout/w153fa.pgk2c10 to netcdf format. Error in converting file dataout/w153fa.pek2c10 to netcdf format. Error in converting file dataout/w153fa.pdk2c10 to netcdf format. scan: 09ue_07_2000_atmos.gz scan: 09ue_07_2000_ocean.gz scan: 1085_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_task_state.xml scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w153_2000_80_06761578.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: hdmjhdck_0208_nickfluxcorr.anc.gz scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_1.gz CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... CPDN Monitor - Quit request from BOINC... scan: 09ue_07_2000_atmos.gz scan: 09ue_07_2000_ocean.gz scan: 1085_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_task_state.xml scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w153_2000_80_06761578.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: hdmjhdck_0208_nickfluxcorr.anc.gz scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_1.gz CPDN Monitor - Quit request from BOINC... scan: 09ue_07_2000_atmos.gz scan: 09ue_07_2000_ocean.gz scan: 1085_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_task_state.xml scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w153_2000_80_06761578.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: hdmjhdck_0208_nickfluxcorr.anc.gz scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_1.gz CPDN Monitor - Quit request from BOINC... scan: 09ue_07_2000_atmos.gz scan: 09ue_07_2000_ocean.gz scan: 1085_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_task_state.xml scan: boinc_ufs_cpdnout1.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w153_2000_80_06761578.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: hdmjhdck_0208_nickfluxcorr.anc.gz scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_1.gz CPDN Monitor - Quit request from BOINC... scan: 09ue_07_2000_atmos.gz scan: 09ue_07_2000_ocean.gz scan: 1085_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_task_state.xml scan: boinc_ufs_cpdnout1.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w153_2000_80_06761578.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: hdmjhdck_0208_nickfluxcorr.anc.gz scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_1.gz CPDN Monitor - Quit request from BOINC... scan: 09ue_07_2000_atmos.gz scan: 09ue_07_2000_ocean.gz scan: 1085_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_task_state.xml scan: boinc_ufs_cpdnout1.zip scan: boinc_ufs_cpdnout2.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w153_2000_80_06761578.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: hdmjhdck_0208_nickfluxcorr.anc.gz scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_1.gz CPDN Monitor - Quit request from BOINC... scan: 09ue_07_2000_atmos.gz scan: 09ue_07_2000_ocean.gz scan: 1085_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_task_state.xml scan: boinc_ufs_cpdnout1.zip scan: boinc_ufs_cpdnout2.zip scan: boinc_ufs_cpdnout3.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w153_2000_80_06761578.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: hdmjhdck_0208_nickfluxcorr.anc.gz scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_1.gz error: cannot delete old hadcm3igeo_w153_2000_80_06761578/jobs/yafbg.PRESM_O error: cannot delete old hadcm3igeo_w153_2000_80_06761578/datain/ancil/basin.index error: cannot delete old hadcm3igeo_w153_2000_80_06761578/jobs/yafbg.namelists CPDN process is not running, exiting, bRetVal = 0, checkPID=0, selfPID=0, iMonCtr=0 BUFFIN: C I/O Error feof - Unit 63 - Return code = 16 BUFFIN: C I/O Error feof - Unit 64 - Return code = 16 BUFFIN: C I/O Error feof - Unit 65 - Return code = 16 BUFFIN: C I/O Error feof - Unit 66 - Return code = 16 BUFFIN: C I/O Error feof - Unit 67 - Return code = 16 BUFFIN: C I/O Error feof - Unit 68 - Return code = 16 BUFFIN: C I/O Error feof - Unit 69 - Return code = 16 Error in converting file dataout/w153fo.pjn9c10 to netcdf format. Error in converting file dataout/w153fo.pin9c10 to netcdf format. Error in converting file dataout/w153fo.pfn9c10 to netcdf format. Error in converting file dataout/w153fa.phn9c10 to netcdf format. Error in converting file dataout/w153fa.pgn9c10 to netcdf format. Error in converting file dataout/w153fa.pen9c10 to netcdf format. Error in converting file dataout/w153fa.pdn9c10 to netcdf format. scan: 09ue_07_2000_atmos.gz scan: 09ue_07_2000_ocean.gz scan: 1085_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_task_state.xml scan: boinc_ufs_cpdnout1.zip scan: boinc_ufs_cpdnout2.zip scan: boinc_ufs_cpdnout3.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w153_2000_80_06761578.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: hdmjhdck_0208_nickfluxcorr.anc.gz scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_1.gz CPDN Monitor - Quit request from BOINC... scan: 09ue_07_2000_atmos.gz scan: 09ue_07_2000_ocean.gz scan: 1085_flux_corr.anc.gz scan: boinc_lockfile scan: boinc_task_state.xml scan: boinc_ufs_cpdnout1.zip scan: boinc_ufs_cpdnout2.zip scan: boinc_ufs_cpdnout3.zip scan: boinc_ufs_cpdnout4.zip scan: cpdnout1.zip scan: cpdnout2.zip scan: cpdnout3.zip scan: cpdnout4.zip scan: cpdnout5.zip scan: cpdnout6.zip scan: cpdnout7.zip scan: cpdnout8.zip scan: DMSNH3SO2A1B_19182082N.gz scan: DMSNH3SO2A1B_19182082N.mod.gz scan: ghg_a1b.gz scan: graphics_app scan: hadcm3igeo_w153_2000_80_06761578.zip scan: hadcm3trans_6.04_windows_intelx86.exe scan: hadcm3trans_data_6.04_windows_intelx86.zip scan: hadcm3trans_se_6.04_windows_intelx86.zip scan: hadcm3trans_um_6.04_windows_intelx86.zip scan: hdmjhdck_0208_nickfluxcorr.anc.gz scan: init_data.xml scan: NAT_VOLC.gz scan: ozone_hadcm3_1919_2082.gz scan: ozone_hadcm3_1919_2082.mod.gz scan: solar_v01.gz scan: spec3a_lw_3_asol2c_hadcm3.gz scan: spec3a_sw_3_asol2b_hadcm3.gz scan: stderr.txt scan: SULPC_OXIDANTS_19_A2_1990.gz scan: SULPC_OXIDANTS_19_A2_1990.mod.gz scan: volc_geo2_1.gz Model crashed: Model crashed: Model crashed: Model crashed: Model crashed: Model crashed: Sorry, too many model crashes! :-( called boinc_finish </stderr_txt> ]]>

Latest Trickles Received
Time Sent (UTC)	Host ID	Result ID	Result Name	Timestep	CPU Time (sec)	Average (sec/TS)
04 Jan 2011 08:03:00	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	1,296,000	3,137,335	2.4208
04 Jan 2011 08:03:00	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	1,270,080	3,075,698	2.4217
04 Jan 2011 08:03:00	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	1,244,160	3,014,944	2.4233
27 Dec 2010 18:01:19	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	1,218,240	2,954,207	2.4250
26 Dec 2010 22:47:20	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	1,192,320	2,893,441	2.4267
26 Dec 2010 11:35:39	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	1,166,400	2,832,733	2.4286
25 Dec 2010 11:01:27	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	1,140,480	2,771,970	2.4305
24 Dec 2010 14:13:38	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	1,114,560	2,711,233	2.4326
23 Dec 2010 19:12:05	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	1,088,640	2,649,959	2.4342
23 Dec 2010 00:10:24	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	1,062,720	2,588,505	2.4357
22 Dec 2010 11:36:15	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	1,036,800	2,527,181	2.4375
21 Dec 2010 11:48:20	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	1,010,880	2,465,500	2.4390
20 Dec 2010 14:32:12	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	984,960	2,403,655	2.4404
19 Dec 2010 19:19:14	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	959,040	2,341,520	2.4415
18 Dec 2010 23:56:53	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	933,120	2,279,484	2.4429
18 Dec 2010 13:33:27	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	907,200	2,217,369	2.4442
17 Dec 2010 10:35:43	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	881,280	2,155,227	2.4456
16 Dec 2010 13:57:53	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	855,360	2,093,604	2.4476
15 Dec 2010 20:13:08	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	829,440	2,031,703	2.4495
14 Dec 2010 22:22:07	1024632	12019137	hadcm3igeo_w153_2000_80_06761578_4	803,520	1,969,747	2.4514