Abstract: According to high-resolution remote sensing image and digital surface model(DSM) the three-dimensional building models can be automated established.The key of procedure is to obtain the building points from the DSM.Combining high resolution remote sensing image,the small region elimination method and Median-SUSAN filter is discussed for extracting the building points in this paper.The experiment indicats that this method is effectived for obtaining the major part of building points from DSM.It is benefit for the building's precise three-dimensional reconstruction.