Abstract: The imaging mechanism,acquired angle and resolution between imagery acquired by diverse remote sensing sensors are different,which throws a big difficulty in the registration between them.The SIFT algorithm has had a successful application in aerial and video images presently;however,when applying it in registration between imagery acquired by different sensors or with big differences in resolution and angle,few matching couples are obtained.Aiming to this problem,a new algorithm named SIFT based on visual matching window is proposed.By constructing the visual matching window,the scale similarity and matching probability between SIFT features are increased,and then combined with least-square equation and bilinear interpolation method,the automatic registration is achieved.SPOT-5(P) and TM images,which have big differences in acquired angle and resolution,were tested,and the results show that the precision is lower than 1 pixel.