Abstract: An adaptive template-matching framework integrating the Fourier-Mellin and Affine transformation is proposed for implementing area-based matching toward complicated image motion or geometry distortion.Firstly,IR(interest of region) with remarkable intensity distribution is automatically generated from reference image by dividing image into grids and within each grid,applying the Moravec operator to extract the most distinct point as the center of IR.Secondly,based on Fourier-Mellin transformation,global image motion is coarsely estimated and with estimated motion parameters,obvious geometry distortion is removed from each IR to obtain its "coarse" template as well as prediction of IR in other image is obtained.Thirdly,with IR "coarse" template and its prediction in other image,rigid affine transformation model is sought though iterative hypothesis-validation procedure and based on the model,"fine" template ensuring a locally maximum NCC computation is generated for each IR as well as its conjunctive is determined.Finally,the experimental results over different view/source of stereo image show that the proposed approach is robust to complicated image motion or geometry distortion.