LI Deren, XIAO Xiongwu, GUO Bingxuan, JIANG Wanshou, SHI Yueru. Oblique Image Based Automatic Aerotriangulation and Its Application in 3D City Model Reconstruction[J]. Geomatics and Information Science of Wuhan University, 2016, 41(6): 711-721. DOI: 10.13203/j.whugis20160099
Citation: LI Deren, XIAO Xiongwu, GUO Bingxuan, JIANG Wanshou, SHI Yueru. Oblique Image Based Automatic Aerotriangulation and Its Application in 3D City Model Reconstruction[J]. Geomatics and Information Science of Wuhan University, 2016, 41(6): 711-721. DOI: 10.13203/j.whugis20160099

Oblique Image Based Automatic Aerotriangulation and Its Application in 3D City Model Reconstruction

Funds: 

The National 973 Program of China Nos. 2012CB719905, 2012CB721317

the National Natural Science Foundation of China No. 41127901

the Open Research Funds of State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing No. 13 (Key Project)

the Scientific Research Programs in Public Interest of Surveying, Mapping and Geographic Information No. 201412015

More Information
  • Author Bio:

    LI Deren, PhD,professor, academician of Chinese Academy of Sciences, academician of Chinese Academy of Engineering, academician of Euro-Asia International Academy of Sciences, concentrates on the research, education and industrial application of RS, GNSS and GIS related spatial information science and technology. E-mail: drli@whu.edu.cn

  • Corresponding author:

    XIAO Xiongwu, PhD candidate. E-mail: xwxiao@whu.edu.cn

  • Received Date: March 13, 2016
  • Published Date: June 04, 2016
  • In this paper, we proposed an automatic aerotriangulation method based on SWDC-5 oblique images. First of all, we designed an improved viewpoint-invariant matching method for oblique images based on the perspective transformation. Secondly, in order to reduce the amount of unknown adjustment parameters (overmuch unknown adjustment parameter may weaken the instability of adjustment solution), we offered a new bundle adjustment model for oblique images which took the relative attitude parameters of cameras into account, and also gave the application scope of the model. Experiments conducted on the typical SWDC-5 oblique images demonstrated that when the relative attitude of cameras (on same camera station) are stable and their cameras exposure are limited within a short time delay, the aero-triangulation accuracy of our method is high, the unit weight error is 0.46 pixels and the average residual of image points is 0.27 pixels. Thirdly, we applied the results of aero-triangulation to PMVS (patch-based multi-view stereo matching) algorithm to gain the dense point-cloud of the experimental city, used screened Poisson reconstruction algorithm to get its 3D mesh, and reconstruct its 3D surface with 3D texture algorithm. Experiments showed that the accuracy of the aero triangulation met the requirements of applications, and the obtained 3D city model had a natural, real texture, all this proved that the idea of automatic reconstruction of 3D city model is feasible and made a good reference for the large-scale 3D city model reconstruction.
  • [1]
    Zebedin L, Klaus A, Geymayer B G, et al. Towards 3D Map Generation from Digital Aerial Images[J]. Journal of Photogrammetry and Remote Sensing, 2006, 60(6):413-427
    [2]
    Nguyen H M, Wunsche B, Delmas P, et al. High-Definition Texture Reconstruction for 3D Image-based Modeling[C]. The 21st International Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, Plzen, 2013
    [3]
    Fritsch D, Rothermel M. Oblique Image Data Processing:Potential, Experience, Recommendations[EB/OL]. http://www.ifp.uni-stuttgart.de/publications/phowo13/090Fritsch.pdf, 2015
    [4]
    肖雄武,郭丙轩,李德仁,等. 一种具有仿射不变性的倾斜影像快速匹配方法[J].测绘学报,2015,44(4):414-421

    Xiao Xiongwu, Guo Bingxuan, Li Deren, et al. A Quick and Affine Invariance Matching Method for Oblique Images[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(4):414-421
    [5]
    Hu H, Zhu Q, Du Z, et al. Reliable Spatial Relationship Constrained Feature Point Matching of Oblique Aerial Images[J]. Photogrammetric Engineering & Remote Sensing, 2015, 81(1):49-58
    [6]
    Richard H, Andrew Z. Multiple View Geometry in Computer Vision[M]. 2nd ed. United Kingdom:Cambridge University Press, 2003:116-127, 153-158, 239-261, 325-343
    [7]
    肖雄武,李德仁,郭丙轩,等.一种具有视点不变性的倾斜影像快速匹配方法[J/OL].武汉大学学报·信息科学版,2015,DOI:10.13203/j.whugis20140405

    Xiao Xiongwu, Li Deren, Guo Bingxuan, et al. A Robust and Rapid Viewpoint-Invariant Matching Method for Oblique Images[J/OL]. Geomatics and Information Science of Wuhan University, 2015, DOI:10.13203/j.whugis20140405
    [8]
    张剑清,潘励,王树根.摄影测量学[M].2版.武汉:武汉大学出版社,2009:54-64,87-116,173-178

    Zhang Jianqing, Pan Li, Wang Shugen. Photogrammetry[M]. 2nd ed. Wuhan:Wuhan University Press, 2009:54-64, 87-116, 173-178
    [9]
    李德仁,袁修孝.误差处理与可靠性理论[M].2版.武汉:武汉大学出版社,2012:44-62

    Li Deren, Yuan Xiuxiao. Error Processing and Reliability Theory[M]. 2nd ed. Wuhan:Wuhan University Press, 2012:44-62
    [10]
    Hirschmuller H. Stereo Processing by Semi-global Matching and Mutual Information[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2008, 30(2):328-341
    [11]
    Rothermel M, Wenzel K, Fritsch D, et al. SURE:Photogrammetric Surface Reconstruction from Imagery[OL]. The LC3D Workshop, http://www.ifp.uni-stuttgart.de/publications/2012/Rothermel_etal_lc3d.pdf, 2012
    [12]
    Furukawa Y, Ponce J. Accurate, Dense, and Robust Multiview Stereopsis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(8):1362-1376
    [13]
    Labatut P, Pons J P, Keriven R. Efficient Multi-view Reconstruction of Large-Scale Scenes Using Interest Points, Delaunay Triangulation and Graph Cuts[C]. IEEE International Conference on Computer Vision, Rio de Janeiro, 2007
    [14]
    Labatut P, Pons J P, Keriven R. Robust and Efficient Surface Reconstruction from Range Data[J]. Computer Graphics Forum, 2009, 28(8):2275-2290
    [15]
    Kazhdan M, Bolitho M, Hoppe H. Poisson Surface Reconstruction[C]. The 4th Eurographics Symposium on Geometry Processing, Switzerland, 2006
    [16]
    Kazhdan M, Hoppe H. Screened Poisson Surface Reconstruction[J]. ACM Transactions on Graphics, 2013, 32(3):1-13
    [17]
    Bornik A, Karner K, Bauer J, et al. High Quality Texture Reconstruction from Multiple Views[J]. The Journal of Visualization and Computer Animation, 2001, 12(5):263-276
    [18]
    张春森,张卫龙,郭丙轩,等.倾斜影像的三维纹理快速重建[J].测绘学报,2015,44(7):782-790

    Zhang Chunsen, Zhang Weilong, Guo Bingxuan, et al. Rapidly 3D Texture Reconstruction Based on Oblique Photography[J]. Acta Geodaetica et Cartographica Sinica, 2015, 44(7):782-790
    [19]
    David G L. Distinctive Image Features from Scale-Invariant Keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110
    [20]
    肖雄武.基于特征不变的倾斜影像匹配算法研究与应用[D].西安:西安科技大学,2014

    Xiao Xiongwu. The Research and Application of Oblique Images Matching Methods Based on Invariant Features[D]. Xi'an:Xi'an University of Science and Technology, 2014
    [21]
    时月茹.SWDC-5倾斜影像光束法平差研究与实现[D].武汉:武汉大学,2014

    Shi Yueru. Research and Achievement of SWDC-5 Oblique Image Bundle Adjustment[D]. Wuhan:Wuhan University, 2014
    [22]
    Fraser C S. Digital Camera Self-Calibration[J]. Journal of Photogrammetry and Remote Sensing, 1997, 52:149-159
    [23]
    Harris C, Stephens M. A Combined Corner and Edge Detector[C]. The 4th Alvey Vision Conference, Manchester, 1988
    [24]
    肖雄武,郭丙轩,潘飞,等.利用泰勒展开的点特征子像素定位方法[J].武汉大学学报·信息科学版, 2014,39(10):1231-1235

    Xiao Xiongwu, Guo Bingxuan, Pan Fei, et al. Sub-pixel Location of Feature Point Based on Taylor Expansion and Its Application[J]. Geomatics and Information Science of Wuhan University, 2014, 39(10):1231-1235
    [25]
    Zhang Z. Flexible Camera Calibration by Viewing a Plane from Unknown Orientations[C]. IEEE International Conference on Computer Vision, Kerkyra, 1999
    [26]
    Klippenstein J, Zhang H. Quantitative Evaluation of Feature Extractors for Visual SLAM[C]. The 4th Canadian Conference on Computer and Robot Vision, IEEE Computer Society, Ontario, 2007
    [27]
    Xiao X, Guo B, Li D, et al. Multi-View Stereo Matching Based on Self-Adaptive Patch and Image Grouping for Multiple Unmanned Aerial Vehicle Imagery[J]. Remote Sensing, 2016, 8(2):89
    [28]
    Lorensen W E, Cline H E. Marching Cubes:A High Resolution 3D Surface Construction Algorithm[J]. Computers and Graphics, 1987, 21(4):163-169
    [29]
    李德仁,刘立坤,邵振峰.集成倾斜航空摄影测量和地面移动测量技术的城市环境监测[J].武汉大学学报·信息科学版,2015,40(4):427-435

    Li Deren, Liu Likun, Shao Zhenfeng. An Integration of Aerial Oblique Photogrammetry and Mobile Mapping System for Urban Geographical Conditions Monitoring[J]. Geomatics and Information Science of Wuhan University, 2015, 40(4):427-435
    [30]
    龚健雅,崔婷婷,单杰,等.利用车载移动测量数据的建筑物立面建模方法[J]. 武汉大学学报·信息科学版,2015,40(9):1137-1143

    Gong Jianya, Cui Tingting, Shan Jie, et al. A Survey on Facade Modeling Using LiDAR Point Clouds and Image Sequences Collected by Mobile Mapping Systems[J]. Geomatics and Information Science of Wuhan University, 2015, 40(9):1137-1143
  • Related Articles

    [1]LIU Tingting, YANG Zijian, WANG Zemin, GAO Kefu. Evaluation of Arctic Sea Ice Concentration Estimated by Fengyun-3D Microwave Radiation Imager[J]. Geomatics and Information Science of Wuhan University, 2021, 46(12): 1843-1851. DOI: 10.13203/j.whugis20210449
    [2]WANG Weiqi, YOU Xiong, YANG Jian, LI Qin. ElasticFusion for Indoor 3D Reconstruction with an Improved Matching Points Selection Strategy[J]. Geomatics and Information Science of Wuhan University, 2020, 45(9): 1469-1477. DOI: 10.13203/j.whugis20180278
    [3]Zheng Shunyi, Wang Xiaonan, Ma Dian. A Convenient 3D Reconstruction Method of Small Objects[J]. Geomatics and Information Science of Wuhan University, 2015, 40(2): 147-152+158.
    [4]WANG Wei, ZHAN Weiwei, WANG Chao, LI Yan. A Template Based Dynamic Modeling Method of 3D Road[J]. Geomatics and Information Science of Wuhan University, 2013, 38(9): 1092-1096.
    [5]YING Shen, MAO Zhengyuan, LI Lin, XU Guang. Point Cloud Segmentation of 3D Rabbit Base 3D Voronoi[J]. Geomatics and Information Science of Wuhan University, 2013, 38(3): 358-361.
    [6]GUO Fenglin, HU Peng, BAI Yiduo, WANG Yuping. Pseudo 3D Visualization Design in Mobile Maps[J]. Geomatics and Information Science of Wuhan University, 2010, 35(1): 79-82.
    [7]ZHENG Shunyi, ZHANG Zuxun, ZHAI Ruifang. 3D Reconstruction of Complex Objects Based on Non-metric Image[J]. Geomatics and Information Science of Wuhan University, 2008, 33(5): 446-449.
    [8]TANG Min, ZHANG Zuxun, ZHANG Jianqing. 3D Reconstruction and Inspection of Industrial Sheet Metal Parts with Multiple Baseline Images Based on Generalized Point Photogrammetry Theory[J]. Geomatics and Information Science of Wuhan University, 2007, 32(12): 1095-1098.
    [9]ZHU Qing, LI Fengchun, ZHANG Yeting. An Improved Region-Growing Algorithm for Surface Reconstruction from 3D Irregular Points[J]. Geomatics and Information Science of Wuhan University, 2006, 31(8): 667-670.
    [10]HUANG Peizhi. 3D Terrain Surface Reconstruction with Contour Data[J]. Geomatics and Information Science of Wuhan University, 2005, 30(8): 668-672.
  • Cited by

    Periodical cited type(0)

    Other cited types(1)

Catalog

    Article views (4120) PDF downloads (1119) Cited by(1)
    Related

    /

    DownLoad:  Full-Size Img  PowerPoint
    Return
    Return