Panoramic Texture Mapping Algorithm Based on Multi-image Pose Estimation

HUANG Ming; JIA Jianan; LI Shanlei; ZHANG Jianguang; GONG Jianhui

doi:10.13203/j.whugis20180086

Volume 44 Issue 11

Nov. 2019

Turn off MathJax

Article Contents

Abstract

References

Geomatics and Information Science of Wuhan University > 2019 > 44(11): 1622-1632. > DOI: 10.13203/j.whugis20180086

HUANG Ming, JIA Jianan, LI Shanlei, ZHANG Jianguang, GONG Jianhui. Panoramic Texture Mapping Algorithm Based on Multi-image Pose Estimation[J]. Geomatics and Information Science of Wuhan University, 2019, 44(11): 1622-1632. DOI: 10.13203/j.whugis20180086

Citation:

PDF (11640 KB)

Panoramic Texture Mapping Algorithm Based on Multi-image Pose Estimation

HUANG Ming^{1, 2,},
JIA Jianan^{1, 2, ,},
LI Shanlei^{1, 2},
ZHANG Jianguang³,
GONG Jianhui⁴

1.
School of Geomatics and Urban Spatial Informatics, Beijing University of Civil Engineering and Architecture, Beijing 102616, China
2.
Engineering Research Center of Representative Building and Architectural Heritage Database, Ministry of Education, Beijing 102616, China
3.
Beijing North-Star Digital Remote Sensing Technology Co. Ltd, Beijing 100120, China
4.
The Third Aerial Survey and Remote Sensing Institute of the Ministry of Natural Resources, Chengdu 610100, China

Funds:

The National Key Research and Development Program of China 2016YFC0802107

the National Natural Science Foundation of China 41971350

the National Natural Science Foundation of China 41601409

Beijing Natural Science Foundation 8172016

the Key Research and Development Project of Sichuan Provincial Science and Technology Department 2017SZ0027

More Information

Author Bio:
HUANG Ming, PhD, professor, specializes in 3D laser data processing and reconstruction. E-mail:huangming@bucea.edu.cn
Corresponding author:
JIA Jianan, postgraduate. E-mail:jia_jn@stu.bucea.edu.cn
Received Date: March 19, 2018
Published Date: November 04, 2019

Graphical Abstract

Abstract

Abstract

Texture mapping technology, which is an effective means to obtain true color point clouds with rich texture information, has been widely used in many fields with its unique advantages. It has a very broad application prospect. We study a method for solving multiple image poses based on joint calibration of 3D laser scanners and external digital cameras, and obtain a method for obtaining panoramic true color point clouds. The basic idea is to use the inherent relative position and posture of the camera and the laser scanner to calibrate the first image obtained by rotating the camera. After obtaining its position and posture, the geometrical characteristics of the camera's space rotation are used to determine the position and orientation of the rest of the images in terms of the pose of first image. Then the texture mapping of multiple images can be accomplished to obtain a panoramic color point cloud. Compared with the current mainstream panoramic image texture mapping algorithm, this algorithm has certain improvement in accuracy and efficiency. By performing texture mapping experiments on a variety of point cloud data, the results show that the method can quickly and accurately obtain true three-dimensional panoramic color point clouds, providing a data foundation for three-dimensional refined modeling.
- texture mapping,
- pose estimation,
- panoramic point cloud,
- image dodging

FullText(HTML)

References (31)

References

[1]	张靖, 江万寿.激光点云与光学影像配准:现状与趋势[J].地球信息科学学报, 2017, 19(4):528-539 http://d.old.wanfangdata.com.cn/Periodical/dqxxkx201704011 Zhang Jing, Jiang Wanshou. Registration Between Laser Scanning Point Cloud and Optical Images: Status and Trends[J]. Journal of Geo-information Science, 2017, 19(4):528-539 http://d.old.wanfangdata.com.cn/Periodical/dqxxkx201704011
[2]	Lowe D G. Distinctive Image Features from Scale-Invariant Keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110 doi: 10.1023/B:VISI.0000029664.99615.94
[3]	Snavely N, Seitz S M, Szeliski R. Modeling the World from Internet Photo Collections[J]. International Journal of Computer Vision, 2008, 80(2):189-210 doi: 10.1007/s11263-007-0107-3
[4]	Stamos I, Liu L, Chen C, et al. Integrating Automated Range Registration with Multiview Geometry for the Photorealistic Modeling of Large-Scale Scenes[J]. International Journal of Computer Vision, 2008, 78(2/3):237-260 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=ebe19992a055ca6e91096c9db9a89b23
[5]	Triggs B, Mclauchlan P F, Hartley R I, et al. Bundle Adjustment: A Modern Synthesis[C]. The International Workshop on Vision Algorithms: Theory and Practice, London, UK, 1999
[6]	邓非, 张祖勋, 张剑清.一种激光扫描数据与数码照片的配准方法[J].武汉大学学报·信息科学版, 2007, 32(4): 290-292 http://ch.whu.edu.cn/CN/abstract/abstract1879.shtml Deng Fei, Zhang Zuxun, Zhang Jianqing. A Method of Registration Between Laser Scanning Data and Digital Images[J]. Geomatics and Information Science of Wuhan University, 2007, 32(4): 290-292 http://ch.whu.edu.cn/CN/abstract/abstract1879.shtml
[7]	李媛, 胡翰, 谢金华, 等.局部区域表面一致性约束的三维模型纹理映射方法[J].武汉大学学报∙信息科学版, 2016, 41(12):1 599-1 604 http://d.old.wanfangdata.com.cn/Periodical/whchkjdxxb201612006 Li Yuan, Hu Han, Xie Jinhua, et al. An Automatic Texture Mapping Method Using Local Surface Consistency Constraint[J]. Geomatics and Information Science of Wuhan University, 2016, 41(12):1 599-1 604 http://d.old.wanfangdata.com.cn/Periodical/whchkjdxxb201612006
[8]	Swart A, Broere J, Veltkamp R, et al. Refined Non-rigid Registration of a Panoramic Image Sequence to a LiDAR Point Cloud[C]. ISPRS Conference on Photogrammetric Image Analysis, Munich, Germany, 2011
[9]	邓非, 杨海关, 李丽英.基于互信息的LiDAR与光学影像配准方法[J].测绘科学, 2009, 34(6):51-52 http://d.old.wanfangdata.com.cn/Periodical/chkx200906017 Deng Fei, Yang Haiguan, Li Liying. 3D Reconstruction of Old Architecture by Laser Scanner and Digital Camera[J]. Science of Surveying and Mapping, 2009, 34(6):51-52 http://d.old.wanfangdata.com.cn/Periodical/chkx200906017
[10]	闫利, 曹亮, 谢洪, 等.车载全景影像与激光点云融合生成彩色点云方案[J].测绘科学, 2015, 40(9):111-114 http://d.old.wanfangdata.com.cn/Periodical/chkx201509023 Yan Li, Cao Liang, Xie Hong, et al. Generation of Colored Point Cloud by Fusion of Vehicle-Borne Panoramic Images and LiDAR Point Clouds[J]. Science of Surveying and Mapping, 2015, 40(9):111-114 http://d.old.wanfangdata.com.cn/Periodical/chkx201509023
[11]	陈为民, 聂倩, 林昀.基于罗德里格矩阵的车载激光点云与全景影像配准研究[J].测绘通报, 2013(11):21-24 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=chtb201311006 Chen Weimin, Nie Qian, Lin Yun. Research on Registration of Vehicle-Borne Laser Point Clouds and Panoramic Images Based on Lodrigues Matrix Transformation[J]. Bulletin of Surveying and Mapping, 2013(11):21-24 http://www.wanfangdata.com.cn/details/detail.do?_type=perio&id=chtb201311006
[12]	梅文胜, 胡帅朋, 李谋思, 等.基于普通数码相机的旋转全景摄影测量方法[J].武汉大学学报∙信息科学版, 2017, 42(2):243-249 http://d.old.wanfangdata.com.cn/Periodical/whchkjdxxb201702016 Mei Wensheng, Hu Shuaipeng, Li Mousi, et al. Rotation Panorama Photogrammetry Method Based on Digital Camera[J]. Geomatics and Information Science of Wuhan University, 2017, 42(2):243-249 http://d.old.wanfangdata.com.cn/Periodical/whchkjdxxb201702016
[13]	李艳红, 李海亭, 庞小平, 等.采用投影回归原理的全景影像测量方法[J].武汉大学学报·信息科学版, 2014, 39(1): 32-36 http://ch.whu.edu.cn/CN/abstract/abstract2844.shtml Li Yanhong, Li Haiting, Pang Xiaoping, et al. Panoramic Image Measurement Method Based on Projection Regression[J]. Geomatics and Information Science of Wuhan University, 2014, 39(1):32-36 http://ch.whu.edu.cn/CN/abstract/abstract2844.shtml
[14]	田茂, 花向红, 丁鸽, 等.基于罗德里格矩阵的混合最小二乘方法在三维激光中的应用[J].测绘地理信息, 2014, 39(2):18-21 http://www.cnki.com.cn/Article/CJFDTotal-CHXG201402006.htm Tian Mao, Hua Xianghong, Ding Ge, et al. Three-Dimensional Laser Scanning Technology Research Application Based on Mixed Least Squares in Rodrigue Matrix[J]. Journal of Geomatics, 2014, 39(2):18-21 http://www.cnki.com.cn/Article/CJFDTotal-CHXG201402006.htm
[15]	王永波, 汪云甲, 杨化超.基于单位四元数描述的单像空间后方交会算法[J].中国矿业大学学报, 2015, 44(3):557-565 http://www.cqvip.com/QK/93316X/201503/664858128.html Wang Yongbo, Wang Yunjia, Yang Huachao. A Unit Quaternion Based Approach for Single Image Space Resection[J]. Journal of China University of Mining and Technology, 2015, 44(3):557-565 http://www.cqvip.com/QK/93316X/201503/664858128.html
[16]	Otero J, Sánchez L. Local Iterative DLT Soft-Computing vs. Interval-Valued Stereo Calibration and Triangulation with Uncertainty Bounding in 3D Reconstruction[J]. Neurocomputing, 2015, 167:44-51 doi: 10.1016/j.neucom.2014.11.087
[17]	王青山.一种基于DLT模型改进的三维相机标定算法研究[J].测绘与空间地理信息, 2016, 39(12):207-210 doi: 10.3969/j.issn.1672-5867.2016.12.065 Wang Qingshan. A Model Based on DLT Improved Three-Dimensional Camera Calibration Algorithm Research[J]. Geomatics and Spatial Information Technology, 2016, 39(12):207-210 doi: 10.3969/j.issn.1672-5867.2016.12.065
[18]	王彦君, 高飞.附加约束条件的DLT在基坑变形监测中的应用[J].工程勘察, 2015, 43(6):76-80 http://d.old.wanfangdata.com.cn/Periodical/gckc201506016 Wang Yanjun, Gao Fei. Application Research on Deformation Monitoring of Foundation Pit by Using DLT Method with Additional Constraints[J]. Geotechnical Investigation and Surveying, 2015, 43(6):76-80 http://d.old.wanfangdata.com.cn/Periodical/gckc201506016
[19]	赵煦, 周克勤, 闫利, 等.基于激光点云的大型文物景观三维重建方法[J].武汉大学学报∙信息科学版, 2008, 33(7): 684-687 http://ch.whu.edu.cn/CN/abstract/abstract1640.shtml Zhao Xu, Zhou Keqin, Yan Li, et al. 3D Reconstruction Method for Large Scale Relic Landscape from Laser Point Cloud[J]. Geomatics and Information Science of Wuhan University, 2008, 33(7):684-687 http://ch.whu.edu.cn/CN/abstract/abstract1640.shtml
[20]	Grunert J A. Das Pothenotische Problem in Erweiterter Gestalt Nebst Bber Seine Anwendungen in Der Geodasie[J]. Grunerts Archiv fur Mathematik und Physik, 1841(1): 238–248
[21]	Fischler M A, Bolles R C. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography[J]. Communications of the ACM, 1981, 24(6):381-395 doi: 10.1145/358669.358692
[22]	王波, 胡浩, 张彩霞, 等. P3P问题多解现象的普遍性[J].中国科学(信息科学), 2017, 47(4): 482-491 http://www.cnki.com.cn/Article/CJFDTotal-PZKX201704007.htm Wang Bo, Hu Hao, Zhang Caixia, et al. Generality of the Multi-Solution Phenomenon in the P3P Problem[J]. Science China(Informationis Sciences), 2017, 47(4):482-491 http://www.cnki.com.cn/Article/CJFDTotal-PZKX201704007.htm
[23]	Gao X, Hou X R, Tang J, et al. Complete Solution Classification for the Perspective-Three-Point Problem[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2003, 25(8):930-943 doi: 10.1109/TPAMI.2003.1217599
[24]	Kneip L, Scaramuzza D, Siegwart R. A Novel Parametrization of the Perspective-Three-Point Problem for a Direct Computation of Absolute Camera Position and Orientation[C]. Computer Vision and Pattern Recognition, Colorado, USA, 2011
[25]	Kneip L, Li H, Seo Y. UPnP: An Optimal O(n) Solution to the Absolute Pose Problem with Universal Applicability[C]. The European Conference on Computer Vision (ECCV), Zurich, Switzerland, 2014
[26]	Hesch J A, Roumeliotis S I. A Direct Least-Squares (DLS) Method for PnP[C]. IEEE International Conference on Computer Vision, Barcelona, Spain, 2011
[27]	Zheng Y, Kuang Y, Sugimoto S, et al. Revisiting the PnP Problem: A Fast, General and Optimal Solution[C]. IEEE International Conference on Computer Vision, Washington, USA, 2013
[28]	孙文, 尤红建, 傅兴玉, 等.基于非线性MASK的遥感影像匀光算法[J].测绘科学, 2014, 39(9):130-134 http://d.old.wanfangdata.com.cn/Periodical/chkx201409029 Sun Wen, You Hongjian, Fu Xingyu, et al. A Non-Linear MASK Dodging Algorithm for Remote Sensing Images[J]. Science of Surveying and Mapping, 2014, 39(9):130-134 http://d.old.wanfangdata.com.cn/Periodical/chkx201409029
[29]	李德仁, 王密, 潘俊.光学遥感影像的自动匀光处理及应用[J].武汉大学学报∙信息科学版, 2006, 31(9):753-756 http://d.old.wanfangdata.com.cn/Periodical/whchkjdxxb200609001 Li Deren, Wang Mi, Pan Jun. Auto-dodging Processing and Its Application for Optical RS Images[J]. Geomatics and Information Science of Wuhan University, 2006, 31(9):753-756 http://d.old.wanfangdata.com.cn/Periodical/whchkjdxxb200609001
[30]	Horn B K P, Hilden H M, Negahdaripour S. Closed-Form Solution of Absolute Orientation Using Orthonormal Matrices[J]. Journal of the Optical Society of America A, 1988, 5(7):1 127-1 135 doi: 10.1364/JOSAA.5.001127
[31]	单杰.光束法平差简史与概要[J].武汉大学学报·信息科学版, 2018, 43(12): 1 797-1 810 http://ch.whu.edu.cn/CN/abstract/abstract6263.shtml Shan J. A Brief History and Essentials of Bundle Adjustment[J]. Geomatics and Information Science of Wuhan University, 2018, 43(12):1 797-1 810 http://ch.whu.edu.cn/CN/abstract/abstract6263.shtml

Cited By

Get Citation

PDF

XML

Article views PDF downloads

Panoramic Texture Mapping Algorithm Based on Multi-image Pose Estimation

Abstract

References

Catalog

Related

Panoramic Texture Mapping Algorithm Based on Multi-image Pose Estimation

Abstract

References

Catalog

Related

Export File

Citation

Format

Content