Adaptive Fast Mesh Refinement of 3D Reconstruction Based on Image Information

ZHANG Chunsen; ZHANG Menghui; GUO Bingxuan; PENG Zhe

doi:10.13203/j.whugis20190161

Volume 45 Issue 3

Mar. 2020

Turn off MathJax

Article Contents

Abstract

References

Geomatics and Information Science of Wuhan University > 2020 > 45(3): 411-418. > DOI: 10.13203/j.whugis20190161

ZHANG Chunsen, ZHANG Menghui, GUO Bingxuan, PENG Zhe. Adaptive Fast Mesh Refinement of 3D Reconstruction Based on Image Information[J]. Geomatics and Information Science of Wuhan University, 2020, 45(3): 411-418. DOI: 10.13203/j.whugis20190161

Citation:

PDF (27792 KB)

Adaptive Fast Mesh Refinement of 3D Reconstruction Based on Image Information

1.
College of Geomatics, Xi'an University of Science and Technology, Xi'an 710054, China
2.
State Key Laboratory of Information Engineering in Surveying, Mapping and Remote Sensing, Wuhan University, Wuhan 430079, China
3.
Wuhan Xuntu Technology Co. Ltd., Wuhan 430079, China

Funds:

Shaanxi Natural Science Foundation 2018JM5103

More Information

Author Bio:
ZHANG Chunsen, PhD, professor, specializes in photogrammetry and remote sensing. E-mail: zhchunsen@aliyun.com
Received Date: February 28, 2019
Published Date: March 04, 2020

Graphical Abstract

Abstract

Abstract

A method of balancing the optimize accuracy and efficiency of the mesh to achieve mesh adaptive fast optimization is proposed to solve the problem of low efficiency of mesh optimization in the existing 3D reconstruction based on images. After calculating the initial value of the vertex gradient along the triangular normal vector based on the image gray information, the mesh of each triangle is marked differently according to the different results:The active triangles and the lazy triangles, through the active in the mesh is refined to abandon the optimization of the lazy triangles in exchanging for improvement of efficiency. The optimization of the efficiency is fast improving while obtaining better mesh vertices. We choose classical images church and fountain data in the 3D reconstruction experiment of computer vision and the widely used of unmanned aerial vehicle (UAV) images in photogrammetry to reconstruct mesh to refine. The mesh model optimization time and precision comparison results show that this algorithm can greatly improve the mesh optimize efficiency to obtain the 3D model faster.
- mesh refinement,
- image information,
- gradient calculation,
- adaptive refinement,
- 3D reconstruction

FullText(HTML)

References (21)

References

[1]	李德仁, 肖雄武, 郭丙轩, 等.倾斜影像自动空三及其在城市真三维模型重建中的应用[J].武汉大学学报·信息科学版, 2016, 41(6):711-721 http://ch.whu.edu.cn/CN/abstract/abstract5454.shtml Li Deren, Xiao Xiongwu, Guo Bingxuan, et al. Oblique Image Based Automatic Aero-triangulation and Its Application in 3D City Model Reconstruction[J]. Geomatics and Information Science of Wuhan University, 2016, 41(6):711-721 http://ch.whu.edu.cn/CN/abstract/abstract5454.shtml
[2]	Delaunoy A, Prados E.Gradient Flows for Optimizing Triangular Mesh-Based Surfaces:Applications to 3D Reconstruction Problems Dealing with Visibility[J]. International Journal of Computer Vision, 2011, 95(2):100-123 doi: 10.1007/s11263-010-0408-9
[3]	张春森, 张萌萌, 郭丙轩.影像信息驱动的三角网格模型优化方法[J].测绘学报, 2018, 47(7):959-967 http://d.old.wanfangdata.com.cn/Periodical/chxb201807009 Zhang Chunsen, Zhang Mengmeng, Guo Bingxuan. Refinement of 3D Mesh Model Driven by the Image Information[J]. Acta Geodaetica et Cartographica Sinica, 2018, 47(7):959-967 http://d.old.wanfangdata.com.cn/Periodical/chxb201807009
[4]	Sinha S N, Pollefeys M. Multi-view Reconstruction Using Photo-Consistency and Exact Silhouette Constraints: A Maximum-Flow Formulation[C]. IEEE International Conference on Computer Vision, Beijing, China, 2005
[5]	Furukawa Y, Ponce J. Carved Visual Hulls for Image-Based Modeling[C]. European Conference on Computer Vision, Graz, Austria, 2006
[6]	谭仁春, 杜清运, 杨品福, 等.地形建模中不规则三角网构建的优化算法研究[J].武汉大学学报·信息科学版, 2006, 31(5):436-439 http://ch.whu.edu.cn/CN/abstract/abstract2458.shtml Tan Renchun, Du Qingyun, Yang Pinfu, et al. Optimized Triangulation Arithmetic in Modeling Terrain[J]. Geomatices and Information Science of Wuhan University, 2006, 31(5):436-439 http://ch.whu.edu.cn/CN/abstract/abstract2458.shtml
[7]	Wu Haijun, Chen Zhiming. Uniform Convergence of Multigrid V-cycle on Adaptively Refined Finite Element Meshes for Second Order Elliptic Problems[J]. Science in China (Series A:Mathematics), 2006, 49(10):1405-1429 doi: 10.1007/s11425-006-2005-5
[8]	Esteban C H, Schmitt F. Silhouette and Stereo Fusion for 3D Object Modeling[J]. Computer Vision and Image Understanding, 2004, 96(3):367-392 doi: 10.1016/j.cviu.2004.03.016
[9]	Tylecek R, Sara R. Refinement of Surface Mesh for Accurate Multi-view Restriction[J]. The International Journal of Virtual Reality, 2010, 9(1):45-54 doi: 10.20870/IJVR.2010.9.1.2761
[10]	戴雪峰, 熊汉江, 龚健雅.一种三维城市模型多纹理自动合并方法[J].武汉大学学报·信息科学版, 2015, 40(3):347-352 http://ch.whu.edu.cn/CN/abstract/abstract3208.shtml Dai Xuefeng, Xiong Hanjiang, Gong Jianya. A Multi-texture Automatic Merging Approach for 3D City Models[J].Geomatics and Information Science of Wuhan University, 2015, 40(3):347-352 http://ch.whu.edu.cn/CN/abstract/abstract3208.shtml
[11]	Esteban C H. Stereo and Silhouette Fusion for 3D Object Modeling from Uncalibrated Images Under Circular Motion[J]. Computer Vision and Image Understanding, 2004, 96(3):367-392 doi: 10.1016/j.cviu.2004.03.016
[12]	朱红, 宋东伟, 谭海, 等. Delaunay三角网优化下的小面元遥感影像配准算法[J].信号处理, 2016, 32(9):1032-1038 http://d.old.wanfangdata.com.cn/Periodical/xhcl201609004 Zhu Hong, Song Dongwei, Tan Hai, et al. A Tiny Facet Primitive Remote Sensing Image Registration Algorithm Based on Optimized Delaunay Triangulation[J]. Journal of Signal Processing, 2016, 32(9):1032-1038 http://d.old.wanfangdata.com.cn/Periodical/xhcl201609004
[13]	Delaunoy A, Prados E, Gargallo P, et al.Minimizing the Multi-view Stereo Reprojection Error for Triangular Surface Meshes[C]. British Machine Vision Conference, the University of Warwick, UK, 2008
[14]	Jean-Philippe P, Renaud K, Olivier F. Multi-view Stereo Reconstruction and Scene Flow Estimation with a Global Image-Based Matching Score[J]. International Journal of Computer Vision, 2007, 72(2):179-193 doi: 10.1007/s11263-006-8671-5
[15]	Yuan Hongxing, Li Guo, Li Yu, et al. Multi-view Reconstruction Using Band Graph-Cuts[J]. Journal of Computer Aided Design and Computer Graphics, 2010, 22(4):605-611 doi: 10.3724/SP.J.1089.2010.10601
[16]	Le-Jeng A S. Mesh Rrefinement Based on Euler Encoding[C].The International Conference on Shape Modeling and Applications, Cambridge, MA, USA, 2005
[17]	Furukawa Y, Ponce J. Accurate, Dense, and Robust Multiview Stereopsis[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2010, 32(8):1362-1376 doi: 10.1109/TPAMI.2009.161
[18]	Strecha C, van Gooll F. Wide Baseline Stereo from Multiple Views: A Probabilistic Account[C]. IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Washington D C, 2004
[19]	Pons J P, Boissonnat J D. Delaunay Deformable Models: Topology-Adaptive Meshes Based on the Restricted Delaunay Triangulation[C]. IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, USA, 2007
[20]	Pons J P, Keriven R, Faugeras O. Multi-view Stereo Reconstruction and Scene Flow Estimation with a Global Image-Based Matching Score[J].International Journal of Computer Vision, 2007, 72(2):179-193 doi: 10.1007/s11263-006-8671-5
[21]	Hoang-Hiep V, Renaud K, Jean-Philippe P, et al. High Accuracy and Visibility-Consistent Dense Multi-view Stereo[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2012, 34(5):889-901 doi: 10.1109/TPAMI.2011.172

[1]	ZHU Shaolin, YUE Dongjie, HE Lina, CHEN Jian, LIU Shengnan. BDS-2/BDS-3 Joint Triple-Frequency Precise Point Positioning Models and Bias Characteristic Analysis[J]. Geomatics and Information Science of Wuhan University, 2023, 48(12): 2049-2059. DOI: 10.13203/j.whugis20210273
[2]	GENG Jianghui, YAN Zhe, WEN Qiang. Multi-GNSS Satellite Clock and Bias Product Combination: The Third IGS Reprocessing Campaign[J]. Geomatics and Information Science of Wuhan University, 2023, 48(7): 1070-1081. DOI: 10.13203/j.whugis20230071
[3]	LIU Mingliang, AN Jiachun, WANG Zemin, ZHANG Baojun, SONG Xiangyu. Performance Analysis of BDS-3 Multi-frequency Pseudorange Positioning[J]. Geomatics and Information Science of Wuhan University, 2023, 48(6): 902-910. DOI: 10.13203/j.whugis20200714
[4]	YUAN Haijun, ZHANG Zhetao, HE Xiufeng, XU Tianyang, XU Xueyong. Stability Analysis of BDS-3 Satellite Differential Code Bias and Its Impacts on Single Point Positioning[J]. Geomatics and Information Science of Wuhan University, 2023, 48(3): 425-432. DOI: 10.13203/j.whugis20200517
[5]	ZHOU Ren-yu, HU Zhi-gang, CAI Hong-liang, ZHAO Zhen, RAO Yong-nan, CHEN Liang, ZHAO Qi-le. Analysis of Pseudorange and Carrier Ranging Deviation of BDS-3 Using Parabolic Directional Antenna[J]. Geomatics and Information Science of Wuhan University, 2021, 46(9): 1298-1308. DOI: 10.13203/j.whugis20200182
[6]	ZHANG Hui, HAO Jinming, LIU Weiping, ZHOU Rui, TIAN Yingguo. GPS/BDS Precise Point Positioning Model with Receiver DCB Parameters for Raw Observations[J]. Geomatics and Information Science of Wuhan University, 2019, 44(4): 495-500, 592. DOI: 10.13203/j.whugis20170119
[7]	ZOU Xuan, LI Zongnan, CHEN Liang, LI Min, TANG Weiming, SHI Chuang. Modeling BeiDou IGSO and MEO Satellites Code Pseudorange Variations[J]. Geomatics and Information Science of Wuhan University, 2018, 43(11): 1661-1666. DOI: 10.13203/j.whugis20160275
[8]	LI Xin, ZHANG Xiaohong, ZENG Qi, PAN Lin, ZHU Feng. The Estimation of BeiDou Satellite-induced Code Bias and Its Impact on the Precise Positioning[J]. Geomatics and Information Science of Wuhan University, 2017, 42(10): 1461-1467. DOI: 10.13203/j.whugis20160062
[9]	LOU Yidong, GONG Xiaopeng, GU Shengfeng, ZHENG Fu, YI Wenting. The Characteristic and Effect of Code Bias Variations of BeiDou[J]. Geomatics and Information Science of Wuhan University, 2017, 42(8): 1040-1046. DOI: 10.13203/j.whugis20150107
[10]	FAN Lei, ZHONG Shiming, LI Zishen, OU Jikun. Effect of Tracking Stations Distribution on the Estimation of Differential Code Biases by GPS Satellites Based on Uncombined Precise Point Positioning[J]. Geomatics and Information Science of Wuhan University, 2016, 41(3): 316-321. DOI: 10.13203/j.whugis20140114

Cited By

Get Citation

PDF

XML

Article views (2722) PDF downloads (193)

Adaptive Fast Mesh Refinement of 3D Reconstruction Based on Image Information

Abstract

References

Related Articles

Catalog

Related

Adaptive Fast Mesh Refinement of 3D Reconstruction Based on Image Information

Abstract

References

Related Articles

Catalog

Related

Export File

Citation

Format

Content