Global Image Orientation Method for PTZ Camera with Pure Rotation

YANG Hong; XIAO Teng; WU Linghui; DENG Fei

doi:10.13203/j.whugis20220712

Turn off MathJax

Article Contents

Abstract

References

YANG Hong, XIAO Teng, WU Linghui, DENG Fei. Global Image Orientation Method for PTZ Camera with Pure Rotation[J]. Geomatics and Information Science of Wuhan University. DOI: 10.13203/j.whugis20220712

Citation:

PDF (1164 KB)

Global Image Orientation Method for PTZ Camera with Pure Rotation

YANG Hong¹,
XIAO Teng^2,3,
WU Linghui¹,
DENG Fei^1,3, ,

1 School of Geodesy and Geomatics, Wuhan University, Wuhan 430079, China;
2 School of Computer Science, Hubei University of Technology, Wuhan 430068, China;
3 Wuhan Tianjihang Information Technology Co., Ltd, Wuhan 430074, China

More Information

Received Date: January 08, 2024
Available Online: February 29, 2024

Graphical Abstract

Abstract

Abstract

Objectives: Pan-tilt-zoom(PTZ) camera is widely used in surveillance systems due to its wide field of view and high resolution. The camera mounted on the gimbal can only make pure rotation motion around the optical center. The optical center overlap of images makes it impossible to use existing Structure from Motion (SfM) methods for purely rotated images orientation. In order to estimate the elements of interior and exterior orientation in the free net of a set of PTZ camera images with pure rotation, a global image orientation method for PTZ camera with pure rotation was proposed, which motivated by the idea of the global SfM. Methods: Compared with the general SfM method, the similarities are feature extraction and feature matching, and the differences are interior orientation, exterior orientation and bundle adjustment. Firstly, partial image pairs are selected for inner orientation to estimate the elements of interior orientation. Then, global exterior orientation was implemented for all images, and the elements of exterior orientation were estimated. Finally, the elements of interior and exterior orientation are optimized by bundle adjustment with no object 3d point. Results: Experiments on simulation data and real data prove the feasibility and accuracy of the proposed method. In the simulation data experiments, the maximum error of the focal length and the principal point is 3.321 pixels, and most of the errors are less than 1 pixel. The maximum rotation errors of the four datasets are 0.116 degrees, 0.320 degrees, 0.103 degrees, 0.125 degrees. In the real data experiments, the maximum reprojection errors of the checkpoints are 4.919 pixels and 4.758 pixels for the two datasets, respectively. Conclusions: Compared with the existing global SfM method, the proposed method can successfully orient the images of PTZ camera with pure rotation. In addition, compared with other commercial software, the exterior orientation accuracy of the proposed method is higher, and it also has the advantage of computational efficiency. The method presented is not limited to PTZ camera images, and it has universality for other purely rotated images orientation problems.
- global structure from motion (SfM),
- image orientation,
- pan-tilt-zoom (PTZ) camera,
- pure rotation image,
- bundle adjustment,
- omnidirectional camera

FullText(HTML)

References (30)

References

[1]	Sinha S N. Pan-Tilt-Zoom (PTZ) Camera[M]//Computer Vision: A Reference Guide. Cham: Springer International Publishing, 2021: 941-947.
[2]	Gao Fei,Wang Meizhen,Liu Xuejun,et al.A Road Network Coverage Optimization Method in Surveillance Camera Network[J].Geomatics and Information Science of Wuhan University,2020,45(3):362-373（高飞,王美珍,刘学军,等.一种监控摄像机网络‐路网覆盖优化调度方法[J].武汉大学学报·信息科学版,2020,45(3):362-373）
[3]	Yong H, Huang J, Xiang W, et al. Panoramic background image generation for PTZ cameras[J]. IEEE Transactions on Image Processing, 2019, 28(7): 3162-3176.
[4]	Ullah F, Kwon O J, Choi S. Generation of a panorama compatible with the JPEG 360 international standard using a single PTZ camera[J]. Applied Sciences, 2021, 11(22): 11019.
[5]	Chen J, Zhu F, Little J J. A two-point method for PTZ camera calibration in sports[C]//2018 IEEE Winter Conference on Applications of Computer Vision (WACV). IEEE, 2018: 287-295.
[6]	Homayounfar N, Fidler S, Urtasun R. Sports field localization via deep structured models[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 2017: 5212-5220.
[7]	Ma Qingping. Object Detection and Location System Based on PTZ Active Multi-camera[D]. University of ElectronicScinece and Techology of China, 2014. (马庆平. 多PTZ主动摄像头的类目标检测定位系统[D]. 电子科技大学,2014.)
[8]	Yun K, Kim H, Bae K, et al. Unsupervised moving object detection through background models for ptz camera[C]//2020 25th International Conference on Pattern Recognition (ICPR). IEEE, 2021: 3201-3208.
[9]	Simonsen C P, Theisson F M, Holtskog Ø, et al. Detecting and locating boats using a PTZ camera with both optical and thermal sensors[C]//15th International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications, VISIGRAPP 2020. SCITEPRESS Digital Library, 2020: 395-403.
[10]	Zhang Xing,Liu Tao,Sun Longpei,et al.A Visual-Inertial Collaborative Indoor Localization Method for Multiple Moving Pedestrian Targets[J]. Geomatics and Information Science of Wuhan University,2021,46(5):672-680（张星,刘涛,孙龙培,等. 一种视觉与惯性协同的室内多行人目标定位方法[J].武汉大学学报·信息科学版,2021,46(5):672-680）
[11]	Wu Z, Radke R J. Keeping a pan-tilt-zoom camera calibrated[J]. IEEE transactions on pattern analysis and machine intelligence, 2012, 35(8): 1994-2007.
[12]	Jain L C. Dynamic Self-Calibration Algorithm for PTZ Camera in Traffic Scene[J]. Information Technology and Intelligent Transportation Systems, 2020, 323: 176.
[13]	Song J, Song H, Wang S. PTZ camera calibration based on improved DLT transformation model and vanishing Point constraints[J]. Optik, 2021, 225: 165875.
[14]	Xie Jingting, Lin Xiaohu, Wang Fuhong, et al. Extrinsic Calibration Method for LiDAR and Camera with Joint Point-Line-Plane Constraints[J]. Geomatics and Information Science of Wuhan University, 2021, 46(12): 1916-1923（谢婧婷,蔺小虎,王甫红,等. 一种点线面约束的激光雷达和相机标定方法[J]. 武汉大学学报·信息科学版,2021,46(12):1916-1923）
[15]	Junejo I N, Foroosh H. Optimizing PTZ camera calibration from two images[J]. Machine Vision and Applications, 2012, 23: 375-389.
[16]	Zheng Keyin. Self-calibration and Error Analysis for Rotating Camera[D]. Shanxi University, 2015. (郑珂银. 旋转摄像机自标定方法及误差分析[D]. 山西大学, 2015.)
[17]	Zhang C, Rameau F, Kim J, et al. Deepptz: Deep self-calibration for ptz cameras[C]//Proceedings of the IEEE/CVF Winter Conference on Applications of Computer Vision. 2020: 1041-1049.
[18]	Chen Wu,Jiang San,Li Qingquan,et al.Recent Research of Incremental Structure from Motion for Unmanned Aerial Vehicle Images[J].Geomatics and Information Science of Wuhan University,2022,47(10):1662-1674（陈武,姜三,李清泉,等. 无人机影像增量式运动恢复结构研究进展[J]. 武汉大学学报·信息科学版,2022,47(10):1662-1674）
[19]	Moulon P, Monasse P, Marlet R. Global fusion of relative motions for robust, accurate and scalable structure from motion[C]//Proceedings of the IEEE international conference on computer vision. 2013: 3248-3255.
[20]	Shan Jie. A Brief History and Essentials of Bundle Adjustment[J]. Geomatics and Information Science of Wuhan University, 2018, 43(12): 1797-1810(单杰. 光束法平差简史与概要[J]. 武汉大学学报：信息科学版, 2018,43(12): 1797-1810)
[21]	Cefalu A, Haala N, Fritsch D. Structureless bundle adjustment with self-calibration using accumulated constraints[J]. ISPRS Annals of the Photogrammetry, Remote Sensing and Spatial Information Sciences, 2016, 3: 3-9.
[22]	Moulon P, Monasse P, Marlet R. Adaptive structure from motion with a contrario model estimation[C]//Computer Vision– ACCV 2012: 11th Asian Conference on Computer Vision, Daejeon, Korea, November 5-9, 2012, Revised Selected Papers, Part IV 11. Springer Berlin Heidelberg, 2013: 257-270.
[23]	Hartley,Zissermana． Multiple View Geometry in Computer Vision[M]. Hefei: Anhui University Press,2002:229.(哈特利R,Hartley Richard,齐瑟曼A,等.计算机视觉中的多视图几何[M].安徽大学出版社,2002:229)
[24]	Parra A, Chng S F, Chin T J, et al. Rotation coordinate descent for fast globally optimal rotation averaging[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021: 4298-4307.
[25]	Lee S H, Civera J. Rotation-only bundle adjustment[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. 2021: 424-433.
[26]	Zach C, Klopschitz M, Pollefeys M. Disambiguating visual relations using loop constraints[C]//2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE, 2010: 1426-1433.
[27]	Ai H, Cao Z, Zhu J, et al. Deep learning for omnidirectional vision: A survey and new perspectives[J]. arXiv preprint arXiv:2205.10468, 2022.
[28]	Deng Fei, Wu Yousi, Hu Yulei, Cui Hongxia. Position and Pose Estimation of Spherical Panoramic Image with Improved EPnP Algorithm[J]. Acta Geodaetica et Cartographica Sinica, 2016, 45(6): 677-684. (邓非, 吴幼丝, 胡玉雷, 等. 球形全景影像位姿估计的改进EPnP算法[J]. 测绘学报, 2016, 45(006): 677-684.)
[29]	CHEN Yulun,CHEN Danni,LI Xi.Analysis of Night Light Patterns Using Urban Public Camera[J].Geomatics and Information Science of Wuhan University,2022,47(8):1318-1327（陈宇伦,陈丹妮,李熙. 利用城市公共摄像头分析夜间灯光变化规律[J].武汉大学学报·信息科学版,2022,47(8):1318-1327）
[30]	Chen Jun,Liu Jianjun,Tian Haibo.Basic Directions and Technological Path for Building 3D Realistic Geospatial Scene in China[J].Geomatics and Information Science of Wuhan University,2022,47(10):1568-1575（陈军,刘建军,田海波. 实景三维中国建设的基本定位与技术路径[J]. 武汉大学学报·信息科学版, 2022, 47(10): 1568-1575）

[1]	HUANG Bohua, YANG Bohang, LI Minggui, GUO Zhongkai, MAO Jianyou, WANG Hong. An Improved Method for MAD Gross Error Detection of Clock Error[J]. Geomatics and Information Science of Wuhan University, 2022, 47(5): 747-752. DOI: 10.13203/j.whugis20190430
[2]	WANG Leyang, GU Wangwang, ZHAO Xiong, XU Guangyu, GAO Hua. Determination of Relative Weight Ratio of Joint Inversion Using Bias-Corrected Variance Component Estimation Method[J]. Geomatics and Information Science of Wuhan University, 2022, 47(4): 508-516. DOI: 10.13203/j.whugis20200216
[3]	IA Lei, LAI Zulong, MEI Changsong, JIAO Chenchen, JIANG Ke, PAN Xiong. An Improved Algorithm for Real-Time Cycle Slip Detection and Repair Based on TurboEdit Epoch Difference Model[J]. Geomatics and Information Science of Wuhan University, 2021, 46(6): 920-927. DOI: 10.13203/j.whugis20190287
[4]	ZHAO Jianhu, WU Jingwen, ZHAO Xinglei, ZHOU Fengnian. A Correction Model for Depth Bias in Airborne LiDAR Bathymetry Systems[J]. Geomatics and Information Science of Wuhan University, 2019, 44(3): 328-333. DOI: 10.13203/j.whugis20160481
[5]	LU Tieding, YANG Yuanxi, ZHOU Shijian. Comparative Analysis of MDB for Different Outliers Detection Methods[J]. Geomatics and Information Science of Wuhan University, 2019, 44(2): 185-192, 199. DOI: 10.13203/j.whugis20140330
[6]	LOU Yidong, GONG Xiaopeng, GU Shengfeng, ZHENG Fu, YI Wenting. The Characteristic and Effect of Code Bias Variations of BeiDou[J]. Geomatics and Information Science of Wuhan University, 2017, 42(8): 1040-1046. DOI: 10.13203/j.whugis20150107
[7]	SUN Wenchuan, BAO Jingyang, JIN Shaohua, XIAO Fumin, ZHANG Zhiwei. A Re-calibration Method for Roll Bias of Multi-beam Sounding System[J]. Geomatics and Information Science of Wuhan University, 2016, 41(11): 1440-1444. DOI: 10.13203/j.whugis20140481
[8]	ZOU Qin, LI Qingquan. Target-points MST for Pavement Crack Detection[J]. Geomatics and Information Science of Wuhan University, 2011, 36(1): 71-75.
[9]	HUANG Xianyuan, ZHAI Guojun, SUI Lifen, HUANG Motao. Application of Least Square Support Vector Machine to Detecting Outliers of Multi-beam Data[J]. Geomatics and Information Science of Wuhan University, 2010, 35(10): 1188-1191.
[10]	XU Caijun, WANG Jianglin. Linear Minimum Mean Square Error Estimation for Wet Delay Correction in SAR Interferogram[J]. Geomatics and Information Science of Wuhan University, 2007, 32(9): 757-760.

Cited By

Get Citation

PDF

XML

Article views (105) PDF downloads (21)

Global Image Orientation Method for PTZ Camera with Pure Rotation

Abstract

References

Related Articles

Catalog

Related

Global Image Orientation Method for PTZ Camera with Pure Rotation

Abstract

References

Related Articles

Catalog

Related

Export File

Citation

Format

Content