不依赖固定锚点合并的无人机影像并行化SfM方法

Parallel SfM for UAV Images via Anchor-Free Merging

  • 摘要: 增量式运动恢复结构(structure from motion,SfM)并行化方法中,存在场景图构建忽略影像局部连接强度、子场景(空间关联的影像集合)合并路径长和效率低等问题,使其难以满足大场景影像处理需求。提出了一种不依赖固定锚点(参考模型)合并的无人机影像并行化SfM方法。设计了顾及影像局部连接强度约束的场景图构建方法,有效提升了场景图分块的紧凑性,保证了分块内部影像SfM重建的高稳健性;提出了不依赖固定锚点的子场景并行化合并方法,实现合并路径自适应调整与多子场景并行化合并,有效提高了子场景合并的可靠性和效率。利用真实无人机影像进行实验,结果表明,所提方法能够实现9倍加速比的子场景合并,且相对定向和绝对定向性能与现有方法相当。所提方法已成功应用于覆盖范围约50 km2近9万张无人机影像的并行化SfM重建。

     

    Abstract:
    Objectives Incremental structure from motion (SfM) has become the widely used workflow for aerial triangulation of unmanned aerial vehicle (UAV) images. However, it suffers from significant issues of error accumulation and efficiency degradation. The existing parallelization methods for SfM suffer from issues such as the scene graph construction ignoring the local connection strength of images, long merging paths for sub-scenes (spatially related image collections), and low efficiency, making it difficult to meet the requirements of large-scale scene image processing.
    Methods This paper proposes a parallelized SfM method for UAV images that does not rely on fixed anchor points (reference models). The proposed solution develops a scene graph construction algorithm that considers local connection strength constraints, effectively improving the compactness of scene graph partitioning and ensuring the high robustness of SfM reconstruction within partitions. Then, it proposes a parallelized sub-scene merging method that does not rely on fixed anchor points, enabling adaptive adjustment of merging paths and parallel merging of multiple sub-scenes, significantly enhancing the reliability and efficiency of sub-scene merging. To avoid the influence of outliers in corresponding geometric elements, this paper employs the random sample consensus hypothesis-verification framework for robust parameter estimation and designs a transformation model estimation based on a bidirectional mean square reprojection error metric.
    Results Experiments using real UAV images demonstrate that the proposed method achieves a 9 times speedup in sub-scene merging, with relative and absolute orientation performance comparable to the existing methods. And the proposed method has also been successfully applied to the parallel SfM reconstruction of nearly 90 000 UAV images covering an area of about 50 km2.
    Conclusions Considering the metric of efficiency and precision, the proposed method can be a validate solution for the efficient SfM reconstruction for large-scale UAV datasets.

     

/

返回文章
返回