An Improved Deep Novel Target Detection Method for Mars Rover Multispectral Imagery

  Objectives  Mars is the main target object for deep space exploration. Mars rovers, or roving probes, are important tools for surface exploration and scientific research on Mars. For the growing amount of remote sensing data collected by Mars rovers, there is an urgent need for a method that can intelligently detect novel targets of scientific value from the massive amount of images, reduce the time cost of detection planning, and provide information for subsequent scientific analysis. The traditional novel detection methods mostly include distance-based metrics and image-based reconstruction methods, distance-based metrics calculate novel scores pixel by pixel without considering spatial contextual information, and image-based reconstruction methods focus on reconstruction of typical landscape backgrounds, and novelty is manifested by image reconstruction errors, which is not effective in extracting small novel targets such as boreholes and dust removal points.

  Methods  To address the above problems of traditional novel detection methods in Mars rover novel target detection, this paper proposes an improved Mars rover multispectral image depth novel target detection method, uses full convolutional self-coding neural network to extract deep features for typical landscape reconstruction, and joints Mahalanobis distance for novel target and typical landscape background separation, fully exploits the spatial and spectral dimensional features to improve the accuracy of Mars rover novel target detection results.

  Results  The experiments use the multispectral image dataset of Curiosity rover released by NASA (National Aeronautics and Space Administration), and the proposed convolution auto-encoder combined Mahalanobis distance method(CAE-M) is compared with Reed-Xiaoli detector, principal component analysis, convolution auto-encoder convolution, and generative adversarial networks on the surface of Gale crater. The results show that CAE-M outperforms previous detection methods in terms of detection accuracy and visual interpretation, and has a balanced and stable performance in different classes of novel target detection.

  Conclusion  The proposed CAE-M method comprehensively utilizes spatial and spectral information of multispectral images, which can help Mars rover exploration missions to quickly and intelligently screen and sort novel data with scientific value in massive data, save the time and cost of route planning, improve scientific returns.