Abstract: The rapid development of deep learning provides an important technical means for intelligent analysis of remote sensing big data. Firstly, this paper mainly introduces the deep learning modes in remote sensing data recognition and application, and proposes a deep reinforcement learning, multi-task learning and sub-pixel-pixel-super-pixel feature learning models for object features recognition from LiDAR point clouds, optical remote sensing images and hyperspectral images. The model parameters are basically obtained by learning, and thus the workload of the parameter adjustments is small. The spatial and contextual information, texture and spectral characteristics between ground objects are fully taken into account, so the presented models have good generalization abilities. Then, it describes the progress in terms of the joint deep learning and multi-source remote sensing data in accurate poverty alleviation assessment, wetland change and spatial analysis in Qinghai-Tibet Plateau in the past 20 years, and corn yield estimation. In order to better promote the transformation from remote sensing data to knowledge, it is necessary give full play to the advantages of deep learning in remote sensing big data processing, and develop new data processing algorithms and technologies.