Abstract: In recent years, the rapid development of the earth observation capability and the intelligent computing technology has provided opportunities for the advancement and even revolution of remote sensing information technology. Remote sensing data processing technology has experienced the Digi-tal Signal Processing Era from 60s to 80s of last century, which utilizes the Statistical Model as the core, and the Quantitative Remote Sensing Era from 90s marked by the Physical Model. Recently, it is developing towards Remotely Sensed Big Data Era which relies on Data Model by data-driven intelligent analysis. This paper summarizes the history of remote sensing information technology and presents the concept of remotely sensed big data and the characteristics of intelligent information extraction era. Firstly, from the view of remotely sensed big data, this paper discusses the construction of object-based remote sensing knowledge dataset and analyzes the data-driven intelligent information extraction strategy combined the knowledge of remote sensing and deep learning algorithm. Then the current status and development of intelligent algorithms represented by deep learning are introduced by typical applications on object detection, fine classification and parameter inversion based on remote sensing data. Consequently, the application potential of deep learning on intelligent information extraction in Remotely Sensed Big Data Era is discussed.