陆地观测卫星数据中心:大数据挑战及一种解决方案

Land Observing Satellite Data Center:Big Data Challenges and a Potential Solution

  • 摘要: 为应对陆地观测卫星数据及应用的多样性、存储数据规模的急速增长、数据处理与应用的高时效性、系统高可扩展性、系统资源整合的紧迫性等挑战,结合大数据技术,提出了一种基于Hadoop平台支持大数据处理与分析的陆地观测卫星数据中心架构解决方案,以提高陆地观测卫星数据利用水平与决策支持能力,提升国家空间信息资源应用水平,培育我国陆地观测卫星数据应用新的经济增长点。

     

    Abstract: Land Observing Satellite Data Center is the core platform for storing, distributing, processing, and integrating land observing satellite resources. It can provide high quality and effective services for the State Council and the relevant departments of government and local authorities. In the era of big data, the data center benefits from big data opportunities as well as suffering from big data challenges. In this paper, the big data challenges in the center are discussed and then a big data solution is presented. In particular, five major challenges include the 3V dimensions of big data (i.e. Volume, Variety, and Velocity) and the specific challenges in the CRESDA, i.e., extensibility and integration (of multiple disparate management systems). To tackle the challenges aforementioned, a distributed architecture is proposed to manage all resources inside the data center thanks to the Hadoop-like framework for storing and processing the big remote sensing data. It is hoped that the proposed architecture can lend more support to national decision-making, improve the country's spatial information resources application level and serves as a new economic growth source of land observing satellite data applications.

     

/

返回文章
返回