Design and development of real-time query platform for big data based on hadoop

• 作 者: 刘小利 Xu Pandeng Liu Mingliang Z
• 机 构: KeyLaboratoryofEarthquakeGeodesy,JiangxiBranchofChinaTelecom,TheChineseInstituteofElectronics,Intern
• 出 处: 高技术通讯：英文版
• 发表日期: 2015年2期
• 关键词: 实时查询 平台框架 开发 设计 数据输入模块 数据存储层 功能测试 性能试验 big data massive data storage real-time
• 基金项目: Supported by the National Science and Technology Support Project （No. 2012BAH01F02） from Ministry of Science and Technology of China and the Director Fund （ No. IS201116002） from Institute of Seismolo

This paper designs and develops a framework on a distributed computing platform for massive multi-source spatial data using a column-oriented database(HBase).This platform consists of four layers including ETL(extraction transformation loading) tier,data