HMIBase: An Hierarchical Indexing System for Storing and Querying Big Data

来源 :ZTE Communications | 被引量 : 0次 | 上传用户:wang8550cimc
下载到本地 , 更方便阅读
声明 : 本文档内容版权归属内容提供方 , 如果您对本文有版权争议 , 可与客服联系进行内容授权或下架
论文部分内容阅读
Relational database management systems are usually deployed on single-node machines and have strict limitations in terms of da-ta structure. This means they do not work well with big data, and No SQL has been proposed as a solution. To make data queryingmore efficient, indexes and memory cache techniques are used in No SQL databases. In this paper, we propose a hierarchical in-dexing mechanism and a prototype distributed data-storage system, called HMIBase, which has hierarchical indexes for non-prima-ry keys in tables and makes data querying more efficient. HMIBase uses HBase as the lower data storage and creates a memorycache for more efficient data transmission. HMIBase supports coprocessor-to-process update requests. It also provides a client withquery and update APIs and a server to support RPCs from the client and finish jobs. To improve the cache hit ratio, we propose amemory cache replacement strategy, called Hot Score algorithm, in HMIBase. The experimental results show that Hot Score algo-rithm is better than other cache-replacement strategies. Relational database management systems are usually deployed on single-node machines and have strict limitations in terms of da-ta structure. This means they do not work well with big data, and No SQL has been proposed as a solution. To make data queryingmore efficient , indexes and memory cache techniques are used in No SQL databases. In this paper, we propose a hierarchical in-dexing mechanism and a prototype distributed data-storage system, called HMIBase, which has hierarchical indexes for non-prima-ry keys in tables and makes data querying more efficient. HMIBase uses the lower data storage and creates a memory cache for more efficient data transmission. HMIBase supports coprocessor-to-process update requests. It also provides a client withquery and update APIs and a server to support RPCs from the client and finish jobs. To improve the cache hit ratio, we propose a memory cache replacement strategy, called Hot Score algorithm, in HMIBase. The experimental results show that H ot Score algo-rithm is better than other cache-replacement strategies.
其他文献
妈妈从菜场买回来两只小螃蟹。它们都是雄的,全身披了一身青黑色铠甲,八条腿又细又长,末尾还装有锋利的小钩子,再加上一对有力的小钳子,显得很威风。我把它们放在一个透明的
期刊
Integration of the cloud desktop and cloud storage platform is urgent for enterprises. However, current proposals for cloud disk arenot satisfactory in terms of
汉字字体文化在我国有着悠久的历史,汉字作为传播载体,发展至今已经成为设计领域的重要内容之一。尤其在信息时代背景下,受审美、时代特点等诸多因素的影响,现代汉字开始与艺
期刊
为了提高传统电梯在自我故障诊断、远程监控等智能化方面的控制功能,使用西门子AS-I总线技术对传统电梯进行技术改造,实现电梯产品的升级换代.通过对传统电梯硬件、软件控制
随着大连市建设北方明珠,以及国防化城市宏伟蓝图的逐步实现,我校政治思想工作为了适应社会主义市场经济的变革,也在改革中加强,在加强中改革。坚持“育人第一”的培养目标,
“显影”技法既可表现工笔重彩风格,也可表现水墨写意之路,同时还可以兼具工笔与写意二者特色,在构图形式与章法上有着与工笔花鸟相同的严谨细致,而又不会受到工笔勾染之法的
自到法国后,也曾跟着旅行团参观过巴黎,但只有一天时间,走马观花,不能尽兴。所以一直有个心愿,希望能在巴黎住上几天,细细地品味这个世界花都的优雅与浪漫。这次得空,便在周
期刊
通过体育教学来培养中学生的体育能力和养成中学生自觉锻炼的好习惯,这是每一位体育教师的职责,也是体育教学向素质教育转轨的一项重要任务和研究课题.中学生体育能力的提高,