论文部分内容阅读
提出了一种针对电力大数据处理的混合实时大数据处理的框架RTDP,提出了RTDP模型的四层体系结构,以及分层计算模式。考虑到RTDP系统对实时性和计算能力的要求,文章采用批量数据处理和流式数据实时处理两种方式相结合的混合处理方法。对于实时性要求不高的数据采用批量数据处理方式进行计算,同时将计算结果作为流式计算的先验知识。本文指出了未来RTDP系统的一般架构和计算方式,也是目前RTDP系统设计的一般方法。
A new RTDP framework for mixed real-time big data processing for power big data processing is proposed. The RTDP model’s four-layer architecture and layered computing mode are proposed. Considering the requirements of real-time and computing ability of RTDP system, the article adopts a hybrid processing method combining batch data processing and real-time processing of streaming data in two ways. For less demanding real-time data using bulk data processing methods to calculate, at the same time the results of the calculation as a priori knowledge of streaming computing. This paper points out the general RTDP system architecture and calculation methods in the future, and is also the general method of RTDP system design.