Big data real-time storage, processing and querying system

A query system and data query technology, applied in the fields of electrical digital data processing, special data processing applications, instruments, etc., can solve problems such as difficult to achieve mass, high-speed and changeable, so as to speed up the real-time data and improve the comprehensive ability. , the effect of high throughput

Inactive Publication Date: 2017-06-09
BEIJING ZHONGHAI INVESTMENT MANAGEMENT CO LTD
View PDF2 Cites 97 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] To sum up, in the traditional one-stop real-time data storage, data processing an

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Big data real-time storage, processing and querying system
  • Big data real-time storage, processing and querying system
  • Big data real-time storage, processing and querying system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described below in conjunction with the accompanying drawings. The following description is only for a better understanding of the present invention, and does not set the protection scope of the present invention.

[0028] The present invention provides a real-time storage, processing and query system for big data, which can specify the real-time performance of effective data, and effectively improve the characteristics of high throughput, massive data, fast response to messages, and high availability of data, thereby Improve the comprehensive ability in the big data real-time data business system. Such as figure 1 As shown in the system composition block diagram, the big data real-time storage, processing and query system of the present invention includes a distributed support module, a data collection module, a message middleware module, a data cleaning module, a data processing module, a data depth mining module, and a data manag...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A big data real-time storage, processing and querying system includes a distributed support module, a data acquisition module, a message-oriented middleware module, a data cleaning module, a data processing module, a data deep mining module, a data management module, a data querying module, and a system scheduling module; all the modules run under the coordination of the system scheduling module, and scheduling and circulation of data flows among all the modules can be achieved Processing flows among all the modules can be coordinated, and the date real-time performance is improved; effective improvement is performed for high throughput, mass data, fast response messages and data high availability; and then the comprehensive ability of a big data real-time data service system can be improved.

Description

technical field [0001] The invention relates to data processing inside a computer, in particular to a large data real-time storage, real-time processing analysis, and real-time query system. Background technique [0002] In recent years, with the rapid development and popularization of computer and information technology, the scale of industrial application systems has expanded rapidly, and the data generated by industrial applications has grown explosively. Industry / enterprise big data that can easily reach hundreds of TB or even tens to hundreds of PB has far exceeded the real-time processing, storage and query capabilities of existing traditional computing technologies and information systems. Therefore, seeking effective big data in Methods and means such as processing technology, storage, and query in real-time data have become an urgent need in the real world. [0003] The files that need to be stored in the traditional storage system will increase exponentially, whic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
Inventor 任广坤马亚中张岳徐玉阳赵雷马小川
Owner BEIJING ZHONGHAI INVESTMENT MANAGEMENT CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap