Real-time big data calculation and storage method and system

A real-time computing and big data technology, applied in database management system, computing, electronic digital data processing, etc., can solve the problems of wide source of geographic information data, difficult fast calculation and storage, complex structure, etc.

Active Publication Date: 2019-10-25
武汉中地数码科技有限公司
View PDF8 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, real-time data in the context of big data faces the problems of huge traffic, extremely fast flow, and difficulty in fast calculation and storage.
Geographic information data has a wide range of sources and complex structures, and traditional big data computing methods are also limited by disk read and write performance and network performance constraints, and are not efficient in querying, computing, and storing real-time data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Real-time big data calculation and storage method and system
  • Real-time big data calculation and storage method and system
  • Real-time big data calculation and storage method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0048] In the following text, many aspects of the invention will be better understood with reference to the accompanying drawings. Components in the figures are not necessarily drawn to scale. Instead, emphasis is placed on clearly illustrating the components of the invention. Furthermore, like reference numerals indicate corresponding parts throughout the several views of the drawings.

[0049] As used herein, the word "exemplary" or "illustrative" means serving as an example, instance, or illustration. Any implementation described herein as "exemplary" or "illustrative" is not necessa...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of real-time big data, in particular to a real-time big data calculation and storage method and system, which are characterized by comprising the followingsteps of: S1, extracting multi-source heterogeneous data through a data conversion module, converting the multi-source heterogeneous data into data with a unified format, and sending the processed data to an input control module; S2, enabling an input control module to perform aggregation, centralization and caching on the input data, perform a series of processing such as interception, monitoring and scheduling, and forward the data to the real-time computing module in batches; S3, dividing a real-time calculation module to space filtering calculation and space mapping calculation, and sending a calculation result to the streaming data service module after calculation is completed; and S4, providing a real-time data service and a historical data service through a streaming data service module. According to the invention, the multi-source heterogeneous real-time big data can be processed more efficiently.

Description

technical field [0001] The invention relates to the technical field of real-time big data, in particular to a real-time big data calculation and storage method and system thereof. Background technique [0002] With the gradual development of my country's geographic information services from specialization to popularization, the data generated by it is growing explosively, so the requirements for query, analysis and storage of real-time geographic information data are also getting higher and higher. Real-time data refers to the data collected in real time from the process control system, the data sent to the process control system in real time, and the intermediate data directly generated by various real-time calculations on the real-time data. Real-time data comes from a wide range of sources, such as data obtained from various types of sensors in the Internet of Things, location information data, feature information data, news RSS data, logs, etc. The calculation of real-t...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/25G06F16/2458G06F16/27
CPCG06F16/2471G06F16/254G06F16/27
Inventor 吴信才吴亮万波黄颖黄胜辉黄波陈小佩尹培培
Owner 武汉中地数码科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap