Large data management system

A management system and big data technology, which is applied in the field of massive data element management and processing, can solve the problem that the response speed of the data point capacity system cannot meet the requirements, etc.

Inactive Publication Date: 2014-03-05
STATE GRID CORP OF CHINA +1
View PDF6 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Existing technology cannot meet the requirements

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Large data management system
  • Large data management system
  • Large data management system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0018] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0019] The inventor found through research that although the distributed processing architecture has great flexibility and the advantages of reducing system hardware costs, there are common problems such as data version inconsistency, difficult data backup, sensitivity to viruses, and complex data management. The distributed high-availability cluster architecture using a compromise processing method can effectively solve the respective shortcomings of centralization and decentralization, and balance the advantages of each to solve the problem of distributed data processing.

[0020] Real-time database (RTDB-Real T...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a large data management system which adopts a distribution type framework. The system comprises a local data server and a principal data server, wherein the local data server provides a local clustered database which constitutes a high-availability cluster by means of two machines and a disk array; the principal data server provides cluster proxy service which is data access proxy service of the local clustered database. Preferably, the large data management system further comprises one or more clients which are suitable for determining whether the one or more clients have the authority to have access to a target data point by having access to the cluster proxy service, obtaining position information of the local clustered database where the target data point belongs to, and directly having access to the local clustered database corresponding to the position information. The large data management system solves the problem of super-large-scale data management capacity of a system by means of the distribution type high-availability cluster framework, and solves the problem of high-frequency data sampling and processing capacity by the adoption of a local real-time database.

Description

technical field [0001] The invention relates to the field of massive data element management and processing, in particular to a big data management system. Background technique [0002] Big data, or huge amount of data, refers to the amount of data involved is so large that it cannot be captured, managed, processed, and organized within a reasonable time through current mainstream software tools to help enterprises operate Information for more active purposes in decision-making. [0003] The rapid development of cloud computing technology puts forward higher requirements for big data management, especially for data centers in the production field. The data volume has exceeded 100 million points, and a large part of the storage volume is real-time and quasi-real-time production process data. . [0004] Existing technologies fall short in terms of data point capacity and system responsiveness. Contents of the invention [0005] The technical problem to be solved by the pr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F3/067G06F16/284
Inventor 喻宜吕志来齐国印张东王云鹏刘永银张学深李海
Owner STATE GRID CORP OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap