Data cluster management system based on quasi-realtime platform

A technology of data clustering and management system, applied in electrical digital data processing, special data processing applications, instruments, etc., can solve the problem of unsuitable data storage, real-time data writing, slow access and archiving, and relational libraries that do not support historical data Compression etc.

Active Publication Date: 2012-07-25
ELECTRIC POWER RES INST OF GUANGDONG POWER GRID
View PDF2 Cites 54 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0010] Although the relational database has no limit on the scale of measurement points, the writing, accessing and archiving speed of real-time data is slow, especially the writing speed will be a big bottleneck. At the same time, the relational database does not support direct compression of historical data. Not suitable for storing data with massive historical data storage and frequent access requirements

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data cluster management system based on quasi-realtime platform
  • Data cluster management system based on quasi-realtime platform
  • Data cluster management system based on quasi-realtime platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] In the method of the present invention, multiple real-time databases and even relational databases are jointly deployed to form a logical database—cluster database, such as figure 1 shown.

[0033] Encapsulate the database measurement points distributed on different node servers and the management and maintenance of the database, establish a mapping with the database measurement points on each node through the global measurement point metadata, and provide a unified and transparent data access service to the outside world to meet the massive real-time platform Centralized storage and sharing of data.

[0034] Such as figure 2 As shown, the data cluster management system based on the quasi-real-time platform of the method includes a storage carrier layer and a cluster data access middleware; the storage carrier layer is a cluster database composed of several database servers, and each database server is used as a child node, and the cluster database The access middlew...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a data cluster management system based on a quasi-realtime platform, which comprise a storage carrier layer and a cluster database access middleware. The storage carrier layer is a cluster database composed of a plurality of child nodes and each child node is a physical database server. The clustering database access middleware comprises a cluster management module, a communication management module, an execution engine module and a connection management module. By combining a plurality of real-time databases and relational databases to form the cluster database, uniform access interfaces are provided for external users, transparent access interfaces to measuring point positions are realized, uniform and transparent data access service is provided for the external users, centralized storage and share of massive data of the quasi-realtime platform are satisfied.

Description

technical field [0001] The invention relates to a real-time data processing method, in particular to a data cluster management system based on a quasi-real-time platform. Background technique [0002] With the continuous development of electric power informatization, the pilot construction of smart grid has been gradually carried out, which has produced a large amount of real-time and quasi-real-time data closely related to the company's production and operation, and then precipitated into a large amount of historical data. Real-time data such as power at the gate, protection, and lightning together form a massive amount of data. These data are the company's precious wealth and the basis for lean management. At the same time, with the further development of the smart grid and the continuous deepening of new business applications, units at all levels and business departments have put forward higher requirements for the centralized storage and access of massive quasi-real-time...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
Inventor 陈炯聪齐志刚杜旭颜璟仪甘杉陈达峰萧展辉林跃晓刘爱生
Owner ELECTRIC POWER RES INST OF GUANGDONG POWER GRID
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products