Massive data storage method and system of power utilization information collecting system

A collection system and massive data technology, applied in transmission systems, digital transmission systems, data exchange networks, etc., can solve problems such as network bottlenecks, achieve good scalability, avoid data hotspots, and lower deployment costs

Inactive Publication Date: 2015-01-28
XUJI GRP +3
View PDF4 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a massive data storage method and system for the electricity consumption information collection system, so as to solve the network bottleneck problem in the storage process of the existing electricity consumption information collection system

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Massive data storage method and system of power utilization information collecting system
  • Massive data storage method and system of power utilization information collecting system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0029] The specific embodiments of the present invention will be further described below in conjunction with the accompanying drawings.

[0030] An embodiment of a massive data storage method for an electricity consumption information collection system of the present invention

[0031] The present invention configures a monitoring client on each storage sub-node, and transmits the CPU load of the node, the margin of the system memory, the flow of the network, the number of currently established connections and other related operating load information to the scheduling and management in real time. Nodes, through the allocation of scheduling and management nodes, a node in the front-end processor cluster directly establishes a communication link with a storage sub-node for data transmission and storage, and the data flow does not pass through the scheduling and management nodes. The procedure of this method is as follows figure 2 As shown, the specific steps are as follows:

...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a massive data storage method and system of a power utilization information collecting system, and belongs to the technical field of power utilization information collecting data storage. Each storage subnode is provided with a monitoring client side, CPU loads of the nodes, system internal storage margins, network flow, current established linking numbers and other related running load information are transmitted to a dispatching and managing node in real time, a communication link is directly established between one node in a front-end processor cluster and one storage subnode through the allocation of the dispatching and managing node to carry out data transmission and storage, and the data flow does not pass through the dispatching and managing node. A communication network used for data storage and composed of a plurality of point-to-point communication links can be established through reasonable dispatching, data hot spots can be effectively avoided, the network transmission resource of the system is utilized to the maximum degree, and a distributed type storage subnode cluster is low in cost and high in expansibility.

Description

technical field [0001] The invention relates to a massive data storage method and system for an electricity consumption information collection system, and belongs to the technical field of electricity consumption information collection data storage. Background technique [0002] In the warehousing process of the existing power consumption information collection system, its data flow is mainly as follows: First, the front-end processor obtains the original collected data through communication with the terminal and performs corresponding protocol analysis to generate data that can be warehoused files; then, a data collection service node establishes a socket connection with the front-end computer cluster to collect these data files. Finally, according to different storage schemes (centralized storage or distributed database), the data collection service node forwards the data file to a database server or multiple data storage sub-nodes. [0003] With the expansion of the cons...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08H04L12/24
CPCH04L67/1097H04L67/1074
Inventor 雷鸣周逢权徐大青张展国谢学征王林贺彪
Owner XUJI GRP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products