Online elastic expansion method for multi-source heterogeneous data access channel based on container technology

A multi-source heterogeneous data and data channel technology, which is applied in the field of online elastic expansion of multi-source heterogeneous data access channels based on container technology, can solve single channel blocking and insufficient expansion capability to meet multi-source heterogeneous data transmission, etc. It can solve the problem of low operation efficiency, improve maintainability and scalability, and improve resource adaptability.

Pending Publication Date: 2021-10-08
ZHONGSHAN POWER SUPPLY BUREAU OF GUANGDONG POWER GRID
View PDF8 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Data producers continue to increase the pressure this brings to data consumers. The traditional single channel has shown congestion in actual work, and its expansion capability is not enough to meet the transmission of multi-source heterogeneous data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Online elastic expansion method for multi-source heterogeneous data access channel based on container technology
  • Online elastic expansion method for multi-source heterogeneous data access channel based on container technology
  • Online elastic expansion method for multi-source heterogeneous data access channel based on container technology

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described below in conjunction with the specific embodiments in the accompanying drawings.

[0028] refer to Figure 2-4 , an online elastic expansion method for multi-source heterogeneous data access channels based on container technology, including:

[0029] Establish multiple data channels according to different data types;

[0030] Use the container virtualization layer to create independent containers for each data channel through Docker, that is, microservices. Each container is connected and interacted through the communication mode between Docker containers to achieve the purpose of high cohesion and low coupling. The container virtualization layer is convenient for different Deploying an independent data transmission channel solution in the scenario, the module decomposition of the container virtualization layer is as follows image 3 shown;

[0031] Manage containers through container orchestration and visualized manage...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an online elastic expansion method for a multi-source heterogeneous data access channel based on a container technology, relates to the technical field of communication, and solves the technical problem of insufficient expansion capability of a traditional data channel. The method comprises the following steps: establishing a plurality of data channels according to different data types; creating independent containers for each data channel through Docker by utilizing a container virtualization layer, and connecting and interacting the containers through a communication mode between Docker containers; managing the containers through a container arrangement and visualization management layer; arranging a data channel distribution module, and distributing data collected by the data terminal to different data channels through the data channel distribution module; enabling each data channel to upload the data to a redis cluster data cache layer; and enabling the redis cluster data cache layer to store the data in an Hbase database. According to the invention, independent containers are created for each data transmission channel by adopting a Docker container technology, so that the multi-source heterogeneous data transmission and acquisition have better maintainability and expandability.

Description

technical field [0001] The present invention relates to the technical field of communication, and more specifically, relates to an online elastic expansion method of multi-source heterogeneous data access channels based on container technology. Background technique [0002] There are many sources of data on the electrical work site, such as audio and video data, electrical data, GIS data and other structured and unstructured data. The premise of establishing an intelligent management and control platform for electric power operation sites is to develop a multi-source heterogeneous data hybrid acquisition system. The mixed data acquisition system of the electric power operation site has begun to develop in the direction of large-scale, massive data and intelligence. Traditional stand-alone-based processing platforms are increasingly difficult to cope with the transmission and calculation of today's massive multi-source heterogeneous data. Building a distributed computing sy...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F9/455G06F16/2455G06F16/2458
CPCG06F9/45558G06F16/24552G06F16/2471
Inventor 刘文韬李华罗其锋张春梅谭伟王天师谭莹莹包达志魏俊锋黄国柱
Owner ZHONGSHAN POWER SUPPLY BUREAU OF GUANGDONG POWER GRID
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap