Log routing load balancing implementation method and device

A technology of load balancing and implementation method, which is applied in the field of data processing and can solve problems such as load imbalance

Pending Publication Date: 2020-10-20
INDUSTRIAL AND COMMERCIAL BANK OF CHINA
View PDF6 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In order to solve the load imbalance problem in the log storage system, the pre

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Log routing load balancing implementation method and device
  • Log routing load balancing implementation method and device
  • Log routing load balancing implementation method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0050] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

[0051] By automatically adjusting the cluster where the application log is located according to the cluster load, the cluster can be fully utilized to a certain extent, but because it is calculated based on the old data of the previous day, it cannot be adjusted in real time to achieve the optimal situation of the day.

[0052] In this context, how to provide an automatic log routing load balancing method, which can be adjusted in the smallest possible range ac...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a log routing load balancing implementation method and a device. The method comprises the steps of obtaining cluster resource use condition monitoring data of a log storage layer of a cloud platform log storage system; performing load balancing processing according to the use condition monitoring data and a preset storage threshold, and determining updated routing configuration information; and processing a log file of the cloud platform log storage system according to the updated routing configuration information. According to the method, different applications are automatically distributed to the basis of different storage layer clusters in a balanced manner according to the early log data volume of each application and the storage condition of each cluster of thecurrent storage layer, a deployment container does not need to be manually reconfigured, automatic configuration updating is realized, and the configuration workload of operation and maintenance personnel is greatly reduced. Load balance adjustment of clusters of a storage layer and a buffer layer can be completed in a self-adaptive mode, and intelligent distribution of log storage clusters is achieved. Therefore, each cluster is efficiently utilized, and unnecessary resource waste is reduced.

Description

technical field [0001] The invention relates to data processing technology, in particular to a log routing load balancing implementation method and device. Background technique [0002] With the increase of connected applications and the large-scale promotion of service work, the amount of container log data on the cloud is increasing. In order to facilitate data analysis and mining, centralized collection and storage of log data becomes the only choice. Centralized storage will also bring some urgent problems to be solved, such as how to balance the distribution of log storage, etc. The collection and storage of logs has become a new topic. [0003] The common centralized container log storage architecture in the industry mainly includes four parts: log collection layer, log buffer layer, log consumption layer and log storage layer. Among them, the log consumption layer consumes and parses the data of multiple log buffer layer clusters, and writes them into the log storag...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F3/06G06F11/30
CPCG06F3/0608G06F3/0605G06F3/0635G06F3/0653G06F3/067G06F11/3006G06F11/3093G06F11/3096G06F11/3065
Inventor 齐颀任政武文轩白佳乐
Owner INDUSTRIAL AND COMMERCIAL BANK OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap