Adaptive optimization operation method of large-scale data distribution system

Abstract

The invention discloses an adaptive optimization operation method of a large-scale data distribution system, and aims at providing a stable operation optimization method of the large-scale data distribution system. The technical scheme is as follows: firstly establishing an adaptive optimization system of the large-scale data distribution system, deploying a data distribution subsystem and a monitoring proxy on an edge node, and deploying a data collector and the adaptive optimization system on a central computing node; generating optimization strategies via a resource allocation module, a performance threshold module and an optimization strategy generation module of the adaptive optimization system to form an optimization strategy library; and obtaining the optimization strategy from the optimization strategy library by the data distribution subsystem on any edge node, and implementing optimization on the current edge node by adopting the optimization strategy. By adoption of the adaptive optimization operation method disclosed by the invention, fault optimization strategies of the large-scale data distribution system can be generated, and the majority of faults can be automatically restored by adopting the corresponding optimization strategies according to an operation state, so that the large-scale data distribution system operates stably.

Description

technical field [0001] The invention relates to the field of distributed software system optimization, in particular to a real-time optimization method for large-scale data distribution systems. Background technique [0002] The development of network technology has provided the source power for large-scale distribution-oriented applications, expanding computing technology to the entire space of human existence and living, networking the physical world, and realizing the deep integration of physical space and cyberspace are the future development of the network. important trends. The large-scale data distribution system is a product of the development of the Internet. The large-scale data distribution system is a large-scale system distributed on server nodes in different geographical locations, providing services for a large number of end users. According to statistics, in 2020, there will be hundreds of billions of diversified terminals connected to the Internet system; i...

AI Technical Summary

Problems solved by technology

These technologies can guarantee the stability of the system to a certain extent. However, it is difficult to implement these technologies on large-scale and high-real-time systems. For example, disaster recovery and backup of huge data requires high resource costs. Hot backups don't optimize when the server gets slow, etc.

Images