A container-based data receiving and parsing method

Abstract

The invention discloses a container-based data receiving and parsing method, which includes: providing a standard container image, which packs basic components required for data receiving and parsing service operation; Automatically make a container image and push it to the central library; automatically deploy the container image through the automated deployment platform; monitor the flow and number of connections of each data receiving and parsing service, generate the average data per minute of the flow and number of connections and The average data is put into the message queue; the data in the message queue is received by the monitoring service and the number of containers is adjusted according to the size of the received data. The present invention can realize automatic deployment of services and automatic expansion and contraction of containers based on monitoring data, thereby realizing automatic management of data reception and analysis.

Description

technical field [0001] The invention relates to the technical field of data receiving and parsing, in particular to a container-based data receiving and parsing method. Background technique [0002] At present, the receiving and parsing of data from various networked devices is not based on containerization, and operations such as business deployment, capacity expansion, and capacity reduction are generally performed manually. However, the existing manual operation method is easy to cause deployment errors, and cannot expand in time when the data traffic increases, and cannot shrink in time after the data traffic decreases, which is not conducive to data reception and analysis processing. Contents of the invention [0003] Aiming at the deficiencies in the above-mentioned prior art, the present invention provides a container-based data receiving and parsing method, which realizes automatic deployment of services and realizes automatic expansion and contraction of container...

AI Technical Summary

Problems solved by technology

[0002] At present, the receiving and parsing of data from various networked devices is not based on containerization, and operations such as business deployment, capacity expansion and contraction are generally performed manually

However, the existing manual operation method is easy to cause deployment errors, and cannot expand in time when the data traffic increases, and cannot shrink in time after the data traffic decreases, which is not conducive to data reception and analysis processing

Images