SSH protocol text data collection method, collector and computer equipment
A technology of text data and collection methods, applied in the field of communication, can solve problems such as unacceptability of enterprises
Active Publication Date: 2021-07-09
SHENZHEN TIANYUAN DIC INFORMATION TECH CO LTD
View PDF5 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
Existing collectors, such as flume, logstash, etc., although powerful, stable and scalable, none of them can collect data without the cooperation of the target machine.
[0004] As the core component of the log platform, the collector has many mature products, but most of these products are realized by installing the agent program on the target machine, but in the production environment, enterprises generally cannot accept this method, so It is necessary to develop a collector that uses a common protocol for remote collection
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0032] see figure 1 , which is a schematic diagram of the collection process of a preferred embodiment of the SSH protocol text data collector of the present invention. A plurality of collectors 1 of the present invention can be deployed on a collector deployment server 2 at the same time, and the collectors 1 and corresponding target machines 3 are respectively communicated and connected, and the collector 1 is used to collect text data from the target machine 3, such as the target machine 3 All kinds of log source files on the network, and then the collector 1 sends the data to the message middleware 4. Using the collector 1 of the present invention, there is no need to install additional programs (except the SSH protocol) on the target machine 3, and the text data on the target machine 3 can be collected remotely through the SSH protocol, and the collected data is collected by the collector 1 according to corresponding rules. , perform structured processing, and store in m...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The invention relates to an SSH protocol text data collection method, a collector and computer equipment. The method comprises: step 10, SSH resource pool management to read the required connection resources of the log source file; step 20, at least one reading component competes for the connection resource to read the log source file, if the SSH resource pool does not If the connection resource is idle, the reading component will wait until other reading components release the connection resource; step 30, the reading component stores the read log source file data in the shared memory; step 40, the parsing component reads from the shared memory Read the log source file data and perform structured analysis according to the rules, and then save the obtained structured data into the shared memory; step 50, pack and send the structured data obtained from the shared memory by packaging and compressing the component, and then Sent to message middleware. The invention remotely collects the text data on the target machine through the SSH protocol, without installing additional programs on the target machine.
Description
technical field [0001] The invention relates to the communication field, in particular to an SSH protocol text data collection method, a collector and computer equipment. Background technique [0002] With the increasing informatization of enterprises, faced with a large number of logs (device logs, system logs, application logs, etc.) As an important topic, it is imperative to establish a unified log platform that meets the capabilities of unified log storage, unified query, unified analysis, data sharing, intelligent early warning, audit dispatch, and operation evaluation and analysis to form evaluation reports. [0003] In the prior art, collectors are generally used to collect various logs. Existing collectors, such as flume and logstash, are powerful, stable and scalable, but none of them can collect data without the cooperation of the target machine. [0004] As the core component of the log platform, the collector has many mature products, but most of these products...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): H04L29/06
CPCH04L63/168
Inventor 邓少宝傅斌黄林峰廖磊
Owner SHENZHEN TIANYUAN DIC INFORMATION TECH CO LTD