Log collection method, device, system, medium and electronic equipment
A collection system and collection method technology, applied in the field of log processing, can solve problems such as unfavorable log collection system expansion and high pressure on master node management, and achieve the effects of improving log collection efficiency, reducing processing pressure, and achieving flexibility and usability
Active Publication Date: 2021-08-10
深圳视界云天科技有限公司
View PDF0 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
With the expansion of business, there will be more and more edge nodes, and the management pressure of the master node will increase, which is not conducive to the expansion of the log collection system
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0052] The specific embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. It should be understood that the specific embodiments described herein are only used to illustrate and explain the present disclosure, but not to limit the present disclosure.
[0053] The present disclosure provides a log collection system, wherein the log collection system includes a main node, a plurality of middle layer nodes corresponding to the main node, and a plurality of edge nodes corresponding to each middle layer node. Among them, the edge node refers to the node device in the log collection system that is closer to the log collection requester; each middle-layer node is located in different areas, and multiple edge nodes corresponding to each middle-layer node are located in the middle-layer node. In the area to which it belongs, that is, the multiple edge nodes corresponding to each intermediate layer node and the intermediate l...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present disclosure relates to a log collection method, device, system, medium and electronic equipment. The method includes: in response to receiving the log collection instruction, determining the log source of the log to be collected and the area where the log source is located; determining the target intermediate layer node from multiple intermediate layer nodes according to the area where the log source is located; sending the log collection instruction to to the target intermediate layer node, so that the target intermediate layer node determines the target edge node for collecting logs to be collected from the log source from the multiple edge nodes corresponding thereto. In this way, each intermediate layer node can manage the edge nodes in its own area, reduce the processing pressure of the master node, facilitate the expansion of the log collection system, and realize the flexibility and availability of the system. In addition, you can select the target edge node that is closer to the area where the log source is located to improve the efficiency of log collection, ensure that the logs to be collected can be collected in time, and effectively reduce network bandwidth consumption.
Description
technical field [0001] The present disclosure relates to the technical field of log processing, and in particular, to a log collection method, apparatus, system, medium and electronic device. Background technique [0002] The current log collection system usually adopts a master-slave structure, that is, the system includes a master node and a plurality of edge nodes correspondingly connected to the master node. Among them, the master node is used to allocate an edge node for collecting logs for each user, and when the allocated edge node resources are insufficient, another edge node with sufficient resources is allocated to the user, and at the same time, the health of each edge node is monitored. Status; edge nodes are used to collect logs corresponding to user requests, and perform operations such as merging / splitting, statistics, analysis, and multi-format conversion of logs, and then output the processed logs to the output directory. Interface to the output directory t...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F11/34G06F11/30G06F9/50
CPCG06F9/505G06F9/5083G06F11/3006G06F11/3476
Inventor 满运历
Owner 深圳视界云天科技有限公司