High-performance network log message distribution method for supporting target cluster dynamic detection

A message distribution, high-performance technology, applied in the field of network management, can solve the problems of memory resource consumption, log message distribution failure, etc., and achieve the effect of reducing the impact

Active Publication Date: 2019-04-26
BEIJING TIANYUAN TETONG SCI & TECH CO LTD
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The existing technology mainly adopts the scheme that the message distribution nodes independently complete the state detection of the receiving host. However, when dealing with cross-regional message distribution, the same distribution node or multiple distribution nodes in different regions send messages to the same receiving host cluster. In some cases, if the distribution nodes make inconsistent judgments on the state of a receiving ho

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • High-performance network log message distribution method for supporting target cluster dynamic detection
  • High-performance network log message distribution method for supporting target cluster dynamic detection

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0029] In this embodiment, Zookeeper is selected as the distribution management center.

[0030]Step 1. The detection node detects the receiving host in the area, obtains the status information of the receiving host, and compares the status information with the historical status data of the receiving host stored locally to judge the status of the receiving host at this time. The state includes: active state, failure state and recovery state. If the current state of the receiving host is consistent with its historical data, the current state information of the receiving host will be sent to Zookeeper immediately; if the current state of the receiving host is invalid, the The current state information of the receiving host, that is, the invalid state, is sent to Zookeeper; if the current state of the receiving host is active, but its historical data is invalid, the state of the receiving host is considered to be in the recovery state, and the sending of the state information of t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a high-performance network log message distribution method for supporting target cluster dynamic detection. By adopting a keep-alive dynamic detection strategy of distributed detection and unified state release, consistency of receiving host status on each distribution node can be ensued, and at the same time, weighted load balancing is used in the log message distribution process to avoid a large amount of memory access. By adopting methods such as distributed dynamic detection and unified state distribution, the activity of the receiving host is ensured. The weighted load balancing algorithm is used to distribute the network log messages more evenly to the receiving host in the cluster environment. At the same time, the method of determining the ports of the receiving host packet by packet by hash values of the quintuple (source address, destination address, source port, destination port, and protocol) included in the session packet calculated by using the hashfunction effectively reduces the impact of the failure of the receiving host.

Description

technical field [0001] The invention belongs to the field of network management, and in particular relates to a high-performance network log message distribution method supporting dynamic detection of target clusters. Background technique [0002] The original meaning of session (Session) refers to a series of actions / messages from beginning to end. When a session is associated with a network protocol, it also includes two meanings of "connection-oriented" and "state-keeping". Network devices or software will generate session logs according to actual business needs. With the rapid development of network technology, it has become an important content of current research to process network traffic with high performance in real time and aggregate and distribute the generated log messages of the same session to the same specific cluster, especially in many applied research fields. . For example: network monitoring, e-commerce and other important fields. In the process of proc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): H04L12/24H04L29/08
CPCH04L41/0823H04L41/0893H04L67/1004H04L67/1097
Inventor 李少敏王凯峰许云飞王志飞魏川鸿明树新贾夺元
Owner BEIJING TIANYUAN TETONG SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap