Message traffic control method and device and related system

A flow control and message technology, applied in transmission systems, digital transmission systems, data exchange networks, etc., can solve problems such as high message discarding, system instability, and idle computing resources, and achieve high control accuracy and reduce message discarding , Improve the effect of stability and processing efficiency

Active Publication Date: 2017-07-04
ALIBABA GRP HLDG LTD
View PDF5 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The above flow control strategy has serious drawbacks in practical applications; for example, if the above flow control value is configured too high, the amount of message discards is too high, which will still cause system instability, but when the flow control value is configured too low, It will also cause idle computing resources

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Message traffic control method and device and related system
  • Message traffic control method and device and related system
  • Message traffic control method and device and related system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0053] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with the present invention. Rather, they are merely examples of apparatus and methods consistent with some aspects of the invention as recited in the appended claims.

[0054] First, the embodiments of the message flow control method provided by the present application will be described. The method can be applied to any pipelined data processing system including a data source and multiple processing nodes, such as real-time computing systems such as Storm, Jstorm, Sparkstreaming, etc., to adjust the message flow between each node in the pipeline, realize the data sou...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The application discloses a message traffic control method and device and a related system. A message receiving quantity of each processing node is sampled, once an actual message receiving quantity of a certain processing node is not in a corresponding preset traffic threshold interval, a corresponding traffic control request is generated, and according to the traffic control request, a message sending rate of an upstream data node corresponding to the processing node is regulated, so that dynamic control on message traffic between any two adjacent upstream and downstream data nodes is implemented. With respect to a mode of regulating a message sending rate of a data source only according to an unprocessed message number of the last processing node in the prior art, according to the application, control accuracy is higher, and any one processing node cannot generate a message overstocked or idle phenomenon, so that a message dropping quantity can be reduced, and stability and processing efficiency of an integral data processing system are improved.

Description

technical field [0001] The present invention relates to the technical field of distributed real-time computing, in particular to a message flow control method, device and related system. Background technique [0002] Most of the existing data processing systems use pipeline processing methods, such as figure 1 As shown in the topology diagram, after the message is sent from the data source S, it gradually flows downstream according to the logical relationship between each processing node; the total number of processing nodes and the number of nodes on each pipeline are determined according to the actual data processing logic. figure 1 Taking only three processing nodes of A, B and C as an example, the arrows indicate the message flow direction. [0003] Under normal circumstances, the message sending rate of the upstream data source or processing node should match the message processing rate of the adjacent downstream processing node; if the upstream node has a peak message...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): H04L12/825
CPCH04L47/263
Inventor 刘键封仲淹方孝健王逸伍翀
Owner ALIBABA GRP HLDG LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap