Traffic statistics method, device and system and storage medium

Abstract

The embodiment of the invention discloses a flow statistics method, device and system and a storage medium. According to the method, an annular queue storage structure is used for recording flow data;sequentially storing the collected data traffic in a queue element in a circular queue in a circular queue storage structure every time; due to the fact that the queue is the annular queue, the starting pointer and the ending pointer are further arranged to indicate the queue head and the queue tail where the data flow of the current statistical period is stored, and when the current statisticalperiod is finished, the total flow of the current statistical period can be obtained by accumulating the data flow recorded by all queue elements between the queue head and the queue tail. According to the embodiment of the invention, the flow statistics method is used, the problem of counter zero clearing does not exist, jittering of sudden data volume expansion does not occur easily, and the data flow in a certain statistics period can be recorded more completely and accurately. In addition, the annular queue does not need to be initialized for multiple times, can be repeatedly used and is very high in utilization rate.

Description

technical field [0001] The invention relates to the field of flow control, in particular to a flow statistics method, device, system and storage medium. Background technique [0002] In a distributed system, in order to make reasonable use of the IO resources of the entire system, IO flow control is performed in many scenarios, so current limiting technology has become a key technology for distributed system resource management. The smoothness, real-time performance of current limiting, and read and write performance after current limiting are key indicators for measuring current limiting technology. Among them, flow statistics are the data foundation and decision-making basis of current limiting technology. How to record flow data accurately and in real time to complete flow statistics has also become an important factor affecting the effect of current limiting technology. [0003] At present, in order to perform more accurate current limiting, a flow counter method is usu...

AI Technical Summary

Problems solved by technology

However, in a statistical cycle, the counter may clear the cache, but no data is received during the clearing process, and the data generated during the clearing process may be accumulated during the re-counting, resulting in a sudden increase in traffic. But this sudden increase is due to data squeeze, not a sudden increase in real traffic

These various defects caused by the inconsistency between the counter clearing frequency and the statistical period will cause the traffic data to jitter, making it impossible to collect real-time and accurate traffic statistics, and cannot take real-time and accurate current limiting measures, which will affect the system resources to a certain extent. use efficiently

Images