172 results about "Token bucket" patented technology

The invention discloses a decentralized multi-agent information interaction method and system, and the method comprises the steps: generating a subtask carrying a unique identifier and metadata based on mixed dimension task decomposition, and embedding a global utility function; sub-task-agent mapping is dynamically adjusted through Kafka and Flink, and a utility function weight coefficient is broadcasted; the sub-agent determines an executor through contract network protocol bidding, and performs execution permission arbitration on key resources in combination with a token bucket algorithm; metadata are transmitted by adopting a Gossip protocol, and intermediate data are transmitted by P2P direct connection (abnormal degradation to Kafka); key metadata are synchronized through lightweight Raft consensus, and non-key metadata are merged by adopting CRDT; and after a final result is written in through Kafka, duplicate removal, sorting and aggregation are carried out through Flink, and key states are synchronized through Gossip. According to the method, the problem of message disorder under a hybrid protocol is solved; and high-reliability message transmission and state synchronization are realized by combining the strong consistency bottom of Kafka and the conflict resolution of lightweight Raft and CRDT.

The invention provides a gateway data transmission control method and system based on an improved token bucket method. According to the method, a traditional token bucket flow limiting method is improved by introducing a parameter self-optimization mechanism, a burst flow self-adaptive adjustment mechanism and a multi-node cooperative control mechanism. The method comprises the following steps: firstly, generating tokens according to a specified frequency and distributing the tokens to token buckets, and requesting to perform access control according to token acquisition conditions by a client; dividing the data into a plurality of independent data groups, queuing and processing the data groups in corresponding token buckets, and solving the optimal token bucket capacity and issuing rate to minimize data processing delay by analyzing the arrival rate and queuing probability of data packets; when a single-channel or group-level burst traffic event is detected, the token bucket rate and capacity are automatically adjusted to achieve traffic limiting adaptation and cooperative stabilization. According to the invention, system load balance and rate convergence can be maintained under a high concurrency condition, time delay and jitter caused by flow fluctuation can be substantially reduced, and continuity of data transmission and gateway scheduling efficiency can be improved.

The invention provides a framework migration method and system for a heterogeneous micro-service architecture, and relates to the technical field of micro-service architecture.The framework migration method comprises the steps that migration priorities are determined through topological sorting based on service calling features, a unified service interface description file is generated, a link tracking probe is injected, and service adaptation layer codes are generated; flow control is carried out in combination with a variation gradient token bucket algorithm, and service fusing and degradation are realized by adopting an exponential backoff algorithm and a sliding time window mechanism. According to the method, the problems of complex service dependence, difficulty in flow regulation and control and the like in heterogeneous architecture migration are solved, the security and stability of framework migration are improved, and the operation and maintenance cost of the system is reduced.

The invention discloses a CAN message priority dynamic arbitration method and system based on event triggering, and the method comprises the steps: obtaining a discrete sampling signal of a CAN node of an engineering vehicle and a state register value of a CAN controller, converting the discrete sampling signal into a working condition data sequence, and obtaining a bus load rate through the state register value; obtaining an event state sequence according to the working condition data sequence; all CAN messages to be sent are constructed into a message data record, and the message data record with event semantics and dynamic priority labels is obtained according to the protocol data unit and the event state sequence; and according to the bus load rate and the event state sequence, sending a message data record with event semantics and dynamic priority annotations by adopting a token bucket mechanism through a three-level priority queue linked with a three-state state machine. According to the invention, the security key message in the system can still be transmitted in time under high load, and the bandwidth occupation and delay jitter caused by the low-priority message are avoided at the same time.

The invention relates to the technical field of computers, and discloses an equipment protocol adaptive analysis and instruction scheduling method for an intelligent central control system, and the method comprises the steps: obtaining an original communication data flow of heterogeneous equipment, and extracting a protocol feature fingerprint to recognize a protocol type; calling a corresponding pluggable protocol parser to generate a standardized instruction object; analyzing instruction semantics and dynamically calculating priorities in combination with a system load; and performing non-blocking scheduling and execution monitoring on the instruction based on a resource token bucket mechanism. The system comprises a data acquisition module, a protocol identification module, a self-adaptive analysis module, a semantic analysis module, a priority calculation module, an instruction sorting module, a token management module, a scheduling execution module, an execution monitoring module and a response generation module. According to the method, through protocol self-learning, dynamic priority quantification and multi-dimensional resource isolation scheduling, the response certainty, expansibility and operation stability of the system in a high-concurrency scene are remarkably improved.

The invention belongs to the technical field of cache prefetching optimization of a firmware layer of a computer storage system, and particularly provides a memory control method, a storage device, a medium and equipment.The instantaneous flow is effectively filtered and persistent hotspot data is accurately recognized through a three-layer structure of combining a first-stage hotspot filtering module with a window cache, a view queue and a protection queue; the second-stage continuous access filtering module dynamically judges a continuous access mode by means of mean-variance statistics of an annular buffer area, and accidental continuous triggering of prefetching is avoided; and the third-stage random access judgment module prohibits invalid prefetching and effectively distinguishes access modes. The pre-fetching bandwidth is limited through the token bucket algorithm, the global priority queue of the skip list is combined, it is ensured that the priority of the write task is higher than that of the pre-fetching task, pre-fetching and foreground I / O resources are isolated, delay jitter control over foreground key I / O can be achieved during full-load pre-fetching, and the problem that delay soaring is caused when pre-fetching preempts the resources is solved.

The invention discloses a traffic shaping scheduling method and device, electronic equipment and a storage medium. The method comprises the following steps: determining a target service type of a first data stream at a first time, and obtaining a second data stream at a second time corresponding to the target service type; the second time is before the first time and comprises flow data of a plurality of time periods; determining flow characteristic data of a third data stream at a third time according to the second data stream; the flow characteristic data is used for describing the flow rate and the burst degree of the third data flow; and determining a control instruction of a token bucket shaper of the flow queue based on the flow characteristic data, and adding a token to the token bucket shaper based on the control instruction to meet the flow transmission of the third data flow. According to the invention, through real-time adjustment of the token bucket parameters, accurate control of network congestion is realized.

A data transmission method and apparatus are disclosed. The data transmission method includes: receiving first configuration information, and configuring a priority, a first prioritized bit rate (PBR), and a first bucket size duration (BSD) of each logical channel in a plurality of logical channels; receiving association indication information and first indication information, where the association indication information indicates at least two first logical channels; determining, based on at least one of the first PBR, the first BSD, or the first indication information, a quantity of tokens in at least one first token bucket corresponding to the at least two first logical channels; and determining, based on the quantity of tokens and a priority of each of the at least two first logical channels, transmission resources corresponding to the at least two first logical channels.

The invention relates to the technical field of information processing, in particular to a document management method and device supporting API integration, equipment and a storage medium. Role permissions to which different users belong are distributed, API access tokens are issued for the users with API calling permissions by using a token bucket algorithm, an API interface is called according to the API access tokens, and the user access permission is called according to the API interface. Interface access can be controlled based on permissions of different user roles, the flexibility and expansibility of the document management system are improved, the document management system adapts to diversified business scenes, a task scheduler is utilized to trigger an API interface according to preset time to pull timing synchronization data from an external system, document events of the external system are monitored in real time based on a message queue, and the user experience is improved. According to a document event, an API interface is triggered to pull real-time synchronization data, timing synchronization and real-time synchronization with external system data are achieved, the integration level of the system is improved, format conversion is conducted on the timing synchronization data or the real-time synchronization data, a document library is updated based on standard format synchronization data, and the reliability of document management is improved.

The present disclosure provides a method for managing allocation of compute resources in a distributed database. Each request on every task is allocated a certain number of tokens when it arrives, such as by using a token bucket algorithm. This initial allocation may be the per-request maximum usage permitted in the system. This request is made to a central quota server in the region to coordinate allocations between tasks. As the task runs, the system evaluates how much of the limit the request is using, and adjusts its limit up or down to keep the quota allocation tight on the actual usage of the request. If there aren't enough tokens to keep the request active, the request can be evicted.

The invention relates to a satellite-borne router software security reconstruction method, aims to solve the problems of transmission monitoring lag, high-delay verification and insufficient isolation, provides an integrity chain verification and firewall double-layer verification cooperation scheme, and is combined with a modular physical isolation design. When the routing module receives the data packet, a hardware write protection lock is activated, unauthorized modification is forbidden, and strategy lock-free update is supported; the platform management module downloads an accumulated verification value in real time, and pays attention to a reconstruction instruction after ground verification; and the program programming module adopts double Bank storage, supports atomization programming and credible verification, and automatically returns a safe version when an exception occurs. Attacks are defended through satellite-ground cooperative double-closed-loop verification (firewall filtering, token bucket current limiting and ground CRC verification), hardware isolation guarantees updating without interrupting routing operation, and intelligent backspacing improves the fault-tolerant capability. The method is suitable for a high-delay and strong-interference satellite-borne routing scene, ensures zero interruption of a reconstruction service during in-orbit maintenance of a transit / overseas satellite, and meets the security requirement of a modern satellite network.

The invention relates to a token-based task scheduling method and system and a medium, and the method comprises the steps: initializing the token capacity of a token bucket and the number of available tokens, and entering a slow start process; when the current round of task is issued, the tasks in the cache queue are issued to an algorithm module for processing based on the number of the available tokens, and the number of the available tokens is updated; before the next round of task is issued, the token capacity is updated, the number of result tokens is determined based on the task processing result returned by the algorithm module, and the number of time tokens is determined based on the dynamic timeout time; and updating the number of the available tokens in the token bucket based on the number of the result tokens, the number of the time tokens and the updated token capacity, so that the task sending rate can be dynamically adjusted, the computing power resource utilization rate is improved, and the fault risk is reduced.

The invention discloses a communication method and electronic equipment, and relates to the technical field of communication, and the method adopts a two-stage QoS control strategy, and combines a bottom layer hierarchical token bucket algorithm with a top layer deficit polling algorithm. And the bottom layer QoS adopts a hierarchical token bucket to realize bandwidth allocation and traffic shaping based on traffic categories. The top layer distributes bandwidth resources by adopting deficit polling on the basis of functions, so that the problem that the waiting time of data packets in transmission queues of other functions is too long due to the fact that large data packet transmission of a certain function occupies more bandwidth in function scheduling can be solved. According to the method, end-to-end QoS guarantee can be realized, and bandwidth requirements of different traffic categories and functions are considered, so that under the scene of cross-domain sharing of PCIe equipment, the hardware resource utilization rate is maximized, fine bandwidth allocation and traffic control are performed, efficient transmission and scheduling are ensured, and bandwidth fluctuation caused by burst cross-domain access is smoothly processed.

The invention relates to the technical field of communication, in particular to a flow fine control method and system.The method comprises the steps that firstly, flow data of a system are collected in real time, the flow data comprise request frequency, response time, CPU utilization rate, memory utilization rate and thread pool utilization rate indexes, and then the token generation rate is dynamically adjusted based on a flow trend analysis result; generating tokens at regular time according to the adjusted rate, storing the tokens in a token bucket, and checking the state of the token bucket when a request is received: if available tokens exist, consuming the tokens and processing the request, otherwise, refusing or delaying the request, and when the system load exceeds a preset threshold value, triggering a fusing mechanism and pausing a non-key request; according to the method, the request number, the response time, the CPU utilization rate, the memory utilization rate and the thread pool utilization rate are collected in real time, and a mechanism for dynamically adjusting the token generation rate is combined, so that the load change of the system can be accurately sensed, and the problem of dynamic response lag is effectively solved.

A novel dynamic bandwidth allocation system and a method of its operation incorporate a quality-of-service (QOS)-based media access control (MAC) layer controller, which is able to dynamically allocate data transmission capacity (i.e. bandwidth) to multiple incoming service flows of data packets for multiple subscribers more efficiently with less network congestions and service inconsistencies than conventional MAC layer management methods. The QoS-based MAC layer controller is able to determine and place incoming service flows into two separate states of token buckets (i.e. conforming or non-conforming), wherein the conforming token bucket utilizes a longer filtering interval (e.g. 1 second) and the non-conforming token bucket utilizes a shorter filtering interval (e.g. 1 ms) for detecting token bucket violations. The QoS-based MAC layer controller is able to utilize either conforming or non-conforming states flexibly and intelligently to minimize unnecessary packet droppages, network congestions, or speed degradations during bursty and oscillating network traffic.

The invention discloses a secure data transmission method based on multi-thread control, and relates to the technical field of network information security, and the method comprises the following steps: extracting a sensitivity identifier from a data packet header, adopting a lookup algorithm to match a preset sensitivity grading table, dividing data into a high-sensitivity type, a medium-sensitivity type and a low-sensitivity type, determining a priority queue distribution proportion according to the sensitivity, obtaining an initial flow shaping parameter, obtaining current network flow data according to the initial flow shaping parameter, analyzing a preset congestion detection threshold value and a historical transmission record, judging a network congestion degree by adopting a token bucket algorithm, and if the congestion degree is higher than the preset congestion detection threshold value, sending the current network flow data to the priority queue; if yes, the token generation rate of the high-sensitivity data is adjusted, and an adjusted traffic shaping strategy is obtained; according to the secure data transmission method based on multi-thread control, the network transmission efficiency can be effectively improved while the data security is ensured, and the method is particularly suitable for a complex network environment in which data with different sensitivities needs to be processed at the same time.

This specification provides a rate limiting method, apparatus, electronic device, and medium for a distributed cluster. The method includes: if at least one token in the token set is greater than 0, calculating a token deviation value; if the token deviation value is less than a first threshold and the condition that all tokens in the token set are greater than or equal to 0 is not met, reducing the token generation rate corresponding to the token bucket rate limiter with tokens greater than the token number threshold, and increasing the token generation rate corresponding to the token bucket rate limiter with tokens less than the token number threshold; if every token in the token set is less than or equal to 0, calculating a rate deviation value based on the generation rate set; if the rate deviation value is greater than or equal to a second threshold, reducing the token generation rate corresponding to the token bucket rate limiter with a token generation rate greater than the token generation rate threshold, and increasing the token generation rate corresponding to the token bucket rate limiter with a token generation rate less than the token generation rate threshold.

The application discloses a kind of solid state disk's multiple NS flow control method, equipment and storage medium.Therein, the method includes: based on token bucket algorithm is configured initial token parameter for each IO path;Multiple NS and multiple IO paths are respectively associated one by one to determine the association between each NS and each IO path;Receiving target NS from host input and the target flow control parameter corresponding to the target NS;According to the association, find the target IO path corresponding to the target NS;The target flow control parameter is configured to the target IO path, and the initial token parameter is updated according to the target flow control parameter to determine target token parameter;Receive the IO service issued by the host;Processing the IO service and according to the target token parameter, the IO service is limited in flow. Through the application, the resource efficiency, performance balance and performance stability of solid state disk in multiple NS scenarios are improved.

The invention relates to the technical field of communication, and discloses a traffic shaping method and device and a storage medium, the traffic shaping device comprises a message receiving module, a plurality of cache units, a message forwarding module and a token management module, and the token management module comprises a token supplementing unit and a token deduction unit. And the token deduction unit is used for determining a corresponding deduction multiplying power coefficient according to the priority of the message to be forwarded when the message forwarding module forwards the message to be forwarded, and deducting a corresponding number of tokens from the token bucket corresponding to the cache unit in which the message to be forwarded is located. According to the invention, the differentiated deduction multiplying power coefficients are set for the messages with different priorities, so that the overall forwarding efficiency and the service quality adaptability of the system in a multi-service complex environment are improved.

The invention discloses an SSD dynamic power consumption management method and device, computer equipment and a storage medium, and relates to the technical field of SSD power consumption management. Determining a total number of tokens of the token bucket based on the power consumption gear; initializing a token bucket based on the total number of tokens; if the host command is received, determining the number of target tokens required by the host command; judging whether the number of the remaining tokens in the token bucket is greater than or equal to the number of the target tokens; if yes, distributing tokens of a target token number to the host command, and executing the host command; and if not, adding the host command to a preset command waiting queue. According to the SSD dynamic power consumption management method, the power consumption upper limit reference is established through power consumption gear setting, and it is ensured that the instantaneous power consumption of the SSD never exceeds the limit. Therefore, limitation of a protocol layer is broken through, a host manufacturer can configure a power consumption threshold according to needs, redundant design and compatibility risks of a power supply module are eliminated, and power consumption self-adaption capability is given to terminal equipment.

This application provides a dynamic bandwidth allocation method, apparatus, and optical line terminal (OLT), relating to the field of passive optical network (PON) technology. The method is applied to an OLT in a PON. The OLT has multiple token bucket queues, each with a priority level. Each token bucket in each queue corresponds to a TCONT (Trusted Token Terminal). The number of tokens in each token bucket indicates the configured bandwidth. The method includes: traversing multiple token bucket queues in descending order of priority during each bandwidth allocation cycle; allocating bandwidth authorization values ​​to the TCONT corresponding to each token bucket based on the number of tokens in each queue, until the remaining bandwidth is empty, or the traversal of multiple token bucket queues is complete; generating a bandwidth mapping using the bandwidth authorization values ​​allocated to each TCONT; and distributing the bandwidth mapping to the ONUs (Optical Units) in the PON. This scheme improves the fairness of dynamic bandwidth allocation.

The invention relates to the technical field of flow control, in particular to a dynamic advertisement frequency control optimization method based on family member multi-dimensional evaluation, which comprises the following steps: acquiring equipment topological characteristics and interaction logs to construct a heterogeneous mapping graph, and identifying family units by utilizing graph representation learning and a community discovery algorithm; by extracting behavior characteristics such as key Shannon entropy, time interval and response jitter, the identities of active members are judged and activated by using a classification model; initializing a dynamic token bucket based on a user activeness index and historical load data, and weighting and calculating a load pressure coefficient in combination with resource saturation and a global residual water level; dynamically adjusting the depth of the token bucket by using a nonlinear negative feedback mapping mechanism so as to adjust the frequency control upper limit in real time; and a data distribution decision is executed in cooperation with a flow interception hook and a dual atomicity verification mechanism. According to the invention, through identity perception and negative feedback adjustment, quota distribution adaptive optimization is realized.

The present application provides a message sending method and apparatus, a message receiving method and apparatus, an electronic device, a computer-readable storage medium, and a computer program product. The message sending and receiving method comprises: on the basis of the maximum data volume of a sub-message corresponding to an application, splitting a message in a message queue corresponding to the application into at least one sub-message, and storing each sub-message to a sub-message queue corresponding to the application; setting a token bucket for each sub-message queue, and according to a token filling rate, adding tokens to the token bucket until the number of tokens in the token bucket reaches the maximum number of tokens that can be accommodated; and polling a sub-message queue corresponding to each application, if the byte length of a queue head sub-message in the sub-message queue is less than or equal to a first number of tokens, dequeuing and sending the queue head sub-message, and taking out a byte length number of tokens from the token bucket corresponding to the sub-message queue, wherein the first number of tokens is the number of tokens in the token bucket corresponding to the sub-message queue.

The present application provides a resource management method and apparatus, and a device. The method comprises: for each resource object comprising at least one resource identification point, acquiring load data of each resource identification point, the load data representing resource usage of the resource identification point; on the basis of the load data of each resource identification point, determining a load level of the resource object; on the basis of the load level, determining an overload control object, the overload control object comprising at least one of: a background task of the resource object, a foreground service object of the resource object, and a token bucket object for backpressuring host IO; and controlling resources occupied by the overload control object. By means of the technical solution of the present application, a current load can be prevented from exceeding the maximum processing capacity of a distributed storage system, and the operational stability and service reliability of the distributed storage system can be effectively improved.

The application discloses a kind of electronic bank dynamic flow control method and system based on multidimensional data fusion, belong to data processing technical field.The method includes: the multiple-source data in electronic bank system is collected and unified structured processing is carried out;Dynamic baseline is generated based on historical transaction data using sliding window algorithm, and dynamic baseline is corrected in combination with real-time cluster load state;Business priority and multi-tenant priority are calculated, and after dynamically adjusting weight coefficient according to load factor, weighted summation is obtained to obtain comprehensive priority;According to the comprehensive priority, generate token bucket parameters, execute service level throttling and interface level throttling, and dispatch requests according to queue weight proportion;The execution result is collected and returned to update dynamic baseline and calculation parameters.The application realizes adaptive adjustment and differentiated resource guarantee of throttling parameters through the synergistic effect of dynamic baseline calculation, comprehensive priority model, hierarchical throttling execution and closed-loop feedback.

This invention discloses a concurrency control and traffic scheduling system for card data interaction, relating to the fields of Internet of Things communications and distributed data processing technology. By adding a semantic addressing intent field (PIF) to the IPv6 extension header, the system enables switches to complete parsing and direct traffic to SmartNICs within 16ns. The SmartNIC generates a time-slot micro-ledger with a 500µs cycle and pre-allocates transaction locks using the Edge-Lock Weaving algorithm. Backend nodes complete strongly consistent transaction submissions using a single round of RDMA using a fast two-phase commit protocol. Dynamic congestion management is achieved through a dual-layer token bucket combined with flight windows. This solution achieves nanosecond read and write speeds, sub-millisecond submissions, and highly available decentralized scalability, significantly improving latency, throughput, and fault tolerance.

The application relates to a network traffic control method and device, a chip, a network interface card, computer equipment, a computer readable storage medium and a computer program product. The method is applied to a chip comprising a RISC-V architecture processor core and comprises the following steps: determining a to-be-updated token quantity corresponding to a token bucket; reading a number of overdraft tokens corresponding to the token bucket in a rate limiting configuration table based on a hardware characteristic of a RISC-V design, and reading a current token quantity; updating the current token quantity in the rate limiting configuration table based on the to-be-updated token quantity, the number of overdraft tokens and the current token quantity; reading the rate limiting configuration table, and marking a to-be-sent packet based on the current token quantity, the number of overdraft tokens in the rate limiting configuration table and a length of the to-be-sent packet; and processing traffic corresponding to the to-be-sent packet based on actions corresponding to each mark in the rate limiting configuration table. The method can improve processing efficiency.

The invention relates to a flow control method and device, computer equipment, a storage medium and a program product. The method comprises the steps that the current token filling rate of each thread in a plurality of threads is determined, and the current token filling rate of the thread refers to the rate of filling a token bucket of the thread with a token in a current period; the current token filling rate of the thread is divided from the total token filling rate of the multiple threads according to the required flow of the thread in the previous period, and the current token bucket filling rate of the thread and the required flow of the thread in the previous period are in positive correlation; and for each thread, filling the token bucket of the thread with tokens according to the current token filling rate of the thread in the current period, so that the thread processes the request allocated to the thread by consuming the tokens in the token bucket of the thread. By adopting the method, the system throughput and the system performance can be improved.

The embodiment of the present application provides a token bucket-based flow control method and network equipment, which are used for flow control on messages passing through the network equipment. Tokens are periodically added to the token bucket, and the number of tokens added in each period is an integer multiple of a natural number power of 2; when a message passes through the network equipment, tokens are deducted from the token bucket according to the length of the message, wherein the number of tokens deducted each time is an integer multiple of a natural number power of 2. According to the above technical solution, the number of tokens added and the number of tokens deducted are both integer multiples of a natural number power of 2, so they can be accurately obtained through the shift operation of hardware, without introducing a divider or taking an approximate value. Therefore, the token bucket-based flow control method provided by the embodiment of the present application can achieve accurate flow control while consuming low hardware resources.

The invention discloses a vehicle-mounted network flow management system based on dynamic qualification time adjustment, and aims to solve the problem that traditional vehicle-mounted flow management depends on static rules and is poor in adaptability. The system comprises a data acquisition module, an ATS scheduler and a configuration management module. The data acquisition module acquires network flow data (including normalized network load and service data flow rate) and vehicle state information and sends the network flow data and the vehicle state information to the ATS scheduler. The ATS scheduler calculates qualification time through a dynamic qualification time adjustment step in combination with a committed information rate, a committed burst size, a token bucket capacity, a security service activity state and a service priority; and the configuration management module receives the qualification time and issues the qualification time as a configuration parameter to the vehicle-mounted network equipment or the service module so as to realize flow scheduling. The system can dynamically adapt to the vehicle-mounted network load and safety service state change, guarantees the real-time performance and reliability of key data transmission such as safety service, and improves the vehicle-mounted network resource distribution efficiency.