295 results about "Token bucket" patented technology

The invention discloses a self-adaptive packet data transmission system and method based on Beidou short messages, the system is composed of eight core modules such as a serial port communication module, a protocol conversion module and a configuration module, multi-link communication is established through an RS232 serial port and a Beidou director, and Baud rate self-adaptive adjustment and multi-serial port parallel processing are supported. The protocol conversion module adopts a finite-state machine to analyze a BDS-3 protocol, data fragmentation and recombination are achieved in combination with a sliding window algorithm, and the compression rate reaches 3: 1. The method comprises the following seven stages of flows: evaluating channel quality by detecting a message, and dynamically switching a BDS-3 anti-interference mode; implementing flow control by adopting a token bucket algorithm, and dividing three levels of QoS guarantee emergency instructions; and terminal health management is realized through a heartbeat detection and diagnosis instruction set. According to the method, instruction execution is delayed by 1.2 seconds in emergency communication, the bit error rate is controlled to be 0.0005%, the transmission efficiency is improved by 40% compared with a traditional scheme, and the method can be widely applied to the fields of Internet of Things, intelligent transportation and the like.

The invention discloses a hyper-converged server resource pooling method and system, and belongs to the technical field of resource scheduling, and the method comprises the steps: collecting spatial information, generating a multi-dimensional resource topological graph, abstracting edge node and core node resources into virtual units with position labels, constructing a virtual resource pool, and generating a three-dimensional metadata table; constructing an independent double-queue architecture, configuring a token bucket, triggering a queue clearing mechanism based on a control period, and performing micro-batch merging on edge node short transactions; binding adjacent virtual units by taking the physical position of the equipment as a fragmentation primary key, monitoring cross-virtual unit access traffic, migrating a high-frequency data copy and redirecting a write request, and adjusting fragmentation granularity according to data relevance; the virtual unit closest to the equipment group is selected as a main node in the data fragments, write operations are combined, low-delay paths are selected for synchronization, an asynchronous confirmation mechanism is adopted to respond to edge nodes, the local resource hit rate and the task processing efficiency are improved, and the real-time performance and reliability of industrial control are guaranteed.

The invention provides a distributed system flow intelligent grading scheduling method and system based on reinforcement learning, and relates to the technical field of flow grading, and the method comprises the steps: constructing a double-layer neural network to extract flow features, and inputting the flow features into a reinforcement learning model employing a double Q network structure, and outputting an intelligent hierarchical scheduling strategy including the interface priority, the processing queue configuration and the resource allocation proportion. Based on the strategy, a distributed token bucket algorithm is utilized to carry out rate limitation, queue allocation and resource regulation and control on interface requests with different priorities. When the system performance fluctuates, real-time monitoring data is fed back to the reinforcement learning model for online learning, a scheduling strategy is continuously optimized, self-adaptive hierarchical scheduling of distributed system traffic is realized, the utilization rate and stability of system resources are improved, and the request response time is shortened.

The invention relates to the technical field of payment system flow control, and particularly discloses a token bucket and leaky bucket combined flow limiting method and system for a payment system, and the method comprises the steps: S1, obtaining an index of the payment system, and calculating a health score; s2, judging the load state of the payment system according to the health score, and adjusting the token generation rate and the token bucket capacity; the token generation rate and the adjusting step length of the token bucket capacity are adjusted according to the response condition of the payment system after multiple times of adjustment; s3, receiving a service request, and judging whether the service request passes or is rejected according to the number of the available tokens; and S4, reading and processing the passed service request according to a leaky bucket algorithm. By dynamically adjusting the token generation speed, the hierarchical token bucket design and the leaky bucket smooth output mechanism, the stability of the system and the user experience are improved.

The invention discloses a multi-NS traffic control method and device for a solid state disk, and a storage medium. The method comprises the following steps: configuring an initial token parameter for each IO path based on a token bucket algorithm; associating the plurality of NS with the plurality of IO paths one by one so as to determine an association relationship between each NS and each IO path; receiving a target NS input by the host and a target flow control parameter corresponding to the target NS; searching a target IO path corresponding to the target NS according to the association relationship; configuring the target flow control parameter into the target IO path, and updating the initial token parameter according to the target flow control parameter to determine a target token parameter; receiving an IO service issued by the host; and processing the IO service and carrying out flow limitation on the IO service according to the target token parameter. According to the method and the device, the resource efficiency, the performance balance and the performance stability of the solid state disk in a multi-NS scene are improved.

The invention discloses a distributed flow limiting method and system, electronic equipment and a storage medium, and relates to the field of flow control. In the method, the initial token number of a token bucket is determined according to the maximum concurrent request number of service instances, the token bucket of the service instances is created according to the initial token number, and requests from a client are distributed to each currently started first target service instance according to a load balancing algorithm. Detecting whether a token can be obtained from an associated token bucket of the first target service instance; when the token can be obtained from the associated token bucket, the request is processed through the first target service instance, the number of tokens in the associated token bucket is updated after processing is completed, and the updated state information of the associated token bucket is synchronized to a distributed cache; and adjusting the current limiting parameter according to the state information of all token buckets in the distributed cache. By implementing the technical scheme provided by the invention, the intelligent control of the flow is realized, and the stability and the high efficiency of the system are ensured.

The invention discloses a decentralized multi-agent information interaction method and system, and the method comprises the steps: generating a subtask carrying a unique identifier and metadata based on mixed dimension task decomposition, and embedding a global utility function; sub-task-agent mapping is dynamically adjusted through Kafka and Flink, and a utility function weight coefficient is broadcasted; the sub-agent determines an executor through contract network protocol bidding, and performs execution permission arbitration on key resources in combination with a token bucket algorithm; metadata are transmitted by adopting a Gossip protocol, and intermediate data are transmitted by P2P direct connection (abnormal degradation to Kafka); key metadata are synchronized through lightweight Raft consensus, and non-key metadata are merged by adopting CRDT; and after a final result is written in through Kafka, duplicate removal, sorting and aggregation are carried out through Flink, and key states are synchronized through Gossip. According to the method, the problem of message disorder under a hybrid protocol is solved; and high-reliability message transmission and state synchronization are realized by combining the strong consistency bottom of Kafka and the conflict resolution of lightweight Raft and CRDT.

The invention relates to the technical field of computers, in particular to a request processing method and device, electronic equipment and a storage medium, which are used for preventing illusion of a large model due to high concurrency and improving the availability of the large model. The method comprises the following steps: acquiring a to-be-processed request, initially acquiring a token corresponding to the to-be-processed request from a token bucket, and adding 1 to the total concurrent number of a current sliding time window; if the token is failed to be acquired for the first time, determining the number of retry times and the retry interval duration for re-acquiring the token based on the total concurrent number and the throughput, the average time delay and the maximum acceptable time delay of the large model; and on the basis of the number of times of retry and the retry interval duration, re-acquiring the token from the token bucket, and when the token is successfully re-acquired, reasoning the to-be-processed request on the basis of the large model, and generating and returning an answer. Thus, according to the real-time total concurrent amount, the number of retry times and the retry interval duration are dynamically adjusted, the requests are dispersed to the large model, and the response success rate and availability are improved.

The invention provides a distributed system hierarchical speed limiting method and device based on real-time load sensing, and relates to the technical field of flow control. Comprising the following steps: an initialization step: configuring system basic parameters and a load data acquisition period; receiving service requests, and identifying and distinguishing read requests, write requests and service priorities in the service requests; periodically collecting load data of distributed nodes, and calculating a standardized index threshold value; judging the load state in combination with a threshold value; according to the load state, dynamically adjusting the TPS gear of the number of transactions per second; dynamically adjusting the current maximum token number in the current token cylinder of the system according to the current gear by using a token bucket algorithm, distributing tokens as required, checking whether enough tokens exist in the current token cylinder based on the received service request, and if yes, allowing the service request to pass; if not, refusing the service request or queuing the service request; and monitoring and analyzing a read-write ratio in the service request, and executing differential speed limit control in combination with the read-write ratio and the service priority.

The invention provides a gateway data transmission control method and system based on an improved token bucket method. According to the method, a traditional token bucket flow limiting method is improved by introducing a parameter self-optimization mechanism, a burst flow self-adaptive adjustment mechanism and a multi-node cooperative control mechanism. The method comprises the following steps: firstly, generating tokens according to a specified frequency and distributing the tokens to token buckets, and requesting to perform access control according to token acquisition conditions by a client; dividing the data into a plurality of independent data groups, queuing and processing the data groups in corresponding token buckets, and solving the optimal token bucket capacity and issuing rate to minimize data processing delay by analyzing the arrival rate and queuing probability of data packets; when a single-channel or group-level burst traffic event is detected, the token bucket rate and capacity are automatically adjusted to achieve traffic limiting adaptation and cooperative stabilization. According to the invention, system load balance and rate convergence can be maintained under a high concurrency condition, time delay and jitter caused by flow fluctuation can be substantially reduced, and continuity of data transmission and gateway scheduling efficiency can be improved.

The invention provides a framework migration method and system for a heterogeneous micro-service architecture, and relates to the technical field of micro-service architecture.The framework migration method comprises the steps that migration priorities are determined through topological sorting based on service calling features, a unified service interface description file is generated, a link tracking probe is injected, and service adaptation layer codes are generated; flow control is carried out in combination with a variation gradient token bucket algorithm, and service fusing and degradation are realized by adopting an exponential backoff algorithm and a sliding time window mechanism. According to the method, the problems of complex service dependence, difficulty in flow regulation and control and the like in heterogeneous architecture migration are solved, the security and stability of framework migration are improved, and the operation and maintenance cost of the system is reduced.

The invention discloses a CAN message priority dynamic arbitration method and system based on event triggering, and the method comprises the steps: obtaining a discrete sampling signal of a CAN node of an engineering vehicle and a state register value of a CAN controller, converting the discrete sampling signal into a working condition data sequence, and obtaining a bus load rate through the state register value; obtaining an event state sequence according to the working condition data sequence; all CAN messages to be sent are constructed into a message data record, and the message data record with event semantics and dynamic priority labels is obtained according to the protocol data unit and the event state sequence; and according to the bus load rate and the event state sequence, sending a message data record with event semantics and dynamic priority annotations by adopting a token bucket mechanism through a three-level priority queue linked with a three-state state machine. According to the invention, the security key message in the system can still be transmitted in time under high load, and the bandwidth occupation and delay jitter caused by the low-priority message are avoided at the same time.

A method of ingress message rate limiting across a distributed producer network function (NF) application using an optimized token bucket algorithm includes implementing a producer NF instance as a distributed producer NF application and implementing a distributed ingress gateway (IGW) for performing ingress message rate limiting on the distributed producer NF application. The method further includes maintaining, for each distributed IGW, a local token bucket for rate restrictions of ingress service-based interface (SBI) request messages received by each distributed IGW; and maintaining a distributed token bucket for refilling the local token bucket. The method further includes receiving an ingress SBI request message at the distributed IGW and consuming, by the distributed IGW, the token from the local token bucket to allow processing of the ingress SBI request message by the distributed producer NF application; and refilling the local token bucket with tokens from the distributed token bucket when the number of tokens in the local token bucket falls below a threshold level.

The invention discloses a session resource scheduling method and device, equipment and a storage medium, and relates to the technical field of communication, and the method comprises the steps: carrying out the prediction through a Kalman filtering algorithm based on the current network bandwidth data and historical flow data of a target session system when a session resource request is received, and obtaining a bandwidth prediction utilization rate; according to the bandwidth prediction utilization rate, bandwidth allocation is carried out through a token bucket algorithm, and an initial interval bandwidth is obtained; determining a session activeness state according to the session resource consumption data of the user; and performing bandwidth adjustment on the initial interval bandwidth through the session activeness state to obtain a session resource allocation result. As the bandwidth prediction utilization rate of the session resource request is predicted firstly, the appropriate initial interval bandwidth is allocated in advance; and meanwhile, bandwidth adjustment is performed in real time according to the session activeness state. By performing multi-stage real-time adjustment on the session process, the situation of non-uniform allocation of session resources is avoided, and the utilization rate of the session resources is improved.

The invention relates to the technical field of computers, and discloses an equipment protocol adaptive analysis and instruction scheduling method for an intelligent central control system, and the method comprises the steps: obtaining an original communication data flow of heterogeneous equipment, and extracting a protocol feature fingerprint to recognize a protocol type; calling a corresponding pluggable protocol parser to generate a standardized instruction object; analyzing instruction semantics and dynamically calculating priorities in combination with a system load; and performing non-blocking scheduling and execution monitoring on the instruction based on a resource token bucket mechanism. The system comprises a data acquisition module, a protocol identification module, a self-adaptive analysis module, a semantic analysis module, a priority calculation module, an instruction sorting module, a token management module, a scheduling execution module, an execution monitoring module and a response generation module. According to the method, through protocol self-learning, dynamic priority quantification and multi-dimensional resource isolation scheduling, the response certainty, expansibility and operation stability of the system in a high-concurrency scene are remarkably improved.

The invention belongs to the technical field of cache prefetching optimization of a firmware layer of a computer storage system, and particularly provides a memory control method, a storage device, a medium and equipment.The instantaneous flow is effectively filtered and persistent hotspot data is accurately recognized through a three-layer structure of combining a first-stage hotspot filtering module with a window cache, a view queue and a protection queue; the second-stage continuous access filtering module dynamically judges a continuous access mode by means of mean-variance statistics of an annular buffer area, and accidental continuous triggering of prefetching is avoided; and the third-stage random access judgment module prohibits invalid prefetching and effectively distinguishes access modes. The pre-fetching bandwidth is limited through the token bucket algorithm, the global priority queue of the skip list is combined, it is ensured that the priority of the write task is higher than that of the pre-fetching task, pre-fetching and foreground I / O resources are isolated, delay jitter control over foreground key I / O can be achieved during full-load pre-fetching, and the problem that delay soaring is caused when pre-fetching preempts the resources is solved.

The invention discloses an electric power data field-oriented congestion control method, which comprises the following steps of: monitoring a broadband utilization rate, a data packet loss rate and a delay key index in real time in an electric power data field, constructing a network state real-time sensing system, calculating a link flow congestion condition by utilizing a DCQCN congestion control algorithm, and when the flow congestion exceeds a threshold value, executing the congestion control. The method comprises the following steps: compressing data packets at a sending end by adopting a compression algorithm, classifying the data packets, transmitting the data packets to a storage buffer area of the sending end by utilizing a scheduling strategy, carrying out emergency queuing processing on the data packets, adopting a token bucket scheduling algorithm, receiving the compressed data packets by a receiving end, and identifying the data packets subjected to coding compression. And decoding the data packet by using the same decompression algorithm, establishing a feedback mechanism, collecting congestion control effect data in real time, and adaptively adjusting a control strategy according to a feedback result, so that congestion control is continuously optimized. The method can effectively solve the problem that the data transmission rate is reduced due to network congestion and DCQCN failure of a large-scale high-concurrency power data field.

The invention relates to a token bucket control method. The method comprises the following steps: setting a filling time interval of a token bucket and an information rate of the token bucket; the token bucket is filled at regular time according to the filling time interval, and the number of tokens filled each time is obtained through calculation according to the information rate and the filling time interval. The invention further provides a corresponding token bucket control device. According to the invention, an improved token bucket control scheme can be provided, the token bucket can be stably filled with tokens, the stability of message flow control is improved, and the system cost can be reduced.

The invention discloses a traffic shaping scheduling method and device, electronic equipment and a storage medium. The method comprises the following steps: determining a target service type of a first data stream at a first time, and obtaining a second data stream at a second time corresponding to the target service type; the second time is before the first time and comprises flow data of a plurality of time periods; determining flow characteristic data of a third data stream at a third time according to the second data stream; the flow characteristic data is used for describing the flow rate and the burst degree of the third data flow; and determining a control instruction of a token bucket shaper of the flow queue based on the flow characteristic data, and adding a token to the token bucket shaper based on the control instruction to meet the flow transmission of the third data flow. According to the invention, through real-time adjustment of the token bucket parameters, accurate control of network congestion is realized.

The embodiment of the invention belongs to the field of data processing, and relates to a flow control method and device, computer equipment and a storage medium, and the method comprises the steps: receiving a request message sent by a client; performing global token bucket inspection on the request message to obtain a first request message passing the inspection and a second request message not passing the inspection; performing sliding window check on the second request message to obtain a third request message passing the check and a fourth check message not passing the check; adding the fourth request message into a delay queue; and executing a message processing flow of the first request message and the third request message according to service logic. According to the method, a three-level flow limiting system of the global token bucket, the sliding window check and the delay queue is constructed, so that hierarchical control and dynamic buffering of the high-concurrency requests are realized, the stability and the processing capability of the system under burst flow are effectively improved, meanwhile, the requests are prevented from being lost, and the service availability and the response performance are enhanced.

A data transmission method and apparatus are disclosed. The data transmission method includes: receiving first configuration information, and configuring a priority, a first prioritized bit rate (PBR), and a first bucket size duration (BSD) of each logical channel in a plurality of logical channels; receiving association indication information and first indication information, where the association indication information indicates at least two first logical channels; determining, based on at least one of the first PBR, the first BSD, or the first indication information, a quantity of tokens in at least one first token bucket corresponding to the at least two first logical channels; and determining, based on the quantity of tokens and a priority of each of the at least two first logical channels, transmission resources corresponding to the at least two first logical channels.

The invention relates to the technical field of information processing, in particular to a document management method and device supporting API integration, equipment and a storage medium. Role permissions to which different users belong are distributed, API access tokens are issued for the users with API calling permissions by using a token bucket algorithm, an API interface is called according to the API access tokens, and the user access permission is called according to the API interface. Interface access can be controlled based on permissions of different user roles, the flexibility and expansibility of the document management system are improved, the document management system adapts to diversified business scenes, a task scheduler is utilized to trigger an API interface according to preset time to pull timing synchronization data from an external system, document events of the external system are monitored in real time based on a message queue, and the user experience is improved. According to a document event, an API interface is triggered to pull real-time synchronization data, timing synchronization and real-time synchronization with external system data are achieved, the integration level of the system is improved, format conversion is conducted on the timing synchronization data or the real-time synchronization data, a document library is updated based on standard format synchronization data, and the reliability of document management is improved.

The present disclosure provides a method for managing allocation of compute resources in a distributed database. Each request on every task is allocated a certain number of tokens when it arrives, such as by using a token bucket algorithm. This initial allocation may be the per-request maximum usage permitted in the system. This request is made to a central quota server in the region to coordinate allocations between tasks. As the task runs, the system evaluates how much of the limit the request is using, and adjusts its limit up or down to keep the quota allocation tight on the actual usage of the request. If there aren't enough tokens to keep the request active, the request can be evicted.

The invention relates to a satellite-borne router software security reconstruction method, aims to solve the problems of transmission monitoring lag, high-delay verification and insufficient isolation, provides an integrity chain verification and firewall double-layer verification cooperation scheme, and is combined with a modular physical isolation design. When the routing module receives the data packet, a hardware write protection lock is activated, unauthorized modification is forbidden, and strategy lock-free update is supported; the platform management module downloads an accumulated verification value in real time, and pays attention to a reconstruction instruction after ground verification; and the program programming module adopts double Bank storage, supports atomization programming and credible verification, and automatically returns a safe version when an exception occurs. Attacks are defended through satellite-ground cooperative double-closed-loop verification (firewall filtering, token bucket current limiting and ground CRC verification), hardware isolation guarantees updating without interrupting routing operation, and intelligent backspacing improves the fault-tolerant capability. The method is suitable for a high-delay and strong-interference satellite-borne routing scene, ensures zero interruption of a reconstruction service during in-orbit maintenance of a transit / overseas satellite, and meets the security requirement of a modern satellite network.

The invention relates to a token-based task scheduling method and system and a medium, and the method comprises the steps: initializing the token capacity of a token bucket and the number of available tokens, and entering a slow start process; when the current round of task is issued, the tasks in the cache queue are issued to an algorithm module for processing based on the number of the available tokens, and the number of the available tokens is updated; before the next round of task is issued, the token capacity is updated, the number of result tokens is determined based on the task processing result returned by the algorithm module, and the number of time tokens is determined based on the dynamic timeout time; and updating the number of the available tokens in the token bucket based on the number of the result tokens, the number of the time tokens and the updated token capacity, so that the task sending rate can be dynamically adjusted, the computing power resource utilization rate is improved, and the fault risk is reduced.

The invention discloses a communication method and electronic equipment, and relates to the technical field of communication, and the method adopts a two-stage QoS control strategy, and combines a bottom layer hierarchical token bucket algorithm with a top layer deficit polling algorithm. And the bottom layer QoS adopts a hierarchical token bucket to realize bandwidth allocation and traffic shaping based on traffic categories. The top layer distributes bandwidth resources by adopting deficit polling on the basis of functions, so that the problem that the waiting time of data packets in transmission queues of other functions is too long due to the fact that large data packet transmission of a certain function occupies more bandwidth in function scheduling can be solved. According to the method, end-to-end QoS guarantee can be realized, and bandwidth requirements of different traffic categories and functions are considered, so that under the scene of cross-domain sharing of PCIe equipment, the hardware resource utilization rate is maximized, fine bandwidth allocation and traffic control are performed, efficient transmission and scheduling are ensured, and bandwidth fluctuation caused by burst cross-domain access is smoothly processed.

The invention relates to the technical field of communication, in particular to a flow fine control method and system.The method comprises the steps that firstly, flow data of a system are collected in real time, the flow data comprise request frequency, response time, CPU utilization rate, memory utilization rate and thread pool utilization rate indexes, and then the token generation rate is dynamically adjusted based on a flow trend analysis result; generating tokens at regular time according to the adjusted rate, storing the tokens in a token bucket, and checking the state of the token bucket when a request is received: if available tokens exist, consuming the tokens and processing the request, otherwise, refusing or delaying the request, and when the system load exceeds a preset threshold value, triggering a fusing mechanism and pausing a non-key request; according to the method, the request number, the response time, the CPU utilization rate, the memory utilization rate and the thread pool utilization rate are collected in real time, and a mechanism for dynamically adjusting the token generation rate is combined, so that the load change of the system can be accurately sensed, and the problem of dynamic response lag is effectively solved.

The invention relates to a token management method and device, equipment and a storage medium. The method comprises the steps of obtaining a storage performance parameter value corresponding to an access request instruction in response to the access request instruction, and deleting a corresponding token quantity from a token bucket of a storage system according to the storage performance parameter value. Wherein the tokens in the token bucket are uniformly filled at preset time intervals based on the maximum token quantity; the maximum token quantity is determined according to the storage performance upper limit of the storage system in a service quality period. By adopting the method, the reasonability of token filling in the token bucket of the storage system can be improved.

The invention discloses a retransmission cache structure based on UCIE, and relates to the technical field of data caching. Comprising a data receiving module, a mapping module, a pointer management module, a direct writing buffer module and a data transmission and storage module, an efficient retransmission cache structure is achieved through the UCIE adaptation layer, transmission and storage of data Flit of 68B and 256B different sizes are compatible, delay of a storage matrix is effectively reduced through the introduced buffer write-through function, read delay is reduced, the data transmission efficiency is improved, meanwhile, the resource utilization rate is improved through the structure, and the data transmission efficiency is improved. The problems that a traditional cache structure is not specific, resource utilization is insufficient and data transmission is delayed are solved. By means of the data receiving module and the token bucket algorithm, data flow is controlled, network congestion is avoided, and it is ensured that the transmission rate of data packets is reasonable.

The invention discloses a database distributed memory management method and device, equipment and a storage medium, and relates to the field of databases, and the method comprises the following steps: in a target database, constructing a distributed memory pooling framework by taking a database instance as a node, and under the distributed memory pooling framework, creating a mapping table by utilizing a memory mapping technology; accessing the shared cache page based on the mapping table among the nodes, and dynamically adjusting the distribution of the private cache page through a preset adaptive load monitoring algorithm and a preset load weight determination formula; and when a data write-in request of the node is obtained, controlling the request flow based on a token bucket algorithm, and executing a write operation on to-be-modified data located in the shared cache page in the node by using a timestamp-based optimistic lock mechanism. Therefore, the management efficiency of the distributed memory in the database can be improved.