95 results about "Rate limiting" patented technology

The invention relates to the field of data processing, in particular to a distributed flow limiting method and device, equipment and a medium, which are used for realizing distributed flow limiting control on a service request. The method comprises the following steps: receiving business requests of business servers connected with a cache server, and clustering the business requests based on multi-dimensional object information of the business requests to obtain request clusters; aiming at each request cluster, respectively executing the following steps: sorting the service requests in the request cluster to obtain a request sequence; aiming at each service request in the request sequence, sequentially executing the following steps: acquiring the count of a counter corresponding to the multi-dimensional object information of the service request, comparing the count with a first quantity threshold value, and judging whether the count is updated or not based on a first comparison result; and sending the first comparison result to a service server corresponding to the service request to enable the service server to analyze the first comparison result, and if a return value in an analysis result is a first set value, performing flow limiting processing on the service request.

The invention discloses an LLM-DoS attack protection method based on a multi-level defense strategy and a related device, and belongs to the field of artificial intelligence security. According to the method, denial of service attacks aiming at a large language model are effectively prevented through a three-layer defense strategy: firstly, dynamic frequency control is carried out on an API request, a three-stage rate limiting system is established, a load-aware dynamic adjustment algorithm is introduced, and when the system load is too high, the quota is automatically adjusted; secondly, constructing an input perception classifier by adopting a lightweight Transform model, breaking through context limitation in combination with a random fragment compression and length penalty strategy, and realizing hierarchical interception of attack requests through a harmfulness scoring function; and finally, a request hash mapping and streaming response multiplexing technology is implemented at a server side, and real-time detection and response multiplexing are performed on repeated high-concurrency attack requests, so that consumption of computing resources is reduced. According to the method, the security and availability of the large language model service can be effectively improved, and the influence of DoS attacks on the system is reduced.

The invention relates to the technical field of computers, and discloses a process scheduling method based on a tenant isolation strategy, and the method comprises the steps: receiving a process scheduling request of a tenant, and carrying out the standardization processing and legality verification; querying a predefined tenant mapping table, and determining an internal unified tenant identifier corresponding to the flow scheduling request and associated single-tenant concurrent quota, tenant resource weight, isolation level and strategy rule; obtaining a single-tenant concurrent quota and a tenant resource weight, generating a tenant isolation strategy in combination with the calculated rate limiting parameter and the tenant correction priority, and performing admission judgment; and based on the judgment result, distributing the flow scheduling request to the corresponding tenant scheduling unit according to the local priority, selecting a target tenant scheduling unit according to the scheduling qualification value and the global scheduling priority, generating an execution instance and triggering the execution instance. Through differentiated services, resource monopoly is prevented, task hunger is eliminated, system overload is avoided, multi-dimensional mutual restriction is carried out, and isolation between tenants is achieved.

This specification provides a rate limiting method, apparatus, electronic device, and medium for a distributed cluster. The method includes: if at least one token in the token set is greater than 0, calculating a token deviation value; if the token deviation value is less than a first threshold and the condition that all tokens in the token set are greater than or equal to 0 is not met, reducing the token generation rate corresponding to the token bucket rate limiter with tokens greater than the token number threshold, and increasing the token generation rate corresponding to the token bucket rate limiter with tokens less than the token number threshold; if every token in the token set is less than or equal to 0, calculating a rate deviation value based on the generation rate set; if the rate deviation value is greater than or equal to a second threshold, reducing the token generation rate corresponding to the token bucket rate limiter with a token generation rate greater than the token generation rate threshold, and increasing the token generation rate corresponding to the token bucket rate limiter with a token generation rate less than the token generation rate threshold.

The invention relates to the technical field of computers, and provides a short message sending control method, a short message sending control device, a computer readable storage medium and electronic equipment.The short message sending control method comprises the steps that a preset short message sending rate limiting strategy is acquired, the short message sending rate limiting strategy is used for defining the maximum number M of short messages allowed to be sent in a preset time window; initializing an annular storage area based on the maximum short message number M, wherein the annular storage area is composed of M memory blocks; when a short message sending request is received, obtaining a time difference between the current timestamp and the earliest timestamp recorded in the annular storage area; if the time difference is larger than or equal to the preset time window, the current short message is allowed to be sent, and the current timestamp is written into the target memory block occupied by the earliest timestamp. According to the method, the memory overhead and the processing delay can be remarkably reduced while the condition that the sending amount in any continuous time window does not exceed M strictly can be ensured.

The application discloses an IO flow rate limiting control method and device, electronic equipment and a storage medium, relates to the technical field of computer data storage, and comprises the following steps: configuring concurrent processing parameters and total capacity parameters of a task pool; identifying the request type of a newly arrived input / output request, and distributing the input / output request to a corresponding queue in the task pool or the cache pool according to the request type and the task pool state; checking the task pool and the cache pool state at a preset time interval, and scheduling the input / output request in the cache pool to the task pool according to a priority order; when a high-priority input / output request arrives and the task pool is full, transferring low-priority input / output requests in the task pool to the cache pool, and limiting the allocation of computing resources to IO requests. The technical problems that related technologies lack flexible and dynamic regulation and control mechanisms can be solved, the processing efficiency of the system for IO requests and the resource utilization rate are improved, and the stability and reliability of the distributed storage system are enhanced.

The application discloses a cloud network service level agreement guarantee system and method based on a distributed speed limiting strategy, wherein the distributed speed limiting strategy is realized through an equal packet loss rate control algorithm, and a core purpose of the equal packet loss rate control algorithm is to update a speed limiting value of each gateway node in a distributed speed limiting gateway cluster when each round time is exhausted; the guarantee system comprises a management module and a routing module; the management module is used for starting, monitoring and configuring the distributed speed limiting gateway cluster based on the distributed speed limiting strategy; and the routing module is used for forwarding data packets in a cloud network and performing bandwidth speed limiting based on the distributed speed limiting strategy in the forwarding process. The system and method utilize the distributed speed limiting strategy, realize cloud network service level agreement guarantee, and are favorable for improving cloud network service quality.

This application relates to the field of interface gateway management technology, and discloses an open application programming interface (API) gateway management system and method. The method includes: responding to a received API call request, extracting the caller's identity information and request context parameters, performing dynamic authentication on the call request, and obtaining the authentication result; obtaining the corresponding rate limiting rules, performing dynamic mixed-mode traffic control on the call request, and obtaining the traffic control result; forwarding the call request to the corresponding backend service, and monitoring the backend service's operating status data in real time during the forwarding process, performing circuit breaker analysis based on the operating status data and preset business semantic rules, and obtaining the circuit breaker control signal; executing the corresponding request processing action according to the circuit breaker control signal, and collecting full-link observable data such as call chain tracing data and network performance data in real time to manage interface calls; this application can effectively intercept replay attacks, abnormal logins from different locations, etc., and improve gateway throughput.

This application discloses a method, apparatus, device, and medium for rate limiting of stacked data protocol packets in a stacked system, relating to the field of communication technology. The method includes: acquiring a service protocol packet to be sent to a master switch; determining the corresponding VLAN identifier based on the protocol type of the service protocol packet by querying a preset mapping relationship between protocol types and VLAN identifiers; filling the VLAN identifier into the outer VLAN tag of the stacked data protocol packet, and filling the private protocol number of the stacked data protocol packet into the EtherType field of the stacked data protocol packet, obtaining a constructed stacked data protocol packet; and sending the constructed stacked data protocol packet to the master switch, so that the master switch can determine the corresponding rate limiting policy based on the VLAN identifier and the private protocol number. This method can accurately rate limit the traffic of stacked data protocol packets.

Logic may provide enforce a rate limit for product offers and generate a product token associated for product authentication. Logic may determine a rate limit associated with the product based on an identity of the consumer in a cryptogram for a transaction. Logic may compare the rate limit with a quantity of purchases of the product with a payment instrument provided for payment for the transaction, the rate limit to limit purchases of the product via the payment instrument or by the consumer associated with the payment instrument. Logic may approve the transaction based on comparison of the rate limit in response to the rate limit being greater than purchases of the product. Logic may create a product token via the cryptogram, the product token encoded via the cryptogram, the product token to uniquely identify the product and logic may cause transmission of the product token to the consumer.

The invention relates to a message processing method and device for bandwidth guarantee speed limitation. The method comprises the following steps: identifying an IP address of a message to be processed; judging whether the IP address is matched with a pre-configured bandwidth guarantee user or not; if the IP address is matched with the bandwidth guarantee user, obtaining interface information corresponding to the message and bandwidth information on an interface; determining a bandwidth guarantee strategy based on the interface information and the bandwidth information; and processing the message data according to the bandwidth guarantee strategy. According to the message processing method and device for bandwidth guarantee speed limitation, occupation of network resources by bandwidth guarantee users can be controlled, and the network resources are reasonably distributed. A user is prevented from maliciously preempting bandwidth resources, and the network use environment is improved.

The invention provides a network flow multi-level security protection model, system, method, equipment and medium. According to the method, a plurality of modularized atomization protection points are constructed through a predefined eBPF program library, and network control capabilities such as matching, speed limiting and state observation are realized. In a system initialization stage, a data plane architecture comprising a plurality of kernel execution layer dispatcher programs is constructed, and persistence of the programs and resource Map is realized through pin operation. The declarative network security policy is received through the SDK module, the policy control module analyzes the declarative network security policy to generate a configuration parameter, and the user mode module loads an eBPF program according to the configuration parameter and mounts the eBPF program to a kernel execution layer. The network flow triggers a protection point according to a path and outputs observation data; and the state aggregation sub-module aggregates the data according to the strategy and feeds information back to the upper-layer application. Therefore, flexible deployment of protection points and strategy dynamic driving can be realized, and the method has good expandability and response capability.

This invention discloses a parallel optimization system for massive video processing. The system adopts a four-layer integrated parallel and collaborative processing architecture, comprising, from top to bottom: a parallel task layer for video stream access, grouping, splitting, encapsulation, and queue management; a resource abstraction layer for unified hardware modeling, status acquisition, topology construction, and capability assessment; a parallel scheduling layer for task-hardware matching, load balancing, priority scheduling, and dynamic adjustment; and an execution optimization layer for data stream localization, parallel read / write, cache optimization, and zero-copy processing. The parallel task layer, resource abstraction layer, parallel scheduling layer, and execution optimization layer form a complete parallel processing link: task input, resource awareness, accurate scheduling, and optimized execution. This invention implements concurrent rate limiting and smooth access for the input video stream to prevent traffic surges; and sets synchronization points and timing control for parallel tasks to ensure orderly output.

The application provides a Linux-based intelligent dynamic network bandwidth allocation method, and belongs to the technical field of computers, and comprises the following steps: step S1, constructing a closed-loop dynamic regulation system; step S2, obtaining current running network data of an application; step S3, when no new application is opened in the foreground, the system maintains a steady-state observation window state; when a new application is opened, the system maintains a fast response window state to collect new state traffic, and judges whether a racing condition occurs in the foreground application; step S4, if the racing condition does not occur, network traffic is maintained at the highest value required by the current application, and if it is judged that the racing condition occurs, the next step is entered; step S5, triggering an intelligent suppression state machine to limit the network rate of the background application until the foreground application can stably run; and step S6, when the foreground application continuously and stably runs within a predetermined time, the network rate of the background application is restored in a probe mode. The method of the application guarantees the foreground experience and eliminates bandwidth waste.

This application provides a method, apparatus, device, and storage medium for cellular data rate limiting control. The method is applied to an operator's network management server and includes: receiving a regional rate limiting request sent by an enterprise management server, the regional rate limiting request including rate limiting area information corresponding to a first preset user to be rate limited; determining, based on the regional rate limiting request, a target user terminal located in the corresponding rate limiting area during the current time period of a first preset user terminal corresponding to the first preset user; determining a first rate limiting mapping relationship based on the target user terminal identification information and the rate limiting area information corresponding to the first preset user; and sending a regional rate limiting instruction to an operator slicing platform, the regional rate limiting instruction including the first rate limiting mapping relationship, the regional rate limiting instruction being used to instruct the operator slicing platform to perform regional rate limiting on the target user terminal according to the first rate limiting mapping relationship and time-based rate limiting on the second preset user terminal according to a second rate limiting mapping relationship.

This application discloses a multi-tenant task scheduling method and related apparatus, relating to the field of cloud computing technology. It receives tasks to be scheduled and their metadata, determines dynamic priority information, and sends the task to a target priority queue if the tenant corresponding to the task has an effective quota. When a tenant has a concurrent consumption token in the target priority queue, it acquires the token, executes the task, and then releases the token. This application sets different dynamic priorities for tasks to be scheduled, ensuring that tasks are distributed to resource-isolated independent queues, guaranteeing priority processing of each task, and improving resource utilization. Before task publication, sliding window rate limiting is implemented, and tenant-level concurrent consumption tokens are distributed during task consumption, isolating tasks between tenants. In complex multi-tenant, high-concurrency production scenarios, this enables intelligent task adjustment, significantly improving resource utilization and scheduling efficiency.

The invention belongs to the technical field of rail transit, and provides a heterogeneous temporary speed limit fusion method and system, a storage medium and equipment. The method comprises the following steps: receiving temporary speed limit message data, performing message analysis on the temporary speed limit message data, judging a temporary speed limit type and acquiring temporary speed limit information; generating a temporary speed limit table corresponding to the temporary speed limit type based on the temporary speed limit type and the temporary speed limit information; and performing fusion processing on the temporary speed limit tables corresponding to all the temporary speed limit types to generate a temporary speed limit fusion table. According to the heterogeneous temporary speed limit fusion method, the processing capacity and compatibility of the system for heterogeneous temporary speed limit are improved.

The application discloses a kind of decentralized rate limiting methods and devices for malicious network attack, comprising: extracting the behavior characteristics of rate limiting node in decentralized distributed system;Using node clustering algorithm to obtain the distance of each rate limiting node to each cluster based on behavior characteristics, according to distance to select the nearest cluster to divide rate limiting node into normal cluster and malicious cluster;Initialize the distributed rate limiting parameter in each cluster, and dynamically adjust the rate limiting value of each rate limiting node based on distributed rate limiting parameter in each cluster using distributed rate limiting algorithm;Real-time monitoring is carried out to each cluster, and the size of cluster is dynamically adjusted according to the number of rate limiting node and the change of behavior characteristics, and malicious node identification and processing are carried out to malicious cluster.The application can improve the security, stability and resource allocation efficiency of distributed system, and is suitable for the optimization and promotion of overall service quality in large-scale distributed network environment.

This application provides a rate limiting method, cloud network system, components, media, and products for a cloud network environment. The method includes: for a first network component and a second network component located on the data plane of a communication network, the first network component, while processing data sent by the second network component, can also monitor its own load parameters. When the load parameters are not less than a preset threshold, indicating overload, the first network component can generate a rate limiting message and directly send the message to the second network component using the communication protocol between them, thereby causing the second network component to reduce its data transmission speed. In this method, for the first network component experiencing overload, the component can generate a rate limiting message and directly send it to the second network component on the data plane to mitigate the overload. Furthermore, the above process does not require the participation of control plane devices in the communication network; therefore, it can quickly improve device overload.

This invention discloses a method, device, and medium for memory access management in data processing, relating to the field of data processing technology. The method includes: receiving read / write access requests from a processor and writing them to an access request queue; performing message decomposition and field parsing on the read / write access requests to obtain request feature fields; generating access flow window parameters based on the process identifier in the request feature fields; collecting congestion characterization data around the access request queue and performing congestion determination to obtain a rate limiting control signal; updating the access flow window parameters based on the rate limiting control signal and setting an incomplete request admission threshold, thereby forming a controlled request queue constrained by the incomplete request admission threshold. This invention controls the size of the access request queue through the linkage of congestion determination and the incomplete request admission threshold, achieving controllable access rhythm for concurrent read / write operations, reducing incomplete request backlog and queuing latency fluctuations, and improving overall throughput stability and operational reliability.

This application provides a message transmission method, apparatus, system, computer device, storage medium, and computer program product. The system includes: obtaining a first message to be transmitted and a message identifier corresponding to each first message to be transmitted from an enqueue unit; the enqueue unit is used to obtain the first messages to be transmitted and generate message identifiers for each first message to be transmitted; storing each first message to be transmitted according to the order of its message identifiers; sending the first messages to be transmitted to a dequeue unit according to the order of their message identifiers; the dequeue unit is used to access the global token bucket corresponding to the received first message to be transmitted in a lock-free manner, obtain the token of the received first message to be transmitted from the global token bucket according to the message identifier of the received first message to be transmitted, and transmit the first message to be transmitted upon receiving the token. This method can improve the accuracy of the rate after rate limiting.

The invention provides a service request dynamic flow limiting method and device, equipment and a storage medium, and the method comprises the steps: intercepting a service request initiated by a user side; the service request is analyzed to obtain request information of the service request, a request portrait of the service request is constructed based on the request information, and the request portrait at least comprises information used for identifying a target management and control entity; based on the request portrait, associating and updating an aggregated portrait of the target management and control entity to form aggregated portrait time sequence data; predicting a request load and a resource consumption trend of the target management and control entity in a future time window based on the aggregated portrait time sequence data; generating a dynamic flow limiting strategy based on the aggregation portrait, the prediction result of the load and resource consumption trend and a preset service rule; and executing flow limiting processing on the subsequent service request according to the dynamic flow limiting strategy so as to realize dynamic flow limiting of the service request. By adopting the method, the accuracy, intelligence and dynamics of service request traffic limiting can be improved.

This invention discloses a high-concurrency access control system and method for multi-terminal collaboration in construction management. The system includes: a terminal access authentication module, which performs identity authentication and role classification on multi-terminal devices, derives corresponding terminal classifications, and assigns corresponding role weight coefficients; a dynamic hierarchical rate limiting module, which calculates the token generation rate and token bucket capacity based on a preset dynamic hierarchical token bucket algorithm and performs token verification and rate limiting control on concurrent access requests from multiple terminals according to the role weight coefficients; a distributed scheduling module, which uses consistent hashing distributed scheduling rules to distribute access requests that pass rate limiting verification, and simultaneously completes multi-terminal session state synchronization based on a distributed session cluster; and a data conflict resolution module, which performs two-factor conflict detection on triggered operations on the same data item, performs conflict resolution, and completes data read / write and returns an access response. Its beneficial effects are: making differentiated rate limiting more reasonable and automatically adapting to on-site network fluctuations.

Disclosed herein are system, method, and computer program product embodiments for implementing global rate limiting of an API cluster capable of dynamically implementing updates without a restart of any instantiation within the API cluster. A local service includes an envoy and a customer resource definition. When an update is received, the customer resource definition identifies changes to be made to a global rate limiting service and dynamically injects those changes into the global rate limiting service. The changes can be instance-specific, with multiple different versions stored for the various instantiations within the cluster. The envoy also extracts and converts header information from a received request into one or more descriptor keys. The global rate limiting service determine global rate limiting based on a set of rules applied to the descriptor keys.

A method of rate limiting per radio access technology or across radio access technologies is provided that includes receiving a request related to a session management (SM) policy association for protocol data unit (PDU) session establishment / modification for a user equipment (UE) associated with a network slice. The method includes receiving information indicating a remaining maximum bit rate associated with a group of one or more PDU sessions associated with the network slice. The remaining maximum bit rate has a value that is specific to a radio access technology (RAT) type of a radio access network (RAN) to which the UE is connected or a value that is common across at least two RAT types including the RAT type of the RAN. And the method includes making a policy decision to accept or reject the establishment / modification of the SM policy association based on whether the value of the remaining maximum bit rate is higher than a value of a granted maximum bit rate for the PDU session.

The invention relates to the field of flow control, in particular to a lightweight API flow limiting method and system based on an annotation, electronic equipment and a medium, the lightweight API flow limiting method comprises the steps that flow limiting parameters of a target interface are defined through the annotation, and the flow limiting parameters comprise a flow limiting strategy, a time window and a threshold value; intercepting the interface request marked by the annotation by using an AOP section, extracting the flow limiting parameter, selecting the corresponding flow limiting strategy, and collecting context information of the interface request; generating a corresponding flow limiting key based on the context information, and counting the request frequency of the interface request in a distributed storage through the flow limiting key and the time window; and judging whether the interface request triggers the current limiting strategy or not based on the request frequency. The current limiting rule definition of zero code intrusion can be realized based on the annotation configuration, the business code is prevented from being modified, and the development complexity is reduced.

This application relates to the field of cloud computing technology and provides a method, apparatus, device, and storage medium for processing e-commerce task requests. It includes: obtaining a task request to be executed and the interface to be requested for the task request; dividing the task request into multiple sub-task requests; allocating a corresponding server for each sub-task request; obtaining a token pool corresponding to the interface to be requested; when a token corresponding to the first sub-task request is obtained from the token pool, triggering the server corresponding to the first sub-task request to initiate a request to the interface to be requested; and obtaining the request result of the first sub-task request. In the above scheme, the task request to be executed is divided into multiple sub-task requests. When a token is obtained, the server corresponding to each sub-task request initiates a request to the interface to be requested separately. This avoids triggering the interface's rate limiting mechanism and enables fast and accurate retrieval of requested data from the interface.

A service providing system executes connection to a micro-service according to a specific request in a case where the service providing system has received the specific request, which is a specific application programming interface (API) request assigned specific identification information, and where the number of times of reception of the API request assigned the specific identification information has not exceeded a specific rate limit. The specific identification information is identification information of a specific client. The specific rate limit is a rate limit associated with the specific identification information. The service providing system updates the specific rate limit in accordance with a whole load of all the micro-services that operate in response to the specific request in a case where the service providing system has received the specific request.

A system contains a machine learning application specific integrated circuit (ASIC) and a power supply unit. The power supply unit and the ASIC are configured to be in data communication through dedicated pins on the ASIC and the power supply unit. The power supply unit detects a present power consumption of the ASIC. Upon determining that a threshold condition has been met, the power supply unit, responsive to the condition sends a digital signal to the ASIC. The ASIC contains a synchronizer which synchronizes the digital signal to be consistent with the ASICs internal clock frequency. A chip manager the synchronized signal and other signals to generate a throttling mask. The throttling mask is sent to a sequencer of the ASIC, which then limits the instruction flow into the processing units of the ASIC based on the mask. This in turn limits the power being consumed by the ASIC.

Accepted events are processed. Each accepted event is associated with a respective ingested timestamp, a respective processing-start timestamp, and a respective processing-complete timestamp. Events are accepted at a rate of a target rate limit. A current error value is obtained as a difference between a target lag time and a second value. The target lag time indicates a configured maximum time within which an accepted event is to be processed. The second value is an average of differences between the respective processing-complete timestamps and the respective ingested timestamps. A base throttle is obtained based on previous error values and the current error value. The base throttle is smaller than the target rate limit and indicates a maximum number of events per a unit of time to be accepted for processing. Subsequent events are accepted at a new rate obtained from the base throttle.