178 results about "Rate limiting" patented technology

The invention provides a cache information processing method and device of a port platform and a medium, and belongs to the technical field of port distributed information processing. An update request is received, and authentication and flow limiting processing are performed on the request; obtaining a cache key prefix and a data structure type, routing a cache key to a fragment node based on a consumption write-back event, executing a write-in operation in a distributed cache service, and setting survival time and multi-copy synchronization; delivering the message body to the message middleware and obtaining delivery confirmation; the messages are pulled from the queue according to the configured concurrency, deduplication verification is carried out on idempotent identifiers of the messages, and data persistence operation is executed after the verification message version is higher than the current version of the database; index collection points are implanted into all modules of the whole link, and the request delay, the cache hit rate and the message accumulation depth index are visually displayed. The reasonable distribution and optimization of system resources are realized; the consistency and integrity of the data are guaranteed, and the reliability of message transmission is improved at the same time.

The invention provides a distributed system flow intelligent grading scheduling method and system based on reinforcement learning, and relates to the technical field of flow grading, and the method comprises the steps: constructing a double-layer neural network to extract flow features, and inputting the flow features into a reinforcement learning model employing a double Q network structure, and outputting an intelligent hierarchical scheduling strategy including the interface priority, the processing queue configuration and the resource allocation proportion. Based on the strategy, a distributed token bucket algorithm is utilized to carry out rate limitation, queue allocation and resource regulation and control on interface requests with different priorities. When the system performance fluctuates, real-time monitoring data is fed back to the reinforcement learning model for online learning, a scheduling strategy is continuously optimized, self-adaptive hierarchical scheduling of distributed system traffic is realized, the utilization rate and stability of system resources are improved, and the request response time is shortened.

The invention discloses a dynamic concurrency control and resource optimization method of a smart phone outbound system. According to the method, the calling resources are dynamically allocated through the multi-dimensional weight model, and line loads and risk management and control are effectively balanced on the premise of ensuring compliance requirements of operators. Real-time state monitoring of the calling number is combined with an intelligent cooling strategy, so that a risk control mechanism is prevented from being triggered by overuse of a single line, and high-efficiency access of high-value customers is ensured through priority scheduling. The concurrency scale and the calling rhythm are accurately controlled through double constraints of the double-token mechanism, the instant flow is prevented from impacting the bearing limit of the system, it is ensured that the outbound call rate is always within the safety threshold value of an operator, and therefore the call failure rate and resource waste are greatly reduced. A parameter optimization mechanism based on dynamic feedback can automatically adjust a resource allocation strategy according to historical data and operation environment changes, for example, rate limitation is temporarily relaxed and remainder smooth scheduling is started in a burst traffic scene, so that smooth transition of a service peak value is realized.

The invention relates to the field of data processing, in particular to a distributed flow limiting method and device, equipment and a medium, which are used for realizing distributed flow limiting control on a service request. The method comprises the following steps: receiving business requests of business servers connected with a cache server, and clustering the business requests based on multi-dimensional object information of the business requests to obtain request clusters; aiming at each request cluster, respectively executing the following steps: sorting the service requests in the request cluster to obtain a request sequence; aiming at each service request in the request sequence, sequentially executing the following steps: acquiring the count of a counter corresponding to the multi-dimensional object information of the service request, comparing the count with a first quantity threshold value, and judging whether the count is updated or not based on a first comparison result; and sending the first comparison result to a service server corresponding to the service request to enable the service server to analyze the first comparison result, and if a return value in an analysis result is a first set value, performing flow limiting processing on the service request.

A method of ingress message rate limiting across a distributed producer network function (NF) application using an optimized token bucket algorithm includes implementing a producer NF instance as a distributed producer NF application and implementing a distributed ingress gateway (IGW) for performing ingress message rate limiting on the distributed producer NF application. The method further includes maintaining, for each distributed IGW, a local token bucket for rate restrictions of ingress service-based interface (SBI) request messages received by each distributed IGW; and maintaining a distributed token bucket for refilling the local token bucket. The method further includes receiving an ingress SBI request message at the distributed IGW and consuming, by the distributed IGW, the token from the local token bucket to allow processing of the ingress SBI request message by the distributed producer NF application; and refilling the local token bucket with tokens from the distributed token bucket when the number of tokens in the local token bucket falls below a threshold level.

The invention discloses an LLM-DoS attack protection method based on a multi-level defense strategy and a related device, and belongs to the field of artificial intelligence security. According to the method, denial of service attacks aiming at a large language model are effectively prevented through a three-layer defense strategy: firstly, dynamic frequency control is carried out on an API request, a three-stage rate limiting system is established, a load-aware dynamic adjustment algorithm is introduced, and when the system load is too high, the quota is automatically adjusted; secondly, constructing an input perception classifier by adopting a lightweight Transform model, breaking through context limitation in combination with a random fragment compression and length penalty strategy, and realizing hierarchical interception of attack requests through a harmfulness scoring function; and finally, a request hash mapping and streaming response multiplexing technology is implemented at a server side, and real-time detection and response multiplexing are performed on repeated high-concurrency attack requests, so that consumption of computing resources is reduced. According to the method, the security and availability of the large language model service can be effectively improved, and the influence of DoS attacks on the system is reduced.

The present disclosure provides techniques for context-sensitive token-bucket rate limiting. A processing device obtains, in a kernel space of an operating system (OS), a message comprising a unique process identifier (UPID) and a message type. The processing device determines whether to send the message from the kernel space to a user space of the OS based on at least one of: the UPID, the message type, or a token count and a discrete time unit in an entry in a data structure in the kernel space. The processing device processes the message based on the determination of whether to send the message from the kernel space to the user space.

This invention provides a controller rate limiting method, apparatus, device, and product, comprising: acquiring the key value and return signature of a resource to be re-enqueued; wherein the return signature is sent by the tuning process based on the return point of the resource to be re-enqueued in the tuning process, and each return point in the tuning process corresponds to a return signature; determining the re-enqueuing time of the resource to be re-enqueued based on the key value and return signature; and performing a delayed enqueuing operation for the resource to be re-enqueued based on the re-enqueuing time. By acquiring the return point of the resource in the tuning process based on the key value and return signature, determining the re-enqueuing time, and performing a delayed enqueuing operation at the re-enqueuing time, rate limiting is performed when the external preconditions required for updating the state cannot be met during the tuning process, thus avoiding deadlock and solving the problem of idle consumption of computing and network resources in the controller and cluster.

A first ratio of a sending rate limit to a full line rate for a link in the computing network is accessed. A second ratio of a sending window size to W_max for the link is accessed. W_max is the maximum allowed window size or the window size that utilizes an end-to-end path for the link. One or more of the first or second ratio is used to determine an amount to reduce the sending rate or window for the link in response to an indication of network congestion in the link.

The invention relates to the technical field of computers, and discloses a process scheduling method based on a tenant isolation strategy, and the method comprises the steps: receiving a process scheduling request of a tenant, and carrying out the standardization processing and legality verification; querying a predefined tenant mapping table, and determining an internal unified tenant identifier corresponding to the flow scheduling request and associated single-tenant concurrent quota, tenant resource weight, isolation level and strategy rule; obtaining a single-tenant concurrent quota and a tenant resource weight, generating a tenant isolation strategy in combination with the calculated rate limiting parameter and the tenant correction priority, and performing admission judgment; and based on the judgment result, distributing the flow scheduling request to the corresponding tenant scheduling unit according to the local priority, selecting a target tenant scheduling unit according to the scheduling qualification value and the global scheduling priority, generating an execution instance and triggering the execution instance. Through differentiated services, resource monopoly is prevented, task hunger is eliminated, system overload is avoided, multi-dimensional mutual restriction is carried out, and isolation between tenants is achieved.

Techniques are disclosed that relate to rate limiting network traffic at a content distribution network based on decisions provided by a rate limiter located on an on-premise network. A computer system may receive, at the CDN, network traffic requesting access to a service associated with an on-premise network. The computer system sends, to a second computing system deployed in the on-premise network, a request to decide whether to rate constrain the network traffic. The second computing system is configured to perform an analysis on the network traffic. In response to the request, the computer system receives a decision from the second computing system. The computer system implements the decision for the network traffic at the CDN.

The invention relates to the technical field of cloud computing and network communication, and discloses a cloud network data flow speed limiting method and device, and the method comprises the steps: configuring a random discarding starting threshold parameter and a priority discarding threshold parameter; the random discarding starting threshold parameter is greater than the priority discarding threshold parameter; and acquiring the number of tokens in the single-bucket single-rate CAR token bucket, when the cloud network data flow reaches the single-bucket single-rate CAR token bucket, comparing the number of tokens with a random discarding start threshold parameter and a priority discarding threshold parameter, and limiting the speed of the cloud network data flow based on a comparison result. According to the invention, the user Qos service quality can be effectively improved under the scene that the user traffic exceeds the bandwidth, and the efficiency and stability of data transmission are improved.

The present application relates to a cluster shared traffic threshold-based rate limiting method and apparatus, which are used for achieving effective bandwidth management and allocation among a plurality of nodes in a cluster and among a plurality of network card queues in the nodes. The method comprises: S1, a cluster manager issuing a cluster rate limiting threshold of a specified data stream to each node in a network cluster, and adding the forwarding process of each node into a multicast to share traffic information between the nodes, the cluster rate limiting threshold being acquired in the forwarding process of the node; S2, a node controller collecting statistics about the traffic of the specified data stream flowing into a network card per second, performing marking, sending out, by means of multicasting, a unique identifier of the node and network card traffic received per second to be shared to other nodes in the cluster, and on the basis of a multicast packet received from the cluster, calculating a node rate limiting quota threshold of the present node; S3, on the basis of each service core for processing traffic of queues in the forwarding process of the node and the bandwidth proportion of the total traffic of the nodes, a bandwidth allocation scheduler allocating a core rate limiting quota threshold of each node; and S4, on the basis of real-time data of the processed traffic of each queue in the nodes and the proportion of the total bandwidth of the nodes, a token bucket manager performing periodical and dynamical adjustment by means of a token bucket algorithm to obtain the proportion of each queue in a cluster rate limiting bandwidth, so as to limit the rate of the traffic passing through the queue.

This specification provides a rate limiting method, apparatus, electronic device, and medium for a distributed cluster. The method includes: if at least one token in the token set is greater than 0, calculating a token deviation value; if the token deviation value is less than a first threshold and the condition that all tokens in the token set are greater than or equal to 0 is not met, reducing the token generation rate corresponding to the token bucket rate limiter with tokens greater than the token number threshold, and increasing the token generation rate corresponding to the token bucket rate limiter with tokens less than the token number threshold; if every token in the token set is less than or equal to 0, calculating a rate deviation value based on the generation rate set; if the rate deviation value is greater than or equal to a second threshold, reducing the token generation rate corresponding to the token bucket rate limiter with a token generation rate greater than the token generation rate threshold, and increasing the token generation rate corresponding to the token bucket rate limiter with a token generation rate less than the token generation rate threshold.

The invention relates to the technical field of computers, and provides a short message sending control method, a short message sending control device, a computer readable storage medium and electronic equipment.The short message sending control method comprises the steps that a preset short message sending rate limiting strategy is acquired, the short message sending rate limiting strategy is used for defining the maximum number M of short messages allowed to be sent in a preset time window; initializing an annular storage area based on the maximum short message number M, wherein the annular storage area is composed of M memory blocks; when a short message sending request is received, obtaining a time difference between the current timestamp and the earliest timestamp recorded in the annular storage area; if the time difference is larger than or equal to the preset time window, the current short message is allowed to be sent, and the current timestamp is written into the target memory block occupied by the earliest timestamp. According to the method, the memory overhead and the processing delay can be remarkably reduced while the condition that the sending amount in any continuous time window does not exceed M strictly can be ensured.

The application discloses an IO flow rate limiting control method and device, electronic equipment and a storage medium, relates to the technical field of computer data storage, and comprises the following steps: configuring concurrent processing parameters and total capacity parameters of a task pool; identifying the request type of a newly arrived input / output request, and distributing the input / output request to a corresponding queue in the task pool or the cache pool according to the request type and the task pool state; checking the task pool and the cache pool state at a preset time interval, and scheduling the input / output request in the cache pool to the task pool according to a priority order; when a high-priority input / output request arrives and the task pool is full, transferring low-priority input / output requests in the task pool to the cache pool, and limiting the allocation of computing resources to IO requests. The technical problems that related technologies lack flexible and dynamic regulation and control mechanisms can be solved, the processing efficiency of the system for IO requests and the resource utilization rate are improved, and the stability and reliability of the distributed storage system are enhanced.

The present application discloses a request rate limiting method, apparatus, device and medium, which are applied to a rate limiting module and relate to the field of computer technology. The method includes: obtaining a target request sent by a target client and determining whether a waiting queue is empty; if it is empty, sending the target request to a source station so that the source station returns a request response based on the target request; if it is not empty, determining whether the target request is a specific request sent by a specific client; if it is not a specific request, returning a waiting page to the target client; if it is a specific request, storing the target request in a waiting queue, and when the waiting queue releases the target request, sending the target request to the source station so that the source station returns a request response based on the target request. When there are many requests, the present application gives priority to ensuring the normal response of a specific request sent by a specific client, so as to ensure a better user experience for users using the specific client.

The application discloses a cloud network service level agreement guarantee system and method based on a distributed speed limiting strategy, wherein the distributed speed limiting strategy is realized through an equal packet loss rate control algorithm, and a core purpose of the equal packet loss rate control algorithm is to update a speed limiting value of each gateway node in a distributed speed limiting gateway cluster when each round time is exhausted; the guarantee system comprises a management module and a routing module; the management module is used for starting, monitoring and configuring the distributed speed limiting gateway cluster based on the distributed speed limiting strategy; and the routing module is used for forwarding data packets in a cloud network and performing bandwidth speed limiting based on the distributed speed limiting strategy in the forwarding process. The system and method utilize the distributed speed limiting strategy, realize cloud network service level agreement guarantee, and are favorable for improving cloud network service quality.

This application relates to the field of interface gateway management technology, and discloses an open application programming interface (API) gateway management system and method. The method includes: responding to a received API call request, extracting the caller's identity information and request context parameters, performing dynamic authentication on the call request, and obtaining the authentication result; obtaining the corresponding rate limiting rules, performing dynamic mixed-mode traffic control on the call request, and obtaining the traffic control result; forwarding the call request to the corresponding backend service, and monitoring the backend service's operating status data in real time during the forwarding process, performing circuit breaker analysis based on the operating status data and preset business semantic rules, and obtaining the circuit breaker control signal; executing the corresponding request processing action according to the circuit breaker control signal, and collecting full-link observable data such as call chain tracing data and network performance data in real time to manage interface calls; this application can effectively intercept replay attacks, abnormal logins from different locations, etc., and improve gateway throughput.

This application discloses a message processing method, system, and device, including: a first communication device determining that when the bandwidth occupied by a message with the highest forwarding priority transmitted through a first port meets a first condition, it acquires the feature information of a first attack message included in the message with the highest forwarding priority transmitted through the first port, and sends the feature information of the first attack message to a control management entity. In this way, the control management entity can generate a message processing strategy based on the message features of the received attack message. Thus, the communication device can perform packet loss and / or rate limiting on messages that match the feature information of the attack message based on the message processing strategy, avoiding network device congestion caused by attacks based on high-priority messages, ensuring that normal messages with the highest forwarding priority can be effectively forwarded, and enabling the communication device to provide normal services.

This application discloses a method, apparatus, device, and medium for rate limiting of stacked data protocol packets in a stacked system, relating to the field of communication technology. The method includes: acquiring a service protocol packet to be sent to a master switch; determining the corresponding VLAN identifier based on the protocol type of the service protocol packet by querying a preset mapping relationship between protocol types and VLAN identifiers; filling the VLAN identifier into the outer VLAN tag of the stacked data protocol packet, and filling the private protocol number of the stacked data protocol packet into the EtherType field of the stacked data protocol packet, obtaining a constructed stacked data protocol packet; and sending the constructed stacked data protocol packet to the master switch, so that the master switch can determine the corresponding rate limiting policy based on the VLAN identifier and the private protocol number. This method can accurately rate limit the traffic of stacked data protocol packets.

Logic may provide enforce a rate limit for product offers and generate a product token associated for product authentication. Logic may determine a rate limit associated with the product based on an identity of the consumer in a cryptogram for a transaction. Logic may compare the rate limit with a quantity of purchases of the product with a payment instrument provided for payment for the transaction, the rate limit to limit purchases of the product via the payment instrument or by the consumer associated with the payment instrument. Logic may approve the transaction based on comparison of the rate limit in response to the rate limit being greater than purchases of the product. Logic may create a product token via the cryptogram, the product token encoded via the cryptogram, the product token to uniquely identify the product and logic may cause transmission of the product token to the consumer.

This invention relates to the field of network traffic rate limiting technology, and in particular to a bandwidth rate limiting method, apparatus, device, medium, and product. The method includes: after receiving an access request carrying a first floating Internet Protocol (IP) address, determining whether the first floating IP address matches any physical flow table; the output action in the physical flow table corresponds to a kernel rate limiter, and the kernel rate limiter corresponds to multiple floating IP addresses sharing the rate limit; if a match is found, determining whether the traffic of the first floating IP address exceeds the rate-limited traffic corresponding to a target kernel rate limiter, where the target kernel rate limiter is the kernel rate limiter corresponding to the output action of the matched physical flow table; if not, access is performed based on the first floating IP address. In this invention, the kernel rate limiter corresponds to multiple floating IP addresses sharing the rate limit, ensuring that multiple floating IPs share the bandwidth rate limit, improving network resource utilization and reducing costs.

The invention relates to a message processing method and device for bandwidth guarantee speed limitation. The method comprises the following steps: identifying an IP address of a message to be processed; judging whether the IP address is matched with a pre-configured bandwidth guarantee user or not; if the IP address is matched with the bandwidth guarantee user, obtaining interface information corresponding to the message and bandwidth information on an interface; determining a bandwidth guarantee strategy based on the interface information and the bandwidth information; and processing the message data according to the bandwidth guarantee strategy. According to the message processing method and device for bandwidth guarantee speed limitation, occupation of network resources by bandwidth guarantee users can be controlled, and the network resources are reasonably distributed. A user is prevented from maliciously preempting bandwidth resources, and the network use environment is improved.

The invention provides a network flow multi-level security protection model, system, method, equipment and medium. According to the method, a plurality of modularized atomization protection points are constructed through a predefined eBPF program library, and network control capabilities such as matching, speed limiting and state observation are realized. In a system initialization stage, a data plane architecture comprising a plurality of kernel execution layer dispatcher programs is constructed, and persistence of the programs and resource Map is realized through pin operation. The declarative network security policy is received through the SDK module, the policy control module analyzes the declarative network security policy to generate a configuration parameter, and the user mode module loads an eBPF program according to the configuration parameter and mounts the eBPF program to a kernel execution layer. The network flow triggers a protection point according to a path and outputs observation data; and the state aggregation sub-module aggregates the data according to the strategy and feeds information back to the upper-layer application. Therefore, flexible deployment of protection points and strategy dynamic driving can be realized, and the method has good expandability and response capability.

Techniques are disclosed relating to selective rate limiting and reducing clock frequency of fabric circuitry in response to certain power management events. Disclosed techniques may advantageously allow power management circuitry to reduce or avoid negative impacts of power events by reducing the clock frequency of a communication fabric while using rate limiting of relatively lower-priority traffic to reduce impacts of the frequency reduction on high-priority traffic. For example, rate limiting of lower-quality-of-service virtual channels may continue after recovery of the clock frequency until higher-quality-of-service virtual channels have recovered from the frequency reduction.

This invention discloses a parallel optimization system for massive video processing. The system adopts a four-layer integrated parallel and collaborative processing architecture, comprising, from top to bottom: a parallel task layer for video stream access, grouping, splitting, encapsulation, and queue management; a resource abstraction layer for unified hardware modeling, status acquisition, topology construction, and capability assessment; a parallel scheduling layer for task-hardware matching, load balancing, priority scheduling, and dynamic adjustment; and an execution optimization layer for data stream localization, parallel read / write, cache optimization, and zero-copy processing. The parallel task layer, resource abstraction layer, parallel scheduling layer, and execution optimization layer form a complete parallel processing link: task input, resource awareness, accurate scheduling, and optimized execution. This invention implements concurrent rate limiting and smooth access for the input video stream to prevent traffic surges; and sets synchronization points and timing control for parallel tasks to ensure orderly output.

The technology described herein relates to systems, methods, and computer storage media, among other things, for generating recommendations corresponding to whether requests (e.g., transmitted by computing devices) are malicious network traffic. For example, the recommendations can be generated using various historical and current network traffic trends (e.g., associated with a particular application programming interface). As another example, the recommendations can be generated based on particular models. Based on the generated recommendation, dynamic rate limiting rules can be applied for determining whether a request is malicious network traffic. Based on determining the request is malicious network traffic, the request (and additional requests associated with that particular request) can be blocked.

The application relates to a network traffic control method and device, a chip, a network interface card, computer equipment, a computer readable storage medium and a computer program product. The method is applied to a chip comprising a RISC-V architecture processor core and comprises the following steps: determining a to-be-updated token quantity corresponding to a token bucket; reading a number of overdraft tokens corresponding to the token bucket in a rate limiting configuration table based on a hardware characteristic of a RISC-V design, and reading a current token quantity; updating the current token quantity in the rate limiting configuration table based on the to-be-updated token quantity, the number of overdraft tokens and the current token quantity; reading the rate limiting configuration table, and marking a to-be-sent packet based on the current token quantity, the number of overdraft tokens in the rate limiting configuration table and a length of the to-be-sent packet; and processing traffic corresponding to the to-be-sent packet based on actions corresponding to each mark in the rate limiting configuration table. The method can improve processing efficiency.

The application provides a Linux-based intelligent dynamic network bandwidth allocation method, and belongs to the technical field of computers, and comprises the following steps: step S1, constructing a closed-loop dynamic regulation system; step S2, obtaining current running network data of an application; step S3, when no new application is opened in the foreground, the system maintains a steady-state observation window state; when a new application is opened, the system maintains a fast response window state to collect new state traffic, and judges whether a racing condition occurs in the foreground application; step S4, if the racing condition does not occur, network traffic is maintained at the highest value required by the current application, and if it is judged that the racing condition occurs, the next step is entered; step S5, triggering an intelligent suppression state machine to limit the network rate of the background application until the foreground application can stably run; and step S6, when the foreground application continuously and stably runs within a predetermined time, the network rate of the background application is restored in a probe mode. The method of the application guarantees the foreground experience and eliminates bandwidth waste.