4results about How to "Reduce request latency" patented technology

This invention discloses an application creation method, which includes the following steps: when creating a target application using BestEffort Pod, obtaining the initial number of CPU cores to be allocated to the target application; obtaining a preset number of CPU NUMA affinity initialization cores; performing CPU NUMA affinity operation based on the number of CPU NUMA affinity initialization cores to obtain an affinity result; when it is determined that the CPU core binding condition is met based on the initial number of CPU cores and the affinity result, determining the initial CPU cores to be bound; and binding the target application to the initial CPU cores to create the target application using the initial CPU cores. Applying the application creation method provided by this invention improves the ability of BestEffort Pod to efficiently execute business logic, reduces request latency, and improves application running efficiency. This invention also discloses an application creation device, equipment, and storage medium, which have corresponding technical effects.

The embodiment of the invention relates to an inference service instance binding method and system, and the method comprises the steps: obtaining instance identification information of at least one candidate inference service instance through an inference client in an inference session establishment process; under the condition that the historical instance identification information is locally stored in the reasoning client, matching the locally stored historical instance identification information with the instance identification information of at least one candidate reasoning service instance; if the matching is successful, determining the successfully matched candidate inference service instance as a target inference service instance, and establishing or maintaining session connection with the target service instance to carry out an inference dialogue; wherein the historical instance identification information is instance identification information of inference service instances connected to the inference client in the last round of inference session; according to the method, when the inference session is newly built, the client can be directly connected to the original instance in which the historical cache is stored, computing resources are reused, meanwhile, a centralized component does not need to be introduced, and the performance bottleneck and the single-point fault risk are avoided.

The application discloses a kind of intelligent DHCP relay system and method based on dynamic network topology perception, system includes: network detection module, configured to send probe packet to multiple DHCP servers, based on the response information of probe packet, obtain the network performance index of each DHCP server between forwarding path;Quality of service evaluation module is configured to receive the network performance index from network detection module, based on network performance index, the comprehensive score of each forwarding path is calculated, and the quality of service map is updated according to comprehensive score, wherein the quality of service map is used to store forwarding path and corresponding quality of service index;Routing decision module is configured to query the updated quality of service map in real time, based on comprehensive score, obtain optimal path, and encapsulate DHCP request message of DHCP client based on optimal path and forward to corresponding DHCP server.The embodiment of the application can reduce request delay through dynamic path selection, improve success rate.

The embodiment of the application provides a long connection task execution method and device and related equipment, and relates to the technical field of Internet of Things. The long connection task execution method can be applied to message pushing, instant messaging service, Internet of Things communication service and the like. The long connection task execution method comprises the following steps: receiving a target request sent by a first client through a long connection channel; the target request carries target task information; calling a target queue thread corresponding to the first client based on the target task information, and executing a target task corresponding to the target request based on pre-stored task information stored by using a dictionary data structure through the target queue thread; based on the target request, feeding back result information of the target task executed by the target queue thread to the first client through the long connection channel; wherein the long connection channel and the first client have a corresponding relationship based on an identity of the client. The embodiment of the application can support high-concurrency requests of the client.