A task transmission method and device, electronic equipment and readable storage medium

Abstract

Embodiments of the present application disclose a task transmission method and device, electronic equipment and a readable storage medium. The method comprises: obtaining a computing task and computing resource information of a plurality of first devices, the computing task comprising service requirement information, the computing task being located at a second device; determining a first device matched with the computing task according to the service requirement information and the computing resource information; determining a transmission route between the second device and the first device matched with the computing task; and transmitting the computing task to the first device matched with the computing task based on the transmission route, so as to process the computing task by the first device.

Description

Technical Field

[0001] This application belongs to the field of information processing technology, and in particular relates to a task transmission method, apparatus, electronic device and readable storage medium. Background Technology

[0002] Currently, with the increasing demand for computing, cluster services have emerged. Users can remotely submit computing tasks to the service providers offering cluster services for processing and to obtain the final results. For these service providers, the number of users and computing tasks is typically large, and the computing resources required by these tasks vary significantly.

[0003] Given the large scale of cluster services and the complexity of computing tasks, it is currently impossible to allocate computing resources efficiently and accurately to computing tasks. Summary of the Invention

[0004] This application provides a task transmission method, apparatus, device, and readable storage medium, which can solve the current problem of being unable to efficiently and accurately allocate computing resources to computing tasks.

[0005] In a first aspect, embodiments of this application provide a task transmission method, the method comprising:

[0006] Acquire computing tasks and computing resource information of multiple first devices. The computing tasks include business requirement information and are located on second devices.

[0007] Based on business requirements and computing resource information, determine the first device that matches the computing task;

[0008] Determine the transmission route between the second device and the first device that matches the computing task;

[0009] Based on the transmission route, the computing task is transmitted to a first device that matches the computing task, so that the first device can process the computing task.

[0010] Secondly, embodiments of this application provide a task transmission device, the device comprising:

[0011] The acquisition module is used to acquire computing tasks and computing resource information of multiple first devices. The computing tasks include business requirement information and are located on second devices.

[0012] The first determination module is used to determine the first device that matches the computing task based on business requirements information and computing resource information.

[0013] The second determining module is used to determine the transmission route between the second device and the first device that matches the computing task;

[0014] A transmission module is used to transmit computing tasks to a first device that matches the computing tasks, based on a transmission route, so that the first device can process the computing tasks.

[0015] Thirdly, embodiments of this application provide an electronic device, the device including: a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, it implements the method as described in the first aspect or any possible implementation of the first aspect.

[0016] Fourthly, embodiments of this application provide a readable storage medium storing computer program instructions that, when executed by a processor, implement the method as described in the first aspect or any possible implementation thereof.

[0017] In this embodiment, by acquiring computing task and computing resource information of multiple first devices, the computing task includes business requirement information and is located on a second device; based on the business requirement information and computing resource information, a first device matching the computing task is determined; here, based on the business requirement corresponding to the computing task and the computing resource information that can currently process the task, a suitable first device for processing the computing task can be allocated to each computing task, enabling fast and accurate matching of computing resources for the computing task, determining the transmission route between the second device and the first device matching the computing task; here, by determining the transmission route in advance before transmitting the computing task, the transmission efficiency can be improved; finally, based on the transmission route, the computing task is transmitted to the first device matching the computing task so that the first device can process the computing task quickly and efficiently. Attached Figure Description

[0018] To more clearly illustrate the technical solutions of the embodiments of this application, the accompanying drawings used in the embodiments of this application will be briefly introduced below. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0019] Figure 1 This is a flowchart of a task transmission method provided in an embodiment of this application;

[0020] Figure 2 This is a schematic diagram illustrating a method for implementing task transmission according to an embodiment of this application;

[0021] Figure 3 This is a schematic diagram of a task transmission device structure provided in an embodiment of this application;

[0022] Figure 4 This is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Detailed Implementation

[0023] The features and exemplary embodiments of various aspects of this application will now be described in detail. To make the objectives, technical solutions, and advantages of this application clearer, the application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only configured to explain this application and are not configured to limit this application. For those skilled in the art, this application can be implemented without some of these specific details. The following description of the embodiments is merely to provide a better understanding of this application by illustrating examples of this application.

[0024] It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising..." does not exclude the presence of additional identical elements in the process, method, article, or apparatus that includes the element.

[0025] First, the technical terms used in the embodiments of this application will be introduced.

[0026] Kubernetes (K8s) is an open-source container orchestration technology for automating the deployment, scaling, and management of containerized applications. K8s makes deploying and managing microservice architecture applications very simple.

[0027] In Kubernetes (K8s), hosts can be physical machines or virtual machines, primarily divided into Master nodes and Nodes. A Node is the host running a specific container, responsible for providing the underlying services, and possesses self-healing capabilities. The Master manages the Nodes, controlling which containers run on them, and also handles external data access. It eliminates many manual operations involved in deploying and scaling containerized applications. In other words, multiple hosts can be combined into a cluster to run Linux containers, and K8s helps manage those clusters simply and efficiently. The hosts that make up these clusters can also span public, private, and hybrid clouds.

[0028] The master node is the machine that controls the Kubernetes nodes and is where job tasks are created. Nodes are machines that execute assigned tasks under the control of the master node. A Pod is a collection of one or more containers deployed as a whole to a single node. Containers within the same Pod share internet protocol addresses, inter-process communication, hostnames, and other resources. Pods abstract the network and storage of the underlying containers, making container migration within the cluster easier. A Pod is the basic unit for operating containers in Kubernetes and is centrally scheduled by Kubernetes; a Pod is typically a group of closely connected containers.

[0029] Pareto analysis is a statistical method for decision-making. Pareto optimality, also known as Pareto efficiency, refers to an ideal state of resource allocation. Given a set of tasks to be processed and available resources, a transition from one allocation state to another should result in at least one task being processed without worsening the situation of any other task. This is Pareto improvement or Pareto optimization. Applying Pareto optimality to measure information resource allocation makes it possible to efficiently process all tasks through appropriate allocation or compensation measures. Studying information resource allocation is of great significance for the effective, rational, and scientific utilization of information resources, maximizing their utility, and ultimately promoting the sustainable development of the information industry.

[0030] Ant colony optimization (ACO) is an intelligent optimization algorithm. It originates from the foraging behavior of ants. Since ants lack sight, they release pheromones along their paths when searching for food and can sense pheromones released by other ants. The concentration of pheromones represents the distance of the path; a higher concentration indicates a shorter path. Typically, ants will preferentially choose paths with higher pheromone concentrations and release some pheromones along those paths to increase the pheromone concentration, thus enabling them to find the shortest path from their nest to the food source. However, the pheromone concentration along the path gradually decreases over time.

[0031] In response to the problems that have arisen in the related technologies, the task transmission method provided in the embodiments of this application will be described in detail below.

[0032] Figure 1 A flowchart illustrating a task transmission method provided in an embodiment of this application.

[0033] like Figure 1As shown, the task transmission method may include steps 110-140. This method is applied to a task transmission device, as detailed below:

[0034] Step 110: Obtain computing task and computing resource information of multiple first devices. The computing task includes business requirement information and is located on a second device.

[0035] Step 120: Based on the business requirements information and computing resource information, determine the first device that matches the computing task;

[0036] Step 130: Determine the transmission route between the second device and the first device that matches the computing task;

[0037] Step 140: Based on the transmission route, the computing task is transmitted to a first device that matches the computing task, so that the first device can process the computing task.

[0038] In the task transmission method provided in this application, by acquiring computing task and computing resource information of multiple first devices, the computing task includes business requirement information and is located on a second device; based on the business requirement information and computing resource information, a first device matching the computing task is determined; here, based on the business requirement corresponding to the computing task and the computing resource information that can currently process the task, a suitable first device for processing the computing task can be allocated to each computing task, and computing resources can be matched for the computing task quickly and accurately, determining the transmission route between the second device and the first device matching the computing task; here, by determining the transmission route in advance before transmitting the computing task, the transmission efficiency can be improved; finally, based on the transmission route, the computing task is transmitted to the first device matching the computing task so that the first device can process the computing task quickly and efficiently.

[0039] The following describes the contents of steps 110-140 respectively:

[0040] Step 110 is involved.

[0041] Acquire computing tasks and computing resource information of multiple first devices. The computing tasks include business requirement information and are located on second devices.

[0042] The computing resource information can include: the type of computing resource and the quantity of computing resources; the types of computing resources include, for example, graphics processing units (GPUs), coprocessors, and central processing units (CPUs). The power of a graphics processing unit (GPU) lies in its ability to execute many tasks simultaneously, thus possessing a natural advantage in handling complex computations. It is also known as a display core, visual processor, or display chip.

[0043] Business requirements information may include: task type, task security level, latency requirements, and computational load. Task types may include image processing, data processing, and model training, etc. The task security level characterizes the degree of security required for the computation task; a higher security level indicates greater privacy. Latency requirements characterize the expected processing time, and computational load characterizes the amount of data to be processed in the task.

[0044] In one possible embodiment, the following steps may be included prior to step 110:

[0045] Deploy the target cluster, which includes a cluster management server and multiple secondary devices;

[0046] Deploy the database, classification model, and line model on the cluster management server. The database is used to store computing tasks.

[0047] Deploy the target cluster based on Kubernetes on the server. A Kubernetes-based cluster mainly consists of three objects: the master node, nodes, and compute nodes (pods).

[0048] First, deploy the Master node and a database on the cluster management server. The database stores log data for each version of the Pods.

[0049] A classification model is constructed using Pareto analysis to obtain the Pareto optimal solution based on business requirements and computing resource information. The first device matching the computing task is then determined based on the Pareto optimal solution.

[0050] Step 120 is involved.

[0051] Based on business requirements and computing resource information, determine the first device that matches the computing task;

[0052] Based on the business requirements and computing resource information, the Pareto optimal solution is obtained, and the first device matching the computing task is determined according to the Pareto optimal solution.

[0053] In one possible embodiment, step 120 may specifically include the following steps:

[0054] The computing tasks are categorized based on business requirements information to determine the category information for each computing task; based on the category information and computing resource information, the first device matching the computing task is determined.

[0055] Specifically, the category information can include: Category 1 information, Category 2 information, and Category 3 information. Category 1 information indicates that the computing task has a large weight and high priority, and the lower the latency, the better; Category 2 information indicates that it is desirable for data to remain within the current cluster, and the latency requirement is moderate; Category 3 information indicates that there are high requirements for business scalability, and it is desirable for the computing network to provide computing power flexibly, while also requiring high data security and an independent network address space, but there are no special requirements for latency.

[0056] Specifically, the step of determining the first device matching the computing task based on category information and computing resource information mentioned above may include the following steps:

[0057] The category information and computing resource information are input into the preset classification model to determine the first device that matches the computing task. The preset classification model is constructed based on the Pareto analysis method.

[0058] The category information and computing resource information are input into the preset classification model to determine the Pareto optimal solution. Based on the Pareto optimal solution, the first device that matches the computing task is determined.

[0059] Step 130 is involved.

[0060] Determine the transmission route between the second device and the first device that matches the computing task;

[0061] In one possible embodiment, step 130 may specifically include the following steps:

[0062] Obtain the occupancy rate of each transmission route, where the transmission route is the thread between the second device where the computing task is located and the first device that matches the computing task;

[0063] Based on occupancy, determine the target transmission route from the transmission routes;

[0064] Based on the target transmission route, the computing task is transmitted to the first device that matches the computing task.

[0065] The occupancy rate of each transmission route is calculated. The occupancy rate of each transmission route is derived from data such as the number of worker threads in the thread pool at runtime, the maximum number of threads, and the size of the task buffer queue. A percentage value is obtained by calculating different weighting ratios.

[0066] The process of obtaining the occupancy rate of each transmission route includes: obtaining the saturation of the transmission route, calculating the task saturation of the transmission route, and the growth rate of the buffer queue of the computing tasks in the transmission route; and calculating the occupancy rate of the transmission route by weighting the saturation of the worker threads, the saturation of the computing tasks, and the growth rate of the buffer queue based on preset weight coefficients.

[0067] The formula for calculating the occupancy rate of transmission routes is as follows:

[0068]

[0069] Where N is the number of worker threads in the thread pool at runtime. max This is the maximum number of threads set. Describes the saturation of worker threads; T cur T is the number of tasks in the current data collection time window. pre Q is the number of tasks in the previous data collection window, and Q is the size of the task buffer queue. Describe the current task saturation. Describes the growth rate of the task buffer queue; ξ is the weighting coefficient.

[0070] In one possible embodiment, step 130 may specifically include the following steps:

[0071] The first location information of the first device that matches the computing task and the second location information of the second device where the computing task is located are input into the line model to determine the transmission route;

[0072] The circuit model was constructed based on the ant colony algorithm.

[0073] An ant colony algorithm is used to construct a route model to obtain the routes between computing tasks of different types of information and the first device. This allows computing tasks of different types of information to be matched with suitable computing resources according to business needs, while also fully meeting the needs of various types of cluster Pods.

[0074] The calculation formulas in the circuit model are as follows:

[0075]

[0076] in, The probability that the k-th ant in the t-th generation chooses to start from ij;

[0077] i: The current location information of ant k;

[0078] j; Location information of ant k's next stop;

[0079] a: The importance of pheromones;

[0080] β: The relative importance of the heuristic factor;

[0081] n ij Heuristic factor;

[0082] J k(i): The location information that ant k can choose in the current period, where each location can only be visited once.

[0083] d ij The distance between location information i and location information j;

[0084] Then, when all the ants complete an iteration, that is, each ant has crawled through all the location information nodes, the pheromones on the path will definitely change. Therefore, the pheromones need to be updated in time so that the transmission route can be reused in the future.

[0085] τ ij (t+1)=(1-ρ)τ ij (t)+Δτ ij τ ij (3)

[0086] T ij (t) represents the pheromone on the i-j path at time t (the t-th generation ant);

[0087] The total pheromone left by m ants on the path i to j;

[0088] The pheromone left by the kth ant on the path i to j (Q represents the pheromone a ant possesses in its lifetime);

[0089] K: Ant ID;

[0090] M: Number of ants;

[0091] ρ: Pheromone dilution level (the rate at which pheromones decrease over time when the value is greater than 0 and less than 1);

[0092] L k : The total distance of the path traveled by ant k;

[0093] Specifically, the first location information of the first device matching the computation task and the second location information of the second device where the computation task is located can be input into the line model according to the Pareto optimal solution calculation results to determine the transmission route. A computing power network resource information table can be generated based on the transmission route. The computing power network resource information table can include: a computing power network resource information table for computation tasks with category information of the first category, including the transmission route corresponding to computation task X; a computing power network resource information table for computing tasks with category information of the second category, including the transmission route corresponding to computation task X; and a computing power network resource information table for computing tasks with category information of the third category, including the transmission route corresponding to computation task Z.

[0094] Figure 2 This is a schematic diagram illustrating a method for implementing task transmission provided in an embodiment of this application, as shown below. Figure 2As shown, the system includes a first device C1 with a computing power resource of 10000; a first device C2 with a computing power resource of 10; and a first device C3 with a computing power resource of 5. The first devices and transmission routes matched for computational tasks X, Y, and Z are shown in the table below:

[0095] Table 1

[0096]

[0097] The computing task with category information X can be processed by computing nodes, i.e., the first device, which may include: C1, C2 and C3, wherein C1 has computing resources of 10000, C2 has computing resources of 10 and C3 has computing resources of 5.

[0098] The transmission route can include: X-AR1-R3-R2-R1-C1, meaning that during the transmission of computation task X to the first device C1, it needs to pass through the intermediate nodes AR1-R3-R2-R1 in sequence. X-AR1-R3-R2-C1, meaning that during the transmission of computation task X to the first device C2, it needs to pass through the intermediate nodes AR1-R3-R2 in sequence. X-AR1-R3-C1, meaning that during the transmission of computation task X to the first device C3, it needs to pass through the intermediate nodes AR1-R3 in sequence.

[0099] Generally, fewer intermediate nodes result in lower latency. Here, if an X-type Pod sees the view and business requirements dictate that lower latency is better, then a C3 computing power node can be selected.

[0100] Table 2

[0101]

[0102] Table 3

[0103]

[0104] The third category of information indicates a high demand for business scalability, a requirement for a flexible computing network to provide computing power, high data security, and an independent network address space, but no particular requirements for latency. Therefore, a dedicated line can be used to connect Z-type Pods to R1-R3, with dedicated line endpoints established at C1-C3.

[0105] Step 140 is involved.

[0106] Based on the transmission route, the computing task is transmitted to a first device that matches the computing task, so that the first device can process the computing task.

[0107] After receiving the computing task, the first device processes the task and obtains the computing result.

[0108] In summary, in this embodiment, by acquiring computing task and computing resource information of multiple first devices, the computing task includes business requirement information and is located on a second device; based on the business requirement information and computing resource information, a first device matching the computing task is determined; here, based on the business requirement corresponding to the computing task and the computing resource information that can currently process the task, a suitable first device for processing the computing task can be allocated to each computing task, and computing resources can be quickly and accurately matched for the computing task, determining the transmission route between the second device and the first device matching the computing task; here, by determining the transmission route in advance before transmitting the computing task, the transmission efficiency can be improved; finally, based on the transmission route, the computing task is transmitted to the first device matching the computing task so that the first device can quickly and efficiently process the computing task.

[0109] Based on the above Figure 1 The task transmission method shown in this application also provides a task transmission device, such as... Figure 3 As shown, the device 300 may include:

[0110] The acquisition module 310 is used to acquire computing tasks and computing resource information of multiple first devices. The computing tasks include business requirement information and are located on second devices.

[0111] The first determining module 320 is used to determine the first device that matches the computing task based on business requirement information and computing resource information;

[0112] The second determining module 330 is used to determine the transmission route between the second device and the first device that matches the computing task;

[0113] The transmission module 340 is used to transmit computing tasks to a first device that matches the computing tasks based on a transmission route, so that the first device can process the computing tasks.

[0114] In one possible implementation, the first determining module 320 is specifically used for:

[0115] The computing tasks are classified according to the business requirements information to determine the category information of each computing task;

[0116] Based on the category information and the computing resource information, a first device matching the computing task is determined.

[0117] In one possible implementation, the first determining module 320 is specifically used for:

[0118] The category information and the computing resource information are input into a preset classification model to determine the first device that matches the computing task. The preset classification model is constructed based on the Pareto analysis method.

[0119] In one possible implementation, the transmission module 340 is specifically used for:

[0120] Obtain the occupancy rate of each transmission route, where the transmission route is the thread between the second device where the computing task is located and the first device that matches the computing task;

[0121] Based on the occupancy rate, a target transmission route is determined from the transmission routes;

[0122] Based on the target transmission route, the computing task is transmitted to the first device that matches the computing task.

[0123] In one possible implementation, the second determining module 330 is specifically used for:

[0124] The first location information of the first device that matches the computing task and the second location information of the second device where the computing task is located are input into the line model to determine the transmission route;

[0125] The circuit model is constructed based on the ant colony algorithm.

[0126] In one possible implementation, the device 300 may further include:

[0127] A deployment module is used to deploy a target cluster, the target cluster including a cluster management server and multiple second devices;

[0128] The deployment module is used to deploy a database, a classification model, and a line model on the cluster management server, wherein the database is used to store the computing tasks.

[0129] In summary, in this embodiment, by acquiring computing task and computing resource information of multiple first devices, the computing task includes business requirement information and is located on a second device; based on the business requirement information and computing resource information, a first device matching the computing task is determined; here, based on the business requirement corresponding to the computing task and the computing resource information that can currently process the task, a suitable first device for processing the computing task can be allocated to each computing task, and computing resources can be quickly and accurately matched for the computing task, determining the transmission route between the second device and the first device matching the computing task; here, by determining the transmission route in advance before transmitting the computing task, the transmission efficiency can be improved; finally, based on the transmission route, the computing task is transmitted to the first device matching the computing task so that the first device can quickly and efficiently process the computing task.

[0130] Figure 4 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application is shown.

[0131] An electronic device may include a processor 401 and a memory 402 storing computer program instructions.

[0132] Specifically, the processor 401 may include a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of this application.

[0133] Memory 402 may include a large-capacity memory for data or instructions. For example, and not limitingly, memory 402 may include a hard disk drive (HDD), a floppy disk drive, flash memory, optical disk, magneto-optical disk, magnetic tape, or a Universal Serial Bus (USB) drive, or a combination of two or more of these. Where appropriate, memory 402 may include removable or non-removable (or fixed) media. Where appropriate, memory 402 may be internal or external to the integrated gateway disaster recovery device. In a particular embodiment, memory 402 is a non-volatile solid-state memory. In a particular embodiment, memory 402 includes read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM), or flash memory, or a combination of two or more of these.

[0134] The processor 401 implements any of the task transfer methods in the embodiment shown in the figure by reading and executing computer program instructions stored in the memory 402.

[0135] In one example, the electronic device may also include a communication interface 403 and a bus 410. For example, Figure 4 As shown, the processor 401, memory 402, and communication interface 403 are connected through bus 410 and complete communication with each other.

[0136] The communication interface 403 is mainly used to realize communication between various modules, devices, units and / or equipment in the embodiments of this application.

[0137] Bus 410 includes hardware, software, or both, that couples components of an electronic device together. For example, and not limitingly, the bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. Where appropriate, bus 410 may include one or more buses. Although specific buses are described and illustrated in embodiments of this application, this application contemplates any suitable bus or interconnect.

[0138] The electronic device can execute the task transfer method in the embodiments of this application, thereby achieving the combination Figures 1 to 2 The described task transfer method.

[0139] Furthermore, in conjunction with the task transfer method in the above embodiments, this application embodiment can provide a computer-readable storage medium for implementation. This computer-readable storage medium stores computer program instructions; these computer program instructions are implemented when executed by a processor. Figures 1 to 2 The task transfer method in [the context].

[0140] It should be clarified that this application is not limited to the specific configurations and processes described above and shown in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of this application is not limited to the specific steps described and shown. Those skilled in the art can make various changes, modifications, and additions, or change the order of steps, after understanding the spirit of this application.

[0141] The functional blocks shown in the above-described structural diagram can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application-specific integrated circuits (ASICs), appropriate firmware, plug-ins, function cards, etc. When implemented in software, the elements of this application are programs or code segments used to perform the required tasks. Programs or code segments can be stored on a machine-readable medium or transmitted over a transmission medium or communication link via data signals carried on a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, etc. Code segments can be downloaded via computer networks such as the Internet, intranets, etc.

[0142] It should also be noted that the exemplary embodiments mentioned in this application describe methods or systems based on a series of steps or apparatus. However, this application is not limited to the order of the above steps; that is, the steps can be performed in the order mentioned in the embodiments, or in a different order, or several steps can be performed simultaneously.

[0143] The above description is merely a specific implementation of this application. Those skilled in the art will clearly understand that, for the sake of convenience and brevity, the specific working processes of the systems, modules, and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be repeated here. It should be understood that the protection scope of this application is not limited thereto. Any person skilled in the art can easily conceive of various equivalent modifications or substitutions within the technical scope disclosed in this application, and these modifications or substitutions should all be covered within the protection scope of this application.

Claims

1. A task transmission method, characterized in that, The method includes: Acquire computing task and computing resource information of multiple first devices, wherein the computing task includes business requirement information and the computing task is located on a second device; Based on the business requirement information and the computing resource information, a first device matching the computing task is determined; Determine the transmission route between the second device and the first device that matches the computing task; Based on the transmission route, the computing task is transmitted to a first device that matches the computing task, so that the first device can process the computing task; The step of transmitting the computing task to the first device matching the computing task based on the transmission route, so that the first device can process the computing task, includes: The occupancy rate of each transmission route is obtained. The transmission route is the route between the second device where the computing task is located and the first device that matches the computing task. The occupancy rate is calculated based on the saturation of the transmission route, the task saturation of the transmission route, and the growth rate of the buffer queue of the transmission route. The saturation is the ratio of the number of worker threads to the maximum number of threads when the thread pool is running. The task saturation is the ratio of the number of tasks in the current acquisition time window to the size of the buffer queue. The growth rate of the buffer queue is the ratio of the difference between the number of tasks in the current acquisition time window and the number of tasks in the previous acquisition time window to the size of the buffer queue. Based on the occupancy rate, a target transmission route is determined from the transmission routes; Based on the target transmission route, the computing task is transmitted to the first device that matches the computing task.

2. The method according to claim 1, characterized in that, The step of determining the first device matching the computing task based on the business requirement information and the computing resource information includes: The computing tasks are classified according to the business requirements information to determine the category information of each computing task; Based on the category information and the computing resource information, a first device matching the computing task is determined.

3. The method according to claim 2, characterized in that, The step of determining a first device matching the computing task based on the category information and the computing resource information includes: The category information and the computing resource information are input into a preset classification model to determine the first device that matches the computing task. The preset classification model is constructed based on the Pareto analysis method.

4. The method according to claim 1, characterized in that, The step of determining the transmission route between the second device where the computing task is located and the first device that matches the computing task includes: The first location information of the first device that matches the computing task and the second location information of the second device where the computing task is located are input into the line model to determine the transmission route; The circuit model is constructed based on the ant colony algorithm.

5. The method according to claim 1, characterized in that, Before acquiring the computing resource information of multiple first devices and multiple computing tasks, each computing task including business requirement information, the method further includes: Deploy a target cluster, the target cluster including a cluster management server and multiple second devices; A database, a classification model, and a line model are deployed on the cluster management server, with the database used to store the computing tasks.

6. A task transmission device, characterized in that, The device includes: An acquisition module is used to acquire computing tasks and computing resource information of multiple first devices, wherein the computing tasks include business requirement information and the computing tasks are located on second devices; The first determining module is used to determine a first device that matches the computing task based on the business requirement information and the computing resource information. The second determining module is used to determine the transmission route between the second device and the first device that matches the computing task; A transmission module is configured to transmit the computing task to a first device matching the computing task based on the transmission route, so that the first device can process the computing task; Specifically, the transmission module is used for: The occupancy rate of each transmission route is obtained. The transmission route is the thread between the second device where the computing task is located and the first device that matches the computing task. The occupancy rate is calculated based on the saturation of the transmission route, the task saturation of the transmission route, and the growth rate of the buffer queue of the transmission route. The saturation is the ratio of the number of worker threads to the maximum number of threads when the thread pool is running. The task saturation is the ratio of the number of tasks in the current acquisition time window to the size of the buffer queue. The growth rate of the buffer queue is the ratio of the difference between the number of tasks in the current acquisition time window and the number of tasks in the previous acquisition time window to the size of the buffer queue. Based on the occupancy rate, a target transmission route is determined from the transmission routes; Based on the target transmission route, the computing task is transmitted to the first device that matches the computing task.

7. The apparatus according to claim 6, characterized in that, The first determining module is specifically used for: The computing tasks are classified according to the business requirements information to determine the category information of each computing task; Based on the category information and the computing resource information, a first device matching the computing task is determined.

8. An electronic device, characterized in that, The device includes: a processor and a memory storing computer program instructions; the processor, when executing the computer program instructions, implements the task transfer method as described in any one of claims 1-5.

9. A readable storage medium, characterized in that, The readable storage medium stores computer program instructions, which, when executed by a processor, implement the task transfer method as described in any one of claims 1-5.

Images