Computing task processing method and device, electronic equipment and storage medium

Abstract

The invention discloses a computing task processing method and device, electronic equipment and a storage medium. The method comprises the following steps: in response to a received to-be-processed calculation task, determining a task resource demand and a priority of the to-be-processed calculation task; determining a computing device type meeting the task resource requirement, and determining the real-time load and performance of candidate computing devices corresponding to the computing device type; and determining a target computing device according to the task resource demand, the priority and the real-time load and performance of the candidate computing device, so as to process the to-be-processed computing task through the target computing device. According to the technical scheme, the performance advantages of different types of computing devices can be brought into full play, the processing efficiency of the computing task is improved, meanwhile, load balancing of the computing devices can be achieved, and the stability and reliability of the system are enhanced.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a computing task processing method, device, electronic device and storage medium. Background Art

[0002] With the rapid development of applications such as artificial intelligence and big data processing, the demand for computing power continues to grow, and various types of computing devices have been introduced into data centers. Different types of computing devices have significant differences in architecture, instruction set, and performance characteristics. Existing schedulers cannot accurately identify the differences in the requirements of different computing tasks for computing devices, resulting in computing tasks being incorrectly assigned to inappropriate computing devices, thereby affecting computing efficiency and task execution time. At the same time, due to the lack of real-time monitoring and evaluation of the performance and load conditions of computing devices, it is difficult for the scheduler to make the best resource allocation decisions, resulting in some computing devices being overloaded while others are idle, causing waste of resources. Summary of the invention

[0003] The present application provides a computing task processing method, device, electronic device and storage medium, which can give full play to the performance advantages of different types of computing devices and improve the processing efficiency of computing tasks. At the same time, it can achieve load balancing of computing devices and enhance the stability and reliability of the system.

[0004] According to one aspect of the present application, a computing task processing method is provided, the method comprising:

[0005] In response to the received pending computing tasks, determining the task resource requirements and priorities of the pending computing tasks;

[0006] Determine a computing device type that meets the task resource requirements, and determine the real-time load and performance of candidate computing devices corresponding to the computing device type;

[0007] The target computing device is determined according to the task resource requirement, the priority, and the real-time load and performance of the candidate computing device, so as to process the computing task to be processed through the target computing device.

[0008] According to another aspect of the present application, a computing task processing device is provided, the device comprising:

[0009] A resource requirement determination module, configured to determine, in response to a received pending computing task, a task resource requirement and a priority of the pending computing task;

[0010] A load performance determination module, used to determine the type of computing device that meets the task resource requirements, and determine the real-time load and performance of the candidate computing device corresponding to the computing device type;

[0011] The computing task processing module is used to determine the target computing device according to the task resource requirements, the priority, and the real-time load and performance of the candidate computing device, so as to process the computing task to be processed through the target computing device.

[0012] According to another aspect of the present application, an electronic device is provided, the electronic device comprising:

[0013] at least one processor; and

[0014] a memory communicatively connected to the at least one processor; wherein,

[0015] The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the computing task processing method described in any embodiment of the present invention.

[0016] According to another aspect of the present application, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the computing task processing method described in any embodiment of the present invention when executed.

[0017] The technical solution of the embodiment of the present application, in response to the received pending computing task, determines the task resource requirement and priority of the pending computing task; determines the type of computing device that meets the task resource requirement, and determines the real-time load and performance of the candidate computing device corresponding to the computing device type; determines the target computing device according to the task resource requirement, the priority, and the real-time load and performance of the candidate computing device, so as to process the pending computing task through the target computing device. The technical solution of the embodiment of the present application, by comprehensively considering the task resource requirement and priority of the pending computing task, and the real-time load and performance of the candidate computing device corresponding to the computing device type determined according to the task resource requirement, determines the target computing device to process the pending computing task, which can give full play to the performance advantages of different types of computing devices, improve the processing efficiency of computing tasks, and at the same time, can achieve load balancing of computing devices and enhance the stability and reliability of the system.

[0018] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0020] Figure 1 is a flowchart of a computing task processing method provided according to Embodiment 1 of the present application;

[0021] Figure 2 is a flowchart of a computing task processing method provided according to Embodiment 2 of the present application;

[0022] Figure 3 is a structural diagram of a computing task processing device provided according to Embodiment 3 of the present application;

[0023] Figure 4 It is a structural diagram of an electronic device that implements the computing task processing method of an embodiment of the present application. DETAILED DESCRIPTION

[0024] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0025] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0026] Embodiment 1

[0027] Figure 1A flowchart of a computing task processing method is provided for the first embodiment of the present application. This embodiment is applicable to the case of processing computing tasks, and is typically applicable to the case of assigning different types of computing devices to process different computing tasks. The computing task processing method can be executed by a computing task processing device, which can be implemented in the form of hardware and / or software, and can be configured in an electronic device. Figure 1 As shown, the method includes:

[0028] S110 . In response to the received computing tasks to be processed, determine the task resource requirements and priorities of the computing tasks to be processed.

[0029] Among them, the pending computing tasks are tasks submitted by users to the data center and intended to be processed by computing devices in the data center. In the embodiment of the present application, the data center includes various types of computing devices, such as Ascend computing devices, NVIDIA computing devices, etc., but the existing K8S scheduler lacks an in-depth understanding of the characteristics of computing devices and targeted scheduling strategies when scheduling computing tasks for different types of computing devices in the data center.

[0030] The task resource requirements of the pending computing tasks include computing type requirements, accuracy requirements, memory requirements, number of parallel processing units requirements, storage requirements, network bandwidth requirements, task execution time requirements, power consumption requirements, specific hardware acceleration function requirements, and computing task dependent environment requirements. The priority of the pending computing tasks is used to determine the order in which the pending computing tasks are executed.

[0031] In an embodiment of the present application, after receiving the pending computing task, the first task is to determine the task resource requirements and priority of the pending computing task. Among them, the task resource requirements of the pending computing task can be determined by analyzing the content of the received pending computing task. According to the analysis results of the content of the pending computing task, it can be determined which type of computing device the computing task should be processed by, so that the computing task can be accurately scheduled to the most appropriate computing device to give full play to the performance advantages of different types of computing devices and improve computing efficiency. Among them, the priority of the pending computing task is usually determined based on factors such as the deadline and importance of the pending task. In an embodiment of the present application, in a multi-user scenario, the priority of the pending computing task also needs to consider the user's level and contract to ensure fairness and service quality.

[0032] S120. Determine the type of computing device that meets the task resource requirements, and determine the real-time load and performance of the candidate computing device corresponding to the computing device type.

[0033] Among them, the candidate computing devices are all available computing devices under the computing device type that meet the task resource requirements of the computing tasks to be processed. The real-time load and performance of the candidate computing devices include the graphics processor GPU utilization rate, memory utilization rate, temperature, network bandwidth utilization, etc., as well as the execution progress and resource consumption of the computing tasks being executed on the computing device.

[0034] In an embodiment of the present application, after determining the task resource requirements of the computing task to be processed, the type of computing device that can meet the task resource requirements can be determined based on the task resource requirements, and the real-time load and performance of the candidate computing device corresponding to the computing device type can be determined. Among them, when determining the type of computing device that can meet the task resource requirements, you can first discover information that has a decisive influence on the determination process of the computing device type based on the task resource requirements, and then determine the type of computing device that meets the task resource requirements based on the discovered information. Among them, the real-time load and performance of the candidate computing device can be obtained by real-time monitoring of the candidate computing device as an important basis for scheduling decisions, so as to avoid the risk of failure of the computing device due to excessive load, thereby enhancing the stability and reliability of the system.

[0035] S130, determining a target computing device according to task resource requirements, priorities, and real-time loads and performances of candidate computing devices, so as to process the pending computing task through the target computing device.

[0036] In an embodiment of the present application, a target computing device can be determined according to the task resource requirements, priority, and real-time load and performance of the candidate computing devices through a preset resource allocation algorithm. Specifically, after determining the task resource requirements, priority, and real-time load and performance of the candidate computing devices, the resource allocation algorithm will comprehensively consider multiple factors such as the task resource requirements, priority, and real-time load and performance of the computing task to be processed, and perform complex calculations and decisions to determine the target computing device for executing the computing task to be processed. Exemplarily, for tasks with high priority and urgent resource requirements, they will be preferentially allocated to candidate computing devices with lower loads and better performance; for tasks with relatively low resource requirements, they can be arranged to run on candidate computing devices with slightly higher loads under appropriate circumstances to improve resource utilization.

[0037] The technical solution of the embodiment of the present application, in response to the received pending computing task, determines the task resource requirement and priority of the pending computing task; determines the type of computing device that meets the task resource requirement, and determines the real-time load and performance of the candidate computing device corresponding to the computing device type; determines the target computing device according to the task resource requirement, priority, and the real-time load and performance of the candidate computing device, so as to process the pending computing task through the target computing device. The technical solution of the embodiment of the present application, by comprehensively considering the task resource requirement and priority of the pending computing task, and the real-time load and performance of the candidate computing device corresponding to the computing device type determined according to the task resource requirement, determines the target computing device to process the pending computing task, which can give full play to the performance advantages of different types of computing devices, improve the processing efficiency of computing tasks, and at the same time, can achieve load balancing of computing devices and enhance the stability and reliability of the system.

[0038] Embodiment 2

[0039] Figure 2 This is a flowchart of a computing task processing method provided in the second embodiment of the present application. The present embodiment is optimized based on the above embodiment. For solutions not described in detail in the present embodiment, please refer to the above embodiment. Figure 2 As shown, the method includes:

[0040] S210 . In response to the received computing tasks to be processed, determine the task resource requirements and priorities of the computing tasks to be processed.

[0041] Optionally, in response to a received computing task to be processed, determining the task resource requirement and priority of the computing task to be processed includes: obtaining task resource requirement description information input by a target user during the submission phase of the computing task to be processed, and determining the task resource requirement of the computing task to be processed based on the task resource requirement description information; determining whether there are other users besides the target user, and determining the priority of the computing task to be processed based on the determination result.

[0042] Among them, the target user is the submitter of the pending computing task, and the task resource requirement description information is the task resource content required for the pending computing task determined by the target user based on his own experience when submitting the pending computing task. Optionally, in order to facilitate the user to input the task resource requirement description information, corresponding options can be provided in the user interface for the user to continue to check. For example, the specific content of the task resource requirement description information is shown in Table 1 below:

[0043] Table 1 Task resource requirement description information table

[0044]

[0045] In an embodiment of the present application, the task resource requirements of the pending computing task can be determined by obtaining the task resource requirement description information input by the target user during the submission phase of the pending computing task, so as to determine which type of computing device the computing task should be processed by, so that the computing task can be accurately scheduled to the most appropriate computing device, so as to give full play to the performance advantages of different types of computing devices and improve computing efficiency. With respect to the priority of the pending computing task, it is possible to first determine whether the scenario is a single-user scenario or a multi-user scenario, and then further determine the priority of the pending computing task based on the judgment result.

[0046] Optionally, determine whether there are other users besides the target user, and determine the priority of the computing task to be processed based on the determination result, including: if there are no other users besides the target user, determine the priority of the computing task to be processed based on the task resource requirements; if there are other users besides the target user, determine the priority of the computing task to be processed based on preset user priorities and resource allocation weights.

[0047] In an embodiment of the present application, whether there are users other than the target user can be determined by obtaining the user ID of the target user corresponding to the computing task to be processed, and searching the data center for user IDs other than the user ID of the target user. If there are no users other than the target user, this is a single-user scenario, and the priority of the computing task to be processed can be determined based on the task resource requirements, such as determining the priority of the computing task to be processed based on the task execution time requirements. If there are users other than the target user, this is a multi-user scenario, and the priority of the computing task to be processed can be determined based on preset user priorities and resource allocation weights, where user priorities and resource allocation weights can be set according to the user's level and contract to ensure fairness and service quality.

[0048] Optionally, the priority of the pending computing task is determined based on preset user priority and resource allocation weight, including: real-time monitoring of the user's business content and the hardware version of the computing device, and when the business content and / or the hardware version changes, adjusting the preset user priority and resource allocation weight through the configuration interface; determining the priority of the pending computing task based on the adjusted user priority and resource allocation weight.

[0049] Among them, the user business content refers to the related business that the user can use as stipulated in the contract signed by the user, and the hardware version of the computing device is used to distinguish computing devices of different production batches of the same model or computing devices of the same model with different component configurations.

[0050] In an embodiment of the present application, the user's business content and the hardware version of the computing device can be monitored in real time, and when the user's business content and / or the hardware version of the computing device changes, the preset user priority and resource allocation weight can be adjusted through the configuration interface to determine the priority of the pending computing task according to the adjusted user priority and resource allocation weight. In an embodiment of the present application, the preset user priority and resource allocation weight can be adjusted through the configuration interface to adapt to the user's business changes and computing device hardware updates, meet the computing needs of different users, and improve user satisfaction.

[0051] S220: Analyze the task resource requirements through an intelligent task identification mechanism to determine the requirement characteristics of the task resource requirements.

[0052] The intelligent task identification mechanism is used to determine the demand characteristics of the task resource requirements of the intelligent task identification mechanism, so as to further determine the type of computing device that meets the task resource requirements. The demand characteristics are information that can have a decisive influence on the determination process of the computing device type.

[0053] In the embodiment of the present application, after determining the task resource requirements of the computing task to be processed, the task resource requirements can be analyzed through the intelligent task identification mechanism to determine the demand characteristics of the task resource requirements, so as to further determine the type of computing device that meets the task resource requirements. For example, after analyzing the task resource requirements of task A, the intelligent task identification mechanism determines that task A has high requirements for high-precision computing and requires a large amount of parallel processing capabilities; after analyzing the task resource requirements of task B, the intelligent task identification mechanism determines that task B has requirements for specific vector computing or low-precision computing.

[0054] S230. Determine the type of computing device that meets the task resource requirements based on the demand characteristics, and determine the real-time load and performance of the candidate computing device corresponding to the computing device type through the computing device monitoring system.

[0055] Among them, the computing equipment monitoring system is used to monitor all computing equipment in the data center in real time, determine the real-time load and performance of the computing equipment, and provide accurate data support for scheduling decisions.

[0056] In the embodiment of the present application, the type of computing device that meets the task resource requirements can be determined based on the demand characteristics. For example, if task A has high requirements for high-precision computing and requires a large amount of parallel processing capabilities, then task A is more suitable for execution on NVIDIA computing devices; if task B has requirements for specific vector calculations or low-precision calculations, then task B is more suitable for execution on Ascend computing devices. Afterwards, the real-time load and performance of the candidate computing device corresponding to the computing device type can be determined through the computing device monitoring system as an important basis for scheduling decisions to avoid the risk of failure of the computing device due to excessive load, thereby enhancing the stability and reliability of the system.

[0057] S240, determining a target computing device according to task resource requirements, priorities, and real-time load and performance of the candidate computing devices, so as to process the pending computing task through the target computing device.

[0058] S250: Periodically obtain historical computing task execution data and historical resource allocation data.

[0059] In an embodiment of the present application, historical computing task execution data and historical resource allocation data can be obtained regularly through the relevant database of the data center, such as once a month, twice a month, etc., which can be set according to actual conditions, and the embodiment of the present application is not limited to this.

[0060] S260. Analyze historical computing task execution data and historical resource allocation data, and iteratively optimize the intelligent task identification mechanism and resource allocation algorithm based on the analysis results; wherein the intelligent task identification mechanism is used to determine the type of computing device that meets the task resource requirements, and the resource allocation algorithm is used to determine the target computing device based on the task resource requirements, priority, and real-time load and performance of the candidate computing devices.

[0061] In an embodiment of the present application, after regularly acquiring historical computing task execution data and historical resource allocation data, the historical computing task execution data and historical resource allocation data can be analyzed, and based on the analysis results, an intelligent task identification mechanism for determining the type of computing device that meets the task resource requirements, and a resource allocation algorithm for determining the target computing device based on the task resource requirements, priority, and real-time load and performance of the candidate computing device are iteratively optimized to continuously improve the intelligent task identification mechanism and resource allocation algorithm so that they can better adapt to the ever-changing computing environment and task requirements.

[0062] The technical solution of the embodiment of the present application determines the task resource requirement and priority of the pending computing task in response to the received pending computing task; analyzes the task resource requirement through an intelligent task identification mechanism to determine the requirement characteristics of the task resource requirement; determines the type of computing device that meets the task resource requirement based on the requirement characteristics, and determines the real-time load and performance of the candidate computing device corresponding to the computing device type through a computing device monitoring system; determines the target computing device based on the task resource requirement, priority, and the real-time load and performance of the candidate computing device, so as to process the pending computing task through the target computing device; regularly obtains historical computing task execution data and historical resource allocation data; analyzes the historical computing task execution data and historical resource allocation data, and iteratively optimizes the intelligent task identification mechanism and resource allocation algorithm based on the analysis results; wherein the intelligent task identification mechanism is used to determine the type of computing device that meets the task resource requirement, and the resource allocation algorithm is used to determine the target computing device based on the task resource requirement, priority, and the real-time load and performance of the candidate computing device. The technical solution of the embodiment of the present application determines the target computing device to process the computing task by comprehensively considering the task resource requirements and priority of the computing task to be processed, as well as the real-time load and performance of the candidate computing device corresponding to the computing device type determined according to the task resource requirements, which can give full play to the performance advantages of different types of computing devices, improve the processing efficiency of computing tasks, and achieve load balancing of computing devices. At the same time, by continuously improving the intelligent task identification mechanism and resource allocation algorithm, it can better adapt to the ever-changing computing environment and task requirements.

[0063] Embodiment 3

[0064] Figure 3 A schematic diagram of the structure of a computing task processing device provided in Example 3 of the present application.

[0065] like Figure 3 As shown, the device comprises:

[0066] The resource requirement determination module 310 is used to determine the task resource requirement and priority of the pending computing task in response to the received pending computing task;

[0067] A load performance determination module 320, for determining a computing device type that meets the task resource requirements, and determining a real-time load and performance of a candidate computing device corresponding to the computing device type;

[0068] The computing task processing module 330 is used to determine the target computing device according to the task resource requirements, the priority, and the real-time load and performance of the candidate computing device, so as to process the computing task to be processed through the target computing device.

[0069] Optionally, the task resource requirements include at least one of computing type requirements, accuracy requirements, memory requirements, parallel processing unit quantity requirements, storage requirements, network bandwidth requirements, task execution time requirements, power consumption requirements, specific hardware acceleration function requirements, and computing task dependent environment requirements.

[0070] Optionally, the resource requirement determination module 310 includes:

[0071] A resource requirement determination unit, configured to obtain task resource requirement description information input by a target user during the submission phase of the pending computing task, and determine the task resource requirement of the pending computing task according to the task resource requirement description information;

[0072] The priority determination unit is used to determine whether there are other users besides the target user, and determine the priority of the to-be-processed computing task according to the determination result.

[0073] Optionally, the priority determination unit includes:

[0074] A first priority determination subunit, configured to determine the priority of the to-be-processed computing task according to the task resource requirement if there are no other users other than the target user;

[0075] The second priority determination subunit is used to determine the priority of the to-be-processed computing task according to preset user priorities and resource allocation weights if there are other users besides the target user.

[0076] Optionally, the second priority determination subunit is specifically configured to:

[0077] Monitor the user's business content and the hardware version of the computing device in real time, and when the business content and / or the hardware version changes, adjust the preset user priority and resource allocation weight through the configuration interface;

[0078] The priority of the pending computing task is determined according to the adjusted user priority and resource allocation weight.

[0079] Optionally, the load performance determination module 320 includes:

[0080] A demand feature determination unit, used to analyze the task resource demand through an intelligent task identification mechanism to determine the demand feature of the task resource demand;

[0081] The load performance determination unit is used to determine the type of computing device that meets the task resource requirements based on the demand characteristics, and determine the real-time load and performance of the candidate computing device corresponding to the computing device type through a computing device monitoring system.

[0082] Optionally, the device further comprises:

[0083] A historical data acquisition module is used to periodically acquire historical computing task execution data and historical resource allocation data;

[0084] A mechanism algorithm optimization module is used to analyze the historical computing task execution data and historical resource allocation data, and iteratively optimize the intelligent task identification mechanism and resource allocation algorithm based on the analysis results; wherein the intelligent task identification mechanism is used to determine the type of computing device that meets the task resource requirements, and the resource allocation algorithm is used to determine the target computing device based on the task resource requirements, the priority, and the real-time load and performance of the candidate computing device.

[0085] The computing task processing device provided in the embodiment of the present application can execute the computing task processing method provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0086] Embodiment 4

[0087] Figure 4 A schematic diagram of an electronic device 10 that can be used to implement an embodiment of the present application is shown. The electronic device is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. The electronic device can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or required herein.

[0088] like Figure 4 As shown, the electronic device 10 includes at least one processor 11, and a memory connected to the at least one processor 11, such as a read-only memory (ROM) 12, a random access memory (RAM) 13, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 11 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 12 or the computer program loaded from the storage unit 18 to the random access memory (RAM) 13. In the RAM 13, various programs and data required for the operation of the electronic device 10 can also be stored. The processor 11, the ROM 12, and the RAM 13 are connected to each other through a bus 14. An input / output (I / O) interface 15 is also connected to the bus 14.

[0089] A number of components in the electronic device 10 are connected to the I / O interface 15, including: an input unit 16, such as a keyboard, a mouse, etc.; an output unit 17, such as various types of displays, speakers, etc.; a storage unit 18, such as a disk, an optical disk, etc.; and a communication unit 19, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 19 allows the electronic device 10 to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0090] The processor 11 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 11 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various special artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 11 performs the various methods and processes described above, such as a computing task processing method.

[0091] In some embodiments, the computing task processing method may be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 18. In some embodiments, part or all of the computer program may be loaded and / or installed on the electronic device 10 via the ROM 12 and / or the communication unit 19. When the computer program is loaded into the RAM 13 and executed by the processor 11, one or more steps of the computing task processing method described above may be performed. Alternatively, in other embodiments, the processor 11 may be configured to perform the computing task processing method in any other appropriate manner (e.g., by means of firmware).

[0092] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0093] The computer programs for implementing the methods of the present application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer programs are executed by the processor, the functions / operations specified in the flow charts and / or block diagrams are implemented. The computer programs may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0094] In the context of the present application, a computer readable storage medium may be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, device or equipment. A computer readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer readable storage medium may be a machine readable signal medium. A more specific example of a machine readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0095] To provide interaction with a user, the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0096] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0097] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0098] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps recorded in this application can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document is not limited here.

[0099] The above specific implementations do not constitute a limitation on the protection scope of this application. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of this application.

Claims

1. A computing task processing method, characterized in that: The method comprises: In response to the received pending computing tasks, determining the task resource requirements and priorities of the pending computing tasks; Determine a computing device type that meets the task resource requirements, and determine the real-time load and performance of candidate computing devices corresponding to the computing device type; The target computing device is determined according to the task resource requirement, the priority, and the real-time load and performance of the candidate computing device, so as to process the computing task to be processed through the target computing device.

2. The method according to claim 1, characterized in that: The task resource requirements include at least one of computing type requirements, accuracy requirements, memory requirements, parallel processing unit quantity requirements, storage requirements, network bandwidth requirements, task execution time requirements, power consumption requirements, specific hardware acceleration function requirements, and computing task dependent environment requirements.

3. The method according to claim 1, characterized in that In response to the received pending computing tasks, determining the task resource requirements and priorities of the pending computing tasks includes: Obtaining task resource requirement description information input by a target user during the submission phase of the pending computing task, and determining the task resource requirement of the pending computing task according to the task resource requirement description information; It is determined whether there are other users besides the target user, and the priority of the to-be-processed computing task is determined according to the determination result.

4. The method according to claim 3, characterized in that Determining whether there are other users other than the target user, and determining the priority of the pending computing task according to the determination result, including: If there are no other users except the target user, determining the priority of the pending computing task according to the task resource requirement; If there are other users besides the target user, the priority of the pending computing task is determined according to preset user priority and resource allocation weight.

5. The method according to claim 4, characterized in that Determining the priority of the pending computing task according to the preset user priority and resource allocation weight includes: Monitor the user's business content and the hardware version of the computing device in real time, and when the business content and / or the hardware version changes, adjust the preset user priority and resource allocation weight through the configuration interface; The priority of the pending computing task is determined according to the adjusted user priority and resource allocation weight.

6. The method according to claim 1, characterized in that Determining a computing device type that meets the task resource requirements, and determining the real-time load and performance of a candidate computing device corresponding to the computing device type, including: Analyze the task resource requirements through an intelligent task identification mechanism to determine the demand characteristics of the task resource requirements; The type of computing device that meets the task resource requirement is determined according to the requirement characteristics, and the real-time load and performance of the candidate computing device corresponding to the computing device type is determined through a computing device monitoring system.

7. The method according to claim 1, characterized in that The method further comprises: Regularly obtain historical computing task execution data and historical resource allocation data; The historical computing task execution data and historical resource allocation data are analyzed, and the intelligent task identification mechanism and resource allocation algorithm are iteratively optimized based on the analysis results; wherein the intelligent task identification mechanism is used to determine the type of computing device that meets the task resource requirements, and the resource allocation algorithm is used to determine the target computing device based on the task resource requirements, the priority, and the real-time load and performance of the candidate computing device.

8. A computing task processing device, characterized in that: The device comprises: A resource requirement determination module, configured to determine, in response to a received pending computing task, a task resource requirement and a priority of the pending computing task; A load performance determination module, used to determine the type of computing device that meets the task resource requirements, and determine the real-time load and performance of the candidate computing device corresponding to the computing device type; The computing task processing module is used to determine the target computing device according to the task resource requirements, the priority, and the real-time load and performance of the candidate computing device, so as to process the computing task to be processed through the target computing device.

9. An electronic device, characterized in that: The electronic device comprises: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores a computer program executable by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can perform the computing task processing method according to any one of claims 1 to 7.

10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the computing task processing method according to any one of claims 1 to 7 when executed.

Images