Computing task allocation method, device, computer equipment and storage medium

Abstract

The embodiments of the present application disclose a computing task allocation method, apparatus, computer equipment and storage medium. Determine the computing task to be processed based on the computing task processing request sent by the first computing power platform; determine the second computing power platform for executing the computing task to be processed among multiple computing power platforms; when the second computing power platform does not have a preset data resource access tool installed, send the preset data resource access tool to the second computing power platform, so that the second computing power platform installs the preset data resource access tool; send the computing task to be processed to the second computing power platform, so that the second computing power platform accesses the target data of the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool; receive the task processing result of the second computing power platform executing the computing task to be processed according to the target data, and send the task processing result to the first computing power platform through the preset data resource access tool. Realize computing power sharing between computing power platforms.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to a computing task allocation method, apparatus, computer equipment, and storage medium. Background Art

[0002] The artificial intelligence model needs to be loaded on the corresponding computer device, and then the data to be processed is imported into the artificial intelligence model, and the data processing is performed through the computing power of the computer device and the data processing method of the artificial intelligence model.

[0003] In related technologies, in order to improve the efficiency of using the computing power of computer devices, cluster management software is usually used to perform virtualization management on multiple computer devices, thereby generating a computing power platform for users to use the computing power resources of different computer devices within the computing power platform.

[0004] However, different computing power platforms use different technical standards, and each computing power platform has different methods for loading and accessing data and models. This makes it impossible for different computing power platforms to share computing power when processing data for artificial intelligence models. As a result, some computing power platforms with sufficient computing power are unable to handle computing tasks of other computing power platforms, resulting in a waste of computing power resources. Summary of the Invention

[0005] The embodiments of the present application provide a computing task allocation method, apparatus, computer equipment, and storage medium, which can realize computing task processing across computing power platforms and improve the utilization rate of computing power resources of computing power platforms.

[0006] To achieve the above objectives, the present application provides a computing task allocation method in a first aspect, comprising:

[0007] receiving a computing task processing request sent by the first computing power platform through a preset data resource access tool, and determining a computing task to be processed according to the computing task processing request;

[0008] Determining a second computing power platform for executing the computing task to be processed from a plurality of computing power platforms;

[0009] When the second computing power platform has not installed the preset data resource access tool, sending the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool;

[0010] Sending the pending computing task to the second computing power platform, so that the second computing power platform accesses the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through the preset data resource access tool;

[0011] Receive the task processing result of the second computing power platform executing the to-be-processed computing task according to the target data, and send the task processing result to the first computing power platform through the preset data resource access tool.

[0012] In order to achieve the above-mentioned object, the second aspect of the present application provides a computing task allocation device, comprising:

[0013] a first receiving module, configured to receive a computing task processing request sent by the first computing power platform via a preset data resource access tool, and determine a computing task to be processed according to the computing task processing request;

[0014] a determination module, configured to determine a second computing power platform for executing the computing task to be processed from a plurality of computing power platforms;

[0015] a first sending module, configured to send the preset data resource access tool to the second computing power platform when the preset data resource access tool is not installed on the second computing power platform, so that the second computing power platform installs the preset data resource access tool;

[0016] A second sending module is used to send the pending computing task to the second computing power platform, so that the second computing power platform can access the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through the preset data resource access tool;

[0017] The second receiving module is used to receive the task processing result of the second computing power platform executing the to-be-processed computing task according to the target data, and send the task processing result to the first computing power platform through the preset data resource access tool.

[0018] In some embodiments, the first sending module is configured to:

[0019] Generate a configuration instruction corresponding to the preset data resource access tool and send it to the second computing power platform;

[0020] Upon receiving the support configuration result returned by the second computing power platform, determining an installation area corresponding to the preset data resource access tool in the second computing power platform;

[0021] The preset data resource access tool is sent to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instruction.

[0022] In some embodiments, the first sending module is configured to:

[0023] Determining a data access variable corresponding to the pending computing task;

[0024] The data access variable and the preset data resource access tool are sent to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instructions, and loads the data access variable through the preset data resource access tool to determine the storage path corresponding to the task to be processed.

[0025] In some embodiments, the first sending module is configured to:

[0026] When receiving an unsupported configuration result returned by the second computing power platform, generating an image generation instruction for installing the preset data resource access tool;

[0027] The preset data resource access tool and the image generation instruction are sent to the second computing power platform, so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image.

[0028] In some embodiments, the first sending module is configured to:

[0029] After sending the preset data resource access tool and the image generation instruction to the second computing power platform so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image, determining the platform construction type corresponding to the first computing power platform;

[0030] The platform construction type is sent to the second computing power platform, so that the second computing power platform analyzes the platform construction type through the preset data resource access tool and determines the storage path corresponding to the computing task to be processed.

[0031] In some embodiments, the first sending module is configured to:

[0032] After determining a second computing power platform for executing the pending computing task from among the multiple computing power platforms, when the second computing power platform has installed the preset data resource access tool, determining whether the preset data resource access tool installed by the second computing power platform is a historical version;

[0033] When the preset data resource access tool installed by the second computing power platform is a historical version, the latest version of the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the latest version of the preset data resource access tool.

[0034] In some embodiments, the determining module is configured to:

[0035] Determine the required computing power when the pending computing task is executed;

[0036] Determine the remaining computing power corresponding to each computing power platform among multiple computing power platforms;

[0037] Determine at least one to-be-selected computing power platform whose remaining computing power is greater than the required computing power, and determine a data transmission speed corresponding to each to-be-selected computing power platform;

[0038] The computing power platform to be selected with the highest data transmission speed is determined as the second computing power platform for executing the computing task to be processed.

[0039] In some embodiments, the second sending module is configured to:

[0040] Obtaining identity authentication information corresponding to the first computing power platform, and sending the identity authentication information to the second computing power platform according to the identity authentication interface corresponding to the preset data resource access tool in the second computing power platform;

[0041] Receiving an identity authentication result returned by the second computing power platform based on the identity authentication information;

[0042] When the identity authentication result indicates pass, the pending computing task is sent to the second computing power platform according to the task management interface corresponding to the preset data resource access tool in the second computing power platform, so that the second computing power platform obtains the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform according to the storage management interface corresponding to the preset data resource access tool.

[0043] In order to achieve the above-mentioned purpose, the third aspect of the present application provides a computer-readable storage medium, which stores multiple instructions, and the instructions are suitable for a processor to load to execute the computing task allocation method provided in the embodiment of the present application.

[0044] In order to achieve the above-mentioned objectives, the fourth aspect of the present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and capable of running on the processor. When the processor executes the computer program, the computing task allocation method provided in the embodiment of the present application is implemented.

[0045] In an embodiment of the present application, a computing task processing request is received from a first computing power platform through a preset data resource access tool, and a computing task to be processed is determined based on the computing task processing request; a second computing power platform for executing the computing task to be processed is determined from multiple computing power platforms; when the second computing power platform has not installed the preset data resource access tool, the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the preset data resource access tool; the computing task to be processed is sent to the second computing power platform so that the second computing power platform accesses the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool; the task processing result of the second computing power platform executing the computing task to be processed according to the target data is received, and the task processing result is sent to the first computing power platform.

[0046] In this way, by installing a preset data resource access tool on the first computing power platform, when the first computing power platform needs other computing power platforms to help process computing tasks, it receives the computing task processing request sent by the first computing power platform through the preset data resource access tool, and determines the computing task to be processed based on the computing task processing request, and then determines the second computing power platform that executes the computing task to be processed, and installs the preset data resource access tool on the second computing power platform, and sends the computing task to be processed to the second computing power platform. The second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool. Finally, the second computing power platform executes the computing task to be processed according to the target data and sends the corresponding task processing result to the first computing power platform through the computing power service platform. In this way, access to the target data of the computing task to be processed between computing power platforms is achieved through the preset data resource access tool, avoiding the inability to achieve data access between computing power platforms due to the different construction types of the computing power platforms. After achieving target data sharing, the computing power platforms in this application can execute the computing task to be processed, thereby realizing computing power sharing between different computing power platforms.

[0047] Other features and advantages of the present application will be described in the following description, and in part will become apparent from the description, or will be understood by practicing the present application. The purposes and other advantages of the present application can be achieved and obtained through the structures particularly pointed out in the description, claims and drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0048] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0049] Figure 1 Schematic diagram of the system framework corresponding to the computing task allocation method provided in the embodiment of the present application;

[0050] Figure 2 This is a schematic diagram of a scenario corresponding to the computing task allocation method provided in an embodiment of the present application;

[0051] Figure 3 Schematic diagram of the process of allocating computing tasks according to the embodiment of the present invention;

[0052] Figure 4 This is another flowchart of the computing task allocation method provided in an embodiment of the present application;

[0053] Figure 5 Schematic diagram of the structure of the computing task allocation device provided in an embodiment of the present application;

[0054] Figure 6 It is a structural diagram of the computer device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0055] In order to enable those skilled in the art to better understand the solutions of this application, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making any creative efforts shall fall within the scope of protection of this application.

[0056] It is understandable that in the specific implementation of this application, when data related to the computing tasks to be processed is involved, when the above embodiments of this application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards.

[0057] It should be noted that some processes described in the specification, claims, and figures above include multiple steps that appear in a specific order. However, it should be understood that these steps may be executed in a different order than the order in which they appear herein or in parallel. The step numbers are used solely to distinguish between the different steps and do not themselves represent any order of execution. Furthermore, terms such as "first," "second," or "target" are used herein to distinguish similar objects and are not necessarily used to describe a specific order or precedence.

[0058] The embodiments of the present application provide a computing task allocation method, device, computer equipment and storage medium. Specifically, the embodiments of the present application will be described from the dimension of the computing task allocation device, which can be specifically integrated in a computer device, which can be a server or a terminal and other devices. Among them, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Among them, the terminal can be a smart phone, tablet computer, laptop computer, desktop computer, smart speaker, smart watch, smart home appliance, car terminal, intelligent voice interaction device, aircraft, etc., but is not limited to this. The embodiments of the present application can be applied to various scenarios, including but not limited to cloud office, enterprise management, etc.

[0059] Before further explaining the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations:

[0060] Computing power platform: A computing power platform is a service platform that provides computing power. Computing power refers to the ability of a computer device to complete a specific task by processing data. Its size represents the computational efficiency of the computer system. Computing power platforms integrate a large number of computing resources, including hardware resources such as central processing units and graphics processing units, and manage these resources through technologies such as virtualization and containerization. These resources can be used flexibly by users, such as through cloud computing services, allowing users to request computing resources based on their needs.

[0061] Computing power service platform: used to interconnect computing power platforms scattered in multiple locations through the network, and provide computing power services to the outside world based on a unified service platform.

[0062] The above is an introduction to the relevant terms involved in this application.

[0063] First, let’s describe the technical problems existing in the related technologies in this application:

[0064] The artificial intelligence model needs to be loaded on the corresponding computer device, and then the data to be processed is imported into the artificial intelligence model, and the data processing is performed through the computing power of the computer device and the data processing method of the artificial intelligence model.

[0065] In related technologies, in order to improve the efficiency of using the computing power of computer devices, cluster management software is usually used to perform virtualization management on multiple computer devices, thereby generating a computing power platform for users to use the computing power resources of different computer devices within the computing power platform.

[0066] However, different computing power platforms use different technical standards, and each computing power platform has different methods for loading and accessing data and models. This makes it impossible for different computing power platforms to share computing power when processing data for artificial intelligence models. As a result, some computing power platforms with sufficient computing power are unable to handle computing tasks of other computing power platforms, resulting in a waste of computing power resources.

[0067] For example, the computing power platform built based on ModelArts technology and the computing power platform built based on the corresponding technology of Qizhi Octopus, due to the differences in the construction technology codes, the two computing power platforms cannot achieve data sharing, and thus cannot achieve computing power sharing between the two computing power platforms.

[0068] In order to solve the above technical problems, the embodiments of the present application provide a computing task allocation method, device, computer equipment and storage medium. By installing a preset data resource access tool on the first computing power platform, when the first computing power platform needs other computing power platforms to help process computing tasks, the computing task processing request sent by the first computing power platform through the preset data resource access tool is received, and the computing task to be processed is determined according to the computing task processing request, and then a second computing power platform for executing the computing task to be processed is determined, and the preset data resource access tool is installed on the second computing power platform, and the computing task to be processed is sent to the second computing power platform. The second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool. Finally, the second computing power platform executes the computing task to be processed according to the target data, and sends the corresponding task processing result to the first computing power platform through the computing power service platform. In this way, access to target data of pending computing tasks between computing power platforms is achieved through a preset data resource access tool, avoiding the inability to achieve data access between computing power platforms due to different construction types of computing power platforms. After achieving target data sharing, the computing power platforms in this application can execute pending computing tasks, thereby realizing computing power sharing between different computing power platforms.

[0069] The computing task allocation method, device, computer equipment and storage medium will be described in detail below.

[0070] See also Figure 1 , Figure 1Schematic diagram of the system framework corresponding to the computing task allocation method provided in the embodiment of the present application. The computing task allocation method provided in the embodiment of the present application can be applied to this system framework.

[0071] It includes a terminal 140, the Internet 130, a gateway 120, a server 110, and the like.

[0072] The terminal 140 or the server 110 may be a device for executing the computing task allocation method.

[0073] Terminal 140 includes, but is not limited to, mobile phones, computers, intelligent voice interaction devices, smart home appliances, vehicle-mounted terminals, aircraft, and the like. Embodiments of the present application can be applied to various scenarios, including, but not limited to, model training and model prediction. Furthermore, it can be a single device or a combination of multiple devices. For example, multiple desktop computers connected to each other via a local area network, sharing a common display, and working collaboratively, together constitute a terminal 140. Terminal 140 can communicate with Internet 130 in a wired or wireless manner to exchange data.

[0074] Server 110 refers to a computer system that provides certain services to terminal 140. Compared to ordinary terminal 140, server 110 has higher requirements in terms of stability, security, and performance. Server 110 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0075] Gateway 120, also known as a gateway or protocol converter, implements network interconnection at the transport layer and is a computer system or device that performs a conversion function. It acts as a translator between two systems using different communication protocols, data formats, languages, or even completely different architectures. Gateways can also provide filtering and security functions. Messages sent from terminal 140 to server 110 are sent through gateway 120 to the corresponding server 110. Messages sent from server 110 to terminal 140 are also sent through gateway 120 to the corresponding terminal 140.

[0076] The computing task allocation method in the embodiment of the present application can be applied to a variety of scenarios, such as model training, model prediction, etc. The scenarios to which the computing task allocation method in the present application is applied are not limited here.

[0077] See also Figure 2 , Figure 2 This is a schematic diagram of the scenario corresponding to the computing task allocation method provided in the embodiment of the present application.

[0078] Among them, the first computing power platform and the second computing power platform are platforms that provide computing power to process computing tasks, and the computing power service platform is a platform that dispatches the computing power of different computing power platforms to process computing tasks.

[0079] Computing resource sharing between the first and second computing platforms is primarily based on a pre-defined data resource access tool, which can be understood as a software development kit (SDK). This tool provides users with access to the code, data, model, and training result directories associated with computing tasks. This tool eliminates the need for users to worry about which platform the computing task is executed on.

[0080] like Figure 2 As shown, the preset data resource access tool corresponds to an authentication interface, a task management interface, and a storage management interface. In the first computing power platform, the authentication interface, task management interface, and storage management interface are specifically provided by the first computing power platform, and the preset data resource access tool can call these interfaces. In the second computing power platform, the authentication interface, task management interface, and storage management interface are specifically provided by the second computing power platform, and the preset data resource access tool can call these interfaces.

[0081] The authentication interface is used to implement user security authentication and obtain access to the task management interface and storage management interface. The task management interface is used to manage computing tasks, including creating, viewing, and deleting AI tasks. The storage management interface manages storage resources, including uploading and downloading data. Data here refers to electronic resources, including dataset files, code files, and model files required for AI training.

[0082] The pre-set data resource access tool connects to these interfaces of each computing power platform, enabling interconnection and task scheduling between different computing power platforms. When processing actual computing tasks, different computing power platforms can access data through the pre-set data resource access tool and these interfaces, thereby executing the corresponding computing tasks and sharing computing power, thereby improving the utilization of computing power resources between different computing power platforms.

[0083] See also Figure 3 , Figure 3 : is a flow chart of a computing task allocation method provided in an embodiment of the present application. The computing task allocation method may include the following steps:

[0084] Step 210: Receive a computing task processing request sent by the first computing power platform through a preset data resource access tool, and determine a computing task to be processed according to the computing task processing request;

[0085] Step 220: Determine a second computing power platform for executing the computing task to be processed from the plurality of computing power platforms;

[0086] Step 230: When the second computing power platform does not have the preset data resource access tool installed, send the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool;

[0087] Step 240: Send the pending computing task to the second computing power platform, so that the second computing power platform can access the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through a preset data resource access tool;

[0088] Step 250: Receive the task processing result of the second computing power platform executing the computing task to be processed according to the target data, and send the task processing result to the first computing power platform through the preset data resource access tool.

[0089] The following will describe in detail steps 210 to 250. The entire computing task allocation method will be described from the perspective of the computing power service platform.

[0090] In step 210, a computing task processing request sent by the first computing power platform through a preset data resource access tool is received, and a computing task to be processed is determined according to the computing task processing request.

[0091] Among them, the first computing power platform can handle related computing tasks, such as the computing tasks corresponding to the training of artificial intelligence models, and the prediction tasks of artificial intelligence models. When the first computing power platform handles more computing tasks at the same time, the computing power of the first computing power platform is used more, resulting in the pending computing tasks being queued for processing and unable to be processed in time. Therefore, the pending computing tasks need to be handed over to other platforms for further processing.

[0092] A preset data resource access tool is installed in the first computing power platform. The preset data resource access tool acts as a bridge in the process of processing computing tasks between computing power platforms. It can realize data access and data transmission between different computing power platforms, thereby realizing the distribution of computing tasks between different computing power platforms and realizing computing power sharing between different computing power platforms.

[0093] In some embodiments, the computing power service platform may receive a computing task processing request sent by the first computing power platform through a preset data resource access tool, and determine a computing task to be processed based on the computing task processing request.

[0094] For example, when the First Computing Platform needs to process a computing task, it uses a pre-defined data resource access tool, following established communication protocols and data formats, to send a computing task processing request. This request includes a detailed description of the task, including key information such as the task type (data mining, image recognition, or other types), the data source, the expected computing result format, and the task priority.

[0095] The computing power service platform continuously monitors ports from pre-defined data resource access tools. Upon receiving a request, it first performs a validity check to verify compliance with the format, data integrity, and the presence of cryptographic signatures. Once verified, a specialized parsing program extracts the requested information according to data format specifications.

[0096] The computing power service platform then extracts the core computing task content from the parsed request information. For example, for a data mining task, key parameters such as the data tables and fields to be mined, as well as the mining algorithm, are determined; for an image recognition task, the image source path and the target category to be identified are clearly defined. This key information is organized into a pending computing task object, which contains all the necessary information for task execution. Furthermore, this task information is recorded in the task management database to facilitate subsequent task tracking and management.

[0097] Finally, the computing power service platform sends a confirmation response message to the first computing power platform, informing it that the request has been successfully received. Following this, the task management system allocates the pending computing task to the appropriate computing resources (the second computing power platform) and prepares to begin executing the task. During task execution, the task status is continuously monitored, and progress is promptly reported to the first computing power platform.

[0098] In step 220, a second computing power platform for executing the computing task to be processed is determined from a plurality of computing power platforms.

[0099] Among them, the computing power service platform is connected to multiple computing power platforms. The computing power service platform can specifically analyze the second computing power platform suitable for executing the pending computing tasks among the multiple computing power platforms based on the real-time operation status of each computing power platform.

[0100] For example, the computing power service platform establishes and continuously updates a computing power platform information database, which records in detail key information about multiple computing power platforms. This information includes each computing power platform's computing power, such as the number of CPU cores and GPU performance parameters; storage capacity and read / write speeds; network bandwidth and latency; current load status, namely the number of running tasks and the proportion of computing resources occupied; and service quality indicators, such as task execution success rate and average execution time.

[0101] When a computing task is presented, the computing power service platform first conducts a comprehensive analysis. It analyzes the task type, determining whether it involves complex scientific computation, large-scale data processing, or image or video processing with high real-time requirements. It also identifies the data size of the task and estimates the required computing resources and storage requirements. It also determines the task's time constraints, determining whether it's an urgent task requiring immediate execution or a standard task that can be completed within a certain time window.

[0102] The computing power service platform selects suitable computing platforms based on the requirements of the computing tasks to be processed and the information of each computing platform. For computationally intensive tasks, priority is given to computing platforms with strong computing power and low current load. For tasks with large data volumes, emphasis is placed on platforms with large storage capacity and fast read and write speeds. For tasks with high real-time requirements, emphasis is placed on platforms with low network latency.

[0103] Finally, the second computing platform to be used for the pending computational task is determined according to a pre-set selection strategy. If efficiency is the primary concern, the platform with the shortest estimated completion time is selected; if cost control is a priority, the platform with the lowest cost that meets the basic requirements of the task is chosen. After selecting a platform, the task scheduling system sends a task execution request to the second computing platform, along with task-related information, including task details and data sources. The corresponding relationship between the task and the selected computing platform is recorded in the task management system for subsequent follow-up and management.

[0104] In some embodiments, determining a second computing power platform for executing a pending computing task from among multiple computing power platforms includes:

[0105] (1.1) Determine the required computing power when the pending computing task is executed;

[0106] (1.2) Determine the remaining computing power corresponding to each computing power platform among multiple computing power platforms;

[0107] (1.3) Identify at least one candidate computing platform whose remaining computing power is greater than the required computing power, and determine the data transmission speed corresponding to each candidate computing platform;

[0108] (1.4) The computing power platform with the highest data transmission speed is determined as the second computing power platform for executing the computing task to be processed.

[0109] For example, consider analyzing massive amounts of user viewing behavior data to optimize a video recommendation model. First, analyze the pending computing tasks, performing a detailed analysis of the tasks submitted by the video company. This task requires processing nearly a month's worth of user viewing behavior data, amounting to 500 TB. It involves complex machine learning algorithms, including data cleaning, feature engineering, model training, and evaluation.

[0110] The platform's resource estimation system estimated the required computing power based on historical experience with similar tasks and theoretical models of algorithm complexity. Completing this task required the continuous and stable provision of at least 2,000 high-performance CPU cores and a total of 50TB of memory for data processing and intermediate result storage. This translates to a computing power requirement of 2,000 CPU cores and 50TB of memory.

[0111] The computing power service platform regularly collects resource usage data from each partner computing power platform through real-time monitoring interfaces established with the platform. This data includes CPU utilization, memory usage, storage usage, and more. Based on this collected data, the remaining computing power is calculated for each computing power platform. For example, computing power platform A provides a total of 10,000 CPU cores and 200TB of memory. Currently, 4,000 CPU cores and 80TB of memory are in use, resulting in a remaining computing power of 6,000 CPU cores and 120TB of memory. Using the same method, computing power platform B calculates that it has 1,500 CPU cores and 30TB of memory remaining, while computing power platform C has 3,000 CPU cores and 60TB of memory remaining.

[0112] Compare the remaining computing power of each computing platform with the required computing power. For example, computing platform A has 6,000 CPU cores and 120TB of memory remaining, while computing platform C has 3,000 CPU cores and 60TB of memory remaining. Both platforms meet the required computing power requirements, so computing platforms A and C are selected as the computing platforms to be selected. However, computing platform B is excluded because its remaining CPU cores (1,500) are less than the required 2,000, and its remaining memory (30TB) is less than the required 50TB.

[0113] Finally, based on the data transmission speed comparison results, computing platform C's data transmission speed of 15GB / s is greater than computing platform A's 10GB / s. Therefore, the computing power service platform determines computing platform C as the second computing platform for executing the pending computing task.

[0114] In step 230, when the second computing power platform has not installed the preset data resource access tool, the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the preset data resource access tool.

[0115] It should be noted that when the second computing power platform has not installed the preset data resource access tool, it is necessary to install the preset data resource access tool on the second computing power platform so that the subsequent second computing power platform can obtain the target data corresponding to the computing task to be processed according to the preset data resource access tool.

[0116] In some embodiments, sending the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool includes:

[0117] (1.1) Generate configuration instructions corresponding to the preset data resource access tool and send them to the second computing power platform;

[0118] (1.2) upon receiving the supported configuration result returned by the second computing power platform, determining the installation area corresponding to the preset data resource access tool in the second computing power platform;

[0119] (1.3) Sending the preset data resource access tool to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instructions.

[0120] A configuration instruction corresponding to the preset data resource access tool may be generated, which is used to instruct the second computing power platform to install the preset data resource access tool in the corresponding installation area, and the configuration instruction is sent to the second computing power platform. After receiving the configuration instruction, the second computing power platform may attempt to execute the configuration instruction. If the configuration instruction is supported, the second computing power platform will return a configuration result indicating support for the configuration instruction to the computing power service platform.

[0121] When the computing power service platform receives the support configuration result returned by the second computing power platform, it determines the installation area corresponding to the preset data resource access tool in the second computing power platform, such as installing it to the designated directory specified by the second computing power platform, such as the storage directory / data / sdk / c2net.whl.

[0122] The preset data resource access tool is then sent to the installation area corresponding to the second computing power platform, so that the second computing power platform can install the preset data resource access tool in the installation area according to the configuration instructions, such as sending it to the installation area " / data / sdk / c2net.whl" corresponding to the second computing power platform through a high-speed and stable network transmission channel. After the installation package arrives, the second computing power platform automatically executes the installation program according to the configuration instructions received previously. During the installation process, the second computing power platform places the executable file of the preset data resource access tool in the specified directory and grants the corresponding execution permissions. After the installation is complete, the second computing power platform will also automatically perform simple functional tests to ensure that the preset data resource access tool can operate normally, such as trying to connect to the specified data storage location, reading a small amount of test data, etc. If the test is successful, the second computing power platform will feedback the installation success information to the computing power service platform.

[0123] In some embodiments, sending the preset data resource access tool to the installation area corresponding to the second computing power platform so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instruction includes:

[0124] (1.3.1) Determine the data access variables corresponding to the computational tasks to be processed;

[0125] (1.3.2) Sending the data access variables and the preset data resource access tool to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instructions, and loads the data access variables through the preset data resource access tool to determine the storage path corresponding to the task to be processed.

[0126] Among them, the data access variable corresponding to the computing task to be processed is used to guide the second computing power platform to obtain the target data of the computing task to be processed in the corresponding storage path of the first computing power platform.

[0127] The computing power service platform determines the data access variables corresponding to the computing tasks to be processed, and then sends the data access variables and the preset data resource access tool to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instructions, and loads the data access variables through the preset data resource access tool to determine the storage path corresponding to the tasks to be processed.

[0128] For example, the second computing power platform can load data access variables through a preset data resource access tool to determine the value corresponding to the data access variable, and then decide how to load and access the target data of the processing computing task based on the value corresponding to the data access variable.

[0129] In some embodiments, sending the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool includes:

[0130] (2.1) upon receiving a result indicating that the configuration is not supported from the second computing power platform, generating an image generation instruction for installing a preset data resource access tool;

[0131] (2.2) Sending the preset data resource access tool and the image generation instruction to the second computing power platform, so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image.

[0132] When receiving the unsupported configuration result returned by the second computing power platform, it indicates that the second computing power platform does not support the installation of the preset data resource access tool through the configuration instruction, and the installation area corresponding to the preset data resource access tool does not exist in the second computing power platform.

[0133] At this time, an image generation instruction for installing the preset data resource access tool can be generated, and the preset data resource access tool and the image generation instruction can be sent to the second computing power platform, so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image.

[0134] For example, after receiving the image generation instruction, the second computing platform can generate an image according to the image generation instruction. The image is equivalent to a container, and the container is the installation environment corresponding to the preset data resource access tool. Finally, the preset data resource access tool is installed in the image.

[0135] In some embodiments, after sending the preset data resource access tool and the image generation instruction to the second computing power platform so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image, the method further includes:

[0136] (2.2.1) Determine the platform construction type corresponding to the first computing power platform;

[0137] (2.2.2) Sending the platform construction type to the second computing power platform, so that the second computing power platform analyzes the platform construction type through a preset data resource access tool and determines the storage path corresponding to the computing task to be processed.

[0138] For example, the First Computing Power Platform adopts a distributed computing architecture built based on public cloud resources, utilizing elastic computing instances and distributed storage services provided by cloud service providers. Its platform construction type can be identified as "public cloud distributed architecture."

[0139] After receiving the platform build type information, the second computing platform invokes a pre-set data resource access tool for analysis. This tool includes pre-set rules and mappings for determining storage paths for different platform build types. Knowing that the first computing platform utilizes a "public cloud distributed architecture," the tool, based on pre-set rules, first determines that its data storage is likely reliant on a public cloud distributed storage service. Next, by interacting with the public cloud storage service's interface, it queries the first computing platform for the data storage identifier or directory structure information within that storage service. After a series of query and analysis operations, the tool ultimately determines the storage path corresponding to the pending computing task.

[0140] In some embodiments, after determining a second computing power platform for executing the pending computing task from among the plurality of computing power platforms, the method further includes:

[0141] (3.1) When the second computing power platform has installed a preset data resource access tool, determining whether the preset data resource access tool installed by the second computing power platform is a historical version;

[0142] (3.2) When the preset data resource access tool installed on the second computing power platform is a historical version, the latest version of the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the latest version of the preset data resource access tool.

[0143] When the second computing power platform has installed the preset data resource access tool, determine whether the preset data resource access tool installed by the second computing power platform is a historical version. If it is determined that the preset data resource access tool installed by the second computing power platform is not a historical version but the latest version, proceed to step 240.

[0144] When the preset data resource access tool installed by the second computing power platform is a historical version, the latest version of the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the latest version of the preset data resource access tool.

[0145] This ensures that the preset data resource access tools installed on the second computing power platform are up to date, ensuring the stability of data transmission and loading, and ensuring the smooth progress of pending computing tasks.

[0146] In step 240, the computing task to be processed is sent to the second computing power platform, so that the second computing power platform accesses the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through a preset data resource access tool.

[0147] Among them, the computing task to be processed is sent to the second computing power platform, so that the second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through a preset data resource access tool.

[0148] For example, the second computing platform can first determine the storage path of the target data corresponding to the pending computing task. For example, if the data of the first computing platform is obtained by disk mounting, the second computing platform can load a preset data resource access tool to obtain the disk mount path and set this path as the resource access path for the target data corresponding to the pending computing task. The target data corresponding to the pending computing task can then be accessed through this path.

[0149] For example, if the first computing platform downloads data from an object storage system, the second computing platform can load a pre-set data resource access tool to obtain the download path from the object storage system and set that path as the resource access path for the target data corresponding to the pending computing task. The target data corresponding to the pending computing task can then be accessed through that path.

[0150] For example, if the data on the first computing platform is obtained through another data access method, the second computing platform can load a preset data resource access tool to obtain the other data access method and set the path as the resource access path for the target data corresponding to the pending computing task. The target data corresponding to the pending computing task can then be accessed through this path.

[0151] In some embodiments, sending the pending computing task to the second computing power platform so that the second computing power platform obtains the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through a preset data resource access tool includes:

[0152] (1.1) Obtaining the identity authentication information corresponding to the first computing power platform, and sending the identity authentication information to the second computing power platform according to the identity authentication interface corresponding to the preset data resource access tool in the second computing power platform;

[0153] (1.2) Receive the authentication result returned by the second computing power platform based on the authentication information;

[0154] (1.3) When the identity authentication result indicates a pass, the pending computing task is sent to the second computing power platform according to the task management interface corresponding to the preset data resource access tool in the second computing power platform, so that the second computing power platform obtains the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform according to the storage management interface corresponding to the preset data resource access tool.

[0155] Among them, the identity authentication information corresponding to the first computing power platform can specifically be the identity identifier corresponding to the first computing power platform, such as a hash value, and then the identity authentication information is sent to the second computing power platform according to the identity authentication interface corresponding to the preset data resource access tool in the second computing power platform. The second computing power platform can verify the identity authentication information, for example, it can determine the corresponding identification value based on the hash value and the corresponding hash algorithm, and match the identification value with the identification value pre-saved by the second computing power platform. When the identification value is the same as the identification value pre-saved by the second computing power platform, the identity authentication result is passed.

[0156] When the identity authentication result indicates pass, the pending computing task is sent to the second computing power platform according to the task management interface corresponding to the preset data resource access tool in the second computing power platform, so that the second computing power platform obtains the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform according to the storage management interface corresponding to the preset data resource access tool.

[0157] When the second computing power platform obtains the target data corresponding to the pending computing task, it can perform corresponding computing processing on the pending computing task to obtain the task processing result, and send the task processing result to the computing power service platform.

[0158] In step 250, the task processing result of the second computing power platform executing the computing task to be processed according to the target data is received, and the task processing result is sent to the first computing power platform through a preset data resource access tool.

[0159] The computing power service platform receives the task processing results of the second computing power platform executing the pending computing task based on the target data, and sends the task processing results to the first computing power platform via a preset data resource access tool. For example, by loading the corresponding interface of the preset data resource access tool of the first computing power platform, the task processing results are sent to the first computing power platform.

[0160] This enables the cross-computing power platform processing of computing tasks to be processed, thereby fully utilizing the computing power of the computing power platform and improving the efficiency of computing power utilization.

[0161] In an embodiment of the present application, a computing task processing request is received from a first computing power platform through a preset data resource access tool, and a computing task to be processed is determined based on the computing task processing request; a second computing power platform for executing the computing task to be processed is determined from multiple computing power platforms; when the second computing power platform has not installed the preset data resource access tool, the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the preset data resource access tool; the computing task to be processed is sent to the second computing power platform so that the second computing power platform accesses the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool; the task processing result of the second computing power platform executing the computing task to be processed according to the target data is received, and the task processing result is sent to the first computing power platform.

[0162] In this way, by installing a preset data resource access tool on the first computing power platform, when the first computing power platform needs other computing power platforms to help process computing tasks, it receives the computing task processing request sent by the first computing power platform through the preset data resource access tool, and determines the computing task to be processed based on the computing task processing request, and then determines the second computing power platform that executes the computing task to be processed, and installs the preset data resource access tool on the second computing power platform, and sends the computing task to be processed to the second computing power platform. The second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool. Finally, the second computing power platform executes the computing task to be processed according to the target data and sends the corresponding task processing result to the first computing power platform through the computing power service platform. In this way, access to the target data of the computing task to be processed between computing power platforms is achieved through the preset data resource access tool, avoiding the inability to achieve data access between computing power platforms due to the different construction types of the computing power platforms. After achieving target data sharing, the computing power platforms in this application can execute the computing task to be processed, thereby realizing computing power sharing between different computing power platforms.

[0163] See also Figure 4 , Figure 4 1 is another flow chart of the computing task allocation method provided in an embodiment of the present application. The computing task allocation method may include the following steps:

[0164] Step 301: Receive a computing task processing request sent by a first computing power platform through a preset data resource access tool, and determine a computing task to be processed according to the computing task processing request;

[0165] Step 302: Determine the required computing power when the pending computing task is executed;

[0166] Step 303: Determine the remaining computing power corresponding to each computing power platform among the multiple computing power platforms;

[0167] Step 304: Determine at least one computing power platform to be selected whose remaining computing power is greater than the required computing power, and determine the data transmission speed corresponding to each computing power platform to be selected;

[0168] Step 305: Determine the computing power platform with the highest data transmission speed as the second computing power platform for executing the computing task to be processed;

[0169] Step 306: When the second computing power platform does not have the preset data resource access tool installed, send the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool;

[0170] Step 307: Obtain the identity authentication information corresponding to the first computing power platform, and send the identity authentication information to the second computing power platform according to the identity authentication interface corresponding to the preset data resource access tool in the second computing power platform;

[0171] Step 308: Receive the identity authentication result returned by the second computing power platform based on the identity authentication information;

[0172] Step 309: When the identity authentication result indicates a pass, the pending computing task is sent to the second computing platform according to the task management interface corresponding to the preset data resource access tool in the second computing platform, so that the second computing platform obtains the target data corresponding to the pending computing task in the corresponding storage path of the first computing platform according to the storage management interface corresponding to the preset data resource access tool;

[0173] Step 310: Receive the task processing result of the second computing power platform executing the computing task to be processed according to the target data, and send the task processing result to the first computing power platform through the preset data resource access tool.

[0174] In the above embodiments, the description of each embodiment has its own focus. For the part that is not described in detail in a certain embodiment, please refer to the detailed description of the above computing task allocation method, which will not be repeated here.

[0175] See also Figure 5 , Figure 5 FIG1 is a schematic diagram of the structure of a computing task allocation device provided in an embodiment of the present application. The computing task allocation device is used to execute the computing task allocation method described above.

[0176] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or portion of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal. It can be implemented in whole or in part using software, hardware (such as processing circuits or memory), or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the functionality of the module or unit.

[0177] The computing task allocation device 400 includes:

[0178] A first receiving module 410 is configured to receive a computing task processing request sent by the first computing power platform via a preset data resource access tool, and determine a computing task to be processed based on the computing task processing request;

[0179] A determination module 420 is configured to determine a second computing power platform for executing the computing task to be processed from among the plurality of computing power platforms;

[0180] A first sending module 430 is configured to send the preset data resource access tool to the second computing power platform when the preset data resource access tool is not installed on the second computing power platform, so that the second computing power platform installs the preset data resource access tool;

[0181] The second sending module 440 is used to send the pending computing task to the second computing power platform, so that the second computing power platform can access the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through a preset data resource access tool;

[0182] The second receiving module 450 is used to receive the task processing result of the second computing power platform executing the computing task to be processed according to the target data, and send the task processing result to the first computing power platform through a preset data resource access tool.

[0183] In some implementations, the first sending module 430 is configured to:

[0184] Generate configuration instructions corresponding to the preset data resource access tool and send them to the second computing power platform;

[0185] Upon receiving the support configuration result returned by the second computing power platform, determining the installation area corresponding to the preset data resource access tool in the second computing power platform;

[0186] The preset data resource access tool is sent to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instructions.

[0187] In some implementations, the first sending module 430 is configured to:

[0188] Determine the data access variables corresponding to the computational tasks to be processed;

[0189] The data access variables and the preset data resource access tool are sent to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instructions, and loads the data access variables through the preset data resource access tool to determine the storage path corresponding to the task to be processed.

[0190] In some implementations, the first sending module 430 is configured to:

[0191] When receiving an unsupported configuration result returned by the second computing power platform, generating an image generation instruction for installing a preset data resource access tool;

[0192] The preset data resource access tool and the image generation instruction are sent to the second computing power platform, so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image.

[0193] In some implementations, the first sending module 430 is configured to:

[0194] After sending the preset data resource access tool and the image generation instruction to the second computing power platform, so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image, determining the platform construction type corresponding to the first computing power platform;

[0195] The platform construction type is sent to the second computing power platform, so that the second computing power platform analyzes the platform construction type through a preset data resource access tool and determines the storage path corresponding to the computing task to be processed.

[0196] In some implementations, the first sending module 430 is configured to:

[0197] After determining a second computing power platform for executing the pending computing task from among the plurality of computing power platforms, when the second computing power platform has installed a preset data resource access tool, determining whether the preset data resource access tool installed by the second computing power platform is a historical version;

[0198] When the preset data resource access tool installed by the second computing power platform is a historical version, the latest version of the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the latest version of the preset data resource access tool.

[0199] In some implementations, the determination module 420 is configured to:

[0200] Determine the required computing power when the pending computing task is executed;

[0201] Determine the remaining computing power corresponding to each computing power platform among multiple computing power platforms;

[0202] Determine at least one computing power platform to be selected whose remaining computing power is greater than the required computing power, and determine the data transmission speed corresponding to each computing power platform to be selected;

[0203] The computing power platform to be selected with the highest data transmission speed is determined as the second computing power platform for executing the computing task to be processed.

[0204] In some implementations, the second sending module 440 is configured to:

[0205] Obtain the identity authentication information corresponding to the first computing power platform, and send the identity authentication information to the second computing power platform according to the identity authentication interface of the data resource access tool preset in the second computing power platform;

[0206] Receive the identity verification result returned by the second computing power platform based on the identity verification information;

[0207] When the identity authentication result indicates pass, the pending computing task is sent to the second computing power platform according to the task management interface of the preset data resource access tool in the second computing power platform, so that the second computing power platform obtains the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform according to the storage management interface of the preset data resource access tool.

[0208] In the above embodiments, the description of each embodiment has its own focus. For the part that is not described in detail in a certain embodiment, please refer to the detailed description of the above computing task allocation method, which will not be repeated here.

[0209] In an embodiment of the present application, the first receiving module 410 receives a computing task processing request sent by the first computing power platform through a preset data resource access tool, and determines the computing task to be processed based on the computing task processing request; the determination module 420 determines a second computing power platform for executing the computing task to be processed from multiple computing power platforms; the first sending module 430 sends the preset data resource access tool to the second computing power platform when the second computing power platform has not installed the preset data resource access tool, so that the second computing power platform installs the preset data resource access tool; the second sending module 440 sends the computing task to be processed to the second computing power platform, so that the second computing power platform accesses the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool; the second receiving module 450 receives the task processing result of the second computing power platform executing the computing task to be processed according to the target data, and sends the task processing result to the first computing power platform through the preset data resource access tool.

[0210] In this way, by installing a preset data resource access tool on the first computing power platform, when the first computing power platform needs other computing power platforms to help process computing tasks, it receives the computing task processing request sent by the first computing power platform through the preset data resource access tool, and determines the computing task to be processed based on the computing task processing request, and then determines the second computing power platform that executes the computing task to be processed, and installs the preset data resource access tool on the second computing power platform, and sends the computing task to be processed to the second computing power platform. The second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool. Finally, the second computing power platform executes the computing task to be processed according to the target data and sends the corresponding task processing result to the first computing power platform through the computing power service platform. In this way, access to the target data of the computing task to be processed between computing power platforms is achieved through the preset data resource access tool, avoiding the inability to achieve data access between computing power platforms due to the different construction types of the computing power platforms. After achieving target data sharing, the computing power platforms in this application can execute the computing task to be processed, thereby realizing computing power sharing between different computing power platforms.

[0211] The present application also provides a computer device comprising a memory and a processor, wherein the memory stores a computer program, and the processor implements the above-described computing task allocation method when executing the computer program. The computer device can be any intelligent terminal including a tablet computer, an in-vehicle computer, or the like.

[0212] See also Figure 6 , Figure 6 The hardware structure of a computer device according to another embodiment is shown. The computer device includes:

[0213] The processor 501 may be implemented as a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application.

[0214] The memory 502 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 502 can store an operating system and other application programs. When the technical solutions provided in the embodiments of this specification are implemented through software or firmware, the relevant program code is stored in the memory 502 and is called by the processor 501 to execute the computing task allocation method of the embodiments of this application.

[0215] Input / output interface 503, used to implement information input and output;

[0216] Communication interface 504, used to implement communication interaction between this device and other devices, which can be achieved through wired means (such as USB, network cable, etc.) or wireless means (such as mobile network, WiFi, Bluetooth, etc.);

[0217] Bus 505 , which transmits information between various components of the device (e.g., processor 501 , memory 502 , input / output interface 503 , and communication interface 504 );

[0218] The processor 501 , the memory 502 , the input / output interface 503 and the communication interface 504 are connected to each other in communication within the device via a bus 505 .

[0219] An embodiment of the present application further provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the above-mentioned computing task allocation method is implemented.

[0220] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely arranged relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0221] The computing task allocation method, computing task allocation device, computer equipment and storage medium provided in the embodiments of the present application receive a computing task processing request sent by a first computing power platform through a preset data resource access tool, and determine a pending computing task based on the computing task processing request; determine a second computing power platform for executing the pending computing task from multiple computing power platforms; when the second computing power platform does not have the preset data resource access tool installed, send the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool; send the pending computing task to the second computing power platform so that the second computing power platform accesses the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through the preset data resource access tool; receive the task processing result of the second computing power platform executing the pending computing task based on the target data, and send the task processing result to the first computing power platform.

[0222] In this way, by installing a preset data resource access tool on the first computing power platform, when the first computing power platform needs other computing power platforms to help process computing tasks, it receives the computing task processing request sent by the first computing power platform through the preset data resource access tool, and determines the computing task to be processed based on the computing task processing request, and then determines the second computing power platform that executes the computing task to be processed, and installs the preset data resource access tool on the second computing power platform, and sends the computing task to be processed to the second computing power platform. The second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool. Finally, the second computing power platform executes the computing task to be processed according to the target data and sends the corresponding task processing result to the first computing power platform through the computing power service platform. In this way, access to the target data of the computing task to be processed between computing power platforms is achieved through the preset data resource access tool, avoiding the inability to achieve data access between computing power platforms due to the different construction types of the computing power platforms. After achieving target data sharing, the computing power platforms in this application can execute the computing task to be processed, thereby realizing computing power sharing between different computing power platforms.

[0223] The embodiments described in the embodiments of this application are intended to more clearly illustrate the technical solutions of the embodiments of this application and do not constitute a limitation on the technical solutions provided by the embodiments of this application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of this application are also applicable to similar technical problems.

[0224] Those skilled in the art will understand that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.

[0225] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate, i.e., they may be located in one place or distributed across multiple network units. Some or all of the modules may be selected based on actual needs to achieve the objectives of this embodiment.

[0226] Those skilled in the art will appreciate that all or some of the steps in the methods, systems, and functional modules / units in the devices disclosed above may be implemented as software, firmware, hardware, or appropriate combinations thereof.

[0227] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequential order. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0228] It should be understood that in this application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the previous and next associated objects are in an "or" relationship. "At least one of the following items" or similar expressions refers to any combination of these items, including any combination of single items or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.

[0229] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are merely schematic. For example, the division of the above-mentioned units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0230] The units described above as separate components may or may not be physically separate, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed across multiple network units. Some or all of these units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0231] In addition, the functional units in the various embodiments of the present application may be integrated into a single processing unit, or each unit may exist physically separately, or two or more units may be integrated into a single unit. The aforementioned integrated units may be implemented in the form of hardware or software functional units.

[0232] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes multiple instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: various media that can store programs, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0233] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but are not intended to limit the scope of the present invention. Any modifications, equivalent substitutions, and improvements made by those skilled in the art without departing from the scope and essence of the present invention should be within the scope of the present invention.

Claims

1. A computing task allocation method, characterized in that: include: Receiving a computing task processing request sent by a first computing power platform through a preset data resource access tool, and determining a computing task to be processed according to the computing task processing request, wherein the preset data resource access tool is connected to at least an authentication interface, a task management interface, and a storage management interface of the first computing power platform; Acquire resource usage status data of each computing power platform through a real-time monitoring interface established with each computing power platform, and determine a second computing power platform for executing the pending computing task from among the multiple computing power platforms based on the resource usage status data; When the second computing power platform does not have the preset data resource access tool installed, generating a configuration instruction corresponding to the preset data resource access tool and sending it to the second computing power platform; Upon receiving the support configuration result returned by the second computing power platform, determining an installation area corresponding to the preset data resource access tool in the second computing power platform; Determining a data access variable corresponding to the pending computing task; Sending the data access variable and the preset data resource access tool to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instruction, and loads the data access variable through the preset data resource access tool to determine the storage path corresponding to the pending computing task; When receiving an unsupported configuration result returned by the second computing power platform, generating an image generation instruction for installing the preset data resource access tool; Sending the preset data resource access tool and the image generation instruction to the second computing power platform, so that the second computing power platform generates a target image according to the image generation instruction, and installs the preset data resource access tool in the target image, wherein the preset data resource access tool is connected to at least the authentication interface, task management interface, and storage management interface of the second computing power platform; Sending the pending computing task to the second computing power platform, so that the second computing power platform accesses the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through the preset data resource access tool; Receive the task processing result of the second computing power platform executing the to-be-processed computing task according to the target data, and send the task processing result to the first computing power platform through the preset data resource access tool.

2. The computing task allocation method according to claim 1, characterized in that: After sending the preset data resource access tool and the image generation instruction to the second computing power platform so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image, the method further includes: Determining a platform construction type corresponding to the first computing power platform; The platform construction type is sent to the second computing power platform, so that the second computing power platform analyzes the platform construction type through the preset data resource access tool and determines the storage path corresponding to the computing task to be processed.

3. The computing task allocation method according to claim 1, characterized in that: After determining a second computing power platform for executing the pending computing task from a plurality of computing power platforms according to the resource usage status data, the method further includes: When the second computing power platform has installed the preset data resource access tool, determining whether the preset data resource access tool installed by the second computing power platform is a historical version; When the preset data resource access tool installed by the second computing power platform is a historical version, the latest version of the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the latest version of the preset data resource access tool.

4. The computing task allocation method according to claim 1, wherein: The determining, based on the resource usage status data, a second computing power platform for executing the pending computing task from among the plurality of computing power platforms includes: Determine the required computing power when the pending computing task is executed; Determine the remaining computing power corresponding to each computing power platform among multiple computing power platforms; Determine at least one to-be-selected computing power platform whose remaining computing power is greater than the required computing power, and determine a data transmission speed corresponding to each to-be-selected computing power platform; The computing power platform to be selected with the highest data transmission speed is determined as the second computing power platform for executing the computing task to be processed.

5. The computing task allocation method according to claim 1, wherein: The sending the pending computing task to the second computing power platform so that the second computing power platform accesses the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through the preset data resource access tool includes: Obtaining identity authentication information corresponding to the first computing power platform, and sending the identity authentication information to the second computing power platform according to the identity authentication interface corresponding to the preset data resource access tool in the second computing power platform; Receiving an identity authentication result returned by the second computing power platform based on the identity authentication information; When the identity authentication result indicates pass, the pending computing task is sent to the second computing power platform according to the task management interface corresponding to the preset data resource access tool in the second computing power platform, so that the second computing power platform obtains the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform according to the storage management interface corresponding to the preset data resource access tool.

6. A computing task allocation device, characterized in that: include: A first receiving module is configured to receive a computing task processing request sent by a first computing power platform via a preset data resource access tool, and determine a computing task to be processed based on the computing task processing request, wherein the preset data resource access tool is connected to at least an authentication interface, a task management interface, and a storage management interface of the first computing power platform; a determination module, configured to obtain resource usage status data of each computing power platform through a real-time monitoring interface established with each computing power platform, and determine a second computing power platform for executing the pending computing task from among the multiple computing power platforms based on the resource usage status data; a first sending module, configured to generate a configuration instruction corresponding to the preset data resource access tool and send the configuration instruction to the second computing power platform when the preset data resource access tool is not installed on the second computing power platform; Upon receiving the support configuration result returned by the second computing power platform, determining an installation area corresponding to the preset data resource access tool in the second computing power platform; Determining a data access variable corresponding to the pending computing task; Sending the data access variable and the preset data resource access tool to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instruction, and loads the data access variable through the preset data resource access tool to determine the storage path corresponding to the pending computing task; When receiving an unsupported configuration result returned by the second computing power platform, generating an image generation instruction for installing the preset data resource access tool; Sending the preset data resource access tool and the image generation instruction to the second computing power platform, so that the second computing power platform generates a target image according to the image generation instruction, and installs the preset data resource access tool in the target image, wherein the preset data resource access tool is connected to at least the authentication interface, task management interface, and storage management interface of the second computing power platform; a second sending module, configured to send the pending computing task to the second computing power platform, so that the second computing power platform accesses the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through the preset data resource access tool; The second receiving module is used to receive the task processing result of the second computing power platform executing the to-be-processed computing task according to the target data, and send the task processing result to the first computing power platform through the preset data resource access tool.

7. A computer-readable storage medium, characterized in that The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the computing task allocation method according to any one of claims 1 to 5.

8. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the computer program, the computing task allocation method according to any one of claims 1 to 5 is implemented.

Images