Computing task allocation method and device, computer equipment and storage medium
By installing preset data resource access tools between different computing power platforms, the problem of not being able to share computing power resources between different computing power platforms is solved, and cross-platform computing task processing and resource utilization are improved.
Patent Information
- Application Number
- CN202510287888.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2025-03-12
- Publication Date
- 2025-04-11
- Estimated Expiration
- 2045-03-12
AI Technical Summary
Due to the differences in technical standards and data loading paths between different computing power platforms, it is impossible to share computing power when processing data of artificial intelligence models, resulting in wasting of computing power resources.
By installing a preset data resource access tool on the first computing power platform, receiving a computing task processing request, determining a pending task, and installing the same tool on the second computing power platform to access the target data in the storage path of the first computing power platform, performing the task and returning the result.
The computing task processing across computing power platforms is realized, the utilization rate of computing power resources is improved, and data access barriers are avoided due to different platform construction types.
Smart Images

Figure CN119806787A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of computer technology, and in particular to a computing task allocation method, apparatus, computer equipment and storage medium. Background Art
[0002] The artificial intelligence model needs to be loaded on the corresponding computer device, and then the data to be processed is imported into the artificial intelligence model, and the data is processed through the computing power of the computer device and the data processing method of the artificial intelligence model.
[0003] In related technologies, in order to improve the efficiency of using the computing power of computer devices, cluster management software is usually used to perform virtualization management on multiple computer devices, thereby generating a computing power platform for users to use the computing power resources of different computer devices within the computing power platform.
[0004] However, different computing power platforms use different technical standards, and each computing power platform has different methods of loading and accessing data and models. This makes it impossible for different computing power platforms to share computing power when processing data for artificial intelligence models, resulting in some computing power platforms with sufficient computing power being unable to handle computing tasks of other computing power platforms, causing a waste of computing power resources. Summary of the invention
[0005] The embodiments of the present application provide a computing task allocation method, apparatus, computer equipment and storage medium, which can realize computing task processing across computing power platforms and improve the utilization rate of computing power resources of the computing power platforms.
[0006] In order to achieve the above-mentioned object, the first aspect of the present application provides a computing task allocation method, comprising: Receiving a computing task processing request sent by the first computing power platform through a preset data resource access tool, and determining a computing task to be processed according to the computing task processing request; Determining a second computing power platform for executing the computing task to be processed from a plurality of computing power platforms; When the second computing power platform has not installed the preset data resource access tool, sending the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool; Sending the pending computing task to the second computing power platform, so that the second computing power platform accesses the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through the preset data resource access tool; Receive the task processing result of the second computing power platform executing the to-be-processed computing task according to the target data, and send the task processing result to the first computing power platform through the preset data resource access tool.
[0007] In order to achieve the above-mentioned purpose, the second aspect of the present application provides a device for alleviating visual fatigue, comprising: A first receiving module is used to receive a computing task processing request sent by the first computing power platform through a preset data resource access tool, and determine a computing task to be processed according to the computing task processing request; A determination module, used to determine a second computing power platform for executing the computing task to be processed from multiple computing power platforms; A first sending module, configured to send the preset data resource access tool to the second computing power platform when the preset data resource access tool is not installed on the second computing power platform, so that the second computing power platform installs the preset data resource access tool; A second sending module is used to send the pending computing task to the second computing power platform, so that the second computing power platform can access the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through the preset data resource access tool; The second receiving module is used to receive the task processing result of the second computing power platform executing the to-be-processed computing task according to the target data, and send the task processing result to the first computing power platform through the preset data resource access tool.
[0008] In some implementations, the first sending module is configured to: Generate a configuration instruction corresponding to the preset data resource access tool and send it to the second computing power platform; When receiving the support configuration result returned by the second computing power platform, determining the installation area corresponding to the preset data resource access tool in the second computing power platform; The preset data resource access tool is sent to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instruction.
[0009] In some implementations, the first sending module is configured to: Determining a data access variable corresponding to the computing task to be processed; The data access variables and the preset data resource access tool are sent to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instructions, and loads the data access variables through the preset data resource access tool to determine the storage path corresponding to the task to be processed.
[0010] In some implementations, the first sending module is configured to: When receiving an unsupported configuration result returned by the second computing power platform, generating an image generation instruction for installing the preset data resource access tool; The preset data resource access tool and the image generation instruction are sent to the second computing power platform, so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image.
[0011] In some implementations, the first sending module is configured to: After sending the preset data resource access tool and the image generation instruction to the second computing power platform so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image, determining the platform construction type corresponding to the first computing power platform; The platform construction type is sent to the second computing power platform, so that the second computing power platform analyzes the platform construction type through the preset data resource access tool and determines the storage path corresponding to the computing task to be processed.
[0012] In some implementations, the first sending module is configured to: After determining a second computing power platform for executing the to-be-processed computing task from among the multiple computing power platforms, when the second computing power platform has installed the preset data resource access tool, determining whether the preset data resource access tool installed by the second computing power platform is a historical version; When the preset data resource access tool installed by the second computing power platform is a historical version, the latest version of the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the latest version of the preset data resource access tool.
[0013] In some embodiments, a determination module is used to: Determine the required computing power when the pending computing task is executed; Determine the remaining computing power corresponding to each computing power platform among multiple computing power platforms; Determine at least one computing power platform to be selected whose remaining computing power is greater than the required computing power, and determine the data transmission speed corresponding to each computing power platform to be selected; The computing power platform to be selected with the highest data transmission speed is determined as the second computing power platform for executing the computing task to be processed.
[0014] In some implementations, the second sending module is configured to: Obtaining identity authentication information corresponding to the first computing power platform, and sending the identity authentication information to the second computing power platform according to the identity authentication interface corresponding to the preset data resource access tool in the second computing power platform; Receiving the identity authentication result returned by the second computing power platform according to the identity authentication information; When the identity authentication result indicates pass, the pending computing task is sent to the second computing power platform according to the task management interface corresponding to the preset data resource access tool in the second computing power platform, so that the second computing power platform obtains the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform according to the storage management interface corresponding to the preset data resource access tool.
[0015] In order to achieve the above-mentioned purpose, the third aspect of the present application provides a computer-readable storage medium, which stores multiple instructions, and the instructions are suitable for a processor to load to execute the computing task allocation method provided in an embodiment of the present application.
[0016] In order to achieve the above-mentioned objectives, the fourth aspect of the present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor implements the computing task allocation method provided in the embodiment of the present application when executing the computer program.
[0017] In an embodiment of the present application, a computing task processing request is received from a first computing power platform through a preset data resource access tool, and a computing task to be processed is determined according to the computing task processing request; a second computing power platform for executing the computing task to be processed is determined from multiple computing power platforms; when the second computing power platform has not installed the preset data resource access tool, the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the preset data resource access tool; the computing task to be processed is sent to the second computing power platform so that the second computing power platform accesses the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool; the task processing result of the second computing power platform executing the computing task to be processed according to the target data is received, and the task processing result is sent to the first computing power platform.
[0018] In this way, by installing a preset data resource access tool on the first computing power platform, when the first computing power platform needs other computing power platforms to help process computing tasks, it receives the computing task processing request sent by the first computing power platform through the preset data resource access tool, and determines the computing task to be processed according to the computing task processing request, and then determines the second computing power platform that executes the computing task to be processed, and installs the preset data resource access tool on the second computing power platform, sends the computing task to be processed to the second computing power platform, and the second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool. Finally, the second computing power platform executes the computing task to be processed according to the target data, and sends the corresponding task processing result to the first computing power platform through the computing power service platform. In this way, the access to the target data of the computing task to be processed between the computing power platforms is realized through the preset data resource access tool, which avoids the inability to realize data access between the computing power platforms due to the different construction types of the computing power platforms. After realizing the sharing of target data, the computing power platforms in this application can execute the computing task to be processed, thereby realizing the computing power sharing between different computing power platforms.
[0019] Other features and advantages of the present application will be described in the following description, and partly become apparent from the description, or understood by practicing the present application. The purpose and other advantages of the present application can be realized and obtained by the structures specifically pointed out in the description, claims and drawings. BRIEF DESCRIPTION OF THE DRAWINGS
[0020] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0021] Figure 1 It is a schematic diagram of the system framework corresponding to the computing task allocation method provided in the embodiment of the present application; Figure 2 It is a schematic diagram of a scenario corresponding to the computing task allocation method provided in an embodiment of the present application; Figure 3 It is a flowchart of a computing task allocation method provided in an embodiment of the present application; Figure 4 is another flowchart of the computing task allocation method provided in an embodiment of the present application; Figure 5 is a schematic diagram of the structure of a device for alleviating visual fatigue provided in an embodiment of the present application; Figure 6It is a schematic diagram of the structure of a computer device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0022] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present application.
[0023] It is understandable that in the specific implementation of the present application, data related to the computing tasks to be processed is involved. When the above embodiments of the present application are applied to specific products or technologies, user permission or consent is required, and the collection, use and processing of relevant data must comply with relevant laws, regulations and standards.
[0024] It should be noted that in some processes described in the specification, claims and the above-mentioned drawings, multiple steps appearing in a specific order are included, but it should be clearly understood that these steps may not be executed in the order in which they appear in this document or may be executed in parallel. The step numbers are only used to distinguish different steps, and the numbers themselves do not represent any execution order. In addition, descriptions such as "first", "second" or "target" in this document are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.
[0025] The embodiments of the present application provide a method, device, computer equipment and storage medium for allocating computing tasks. Specifically, the embodiments of the present application will be described from the dimension of the computing task allocation device, which can be integrated in the computer equipment, which can be a server or a terminal and other equipment. Among them, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms. Among them, the terminal can be a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart speaker, a smart watch, a smart home appliance, a car terminal, an intelligent voice interaction device, an aircraft, etc., but is not limited to this. The embodiments of the present application can be applied to various scenarios, including but not limited to cloud office, enterprise management, etc.
[0026] Before further describing the embodiments of the present application in detail, the nouns and terms involved in the embodiments of the present application are explained. The nouns and terms involved in the embodiments of the present application are subject to the following interpretations: Computing power platform: A computing power platform is a service platform that provides computing power. Computing power refers to the ability of a computer device to complete a specific task by processing data. Its size represents the computing efficiency of the computer system. The computing power platform integrates a large number of computing resources, including hardware resources such as central processing units and graphics processing units, and integrates and manages these resources through technologies such as virtualization and containerization. These resources can be used by users in a flexible way. For example, through the cloud computing service model, users can apply for corresponding computing resources according to their needs.
[0027] Computing power service platform: used to interconnect computing power platforms scattered in multiple locations through the network, and provide computing power services to the outside world based on a unified service platform.
[0028] The above is an introduction to the relevant terms involved in this application.
[0029] First, the technical problems existing in the related technologies in this application are described: The artificial intelligence model needs to be loaded on the corresponding computer device, and then the data to be processed is imported into the artificial intelligence model, and the data is processed through the computing power of the computer device and the data processing method of the artificial intelligence model.
[0030] In related technologies, in order to improve the efficiency of using the computing power of computer devices, cluster management software is usually used to perform virtualization management on multiple computer devices, thereby generating a computing power platform for users to use the computing power resources of different computer devices within the computing power platform.
[0031] However, different computing power platforms use different technical standards, and each computing power platform has different methods of loading and accessing data and models. This makes it impossible for different computing power platforms to share computing power when processing data for artificial intelligence models, resulting in some computing power platforms with sufficient computing power being unable to handle computing tasks of other computing power platforms, causing a waste of computing power resources.
[0032] For example, the computing power platform built based on ModelArts technology and the computing power platform built based on the corresponding technology of Qizhi Octopus, due to the differences in the construction technology codes, the two computing power platforms cannot achieve data sharing, which leads to the inability to share computing power between the two computing power platforms.
[0033] In order to solve the above technical problems, the embodiments of the present application provide a computing task allocation method, device, computer equipment and storage medium. By installing a preset data resource access tool on the first computing power platform, when the first computing power platform needs other computing power platforms to help process computing tasks, the computing task processing request sent by the first computing power platform through the preset data resource access tool is received, and the computing task to be processed is determined according to the computing task processing request, and then the second computing power platform that executes the computing task to be processed is determined, and the preset data resource access tool is installed on the second computing power platform, and the computing task to be processed is sent to the second computing power platform. The second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool. Finally, the second computing power platform executes the computing task to be processed according to the target data, and sends the corresponding task processing result to the first computing power platform through the computing power service platform. In this way, access to target data of pending computing tasks between computing power platforms is achieved through a preset data resource access tool, avoiding the inability to achieve data access between computing power platforms due to different construction types of computing power platforms. After achieving target data sharing, the computing power platforms in this application can execute pending computing tasks, thereby realizing computing power sharing between different computing power platforms.
[0034] The computing task allocation method, apparatus, computer equipment and storage medium will be described in detail below.
[0035] See also Figure 1 , Figure 1 1 is a schematic diagram of a system framework corresponding to the computing task allocation method provided in the embodiment of the present application. The computing task allocation method provided in the embodiment of the present application can be applied to the system framework.
[0036] It includes a terminal 140, the Internet 130, a gateway 120, a server 110, and the like.
[0037] The terminal 140 or the server 110 may be a device for executing the computing task allocation method.
[0038] The terminal 140 includes but is not limited to mobile phones, computers, intelligent voice interaction devices, smart home appliances, vehicle terminals, aircraft, etc. The embodiments of the present application can be applied to various scenarios, including but not limited to model training, model prediction, etc. In addition, it can be a single device or a combination of multiple devices. For example, multiple desktop computers are interconnected through a local area network, share a display, etc. to work together, and together constitute a terminal 140. The terminal 140 can communicate with the Internet 130 in a wired or wireless manner to exchange data.
[0039] The server 110 refers to a computer system that can provide certain services to the terminal 140. Compared with the ordinary terminal 140, the server 110 has higher requirements in terms of stability, security, performance, etc. The server 110 can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.
[0040] The gateway 120 is also called an internetwork connector or a protocol converter. The gateway realizes network interconnection at the transport layer and is a computer system or device that acts as a converter. The gateway is a translator between two systems that use different communication protocols, data formats or languages, or even completely different architectures. At the same time, the gateway can also provide filtering and security functions. The message sent by the terminal 140 to the server 110 must be sent to the corresponding server 110 through the gateway 120. The message sent by the server 110 to the terminal 140 must also be sent to the corresponding terminal 140 through the gateway 120.
[0041] The computing task allocation method in the embodiment of the present application can be applied to a variety of scenarios, such as model training, model prediction, etc. The scenarios to which the computing task allocation method in the present application is applied are not limited here.
[0042] See also Figure 2 , Figure 2 It is a scenario diagram corresponding to the computing task allocation method provided in the embodiment of the present application.
[0043] Among them, the first computing power platform and the second computing power platform are platforms that provide computing power to process computing tasks, and the computing power service platform is a platform that dispatches the computing power of different computing power platforms to process computing tasks.
[0044] The computing power resource sharing between the first computing power platform and the second computing power platform is mainly based on the preset data resource access tool, which can be understood as a development toolkit (SDK, Software Development Kit). The preset data resource access tool provides users with a method to access the code directory, data directory, model directory, and training result directory related to the computing task. Based on the preset data resource access tool, users do not need to pay attention to which platform the computing task is executed.
[0045] like Figure 2As shown, the preset data resource access tool corresponds to the identity authentication interface, task management interface and storage management interface. In the first computing power platform, the identity authentication interface, task management interface and storage management interface are specifically provided by the first computing power platform, and the preset data resource access tool can call these interfaces. In the second computing power platform, the identity authentication interface, task management interface and storage management interface are specifically provided by the second computing power platform, and the preset data resource access tool can call these interfaces.
[0046] Among them, the authentication interface is used to implement user security authentication and obtain access rights to the task management interface and storage management interface. The task management interface is used to manage computing tasks, including creating AI tasks, viewing AI tasks, and deleting AI tasks. The storage management interface manages storage resources, including uploading data, downloading data, etc. The data here refers to electronic resources, including data set files, code files, and model files required for AI training.
[0047] The computing power service platform connects to these interfaces of each computing power platform to achieve interconnection and task scheduling of different computing power platforms. When actually processing computing tasks, different computing power platforms can access data through preset data resource access tools and these interfaces, thereby executing corresponding computing tasks and sharing computing power, thus improving the utilization rate of computing power resources between different computing power platforms.
[0048] See also Figure 3 , Figure 3 : is a flow chart of a computing task allocation method provided in an embodiment of the present application. The computing task allocation method may include the following steps: Step 210: receiving a computing task processing request sent by the first computing power platform through a preset data resource access tool, and determining a computing task to be processed according to the computing task processing request; Step 220: Determine a second computing power platform for executing the computing task to be processed from among the multiple computing power platforms; Step 230: When the second computing power platform has not installed the preset data resource access tool, send the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool; Step 240: Send the computing task to be processed to the second computing power platform, so that the second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through a preset data resource access tool; Step 250: Receive the task processing result of the second computing power platform executing the computing task to be processed according to the target data, and send the task processing result to the first computing power platform through a preset data resource access tool.
[0049] The following will describe in detail steps 210 to 250. The entire computing task allocation method will be described from the perspective of the computing power service platform.
[0050] In step 210, a computing task processing request sent by the first computing power platform through a preset data resource access tool is received, and a computing task to be processed is determined according to the computing task processing request.
[0051] Among them, the first computing power platform can process related computing tasks, such as the computing tasks corresponding to the training of artificial intelligence models, and the prediction tasks of artificial intelligence models. When the first computing power platform processes more computing tasks at the same time, the computing power of the first computing power platform is used more, resulting in the pending computing tasks being queued for processing and unable to be processed in time. Therefore, it is necessary to give the pending computing tasks to other platforms for further processing.
[0052] A preset data resource access tool is installed in the first computing power platform. The preset data resource access tool is equivalent to a bridge in the process of processing computing tasks between computing power platforms. It can realize data access and data transmission between different computing power platforms, thereby realizing the distribution of computing tasks between different computing power platforms and realizing computing power sharing between different computing power platforms.
[0053] In some implementations, the computing power service platform may receive a computing task processing request sent by the first computing power platform through a preset data resource access tool, and determine a computing task to be processed based on the computing task processing request.
[0054] For example, when the First Computing Platform needs to process a computing task, it sends out a computing task processing request through a preset data resource access tool in accordance with the established communication protocol and data format. The request contains a detailed description of the task, such as the task type (data mining, image recognition, or other types), data source, expected computing result format, and task priority.
[0055] The computing power service platform can continuously monitor the port from the preset data resource access tool. When receiving a request, it first verifies the legitimacy of the request to check whether the format of the request complies with the regulations, whether the data is complete, whether there is an encrypted signature, etc. After the verification is passed, a special parsing program is used to extract the various information in the request according to the data format specification.
[0056] Then, the computing power service platform extracts the core computing task content from the request based on the parsed request information. For example, if it is a data mining task, determine the key parameters such as the data table, field, and mining algorithm to be mined; if it is an image recognition task, clarify the source path of the image, the target category to be recognized, etc. These key information are organized into a pending computing task object, which contains all the necessary information required for task execution. At the same time, the task information is recorded in the task management database to facilitate subsequent task follow-up and management.
[0057] Finally, the computing power service platform sends a response message to the first computing power platform to confirm receipt, informing the other party that the request has been successfully received. After that, according to the process of the task management system, the pending computing tasks are assigned to the appropriate computing resources (the second computing power receipt) and ready to start executing the computing tasks. During the task execution process, the task status is continuously monitored and the task progress is promptly fed back to the first computing power platform.
[0058] In step 220, a second computing power platform for executing the computing task to be processed is determined from among multiple computing power platforms.
[0059] Among them, the computing power service platform is connected to multiple computing power platforms. The computing power service platform can specifically analyze the second computing power platform suitable for executing the computing tasks to be processed from the multiple computing power platforms according to the real-time operation status of each computing power platform.
[0060] For example, the computing power service platform establishes and continuously updates a computing power platform information database, which records in detail the key information of multiple computing power platforms. This information includes the computing power of each computing power platform, such as the number of CPU cores and GPU performance parameters; storage capacity and read and write speed; network bandwidth and latency; current load status, that is, the number of tasks running and the proportion of computing resources occupied; service quality indicators, such as task execution success rate and average execution time, etc.
[0061] When there is a computing task to be processed, the computing power service platform first conducts a comprehensive analysis of it. It analyzes the type of task to determine whether it is a complex scientific calculation, large-scale data processing, or an image or video processing task with high real-time requirements. It determines the data size of the task and estimates the required computing resources and storage requirements. It determines the time limit of the task, whether it is an urgent task that needs to be executed immediately, or an ordinary task that can be completed within a certain time window.
[0062] The computing power service platform selects appropriate computing power platforms based on the needs of the computing tasks to be processed and the information of each computing power platform. For computing-intensive tasks, priority is given to computing power platforms with strong computing power and low current load; for tasks with large data volumes, emphasis is placed on selecting platforms with large storage capacity and fast read and write speeds. For tasks with high real-time requirements, focus is placed on platforms with low network latency.
[0063] Finally, the second computing power platform used to execute the pending computing tasks is determined according to the preset selection strategy. If you pursue high efficiency in task execution, select the platform with the shortest estimated completion time; if you pay more attention to cost control, select the platform with the lowest cost and that can meet the basic requirements of the task. After determining the platform, the task scheduling system sends a task execution request to the second computing power platform and transmits the task-related information, including task details, data sources, etc. At the same time, the corresponding relationship between the task and the selected computing power platform is recorded in the task management system for subsequent follow-up and management.
[0064] In some implementations, determining a second computing power platform for executing the computing task to be processed from a plurality of computing power platforms includes: (1.1) Determine the required computing power when the pending computing task is executed; (1.2) Determine the remaining computing power corresponding to each computing power platform among multiple computing power platforms; (1.3) Determine at least one computing power platform to be selected whose remaining computing power is greater than the required computing power, and determine the data transmission speed corresponding to each computing power platform to be selected; (1.4) The computing power platform with the highest data transmission speed is determined as the second computing power platform for executing the computing task to be processed.
[0065] For example, we analyze the behavior data of massive users watching videos to optimize the video recommendation model. We can first analyze the computing tasks to be processed and conduct a detailed analysis of the computing tasks submitted by the video company. This task needs to process the viewing behavior data of all users for nearly a month, with a data volume of 500TB, involving complex machine learning algorithms, including data cleaning, feature engineering, model training and evaluation, and other links.
[0066] Based on historical experience data of similar tasks and theoretical models of algorithm complexity, the platform's resource estimation system estimates the required computing power. According to calculations, completing this task requires at least 2,000 high-performance CPU cores to be continuously and stably provided, and a total of 50TB of memory space for data processing and intermediate result storage, that is, the required computing power is 2,000 CPU cores and 50TB of memory.
[0067] The computing power service platform obtains the resource usage status data of each platform regularly through the real-time monitoring interface established with each cooperative computing power platform. These data include CPU usage, memory occupancy, storage usage, etc. Based on the collected data, the remaining computing power of each computing power platform is calculated. Taking computing power platform A as an example, the platform provides a total of 10,000 CPU cores and 200TB of memory. Currently, 4,000 CPU cores and 80TB of memory are in use, so its remaining computing power is 6,000 CPU cores and 120TB of memory. The same method is used to calculate that computing power platform B has 1,500 CPU cores and 30TB of memory remaining, and computing power platform C has 3,000 CPU cores and 60TB of memory remaining.
[0068] Compare the remaining computing power of each computing power platform with the required computing power. For example, computing power platform A has 6,000 CPU cores and 120TB of memory remaining, and computing power platform C has 3,000 CPU cores and 60TB of memory remaining, both of which meet the required computing power requirements. Therefore, computing power platform A and computing power platform C are determined as the computing power platforms to be selected. Computing power platform B is excluded because the remaining number of CPU cores is 1,500, which is less than the required 2,000, and the remaining memory is 30TB, which is less than the required 50TB.
[0069] Finally, according to the data transmission speed comparison results, the data transmission speed of computing platform C (15GB / s) is greater than the 10GB / s of computing platform A. Therefore, the computing service platform determines computing platform C as the second computing platform for executing the pending computing tasks.
[0070] In step 230, when the second computing power platform has not installed the preset data resource access tool, the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the preset data resource access tool.
[0071] It should be noted that when the second computing power platform has not installed the preset data resource access tool, it is necessary to install the preset data resource access tool on the second computing power platform so that the subsequent second computing power platform can obtain the target data corresponding to the computing task to be processed according to the preset data resource access tool.
[0072] In some implementations, sending the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool includes: (1.1) Generate configuration instructions corresponding to the preset data resource access tool and send them to the second computing power platform; (1.2) upon receiving the support configuration result returned by the second computing power platform, determining the installation area corresponding to the preset data resource access tool in the second computing power platform; (1.3) Sending the preset data resource access tool to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instruction.
[0073] Among them, a configuration instruction corresponding to the preset data resource access tool can be generated, and the configuration instruction is used to guide the second computing power platform to install the preset data resource access tool in the corresponding installation area, and the configuration instruction is sent to the second computing power platform. After receiving the configuration instruction, the second computing power platform can try to execute the configuration instruction. If the configuration instruction is supported, the configuration result of supporting the configuration instruction is returned to the computing power service platform.
[0074] When the computing power service platform receives the support configuration result returned by the second computing power platform, it determines the installation area corresponding to the preset data resource access tool in the second computing power platform, such as installing it to a specified directory specified by the second computing power platform, such as the storage directory / data / sdk / c2net.whl.
[0075] The preset data resource access tool is then sent to the installation area corresponding to the second computing power platform, so that the second computing power platform can install the preset data resource access tool in the installation area according to the configuration instructions, such as sending it to the installation area " / data / sdk / c2net.whl" corresponding to the second computing power platform through a high-speed and stable network transmission channel. After the installation package arrives, the second computing power platform automatically executes the installation program according to the configuration instructions received previously. During the installation process, the second computing power platform places the executable file of the preset data resource access tool in the specified directory and grants the corresponding execution permissions. After the installation is completed, the second computing power platform will also automatically perform simple functional tests to ensure that the preset data resource access tool can operate normally, such as trying to connect to the specified data storage location, reading a small amount of test data, etc. If the test is successful, the installation success information will be fed back to the computing power service platform.
[0076] In some implementations, sending the preset data resource access tool to the installation area corresponding to the second computing power platform so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instruction includes: (1.3.1) Determine the data access variables corresponding to the computational tasks to be processed; (1.3.2) Sending the data access variables and the preset data resource access tool to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instructions, and loads the data access variables through the preset data resource access tool to determine the storage path corresponding to the task to be processed.
[0077] Among them, the data access variable corresponding to the computing task to be processed is used to guide the second computing power platform to obtain the target data of the computing task to be processed in the corresponding storage path of the first computing power platform.
[0078] The computing power service platform determines the data access variables corresponding to the computing tasks to be processed, and then sends the data access variables and the preset data resource access tool to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instructions, and loads the data access variables through the preset data resource access tool to determine the storage path corresponding to the tasks to be processed.
[0079] For example, the second computing power platform can load data access variables through a preset data resource access tool to determine the value corresponding to the data access variable, and then decide how to load and access the target data of the computing task to be processed based on the value corresponding to the data access variable.
[0080] In some implementations, sending the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool includes: (2.1) upon receiving an unsupported configuration result returned by the second computing power platform, generating an image generation instruction for installing a preset data resource access tool; (2.2) Sending the preset data resource access tool and the image generation instruction to the second computing power platform, so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image.
[0081] When receiving the unsupported configuration result returned by the second computing power platform, it means that the second computing power platform does not support the installation of the preset data resource access tool through the configuration instruction, and there is no installation area corresponding to the preset data resource access tool in the second computing power platform. At this time, an image generation instruction for installing the preset data resource access tool can be generated, and the preset data resource access tool and the image generation instruction can be sent to the second computing power platform, so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image.
[0082] For example, after receiving the image generation instruction, the second computing power platform can generate an image according to the image generation instruction, and the image is equivalent to a container, and the container is the installation environment corresponding to the preset data resource access tool. Finally, the preset data resource access tool is installed in the image.
[0083] In some embodiments, after sending the preset data resource access tool and the image generation instruction to the second computing power platform so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image, it also includes: (2.2.1) Determine the platform construction type corresponding to the first computing power platform; (2.2.2) Sending the platform construction type to the second computing power platform, so that the second computing power platform analyzes the platform construction type through a preset data resource access tool and determines the storage path corresponding to the computing task to be processed.
[0084] For example, the First Computing Power Platform adopts a distributed computing architecture built on public cloud resources, utilizing elastic computing instances and distributed storage services provided by cloud service providers. Its platform construction type can be identified as "public cloud distributed architecture."
[0085] After receiving the platform construction type information, the second computing power platform calls the preset data resource access tool for analysis. The tool has preset rules and mapping relationships for determining storage paths for different platform construction types. Because it is known that the first computing power platform is a "public cloud distributed architecture", according to the preset rules, the tool first determines that its data storage is likely to rely on the public cloud's distributed storage service. Then, by interacting with the interface of the public cloud storage service, query the data storage identifier or directory structure information of the first computing power platform in the storage service. After a series of query and analysis operations, the storage path corresponding to the computing task to be processed is finally determined.
[0086] In some implementations, after determining a second computing power platform for executing the computing task to be processed from among the multiple computing power platforms, the method further includes: (3.1) When the second computing power platform has installed a preset data resource access tool, determining whether the preset data resource access tool installed by the second computing power platform is a historical version; (3.2) When the preset data resource access tool installed by the second computing power platform is a historical version, the latest version of the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the latest version of the preset data resource access tool.
[0087] When the second computing power platform has installed the preset data resource access tool, determine whether the preset data resource access tool installed by the second computing power platform is a historical version. If it is determined that the preset data resource access tool installed by the second computing power platform is not a historical version but the latest version, proceed to step 240.
[0088] When the preset data resource access tool installed by the second computing power platform is a historical version, the latest version of the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the latest version of the preset data resource access tool.
[0089] This ensures that the preset data resource access tool installed on the second computing power platform is the latest, and ensures the stability of data transmission and loading, so as to ensure the smooth progress of the pending computing tasks.
[0090] In step 240, the computing task to be processed is sent to the second computing power platform, so that the second computing power platform accesses the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through a preset data resource access tool.
[0091] Among them, the computing tasks to be processed are sent to the second computing power platform, so that the second computing power platform can access the target data corresponding to the computing tasks to be processed in the corresponding storage path of the first computing power platform through a preset data resource access tool.
[0092] For example, the second computing power platform can first determine the storage path of the target data corresponding to the computing task to be processed. For example, if the data of the first computing power platform is obtained by disk mounting, the second computing power platform obtains the disk mounting path by loading the preset data resource access tool, and sets the path as the resource access path of the target data corresponding to the computing task to be processed. Then, the target data corresponding to the computing task to be processed is accessed through the path.
[0093] For another example, if the data of the first computing power platform is obtained by downloading from the object storage, the second computing power platform obtains the download method from the object storage by loading the preset data resource access tool, and sets the path as the resource access path of the target data corresponding to the computing task to be processed. Then, the target data corresponding to the computing task to be processed is accessed through the path.
[0094] For another example, if the data of the first computing power platform is obtained by other data access methods, the second computing power platform obtains other data access methods by loading the preset data resource access tool, sets the path as the resource access path of the target data corresponding to the computing task to be processed, and then accesses the target data corresponding to the computing task to be processed through the path.
[0095] In some implementations, sending the computing task to be processed to the second computing power platform so that the second computing power platform obtains the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through a preset data resource access tool includes: (1.1) Obtaining identity authentication information corresponding to the first computing power platform, and sending the identity authentication information to the second computing power platform according to the identity authentication interface corresponding to the preset data resource access tool in the second computing power platform; (1.2) receiving the identity authentication result returned by the second computing power platform based on the identity authentication information; (1.3) When the identity authentication result indicates a pass, the computing task to be processed is sent to the second computing power platform according to the task management interface corresponding to the preset data resource access tool in the second computing power platform, so that the second computing power platform obtains the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform according to the storage management interface corresponding to the preset data resource access tool.
[0096] Among them, the identity authentication information corresponding to the first computing power platform can specifically be the identity identifier corresponding to the first computing power platform, such as a hash value, and then the identity authentication information is sent to the second computing power platform according to the identity authentication interface corresponding to the preset data resource access tool in the second computing power platform. The second computing power platform can verify the identity authentication information, for example, it can determine the corresponding identification value according to the hash value and the corresponding hash algorithm, and match the identification value with the identification value pre-saved by the second computing power platform. When the identification value is the same as the identification value pre-saved by the second computing power platform, the identity authentication result is passed.
[0097] When the identity authentication result indicates pass, the computing task to be processed is sent to the second computing power platform according to the task management interface corresponding to the preset data resource access tool in the second computing power platform, so that the second computing power platform obtains the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform according to the storage management interface corresponding to the preset data resource access tool.
[0098] When the second computing power platform obtains the target data corresponding to the pending computing task, it can perform corresponding computing processing on the pending computing task to obtain the task processing result, and send the task processing result to the computing power service platform.
[0099] In step 250, the task processing result of the second computing power platform executing the computing task to be processed according to the target data is received, and the task processing result is sent to the first computing power platform through a preset data resource access tool.
[0100] The computing power service platform receives the task processing result of the second computing power platform executing the pending computing task according to the target data, and sends the task processing result to the first computing power platform through the preset data resource access tool. For example, by loading the corresponding interface by loading the preset data resource access tool of the first computing power platform, the task processing result is sent to the first computing power platform.
[0101] In this way, cross-computing power platform processing is achieved for computing tasks to be processed, thereby making full use of the computing power of the computing power platform and improving the efficiency of computing power utilization.
[0102] In an embodiment of the present application, a computing task processing request is received from a first computing power platform through a preset data resource access tool, and a computing task to be processed is determined according to the computing task processing request; a second computing power platform for executing the computing task to be processed is determined from multiple computing power platforms; when the second computing power platform has not installed the preset data resource access tool, the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the preset data resource access tool; the computing task to be processed is sent to the second computing power platform so that the second computing power platform accesses the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool; the task processing result of the second computing power platform executing the computing task to be processed according to the target data is received, and the task processing result is sent to the first computing power platform.
[0103] In this way, by installing a preset data resource access tool on the first computing power platform, when the first computing power platform needs other computing power platforms to help process computing tasks, it receives the computing task processing request sent by the first computing power platform through the preset data resource access tool, and determines the computing task to be processed according to the computing task processing request, and then determines the second computing power platform that executes the computing task to be processed, and installs the preset data resource access tool on the second computing power platform, sends the computing task to be processed to the second computing power platform, and the second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool. Finally, the second computing power platform executes the computing task to be processed according to the target data, and sends the corresponding task processing result to the first computing power platform through the computing power service platform. In this way, the access to the target data of the computing task to be processed between the computing power platforms is realized through the preset data resource access tool, which avoids the inability to realize data access between the computing power platforms due to the different construction types of the computing power platforms. After realizing the sharing of target data, the computing power platforms in this application can execute the computing task to be processed, thereby realizing the computing power sharing between different computing power platforms.
[0104] See also Figure 4 , Figure 4 1 is another flow chart of the computing task allocation method provided in the embodiment of the present application. The computing task allocation method may include the following steps: Step 301: receiving a computing task processing request sent by a first computing power platform through a preset data resource access tool, and determining a computing task to be processed according to the computing task processing request; Step 302: Determine the required computing power corresponding to the execution of the pending computing task; Step 303: Determine the remaining computing power corresponding to each computing power platform among the multiple computing power platforms; Step 304: determine at least one computing power platform to be selected whose remaining computing power is greater than the required computing power, and determine the data transmission speed corresponding to each computing power platform to be selected; Step 305: Determine the computing power platform to be selected with the highest data transmission speed as the second computing power platform for executing the computing task to be processed; Step 306: When the second computing power platform has not installed the preset data resource access tool, send the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool; Step 307: Obtain identity authentication information corresponding to the first computing power platform, and send the identity authentication information to the second computing power platform according to the identity authentication interface corresponding to the preset data resource access tool in the second computing power platform; Step 308: Receive the identity authentication result returned by the second computing power platform according to the identity authentication information; Step 309: When the identity authentication result indicates a pass, the computing task to be processed is sent to the second computing power platform according to the task management interface corresponding to the preset data resource access tool in the second computing power platform, so that the second computing power platform obtains the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform according to the storage management interface corresponding to the preset data resource access tool; Step 310: Receive the task processing result of the second computing power platform executing the computing task to be processed according to the target data, and send the task processing result to the first computing power platform through a preset data resource access tool.
[0105] In the above embodiments, the description of each embodiment has its own emphasis. For the part that is not described in detail in a certain embodiment, please refer to the detailed description of the above computing task allocation method, which will not be repeated here.
[0106] See also Figure 5 , Figure 5 1 is a schematic diagram of the structure of the visual fatigue relief device provided in the embodiment of the present application. The computing task allocation device is used to execute the computing task allocation method described above.
[0107] In the embodiments of the present application, the term "module" or "unit" refers to a computer program or a part of a computer program that has a predetermined function and works together with other related parts to achieve a predetermined goal, and can be implemented in whole or in part by using software, hardware (such as processing circuits or memories), or a combination thereof. Similarly, a processor (or multiple processors or memories) can be used to implement one or more modules or units. In addition, each module or unit can be part of an overall module or unit that includes the function of the module or unit.
[0108] The computing task allocation device 400 comprises: The first receiving module 410 is used to receive a computing task processing request sent by the first computing power platform through a preset data resource access tool, and determine a computing task to be processed according to the computing task processing request; A determination module 420 is used to determine a second computing power platform for executing the computing task to be processed from multiple computing power platforms; A first sending module 430 is used to send the preset data resource access tool to the second computing power platform when the preset data resource access tool is not installed on the second computing power platform, so that the second computing power platform installs the preset data resource access tool; The second sending module 440 is used to send the computing task to be processed to the second computing power platform, so that the second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through a preset data resource access tool; The second receiving module 450 is used to receive the task processing result of the second computing power platform executing the computing task to be processed according to the target data, and send the task processing result to the first computing power platform through a preset data resource access tool.
[0109] In some implementations, the first sending module 430 is configured to: Generate a configuration instruction corresponding to the preset data resource access tool and send it to the second computing power platform; When receiving the support configuration result returned by the second computing power platform, determining the installation area corresponding to the preset data resource access tool in the second computing power platform; The preset data resource access tool is sent to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instructions.
[0110] In some implementations, the first sending module 430 is configured to: Determine the data access variables corresponding to the computing tasks to be processed; The data access variables and the preset data resource access tool are sent to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instructions, and loads the data access variables through the preset data resource access tool to determine the storage path corresponding to the task to be processed.
[0111] In some implementations, the first sending module 430 is configured to: When receiving an unsupported configuration result returned by the second computing power platform, generating an image generation instruction for installing a preset data resource access tool; The preset data resource access tool and the image generation instruction are sent to the second computing power platform, so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image.
[0112] In some implementations, the first sending module 430 is configured to: After sending the preset data resource access tool and the image generation instruction to the second computing power platform so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image, determine the platform construction type corresponding to the first computing power platform; The platform construction type is sent to the second computing power platform, so that the second computing power platform analyzes the platform construction type through a preset data resource access tool and determines the storage path corresponding to the computing task to be processed.
[0113] In some implementations, the first sending module 430 is configured to: After determining a second computing power platform for executing the computing task to be processed from among the multiple computing power platforms, when the second computing power platform has installed a preset data resource access tool, determining whether the preset data resource access tool installed by the second computing power platform is a historical version; When the preset data resource access tool installed by the second computing power platform is a historical version, the latest version of the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the latest version of the preset data resource access tool.
[0114] In some implementations, the determination module 420 is configured to: Determine the required computing power when the pending computing task is executed; Determine the remaining computing power corresponding to each computing power platform among multiple computing power platforms; Determine at least one computing power platform to be selected whose remaining computing power is greater than the required computing power, and determine the data transmission speed corresponding to each computing power platform to be selected; The computing power platform to be selected with the highest data transmission speed is determined as the second computing power platform for executing the computing task to be processed.
[0115] In some implementations, the second sending module 440 is configured to: Obtain identity authentication information corresponding to the first computing power platform, and send the identity authentication information to the second computing power platform according to the identity authentication interface of the data resource access tool preset in the second computing power platform; Receive the identity authentication result returned by the second computing power platform according to the identity authentication information; When the identity authentication result indicates pass, the computing task to be processed is sent to the second computing power platform according to the task management interface of the preset data resource access tool in the second computing power platform, so that the second computing power platform obtains the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform according to the storage management interface of the preset data resource access tool.
[0116] In the above embodiments, the description of each embodiment has its own emphasis. For the part that is not described in detail in a certain embodiment, please refer to the detailed description of the above computing task allocation method, which will not be repeated here.
[0117] In an embodiment of the present application, the first receiving module 410 receives a computing task processing request sent by the first computing power platform through a preset data resource access tool, and determines the computing task to be processed based on the computing task processing request; the determination module 420 determines a second computing power platform for executing the computing task to be processed from multiple computing power platforms; the first sending module 430 sends the preset data resource access tool to the second computing power platform when the second computing power platform has not installed the preset data resource access tool, so that the second computing power platform installs the preset data resource access tool; the second sending module 440 sends the computing task to be processed to the second computing power platform, so that the second computing power platform accesses the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool; the second receiving module 450 receives the task processing result of the second computing power platform executing the computing task to be processed according to the target data, and sends the task processing result to the first computing power platform through the preset data resource access tool.
[0118] In this way, by installing a preset data resource access tool on the first computing power platform, when the first computing power platform needs other computing power platforms to help process computing tasks, it receives the computing task processing request sent by the first computing power platform through the preset data resource access tool, and determines the computing task to be processed according to the computing task processing request, and then determines the second computing power platform that executes the computing task to be processed, and installs the preset data resource access tool on the second computing power platform, sends the computing task to be processed to the second computing power platform, and the second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool. Finally, the second computing power platform executes the computing task to be processed according to the target data, and sends the corresponding task processing result to the first computing power platform through the computing power service platform. In this way, the access to the target data of the computing task to be processed between the computing power platforms is realized through the preset data resource access tool, which avoids the inability to realize data access between the computing power platforms due to the different construction types of the computing power platforms. After realizing the sharing of target data, the computing power platforms in this application can execute the computing task to be processed, thereby realizing the computing power sharing between different computing power platforms.
[0119] The embodiment of the present application also provides a computer device, the computer device includes a memory and a processor, the memory stores a computer program, and the processor implements the above-mentioned computing task allocation method when executing the computer program. The computer device can be any intelligent terminal including a tablet computer, a car computer, etc.
[0120] See also Figure 6 , Figure 6 The hardware structure of a computer device according to another embodiment is shown, and the computer device includes: The processor 501 may be implemented by a general-purpose CPU (Central Processing Unit), a microprocessor, an application-specific integrated circuit (Application Specific Integrated Circuit, ASIC), or one or more integrated circuits, and is used to execute relevant programs to implement the technical solutions provided in the embodiments of the present application; The memory 502 can be implemented in the form of a read-only memory (ROM), a static storage device, a dynamic storage device, or a random access memory (RAM). The memory 502 can store an operating system and other application programs. When the technical solution provided in the embodiment of this specification is implemented by software or firmware, the relevant program code is stored in the memory 502, and the processor 501 calls and executes the computing task allocation method of the embodiment of this application; Input / output interface 503, used to implement information input and output; Communication interface 504, used to realize communication interaction between the device and other devices, which can be realized through wired mode (such as USB, network cable, etc.) or wireless mode (such as mobile network, WIFI, Bluetooth, etc.); A bus 505 that transmits information between various components of the device (e.g., the processor 501, the memory 502, the input / output interface 503, and the communication interface 504); The processor 501 , the memory 502 , the input / output interface 503 and the communication interface 504 are connected to each other in communication within the device via the bus 505 .
[0121] An embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. When the computer program is executed by a processor, the above-mentioned computing task allocation method is implemented.
[0122] The memory, as a non-transient computer-readable storage medium, can be used to store non-transient software programs and non-transient computer executable programs. In addition, the memory may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory may optionally include a memory remotely disposed relative to the processor, and these remote memories may be connected to the processor via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0123] The computing task allocation method, visual fatigue relief device, computer equipment and storage medium provided in the embodiments of the present application receive a computing task processing request sent by a first computing power platform through a preset data resource access tool, and determine a computing task to be processed according to the computing task processing request; determine a second computing power platform for executing the computing task to be processed from multiple computing power platforms; when the second computing power platform does not have the preset data resource access tool installed, send the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool; send the computing task to be processed to the second computing power platform so that the second computing power platform accesses the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool; receive the task processing result of the second computing power platform executing the computing task to be processed according to the target data, and send the task processing result to the first computing power platform.
[0124] In this way, by installing a preset data resource access tool on the first computing power platform, when the first computing power platform needs other computing power platforms to help process computing tasks, it receives the computing task processing request sent by the first computing power platform through the preset data resource access tool, and determines the computing task to be processed according to the computing task processing request, and then determines the second computing power platform that executes the computing task to be processed, and installs the preset data resource access tool on the second computing power platform, sends the computing task to be processed to the second computing power platform, and the second computing power platform can access the target data corresponding to the computing task to be processed in the corresponding storage path of the first computing power platform through the preset data resource access tool. Finally, the second computing power platform executes the computing task to be processed according to the target data, and sends the corresponding task processing result to the first computing power platform through the computing power service platform. In this way, the access to the target data of the computing task to be processed between the computing power platforms is realized through the preset data resource access tool, which avoids the inability to realize data access between the computing power platforms due to the different construction types of the computing power platforms. After realizing the sharing of target data, the computing power platforms in this application can execute the computing task to be processed, thereby realizing the computing power sharing between different computing power platforms.
[0125] The embodiments described in the embodiments of the present application are intended to more clearly illustrate the technical solutions of the embodiments of the present application and do not constitute a limitation on the technical solutions provided in the embodiments of the present application. Those skilled in the art will appreciate that with the evolution of technology and the emergence of new application scenarios, the technical solutions provided in the embodiments of the present application are also applicable to similar technical problems.
[0126] Those skilled in the art will appreciate that the technical solutions shown in the figures do not constitute a limitation on the embodiments of the present application, and may include more or fewer steps than shown in the figures, or a combination of certain steps, or different steps.
[0127] The device embodiments described above are merely illustrative, and the units described as separate components may or may not be physically separated, that is, they may be located in one place or distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0128] Those skilled in the art will appreciate that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices may be implemented as software, firmware, hardware, or a suitable combination thereof.
[0129] The terms "first", "second", "third", "fourth", etc. (if any) in the specification of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device comprising a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0130] It should be understood that in the present application, "at least one (item)" means one or more, and "plurality" means two or more. "And / or" is used to describe the association relationship of associated objects, indicating that three relationships may exist. For example, "A and / or B" can mean: only A exists, only B exists, and A and B exist at the same time, where A and B can be singular or plural. The character " / " generally indicates that the objects associated before and after are in an "or" relationship. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, at least one of a, b or c can mean: a, b, c, "a and b", "a and c", "b and c", or "a and b and c", where a, b, c can be single or multiple.
[0131] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the above units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.
[0132] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0133] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0134] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including multiple instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, referred to as ROM), random access memory (Random Access Memory, referred to as RAM), disk or optical disk and other media that can store programs.
[0135] The preferred embodiments of the present invention are described above with reference to the accompanying drawings, but the scope of the rights of the present invention is not limited thereto. Any modification, equivalent substitution and improvement made by a person skilled in the art without departing from the scope and essence of the present invention should be within the scope of the rights of the present invention.
Claims
1. A computing task allocation method, characterized in that: include: Receiving a computing task processing request sent by the first computing power platform through a preset data resource access tool, and determining a computing task to be processed according to the computing task processing request; Determining a second computing power platform for executing the computing task to be processed from a plurality of computing power platforms; When the second computing power platform has not installed the preset data resource access tool, sending the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool; Sending the pending computing task to the second computing power platform, so that the second computing power platform accesses the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through the preset data resource access tool; Receive the task processing result of the second computing power platform executing the to-be-processed computing task according to the target data, and send the task processing result to the first computing power platform through the preset data resource access tool.
2. The computing task allocation method according to claim 1, characterized in that: The sending the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool includes: Generate a configuration instruction corresponding to the preset data resource access tool and send it to the second computing power platform; When receiving the support configuration result returned by the second computing power platform, determining the installation area corresponding to the preset data resource access tool in the second computing power platform; The preset data resource access tool is sent to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instruction.
3. The computing task allocation method according to claim 2, characterized in that: The step of sending the preset data resource access tool to the installation area corresponding to the second computing power platform so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instruction includes: Determining a data access variable corresponding to the computing task to be processed; The data access variables and the preset data resource access tool are sent to the installation area corresponding to the second computing power platform, so that the second computing power platform installs the preset data resource access tool in the installation area according to the configuration instructions, and loads the data access variables through the preset data resource access tool to determine the storage path corresponding to the task to be processed.
4. The computing task allocation method according to claim 2, characterized in that: The sending the preset data resource access tool to the second computing power platform so that the second computing power platform installs the preset data resource access tool includes: When receiving an unsupported configuration result returned by the second computing power platform, generating an image generation instruction for installing the preset data resource access tool; The preset data resource access tool and the image generation instruction are sent to the second computing power platform, so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image.
5. The computing task allocation method according to claim 4, characterized in that: After sending the preset data resource access tool and the image generation instruction to the second computing power platform so that the second computing power platform generates a target image according to the image generation instruction and installs the preset data resource access tool in the target image, the method further includes: Determine a platform construction type corresponding to the first computing power platform; The platform construction type is sent to the second computing power platform, so that the second computing power platform analyzes the platform construction type through the preset data resource access tool and determines the storage path corresponding to the computing task to be processed.
6. The computing task allocation method according to claim 1, characterized in that: After determining a second computing power platform for executing the to-be-processed computing task from among the multiple computing power platforms, the method further includes: When the second computing power platform has installed the preset data resource access tool, determining whether the preset data resource access tool installed by the second computing power platform is a historical version; When the preset data resource access tool installed by the second computing power platform is a historical version, the latest version of the preset data resource access tool is sent to the second computing power platform so that the second computing power platform installs the latest version of the preset data resource access tool.
7. The computing task allocation method according to claim 1, characterized in that: The determining of a second computing power platform for executing the to-be-processed computing task from among the multiple computing power platforms includes: Determine the required computing power when the pending computing task is executed; Determine the remaining computing power corresponding to each computing power platform among multiple computing power platforms; Determine at least one computing power platform to be selected whose remaining computing power is greater than the required computing power, and determine the data transmission speed corresponding to each computing power platform to be selected; The computing power platform to be selected with the highest data transmission speed is determined as the second computing power platform for executing the computing task to be processed.
8. The computing task allocation method according to claim 1, characterized in that: The sending the to-be-processed computing task to the second computing power platform so that the second computing power platform obtains the target data corresponding to the to-be-processed computing task in the corresponding storage path of the first computing power platform through the preset data resource access tool, includes: Obtaining identity authentication information corresponding to the first computing power platform, and sending the identity authentication information to the second computing power platform according to the identity authentication interface corresponding to the preset data resource access tool in the second computing power platform; Receiving the identity authentication result returned by the second computing power platform according to the identity authentication information; When the identity authentication result indicates pass, the pending computing task is sent to the second computing power platform according to the task management interface corresponding to the preset data resource access tool in the second computing power platform, so that the second computing power platform obtains the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform according to the storage management interface corresponding to the preset data resource access tool.
9. A computing task allocation device, characterized in that: include: A first receiving module is used to receive a computing task processing request sent by the first computing power platform through a preset data resource access tool, and determine a computing task to be processed according to the computing task processing request; A determination module, used to determine a second computing power platform for executing the computing task to be processed from multiple computing power platforms; A first sending module, configured to send the preset data resource access tool to the second computing power platform when the preset data resource access tool is not installed on the second computing power platform, so that the second computing power platform installs the preset data resource access tool; A second sending module is used to send the pending computing task to the second computing power platform, so that the second computing power platform can access the target data corresponding to the pending computing task in the corresponding storage path of the first computing power platform through the preset data resource access tool; The second receiving module is used to receive the task processing result of the second computing power platform executing the to-be-processed computing task according to the target data, and send the task processing result to the first computing power platform through the preset data resource access tool.
10. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor to execute the computing task allocation method according to any one of claims 1 to 8.
11. A computer device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the computing task allocation method according to any one of claims 1 to 8 is implemented.
Citation Information
Patent Citations
Heterogeneous cloud isolation system and method for in-cloud GIS service computing
CN104917815A
Task processing method and device, equipment and storage medium
CN112988346A
Data processing method and device, equipment and storage medium
CN115904667A
Task processing method and device, computer equipment, storage medium and program product
CN116795524A
Cross-platform airborne integrated software architecture
CN117742670A