Data processing method and device, computer equipment and readable storage medium

By dynamically selecting suitable computing nodes and transmission periods, the problems of high cost and low efficiency of traditional dedicated line transmission methods are solved, more efficient and flexible data transmission is achieved, and the operating costs of computing power service providers are reduced.

CN119536992APending Publication Date: 2025-02-28CHINA TELECOM CORP LTD TECHNOLOGY INNOVATION CENTER +1
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411484707.4
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-10-23
Publication Date
2025-02-28

AI Technical Summary

Technical Problem

When traditional dedicated line mode transmits massive data to be calculated, there are problems such as high dedicated line cost and low transmission efficiency.

Method used

By obtaining the pending data and transmission time requirements of the computing power demand party, determining the required computing power demand resources, selecting the target computing power node that meets the resources, and transmitting data within the scheduled transmission period.

Benefits of technology

It improves data transmission efficiency, reduces dedicated line costs, provides higher flexibility, allows computing power demanders to quickly respond to market changes or business needs, and helps computing power service providers better manage their computing power resources.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119536992A_ABST
    Figure CN119536992A_ABST
Patent Text Reader

Abstract

The invention relates to the technical field of data processing, in particular to a data processing method and device, computer equipment and a readable storage medium. The method comprises the following steps: acquiring to-be-processed data of a computing power demand side and a transmission aging demand corresponding to the to-be-processed data; determining computing power demand resources required for processing the to-be-processed data; selecting a target computing power node meeting computing power demand resources from candidate computing power nodes of the computing power network; obtaining at least one available time period of the target computing power node, and determining a reserved transmission time period meeting the transmission timeliness requirement according to the at least one available time period of the target computing power node; and transmitting the to-be-processed data to the target computing power node in the reserved transmission time period.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a data processing method, apparatus, computer device and readable storage medium. Background Art

[0002] With the continuous development of computing power facilities and computing power businesses, the contradiction between supply and demand of computing power has become increasingly prominent: computing power service providers have high operation and maintenance costs in building computing power centers, but the utilization rate of computing power resources is insufficient; computing power consumers have large business computing demands, but the cost of using computing power is high.

[0003] Especially for massive computing scenarios, if the massive amount of data to be calculated is transmitted through traditional dedicated lines, it will bring very high dedicated line costs. Therefore, the common practice in the industry is to burn the data into a hard disk and send it to the data center for processing via express logistics.

[0004] However, the above method has the problem of low transmission efficiency. Summary of the invention

[0005] Based on this, it is necessary to provide a data processing method, device, computer equipment and readable storage medium that can improve data transmission efficiency in response to the above technical problems.

[0006] In a first aspect, the present application provides a data processing method, the method comprising:

[0007] Obtain the data to be processed by the computing power demander and the transmission timeliness requirements corresponding to the data to be processed;

[0008] Determine the computing power required to process the data to be processed;

[0009] Select the target computing node that meets the computing power requirement from the candidate computing nodes in the computing power network;

[0010] Obtain at least one available time period of the target computing power node, and determine a reserved transmission time period that meets the transmission timeliness requirement based on at least one available time period of the target computing power node;

[0011] During the scheduled transmission period, the data to be processed is transmitted to the target computing power node.

[0012] In one embodiment, the computing power requirement resources include storage requirement resources and computing requirement resources; within the scheduled transmission period, transmitting the data to be processed to the target computing power node includes:

[0013] According to the demand location information of the computing power demander and the device location information of each edge device of the computing power network, a target device that meets the storage demand resources is selected from each edge device;

[0014] Store the data to be processed in the target device;

[0015] During the scheduled transmission period, the data to be processed is transmitted from the target device to the target computing power node.

[0016] In one embodiment, obtaining at least one available time period of a target computing power node includes:

[0017] Obtain a list of pending tasks of the target computing power node; wherein the list of pending tasks includes each pending task sorted in chronological order according to the task processing period;

[0018] Obtain the remaining computing power resources of the target computing power node when processing each pending task;

[0019] The tasks to be processed whose remaining computing resources can meet the computing power demand resources are taken as the first processing tasks, and the tasks to be processed whose remaining computing resources cannot meet the computing power demand resources are taken as the second processing tasks;

[0020] Determine the available time period of the target computing power node according to the task processing time period corresponding to the first processing task; and

[0021] The available time period of the target computing power node is determined according to the idle time period formed by the task processing time period corresponding to the second processing task.

[0022] In one embodiment, determining the available time period of the target computing power node according to the spatial time period formed by the task processing time period corresponding to the second processing task includes:

[0023] For two adjacent second processing tasks, if the task processing time periods of the two adjacent second processing tasks are not continuous, the space time period between the task processing time periods of the two adjacent second processing tasks is used as an available time period of the target computing power node; and,

[0024] When the last task to be processed in the list of tasks to be processed is the second processing task, a time period of a preset length after the task processing period corresponding to the last generation processing task is used as an available time period for the target computing power node.

[0025] In one embodiment, determining a reserved transmission time period that meets the transmission time efficiency requirement according to at least one available time period of the target computing power node includes:

[0026] Determine the length of a unit time period required to transmit a unit amount of data in the data to be processed;

[0027] When there are at least two discontinuous available time periods at the target computing power node, the at least two discontinuous available time periods are combined according to the unit time period length to obtain a reserved transmission time period that meets the transmission timeliness requirements.

[0028] In one embodiment, at least two discontinuous available time periods are combined according to the unit time period length to obtain a reserved transmission time period that meets the transmission time efficiency requirement, including:

[0029] For each available period of at least two discontinuous available periods, a sub-period is intercepted from the available period; wherein the period length of the sub-period is an integer multiple of the unit period length;

[0030] Sub-periods corresponding to each available period in at least two discontinuous available periods are combined to obtain a reserved transmission period that meets the transmission timeliness requirement.

[0031] In a second aspect, the present application further provides a data processing device, comprising:

[0032] An acquisition module is used to obtain the data to be processed by the computing power demander and the transmission time efficiency requirements corresponding to the data to be processed;

[0033] Resource assessment module, used to determine the computing power required to process the data to be processed;

[0034] The node selection module is used to select a target computing node that meets the computing power requirement resources from the candidate computing nodes in the computing power network;

[0035] A time period determination module, used to obtain at least one available time period of the target computing power node, and determine a reserved transmission time period that meets the transmission timeliness requirement based on at least one available time period of the target computing power node;

[0036] The data transmission module is used to transmit the data to be processed to the target computing power node within the scheduled transmission period.

[0037] In a third aspect, the present application further provides a computer device, including a memory and a processor, wherein the memory stores a computer program, and when the processor executes the computer program, the following steps are implemented:

[0038] Obtain the data to be processed by the computing power demander and the transmission timeliness requirements corresponding to the data to be processed;

[0039] Determine the computing power required to process the data to be processed;

[0040] Select the target computing node that meets the computing power requirement from the candidate computing nodes in the computing power network;

[0041] Obtain at least one available time period of the target computing power node, and determine a reserved transmission time period that meets the transmission timeliness requirement based on at least one available time period of the target computing power node;

[0042] During the scheduled transmission period, the data to be processed is transmitted to the target computing power node.

[0043] In a fourth aspect, the present application further provides a computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the following steps are implemented:

[0044] Obtain the data to be processed by the computing power demander and the transmission timeliness requirements corresponding to the data to be processed;

[0045] Determine the computing power required to process the data to be processed;

[0046] Select the target computing node that meets the computing power requirement from the candidate computing nodes in the computing power network;

[0047] Obtain at least one available time period of the target computing power node, and determine a reserved transmission time period that meets the transmission timeliness requirement based on at least one available time period of the target computing power node;

[0048] During the scheduled transmission period, the data to be processed is transmitted to the target computing power node.

[0049] In a fifth aspect, the present application further provides a computer program product, including a computer program, which implements the following steps when executed by a processor:

[0050] Obtain the data to be processed by the computing power demander and the transmission timeliness requirements corresponding to the data to be processed;

[0051] Determine the computing power required to process the data to be processed;

[0052] Select the target computing node that meets the computing power requirement from the candidate computing nodes in the computing power network;

[0053] Obtain at least one available time period of the target computing power node, and determine a reserved transmission time period that meets the transmission timeliness requirement based on at least one available time period of the target computing power node;

[0054] During the scheduled transmission period, the data to be processed is transmitted to the target computing power node.

[0055] The above-mentioned data processing method, device, computer equipment and readable storage medium, the present application can more accurately match the appropriate computing power node by accurately analyzing the data to be processed by the computing power demander and the computing power resources required. Because the computing power resources are more effectively utilized, the computing power service provider can more effectively share the cost, which may reduce the charges to the computing power consumer. Furthermore, by reserving the transmission time period, the data is transmitted within the appropriate time window, avoiding the time delay caused by waiting for the hard disk express logistics in the traditional method. By dynamically selecting the computing power node and the transmission time period according to the computing power demand and the transmission time efficiency demand, the present solution provides higher flexibility. This allows the computing power demander to respond to market changes or business needs more quickly, and also helps the computing power service provider to better manage its computing power resources. For massive computing scenarios, the traditional dedicated line transmission method is costly, and the present application optimizes the data transmission method (although the specific implementation may still involve physical media, it emphasizes the time period selection and reservation mechanism), which may reduce or avoid the use of dedicated line transmission, thereby reducing related costs. BRIEF DESCRIPTION OF THE DRAWINGS

[0056] In order to more clearly illustrate the technical solutions in the embodiments of the present application or related technologies, the drawings required for use in the embodiments of the present application or related technical descriptions will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other related drawings can be obtained based on these drawings without paying creative work.

[0057] FIG1 is a schematic flow chart of a data processing method in one embodiment;

[0058] FIG2 is a schematic diagram of a flow chart of a step of transmitting to-be-processed data to a target computing power node in one embodiment;

[0059] FIG3 is a schematic diagram of a flow chart of a step of obtaining at least one available time period of a target computing power node in one embodiment;

[0060] FIG4 is a flow chart of the steps of determining a reserved transmission time period that meets the transmission timeliness requirement in one embodiment;

[0061] FIG5 is a schematic flow chart of a process for combining at least two discontinuous available time periods in one embodiment;

[0062] FIG6 is a schematic diagram of a data processing system in one embodiment;

[0063] FIG7 is a block diagram of a data processing device in one embodiment;

[0064] FIG. 8 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0065] In order to make the purpose, technical solution and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0066] In an exemplary embodiment, as shown in FIG1 , a data processing method is provided, taking the method applied to a computer device as an example, comprising:

[0067] S101, obtaining the data to be processed of the computing power demander and the transmission time efficiency requirement corresponding to the data to be processed.

[0068] Among them, computing power demanders refer to entities that need to use computing power resources to process data, which can be enterprises, research institutions, individual users, etc. They have data to be processed and hope to complete the data processing task through the computing power center of the computing power service provider.

[0069] Data to be processed refers to the data set that the computing power demander needs to process, which may include various types of raw data, intermediate data or result data. These data may exist in the form of files, database records, data streams, etc., and require specific computing power resources for processing, analysis or calculation.

[0070] Transmission timeliness requirement refers to the time requirement of the computing power demander for data transmission to the computing power center. This includes the start time, end time and possible transmission speed requirements of data transmission. Transmission timeliness requirement may be affected by many factors, such as the urgency of business needs, the timeliness requirements of data processing and the available time of the computing power center. Meeting the transmission timeliness requirement is the key to ensuring that data processing tasks are completed on time.

[0071] Optionally, first, the computing power service provider can collect the specific needs of the computing power demander through questionnaires and other means, including detailed information such as the type, format, and size of the data to be processed, as well as the expected goals and results of data processing. In this process, the computing power demander will clarify the timeliness requirements of data transmission, such as the deadline for data transmission, the expected transmission speed, etc. These requirements will serve as an important basis for the subsequent formulation of the transmission plan.

[0072] The computing power service provider then evaluates the data to be processed provided by the computing power demander, including the type, format, size, and processing difficulty of the data. This will help determine the required computing power resources and data processing strategies. Based on the data evaluation results, the computing power service provider selects the target computing power node that meets the computing power demand resources from the candidate computing power nodes in the computing power network. This includes considering factors such as the node's computing power performance, storage capacity, and network bandwidth. Obtain the available time period of the target computing power node, and determine the scheduled transmission time period that meets the requirements based on the transmission timeliness requirements of the data to be processed. This includes considering factors such as the start time and end time of data transmission and the possible risk of transmission interruption.

[0073] For example, the computing power service provider communicates with the scientific research institution through a questionnaire to understand its specific needs. The scientific research institution provides detailed information on the data to be processed: the data type is gene sequencing data, the format is FASTQ, the total size is about 50TB, and the processing required is gene variation analysis. The scientific research institution has clarified the timeliness requirements for data transmission: it hopes to complete the data transmission within two weeks, and expects the transmission speed to reach at least 2TB of data per day. The computing power service provider evaluates the provided gene sequencing data and confirms the data format, size, and processing difficulty.

[0074] According to the evaluation results, the computing service provider selected two candidate computing nodes from the computing network: Node A and Node B. Node A has high-performance computing power and large-capacity storage space, but the network bandwidth is limited; Node B has a higher network bandwidth, but its computing power and storage space are slightly inferior to Node A. Taking into account the timeliness requirements and data processing requirements of the scientific research institution, the computing service provider decided to select Node B as the target computing node because its higher network bandwidth can meet the need to transmit at least 2TB of data every day. The computing service provider obtained the available time period of Node B and found that the node has an idle period from 8 pm to 2 am the next day in the next two weeks. According to the transmission timeliness requirements of the scientific research institution and the available time period of Node B, the computing service provider formulated a transmission plan: from now on, data transmission will start at 8 pm every day and end at 2 am the next day. It is expected that data transmission will be completed within two weeks. During the transmission process, the computing service provider adopted efficient data transmission technology and monitored the transmission progress and speed to ensure that data transmission is completed as planned.

[0075] S102, determining the computing power required to process the data to be processed.

[0076] Among them, computing power demand resources usually refer to the various computing resources and services required to complete specific data processing tasks.

[0077] For example, the computing power requirement resources may include the following aspects:

[0078] 1. Computing resources

[0079] Processor (CPU / GPU): The central processing unit (CPU) and the graphics processing unit (GPU) are the core computing units that perform data processing tasks. The CPU is suitable for general computing tasks, while the GPU is good at parallel computing tasks such as image processing, deep learning, etc.

[0080] Accelerators: Dedicated acceleration cards such as TPU (tensor processing unit) and FPGA (field programmable gate array) can provide higher computing efficiency and performance for specific types of data processing tasks.

[0081] 2. Storage resources

[0082] Memory (RAM): It is used to temporarily store data during processing and has an important impact on computing performance. Sufficient memory can ensure that the processor does not frequently access the hard disk due to insufficient memory when processing data, thereby improving computing speed.

[0083] Hard disk / SSD: used for long-term storage of data and programs. Solid-state drives (SSDs) have faster read and write speeds and lower latency than traditional hard disks, which can significantly improve data processing efficiency.

[0084] 3. Network resources

[0085] Network bandwidth: For data processing tasks involving network communications, such as distributed computing and cloud computing, sufficient network bandwidth can ensure fast data transmission and processing tasks.

[0086] Network latency: For data processing tasks that require low latency, such as real-time data analysis, online games, etc., network latency is also an important consideration.

[0087] 4. Other Resources

[0088] Software resources: including operations, databases, middleware, application software, etc. These software resources provide various functions and services required for data processing.

[0089] Service resources: such as cloud services and virtualization services, which can provide flexible computing resources and dynamically adjust the size and quantity of computing resources according to actual needs.

[0090] Accordingly, determining the computing power required to process the data to be processed may include the following aspects:

[0091] 1. Computing resources

[0092] Based on the computational complexity, evaluate the type and quantity of computing resources required (such as CPU, GPU, TPU, etc.). Consider the processor's performance, parallel processing capabilities, and whether it supports specific acceleration libraries or frameworks.

[0093] Evaluate the type and capacity of storage space required based on the amount of data and data access patterns. Consider using in-memory databases, distributed storage, or cloud storage services to meet efficient data reading and writing needs.

[0094] 2. Network resource evaluation:

[0095] For data processing tasks involving network communication, evaluate the required network bandwidth and latency. Ensure the stability and reliability of network connections to avoid data transmission bottlenecks.

[0096] 3. Software resource evaluation:

[0097] Select appropriate operations, databases, middleware, and application software to support efficient execution of data processing tasks. Consider the software's compatibility, stability, and support for required algorithms and tools.

[0098] 4. Service resource evaluation:

[0099] Consider using cloud services, virtualization services, or container services to provide elastic computing resources. Dynamically adjust the size and quantity of computing resources according to actual needs to reduce costs and improve resource utilization.

[0100] Furthermore, the total computing cost can be calculated based on the type, quantity, and usage duration of the selected computing resources. Consider whether to adopt billing models such as pay-as-you-go, reserved instances, or spot instances to reduce costs. Calculate the total storage cost based on the selected storage resource type and capacity. Consider whether to adopt a tiered storage strategy to store hot and cold data separately on more cost-effective storage media. For data processing tasks involving network communication, evaluate the costs of required network bandwidth and latency. Consider whether to use technologies such as data compression and encryption to reduce network transmission costs. Calculate additional costs such as required software licensing fees and service fees. Consider whether to use open source software or free services to reduce costs.

[0101] S103, selecting a target computing node that meets the computing power requirement resources from the candidate computing power nodes in the computing power network.

[0102] Among them, candidate computing nodes refer to all nodes in the computing network that can be used to process specific computing tasks. These nodes have different computing power, storage capacity, network bandwidth and other characteristics, and are candidates for selecting target computing nodes. In the computing network, candidate computing nodes may be distributed in different geographical locations and provided by different operators or service providers.

[0103] The target computing nodes refer to nodes selected from candidate computing nodes that can meet specific computing resource requirements. These nodes meet or exceed the task requirements in terms of computing power, storage capacity, network bandwidth, etc., and are the best choice for executing computing tasks.

[0104] Specifically, detailed information of all candidate computing nodes is obtained from the computing network, including computing power (such as CPU, GPU model and quantity), storage capacity (such as memory capacity, hard disk storage size), network bandwidth, geographical location, operator or service provider, etc. Based on the type, format, size of the data to be processed and the complexity of the data processing task, the required computing resources are evaluated, including computing capacity, storage capacity, network bandwidth, etc.

[0105] Then, the information of the candidate computing power nodes is compared with the computing power requirements, and nodes that meet or exceed the requirements are selected as potential target computing power nodes. In the matching process, factors such as node performance, cost, availability, and security can be comprehensively considered. Potential target computing power nodes are further screened based on the data transmission timeliness requirements (such as transmission deadline, expected transmission speed, etc.) clearly specified by the computing power demander. Ensure that the geographical location, network bandwidth, etc. of the selected node can meet the timeliness requirements of data transmission.

[0106] Among the potential target computing nodes, the final target computing node is determined based on comprehensive evaluation results (such as performance, cost, availability, security, etc.). If multiple nodes meet the requirements, further factors such as node load balancing and failover can be considered to make a selection.

[0107] Obtain the available time period of the target computing power node, and determine the scheduled transmission time period that meets the requirements based on the transmission timeliness requirements of the data to be processed. This includes considering factors such as the start time and end time of data transmission and the possible risk of transmission interruption. During the scheduled transmission period, the data to be processed is transmitted to the target computing power node, and the data processing task is started. During the task execution process, key indicators such as task progress, resource utilization, and network bandwidth can be monitored in real time to ensure that the task can be completed smoothly.

[0108] S104, obtaining at least one available time period of the target computing power node, and determining a reserved transmission time period that meets the transmission timeliness requirement based on at least one available time period of the target computing power node.

[0109] The available time period refers to the time period during which the target computing power node can be used to process data transmission and computing tasks within a specific time range. These time periods may be affected by various factors such as node performance, maintenance plans, and reservations of other users.

[0110] The scheduled transmission time period refers to the time period for data transmission that users reserve and confirm in advance based on the available time period of the target computing power node and their own transmission time requirements. This time period should ensure that the data can be transmitted to the target computing power node within the specified time so that it can be processed in time.

[0111] Optionally, obtain the available time period of the target computing power node, including: obtaining the available time period information of the target computing power node through the computing power network management platform or contacting the service provider. This information usually includes the daily or weekly available time range of the node, possible maintenance plans, and any known reservation conflicts. Clarify the timeliness requirements of data transmission, including the start time of data transmission, the expected transmission speed, the transmission deadline, etc. These requirements will directly affect the selection of the scheduled transmission time period.

[0112] Compare and analyze the available time periods of the target computing power node with the transmission time requirements. Find available time periods that can meet or exceed the transmission time requirements. In the matching process, the impact of factors such as network bandwidth, data transmission volume, and possible network fluctuations on the transmission speed should be fully considered. Among the available time periods that meet the transmission time requirements, select one or more as the scheduled transmission time periods. When selecting, factors such as node load balancing, reservations for other tasks, and possible maintenance plans should be considered to ensure the stability and reliability of the selected time period.

[0113] Make an appointment for the selected transmission time slot through the computing network management platform or contact the service provider, and ensure that the appointment is confirmed. During the appointment process, you may need to provide detailed information on data transmission, the expected transmission speed, and any special network configuration requirements. Furthermore, before booking the transmission time slot, monitor key indicators such as network bandwidth and node performance to ensure smooth data transmission. If any abnormal situation occurs, such as network congestion, node failure, etc., you should contact the service provider in time and adjust the scheduled transmission time slot or take other countermeasures according to the actual situation.

[0114] S105: Transmit the data to be processed to the target computing power node within the scheduled transmission period.

[0115] First, collect the data to be processed from the data source, and perform necessary data cleaning and preprocessing to ensure the accuracy and completeness of the data. According to the requirements of the target computing power node and the needs of the data processing task, format the data to be processed into a format suitable for transmission and processing. This may include data compression, encryption, packaging and other operations.

[0116] Before the scheduled transfer period begins, establish a network connection with the target computing power node. This may include configuring network parameters, setting up routing, etc. Perform a network connection test to ensure that the stability of the network connection and the bandwidth meet the data transmission requirements.

[0117] At the beginning of the scheduled transmission period, start the data transmission task. This can be achieved through data transmission tools or scripts, depending on the data transmission technology and protocol used. During the data transmission process, monitor the transmission progress, transmission rate, and any possible errors or anomalies in real time. If network congestion, decreased transmission rate, or other abnormal conditions are found, adjust the transmission strategy in time according to the monitoring results, such as adding parallel transmission channels, adjusting the size of data packets, etc. Data integrity verification: After the data transmission is completed, perform data integrity verification to ensure that all data has been correctly transmitted to the target computing power node without loss or damage.

[0118] Confirm to the target computing power node that the data transmission has been completed and notify the relevant parties to carry out subsequent data processing tasks.

[0119] The above data processing method, this application can more accurately match the appropriate computing power node by accurately analyzing the data to be processed by the computing power demander and the computing power resources required. Because the computing power resources are more effectively utilized, the computing power service provider can share the cost more effectively, which may reduce the charges to the computing power consumer. Furthermore, by reserving the transmission time period, the data is transmitted within the appropriate time window, avoiding the time delay caused by waiting for the hard disk express logistics in the traditional method. By dynamically selecting the computing power node and the transmission time period according to the computing power demand and the transmission time efficiency demand, this solution provides higher flexibility. This allows the computing power demander to respond to market changes or business needs more quickly, and also helps the computing power service provider to better manage its computing power resources. For massive computing scenarios, the traditional dedicated line transmission method is costly, and this application optimizes the data transmission method (although the specific implementation may still involve physical media, it emphasizes the time period selection and reservation mechanism), which may reduce or avoid the use of dedicated line transmission, thereby reducing related costs.

[0120] In an exemplary embodiment, the computing power requirement resources include storage requirement resources and computing requirement resources.

[0121] It can be understood that storage demand resources refer to the demand for storage space when processing data or performing tasks. This includes data preservation, backup, archiving, and any form of storage needs. Storage capacity refers to the total storage space required, which depends on the amount of data to be stored and the expected storage growth trend. Storage type Different data types and uses may require different types of storage media, such as hard disks, SSDs (solid state drives), cloud storage, etc. Data persistence For critical data, data persistence and reliability need to be ensured to prevent data loss or damage.

[0122] Computational demand resources refer to the demand for computing power when processing data or performing tasks. This includes all tasks that require computing resources, such as data processing, analysis, and simulation.

[0123] Accordingly, as shown in FIG2 , within the scheduled transmission period, the data to be processed is transmitted to the target computing power node, including:

[0124] S201, based on the demand location information of the computing power demander and the device location information of each edge device of the computing power network, select a target device that meets the storage demand resources from each edge device.

[0125] It is understandable that the computing power demander will provide the location information of its needs, including geographical location, network conditions, required computing power type and scale, etc. Furthermore, the computing power network will collect and analyze the device location information of each edge device, including the device's geographical location, storage capacity, current load, network connection quality, etc.

[0126] Optionally, based on the demand location information and edge device location information, the computing network will use an intelligent scheduling algorithm to select the edge device that is closest to the user node and meets the storage requirements as the target device.

[0127] S202, storing the data to be processed in the target device.

[0128] Optionally, once the target device is selected, the user data will first be uploaded to the edge node for caching and pre-processing. The edge node will use its caching and computing power to quickly process the user data to reduce transmission delays and improve processing efficiency.

[0129] S203: within the scheduled transmission period, the data to be processed is transmitted from the target device to the target computing power node.

[0130] Optionally, before transmission, necessary preparations are made for the data to be processed, such as packaging, marking, and verification, to ensure the integrity and correctness of the data. During the scheduled transmission period, the data to be processed is transmitted from the target device to the target computing power node using available network resources. The transmission process may involve data compression, encryption, and fragmentation to improve transmission efficiency and security. On the target computing power node, the transmitted data to be processed is received and stored. The receiving process may involve data decompression, decryption, and reorganization for subsequent processing.

[0131] In this embodiment, by predetermining the scheduled transmission period and transmitting data within the period, the transmission delay caused by network congestion or device busyness can be reduced. The data to be processed is stored in the target device and transmitted to the target computing power node within the scheduled transmission period, which can ensure that the data is processed at the best time point, thereby improving processing efficiency.

[0132] In an exemplary embodiment, as shown in FIG3 , obtaining at least one available time period of a target computing power node includes:

[0133] S301, obtain the list of pending tasks of the target computing power node.

[0134] The pending task list includes the pending tasks sorted in chronological order according to the task processing period.

[0135] It is understandable that the pending task list refers to a collection of all tasks that the target computing node has currently received but has not yet executed or completed. This list is usually sorted in chronological order according to the processing period of the task (i.e. the expected start and end time) so that the tasks can be managed and scheduled in an orderly manner.

[0136] Exemplarily, each task in the list of pending tasks usually contains the following information: 1) Task identification: information used to uniquely identify the task, such as a task ID. 2) Task type: the nature or category of the task, which may involve different computing requirements, priorities, or processing flows. 3) Required computing resources: the amount of computing resources required to execute the task, which may include CPU, memory, storage, etc. 4) Task processing period: the time range when the task is expected to start and end, which may be a specific time point or time period. 5) Task status: the status of the current task, such as waiting, executing, completed, failed, etc. 6) Priority: the execution priority of the task, which is used to determine the execution order of tasks when resources are limited. 7) Dependency: the dependency that may exist between tasks, for example, a task must be executed after another task is completed.

[0137] S302, obtaining the remaining computing power resources of the target computing power node when processing each task to be processed.

[0138] It is understood that the remaining computing resources refer to the amount of additional computing resources that the target computing node can still provide after completing all the tasks it has currently received and planned to execute (i.e., pending tasks) within a specific time period. These resources can be used to process new tasks or meet additional computing power requirements.

[0139] Exemplarily, the calculation of remaining computing resources usually involves the following aspects: 1) Total computing resources: the total computing power possessed by the target computing node, including various resources such as CPU, memory, storage, network bandwidth, etc. 2) Occupied computing resources: computing resources currently occupied or reserved by tasks. This includes resources required for tasks being executed, as well as resources reserved for tasks that have been planned but not yet started. 3) Task computing demand: the amount of computing resources required for each task in the list of pending tasks. These requirements change over time as tasks are constantly added, executed, and completed. 4) Time factor: The remaining computing resources change over time. At a certain point in time, a node may have a large amount of remaining resources, but at another point in time, the remaining resources may be greatly reduced due to the addition of new tasks or the execution of existing tasks.

[0140] S303, taking the pending tasks whose remaining computing resources can meet the computing power demand resources as the first processing task, and taking the pending tasks whose remaining computing resources cannot meet the computing power demand resources as the second processing task.

[0141] It is understandable that the first processing task refers to the task for which the remaining computing power resources can meet the current computing power requirements. These tasks can be executed as planned and will not affect other tasks of the computing power node. The second processing task refers to the task for which the remaining computing power resources cannot meet the current computing power requirements. These tasks need to be postponed or rescheduled.

[0142] S304: Determine the available time period of the target computing power node according to the task processing time period corresponding to the first processing task.

[0143] Specifically, the execution schedule of the first processing task is analyzed to find out the idle time periods or time periods when computing resources are not fully utilized. These time periods are the available time periods of the target computing power node.

[0144] S305: Determine the available time period of the target computing power node according to the idle time period formed by the task processing time period corresponding to the second processing task.

[0145] Specifically, the execution schedule of the second processing task is analyzed to find the gaps between tasks or the time periods after the tasks are completed. During these time periods, the computing resources of the target computing node may be partially or completely idle, and thus can be used as available time periods.

[0146] Furthermore, the available time periods determined in steps S304 and S305 are merged and deduplicated to obtain a final available time period list of the target computing power node. These available time periods can be used to arrange new computing power requirements or as candidate time periods for computing power resource reservation.

[0147] In this embodiment, through the technical solutions of S301 to S305, computing resources can be managed and utilized more intelligently and efficiently, thereby improving overall performance.

[0148] In an exemplary embodiment, determining the available time period of the target computing power node according to the spatial time period formed by the task processing time period corresponding to the second processing task may include the following two situations:

[0149] In one implementable manner, for two adjacent second processing tasks, if the task processing time periods of the two adjacent second processing tasks are not continuous, the space time period between the task processing time periods of the two adjacent second processing tasks is used as an available time period of the target computing power node.

[0150] Optionally, traverse the list of pending tasks, paying special attention to those tasks that are classified as second processing tasks. For each pair of adjacent second processing tasks, check whether their task processing periods are continuous. If they are not continuous, that is, there is a gap in time, then this gap period is regarded as an available period of the target computing power node.

[0151] In another possible implementation, when the last task to be processed in the list of tasks to be processed is the second processing task, a time period of a preset length after the task processing period corresponding to the last generation processing task is used as an available time period for the target computing power node.

[0152] Optionally, check the last task in the list of pending tasks. If this task is the second processing task, that is, the computing power resources required exceed the remaining computing power of the current node, then after the task processing period of this task ends, a preset time period can be set as the available time period of the computing power node. This preset time period can be set according to actual needs, the recovery capability of the computing power node or other strategies.

[0153] In this embodiment, by identifying and utilizing the time gaps between adjacent tasks, it is possible to ensure that computing nodes will not be idle during these time periods, thereby improving resource utilization. Future planning: By setting an available time period of a preset length after the last task, it is possible to prepare for future computing power needs in advance, thereby improving overall planning.

[0154] In an exemplary embodiment, as shown in FIG4 , determining a reserved transmission time period that meets the transmission time efficiency requirement according to at least one available time period of the target computing power node includes:

[0155] S401, determining the length of a unit time period required for transmitting a unit amount of data in the data to be processed.

[0156] The unit time period length required for transmitting a unit amount of data in the data to be processed refers to the time length required for transmitting a data block of a fixed size (ie, a unit amount of data).

[0157] Optionally, measure the time required to transmit a certain unit amount of data through experiments or historical data, consider the impact of factors such as network conditions, data format, and transmission protocol on the length of the unit time period, and determine an average or expected unit time period length as a basis for subsequent calculations.

[0158] S402: When there are at least two discontinuous available time periods at the target computing power node, the at least two discontinuous available time periods are combined according to the unit time period length to obtain a reserved transmission time period that meets the transmission timeliness requirement.

[0159] Optionally, first, identify all available time periods of the target computing power node, especially those that are discontinuous. Sort these discontinuous available time periods according to the start time and length of the time period for subsequent combined processing. If the interval between two adjacent available time periods is less than or equal to a certain proportion of the unit time period length (for example, a small delay is allowed), they can be regarded as a continuous time period. Based on the total amount of data to be processed and the unit time period length, calculate the total transmission time required. Then, try to distribute these total transmission times to the identified available time periods.

[0160] If there are multiple feasible combination schemes, optimization algorithms (such as greedy algorithms, dynamic programming, etc.) can be used to select the best scheme to minimize transmission delay or maximize resource utilization. Finally, based on the results of the combination processing, the scheduled transmission time periods that meet the transmission time requirements are determined. These time periods should cover the entire data transmission process and ensure that the transmission is completed within the specified time limit.

[0161] In this embodiment, by combining discontinuous available time periods, the resources of the target computing nodes can be more effectively utilized to avoid idle resources. Through precise calculation and combined processing, it can be ensured that the data to be processed is transmitted within the specified time limit.

[0162] In an exemplary embodiment, as shown in FIG5 , at least two discontinuous available time periods are combined according to the unit time period length to obtain a reserved transmission time period that meets the transmission timeliness requirement, including:

[0163] S501: For each available period of at least two discontinuous available periods, extract a sub-period from the available period.

[0164] The length of a sub-period is an integer multiple of the length of a unit period.

[0165] Optionally, first, it is necessary to clarify the unit time period length required to transmit a unit amount of data in the data to be processed. This can be determined through experimental measurement, historical data analysis, or based on system performance parameters. Next, identify at least two discontinuous available time periods in the target computing power node. These time periods may be caused by other task occupation, system maintenance, or resource fluctuations of the computing power node itself. For each identified available time period, one or more sub-periods are intercepted from it according to the unit time period length. When intercepting, ensure that the time period length of the sub-period is an integer multiple of the unit time period length, so as to ensure the continuity and efficiency of data transmission.

[0166] S502: Combine sub-periods corresponding to each available period in at least two discontinuous available periods to obtain a reserved transmission period that meets the transmission timeliness requirement.

[0167] Optionally, the sub-periods are sorted according to their start time and length. This facilitates the subsequent combination process. Then, the sub-periods are combined using a suitable combination strategy. The combination strategy may include sequential combination, staggered combination, or segmented combination, depending on the distribution of available time periods and the transmission time efficiency requirements. During the combination process, it is necessary to ensure that the combined scheduled transmission time period can meet the transmission time efficiency requirements. This can be evaluated by calculating the overall length of the combined time period, considering factors such as the rate and efficiency of data transmission. Finally, the scheduled transmission time period that meets the transmission time efficiency requirements is determined based on the combination result. This time period should cover the entire data transmission process and ensure that the transmission is completed within the specified time efficiency.

[0168] In this embodiment, by intercepting sub-periods and combining them for processing, the scattered resources of the target computing power node can be more effectively utilized and resource waste can be avoided.

[0169] In an exemplary embodiment, as shown in Figure 6, a data processing system diagram of a data processing method is provided, including: a user interface, a storage module, a reservation transmission plug-in, a network interface, a control interface, a security module, a computing interface, and an execution module. The modules cooperate with each other through an efficient network communication mechanism to support the data storage and transmission requirements of the computing network during flexible scheduling.

[0170] The user interface is a bridge between the user and the system. The user interface is responsible for receiving the data transmitted by the user and transmitting the processing results to the user. The user can conveniently store the data into the storage module through the interface and obtain the final processing results through the interface after the processing is completed.

[0171] The storage module is responsible for data storage and management. The user data is stored in the edge node of the idle high-speed transmission network closest to the user node, which is used to cache the user data and the data processed by the computing node.

[0172] The control interface connects and communicates with the computing network platform, receives instructions from the computing network platform (such as start transmission time instructions, user information, user service information, etc.), and feeds back the status information of data transmission completion to the computing network platform.

[0173] Among them, the scheduled transmission plug-in is responsible for the timing of the transmission time and the management of the reservation mechanism. When the start transmission time instruction is received from the computing power network platform, the reservation mechanism is started, and the data is transmitted through the execution module when the scheduled transmission time arrives.

[0174] Among them, the network interface is responsible for communication with the external network.

[0175] When the transmission time arrives, the data in the storage module is sent to the network; at the same time, the data transmitted from the network is received.

[0176] The computing interface communicates and transmits data with the computing nodes. It is responsible for transmitting data to the connected computing nodes and receiving the computing results processed by the computing nodes.

[0177] The execution module is responsible for executing data transmission and pre-processing calculation instruction operations. According to the instructions received by the control interface and the timing results of the scheduled transmission plug-in, the data transmission and pre-processing calculation tasks are executed.

[0178] Among them, the security module is responsible for data security, including data encryption, permission management and data integrity verification, to ensure the security and integrity of data during storage, transmission and processing.

[0179] In this embodiment, the fast storage, transmission and processing of data are achieved through efficient collaboration and network communication mechanism between modules. The system architecture supports flexible computing power scheduling and data transmission strategies, and can adapt to different data processing requirements and network conditions. Through the setting of security modules and advanced security technologies, the security and privacy protection of data during storage, transmission and processing are ensured.

[0180] It should be understood that, although the steps in the flowcharts involved in the above embodiments are displayed in sequence according to the indication of the arrows, these steps are not necessarily executed in sequence according to the order indicated by the arrows. Unless there is a clear explanation in this article, the execution of these steps is not strictly limited in order, and these steps can be executed in other orders. Moreover, at least a part of the steps in the flowcharts involved in the above embodiments may include multiple steps or multiple stages, and these steps or stages are not necessarily executed at the same time, but can be executed at different times, and the execution order of these steps or stages is not necessarily carried out in sequence, but can be executed in turn or alternately with other steps or at least a part of the steps or stages in other steps.

[0181] Based on the same inventive concept, the embodiment of the present application also provides a data processing device for implementing the data processing method involved above. The implementation scheme for solving the problem provided by the device is similar to the implementation scheme recorded in the above method, so the specific limitations in the one or more data processing device embodiments provided below can refer to the limitations on the data processing method above, and will not be repeated here.

[0182] In an exemplary embodiment, as shown in FIG7 , a data processing device is provided, including: an acquisition module 11, a resource evaluation module 12, a time period determination module 13 and a data transmission module 14, wherein:

[0183] An acquisition module 11 is used to acquire the to-be-processed data of the computing power demander and the transmission timeliness requirement corresponding to the to-be-processed data;

[0184] A resource evaluation module 12 is used to determine the computing power required to process the data to be processed;

[0185] The node selection module is used to select a target computing node that meets the computing power requirement resources from the candidate computing nodes in the computing power network;

[0186] The time period determination module 13 is used to obtain at least one available time period of the target computing power node, and determine a reserved transmission time period that meets the transmission time efficiency requirement according to at least one available time period of the target computing power node;

[0187] The data transmission module 14 is used to transmit the data to be processed to the target computing power node within the scheduled transmission period.

[0188] In one embodiment, the computing power demand resources include storage demand resources and computing demand resources; the node selection module is further used to: select a target device that meets the storage demand resources from each edge device according to the demand location information of the computing power demander and the device location information of each edge device of the computing power network;

[0189] Store the data to be processed in the target device;

[0190] During the scheduled transmission period, the data to be processed is transmitted from the target device to the target computing power node.

[0191] In one embodiment, the time period determination module 13 is further used to: obtain a list of pending tasks of the target computing power node; wherein the list of pending tasks includes each pending task sorted in chronological order according to the task processing time period;

[0192] Obtain the remaining computing power resources of the target computing power node when processing each pending task;

[0193] The tasks to be processed whose remaining computing resources can meet the computing power demand resources are taken as the first processing tasks, and the tasks to be processed whose remaining computing resources cannot meet the computing power demand resources are taken as the second processing tasks;

[0194] Determine the available time period of the target computing power node according to the task processing time period corresponding to the first processing task; and

[0195] The available time period of the target computing power node is determined according to the idle time period formed by the task processing time period corresponding to the second processing task.

[0196] In one embodiment, the time period determination module 13 is further used to: for two adjacent second processing tasks, if the task processing time periods of the two adjacent second processing tasks are not continuous, use the space time period between the task processing time periods of the two adjacent second processing tasks as an available time period of the target computing power node; and

[0197] When the last task to be processed in the list of tasks to be processed is the second processing task, a time period of a preset length after the task processing period corresponding to the last generation processing task is used as an available time period for the target computing power node.

[0198] In one embodiment, the time period determination module 13 is further used to: determine the unit time period length required for transmitting a unit amount of data in the data to be processed;

[0199] When there are at least two discontinuous available time periods at the target computing power node, the at least two discontinuous available time periods are combined according to the unit time period length to obtain a reserved transmission time period that meets the transmission timeliness requirements.

[0200] In one embodiment, the time period determination module 13 is further used to: for each available time period of at least two discontinuous available time periods, extract a sub-time period from the available time period; wherein the time period length of the sub-time period is an integer multiple of the unit time period length;

[0201] Sub-periods corresponding to each available period in at least two discontinuous available periods are combined to obtain a reserved transmission period that meets the transmission timeliness requirement.

[0202] Each module in the above data processing device can be implemented in whole or in part by software, hardware or a combination thereof. Each module can be embedded in or independent of a processor in a computer device in the form of hardware, or can be stored in a memory in a computer device in the form of software, so that the processor can call and execute operations corresponding to each module.

[0203] In an exemplary embodiment, a computer device is provided, which may be a server, and its internal structure diagram may be shown in FIG8. The computer device includes a processor, a memory, an input / output interface (Input / Output, referred to as I / O) and a communication interface. The processor, the memory and the input / output interface are connected via a system bus, and the communication interface is connected to the system bus via the input / output interface. The processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to store data of a data processing method. The input / output interface of the computer device is used to exchange information between the processor and an external device. The communication interface of the computer device is used to communicate with an external terminal via a network connection. When the computer program is executed by the processor, a data processing method is implemented.

[0204] Those skilled in the art will understand that the structure shown in FIG. 8 is merely a block diagram of a partial structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than shown in the figure, or combine certain components, or have a different arrangement of components.

[0205] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and when the processor executes the computer program, the following steps are implemented:

[0206] Obtain the data to be processed by the computing power demander and the transmission timeliness requirements corresponding to the data to be processed;

[0207] Determine the computing power required to process the data to be processed;

[0208] Select the target computing node that meets the computing power requirement from the candidate computing nodes in the computing power network;

[0209] Obtain at least one available time period of the target computing power node, and determine a reserved transmission time period that meets the transmission timeliness requirement based on at least one available time period of the target computing power node;

[0210] During the scheduled transmission period, the data to be processed is transmitted to the target computing power node.

[0211] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the following steps are implemented:

[0212] Obtain the data to be processed by the computing power demander and the transmission timeliness requirements corresponding to the data to be processed;

[0213] Determine the computing power required to process the data to be processed;

[0214] Select the target computing node that meets the computing power requirement from the candidate computing nodes in the computing power network;

[0215] Obtain at least one available time period of the target computing power node, and determine a reserved transmission time period that meets the transmission timeliness requirement based on at least one available time period of the target computing power node;

[0216] During the scheduled transmission period, the data to be processed is transmitted to the target computing power node.

[0217] In one embodiment, a computer program product is provided, comprising a computer program, which, when executed by a processor, implements the following steps:

[0218] Obtain the data to be processed by the computing power demander and the transmission timeliness requirements corresponding to the data to be processed;

[0219] Determine the computing power required to process the data to be processed;

[0220] Select the target computing node that meets the computing power requirement from the candidate computing nodes in the computing power network;

[0221] Obtain at least one available time period of the target computing power node, and determine a reserved transmission time period that meets the transmission timeliness requirement based on at least one available time period of the target computing power node;

[0222] During the scheduled transmission period, the data to be processed is transmitted to the target computing power node.

[0223] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0224] A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment method can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0225] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0226] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A data processing method, characterized in that: The method comprises: Obtaining the data to be processed of the computing power demander and the transmission timeliness requirement corresponding to the data to be processed; Determine the computing power required to process the data to be processed; Selecting a target computing node that meets the computing power requirement resources from the candidate computing power nodes of the computing power network; Acquire at least one available time period of the target computing power node, and determine a reserved transmission time period that meets the transmission timeliness requirement according to the at least one available time period of the target computing power node; During the scheduled transmission period, the data to be processed is transmitted to the target computing power node.

2. The method according to claim 1, characterized in that The computing power requirement resources include storage requirement resources and computing requirement resources; and transmitting the to-be-processed data to the target computing power node within the scheduled transmission period includes: According to the demand location information of the computing power demander and the device location information of each edge device of the computing power network, a target device that meets the storage demand resources is selected from each edge device; storing the data to be processed in the target device; During the scheduled transmission period, the data to be processed is transmitted from the target device to the target computing power node.

3. The method according to claim 1, characterized in that The obtaining at least one available time period of the target computing power node includes: Obtaining a list of pending tasks of the target computing power node; wherein the list of pending tasks includes the pending tasks sorted in chronological order according to the task processing period; Obtain the remaining computing power resources when the target computing power node processes each task to be processed; The tasks to be processed whose remaining computing power resources can meet the computing power demand resources are taken as the first processing tasks, and the tasks to be processed whose remaining computing power resources cannot meet the computing power demand resources are taken as the second processing tasks; Determining an available time period of the target computing power node according to the task processing time period corresponding to the first processing task; and Determine the available time period of the target computing power node according to the idle time period formed by the task processing time period corresponding to the second processing task.

4. The method according to claim 3, characterized in that The determining, according to the spatial period formed by the task processing period corresponding to the second processing task, the available period of the target computing power node includes: For two adjacent second processing tasks, if the task processing time periods of the two adjacent second processing tasks are not continuous, the space time period between the task processing time periods of the two adjacent second processing tasks is used as an available time period of the target computing power node; and When the last task to be processed in the list of tasks to be processed is the second processing task, a time period of a preset length after the task processing period corresponding to the last generation processing task is used as an available time period for the target computing power node.

5. The method according to claim 1, characterized in that The determining, according to at least one available time period of the target computing power node, a reserved transmission time period that meets the transmission time efficiency requirement includes: Determine the length of a unit time period required to transmit a unit amount of data in the data to be processed; In the case that the target computing power node has at least two discontinuous available time periods, the at least two discontinuous available time periods are combined and processed according to the unit time period length to obtain a reserved transmission time period that meets the transmission timeliness requirement.

6. The method according to claim 5, characterized in that The combining and processing of at least two discontinuous available time periods according to the unit time period length to obtain a reserved transmission time period that meets the transmission time efficiency requirement includes: For each available period of at least two discontinuous available periods, a sub-period is intercepted from the available period; wherein the period length of the sub-period is an integer multiple of the unit period length; Sub-periods corresponding to each available period in at least two discontinuous available periods are combined to obtain a reserved transmission period that meets the transmission timeliness requirement.

7. A data processing device, characterized in that: The device comprises: An acquisition module, used to acquire the to-be-processed data of the computing power demander and the transmission timeliness requirement corresponding to the to-be-processed data; A resource evaluation module, used to determine the computing power required to process the data to be processed; A node selection module is used to select a target computing node that meets the computing power requirement resources from each candidate computing power node of the computing power network; A time period determination module, used to obtain at least one available time period of the target computing power node, and determine a reserved transmission time period that meets the transmission timeliness requirement according to at least one available time period of the target computing power node; A data transmission module is used to transmit the data to be processed to the target computing power node within the scheduled transmission period.

8. A computer device comprising a memory and a processor, wherein the memory stores a computer program, wherein: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 6 are implemented.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

10. A computer program product, comprising a computer program, characterized in that When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 6 are implemented.

Citation Information

Cited By

  • Cloud computing resource scheduling method and system based on artificial intelligence

    CN120602494A

  • Cloud edge collaborative management method and system based on edge computing

    CN120614354A