Data processing method, device, computer equipment and storage medium

By determining the task priority based on the data label and saving it to the task queue when the resource utilization rate of edge nodes exceeds the standard, the problem of data requests for important services cannot be responded in a timely manner, and the priority response to important services and service quality are achieved.

CN114153581BActive Publication Date: 2025-05-02BEIJING KINGSOFT CLOUD NETWORK TECH CO LTD +1
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202111433575.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-11-29
Publication Date
2025-05-02
Estimated Expiration
2041-11-29

AI Technical Summary

Technical Problem

When the resource utilization rate of edge nodes exceeds the standard, data requests for important services cannot be responded in a timely manner, resulting in poor service quality.

Method used

The processing priority of the target task is determined based on the data label when the resource utilization of the target node reaches or exceeds the preset threshold and saves it to the task queue. After the execution of a task with a pending priority higher than the target priority is completed, the target task is executed.

Benefits of technology

It is realized that when the resource utilization rate of edge nodes exceeds the standard, priority response and processing of data requests for important services with higher priority are achieved, thereby ensuring the data service quality of important services.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114153581B_ABST
    Figure CN114153581B_ABST
Patent Text Reader

Abstract

The present application relates to a data processing method, device, computer equipment and storage medium. The method comprises: a target node acquires a target task of a target terminal, the target task is a data task generated based on a data request of the target terminal, and the data request carries a data tag for indicating a data service quality requirement; when the resource utilization rate of the target node is greater than or equal to a preset threshold, the processing priority of the target task is determined according to the data tag, the target priority is obtained, and the target task is saved in a task queue, and when all data tasks with a processing priority greater than the target priority are completed, the target task is executed, in this way, the data tasks received by the target node are graded according to different data service quality requirements, and when the resource utilization rate of the edge node exceeds the standard, the data request of an important business with a higher priority can be responded to in a timely manner.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of cloud computing technology, and in particular to a data processing method, apparatus, computer equipment and storage medium. Background Art

[0002] CDN (Content Delivery Network) is an intelligent virtual network built on the existing network. It relies on edge servers (i.e. edge nodes) deployed in various places. Through the load balancing, content distribution, scheduling and other functional modules of the central platform, it enables users to obtain the required content nearby, reduce network congestion, and improve user access response speed and hit rate.

[0003] Because customers of different service types have different requirements for data service quality, in general, the service quality required by video services is higher than that required by download services, and the service quality required by short video services is higher than that required by long video services. However, when the resource utilization rate of edge nodes is about to exceed the standard or has exceeded the standard, urgent data requests may not be responded to in time, resulting in poor service quality of important services. Summary of the invention

[0004] In order to solve the above technical problems, the present application provides a data processing method, apparatus, computer device and storage medium.

[0005] In a first aspect, the present application provides a data processing method, which is applied to an edge node, comprising:

[0006] Acquire a target task of a target terminal, wherein the target task is used to provide the target terminal with target data stored in a target node, and the target task is a data task generated based on a data request of the target terminal, and the data request carries a data tag for indicating a data service quality requirement;

[0007] When the resource usage rate of the target node is greater than or equal to a preset threshold, determining the target priority corresponding to the target task according to the data tag, wherein the target priority is the processing priority of the target task;

[0008] Saving the target task to a task queue;

[0009] When the data task in the task queue whose processing priority is greater than the target priority is completed, the target task is executed.

[0010] In a second aspect, the present application provides a data processing device, comprising:

[0011] A task acquisition module, used to acquire a target task of a target terminal, wherein the target task is used to provide the target terminal with target data stored in a target node, and the target task is a data task generated based on a data request of the target terminal, and the data request carries a data tag for indicating a data service quality requirement;

[0012] A priority determination module, configured to determine a target priority corresponding to the target task according to the data tag when the resource utilization rate of the target node is greater than or equal to a preset threshold, wherein the target priority is a processing priority of the target task;

[0013] A task saving module, used for saving the target task to a task queue;

[0014] The task execution module is used to execute the target task when the data task with a processing priority greater than the target priority in the task queue is completed.

[0015] In a third aspect, the present application provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the computer program, the following steps are implemented:

[0016] Acquire a target task of a target terminal, wherein the target task is used to provide the target terminal with target data stored in a target node, and the target task is a data task generated based on a data request of the target terminal, and the data request carries a data tag for indicating a data service quality requirement;

[0017] When the resource usage rate of the target node is greater than or equal to a preset threshold, determining the target priority corresponding to the target task according to the data tag, wherein the target priority is the processing priority of the target task;

[0018] Saving the target task to a task queue;

[0019] When the data task in the task queue whose processing priority is greater than the target priority is completed, the target task is executed.

[0020] In a fourth aspect, the present application provides a computer-readable storage medium having a computer program stored thereon, wherein when the computer program is executed by a processor, the following steps are implemented:

[0021] Acquire a target task of a target terminal, wherein the target task is used to provide the target terminal with target data stored in a target node, and the target task is a data task generated based on a data request of the target terminal, and the data request carries a data tag for indicating a data service quality requirement;

[0022] When the resource usage rate of the target node is greater than or equal to a preset threshold, determining the target priority corresponding to the target task according to the data tag, wherein the target priority is the processing priority of the target task;

[0023] Saving the target task to a task queue;

[0024] When the data task in the task queue whose processing priority is greater than the target priority is completed, the target task is executed.

[0025] Based on the above data processing method, the target node obtains the target task of the target terminal, wherein the target node is used to indicate any edge node, the target task is used to provide the target terminal with the target data stored in the target node, and the target task is a data task generated based on the data request of the target terminal, and the data request carries a data tag for indicating the data service quality requirement; when the resource utilization rate of the target node is greater than or equal to a preset threshold, the processing priority of the target task is determined according to the data tag, the target priority is obtained, and the target task is saved in the task queue, and the data tasks in the task queue are executed in sequence according to the processing priority, and the data tasks with high priority are processed first. When the data tasks with a processing priority greater than the target priority are all executed, the target task is executed. In this way, the data tasks received by the target node are graded according to different data service quality requirements. When the resource utilization rate of the edge node exceeds the standard, the data requests of important services with higher priority can be responded to in time. BRIEF DESCRIPTION OF THE DRAWINGS

[0026] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the invention and, together with the description, serve to explain the principles of the invention.

[0027] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0028] Figure 1 An application environment diagram of a data processing method in an embodiment;

[0029] Figure 2 is a flow chart of a data processing method in one embodiment;

[0030] Figure 3 is a structural block diagram of a data processing device in one embodiment;

[0031] Figure 4 FIG. 4 is a diagram showing the internal structure of a computer device in one embodiment. DETAILED DESCRIPTION

[0032] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of this application.

[0033] Figure 1 FIG. 1 is an application environment diagram of a data processing method in an embodiment. Figure 1 , the data processing method is applied to a data processing system. The data processing system includes a terminal 110, an edge node 120 and a dispatch center 130. The terminal 110 and the edge node 120 and the dispatch center 130 are connected through a network. The terminal 110 can be a desktop terminal or a mobile terminal, and the mobile terminal can be at least one of a mobile phone, a tablet computer, a laptop computer, etc. The edge node 120 can be implemented with an independent server or a server cluster composed of multiple servers. The edge node 120 can be a CDN node or a home node, and the home node is a router or set-top box that uses idle bandwidth to provide download services for ordinary user families. The CDN node is a node in the content distribution network, wherein the CDN node refers to a network node with fewer intermediate links from the end user access, and has better response capabilities and connection speeds for the end access users. The CDN node can be used as a cache server to provide data services.

[0034] After receiving the data request from the terminal 110, the dispatch center 130 matches the edge node 120 storing the target data according to the target data requested by the data request, and returns the access address of the matched edge node 120 to the terminal 110. The terminal 110 sends a data request to the edge node 120 storing the target data according to the access address, and the edge node 120 provides the terminal 110 with data services of the target data according to the data request.

[0035] In one embodiment, referring to Figure 2 , provides a data processing method. This embodiment mainly applies this method to the above Figure 1 Taking the edge node in the example as an example, the data processing method specifically includes the following steps:

[0036] Step S210, obtaining the target task of the target terminal.

[0037] In this embodiment, the target task is used to provide the target terminal with the target data stored in the target node. The target node is any edge node. The target task is a data task generated based on the data request of the target terminal, that is, the target node generates a corresponding data task when receiving the data request. The data request carries a data tag for indicating the data service quality requirement. The data tag specifically includes an application tag and a business tag. The application tag is used to indicate the application plug-in that initiates the data request in the target terminal. For example, the application tag can be used to indicate application plug-ins such as Tencent Video, Mango TV or Kuaishou Live. The application tag is specifically a unique identifier of the indicated application plug-in, such as an application identifier string.

[0038] Step S220, when the resource usage rate of the target node is greater than or equal to a preset threshold, determine the target priority corresponding to the target task according to the data tag.

[0039] In this embodiment, the target priority is the processing priority of the target task. If the resource utilization rate of the target node is greater than or equal to the preset threshold, it means that the target node has a large amount of access and cannot respond to all data requests in a timely manner. Only some data requests that need to be responded to in a timely manner can be selected according to their importance and urgency. That is, in this case, the processing priority of the target task and other unexecuted data tasks is determined. The higher the processing priority, the higher the importance and urgency of the data task, and the pending tasks with high processing priority will be given priority.

[0040] Step S230, saving the target task to a task queue.

[0041] In this embodiment, the task queue is used to save data tasks corresponding to all data requests that the target node has not responded to, and the data tasks in the task queue are arranged in descending order of processing priority, and the target tasks are saved in the order in which the target priorities are in the task queue.

[0042] Step S240, executing the target task when the data task with a processing priority greater than the target priority in the task queue is completed.

[0043] In this embodiment, the target node processes the data tasks in the task queue in descending order of processing priority. The target task will be executed only when the data task with a processing priority greater than the target priority in the task queue is completed. In this way, even if the resource utilization rate of the edge node exceeds the standard, it can also respond to data requests of important services with higher priority in a timely manner.

[0044] In one embodiment, when the resource utilization rate of the target node is greater than or equal to a preset threshold, the target priority corresponding to the target task is determined according to the data tag, including: when the disk read rate of the target node is greater than or equal to the read threshold, the target read priority corresponding to the data read task is determined according to the data tag.

[0045] Specifically, the resource utilization rate includes the disk read rate, and the disk read rate is used to indicate the disk read performance of the target node. The preset threshold includes the read threshold. The target priority includes the target read priority. The target task includes the data read task. The read threshold is used to indicate the upper limit of the disk for data reading. The disk read rate is greater than or equal to the read threshold, indicating that the disk read performance has reached the data reading upper limit, that is, the target node receives a large number of data requests and the disk is unable to read them all. In this way, the target read priority of the data reading task is determined according to the data label. In this way, the priorities of multiple data tasks to be read are distinguished, so that the target node can subsequently select data tasks with higher priorities for reading.

[0046] In one embodiment, after determining the target read priority corresponding to the data reading task according to the data tag, saving the target task to the task queue includes: saving the data reading task to the reading task queue; executing the target task when the data task with a processing priority greater than the target read priority in the task queue is completed, includes: executing the data reading task when the data task with a reading priority greater than the target read priority in the reading task queue is completed.

[0047] Specifically, the task queue includes a read task queue, which is used to save the data tasks to be read from the disks of all target nodes. The data reading tasks are saved in the read task queue in descending order of the read priority. The data tasks to be read in the read task queue are arranged in descending order of the read priority. The target node gives priority to executing the data tasks to be read with high read priority in the read task queue. The data reading tasks corresponding to the target terminal are not executed until the data tasks with a read priority greater than the target priority in the read task queue are completed. In this way, the edge nodes can give priority to reading data tasks with higher importance and urgency.

[0048] In one embodiment, when the resource utilization rate of the target node is greater than or equal to a preset threshold, the target priority corresponding to the data task is determined according to the data tag, including: when the bandwidth utilization rate of the target node is greater than or equal to the bandwidth threshold, the target sending priority corresponding to the data sending task is determined according to the data tag.

[0049] Specifically, the resource utilization rate also includes the bandwidth utilization rate, the preset threshold includes the bandwidth threshold, the target priority includes the target sending priority, and the data task includes the data sending task. If the bandwidth utilization rate is greater than or equal to the bandwidth threshold, it means that the available bandwidth of the edge node is smaller, that is, the edge node has more data to be sent, but the bandwidth is insufficient, and the edge node is in a state where it cannot send the data. In this case, it is necessary to prioritize the data to be sent, that is, determine the target sending priority corresponding to the data sending task according to the data label, and determine the sending priority corresponding to each data task in this way, so that the edge node can give priority to sending the data to be sent corresponding to the data task with a higher priority, so as to achieve priority response to data requests with higher importance and urgency.

[0050] In one embodiment, after determining the target sending priority corresponding to the data sending task according to the data tag, the method further includes: acquiring the target data corresponding to the data sending task; saving the target task to a task queue includes: saving the target data corresponding to the data sending task to a sending task queue, wherein the task queue includes a sending task queue; executing the target task when the data task having a processing priority greater than the target priority in the task queue is completed, includes: sending the target data to the target terminal when the data task having a sending priority greater than the target sending priority in the sending task queue is completed.

[0051] Specifically, after the target node executes the data reading task, it searches locally for the target data required by the data request of the target terminal. The data sending task is used to send the target data required by the data request to the target terminal. However, due to the high bandwidth utilization rate of the target node, the target data corresponding to the data sending task needs to be saved in the sending task queue and wait for sending. The sending task queue includes all the data to be sent, and each piece of data to be sent is arranged in descending order according to the sending priority. The target node sends the data to be sent in sequence according to the sending priority. The data task with a sending priority greater than the target sending priority in the sending task queue is completed, that is, the data to be sent with a sending priority greater than the target sending priority in the sending task queue has been successfully sent to the corresponding terminal, and then the target data is sent to the target terminal. In this way, when the bandwidth utilization rate of the edge node reaches a bottleneck, the data corresponding to the data request with higher importance and urgency is sent first, thereby ensuring that the data service quality of important businesses will not deteriorate due to the high resource utilization rate of the edge node.

[0052] In one embodiment, the data tag includes an application tag, a business tag and a first packet tag, and determining the target priority corresponding to the target task based on the data tag includes: determining a first numerical value corresponding to the application tag; determining a second numerical value corresponding to the business tag; determining a third numerical value corresponding to the first packet tag; and weightedly summing the first numerical value, the second numerical value and the third numerical value to obtain a fourth numerical value, wherein the fourth numerical value is used to indicate the target priority corresponding to the target task, and the target task is a data task generated based on the first packet data or non-first packet data in the data request of the target terminal.

[0053] Specifically, the first value is used to indicate the customer requirement level corresponding to the application tag. The edge node locally stores priority matching rules in advance, including priority values ​​for service quality requirements for different application tags, priority values ​​for service quality requirements for different business tags, and priority values ​​for service quality requirements for different data types. The application tag is used to indicate application-side customers, such as Mango TV, Tencent Video, and King of Glory. Different application-side customers have different requirements for data service quality. For example, the application tag is Mango TV, and the priority value corresponding to Mango TV is searched locally at the edge node. The first value is found to be 30, and the first value is within the first value range. Assuming that the first value range is 0-30, it is determined that Mango TV has high service quality requirements.

[0054] The second value is used to indicate the service requirement level corresponding to the service label. The service label is used to indicate the service type of the data request. The service types specifically include long video service, short video service, file download service, game service, etc. Based on the above example, the application label is Mango TV, and the service label is long video service. The priority value corresponding to the long video service is searched locally on the edge node, and the second value is found to be 20. The second value is within the second value range. Assuming that the second value range is 0-40, it is determined that the service quality requirements of Mango TV's long video service are general.

[0055] The third value is used to indicate the service requirement level corresponding to the first packet data or the non-first packet data in the data request of the target terminal. The data request includes the first packet data and the non-first packet data. The target task includes the first task and the second task. When the edge node receives the data request, the edge node generates the corresponding first task according to the first packet data in the data request, and generates the corresponding second task according to the non-first packet data in the data request. The first packet tag includes the first packet identifier and the non-first packet identifier. The first packet identifier is used to indicate that the first task is generated based on the first packet data in the data request, and the non-first packet identifier is used to indicate that the second task is generated based on the non-first packet data in the data request. The third value is within the third value interval. The third value interval can be set to any value interval according to actual conditions. In this embodiment, it is assumed that the third value interval is 0-10. When the first packet tag is the first packet identifier, the priority value corresponding to the first packet identifier is searched locally at the edge node, and the third value is 10; when the first packet tag is the non-first packet identifier, the third value is 0, and the processing priority of the first task is greater than the processing priority of the second task.

[0056] The weight corresponding to each label can be customized according to actual conditions. For example, the first value is 30, the second value is 20, and the third value is 10. The weight corresponding to each label is 1. The first value, the second value and the third value are weighted and summed, that is, the fourth value is 30+20+10=60, which is used to indicate the target priority corresponding to the first task.

[0057] In one embodiment, after executing the target task, the method further includes: when the target task is completed as the head task in the task queue, increasing the processing priority corresponding to each data task in the task queue by a preset level.

[0058] Specifically, the head task refers to the data task that is at the top of the task queue. The preset level is used to indicate a level value of any positive integer. When the head task is completed, the processing priority of all data tasks in the task queue is increased by the preset level, that is, the priority value corresponding to each data task is increased by the same level value. For example, the preset level is 10. Every time a head task is completed in the task queue, 10 is added to the value corresponding to the processing priority of the remaining data tasks in the task queue. In this way, the value corresponding to the processing priority of the remaining data tasks in the task queue is accumulated, that is, the processing priority of data tasks is iteratively improved to avoid the long-term inability to process data tasks with lower priority values.

[0059] In one embodiment, the process of the data processing method is as follows: Figure 2 It should be understood that although Figure 2The steps in the flowchart are shown in sequence as indicated by the arrows, but these steps are not necessarily executed in the order indicated by the arrows. Unless otherwise specified in this document, there is no strict order restriction for the execution of these steps, and these steps can be executed in other orders. Moreover, Figure 2 At least part of the steps may include multiple sub-steps or multiple stages. These sub-steps or stages are not necessarily executed at the same time, but can be executed at different times. The execution order of these sub-steps or stages is not necessarily sequential, but can be executed in turn or alternately with other steps or at least part of the sub-steps or stages of other steps.

[0060] In one embodiment, Figure 3 As shown, a data processing device is provided, comprising:

[0061] The task acquisition module 310 is used to acquire a target task of a target terminal, wherein the target task is used to provide the target terminal with target data stored in a target node, and the target task is a data task generated based on a data request of the target terminal, and the data request carries a data tag for indicating a data service quality requirement;

[0062] A priority determination module 320, configured to determine a target priority corresponding to the target task according to the data tag when the resource usage rate of the target node is greater than or equal to a preset threshold, wherein the target priority is a processing priority of the target task;

[0063] The task saving module 330 is used to save the target task to the task queue;

[0064] The task execution module 340 is used to execute the target task when the data task with a processing priority greater than the target priority in the task queue is completed.

[0065] In one embodiment, when the resource usage rate of the target node is greater than or equal to a preset threshold, the priority determination module 320 is further configured to:

[0066] When the disk read rate of the target node is greater than or equal to the read threshold, the target read priority corresponding to the data read task is determined according to the data tag, wherein the resource utilization rate includes the disk read rate, the preset threshold includes the read threshold, the target priority includes the target read priority, and the target task includes the data read task.

[0067] In one embodiment, after determining the target reading priority corresponding to the data reading task according to the data tag, the task saving module 330 is further used to:

[0068] Saving the data reading task to a reading task queue, wherein the task queue includes the reading task queue;

[0069] The task execution module 340 is also used for:

[0070] When a data task in the read task queue whose read priority is greater than the target read priority is completed, the data read task is executed.

[0071] In one embodiment, the priority determination module 320 is further configured to:

[0072] When the bandwidth utilization rate of the target node is greater than or equal to the bandwidth threshold, the target sending priority corresponding to the data sending task is determined according to the data tag, wherein the resource utilization rate includes the bandwidth utilization rate, the preset threshold includes the bandwidth threshold, the target priority includes the target sending priority, and the data task includes the data sending task.

[0073] In one embodiment, after determining the target sending priority corresponding to the data sending task according to the data tag, the device further includes a data acquisition module for:

[0074] Acquire target data corresponding to the data sending task;

[0075] The task saving module 330 is further used to: save the target data corresponding to the data sending task to a sending task queue, wherein the task queue includes a sending task queue;

[0076] The task execution module 340 is further used to: send the target data to the target terminal when the data sending task with a priority greater than the target sending priority in the sending task queue is executed.

[0077] In one embodiment, the data tag includes an application tag, a service tag, and a first packet tag, and the priority determination module 320 is further used to:

[0078] Determine a first value corresponding to the application tag, wherein the first value is used to indicate a customer requirement level corresponding to the application tag;

[0079] Determine a second value corresponding to the service tag, wherein the second value is used to indicate a service requirement level corresponding to the service tag;

[0080] Determine a third value corresponding to the first packet tag, wherein the third value is used to indicate a service requirement level corresponding to the first packet data or the non-first packet data in the data request of the target terminal;

[0081] Perform a weighted summation on the first value, the second value, and the third value to obtain a fourth value, wherein the fourth value is used to indicate the target priority corresponding to the target task, and the target task is a data task generated based on the first packet data or non-first packet data in the data request of the target terminal.

[0082] In one embodiment, after executing the target task, the priority determination module 320 is further used to:

[0083] When the target task is completed as the head task in the task queue, the processing priority corresponding to each data task in the task queue is increased by a preset level.

[0084] like Figure 4 As shown, the computer device may specifically be Figure 1 The edge node 120 in FIG. Figure 4 As shown, the computer device includes a processor, a memory, a network interface, an input device and a display screen connected through a system bus. Among them, the memory includes a non-volatile storage medium and an internal memory. The non-volatile storage medium of the computer device stores an operating system and may also store a computer program, which, when executed by the processor, enables the processor to implement a data processing method. The internal memory may also store a computer program, which, when executed by the processor, enables the processor to execute a data processing method. The display screen of the computer device may be a liquid crystal display or an electronic ink display screen, and the input device of the computer device may be a touch layer covered on the display screen, or a button, trackball or touchpad provided on the housing of the computer device, or an external keyboard, touchpad or mouse, etc.

[0085] Those skilled in the art will understand that Figure 4 The structure shown in the figure is only a block diagram of a part of the structure related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine certain components, or have a different arrangement of components.

[0086] In one embodiment, the data processing device provided by the present application can be implemented in the form of a computer program. The computer program can be Figure 4 The computer device shown in the figure is run on the computer device. The memory of the computer device can store various program modules constituting the data processing device, such as: Figure 3The task acquisition module 310, priority determination module 320, task storage module 330 and task execution module 340 are shown. The computer program composed of various program modules enables the processor to execute the steps of the data processing method of each embodiment of the present application described in this specification.

[0087] Figure 4 The computer device shown can be Figure 3 The task acquisition module 310 in the data processing device shown executes a target task for acquiring a target terminal, wherein the target task is used to provide the target terminal with target data stored in a target node, and the target task is a data task generated based on a data request of the target terminal, and the data request carries a data tag for indicating data service quality requirements. The computer device can determine the target priority corresponding to the target task according to the data tag through the priority determination module 320 when the resource utilization rate of the target node is greater than or equal to a preset threshold, wherein the target priority is the processing priority of the target task. The computer device can save the target task to a task queue through the task saving module 330. The computer device can execute the target task through the task execution module 340 when the data task with a processing priority greater than the target priority in the task queue is completed.

[0088] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the method described in any one of the above embodiments is implemented when the processor executes the computer program.

[0089] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method described in any one of the above embodiments is implemented.

[0090] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application can include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0091] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0092] The foregoing is merely a specific embodiment of the present invention, which enables those skilled in the art to understand or implement the present invention. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to the embodiments shown herein, but rather to the widest scope consistent with the principles and novel features claimed herein.

Claims

1. A data processing method, characterized in that: Applied to an edge node, the method comprises: Acquire a target task of a target terminal, wherein the target task is used to provide the target terminal with target data stored in a target node, and the target task is a data task generated based on a data request of the target terminal, and the data request carries a data tag for indicating a data service quality requirement; When the resource utilization rate of the target node is greater than or equal to a preset threshold, the target priority corresponding to the target task is determined according to the data tag, wherein the target priority is the processing priority of the target task, and the resource utilization rate of the target node is positively correlated with the access volume of the target node; Saving the target task to a task queue; When the data task in the task queue whose processing priority is greater than the target priority is completed, the target task is executed.

2. The method according to claim 1, characterized in that When the resource usage rate of the target node is greater than or equal to a preset threshold, determining the target priority corresponding to the target task according to the data tag includes: When the disk read rate of the target node is greater than or equal to the read threshold, the target read priority corresponding to the data read task is determined according to the data tag, wherein the resource utilization rate includes the disk read rate, the preset threshold includes the read threshold, the target priority includes the target read priority, and the target task includes the data read task.

3. The method according to claim 2, characterized in that After determining the target reading priority corresponding to the data reading task according to the data tag, saving the target task to the task queue includes: Saving the data reading task to a reading task queue, wherein the task queue includes the reading task queue; When the data task having a processing priority greater than the target priority in the task queue is completed, executing the target task comprises: When a data task in the read task queue whose read priority is greater than the target read priority is completed, the data read task is executed.

4. The method according to claim 1, characterized in that When the resource usage rate of the target node is greater than or equal to a preset threshold, determining the target priority corresponding to the data task according to the data tag includes: When the bandwidth utilization rate of the target node is greater than or equal to the bandwidth threshold, the target sending priority corresponding to the data sending task is determined according to the data tag, wherein the resource utilization rate includes the bandwidth utilization rate, the preset threshold includes the bandwidth threshold, the target priority includes the target sending priority, and the data task includes the data sending task.

5. The method according to claim 4, characterized in that After determining the target sending priority corresponding to the data sending task according to the data tag, the method further includes: Acquire target data corresponding to the data sending task; The step of saving the target task to a task queue comprises: saving the target data corresponding to the data sending task to a sending task queue, wherein the task queue comprises a sending task queue; When the data task whose processing priority is greater than the target priority in the task queue is completed, executing the target task includes: when the data task whose sending priority is greater than the target sending priority in the sending task queue is completed, sending the target data to the target terminal.

6. The method according to claim 1, characterized in that The data tag includes an application tag, a service tag, and a first packet tag, and determining the target priority corresponding to the target task according to the data tag includes: Determine a first value corresponding to the application tag, wherein the first value is used to indicate a customer requirement level corresponding to the application tag; Determine a second value corresponding to the service tag, wherein the second value is used to indicate a service requirement level corresponding to the service tag; Determine a third value corresponding to the first packet tag, wherein the third value is used to indicate a service requirement level corresponding to the first packet data or the non-first packet data in the data request of the target terminal; Perform a weighted summation on the first value, the second value, and the third value to obtain a fourth value, wherein the fourth value is used to indicate the target priority corresponding to the target task, and the target task is a data task generated based on the first packet data or non-first packet data in the data request of the target terminal.

7. The method according to claim 1, characterized in that After executing the target task, the method further includes: When the target task is completed as the head task in the task queue, the processing priority corresponding to each data task in the task queue is increased by a preset level.

8. A data processing device, characterized in that: The device comprises: A task acquisition module, used to acquire a target task of a target terminal, wherein the target task is used to provide the target terminal with target data stored in a target node, and the target task is a data task generated based on a data request of the target terminal, and the data request carries a data tag for indicating a data service quality requirement; A priority determination module, used to determine the target priority corresponding to the target task according to the data tag when the resource utilization rate of the target node is greater than or equal to a preset threshold, wherein the target priority is the processing priority of the target task, and the resource utilization rate of the target node is positively correlated with the access volume of the target node; A task saving module, used for saving the target task to a task queue; The task execution module is used to execute the target task when the data task with a processing priority greater than the target priority in the task queue is completed.

9. A computer device comprising a memory, a processor and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Resource shared using method and system based on preemptive scheduling and equipment

    CN108769254A

  • Data request processing method and device and computer readable storage medium

    CN112256417A