Data scheduling method and apparatus, terminal device, and computer-readable storage medium

Abstract

The application discloses a data scheduling method and device, a terminal equipment and a computer readable storage medium. The method comprises the following steps: obtaining screen projection data stream information; extracting features of the screen projection data stream information to obtain stream feature information; generating a stream classification request according to the stream feature information; and sending the stream classification request to a wireless network management device, so that the wireless network management device generates corresponding stream classification rules according to the stream classification request, and schedules target screen projection data packets based on the stream classification rules. The method of the application can enable the wireless network management device to obtain stream feature information for representing screen projection data streams in the case that the screen projection sending end does not generate stream feature information or the wireless network management device does not obtain the stream feature information sent by the screen projection sending end, thereby providing a basis for the wireless network management device to identify and schedule the screen projection data streams, and improving the transmission quality of the screen projection data.

Description

Technical Field

[0001] This application relates to the field of communication technology, specifically to a data scheduling method, apparatus, terminal equipment, and computer-readable storage medium. Background Technology

[0002] During wireless screen sharing, in order for the wireless network management device to prioritize and schedule the shared data, the sending end typically extracts the stream characteristic information of the shared data stream and sends it to the wireless network management device. This allows the wireless network management device to identify the corresponding shared data stream and perform appropriate data scheduling. In practical applications, if the sending end lacks the ability to generate stream characteristic information, or if the stream characteristic information fails to be transmitted to the wireless network management device, the stream characteristic information obtained by the wireless network management device may be incomplete or missing, thus affecting the identification of the shared data stream. Summary of the Invention

[0003] This application provides a data scheduling method, apparatus, terminal device, and computer-readable storage medium. Even when the screen-sharing sending end does not generate stream feature information or the wireless network management device does not obtain the stream feature information sent by the screen-sharing sending end, the wireless network management device can obtain stream feature information used to characterize the screen-sharing data stream. This provides a basis for the wireless network management device to identify and schedule the screen-sharing data stream, thereby improving the transmission quality of the screen-sharing data.

[0004] The technical solution adopted by this invention to solve the problem is as follows: On the one hand, this application provides a data scheduling method applied to a screen projection receiver, including: Obtain screen mirroring data stream information; Feature extraction is performed on the projected data stream information to obtain stream feature information; Generate a stream classification request based on stream feature information; The flow classification request is sent to the wireless network management device, so that the wireless network management device can generate the corresponding flow classification rules according to the flow classification request, and schedule the target projection data packets based on the flow classification rules.

[0005] In some embodiments of this application, before obtaining the screen projection data stream information, the following is also included: The system detects whether the wireless network management device supports the flow classification service mechanism and obtains the detection results. If the detection result is the first detection result, a wireless screen projection connection is established between the wireless network management device and the screen projection sending end. The first detection result indicates that the wireless network management device supports the stream classification service mechanism.

[0006] In some embodiments of this application, the method further includes: After the screen mirroring session ends or the screen mirroring connection is disconnected, a rule deletion request is generated; Send a rule deletion request to the wireless network management device so that the wireless network management device deletes the stream classification rule and releases the scheduling resources corresponding to the projection data stream information.

[0007] Secondly, embodiments of the present invention also provide a data scheduling method, applied to a wireless network management device, comprising: Receive stream classification requests sent by the screen mirroring receiver; Based on the flow classification request, establish flow classification rules; The target projection data packets are scheduled according to the flow classification rules.

[0008] In some embodiments of this application, flow classification rules are established based on flow classification requests, including: Obtain flow feature information from the flow classification request; Based on the stream feature information, a stream classification rule is established, wherein the stream classification rule includes at least one of the following: matching conditions for the projected data stream information, priority parameters, and queue mapping relationships; Based on the flow classification rules, the target projection data packets are scheduled, including: Based on the matching conditions of the screen casting data stream information, determine whether the target screen casting data packet belongs to the data packet corresponding to the screen casting data stream information; When the target projection data packet belongs to the data packet corresponding to the projection data stream information, the priority queue corresponding to the target projection data packet is determined based on the queue mapping relationship; Map the target screen projection data packet to the priority queue corresponding to the target screen projection data packet.

[0009] In some embodiments of this application, the method further includes: Based on the stream classification rules, establish mirroring rules for the downlink data stream information corresponding to the target projection data packet; schedule the downlink data stream information according to the mirroring rules; and / or, Obtain current network status information, which includes at least one of current network load, current wireless signal strength, current video bitrate change, and current data packet loss rate; adjust the scheduling parameters of the target projection data packets based on the current network status information.

[0010] Thirdly, embodiments of the present invention also provide a data scheduling device, applied to a screen projection receiver, comprising: The data acquisition module is used to acquire screen projection data stream information; The feature extraction module is used to extract features from the projected data stream information to obtain stream feature information; The request generation module is used to generate stream classification requests based on stream feature information; The request sending module is used to send flow classification requests to the wireless network management device, so that the wireless network management device can generate corresponding flow classification rules according to the flow classification requests and schedule target projection data packets based on the flow classification rules.

[0011] Fourthly, embodiments of the present invention also provide a data scheduling device, applied to a wireless network management device, comprising: The request receiving module is used to receive stream classification requests sent by the screen projection receiving end; The rule creation module is used to create flow classification rules based on flow classification requests; The data scheduling module is used to schedule target projection data packets according to stream classification rules.

[0012] Fifthly, this application also provides a terminal device, which includes: One or more processors; Memory; and One or more applications, wherein the applications are stored in memory and configured to be executed by a processor to implement the data scheduling method of any of the first aspects.

[0013] In a sixth aspect, embodiments of this application provide a computer-readable storage medium having a computer program stored thereon, the computer program being loaded by a processor to perform the steps of the data scheduling method of any of the first aspects.

[0014] The beneficial effects of this invention are as follows: The screen projection receiving end acquires screen projection data stream information and extracts features from it to obtain stream feature information. Subsequently, it generates a stream classification request based on the stream feature information and sends the request to the wireless network management device. Since the stream feature information is extracted and sent by the screen projection receiving end that actually receives the screen projection data stream, even if the screen projection sending end does not generate stream feature information or the wireless network management device does not acquire the stream feature information sent by the screen projection sending end, the wireless network management device can still obtain the stream feature information used to characterize the screen projection data stream. This provides a basis for the wireless network management device to identify and schedule the screen projection data stream, thereby improving the transmission quality of the screen projection data. Attached Figure Description

[0015] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments recorded in the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0016] Figure 1 This is a schematic diagram of a data scheduling system provided in an embodiment of the present invention; Figure 2 This is a flowchart illustrating one embodiment of the data scheduling method provided by the present invention; Figure 3 This is a flowchart illustrating another embodiment of the data scheduling method provided in this invention. Figure 4 This is a flowchart illustrating a specific embodiment of the data scheduling media data provided in this invention. Figure 5 This is a schematic block diagram of one embodiment of the data scheduling device provided in this invention; Figure 6 This is a schematic block diagram of another embodiment of the data scheduling device provided in this invention; Figure 7 This is a schematic diagram of an embodiment of the terminal device provided in this invention. Detailed Implementation

[0017] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0018] In the description of this application, the terms "first," "second," "third," etc., are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Therefore, a feature defined with "first," "second," "third," etc., may explicitly or implicitly include one or more of the stated features.

[0019] In this application, the term "exemplary" is used to mean "used as an example, illustration, or description." Any embodiment described as "exemplary" in this application is not necessarily to be construed as being more preferred or advantageous than other embodiments. The following description is provided to enable any person skilled in the art to make and use this application. Details are set forth in the following description for purposes of explanation. It should be understood that those skilled in the art will recognize that this application can be made without using these specific details. In other instances, well-known structures and processes are not described in detail to avoid obscuring the description of this application with unnecessary detail. Therefore, this application is not intended to be limited to the embodiments shown, but is consistent with the broadest scope of the principles and features disclosed in this application.

[0020] It should be noted that since the method in this application embodiment is executed in a terminal device, the processing objects of each terminal device exist in the form of data or information, such as time, which is essentially time information. It can be understood that if size, quantity, position, etc. are mentioned in subsequent embodiments, they are all corresponding data that exist so that the terminal device can process them. Specific details will not be elaborated here.

[0021] This application provides a data scheduling method, apparatus, terminal device, and computer-readable storage medium, which will be described in detail below.

[0022] Please see Figure 1 , Figure 1 This is a schematic diagram of a data scheduling system provided in an embodiment of this application. The data scheduling system may include a screen projection receiver 100, a wireless network management device 200 in the network, and a screen projection sender 300. The screen projection receiver 100 integrates a data scheduling device, and the wireless network management device 200 integrates another data scheduling device.

[0023] In this embodiment, the screen projection receiver 100 is mainly used to acquire screen projection data stream information; extract features from the screen projection data stream information to obtain stream feature information; generate a stream classification request based on the stream feature information; and send the stream classification request to the wireless network management device so that the wireless network management device can generate corresponding stream classification rules based on the stream classification request and schedule the target screen projection data packets based on the stream classification rules. The wireless network management device 200 is mainly used to receive the stream classification request sent by the screen projection receiver; establish stream classification rules based on the stream classification request; and schedule the target screen projection data packets based on the stream classification rules. Even if the screen projection sender does not generate stream feature information or the wireless network management device does not acquire the stream feature information sent by the screen projection sender, the wireless network management device can acquire the stream feature information used to characterize the screen projection data stream, providing a basis for the wireless network management device to identify and schedule the screen projection data stream, thereby improving the transmission quality of the screen projection data.

[0024] It is understood that the screen projection receiver 100, the wireless network management device 200, and the screen projection transmitter 300 used in this application embodiment can be devices that include both receiving and transmitting hardware, i.e., devices with receiving and transmitting hardware capable of performing bidirectional communication on a bidirectional communication link. Such devices can include cellular or other communication devices having a single-line display, a multi-line display, or a cellular or other communication device without a multi-line display. Specifically, the screen projection receiver 100, the wireless network management device 200, and the screen projection transmitter 300 can be a desktop terminal or a mobile terminal, or a mobile phone, tablet computer, laptop computer, etc.

[0025] Those skilled in the art will understand that Figure 1 The application environment shown is merely one application scenario of the solution in this application and does not constitute a limitation on the application scenario of the solution in this application. Other application environments may include those that are more specific to this application. Figure 1 More or fewer devices as shown, for example Figure 1 Only one screen projection sending terminal 300 is shown in the figure. It is understood that the data scheduling system may also include one or more other services, which are not specified here.

[0026] In addition, such as Figure 1 As shown, the data scheduling system may also include a storage device for storing data, such as media data to be shared, authorized device identification information, encrypted media data, etc.

[0027] It should be noted that, Figure 1 The schematic diagram of the data scheduling system shown is merely an example. The data scheduling system and scenario described in this application are intended to more clearly illustrate the technical solutions of this application and do not constitute a limitation on the technical solutions provided in this application. As those skilled in the art will know, with the evolution of data scheduling systems and the emergence of new business scenarios, the technical solutions provided in this application are also applicable to similar technical problems.

[0028] First, this application provides a data scheduling method, the execution subject of which is a data scheduling device, which is applied to the screen projection receiving end. The data scheduling method includes: acquiring screen projection data stream information; extracting features from the screen projection data stream information to obtain stream feature information; generating a stream classification request based on the stream feature information; and sending the stream classification request to a wireless network management device so that the wireless network management device generates corresponding stream classification rules based on the stream classification request and schedules the target screen projection data packets based on the stream classification rules.

[0029] It should be noted that the screen mirroring receiver refers to the device that receives the screen mirroring data, that is, the device that receives the data to be mirrored and displays it. For example, if a user wants to switch the content displayed on a device such as a mobile phone, tablet, or personal computer to a smart TV, projector, or conference tablet for playback, in the above embodiment, the mobile phone, tablet, or personal computer is the screen mirroring sender, and the smart TV, projector, or conference tablet is the screen mirroring receiver. It is a terminal device used to receive and play the mirrored content. It receives the screen mirroring data stream sent by the screen mirroring sender through a wireless network management device and parses and plays the received screen mirroring data stream. Of course, the screen mirroring receiver is not limited to a specific device type such as a mobile phone, tablet, or smart TV. Any device with media data acquisition and data transmission capabilities can be used as the main device to execute the method of this embodiment.

[0030] like Figure 2 The diagram shown is a flowchart of an embodiment of the data scheduling method in this application. The data scheduling method may include the following steps S201 to S203, as detailed below: Step S201: Obtain screen projection data stream information.

[0031] In this embodiment, the screen casting data stream information refers to the data content sent from the screen casting sender to the screen casting receiver during the wireless screen casting process. This can be video data, audio data, or other data used for screen casting display, such as images and documents. Typically, the screen casting receiver continuously receives various types of screen casting data sent by the screen casting sender. Therefore, obtaining the screen casting data stream information can be understood as the screen casting receiver obtaining the currently received screen casting content.

[0032] Step S202: Extract features from the projected data stream information to obtain stream feature information.

[0033] In this embodiment, feature extraction refers to extracting relevant information that characterizes the transmission characteristics of the screen-cast data stream from the screen-cast data stream information, thereby forming stream feature information. Stream feature information may include characteristic parameters that can be used to identify a data stream, such as source IP address, destination IP address, source port, destination port, and data type. Specifically, the source IP address represents the device address sending the screen-cast data, the destination IP address represents the device address receiving the screen-cast data, the source and destination ports identify the communication ports corresponding to the data stream, and the data type indicates whether the current data is video, audio, or other types of data. This step converts the original screen-cast data into information that can describe the transmission characteristics of the data stream, enabling subsequent identification of the corresponding data stream based on the extracted feature information without relying on the specific data content, thus providing a basis for generating subsequent stream classification requests.

[0034] Step S203: Generate a flow classification request based on the flow feature information.

[0035] In this embodiment, the flow classification request is a data request used to transmit screen-casting data stream characteristic information to the wireless network management device. It carries the flow characteristic information obtained in step S202, such as source IP address, destination IP address, source port, destination port, and data type. In other words, the flow classification request can be understood as a request message constructed primarily with flow characteristic information. Since the flow classification request carries flow characteristic information that characterizes the transmission features of the screen-casting data stream, the wireless network management device can subsequently obtain the corresponding data stream characteristics based on this request, providing an information basis for subsequent identification of the target screen-casting data packet.

[0036] Step S204: Send the flow classification request to the wireless network management device so that the wireless network management device can generate the corresponding flow classification rules according to the flow classification request and schedule the target projection data packets based on the flow classification rules.

[0037] In this embodiment, the wireless network management device is responsible for managing wireless network connections and data transmission during the wireless projection process. For example, it could be an Access Point (AP) in an infrastructure network mode or a Group Owner (GO) in Wi-Fi Direct mode. Flow classification rules are data flow identification rules established by the wireless network management device based on flow characteristic information in the flow classification request. These rules describe the scheduling method that should be adopted for data packets that meet the corresponding flow characteristics. When the wireless network management device receives a flow classification request, it can establish corresponding flow classification rules based on the flow characteristic information carried within. When subsequent target projection data packets arrive at the wireless network management device, it can identify the target projection data packets according to the established flow classification rules and transmit data according to the corresponding scheduling method. Because the wireless network management device can establish corresponding flow classification rules using the received flow classification request, when subsequent target projection data packets corresponding to the flow characteristic information pass through the wireless network management device, they can be identified and scheduled according to the established flow classification rules. This facilitates the wireless transmission of target projection data packets according to the corresponding scheduling strategy, further improving the stability of projection data transmission and the smoothness of projection playback.

[0038] In one specific implementation, before obtaining the screen projection data stream information, the method further includes: detecting whether the wireless network management device supports the stream classification service mechanism and obtaining detection result information; if the detection result is the first detection result, establishing a wireless screen projection connection between the wireless network management device and the screen projection sending end, wherein the first detection result indicates that the wireless network management device supports the stream classification service mechanism.

[0039] In this embodiment, compatibility testing can be performed before formally establishing a wireless screen projection connection. The stream classification service mechanism refers to the ability of the wireless network management device to establish stream classification rules based on stream classification requests sent by terminals, and to prioritize and schedule corresponding data streams according to these rules. Specifically, the stream classification service mechanism can be a Mirrored Stream Classification Service (MSCS).

[0040] In this scenario, the support for MSCS by the wireless network management device can be detected as follows: The receiving end receives Beacon frames or Probe Response frames sent by the wireless network management device. Beacon frames are management frames periodically broadcast by the wireless network management device to announce its capabilities and network information to surrounding devices. Probe Response frames are management frames sent by the wireless network management device in response to a terminal's probe request, also carrying device capability information. The receiving end parses the ExtendedCapabilities field in these management frames and checks whether the Mirrored SCS Capability flag is set. The ExtendedCapabilities field characterizes the extended functions supported by the wireless network management device, while the Mirrored SCS Capability flag characterizes whether the wireless network management device supports the MSCS mechanism. When the Mirrored SCS Capability flag is set, it indicates that the wireless network management device supports the flow classification service mechanism, resulting in the first detection result; otherwise, it indicates that the wireless network management device does not support the flow classification service mechanism.

[0041] Since not all wireless network management devices support the flow classification service mechanism, it is essential to confirm whether the wireless network management device supports this mechanism before sending a flow classification request from the screen-sharing receiver. This ensures that subsequent flow classification requests can be correctly identified and processed by the wireless network management device. In the specific implementation, if the detection result indicates that the wireless network management device supports the MSCS mechanism, the subsequent priority scheduling process begins. That is, after establishing the screen-sharing connection, the screen-sharing receiver extracts the characteristics of the screen-sharing data stream and sends a flow classification request to the wireless network management device. If the detection result indicates that the wireless network management device does not support the MSCS mechanism, the default WMM (Wi-Fi Multimedia) scheduling method is used for screen-sharing transmission. Through this method, the screen-sharing receiver can select the appropriate screen-sharing processing flow based on the capabilities of the wireless network management device. This ensures that wireless network management devices supporting the flow classification service mechanism can execute the subsequent priority scheduling process while also being compatible with wireless network management devices that do not support this mechanism, thereby improving the applicability and compatibility of this application solution in different wireless network environments.

[0042] In one specific implementation, the method further includes: generating a rule deletion request after the screen projection session ends or the screen projection connection is disconnected; sending the rule deletion request to the wireless network management device so that the wireless network management device deletes the stream classification rule and releases the scheduling resources corresponding to the screen projection data stream information.

[0043] In this embodiment, a screen-sharing session refers to a complete screen-sharing process established between the screen-sharing sender and receiver for transmitting screen-sharing content. It begins with the establishment of the screen-sharing connection and ends when the user actively terminates the screen-sharing, the screen-sharing connection is disconnected, or other circumstances cause the screen-sharing to terminate. A rule deletion request is a request message generated by the screen-sharing receiver and sent to the wireless network management device. It is used to notify the wireless network management device that the current screen-sharing session has ended and that it is no longer necessary to perform corresponding data scheduling for this screen-sharing data stream. Correspondingly, a flow classification rule is a data flow identification rule established by the wireless network management device based on the flow classification request sent by the screen-sharing receiver. It is used to identify the corresponding screen-sharing data stream and process it according to a preset scheduling method. Scheduling resources are the resources occupied by the wireless network management device for performing the above data scheduling, such as the rule items corresponding to the flow classification rules and the resources occupied by the priority queue.

[0044] When a screen mirroring session ends or the screen mirroring connection is disconnected, the screen mirroring receiving end generates a rule deletion request and sends the request to the wireless network management device to notify the device that the priority scheduling process corresponding to the current screen mirroring data stream has ended. Upon receiving the rule deletion request, the wireless network management device deletes the stream classification rule corresponding to the screen mirroring video stream and releases the corresponding priority resources. This implementation ensures that the stream classification rules established by the wireless network management device remain consistent with the lifecycle of the screen mirroring session, which helps improve the data scheduling and management efficiency of the wireless network management device.

[0045] like Figure 3The diagram illustrates a flowchart of an embodiment of the data scheduling method in this application, which is applied to a wireless network management device. During wireless screen sharing, the wireless network management device is responsible for wireless network connection management and wireless data transmission management. It forwards screen sharing data between the sending and receiving ends and wirelessly transmits the data according to corresponding data scheduling strategies. Existing wireless screen sharing technologies typically operate under two network architectures. One is the Infrastructure Network mode, where both the sending and receiving ends are connected to a wireless access point (AP). The wireless network management device can be an AP, responsible for wireless network access management and data forwarding. The other is the Wi-Fi Direct mode, where a direct point-to-point connection is established between the sending and receiving ends. In this mode, the Group Owner (GO) performs management functions similar to a wireless access point, responsible for device management, data forwarding, and wireless resource management. Therefore, in this mode, the wireless network management device can be a GO. The wireless network management device in this application is not limited to a specific device, but rather refers to a network management node responsible for wireless network management and data scheduling during wireless screen projection. In infrastructure network mode, it can be an Access Point (AP), and in Wi-Fi Direct mode, it can be a Go-to-Network (GO). The data scheduling method provided in this embodiment may include the following steps S301 to S303, as detailed below: Step S301: Receive the stream classification request sent by the screen mirroring receiver.

[0046] In this embodiment, the stream classification request is a request message generated by the screen-casting receiver based on the stream characteristic information of the screen-casting data stream. It is used to transmit information characterizing the transmission characteristics of the screen-casting data stream to the wireless network management device. The stream classification request may carry stream characteristic information such as source IP address, destination IP address, source port, destination port, and data type. The wireless network management device can obtain information describing the transmission characteristics of the target screen-casting data stream by acquiring the stream classification request, without needing to parse or identify the screen-casting service content itself. Since the stream classification request already carries the stream characteristic information of the corresponding data stream, the wireless network management device can use this stream characteristic information as the basis for subsequently establishing stream classification rules, providing a foundation for subsequent data scheduling.

[0047] Step S302: Establish flow classification rules based on the flow classification request.

[0048] In this embodiment, the flow classification rule is a data flow identification rule established by the wireless network management device based on the flow classification request. It describes the scheduling method that should be adopted for data packets with corresponding flow characteristics. Specifically, the wireless network management device extracts the flow characteristic information carried in the flow classification request and establishes corresponding flow classification rules based on this information. This allows subsequent data packets passing through the wireless network management device to be matched and scheduled according to the flow classification rule. When a subsequent data packet has flow characteristics corresponding to the flow classification rule, the wireless network management device can determine that the data packet belongs to the corresponding projection data flow. That is, when the wireless network management device subsequently matches a data packet with the same flow characteristics, it can identify the data packet as projection data that needs to be prioritized for scheduling, i.e., the target projection data packet.

[0049] Step S303: Schedule the target projection data packets according to the flow classification rules.

[0050] In this embodiment, the target projection data packet refers to a data packet transmitted through the wireless network management device that meets the flow characteristics corresponding to the flow classification rules. Scheduling refers to the wireless network management device determining the processing method corresponding to the target projection data packet based on the flow classification rules, and performing wireless transmission according to the determined processing method, such as mapping the target projection data packet to the corresponding priority queue for transmission.

[0051] Wireless network management devices can quickly identify incoming data packets using pre-established flow classification rules and complete data transmission according to the corresponding scheduling methods. Specifically, the device can determine the scheduling method corresponding to the target projection data packet based on the pre-established flow classification rules. Therefore, when subsequent data packets belonging to the same projection data stream arrive continuously, they can all be transmitted according to the corresponding scheduling method. This helps ensure the continuity and consistency of data scheduling throughout the projection process, further improving the stability of projection data transmission and the smoothness of projection playback.

[0052] In one specific implementation, stream classification rules are established based on the stream classification request, including: obtaining stream feature information from the stream classification request; establishing stream classification rules based on the stream feature information, wherein the stream classification rules include at least one of the following: matching conditions for the projection data stream information, priority parameters, and queue mapping relationships; scheduling the target projection data packet according to the stream classification rules, including: determining whether the target projection data packet belongs to the data packet corresponding to the projection data stream information based on the matching conditions of the projection data stream information; when the target projection data packet belongs to the data packet corresponding to the projection data stream information, determining the priority queue corresponding to the target projection data packet based on the queue mapping relationship; and mapping the target projection data packet to the priority queue corresponding to the target projection data packet.

[0053] In this embodiment, after the wireless network management device receives the flow classification request sent by the screen projection receiver, it first obtains flow feature information from the flow classification request. The flow feature information is used to characterize the transmission characteristics of the screen projection data stream, and may include source IP address, destination IP address, source port, destination port, data type, etc. The flow classification rules are rules used by the wireless network management device to identify specific data streams and determine the corresponding scheduling method, and may include at least one of the following: matching conditions corresponding to the screen projection data stream, priority parameters, and queue mapping relationships. The matching conditions describe the flow characteristics that data packets need to meet, such as source IP address, destination IP address, communication port, or data type; the priority parameters indicate the scheduling priority of the corresponding data stream; and the queue mapping relationship describes which priority queue a data packet that meets the matching conditions should be mapped to for transmission.

[0054] After establishing the flow classification rules, when the wireless network management device subsequently receives a target projection data packet, it determines whether the target projection data packet belongs to the corresponding projection data stream based on the matching conditions in the flow classification rules. When the target projection data packet meets the matching condition, it indicates that the target projection data packet belongs to the data packet corresponding to that projection data stream. At this time, the wireless network management device further determines the priority queue corresponding to the target projection data packet based on the queue mapping relationship in the flow classification rules, and maps the target projection data packet to the corresponding priority queue for transmission. Since the flow classification rules pre-establish the correspondence between data stream characteristics and data scheduling methods, for subsequent data packets belonging to the same projection data stream, the wireless network management device does not need to analyze their service content again; it only needs to complete the data packet identification and priority queue mapping based on the flow classification rules, thereby achieving continuous scheduling of data packets of the same projection data stream.

[0055] In one specific implementation, the method further includes: establishing mirroring rules for the downlink data stream information corresponding to the target projection data packet according to the stream classification rules; and scheduling the downlink data stream information according to the mirroring rules.

[0056] In this embodiment, after the wireless network management device establishes the flow classification rules corresponding to the projection data stream, it can also establish mirroring rules for the downlink data stream information corresponding to the target projection data packet based on the flow classification rules. The downlink data stream information refers to the downlink data stream that belongs to the same projection service as the projection data stream and is forwarded by the wireless network management device. The mirroring rule refers to the data scheduling rule generated based on the established flow classification rules and applicable to the corresponding downlink data stream, inheriting or corresponding to the priority parameters, queue mapping relationships, and other scheduling information in the original flow classification rules. When a subsequent downlink data stream passes through the wireless network management device, the device schedules the downlink data stream information according to the established mirroring rules, enabling the downlink data stream to be mapped to the same or corresponding priority queue as the projection data stream for transmission. Thus, both uplink and downlink service streams adopt corresponding scheduling rules, and data related to the same projection service can maintain a consistent data scheduling strategy, which helps improve the continuity and stability of the entire projection service data transmission.

[0057] In one specific implementation, the method further includes: obtaining current network status information, wherein the current network status information includes at least one of current network load, current wireless signal strength, current video bitrate change, and current data packet loss rate; and adjusting the scheduling parameters of the target projection data packets according to the current network status information.

[0058] In this embodiment, the wireless network management device can also adjust the scheduling parameters of the target projection data packets based on the current network status information. The current network status information characterizes the current operating status of the wireless network and may include at least one of the following: current network load, current wireless signal strength, current video bitrate change, and current data packet loss rate. Specifically, the current network load reflects the level of service activity in the current wireless network; the current wireless signal strength reflects the quality of the wireless communication link; the current video bitrate change reflects the change in the data transmission rate of the projection video; and the current data packet loss rate reflects the loss of data packets during wireless transmission. The scheduling parameters are those used by the wireless network management device when performing data scheduling and may include target projection data packet priority parameters, scheduling weights, or queue resource occupancy ratios. After obtaining the current network status information, the wireless network management device can dynamically adjust the above scheduling parameters according to changes in the network status to adapt to the current wireless network environment.

[0059] As a specific embodiment, such as Figure 4As shown, after the screen-sharing receiver detects that the wireless network management device (such as an AP or GO) supports the flow classification service mechanism, a wireless screen-sharing connection is established between the screen-sharing sender and the screen-sharing receiver. Subsequently, the screen-sharing receiver acquires the screen-sharing data stream information, extracts the corresponding flow feature information, and generates a flow classification request, which is then sent to the wireless network management device. The wireless network management device establishes flow classification rules based on the flow classification request, identifies the target screen-sharing data packet according to these rules, and maps the target screen-sharing data packet to the corresponding priority queue. Then, the wireless network management device sends the target screen-sharing data packet according to the Enhanced Distributed Channel Access (EDCA) parameters corresponding to the priority queue. The EDCA parameters control the way different priority queues compete for the wireless channel, such as the contention window, arbitration frame interval, and transmission opportunity, thus giving higher-priority data a higher chance of wireless channel access. Based on this, the wireless network management device can also establish corresponding downlink service flow mirroring rules and dynamically adjust the scheduling parameters corresponding to the screen-sharing data stream according to the current network status to adapt to changes in the network environment. When the screen mirroring session ends, the receiving end notifies the wireless network management device to delete the corresponding flow classification rule and release the relevant resources, thereby completing the entire wireless screen mirroring data scheduling process.

[0060] To better implement the data scheduling method in the embodiments of this application, a data scheduling device is also provided in the embodiments of this application, such as... Figure 5 As shown, the data scheduling device includes: Data acquisition module 510 is used to acquire screen projection data stream information; The feature extraction module 520 is used to extract features from the projected data stream information to obtain stream feature information; The request generation module 530 is used to generate a stream classification request based on stream feature information; The request sending module 540 is used to send the flow classification request to the wireless network management device, so that the wireless network management device can generate the corresponding flow classification rule according to the flow classification request and schedule the target projection data packet based on the flow classification rule.

[0061] In this embodiment, the screen-sharing receiver obtains screen-sharing data stream information and extracts features from it to obtain stream feature information. Then, it generates a stream classification request based on the stream feature information and sends the request to the wireless network management device. Since the stream feature information is extracted and sent by the screen-sharing receiver that actually receives the screen-sharing data stream, even if the screen-sharing sender does not generate stream feature information or the wireless network management device does not obtain the stream feature information sent by the screen-sharing sender, the wireless network management device can still obtain the stream feature information characterizing the screen-sharing data stream. This provides a basis for the wireless network management device to identify and schedule the screen-sharing data stream, thereby improving the transmission quality of the screen-sharing data.

[0062] In some embodiments of this application, before acquiring the screen projection data stream information, the data acquisition module 510 is further configured to: The system detects whether the wireless network management device supports the flow classification service mechanism and obtains the detection results. If the detection result is the first detection result, a wireless screen projection connection is established between the wireless network management device and the screen projection sending end. The first detection result indicates that the wireless network management device supports the stream classification service mechanism.

[0063] In some embodiments of this application, the request generation module 530 is further configured to: generate a rule deletion request after the screen mirroring session ends or the screen mirroring connection is disconnected; The request sending module 540 is also used to: send a rule deletion request to the wireless network management device so that the wireless network management device deletes the stream classification rule and releases the scheduling resources corresponding to the projection data stream information.

[0064] To better implement another data scheduling method in the embodiments of this application, based on this data scheduling method, another data scheduling device is also provided in the embodiments of this application, such as... Figure 6 As shown, the data scheduling device includes: The request receiving module 610 is used to receive the stream classification request sent by the screen projection receiving end; The rule creation module 620 is used to create flow classification rules based on flow classification requests; The data scheduling module 630 is used to schedule target projection data packets according to the stream classification rules.

[0065] In this embodiment, the wireless network management device receives a stream classification request sent by the screen-casting receiver, establishes stream classification rules based on the request, and then schedules the target screen-casting data packets according to the stream classification rules. Since the wireless network management device can establish corresponding stream classification rules based on the stream classification request sent by the screen-casting receiver, when the target screen-casting data packet arrives at the wireless network management device, it can determine the corresponding scheduling method based on the established stream classification rules and perform data scheduling according to the determined scheduling method. This facilitates the wireless transmission of the target screen-casting data packet according to the corresponding priority, thereby improving the transmission stability and playback smoothness of the screen-casting service.

[0066] In some embodiments of this application, the rule establishment module 620 establishes flow classification rules based on the flow classification request, including: Obtain flow feature information from the flow classification request; Based on the stream feature information, a stream classification rule is established, wherein the stream classification rule includes at least one of the following: matching conditions for the projected data stream information, priority parameters, and queue mapping relationships; The data scheduling module 630 schedules the target projection data packets according to the stream classification rules, including: Based on the matching conditions of the screen casting data stream information, determine whether the target screen casting data packet belongs to the data packet corresponding to the screen casting data stream information; When the target projection data packet belongs to the data packet corresponding to the projection data stream information, the priority queue corresponding to the target projection data packet is determined based on the queue mapping relationship; Map the target screen projection data packet to the priority queue corresponding to the target screen projection data packet.

[0067] In some embodiments of this application, the rule establishment module 620 is further configured to: establish mirroring rules for the downlink data stream information corresponding to the target projection data packet according to the stream classification rules; schedule the downlink data stream information according to the mirroring rules; and / or, The data scheduling module 630 is also used to: obtain current network status information, wherein the current network status information includes at least one of current network load, current wireless signal strength, current video bitrate change and current data packet loss rate; and adjust the scheduling parameters of the target projection data packets according to the current network status information.

[0068] This application embodiment also provides a terminal device that integrates any of the data scheduling devices provided in this application embodiment. The terminal device includes: One or more processors; Memory; and One or more applications, wherein the applications are stored in memory and configured to be executed by a processor from the steps of the data scheduling method in any of the above-described data scheduling method embodiments.

[0069] This application also provides a terminal device that integrates any of the data scheduling devices provided in this application. For example... Figure 7 As shown, it illustrates a structural schematic diagram of the terminal device involved in the embodiments of this application. Specifically: The terminal device may include components such as a processor 701 with one or more processing cores, a memory 702 with one or more computer-readable storage media, a power supply 703, and an input unit 704. Those skilled in the art will understand that... Figure 7 The terminal device structure shown does not constitute a limitation on the terminal device and may include more or fewer components than shown, or combine certain components, or have different component arrangements. Wherein: The processor 701 is the control center of the terminal device. It connects various parts of the terminal device via various interfaces and lines. By running or executing software programs and / or modules stored in the memory 702, and by calling data stored in the memory 702, it performs various functions and processes data of the terminal device, thereby providing overall monitoring of the terminal device. Optionally, the processor 701 may include one or more processing cores; preferably, the processor 701 may integrate an application processor and a modem processor, wherein the application processor mainly handles the operating system, user interface, and applications, and the modem processor mainly handles wireless communication. It is understood that the modem processor may not be integrated into the processor 701.

[0070] The memory 702 can be used to store software programs and modules. The processor 701 executes various functional applications and data processing by running the software programs and modules stored in the memory 702. The memory 702 may mainly include a program storage area and a data storage area. The program storage area may store the operating system, application programs required for at least one function (such as sound playback function, image playback function, etc.), etc.; the data storage area may store data created according to the use of the terminal device, etc. In addition, the memory 702 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 702 may also include a memory controller to provide the processor 701 with access to the memory 702.

[0071] The terminal device also includes a power supply 703 that supplies power to the various components. Preferably, the power supply 703 can be logically connected to the processor 701 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system. The power supply 703 may also include one or more DC or AC power supplies, recharging systems, power fault detection circuits, power converters or inverters, power status indicators, and other arbitrary components.

[0072] The terminal device may also include an input unit 704, which can be used to receive input digital or character information, and generate keyboard, mouse, joystick, optical or trackball signal inputs related to user settings and function control.

[0073] Although not shown, the terminal device may also include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 701 in the terminal device loads the executable files corresponding to the processes of one or more applications into the memory 702 according to the following instructions, and the processor 701 runs the applications stored in the memory 702 to realize various functions, as follows: Obtain screen mirroring data stream information; Feature extraction is performed on the projected data stream information to obtain stream feature information; Generate a stream classification request based on stream feature information; The flow classification request is sent to the wireless network management device, so that the wireless network management device can generate the corresponding flow classification rules according to the flow classification request, and schedule the target projection data packets based on the flow classification rules.

[0074] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be performed by instructions, or by instructions controlling related hardware. These instructions can be stored in a computer-readable storage medium and loaded and executed by a processor.

[0075] Therefore, embodiments of this application provide a computer-readable storage medium, which may include: read-only memory (ROM), random access memory (RAM), a magnetic disk, or an optical disk, etc. A computer program is stored thereon, and the computer program is loaded by a processor to execute the steps in any of the data scheduling methods provided in embodiments of this application. For example, the computer program loaded by the processor can execute the following steps: Obtain screen mirroring data stream information; Feature extraction is performed on the projected data stream information to obtain stream feature information; Generate a stream classification request based on stream feature information; The flow classification request is sent to the wireless network management device, so that the wireless network management device can generate the corresponding flow classification rules according to the flow classification request, and schedule the target projection data packets based on the flow classification rules.

[0076] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the detailed descriptions of other embodiments above, which will not be repeated here.

[0077] In practice, each of the above units or structures can be implemented as an independent entity or can be arbitrarily combined to be implemented as the same or several entities. For the specific implementation of each of the above units or structures, please refer to the previous method embodiments, which will not be repeated here.

[0078] For details on the implementation of each of the above operations, please refer to the previous examples, which will not be repeated here.

[0079] The data scheduling method, apparatus, terminal device, and computer-readable storage medium provided in the embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A data scheduling method, characterized in that, Applied to the screen mirroring receiver, the method includes: Obtain screen mirroring data stream information; Feature extraction is performed on the projected data stream information to obtain stream feature information; Based on the flow feature information, a flow classification request is generated; The flow classification request is sent to the wireless network management device, so that the wireless network management device generates corresponding flow classification rules according to the flow classification request, and schedules the target projection data packets based on the flow classification rules.

2. The data scheduling method according to claim 1, characterized in that, Before obtaining the screen projection data stream information, the following is also included: The detection result information is obtained by determining whether the wireless network management device supports the flow classification service mechanism. If the detection result is the first detection result, a wireless screen projection connection is established between the wireless network management device and the screen projection sending end, wherein the first detection result indicates that the wireless network management device supports the stream classification service mechanism.

3. The data scheduling method according to claim 1, characterized in that, Also includes: After the screen mirroring session ends or the screen mirroring connection is disconnected, a rule deletion request is generated; The rule deletion request is sent to the wireless network management device so that the wireless network management device deletes the stream classification rule and releases the scheduling resources corresponding to the screen projection data stream information.

4. A data scheduling method, characterized in that, Applied to wireless network management devices, the method includes: Receive stream classification requests sent by the screen mirroring receiver; Based on the stream classification request, establish stream classification rules; The target projection data packets are scheduled according to the aforementioned stream classification rules.

5. The data scheduling method according to claim 4, characterized in that, The step of establishing flow classification rules based on the flow classification request includes: Obtain flow feature information from the flow classification request; Based on the stream feature information, a stream classification rule is established, wherein the stream classification rule includes at least one of the following: matching conditions for screen projection data stream information, priority parameters, and queue mapping relationships; The step of scheduling the target projection data packets according to the stream classification rules includes: Based on the matching conditions of the screen projection data stream information, determine whether the target screen projection data packet belongs to the data packet corresponding to the screen projection data stream information; When the target projection data packet belongs to the data packet corresponding to the projection data stream information, the priority queue corresponding to the target projection data packet is determined based on the queue mapping relationship; Map the target screen projection data packet to the priority queue corresponding to the target screen projection data packet.

6. The data scheduling method according to claim 4, characterized in that, Also includes: Based on the stream classification rules, a mirroring rule is established for the downlink data stream information corresponding to the target projection data packet; According to the mirroring rules, the downlink data stream information is scheduled; and / or, Obtain current network status information, wherein the current network status information includes at least one of current network load, current wireless signal strength, current video bitrate change, and current data packet loss rate; adjust the scheduling parameters of the target projection data packet according to the current network status information.

7. A data scheduling device, characterized in that, This device, used in screen mirroring receivers, includes: The data acquisition module is used to acquire screen projection data stream information; The feature extraction module is used to extract features from the projected data stream information to obtain stream feature information; The request generation module is used to generate a stream classification request based on the stream feature information; The request sending module is used to send the flow classification request to the wireless network management device, so that the wireless network management device generates corresponding flow classification rules according to the flow classification request, and schedules the target projection data packets based on the flow classification rules.

8. A data scheduling device, characterized in that, Applied to wireless network management devices, the device includes: The request receiving module is used to receive stream classification requests sent by the screen projection receiving end; The rule creation module is used to create flow classification rules based on the flow classification request; The data scheduling module is used to schedule the target projection data packets according to the stream classification rules.

9. A terminal device, characterized in that, The terminal device includes: one or more processors, a memory, and one or more applications, wherein the one or more applications are stored in the memory and configured to be executed by the processor to implement the data scheduling method of any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that, It stores a computer program, which is loaded by a processor to execute the steps of the data scheduling method according to any one of claims 1 to 6.

Images