A method, device, equipment and medium for processing virtual desktop data

Abstract

The embodiments of the present application disclose a method, device, equipment, and medium for processing virtual desktop data, and obtain network status information; the network status information reflects the network status when playing dynamic images. The picture clarity and picture smoothness corresponding to the virtual desktop data to be encoded are determined based on the network status information; the picture clarity and picture smoothness are important parameters that affect the user's viewing experience. The virtual desktop data is encoded based on the picture clarity and picture smoothness, and the encoded virtual desktop data is sent to the client. In this technical solution, the picture clarity and picture smoothness are adjusted based on the network status information, so that the playback of the encoded virtual desktop data is improved to a certain extent as the network status changes, effectively ensuring a good user experience when the encoded virtual desktop data is played.

Description

Technical Field

[0001] The present application relates to the field of video playback technology, and in particular to a method, device, equipment and computer-readable storage medium for processing virtual desktop data. Background Art

[0002] Frame rate and image quality parameters are important parameters that affect the smoothness and quality of video playback. Frame rate (Frame PerSecond, FPS) indicates the number of frames displayed per second. The higher the FPS, the better the smoothness. Image quality parameter (QuantizationParameter, QP) is the image quality parameter of H264 encoding. The value range is 0 to 51. The smaller the QP value, the higher the image quality. FQP (FPSand QP, a combined parameter of FPS and QP) can indicate the current frame control quality control effect.

[0003] At present, most frame control and quality control strategies in the industry are based on H264's average bitrate (Average Bitrate, ABR) or constant bitrate (Constant Bit Rate, CBR) encoding methods to achieve dynamic adjustment of frame rate and image quality. This implementation method requires a network bandwidth to be detected in advance, but the network status will fluctuate dynamically. Setting frame rate and image quality parameters based on a fixed network bandwidth will result in failure to respond to network changes in a timely manner, resulting in large fluctuations in the smoothness and image quality of video playback, affecting user experience. In addition, the current encoding method tends to adjust the frame rate and image quality based on the network status, so the adjustment effect of very fuzzy image quality may result in a poor user experience.

[0004] It can be seen that how to dynamically adjust the parameters of playing dynamic pictures to achieve a better user experience is a problem that technical personnel in this field need to solve. Summary of the invention

[0005] The purpose of the embodiments of the present application is to provide a method, apparatus, device and computer-readable storage medium for processing virtual desktop data, which can dynamically adjust the parameters of playing dynamic pictures to achieve a better user experience.

[0006] In order to solve the above technical problems, an embodiment of the present application provides a method for processing virtual desktop data, which is applied to a server and includes:

[0007] Get network status information;

[0008] Determining the picture clarity and picture smoothness corresponding to the virtual desktop data to be encoded according to the network status information;

[0009] The virtual desktop data is encoded according to the picture clarity and the picture smoothness, and the encoded virtual desktop data is sent to the client.

[0010] Optionally, the picture clarity includes picture quality parameters corresponding to the virtual desktop data, and the picture smoothness includes a frame rate corresponding to the virtual desktop data.

[0011] Optionally, the network status information includes one or more combinations of network bandwidth information, network delay information, network jitter information or network packet loss information.

[0012] Optionally, before acquiring the network status information, the method further includes:

[0013] Pre-configuring a value range of a dynamic picture parameter; wherein the value range of the dynamic picture parameter includes a value range of picture clarity and a value range of picture smoothness;

[0014] The determining, according to the network status information, the picture clarity and picture smoothness corresponding to the virtual desktop data to be encoded comprises:

[0015] The picture clarity and the picture smoothness are determined from a value range of the dynamic picture parameter according to the network status information.

[0016] Optionally, with respect to determining the value range of the dynamic picture parameter, the method further includes:

[0017] Get network status information and screen-related parameters within a preset time;

[0018] Based on the network status information and the picture-associated parameters, a value range of a dynamic picture parameter is determined.

[0019] Optionally, the picture association parameter includes one or more combinations of frame rate information, bit rate information and encoding information.

[0020] Optionally, the determining a value range of a dynamic picture parameter based on the network state information and the picture association parameter includes:

[0021] According to the correspondence between the set value range and the network state, determining the target network state to which the network state information and the screen association parameters belong within the preset time;

[0022] According to the target network state and the change trend of the network state information and the picture-related parameters within the preset time, the value range of the dynamic picture parameter is adjusted.

[0023] Optionally, before determining the picture clarity and the picture smoothness from the value range of the dynamic picture parameter according to the network state information, the method further includes:

[0024] Collect coded information;

[0025] Determining the picture clarity and the picture smoothness from the value range of the dynamic picture parameter according to the network status information includes:

[0026] The picture clarity and the picture smoothness are determined from a value range of the dynamic picture parameter according to the network status information and the encoding information.

[0027] Optionally, when the target network state is a congested state, adjusting the value range of the dynamic picture parameter according to the target network state and the change trend of the network state information and the picture-related parameter within the preset time includes:

[0028] When the change trend of the network status information or the picture-related parameter within the preset time is always in a congested state, adjusting the value range of the dynamic picture parameter according to the first adjustment rule based on the picture clarity, the picture smoothness, the bit rate information and the frame rate information included in the picture-related parameter;

[0029] When the change trends of the network status information and the picture-related parameters within the preset time are changing from a congested state to an idle state or a stable state, the current value range of the dynamic picture parameter is maintained.

[0030] Optionally, determining the picture clarity and the picture smoothness from a value range of the dynamic picture parameter according to the network state information and the encoding information includes:

[0031] When the network status information or the coding information belongs to a value range corresponding to a congestion state, adjusting the dynamic picture parameter according to a set first strategy;

[0032] When the network status information and the encoding information do not belong to the corresponding value range under the congestion state, the current value of the dynamic picture parameter is maintained.

[0033] Optionally, adjusting the dynamic picture parameters according to the set first strategy includes:

[0034] In the case of image quality priority, reducing the frame rate in the dynamic image parameter according to the set first value;

[0035] When smoothness is prioritized, the image quality parameter in the dynamic image parameter is increased according to the set second value.

[0036] Optionally, adjusting the value range of the dynamic picture parameter according to a first adjustment rule based on the picture clarity, the picture smoothness, and the bit rate information and frame rate information included in the picture-associated parameter includes:

[0037] The frame rate included in the picture smoothness is used as the upper limit of the frame rate; the picture quality parameter included in the picture clarity is used as the upper limit of the picture quality parameter;

[0038] Determine a frame rate lower limit by using the bit rate information and frame rate information included in the picture association parameters and the frame rate value included in the picture smoothness;

[0039] Based on the set correspondence between the frame rate and the image quality parameter, a lower limit value of the image quality parameter corresponding to the lower limit value of the frame rate is determined.

[0040] Optionally, when the target network state is an idle state, adjusting the value range of the dynamic picture parameter according to the target network state and the change trend of the network state information and the picture-related parameter within the preset time includes:

[0041] When the change trends of the network status information and the picture-related parameters within the preset time are always in an idle state, adjusting the value range of the dynamic picture parameter according to the second adjustment rule based on the picture clarity, the picture fluency, and the set dynamic picture parameter level;

[0042] When the change trends of the network status information and the picture-related parameters within the preset time are transitioning from an idle state to a congested state or a stable state, the current value range of the dynamic picture parameter is maintained.

[0043] Optionally, determining the picture clarity and the picture smoothness from a value range of the dynamic picture parameter according to the network state information and the encoding information includes:

[0044] When the network status information and the coding information belong to a corresponding value range in an idle state, adjusting the dynamic picture parameter according to a set second strategy;

[0045] When the network status information or the coding information does not belong to the corresponding value range in the idle state, the current value of the dynamic picture parameter is maintained.

[0046] Optionally, adjusting the dynamic picture parameters according to the set second strategy includes:

[0047] In the case where fluency is prioritized, increasing the frame rate in the dynamic picture parameter according to the set first value;

[0048] In the case of image quality priority, the image quality parameter in the dynamic image parameter is reduced according to the set second value.

[0049] Optionally, adjusting the value range of the dynamic picture parameter according to the second adjustment rule based on the picture clarity, the picture smoothness, and a set dynamic picture parameter level includes:

[0050] The frame rate included in the picture smoothness is used as the frame rate lower limit; the picture quality parameter included in the picture clarity is used as the picture quality parameter lower limit;

[0051] According to the set frame rate level, the highest frame rate value corresponding to the previous level adjacent to the frame rate lower limit value is used as the frame rate upper limit value; wherein each frame rate level has its corresponding frame rate value range;

[0052] According to the set picture quality parameter level, the highest picture quality parameter value corresponding to the previous level adjacent to the picture quality parameter lower limit value is used as the picture quality parameter upper limit value; wherein each picture quality parameter level has its corresponding picture quality parameter value range.

[0053] The embodiment of the present application also provides a virtual desktop data processing device, including an acquisition unit, a determination unit and an encoding unit;

[0054] The acquisition unit is used to acquire network status information;

[0055] The determining unit is used to determine the picture clarity and picture smoothness corresponding to the virtual desktop data to be encoded according to the network status information;

[0056] The encoding unit is used to encode the virtual desktop data according to the picture clarity and the picture smoothness, and send the encoded data to the client.

[0057] The embodiment of the present application also provides a virtual desktop data processing device, including:

[0058] Memory for storing computer programs;

[0059] The processor is used to execute the computer program to implement the steps of the above-mentioned virtual desktop data processing method.

[0060] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for processing virtual desktop data as described above are implemented.

[0061] It can be seen from the above technical solution that network status information is obtained; the network status information reflects the network status when playing dynamic images. The picture clarity and picture smoothness corresponding to the virtual desktop data to be encoded are determined according to the network status information; picture clarity and picture smoothness are important parameters that affect the user's viewing experience. The virtual desktop data is encoded according to the picture clarity and picture smoothness, and the encoded virtual desktop data is sent to the client. In this technical solution, the picture clarity and picture smoothness are adjusted based on the network status information, so that the playback of the encoded virtual desktop data is improved to a certain extent as the network status changes, effectively ensuring a good user experience when the encoded virtual desktop data is played. BRIEF DESCRIPTION OF THE DRAWINGS

[0062] In order to more clearly illustrate the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0063] Figure 1 A schematic diagram of a scene for playing a dynamic picture provided in an embodiment of the present application;

[0064] Figure 2 A flowchart of a method for processing virtual desktop data provided by an embodiment of the present application;

[0065] Figure 3 A flowchart of a method for adjusting a value range of a dynamic picture parameter provided in an embodiment of the present application;

[0066] Figure 4 A flowchart of a method for adjusting a value range of a dynamic picture parameter when a target network state is a congested state provided in an embodiment of the present application;

[0067] Figure 5 A flowchart of a method for adjusting a value range of a dynamic picture parameter when a target network state is an idle state provided in an embodiment of the present application;

[0068] Figure 6 A schematic diagram of the structure of a virtual desktop data processing device provided in an embodiment of the present application;

[0069] Figure 7 A schematic diagram of the structure of a virtual desktop data processing device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0070] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0071] In order to enable those skilled in the art to better understand the present application, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0072] Frame rate and image quality parameters are important parameters that affect the smoothness and quality of video playback. The current frame control and quality control strategy in the industry is to use average bit rate encoding or constant bit rate encoding to achieve dynamic adjustment of frame rate and image quality. These two implementation methods require a network bandwidth to be detected in advance, but setting frame rate and image quality parameters based on a fixed network bandwidth will result in an inability to respond to network changes in a timely manner, resulting in large fluctuations in the smoothness and image quality of video playback, affecting user experience. In addition, the current encoding method tends to adjust the frame rate and image quality based on the network status, so the adjustment effect of very blurred image quality may result in a poor user experience.

[0073] Therefore, the embodiments of the present application provide a method, device, equipment and computer-readable storage medium for processing virtual desktop data. The processing scheme for virtual desktop data provided by the embodiments of the present application is applicable to desktop cloud scenarios. In the desktop cloud scenario, a user can log in to any client based on his or her own account information. At this time, the client presents an interface corresponding to the account information, and any operation on the client is supported by the server. The desktop cloud scenario can support interaction between multiple clients and the server. Multiple virtual machines can be set up on the server, and the virtual machines can be used to store dynamic pictures that need to be played. In the embodiments of the present application, the pictures that can be dynamically played are called dynamic pictures. Among them, the dynamic picture can be a video stream or a web page picture. For the convenience of introduction, the dynamic picture is taken as a video stream as an example in the subsequent introduction.

[0074] Figure 1 A schematic diagram of a dynamic picture playback scenario provided in an embodiment of the present application. When a client has a need to play a dynamic picture, the client can transmit a playback instruction to the server, and the server can obtain network status information and picture-related parameters corresponding to the dynamic picture within a preset time. The server can provide services to multiple clients. Figure 1 The following example takes the interaction between a client and a server as an example.

[0075] When the client has a demand for dynamic picture playback, the server can obtain network status information; and determine the picture clarity and picture smoothness corresponding to the virtual desktop data to be encoded according to the network status information.

[0076] In actual applications, in order to prevent the picture clarity and picture smoothness from taking values ​​that are too extreme, the server can adjust the value range of the dynamic picture parameters based on the network status information and picture-related parameters corresponding to the dynamic picture within a preset time. The value range of the dynamic picture parameters may include the value range of the picture clarity and the value range of the picture smoothness. This ensures that there is a range basis for the subsequent adjustment of the values ​​of the dynamic picture parameters, so that the values ​​of the dynamic picture parameters will not be too extreme, and a good user experience is guaranteed when the dynamic picture is played. The server can determine the target dynamic picture parameters based on the currently collected network status information and the value range of the dynamic picture parameters. The server can encode the virtual desktop data based on the picture clarity and picture smoothness, and send the encoded virtual desktop data to the client. The client can decode the virtual desktop data and play the virtual desktop data in the form of a dynamic picture on the display screen.

[0077] In the embodiment of the present application, the target dynamic picture parameters are determined based on historical data, which can effectively avoid the adjustment of dynamic picture parameters being greatly affected by network fluctuations, thereby ensuring the stability of user experience. The specific values ​​of dynamic picture parameters are determined based on current data, and the picture clarity and picture smoothness are adjusted in real time within a limited value range, so that the video can be improved to a certain extent as the network status changes, achieving a better user experience.

[0078] Next, a method for processing virtual desktop data provided by an embodiment of the present application is described in detail. Figure 2 A flowchart of a method for processing virtual desktop data provided by an embodiment of the present application, the method comprising:

[0079] S201: Obtain network status information.

[0080] The network status information may be a parameter used to reflect the network status between the client and the server, and may include one or more combinations of network bandwidth information, network delay information, network jitter information, or network packet loss information.

[0081] S202: Determine the picture clarity and picture smoothness corresponding to the virtual desktop data to be encoded according to the network status information.

[0082] The picture definition may include a picture quality parameter corresponding to the virtual desktop data. The smaller the value of the picture quality parameter is, the higher the picture definition is.

[0083] The picture fluency may include the frame rate corresponding to the virtual desktop data. The higher the frame rate value, the better the picture fluency.

[0084] The network status information reflects the current network quality. In actual applications, if the current network quality is good, it means that the current network quality can support higher picture clarity and smoothness, so you can adjust the picture quality parameters and frame rate, such as reducing the picture quality parameters or increasing the frame rate, to improve the picture clarity and smoothness. If the current network quality is poor, it means that the current network quality cannot support higher picture clarity and smoothness, so you can adjust the picture quality parameters and frame rate, such as increasing the picture quality parameters or lowering the frame rate, to reduce the picture clarity and smoothness.

[0085] S203: Encode the virtual desktop data according to the picture clarity and picture smoothness, and send the encoded virtual desktop data to the client.

[0086] In the embodiment of the present application, the virtual desktop data can be played in the form of dynamic pictures, and the corresponding picture clarity and picture smoothness can be determined once for each frame of the virtual desktop data.

[0087] The server can transmit the encoded virtual desktop data to the client, so that the client can play the decoded virtual desktop data in the form of dynamic pictures.

[0088] It can be seen from the above technical solution that network status information is obtained; the network status information reflects the network status when playing dynamic images. The picture clarity and picture smoothness corresponding to the virtual desktop data to be encoded are determined according to the network status information; picture clarity and picture smoothness are important parameters that affect the user's viewing experience. The virtual desktop data is encoded according to the picture clarity and picture smoothness, and the encoded virtual desktop data is sent to the client. In this technical solution, the picture clarity and picture smoothness are adjusted based on the network status information, so that the playback of the encoded virtual desktop data is improved to a certain extent as the network status changes, effectively ensuring a good user experience when the encoded virtual desktop data is played.

[0089] In the embodiment of the present application, in order to ensure a good user experience when playing dynamic pictures and to avoid the situation where the values ​​of the dynamic picture parameters are too extreme, the value range of the dynamic picture parameters can be pre-configured.

[0090] The value range of the dynamic picture parameter may include the value range of picture clarity and the value range of picture smoothness.

[0091] When determining the picture clarity and picture smoothness, the picture clarity and picture smoothness may be determined from a value range of a dynamic picture parameter according to network status information.

[0092] In order to better adapt to changes in the network environment, the value range of the dynamic picture parameters can be dynamically adjusted.

[0093] Figure 3 A flowchart of a method for adjusting a value range of a dynamic picture parameter provided in an embodiment of the present application, the method comprising:

[0094] S301: Acquire network status information and picture-related parameters corresponding to dynamic pictures within a preset time.

[0095] The value of the preset time can be set according to actual needs and is not limited here. In actual applications, the network status information and screen-related parameters corresponding to the dynamic screen can be collected once per second, and the preset time can be set to 10 seconds, and the network status information and screen-related parameters collected within 10 seconds are summarized.

[0096] The picture-related parameters may be used to reflect the quality of dynamic pictures transmitted from the server to the client, and may include one or more combinations of frame rate information, bit rate information, and encoding information.

[0097] Frame rate information, bit rate information and encoding information are all important parameters that affect picture clarity and picture smoothness.

[0098] The coding information can be used to indicate the situation of the client receiving data. The more data the client receives per unit time, the smoother the data transmission between the client and the server.

[0099] The frame rate information may include the number of image frames transmitted from the server to the client in unit time. The higher the frame rate, the smoother the data transmission between the client and the server.

[0100] Bitrate information can be used to indicate the number of bits of data transmitted per unit time during data transmission. The higher the bitrate, the more data is transmitted from the server to the client per unit time, and the corresponding image quality is clearer.

[0101] The more comprehensive the parameter types included in the picture-related parameters, the more accurately they can represent the smoothness of the dynamic picture transmitted from the server to the client.

[0102] S302: adjusting the value range of the dynamic picture parameter based on the network status information and the picture-related parameters.

[0103] The network status information and picture-related parameters within the preset time can reflect the network status when playing dynamic pictures. In the embodiment of the present application, the corresponding relationship between the value range and the network status can be set for different types of parameters. According to the set corresponding relationship between the value range and the network status, the target network status to which the network status information and picture-related parameters within the preset time belong can be determined. According to the target network status and the changing trend of the network status information and picture-related parameters within the preset time, the value range of the dynamic picture parameters is adjusted.

[0104] The target network state can be any one of all network states. In an embodiment of the present application, the network state can be divided into an initial state, a congested state, an idle state, and a stable state. The initial state is the state in which the server is initially located. The congested state indicates that the network quality between the server and the client is poor and cannot meet the requirements of high fluency and high image quality. The idle state indicates that the network quality between the server and the client is good and can meet the requirements of high fluency and high image quality. The stable state indicates that the network quality between the server and the client is in a relatively stable state and can meet normal fluency and image quality requirements.

[0105] The network quality within the preset time can be known according to the target network status, and the change of network quality can be known according to the change trend of network status information and picture-related parameters. By using the target network status and the change trend of network status information and picture-related parameters within the preset time, the subsequent change of network quality can be better known, so that the value range of the adjusted dynamic picture parameters is more in line with the subsequent actual network environment.

[0106] The value range of the dynamic picture parameters ensures that there is a range basis when adjusting the values ​​of the dynamic picture parameters, so that the values ​​of the dynamic picture parameters will not be too extreme, thereby ensuring a good user experience when playing dynamic pictures.

[0107] In the embodiment of the present application, the value range of the dynamic picture parameter can be adjusted once every preset time.

[0108] The image quality parameters and frame rates corresponding to dynamic picture playback are specific values, not value ranges. Therefore, after obtaining the value range of the dynamic picture parameters, it is necessary to further determine the final values ​​of the image quality parameters and frame rates. For the sake of distinction, the final values ​​of the image quality parameters and frame rates can be referred to as target dynamic picture parameters.

[0109] In the embodiment of the present application, the target dynamic picture parameters can be determined by relying on the currently collected network status information and the value range of the dynamic picture parameters; the target dynamic picture parameters can also be determined by relying on the currently collected coding information and the value range of the dynamic picture parameters; or the target dynamic picture parameters can be determined based on the currently collected network status information and coding information, as well as the value range of the dynamic picture parameters. The more comprehensive the parameters relied on, the more accurate the target dynamic picture parameters determined.

[0110] Both network status information and coding information can be used to reflect the current network quality. In practical applications, when the current network quality is good, a parameter closer to the upper limit of the dynamic picture parameter value range can be selected as the target dynamic picture parameter; when the current network quality is poor, a parameter closer to the lower limit of the dynamic picture parameter value range can be selected as the target dynamic picture parameter.

[0111] It can be seen from the above technical solution that the network status information and picture-related parameters corresponding to the dynamic picture within the preset time are obtained; wherein the picture-related parameters include one or more combinations of coding information, frame rate information and bit rate information. The network status information and picture-related parameters within the preset time reflect the network status when playing the dynamic picture. Based on the network status information and picture-related parameters within the preset time, the value range of the dynamic picture parameters can be adjusted. By adjusting the value range of the dynamic picture parameters, it can be ensured that there is a basis for the range when the values ​​of the dynamic picture parameters are subsequently adjusted, so that the values ​​of the dynamic picture parameters will not be too extreme, and a good user experience is guaranteed when the dynamic picture is played. According to the currently collected network status information and coding information, as well as the value range of the dynamic picture parameters, the target dynamic picture parameters can be determined. The server can encode the dynamic picture according to the target dynamic picture parameters, and transmit the encoded dynamic picture to the client, so that the client can play the decoded dynamic picture. In this technical solution, the target dynamic picture parameters are determined based on historical data, which can effectively avoid the adjustment of the dynamic picture parameters being greatly affected by network fluctuations, and ensure the stability of the user experience. The specific values ​​of dynamic picture parameters are determined based on current data, and the picture clarity and smoothness are adjusted within a limited range of values, so that the playback of dynamic pictures can be improved to a certain extent as the network status changes, achieving a better user experience.

[0112] Taking the network state including the initial state, congested state, idle state and stable state as an example, when the network state is the initial state and the stable state, there is no need to adjust the value range of the dynamic picture parameter. In the embodiment of the present application, the value range of the dynamic picture parameter is adjusted mainly when the network state is a congested state or an idle state. In the congested state and the idle state, the adjustment method of the value range of the dynamic picture parameter is different. Next, the target network state is a congested state and the target network state is an idle state as examples for introduction.

[0113] like Figure 4 The flowchart of a method for adjusting the value range of a dynamic picture parameter when the target network state is a congested state provided by an embodiment of the present application is shown, and the method includes:

[0114] S401: Determine whether the change trend of network status information or screen-related parameters within a preset time period is always in a congested state.

[0115] If the change trend of the network status information or the screen-related parameters within the preset time is always in a congested state, it means that the network quality between the server and the client has no trend of improving. At this time, the server can execute S402.

[0116] If the changing trend of the network status information and the screen-related parameters within the preset time is a transition from a congested state to an idle state or a stable state, it indicates that the network quality between the server and the client is improving, and the server may execute S403.

[0117] S402: adjusting the value range of the dynamic picture parameter according to the first adjustment rule based on the picture clarity, picture smoothness, bit rate information and frame rate information included in the picture-related parameters.

[0118] Taking the dynamic picture as a video as an example, the dynamic picture parameters may include frame rate and picture quality parameters. The frame rate may affect the smoothness of video playback, and the picture quality parameters may affect the picture quality of each frame of the video when the video is played.

[0119] The value range of the dynamic picture parameter may include the value range of the frame rate and the value range of the picture quality parameter.

[0120] Taking into account actual applications, in order to provide users with a better viewing experience, the correspondence between frame rate and picture quality parameters is often set to ensure that the adjustment of frame rate and picture quality parameters will not be too extreme, such as good fluency and poor picture quality, or good picture quality and poor fluency.

[0121] Therefore, in the embodiment of the present application, the first adjustment rule may include first determining the value range of the frame rate, and then determining the value range of the image quality parameter based on the correspondence between the frame rate and the image quality parameter.

[0122] In a specific implementation, when the target network status is a congested state, and the change trend of the network status information or the picture-related parameters within a preset time has always been a congested state, it means that the current network quality can no longer meet the requirements of the original picture quality parameters. At this time, the value range of the picture quality parameters can be reduced.

[0123] A feasible implementation method is to reduce the value range of the image quality parameter to the value range corresponding to the next level according to the set correspondence between the value range of the image quality parameter and the level.

[0124] Among them, the correspondence between the value range and level of the image quality parameter can be preset artificially based on the user's experience of watching dynamic pictures.

[0125] Another feasible implementation method is to use the frame rate included in the picture smoothness as the upper limit of the frame rate; and use the picture quality parameters included in the picture clarity as the upper limit of the picture quality parameters. The lower limit of the frame rate is determined by using the bit rate information and frame rate information contained in the picture association parameters. Bit rate information and frame rate information are important parameters that affect the smoothness of dynamic picture playback. In a specific implementation, the lower limit of the frame rate can be obtained by multiplying the normalized bit rate and frame rate.

[0126] After the frame rate lower limit is determined, based on the set correspondence between the frame rate and the image quality parameter, the image quality parameter lower limit corresponding to the frame rate lower limit can be determined.

[0127] S403: Maintain the current value range of the dynamic picture parameter.

[0128] If the changing trend of the network status information and the picture-related parameters within the preset time is a transition from a congested state to an idle state or a stable state, it indicates that the network environment between the server and the client is improving. At this time, the server can continue to maintain the current value range of the dynamic picture parameters.

[0129] In an embodiment of the present application, the value range of the dynamic picture is dynamically adjusted according to the target network status and the changing trend of the network status information and picture-related parameters within a preset time, so that the value range of the dynamic picture can be more in line with the current network changes, thereby ensuring the rationality of the dynamic picture parameter setting.

[0130] In the embodiment of the present application, after determining the value range of the dynamic picture parameter, appropriate target dynamic picture parameters, namely picture clarity and picture smoothness, can be selected from the value range of the dynamic picture parameter based on the currently collected network status information and encoding information.

[0131] In the initial state, the server has its default dynamic picture parameters. Determining the target dynamic picture parameters is actually adjusting the original dynamic picture parameters.

[0132] Taking the target network state as a congestion state as an example, when the currently collected network state information or coding information belongs to the corresponding value range under the congestion state, the dynamic picture parameters can be adjusted according to the set first strategy.

[0133] The set first strategy may include a specific method of adjusting dynamic picture parameters.

[0134] Taking the dynamic picture parameters including frame rate and picture quality parameters as an example, the better the network status, the larger the frame rate can be set, and the smaller the picture quality parameters can be set. The adjustment of dynamic picture parameters can be to adjust the frame rate, to adjust the picture quality parameters, or to adjust the frame rate and picture quality parameters at the same time. Taking adjusting one parameter at a time as an example, when the currently collected network status information or encoding information belongs to the corresponding value range under the congestion state, the frame rate can be reduced or the picture quality parameter can be increased. The amplitude of parameter adjustment can be pre-set and is not limited here.

[0135] When the currently collected network status information and encoding information do not belong to the corresponding value range under the congestion state, it means that the currently set dynamic picture parameters meet the current network status. At this time, the current values ​​of the dynamic picture parameters can be maintained.

[0136] Considering that in actual applications, users have different requirements for dynamic image playback. Some users may have higher requirements for image quality but not for smoothness; while some users may have higher requirements for smoothness but not for image quality.

[0137] Therefore, in actual applications, priorities can be set according to different user needs. When users have high requirements for image quality and low requirements for fluency, image quality priority can be set. When users have high requirements for fluency and low requirements for image quality, frame rate priority can be set.

[0138] In a specific implementation, adjusting the dynamic picture parameters according to the set first strategy may include, when image quality is prioritized, reducing the frame rate in the dynamic picture parameters according to the set first value; and when smoothness is prioritized, increasing the image quality parameters in the dynamic picture parameters according to the set second value.

[0139] The first value and the second value may be the same or different. For example, the first value and the second value may both be set to 1. When the dynamic picture parameter needs to be increased, 1 is added to the original dynamic picture parameter; when the dynamic picture parameter needs to be decreased, 1 is subtracted from the original dynamic picture parameter.

[0140] By setting different priorities, the diverse needs of different users can be met, making the determination of target dynamic picture parameters more in line with actual needs.

[0141] like Figure 5 The figure is a flow chart of a method for adjusting the value range of a dynamic picture parameter when the target network state is an idle state provided by an embodiment of the present application, the method comprising:

[0142] S501: Determine whether the change trend of network status information or screen-related parameters within a preset time period is always in an idle state.

[0143] If the change trends of the network status information and the picture-related parameters within the preset time remain in the idle state, it means that the network quality between the server and the client is consistently good and can meet higher dynamic picture playback requirements. At this time, the server can execute S502.

[0144] When the changing trend of the network status information and picture-related parameters within the preset time is a transition from an idle state to a congested state or a stable state, it indicates that the network quality between the server and the client has a tendency to deteriorate, and the value ranges of picture clarity and picture smoothness are originally suitable for lower playback requirements. At this time, the current value range of the dynamic picture parameters may not be adjusted temporarily, that is, S503 is executed.

[0145] S502: adjusting the value range of the dynamic picture parameter according to the second adjustment rule based on the picture clarity, picture smoothness, and the set dynamic picture parameter level.

[0146] Taking dynamic picture parameters including frame rate and picture quality parameters as an example, in actual applications, in order to achieve a better user experience, the frame rate level and picture quality parameter level can be divided according to the user experience.

[0147] As shown in Table 1 below, a frame rate level list of frame rate types and frame rate ranges divided according to user experience is provided in an embodiment of the present application. Each frame rate type has its corresponding meaning, which is used to indicate the smoothness that can be achieved when playing the video within the current frame rate range.

[0148] Table 1

[0149] FPS Type FPS Range meaning FPS_SMOOTH_HIGH [27,30] Smooth+ FPS_SMOOTH [24,26] Smooth FPS_SMOOTH_LOW [20,23] Smooth- FPS_CONTINUSOUS_HIGH [17,19] Continuous+ FPS_CONTINUSOUS [14,16] continuous FPS_CONTINUSOUS_LOW [10,13] continuous- FPS_NON_CONTINUSOUS_LOW [8,9] Stuck and stopped- FPS_NON_CONTINUSOUS [6,7] Stuck and stopped FPS_NON_CONTINUSOUS_HIGH [2,5] Caton+

[0150] It should be noted that the division method of the frame rate (FPS) range and its corresponding meaning in Table 1 are only examples. In actual applications, each FPS range and its corresponding meaning can also be adjusted according to changes in user needs.

[0151] As shown in Table 2 below, a list of picture quality parameter levels of picture quality types and picture quality value ranges divided according to user experience is provided in an embodiment of the present application. Each picture quality type has its corresponding meaning, which is used to indicate the picture quality efficiency that can be achieved by playing the video under the current picture quality value range.

[0152] Table 2

[0153] QP Type QP Range meaning QP_SUPER_CLEAR [25,26] Ultra HD QP_HD_HIGH [27,29] HD+ QP_HD [30,32] HD QP_SD_HIGH [33,34] Clarity+ QP_SD [35,36] Clarity QP_BLURRY [37,39] Vague QP_BLURRY_HIGH [40,45] Blur+

[0154] It should be noted that the division method of the picture quality parameter (QP) range and its corresponding meaning in Table 2 are only examples. In actual applications, each QP range and its corresponding meaning can also be adjusted according to changes in user needs.

[0155] If the trend of network status information and picture-related parameters remains in an idle state within a preset period of time, the server can adjust the value range of dynamic picture parameters. In a specific implementation, the server can use the frame rate included in the picture smoothness as the lower limit of the frame rate; and use the picture quality parameters included in the picture clarity as the lower limit of the picture quality parameters.

[0156] According to the set frame rate level, the highest frame rate value corresponding to the previous level adjacent to the frame rate lower limit value is used as the frame rate upper limit value; wherein each frame rate level has its corresponding frame rate value range.

[0157] According to the frame rate level list in Table 1, the highest frame rate value corresponding to the upper level adjacent to the frame rate lower limit value can be determined.

[0158] According to the set picture quality parameter level, the highest picture quality parameter value corresponding to the previous level adjacent to the picture quality parameter lower limit value is used as the picture quality parameter upper limit value; wherein each picture quality parameter level has its corresponding picture quality parameter value range.

[0159] By using the picture quality parameter level list in Table 2, the highest picture quality parameter value corresponding to the previous level adjacent to the picture quality parameter lower limit value can be determined.

[0160] S503: Maintain the current value range of the dynamic picture parameter.

[0161] When the changing trend of the network status information and picture-related parameters within the preset time is a transition from an idle state to a congested state or a stable state, it indicates that the network quality between the server and the client is deteriorating, and the value ranges of the picture clarity and picture smoothness are originally suitable for lower playback requirements. At this time, the current value range of the dynamic picture parameters can be maintained.

[0162] In an embodiment of the present application, the value range of the dynamic picture parameters is dynamically adjusted according to the picture clarity and picture smoothness and the set dynamic picture parameter level, so that the value range of the dynamic picture can be more in line with the current network changes, thereby ensuring the rationality of the dynamic picture parameter setting.

[0163] In the initial state, the server has its default dynamic picture parameters. Determining the target dynamic picture parameters is actually adjusting the original dynamic picture parameters.

[0164] Taking the target network state as an idle state as an example, when the currently collected network state information and encoding information belong to the corresponding value range in the idle state, the dynamic picture parameters can be adjusted according to the set second strategy.

[0165] The set second strategy may include a specific method for adjusting dynamic picture parameters.

[0166] Taking the dynamic picture parameters including frame rate and picture quality parameters as an example, the better the network status, the larger the frame rate can be set, and the smaller the picture quality parameters can be set. The adjustment of dynamic picture parameters can be to adjust the frame rate, to adjust the picture quality parameters, or to adjust the frame rate and picture quality parameters at the same time. Taking adjusting one parameter at a time as an example, when the currently collected network status information or encoding information belongs to the corresponding value range in the idle state, the frame rate can be increased or the picture quality parameter can be decreased. The amplitude of parameter adjustment can be preset and is not limited here.

[0167] When the currently collected network status information or encoding information belongs to the corresponding value range in the idle state, it means that the currently set dynamic picture parameters meet the current network status. At this time, the current values ​​of the dynamic picture parameters can be maintained.

[0168] Considering that in actual applications, users have different requirements for dynamic image playback. Some users may have higher requirements for image quality but not for smoothness; while some users may have higher requirements for smoothness but not for image quality.

[0169] Therefore, in actual applications, priorities can be set according to different user needs. When users have high requirements for image quality and low requirements for fluency, image quality priority can be set. When users have high requirements for fluency and low requirements for image quality, frame rate priority can be set.

[0170] In a specific implementation, adjusting the dynamic picture parameters according to the set second strategy may include, when smoothness is prioritized, increasing the frame rate in the dynamic picture parameters according to the set first value; and when image quality is prioritized, decreasing the image quality parameters in the dynamic picture parameters according to the set second value.

[0171] The first value and the second value may be the same or different. For example, the first value and the second value may both be set to 1. When the dynamic picture parameter needs to be increased, 1 is added to the original dynamic picture parameter; when the dynamic picture parameter needs to be decreased, 1 is subtracted from the original dynamic picture parameter.

[0172] By setting different priorities based on different needs of users, different user needs can be met and the determination of target dynamic picture parameters can be made more in line with the actual needs of users.

[0173] Figure 6 The embodiment of the present application also provides a schematic diagram of the structure of a virtual desktop data processing device, including an acquisition unit 61, a determination unit 62 and an encoding unit 63;

[0174] An acquisition unit 61 is used to acquire network status information;

[0175] A determination unit 62, configured to determine the picture clarity and picture smoothness corresponding to the virtual desktop data to be encoded according to the network status information;

[0176] The encoding unit 63 is used to encode the virtual desktop data according to the picture clarity and picture smoothness, and send the encoded data to the client.

[0177] Optionally, the picture clarity includes picture quality parameters corresponding to the virtual desktop data, and the picture smoothness includes a frame rate corresponding to the virtual desktop data.

[0178] Optionally, the network status information includes one or more combinations of network bandwidth information, network delay information, network jitter information or network packet loss information.

[0179] Optionally, a configuration unit is also included;

[0180] A configuration unit, used to pre-configure a value range of a dynamic picture parameter; wherein the value range of the dynamic picture parameter includes a value range of picture clarity and a value range of picture smoothness;

[0181] The determination unit is used to determine the picture clarity and picture smoothness from the value range of the dynamic picture parameters according to the network status information.

[0182] Optionally, for determining the value range of the dynamic picture parameter, the device further includes a parameter acquisition unit and a range determination unit;

[0183] A parameter acquisition unit, used to acquire network status information and screen-related parameters within a preset time;

[0184] The range determination unit is used to determine the value range of the dynamic picture parameter based on the network state information and the picture association parameter.

[0185] Optionally, the picture association parameter includes one or more combinations of frame rate information, bit rate information and encoding information.

[0186] Optionally, the range determination unit includes a state determination subunit and a range adjustment subunit;

[0187] The state determination subunit is used to determine the target network state to which the network state information and the screen association parameters belong within a preset time according to the corresponding relationship between the set value range and the network state;

[0188] The range adjustment subunit is used to adjust the value range of the dynamic picture parameters according to the target network state and the change trend of the network state information and the picture-related parameters within a preset time.

[0189] Optionally, the device further comprises a collection unit;

[0190] A collection unit, used for collecting coding information;

[0191] The determination unit is used to determine the picture clarity and picture smoothness from the value range of the dynamic picture parameters according to the network status information and the coding information.

[0192] Optionally, when the target network state is a congested state, the range adjustment subunit is used to adjust the value range of the dynamic picture parameter according to the first adjustment rule based on the picture clarity, picture smoothness, bit rate information and frame rate information included in the picture associated parameters, when the change trend of the network state information or the picture associated parameters within a preset time has always been in a congested state;

[0193] When the change trends of the network status information and the picture-related parameters within the preset time are changing from a congested state to an idle state or a stable state, the current value range of the dynamic picture parameters is maintained.

[0194] Optionally, the determining unit includes a first adjusting subunit and a first maintaining subunit;

[0195] A first adjustment subunit is used to adjust the dynamic picture parameters according to a set first strategy when the network state information or the coding information belongs to a corresponding value range in a congestion state;

[0196] The first maintaining subunit is used to maintain the current value of the dynamic picture parameter when the network state information and the coding information do not belong to the corresponding value range under the congestion state.

[0197] Optionally, the first adjustment subunit is used to reduce the frame rate in the dynamic picture parameter according to a set first value when image quality is prioritized;

[0198] When smoothness is prioritized, the image quality parameter in the dynamic image parameter is increased according to the set second value.

[0199] Optionally, the range adjustment subunit is used to use the frame rate included in the picture smoothness as the upper limit value of the frame rate; and use the picture quality parameters included in the picture clarity as the upper limit value of the picture quality parameters;

[0200] Determine the frame rate lower limit by using the bit rate information and frame rate information included in the picture association parameters and the frame rate value included in the picture smoothness;

[0201] Based on the set correspondence between the frame rate and the image quality parameter, a lower limit value of the image quality parameter corresponding to the lower limit value of the frame rate is determined.

[0202] Optionally, when the target network state is an idle state, the range adjustment subunit is used to adjust the value range of the dynamic picture parameter according to the second adjustment rule based on the picture clarity, picture smoothness, and the set dynamic picture parameter level when the change trend of the network state information and the picture-related parameters within a preset time has always been in the idle state;

[0203] When the change trends of the network status information and the picture-related parameters within the preset time are changing from an idle state to a congested state or a stable state, the current value range of the dynamic picture parameters is maintained.

[0204] Optionally, the determination unit includes a second adjustment subunit and a second holding subunit;

[0205] A second adjustment subunit is used to adjust the dynamic picture parameters according to a set second strategy when the network state information and the coding information belong to a corresponding value range in an idle state;

[0206] The second maintaining subunit is used to maintain the current value of the dynamic picture parameter when the network state information or the coding information does not belong to the corresponding value range in the idle state.

[0207] Optionally, the second adjustment subunit is used to increase the frame rate in the dynamic picture parameter according to the set first value when fluency is prioritized;

[0208] When image quality is prioritized, the image quality parameter in the dynamic image parameter is reduced according to the set second value.

[0209] Optionally, the range adjustment subunit is used to use the frame rate included in the picture smoothness as the frame rate lower limit value; and use the picture quality parameters included in the picture clarity as the picture quality parameter lower limit value;

[0210] According to the set frame rate level, the highest frame rate value corresponding to the previous level adjacent to the frame rate lower limit value is used as the frame rate upper limit value; wherein each frame rate level has its corresponding frame rate value range;

[0211] According to the set picture quality parameter level, the highest picture quality parameter value corresponding to the previous level adjacent to the picture quality parameter lower limit value is used as the picture quality parameter upper limit value; wherein each picture quality parameter level has its corresponding picture quality parameter value range.

[0212] Figure 6 The description of the features in the corresponding embodiments can be found in Figures 2 to 5 The relevant descriptions of the corresponding embodiments will not be repeated here one by one.

[0213] It can be seen from the above technical solution that network status information is obtained; the network status information reflects the network status when playing dynamic images. The picture clarity and picture smoothness corresponding to the virtual desktop data to be encoded are determined according to the network status information; picture clarity and picture smoothness are important parameters that affect the user's viewing experience. The virtual desktop data is encoded according to the picture clarity and picture smoothness, and the encoded virtual desktop data is sent to the client. In this technical solution, the picture clarity and picture smoothness are adjusted based on the network status information, so that the playback of the encoded virtual desktop data is improved to a certain extent as the network status changes, effectively ensuring a good user experience when the encoded virtual desktop data is played.

[0214] Figure 7 A schematic diagram of a virtual desktop data processing device provided in an embodiment of the present application includes:

[0215] A memory 71, used for storing computer programs;

[0216] The processor 72 is used to execute a computer program to implement the steps of the above-mentioned method for processing virtual desktop data.

[0217] An embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the method for processing virtual desktop data as described above are implemented.

[0218] The above is a detailed introduction to a method, device, equipment and computer-readable storage medium for processing virtual desktop data provided by an embodiment of the present application. The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the various embodiments can be referenced to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description. It should be pointed out that for ordinary technicians in this technical field, without departing from the principles of the present application, several improvements and modifications can be made to the present application, and these improvements and modifications also fall within the scope of protection of the claims of the present application.

[0219] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0220] The steps of the method or algorithm described in conjunction with the embodiments disclosed herein may be implemented directly using hardware, a software module executed by a processor, or a combination of the two. The software module may be placed in a random access memory (RAM), a memory, a read-only memory (ROM), an electrically programmable ROM, an electrically erasable programmable ROM, a register, a hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.

Claims

1. A method for processing virtual desktop data, characterized in that: The method is applied to the server, and includes: Get network status information and screen-related parameters; According to the correspondence between the value range set by the network state information and the value range set by the screen association parameter and the network state, determine the target network state to which the network state information and the screen association parameter belong within a preset time; According to the target network state and the changing trends of the network state information and the picture-related parameters within the preset time, the value range of the dynamic picture parameter is adjusted; wherein, when the target network state is a congested state, the adjusting the value range of the dynamic picture parameter according to the target network state and the changing trends of the network state information and the picture-related parameters within the preset time includes: when the changing trends of the network state information or the picture-related parameters within the preset time have always been in a congested state, adjusting the value range of the dynamic picture parameter according to the first adjustment rule according to the picture clarity, the picture smoothness or the bit rate information and the frame rate information included in the picture-related parameters; when the changing trends of the network state information and the picture-related parameters within the preset time are transitioning from a congested state to an idle state or a stable state, maintaining the current value range of the dynamic picture parameter; Determining the picture clarity and the picture smoothness from the value range of the dynamic picture parameter according to the network status information; The virtual desktop data is encoded according to the picture clarity and the picture smoothness, and the encoded virtual desktop data is sent to the client.

2. The method for processing virtual desktop data according to claim 1, characterized in that: The picture clarity includes picture quality parameters corresponding to the virtual desktop data, and the picture smoothness includes a frame rate corresponding to the virtual desktop data.

3. The method for processing virtual desktop data according to claim 1, characterized in that: The network status information includes one or more combinations of network bandwidth information, network delay information, network jitter information or network packet loss information.

4. The method for processing virtual desktop data according to claim 1, characterized in that: The picture association parameters include one or more combinations of frame rate information, bit rate information and encoding information.

5. The method for processing virtual desktop data according to claim 1, characterized in that: Before determining the picture clarity and the picture smoothness from the value range of the dynamic picture parameter according to the network status information, the method further includes: Collect coded information; Determining the picture clarity and the picture smoothness from the value range of the dynamic picture parameter according to the network status information includes: The picture clarity and the picture smoothness are determined from a value range of the dynamic picture parameter according to the network status information and the encoding information.

6. The method for processing virtual desktop data according to claim 1, characterized in that: When the target network state is an idle state, adjusting the value range of the dynamic picture parameter according to the target network state and the change trend of the network state information and the picture-related parameter within the preset time includes: When the change trends of the network status information and the picture-related parameters within the preset time are always in an idle state, adjusting the value range of the dynamic picture parameter according to the second adjustment rule based on the picture clarity, the picture fluency, and the set dynamic picture parameter level; When the change trends of the network status information and the picture-related parameters within the preset time are transitioning from an idle state to a congested state or a stable state, the current value range of the dynamic picture parameter is maintained.

7. A virtual desktop data processing device, characterized in that: It includes an acquisition unit, a determination unit and an encoding unit; The acquisition unit is used to acquire network status information and picture-related parameters; determine the target network status to which the network status information and the picture-related parameters belong within a preset time according to the corresponding relationship between the value range set by the network status information and the value range set by the picture-related parameters and the network status; adjust the value range of the dynamic picture parameter according to the target network status and the change trend of the network status information and the picture-related parameters within the preset time; specifically, when the change trend of the network status information or the picture-related parameters within the preset time always belongs to the congested state, adjust the value range of the dynamic picture parameter according to the first adjustment rule according to the picture clarity, picture smoothness or the bit rate information and frame rate information contained in the picture-related parameters; when the change trend of the network status information and the picture-related parameters within the preset time belongs to the transition from the congested state to the idle state or the stable state, maintain the current value range of the dynamic picture parameter; The determining unit is used to determine the picture clarity and the picture smoothness from the value range of the dynamic picture parameter according to the network status information; The encoding unit is used to encode the virtual desktop data according to the picture clarity and the picture smoothness, and send the encoded data to the client.

8. A virtual desktop data processing device, characterized in that: include: Memory for storing computer programs; A processor is used to execute the computer program to implement the steps of the method for processing virtual desktop data as claimed in any one of claims 1 to 6.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the steps of the method for processing virtual desktop data according to any one of claims 1 to 6 are implemented.

Images