Image processing method and device

By adjusting encoding parameters in real time on the cloud server and optimizing video quality and fluency according to the evaluation indicators of terminal devices, the problems of inaccurate bandwidth evaluation and neglected decoding capabilities in existing cloud services are solved, and a more stable video playback experience is achieved.

CN119383383BActive Publication Date: 2025-04-18HAIMA CLOUD TIANJIN INFORMATION TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202411950966.1
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-12-27
Publication Date
2025-04-18
Estimated Expiration
2044-12-27

AI Technical Summary

Technical Problem

In existing cloud services, bandwidth evaluation is inaccurate and the decoding capabilities of terminal devices are ignored, resulting in lag and image quality degradation during video playback.

Method used

By adjusting the encoding parameters in real time on the cloud server, including resolution, frame rate and code rate, and adjusting them according to the image quality evaluation indicators and lag evaluation indicators of the target terminal, ensuring that the video quality and fluency are optimally balanced.

Benefits of technology

It realizes accurate evaluation and adaptation of the user's actual network bandwidth and terminal device decoding capabilities, reducing the problems of lag and image quality degradation during video playback.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119383383B_ABST
    Figure CN119383383B_ABST
Patent Text Reader

Abstract

The present application provides a picture processing method and device, the method comprising: S10, determining encoding parameters, encoding a first video using the encoding parameters to obtain a second video, and sending the second video to a target terminal, so that the target terminal decodes the second video to obtain a first decoded video; S11, adjusting the encoding parameters when it is determined that a picture quality evaluation index satisfies a first condition or a jamming evaluation index satisfies a second condition; repeating steps S10 and S11 until the picture quality evaluation index does not satisfy the first condition and the jamming evaluation index does not satisfy the second condition; S12, determining target encoding parameters, and when providing cloud services to the target terminal, encoding a cloud application screen or a desktop screen rendered by the system using the target encoding parameters to obtain an encoded screen, and sending the encoded screen to the target terminal, which can reduce the occurrence of jamming and picture quality degradation problems when the terminal plays the video.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of cloud computing, and in particular to a picture processing method and device. Background Art

[0002] With the rapid development of cloud computing and network technology, cloud services such as cloud computers and cloud games have been widely used in various fields. Cloud services concentrate computing and storage resources in the cloud, allowing users to remotely access high-performance computing resources through terminal devices to achieve complex computing and high-quality graphics rendering. This service model greatly reduces the user's hardware costs and improves resource utilization efficiency.

[0003] In cloud services, service providers usually deploy a large number of edge nodes to reduce network latency and improve user experience. In order to provide users with the best service quality, users' bandwidth is usually evaluated and the encoding bit rate of the cloud server is configured based on the bandwidth. This method has the following shortcomings: (1) Existing bandwidth evaluation usually determines the user's bandwidth through file download tests using the HTTP (HyperText Transfer Protocol) protocol. However, the HTTP protocol is based on TCP (Transmission Control Protocol), while actual cloud service video streaming usually uses a real-time communication protocol based on UDP (User Datagram Protocol). Due to the differences in transmission mechanisms and performance between TCP and UDP, the bandwidth obtained from the file download test is inconsistent with the bandwidth of actual video streaming, resulting in inaccurate evaluation results. (2) Existing evaluation methods mainly focus on network bandwidth and only configure the video bit rate based on bandwidth, ignoring the decoding capabilities of the terminal device. The above shortcomings will cause the terminal device to be unable to decode the video smoothly, resulting in freezes or reduced image quality, affecting the user experience.

[0004] In view of this, how to provide a coding solution that can comprehensively and accurately reflect the user's actual network bandwidth conditions and the decoding capabilities of the terminal device to reduce the occurrence of freezes and image quality degradation when the terminal plays the video has become a technical problem that needs to be solved urgently. Summary of the invention

[0005] In view of the technical problems existing in the prior art, the embodiments of the present application provide a picture processing method and device.

[0006] In a first aspect, an embodiment of the present application provides a picture processing method, which is applied to a cloud server, comprising:

[0007] S10, determining encoding parameters, encoding the first video using the encoding parameters to obtain a second video, and sending the second video to a target terminal, so that the target terminal decodes the second video to obtain a first decoded video;

[0008] S11. When it is determined that the image quality evaluation index satisfies the first condition or the jamming evaluation index satisfies the second condition, adjusting the encoding parameters, wherein the image quality evaluation index is used to evaluate the image quality of the first decoded video, and the jamming evaluation index is used to evaluate the jamming situation when the target terminal renders and displays the first decoded video, and adjusting the encoding parameters includes reducing the value of at least one of the resolution, the frame rate, and the bit rate;

[0009] Repeat steps S10 and S11 until the image quality evaluation index does not meet the first condition and the jamming evaluation index does not meet the second condition;

[0010] S12. Determine target encoding parameters, and when providing cloud services to a target terminal, use the target encoding parameters to encode a cloud application screen or a desktop screen rendered by the system to obtain an encoded screen, and send the encoded screen to the target terminal.

[0011] In a second aspect, the embodiment of the present application further provides a picture processing device, which is applied to a cloud server, comprising:

[0012] The processing unit is used to perform the following steps:

[0013] S10, determining encoding parameters, encoding the first video using the encoding parameters to obtain a second video, and sending the second video to a target terminal, so that the target terminal decodes the second video to obtain a first decoded video;

[0014] S11. When it is determined that the image quality evaluation index satisfies the first condition or the jamming evaluation index satisfies the second condition, adjusting the encoding parameters, wherein the image quality evaluation index is used to evaluate the image quality of the first decoded video, and the jamming evaluation index is used to evaluate the jamming situation when the target terminal renders and displays the first decoded video, and adjusting the encoding parameters includes reducing the value of at least one of the resolution, the frame rate, and the bit rate;

[0015] Repeat steps S10 and S11 until the image quality evaluation index does not meet the first condition and the jamming evaluation index does not meet the second condition;

[0016] S12. Determine target encoding parameters, and when providing cloud services to a target terminal, use the target encoding parameters to encode a cloud application screen or a desktop screen rendered by the system to obtain an encoded screen, and send the encoded screen to the target terminal.

[0017] In a third aspect, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the image processing method described in the first aspect are executed.

[0018] In a fourth aspect, an embodiment of the present application further provides an electronic device, comprising: a processor, a storage medium and a bus, wherein the storage medium stores machine-readable instructions executable by the processor, and when the electronic device is running, the processor communicates with the storage medium through the bus, and the processor executes the machine-readable instructions to perform the steps of the picture processing method described in the first aspect.

[0019] In summary, the picture processing method and device, electronic device and storage medium provided in the embodiments of the present application still use the streaming protocol of the cloud service to send the second video to the target terminal, thereby avoiding the problem of inaccurate evaluation results that may occur when the existing bandwidth evaluation method directly measures the bandwidth, and adjusting the encoding parameters of the cloud server through the evaluation indicators of video quality and video playback smoothness that will be affected by network bandwidth and terminal decoding capability (i.e., image quality evaluation indicators and stuttering evaluation indicators), so that the finally determined encoding parameters (i.e., target encoding parameters) can adapt to the network bandwidth and the decoding capability of the terminal, and achieve the best balance between image quality and image smoothness. This scheme comprehensively considers the network bandwidth and terminal decoding capability, so that after the target encoding parameters are applied to the cloud service provided to the target terminal, the occurrence of stuttering and image quality degradation when the terminal plays the video can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] Figure 1 A schematic diagram of a flow chart of an embodiment of a picture processing method provided in an embodiment of the present application;

[0021] Figure 2 A schematic diagram of the structure of an embodiment of a picture processing device provided in an embodiment of the present application;

[0022] Figure 3 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0023] To make the purpose, technical scheme and advantages of the embodiments of the present application clearer, the technical scheme in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. It should be understood that the drawings in the present application only serve the purpose of explanation and description and are not used to limit the scope of protection of the present application. In addition, it should be understood that the schematic drawings are not drawn in real proportion. The flowchart used in this application shows the operations implemented according to some embodiments of the present application. It should be understood that the operations of the flowchart can be implemented out of sequence, and the steps without logical context can be reversed in order or implemented simultaneously. In addition, those skilled in the art can add one or more other operations to the flowchart under the guidance of the content of the present application, or remove one or more operations from the flowchart.

[0024] In addition, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments. The components of the embodiments of the present application described and shown in the drawings here can be arranged and designed in various configurations. Therefore, the following detailed description of the embodiments of the present application provided in the drawings is not intended to limit the scope of the application claimed for protection, but merely represents the selected embodiments of the present application. Based on the embodiments of the present application, all other embodiments obtained by those skilled in the art without making creative work belong to the scope of protection of the present application.

[0025] It should be noted that the term "comprising" will be used in the embodiments of the present application to indicate the existence of the features declared thereafter, but does not exclude the addition of other features.

[0026] Reference Figure 1 As shown, an embodiment of the present application provides a flow chart of a method for processing a picture, which is applied to a cloud server and includes:

[0027] S10, determining encoding parameters, encoding the first video using the encoding parameters to obtain a second video, and sending the second video to a target terminal, so that the target terminal decodes the second video to obtain a first decoded video;

[0028] In this embodiment, it should be noted that the protocol used to send the second video to the target terminal is the same as the streaming protocol used by the cloud server to provide cloud services to the target terminal. In the first iteration, the encoding parameters in step S10 can be set as needed, such as high-specification parameters: the resolution is set to 4K, the frame rate is set to 120fps, and the bit rate is set to 125Mbps.

[0029] S11. When it is determined that the image quality evaluation index satisfies the first condition or the jamming evaluation index satisfies the second condition, adjusting the encoding parameters, wherein the image quality evaluation index is used to evaluate the image quality of the first decoded video, and the jamming evaluation index is used to evaluate the jamming situation when the target terminal renders and displays the first decoded video, and adjusting the encoding parameters includes reducing the value of at least one of the resolution, the frame rate, and the bit rate;

[0030] In this embodiment, it should be noted that the image quality evaluation index and the jamming evaluation index can be calculated by the target terminal or by the cloud server. The image quality evaluation index is calculated based on the first video and the first decoded video, for example, it can be PSNR (peak signal-to-noise ratio), SSIM (structural similarity), VMAF (Visual Multimethod Assessment Fusion) value, etc.; the jamming evaluation index is calculated based on the start rendering time of the video frame in the first decoded video, for example, it can be the jamming rate. If the image quality evaluation index is calculated by the target terminal, the first video needs to be downloaded to the target terminal in advance. When calculating the image quality evaluation index, the image quality evaluation index of multiple video frames in the first decoded video can be calculated, and the image quality evaluation index of the multiple video frames can be calculated to obtain the image quality evaluation index of the first decoded video. For example, the image quality evaluation index of multiple video frames can be weighted summed to obtain the image quality evaluation index of the first decoded video, or the image quality evaluation index of multiple video frames can be obtained by calculating the variance to obtain the image quality evaluation index of the first decoded video. For each video frame in the first decoded video for which the image quality evaluation index needs to be calculated, it is necessary to determine the video frame corresponding to the video frame in the first video, and calculate the image quality evaluation index based on the determined video frame and the video frame. When determining the video frame corresponding to the video frame in the first video, based on the frame number carried in the video frame, the video frame with the same frame number as the video frame in the first video can be determined as the video frame corresponding to the video frame in the first video. When calculating the stuttering rate, the existing stuttering rate calculation method can be used.

[0031] If the image quality evaluation index satisfies the first condition, it indicates that the image quality of the first decoded video is poor. If the jamming evaluation index satisfies the second condition, it indicates that the target terminal is relatively jammed when rendering and displaying the first decoded video.

[0032] Repeat steps S10 and S11 until the image quality evaluation index does not meet the first condition and the jamming evaluation index does not meet the second condition, and the current encoding parameters of the cloud server can be determined;

[0033] S12. Determine target encoding parameters, and when providing cloud services to a target terminal, use the target encoding parameters to encode a cloud application screen or a desktop screen rendered by the system to obtain an encoded screen, and send the encoded screen to the target terminal.

[0034] In this embodiment, it should be noted that the target encoding parameters can be determined using the determined current encoding parameters of the cloud server. The cloud server can subsequently use the target encoding parameters for encoding when providing cloud services to the target terminal. For example, for cloud application services, the cloud server can use the target encoding parameters to encode the cloud application screen rendered by the system to obtain an encoded screen, and send the encoded screen to the target terminal; for cloud computer services, the cloud server can use the target encoding parameters to encode the cloud computer desktop screen rendered by the system to obtain an encoded screen, and send the encoded screen to the target terminal; for cloud mobile phone services, the cloud server can use the target encoding parameters to encode the cloud mobile phone desktop screen rendered by the system to obtain an encoded screen, and send the encoded screen to the target terminal.

[0035] The picture processing method provided in the embodiment of the present application sends the second video to the target terminal using the streaming protocol of the cloud service, thereby avoiding the problem of inaccurate evaluation results that may occur when the existing bandwidth evaluation method directly measures the bandwidth, and adjusting the encoding parameters of the cloud server through evaluation indicators of video quality and video playback smoothness that may be affected by network bandwidth and terminal decoding capability (i.e., image quality evaluation indicators and stuttering evaluation indicators), so that the finally determined encoding parameters (i.e., target encoding parameters) can adapt to the network bandwidth and the decoding capability of the terminal, and achieve the best balance between image quality and image smoothness. This solution comprehensively considers the network bandwidth and the decoding capability of the terminal, so that after the target encoding parameters are applied to the cloud service provided to the target terminal, the occurrence of stuttering and image quality degradation problems when the terminal plays the video can be reduced.

[0036] Based on the above method embodiment,

[0037] The target encoding parameters may be the encoding parameters of the cloud server when the iteration is completed; or

[0038] The target encoding parameters can be determined based on the encoding parameters of the cloud server when the iteration is completed.

[0039] In this embodiment, it should be noted that the encoding parameters of the cloud server after the iteration is completed are the current encoding parameters of the cloud server determined in the previous embodiment.

[0040] Based on the foregoing method embodiment, the process of determining the target encoding parameter may include:

[0041] S20, determining encoding parameters, encoding the first video using the encoding parameters to obtain a third video, and sending the third video to a target terminal, so that the target terminal decodes the third video to obtain a second decoded video, wherein the encoding parameters at the first iteration are obtained by adjusting the encoding parameters of the cloud server, and the adjustment process includes increasing the value of at least one of the resolution, the frame rate, and the bit rate. If the adjustment process includes increasing the resolution, the increased resolution is not higher than the display resolution of the target terminal, if the adjustment process includes increasing the frame rate, the increased frame rate is not higher than the display frame rate of the target terminal, and if the adjustment process includes increasing the bit rate, the increased bit rate is not higher than the bit rate threshold;

[0042] In the present embodiment, it should be noted that the current encoding parameters of the cloud server determined in the aforementioned embodiment may be adjusted to obtain the encoding parameters for the first iteration, and the adjustment process includes increasing the value of at least one of the resolution, frame rate and bit rate, but the value of the corresponding parameter item after the increase cannot exceed the specified value, specifically: if the adjustment process includes increasing the resolution, the increased resolution shall not be higher than the display resolution of the target terminal; if the adjustment process includes increasing the frame rate, the increased frame rate shall not be higher than the display frame rate of the target terminal; if the adjustment process includes increasing the bit rate, the increased bit rate shall not be higher than the bit rate threshold.

[0043] S21. When it is determined that the image quality evaluation index does not meet the first condition and the jamming evaluation index does not meet the second condition, adjusting the encoding parameters, wherein adjusting the encoding parameters includes increasing the value of at least one of the resolution, the frame rate, and the bit rate. If adjusting the encoding parameters includes increasing the resolution, the increased resolution is not higher than the display resolution of the target terminal. If adjusting the encoding parameters includes increasing the frame rate, the increased frame rate is not higher than the display frame rate of the target terminal. If adjusting the encoding parameters includes increasing the bit rate, the increased bit rate is not higher than the bit rate threshold.

[0044] In the present embodiment, it should be noted that, in each iteration process when executing step S21, if the picture quality evaluation index used to evaluate the picture quality of the second decoded video does not meet the first condition and the stuttering evaluation index used to evaluate the stuttering situation when the target terminal renders and displays the second decoded video does not meet the second condition, that is, the picture quality of the second decoded video is better and the target terminal does not stutter when rendering and displaying the second decoded video, then the encoding parameters are adjusted, and the adjustment process is the same as the adjustment process in step S20, which will not be repeated here.

[0045] Repeat steps S20 and S21 until the image quality evaluation index satisfies the first condition or the jamming evaluation index satisfies the second condition, or the encoding parameter reaches the upper limit of adjustment;

[0046] In the present embodiment, it should be noted that the condition for stopping the iteration is that the image quality evaluation index used to evaluate the image quality of the second decoded video satisfies the first condition or the stuttering evaluation index used to evaluate the stuttering situation when the target terminal renders and displays the second decoded video satisfies the second condition or the encoding parameter reaches the adjustment upper limit, wherein the encoding parameter reaches the adjustment upper limit means that if the value of the specified parameter item of the encoding parameter is increased, the value of the parameter item after the increase is greater than the specified value corresponding to the parameter item.

[0047] The encoding parameters before the last iteration adjustment are determined as the target encoding parameters, or the encoding parameters when the adjustment upper limit is reached are determined as the target encoding parameters.

[0048] In the present embodiment, it should be noted that if the image quality evaluation index used to evaluate the image quality of the second decoded video satisfies the first condition or the stuttering evaluation index used to evaluate the stuttering situation when the target terminal renders and displays the second decoded video satisfies the second condition and causes the iteration to stop, then the encoding parameters before the last iterative adjustment are determined as the target encoding parameters; and if the iteration is stopped because the encoding parameters reach the adjustment upper limit, then the encoding parameters when the adjustment upper limit is reached are the target encoding parameters.

[0049] Based on the above method embodiment,

[0050] If the larger the image quality evaluation index is, the better the image quality is, then the first condition may be that the image quality evaluation index is less than the first value;

[0051] If the larger the jamming evaluation index is, the more serious the jamming situation is, then the second condition may be that the jamming evaluation index is greater than the second value.

[0052] In this embodiment, it should be noted that if the larger the image quality evaluation index, the better the image quality, the first condition may be that the image quality evaluation index is less than the first value; and if the larger the image quality evaluation index, the worse the image quality, the first condition may be that the image quality evaluation index is greater than the third value. If the larger the jamming evaluation index, the more serious the jamming situation, the second condition may be that the jamming evaluation index is greater than the second value; and if the larger the jamming evaluation index, the smoother the jamming situation, the second condition may be that the jamming evaluation index is less than the fourth value.

[0053] Based on the aforementioned method embodiment, the cloud server belongs to a target Internet data center IDC computer room, the target IDC computer room is one of multiple IDC computer rooms of the cloud service provider, and the round-trip delay between the cloud server and the target terminal is less than the round-trip delay between the cloud server and the target terminal in other IDC computer rooms among the multiple IDC computer rooms of the cloud service provider except the target IDC computer room.

[0054] In this embodiment, it should be noted that for the target terminal, multiple IDC computer rooms or all IDC computer rooms can be selected from all IDC computer rooms of the cloud service provider, and a cloud server is set up in each selected IDC computer room. The round-trip delay between the target terminal and each set cloud server is measured, and the cloud server with the smallest round-trip delay is used as the cloud server applied to the aforementioned method embodiment.

[0055] Reference Figure 2 FIG. 1 is a schematic diagram of a structure of a picture processing device provided in an embodiment of the present application, and the device is applied to a cloud server, comprising:

[0056] The processing unit 20 is used to perform the following steps:

[0057] S10, determining encoding parameters, encoding the first video using the encoding parameters to obtain a second video, and sending the second video to a target terminal, so that the target terminal decodes the second video to obtain a first decoded video;

[0058] S11. When it is determined that the image quality evaluation index satisfies the first condition or the jamming evaluation index satisfies the second condition, adjusting the encoding parameters, wherein the image quality evaluation index is used to evaluate the image quality of the first decoded video, and the jamming evaluation index is used to evaluate the jamming situation when the target terminal renders and displays the first decoded video, and adjusting the encoding parameters includes reducing the value of at least one of the resolution, the frame rate, and the bit rate;

[0059] Repeat steps S10 and S11 until the image quality evaluation index does not meet the first condition and the jamming evaluation index does not meet the second condition;

[0060] S12. Determine target encoding parameters, and when providing cloud services to a target terminal, use the target encoding parameters to encode a cloud application screen or a desktop screen rendered by the system to obtain an encoded screen, and send the encoded screen to the target terminal.

[0061] The image processing device provided in the embodiment of the present application sends the second video to the target terminal using the streaming protocol of the cloud service, thereby avoiding the problem of inaccurate evaluation results that may occur when the existing bandwidth evaluation method directly measures the bandwidth, and adjusting the encoding parameters of the cloud server through evaluation indicators of video quality and video playback smoothness that may be affected by network bandwidth and terminal decoding capability (i.e., image quality evaluation indicators and stuttering evaluation indicators), so that the finally determined encoding parameters (i.e., target encoding parameters) can adapt to the network bandwidth and the decoding capability of the terminal, and achieve the best balance between image quality and image smoothness. This solution comprehensively considers the network bandwidth and the decoding capability of the terminal, so that after the target encoding parameters are applied to the cloud service provided for the target terminal, the occurrence of stuttering and image quality degradation problems when the terminal plays the video can be reduced.

[0062] On the basis of the above device embodiment,

[0063] The target encoding parameters may be the encoding parameters of the cloud server when the iteration is completed; or

[0064] The target encoding parameters can be determined based on the encoding parameters of the cloud server when the iteration is completed.

[0065] Based on the above device embodiment, the process of determining the target encoding parameter may include:

[0066] S20, determining encoding parameters, encoding the first video using the encoding parameters to obtain a third video, and sending the third video to a target terminal, so that the target terminal decodes the third video to obtain a second decoded video, wherein the encoding parameters at the first iteration are obtained by adjusting the encoding parameters of the cloud server, and the adjustment process includes increasing the value of at least one of the resolution, the frame rate, and the bit rate. If the adjustment process includes increasing the resolution, the increased resolution is not higher than the display resolution of the target terminal, if the adjustment process includes increasing the frame rate, the increased frame rate is not higher than the display frame rate of the target terminal, and if the adjustment process includes increasing the bit rate, the increased bit rate is not higher than the bit rate threshold;

[0067] S21. When it is determined that the image quality evaluation index does not meet the first condition and the jamming evaluation index does not meet the second condition, adjusting the encoding parameters, wherein adjusting the encoding parameters includes increasing the value of at least one of the resolution, the frame rate, and the bit rate. If adjusting the encoding parameters includes increasing the resolution, the increased resolution is not higher than the display resolution of the target terminal. If adjusting the encoding parameters includes increasing the frame rate, the increased frame rate is not higher than the display frame rate of the target terminal. If adjusting the encoding parameters includes increasing the bit rate, the increased bit rate is not higher than the bit rate threshold.

[0068] Repeat steps S20 and S21 until the image quality evaluation index satisfies the first condition or the jamming evaluation index satisfies the second condition, or the encoding parameter reaches the upper limit of adjustment;

[0069] The encoding parameters before the last iteration adjustment are determined as the target encoding parameters, or the encoding parameters when the adjustment upper limit is reached are determined as the target encoding parameters.

[0070] Based on the above device embodiment,

[0071] If the larger the image quality evaluation index is, the better the image quality is, then the first condition may be that the image quality evaluation index is less than the first value;

[0072] If the larger the jamming evaluation index is, the more serious the jamming situation is, then the second condition may be that the jamming evaluation index is greater than the second value.

[0073] Based on the aforementioned device embodiment, the cloud server belongs to a target Internet data center IDC computer room, the target IDC computer room is one of multiple IDC computer rooms of the cloud service provider, and the round-trip delay between the cloud server and the target terminal is less than the round-trip delay between the cloud server and the target terminal in other IDC computer rooms among the multiple IDC computer rooms of the cloud service provider except the target IDC computer room.

[0074] The picture processing device provided in the embodiment of the present application has an implementation process that is consistent with the picture processing method provided in the embodiment of the present application, and the effect that can be achieved is also the same as the picture processing method provided in the embodiment of the present application, which will not be repeated here.

[0075] like Figure 3 As shown, an electronic device provided by an embodiment of the present application includes: a processor 30, a memory 31 and a bus 32, wherein the memory 31 stores machine-readable instructions executable by the processor 30, and when the electronic device is running, the processor 30 communicates with the memory 31 through the bus 32, and the processor 30 executes the machine-readable instructions to perform the steps of the above-mentioned image processing method.

[0076] Specifically, the memory 31 and the processor 30 can be general-purpose memories and processors, which are not specifically limited here. When the processor 30 runs the computer program stored in the memory 31, the image processing method can be executed.

[0077] Corresponding to the above-mentioned picture processing method, an embodiment of the present application further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the above-mentioned picture processing method are executed.

[0078] The above are only specific implementations of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A picture processing method, characterized in that: Applied to cloud servers, including: S10, determining encoding parameters, encoding the first video using the encoding parameters to obtain a second video, and sending the second video to a target terminal, so that the target terminal decodes the second video to obtain a first decoded video; S11. When it is determined that the image quality evaluation index satisfies the first condition or the jamming evaluation index satisfies the second condition, adjusting the encoding parameters, wherein the image quality evaluation index is used to evaluate the image quality of the first decoded video, and the jamming evaluation index is used to evaluate the jamming situation when the target terminal renders and displays the first decoded video, and adjusting the encoding parameters includes reducing the value of at least one of the resolution, the frame rate, and the bit rate; Repeat steps S10 and S11 until the image quality evaluation index does not meet the first condition and the jamming evaluation index does not meet the second condition; S12. Determine target encoding parameters, and when providing cloud services to a target terminal, use the target encoding parameters to encode a cloud application screen or a desktop screen rendered by the system to obtain an encoded screen, and send the encoded screen to the target terminal.

2. The method according to claim 1, characterized in that The target encoding parameters are the encoding parameters of the cloud server when the iteration is completed; or The target encoding parameters are determined according to the encoding parameters of the cloud server when the iteration is completed.

3. The method according to claim 2, characterized in that The process of determining the target encoding parameters includes: S20, determining encoding parameters, encoding the first video using the encoding parameters to obtain a third video, and sending the third video to a target terminal, so that the target terminal decodes the third video to obtain a second decoded video, wherein the encoding parameters at the first iteration are obtained by adjusting the encoding parameters of the cloud server, and the adjustment process includes increasing the value of at least one of the resolution, the frame rate, and the bit rate. If the adjustment process includes increasing the resolution, the increased resolution is not higher than the display resolution of the target terminal, if the adjustment process includes increasing the frame rate, the increased frame rate is not higher than the display frame rate of the target terminal, and if the adjustment process includes increasing the bit rate, the increased bit rate is not higher than the bit rate threshold; S21. When it is determined that the image quality evaluation index does not meet the first condition and the jamming evaluation index does not meet the second condition, adjusting the encoding parameters, wherein adjusting the encoding parameters includes increasing the value of at least one of the resolution, the frame rate, and the bit rate. If adjusting the encoding parameters includes increasing the resolution, the increased resolution is not higher than the display resolution of the target terminal. If adjusting the encoding parameters includes increasing the frame rate, the increased frame rate is not higher than the display frame rate of the target terminal. If adjusting the encoding parameters includes increasing the bit rate, the increased bit rate is not higher than the bit rate threshold. Repeat steps S20 and S21 until the image quality evaluation index satisfies the first condition or the jamming evaluation index satisfies the second condition, or the encoding parameter reaches the upper limit of adjustment; The encoding parameters before the last iteration adjustment are determined as the target encoding parameters, or the encoding parameters when the adjustment upper limit is reached are determined as the target encoding parameters.

4. The method according to any one of claims 1 to 3, characterized in that If the larger the image quality evaluation index is, the better the image quality is, then the first condition is that the image quality evaluation index is less than the first value; If the larger the jamming evaluation index is, the more serious the jamming situation is, then the second condition is that the jamming evaluation index is greater than the second value.

5. The method according to claim 1, characterized in that The cloud server belongs to a target Internet data center IDC computer room, the target IDC computer room is one of multiple IDC computer rooms of the cloud service provider, and the round-trip delay between the cloud server and the target terminal is less than the round-trip delay between the cloud server and the target terminal in other IDC computer rooms among the multiple IDC computer rooms of the cloud service provider except the target IDC computer room.

6. A picture processing device, characterized in that: Applied to cloud servers, including: The processing unit is used to perform the following steps: S10, determining encoding parameters, encoding the first video using the encoding parameters to obtain a second video, and sending the second video to a target terminal, so that the target terminal decodes the second video to obtain a first decoded video; S11. When it is determined that the image quality evaluation index satisfies the first condition or the jamming evaluation index satisfies the second condition, adjusting the encoding parameters, wherein the image quality evaluation index is used to evaluate the image quality of the first decoded video, and the jamming evaluation index is used to evaluate the jamming situation when the target terminal renders and displays the first decoded video, and adjusting the encoding parameters includes reducing the value of at least one of the resolution, the frame rate, and the bit rate; Repeat steps S10 and S11 until the image quality evaluation index does not meet the first condition and the jamming evaluation index does not meet the second condition; S12. Determine target encoding parameters, and when providing cloud services to a target terminal, use the target encoding parameters to encode a cloud application screen or a desktop screen rendered by the system to obtain an encoded screen, and send the encoded screen to the target terminal.

7. The device according to claim 6, characterized in that The target encoding parameters are the encoding parameters of the cloud server when the iteration is completed; or The target encoding parameters are determined according to the encoding parameters of the cloud server when the iteration is completed.

8. The device according to claim 7, characterized in that The process of determining the target encoding parameters includes: S20, determining encoding parameters, encoding the first video using the encoding parameters to obtain a third video, and sending the third video to a target terminal, so that the target terminal decodes the third video to obtain a second decoded video, wherein the encoding parameters at the first iteration are obtained by adjusting the encoding parameters of the cloud server, and the adjustment process includes increasing the value of at least one of the resolution, the frame rate, and the bit rate. If the adjustment process includes increasing the resolution, the increased resolution is not higher than the display resolution of the target terminal, if the adjustment process includes increasing the frame rate, the increased frame rate is not higher than the display frame rate of the target terminal, and if the adjustment process includes increasing the bit rate, the increased bit rate is not higher than the bit rate threshold; S21. When it is determined that the image quality evaluation index does not meet the first condition and the jamming evaluation index does not meet the second condition, adjusting the encoding parameters, wherein adjusting the encoding parameters includes increasing the value of at least one of the resolution, the frame rate, and the bit rate. If adjusting the encoding parameters includes increasing the resolution, the increased resolution is not higher than the display resolution of the target terminal. If adjusting the encoding parameters includes increasing the frame rate, the increased frame rate is not higher than the display frame rate of the target terminal. If adjusting the encoding parameters includes increasing the bit rate, the increased bit rate is not higher than the bit rate threshold. Repeat steps S20 and S21 until the image quality evaluation index satisfies the first condition or the jamming evaluation index satisfies the second condition, or the encoding parameter reaches the upper limit of adjustment; The encoding parameters before the last iteration adjustment are determined as the target encoding parameters, or the encoding parameters when the adjustment upper limit is reached are determined as the target encoding parameters.

9. The device according to any one of claims 6 to 8, characterized in that If the larger the image quality evaluation index is, the better the image quality is, then the first condition is that the image quality evaluation index is less than the first value; If the larger the jamming evaluation index is, the more serious the jamming situation is, then the second condition is that the jamming evaluation index is greater than the second value.

10. The device according to claim 6, characterized in that The cloud server belongs to a target Internet data center IDC computer room, the target IDC computer room is one of multiple IDC computer rooms of the cloud service provider, and the round-trip delay between the cloud server and the target terminal is less than the round-trip delay between the cloud server and the target terminal in other IDC computer rooms among the multiple IDC computer rooms of the cloud service provider except the target IDC computer room.

Citation Information

Patent Citations

  • Method for controlling balanced code rate and picture quality code rate

    CN101202912A

  • Method for dynamically adjusting definition mode in video call, and server

    CN108881780A