Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method, device, equipment and storage medium for determining an encoding mode

A technology of encoding mode and determination method, applied in the field of video encoding, can solve the problems of loss of encoding quality, computational burden, and high accuracy requirements, and achieve the effect of improving video encoding rate, reducing computational overhead, and ensuring adaptability

Active Publication Date: 2022-04-12
BIGO TECH PTE LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Each CU usually includes two parts, the Transform Unit (TU) and the Prediction Unit (PU). The TU mainly performs the basic rate-distortion optimization (RDO) in consideration of the impact of the video coding bit rate and distortion. ) process, the PU mainly tries to calculate the encoding cost under the RDO process after the CU is recursively divided into TUs in different prediction modes; 2NxN / Nx2N / 2NxnD / 2NxnU / nRx2N / nLx2N / Intra2Nx2N / IntraNxN12 types), the prediction data during the TU execution process is obtained, and then the calculated residual data is transformed, quantized and entropy encoded to obtain the current prediction mode Encoding bit rate, at the same time, dequantize and inverse transform the quantized residual data to obtain the corresponding reconstructed data, and then compare it with the original residual data to obtain the corresponding encoding distortion, and then according to the encoding bit rate and encoding distortion Calculate the encoding cost in this prediction mode, and then calculate the encoding cost of the current non-recursive CU at each recursion depth and the sum of the encoding costs of the 4 small CUs divided by the current CU after recursion, so as to judge the current CU Whether recursive division is required; at this time, each recursive situation from a 64*64 size CU to an 8*8 size CU needs to calculate the corresponding encoding cost one by one based on the TUs divided under the CU, resulting in a large amount of calculation burden. Increased resource overhead for video encoding
[0004] Therefore, in order to reduce the calculation overhead of TU when CU is recursively divided, there are usually the following two methods: 1) Use the coefficients in the quantization domain to predict the coding distortion, and establish a code rate model to predict the coding code rate, so that there is no need for residual Data dequantization and inverse transformation process, but the accuracy of encoding distortion and encoding rate estimation is high, once the estimation is inaccurate, it will cause increased video encoding loss; 2) According to the existing encoding information or calculation Analyze the video texture under each TU to determine whether recursive division is required. This will increase the amount of additional calculations. At the same time, the method of uniformly calculating the encoding cost will lose the encoding quality under different components.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method, device, equipment and storage medium for determining an encoding mode
  • Method, device, equipment and storage medium for determining an encoding mode
  • Method, device, equipment and storage medium for determining an encoding mode

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0027] Figure 1A It is a flow chart of a method for determining an encoding mode provided in Embodiment 1 of the present invention. This embodiment is applicable to scenarios where there is an encoding requirement for any video. The method for determining the encoding mode provided in this embodiment can be performed by the device for determining the encoding mode provided in the embodiment of the present invention, which can be implemented in the form of software and / or hardware, and integrated into the device that executes the method. The device may be a background server participating in video data interaction.

[0028] Specifically, refer to Figure 1A , the method may include the following steps:

[0029] S110. Divide the coding unit under each coding standard into transformation units under the next coding standard adjacent to the coding standard, and calculate the coding cost of each transformation unit.

[0030] Specifically, video coding is usually encoded with the ...

Embodiment 2

[0040] Figure 2A It is a flow chart of a method for determining a coding mode provided in Embodiment 2 of the present invention, Figure 2B It is a schematic diagram of the principle of cost-optimized integration of coding units and transformation units under the same coding standard in the method provided by Embodiment 2 of the present invention. This embodiment is optimized on the basis of the foregoing embodiments. Specifically, such as Figure 2A As shown, this embodiment explains in detail the specific process of cost-optimized integration of coding units and transformation units under the same coding standard.

[0041] optional, such as Figure 2A As shown, the following steps may be included in this embodiment:

[0042] S210. Divide the coding unit under each coding standard into transformation units under the next coding standard adjacent to the coding standard, and calculate the coding cost of each transformation unit.

[0043] S220. Use the division result of t...

Embodiment 3

[0059] image 3 A schematic structural diagram of a device for determining a coding mode provided in Embodiment 3 of the present invention, specifically, as image 3 As shown, the device may include:

[0060] A coding division module 310, configured to divide the coding unit under each coding standard into transformation units under the next coding standard adjacent to the coding standard, and calculate the coding cost of each transformation unit;

[0061] The coding mode optimization module 320 is configured to sequentially perform cost-optimized integration of coding units and transformation units under the same coding specification to obtain an overall coding mode under the optimal coding cost.

[0062] In the technical solution provided by this embodiment, first, the coding unit under each coding standard is divided into the transformation unit under the next coding standard adjacent to the coding standard, and the coding cost of each partitioned transformation unit is ca...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the present invention discloses a method, device, device, and storage medium for determining a coding mode, wherein the method includes: dividing a coding unit under each coding standard into a coding unit under the next coding standard adjacent to the coding standard transformation unit, and calculate the coding cost of each transformation unit; sequentially perform cost optimization integration on the coding unit and transformation unit under the same coding specification, and obtain the overall coding mode under the optimal coding cost. The technical solution provided by the embodiment of the present invention enables the encoding cost to be minimized when the overall encoding mode is used for video encoding, ensures the adaptability of the video encoding mode adopted under different videos, reduces the computational overhead of video encoding, and further improves Video encoding rate.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of video coding, and in particular, to a method, device, device and storage medium for determining a coding mode. Background technique [0002] At present, video coding is usually coded with the coding unit (Coding Unit, CU) as the basic unit. At this time, the coding unit CU has four sizes: 64*64, 32*32, 16*16, and 8*8. All of them need to recursively try the quadtree from the 64*64 size CU to the 8*8 size CU in order to select the coding size with the best efficiency. At this time, the recursion depth of the 64*64 size CU is 0 , adding 1 to the depth of each downward recursion, and the recursion depth of the 8*8 size CU is 3. At the same time, at each recursion depth, the encoding cost of the current non-recursive CU and the current CU are divided after recursion Compare the sum of the coding costs of the 4 small CUs to determine whether recursive partitioning is required at this...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04N19/103H04N19/146H04N19/157
CPCH04N19/103H04N19/146H04N19/157
Inventor 崔同兵
Owner BIGO TECH PTE LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products