Code division method, system and equipment of video coding unit, and storage medium

Abstract

The embodiment of the invention discloses a coding division method, system and equipment of a video coding unit, and a storage medium. According to the technical scheme provided by the embodiment of the invention, the current video coding unit is divided into two sub-coding units according to a specified direction under the condition that the coding division judgment of the current video coding unit is determined to be executed based on the pixel texture complexity comparison result and the pixel texture difference information; and determining a pixel gradient difference between the two sub-coding units in different directions, performing binary tree division and ternary tree division decisions of the current video coding unit in a specified direction based on the pixel gradient difference, and performing coding division of the current video coding unit according to a division decision result. By adopting the technical means, the calculation complexity of video image coding division can be reduced, and the video coding efficiency is further improved.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of video coding, and in particular, to a coding division method, system, device, and storage medium for a video coding unit. Background Art

[0002] Currently, in video coding scenarios, most video coding standards are formulated based on a hybrid coding framework. Under this framework, each frame in a video is first divided into maximum coding units of a fixed size and may be further divided into coding units of variable sizes. Each coding unit first uses inter-frame or intra-frame prediction techniques to obtain a predicted image. Among them, the difference between the predicted image and the original image is called the residual. During the coding process, the video image is transformed and quantized and then sent to an entropy encoder for coding. Subsequently, during the video image decoding process, through inverse quantization and inverse transformation, plus the predicted image for reconstruction, and finally through loop filtering to obtain the reconstructed image. The reconstructed image will enter the coded (reconstructed) image buffer in the encoder and serve as a reference image for inter-frame prediction of subsequent coded frames. In the new generation of encoder standards VVC, AV1, and AVS3, the coding division not only retains the non-division and quadtree recursive division methods in the previous generation of encoder standards but also supports binary tree and ternary tree division methods. The division methods of binary tree and ternary tree are collectively referred to as multi-type trees, which include a total of four types of divisions: vertical binary tree, horizontal binary tree, vertical ternary tree, and horizontal ternary tree.

[0003] In the related art, when performing coding division, the encoder determines the division method and whether to divide the current video coding unit based on the rate-distortion cost. First, the maximum coding unit is set as the root node and a division decision is made for it. Subsequently, the coding unit is divided into four sub-units in a quadtree manner, and these sub-units will recursively perform mode decision and division decision, and then return to the coding unit state. Then, the binary tree and ternary tree division decisions are executed in the same way. Finally, the division structure with the minimum rate-distortion cost is selected as the final division result of the coding unit. Thus, through a more refined coding unit division structure, the coding gain of video images is improved. However, a more refined coding unit division structure requires more division type decisions, and each division type decision requires complex rate-distortion cost calculations, which will increase the computational complexity of the video encoder, thereby reducing the coding speed and affecting the video coding efficiency. Summary of the Invention

[0004] The embodiments of the present application provide a coding division method, system, device, and storage medium for a video coding unit, which can reduce the computational complexity of video image coding division, improve the division efficiency of coding units, and solve the technical problem of high computational complexity of video image coding division.

[0005] In a first aspect, an embodiment of the present application provides a method for coding division of a video coding unit, including:

[0006] Determine the comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs, and determine the pixel texture difference information of the current video coding unit in different directions;

[0007] In the case of determining to perform the coding division judgment of the current video coding unit based on the comparison result of the pixel texture complexity and the pixel texture difference information, divide the current video coding unit into two sub-coding units in a specified direction, where the specified direction includes the vertical direction and the horizontal direction;

[0008] Determine the pixel gradient difference between the two sub-coding units in different directions, make a binary tree division and a ternary tree division decision of the current video coding unit in the specified direction based on the pixel gradient difference, and perform the coding division of the current video coding unit according to the division decision result.

[0009] In a second aspect, an embodiment of the present application provides a coding division system for a video coding unit, including:

[0010] A judgment module configured to determine the comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs, and determine the pixel texture difference information of the current video coding unit in different directions;

[0011] A division module configured to divide the current video coding unit into two sub-coding units in a specified direction in the case of determining to perform the coding division judgment of the current video coding unit based on the comparison result of the pixel texture complexity and the pixel texture difference information, where the specified direction includes the vertical direction and the horizontal direction;

[0012] A decision module configured to determine the pixel gradient difference between the two sub-coding units in different directions, make a binary tree division and a ternary tree division decision of the current video coding unit in the specified direction based on the pixel gradient difference, and perform the coding division of the current video coding unit according to the division decision result.

[0013] In a third aspect, an embodiment of the present application provides a coding division device for a video coding unit, including:

[0014] A memory and one or more processors;

[0015] The memory is configured to store one or more programs;

[0016] When the one or more programs are executed by the one or more processors, the one or more processors implement the method for coding division of the video coding unit as described in the first aspect.

[0017] In a fourth aspect, an embodiment of the present application provides a non-volatile computer-readable storage medium storing computer-executable instructions that, when executed by a computer processor, are configured to perform the encoding division method of the video encoding unit as described in the first aspect.

[0018] In a fifth aspect, an embodiment of the present application provides a computer program product containing instructions that, when running on a computer or a processor, cause the computer or the processor to perform the encoding division method of the video encoding unit as described in the first aspect.

[0019] In the embodiment of the present application, by determining the comparison result of the pixel texture complexity between the current video encoding unit and the largest encoding unit to which it belongs, the pixel texture difference information in different directions of the current video encoding unit is determined; in the case of determining to perform the encoding division judgment of the current video encoding unit based on the comparison result of the pixel texture complexity and the pixel texture difference information, the current video encoding unit is divided into two sub-encoding units in a specified direction, and the specified direction includes the vertical direction and the horizontal direction; the pixel gradient difference between the two sub-encoding units in different directions is determined, and based on the pixel gradient difference, the binary tree division and the ternary tree division decisions of the current video encoding unit in the specified direction are made, and the encoding division of the current video encoding unit is performed according to the division decision result. By adopting the above technical means, the division decision of the encoding unit is made through the comparison result of the pixel texture complexity and the pixel texture difference information, and in the case of determining to perform the encoding division, the binary tree division and the ternary tree division decisions of the current video encoding unit in the specified direction are made based on the pixel gradient difference, so that the rate-distortion cost calculation process of the corresponding division type decision can be reduced, the calculation time consumption of the corresponding division type decision process can be reduced, the calculation complexity of the video image encoding division can be reduced, the division efficiency of the encoding unit can be improved, and further the video encoding efficiency can be improved. Description of the Drawings

[0020] Figure 1 is a schematic diagram of the encoding division of the encoding unit provided by the embodiment of the present application;

[0021] Figure 2 is a flowchart of the encoding division method of a video encoding unit provided by the embodiment of the present application;

[0022] Figure 3 is a flowchart of determining the comparison result of the pixel texture complexity in the embodiment of the present application;

[0023] Figure 4 is a flowchart of selecting the encoding division scheme in the embodiment of the present application;

[0024] Figure 5It is the flowchart of the coding partition decision of the coding unit in the embodiment of the present application;

[0025] Figure 6 It is the schematic structural diagram of a coding partition system for a video coding unit provided by the embodiment of the present application;

[0026] Figure 7 It is the schematic structural diagram of a coding partition device for a video coding unit provided by the embodiment of the present application. Detailed implementation manners

[0027] In order to make the objectives, technical solutions and advantages of the present application clearer, the following further describes the specific embodiments of the present application in detail with reference to the accompanying drawings. It can be understood that the specific embodiments described herein are only used to explain the present application, rather than limiting the present application. Additionally, it should be noted that for the sake of convenience of description, only parts related to the present application are shown in the drawings rather than all the content. Before discussing the exemplary embodiments in more detail, it should be mentioned that some exemplary embodiments are described as processes or methods depicted as flowcharts. Although the flowcharts describe the operations (or steps) as sequential processes, many of the operations can be implemented in parallel, concurrently or simultaneously. In addition, the order of the operations can be rearranged. When the operations are completed, the process can be terminated, but there may also be additional steps not included in the drawings. The process can correspond to a method, function, procedure, subroutine, subprogram, etc.

[0028] The coding partition method for the video coding unit provided by the present application aims to make a coding unit partition decision through the comparison result of pixel texture complexity and pixel texture difference information, and when it is determined to perform coding partition, based on the pixel gradient difference, make a binary tree partition and a ternary tree partition decision for the current video coding unit in the specified direction, so as to reduce the rate-distortion cost calculation process for the corresponding partition type decision, reduce the calculation time consumption of the corresponding partition type decision process, and reduce the calculation complexity of video image coding partition.

[0029] Current video coding standards are all formulated based on the hybrid coding framework. Under this framework, each frame in the video is first divided into maximum coding units of a fixed size and may be further divided into coding units of variable sizes. Each coding unit first uses inter-frame or intra-frame prediction techniques to obtain a predicted image. Among them, the difference between the predicted image and the original image is called the residual. The video image will be transformed and quantized and then sent to the entropy encoder for coding. Through inverse quantization and inverse transformation, plus the predicted image for reconstruction, and finally through loop filtering to obtain the reconstructed image. The reconstructed image will enter the coding (reconstructed) image buffer in the encoder as a reference image for inter-frame prediction of subsequent coding frames.

[0030] In the new-generation encoder standards VVC, AV1, and AVS3, the coding partitions not only retain the non-partition and quadtree recursive partitioning methods in the previous-generation encoder standards but also support binary tree and ternary tree partitions. The partitioning methods of binary tree and ternary tree partitions are collectively referred to as multi-type trees, which include a total of four types of partitions: vertical binary tree, horizontal binary tree, vertical ternary tree, and horizontal ternary tree.

[0031] Among them, referring to Figure 1 , for the four units A, B, C, and D partitioned from a coding unit, the A coding unit divides itself into four sub-units in the quadtree manner, the B coding unit adopts the non-partition method, the C coding unit divides itself into two sub-units in the vertical binary tree partition manner, and the D coding unit divides itself into three sub-units in the horizontal ternary tree manner.

[0032] For a video image frame, when performing coding partitions, the encoder determines the partitioning method and whether to perform partitioning of the current video coding unit based on the rate-distortion cost. First, the largest coding unit is set as the root node, and a partitioning decision is made for it. Subsequently, the coding unit is divided into four sub-units in the quadtree manner, and these sub-units will recursively perform mode decisions and partitioning decisions. After completion, it returns to the coding unit state. Then, the binary tree and ternary tree partitioning decisions are performed in the same way. Finally, the partitioning structure with the minimum rate-distortion cost is selected as the final partitioning result of the coding unit. Moreover, in order to adapt to the pipeline design of the hardware decoder and ensure the coding efficiency, the encoder has restricted the partitioning method. For example, during the coding partition process, the coding unit can select any partitioning tree, but once a multi-type tree is selected, subsequent nodes must select a multi-type tree, and the maximum depth of the multi-type tree is restricted.

[0033] Although the new-generation encoder standards bring better coding benefits by adding new partitioning structures, more partitioning type decisions are required, which will increase the computational complexity of the video encoder, reduce the coding speed, affect the video coding efficiency, and need to be improved.

[0034] Based on this, an encoding partition method for a video coding unit according to an embodiment of the present application is provided to solve the technical problem of the relatively high computational complexity of video image encoding partitions. Among them, by analyzing the texture information of the coding unit and referring to the variance and gradient information to determine whether to perform a skip decision on the corresponding partitioning type of the current video coding unit, the time-consuming process of calculating the rate-distortion cost to decide the partitioning type is avoided, the computational complexity of the video encoder is reduced, the coding speed is increased, and thus the video coding efficiency is improved.

[0035] Embodiment:

[0036] Figure 2The flowchart of a coding partition method for a video coding unit provided in an embodiment of the present application is given. The coding partition method for the video coding unit provided in this embodiment can be executed by a coding partition device of the video coding unit. The coding partition device of the video coding unit can be implemented in software and / or hardware. The coding partition device of the video coding unit can be composed of two or more physical entities, or can be composed of one physical entity. Generally speaking, the coding partition device of the video coding unit can be a computing device of a video encoder.

[0037] The following takes the coding partition device of the video coding unit as the main body for executing the coding partition method of the video coding unit as an example for description. Refer to Figure 2 , the coding partition method of the video coding unit specifically includes:

[0038] S110. Determine the comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs, and determine the pixel texture difference information of the current video coding unit in different directions.

[0039] When performing coding partition of the video coding unit in the present application, for the coding partition types that a coding unit may select (i.e., no partition, quadtree recursive partition, binary tree, and ternary tree partition, etc.), by analyzing whether the corresponding coding partition type can be skipped to reduce unnecessary calculations. Wherein, the coding unit currently performing coding partition is defined as the current video coding unit (CU).

[0040] By comparing the pixel texture complexity between the current video coding unit (CU) and the largest coding unit (LCU) to which it belongs, the comparison result of the pixel texture complexity is obtained to evaluate the change in the texture complexity of the current video coding unit relative to the largest coding unit to which it belongs. Among them, the comparison result of the pixel texture complexity can be obtained by calculating the texture features (such as pixel variance, pixel gradient, etc.) of the two and comparing them.

[0041] On the other hand, by determining the pixel texture difference information of the current video coding unit in different directions (such as vertical, horizontal directions, etc.), it is evaluated whether there is significant texture directionality in the current video coding unit. Among them, the pixel texture difference information can be realized by calculating the pixel value change rate or pixel gradient of the current video coding unit in these directions.

[0042] It can be understood that if the change in the texture complexity of the current video coding unit relative to the largest coding unit to which it belongs is small, there is no need to perform coding partition of the current video coding unit. Similarly, if the texture directionality of the current video coding unit is not significant, there is no need to perform coding partition of the current video coding unit.

[0043] It should be noted that this application does not impose fixed restrictions on the specific comparison results of pixel texture complexity and pixel texture difference information, which will not be elaborated here.

[0044] Optionally, referring to Figure 3 , determine the comparison result of the pixel texture complexity between the current video coding unit and the maximum coding unit to which it belongs, including:

[0045] S1101. Determine the first pixel texture complexity information of the current video coding unit, and determine the second pixel texture complexity information of the maximum coding unit to which the current video coding unit belongs;

[0046] S1102. Based on the first pixel texture complexity information and the second pixel texture complexity information, generate the comparison result of the pixel texture complexity between the current video coding unit and the maximum coding unit to which it belongs.

[0047] By determining a method for measuring pixel texture complexity. This method can be a gradient-based method, a statistics-based method (such as variance, standard deviation), a frequency-domain-based method (such as Fourier transform), or a machine learning-based method, etc. Then apply the selected method to analyze the pixel data of the current video coding unit, calculate its texture complexity, and define it as the first pixel texture complexity information. Such as calculating the gradient of pixel values, analyzing statistical characteristics, or extracting features within the current video coding unit.

[0048] Similarly, since the maximum coding unit to which the current video coding unit belongs is the parent or higher-level coding unit of the current video coding unit, it is necessary to obtain the complete pixel data of the maximum coding unit. Use the same method as calculating the texture complexity of the current video coding unit to analyze the pixel data of the maximum coding unit, calculate its texture complexity, and define it as the second pixel texture complexity information. Finally, by comparing the first pixel texture complexity information and the second pixel texture complexity information, such as calculating the ratio of the two or comparing the difference between the two, the comparison result of the pixel texture complexity between the current video coding unit and the maximum coding unit to which it belongs is obtained.

[0049] Through the above steps, the comparison result of the pixel texture complexity between the current video coding unit and the maximum coding unit to which it belongs can be systematically determined. Thus, the texture characteristic differences between different coding units can be obtained, providing accurate basic information for decision-making in the video coding process.

[0050] Optionally, determining the first pixel texture complexity information of the current video coding unit and determining the second pixel texture complexity information of the maximum coding unit to which the current video coding unit belongs includes:

[0051] Determine the variance of pixel values of the current video coding unit as the first pixel texture complexity information, and determine the variance of pixel values of the largest coding unit to which the current video coding unit belongs as the second pixel texture complexity information;

[0052] Based on the first pixel texture complexity information and the second pixel texture complexity information, generate a comparison result of pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs, including:

[0053] Compare the first pixel texture complexity information after being magnified by a set multiple with the second pixel texture complexity information to generate a comparison result of pixel texture complexity, and the set multiple is determined according to the sizes of the current video coding unit and the largest coding unit.

[0054] By comparing the variances of pixel values of the current video coding unit and the largest coding unit, determine whether to perform coding division on the current video coding unit. If the first pixel texture complexity information is still less than the second pixel texture complexity information of the largest coding unit area after being magnified by the set multiple, it indicates that the texture complexity of this current video coding unit is relatively low and there is no need for further division, so the coding division of the current video coding unit can be directly skipped. Among them, the calculation formula for the pixel value variance d is expressed as:

[0055]

[0056] Among them, I(x,y) represents the pixel value of the image at the coordinate (x,y), M and N respectively represent the length and width of the corresponding coding unit (the current video coding unit or the largest coding unit), and avg represents the average value of the pixel values of the corresponding coding unit. The calculation formula for avg is expressed as:

[0057]

[0058] In addition, the value of the above-mentioned set multiple α is related to the sizes of the current coding region and the largest coding unit, and can be set as:

[0059]

[0060] Among them, I(x,y) represents the pixel value of the image at the coordinate (x,y), M L and N L respectively represent the length and width of the largest coding unit, M C and N C respectively represent the length and width of the current video coding unit. According to actual requirements, the above-mentioned set multiple can be adaptively set.

[0061] On the other hand, determine the pixel texture difference information of the current video coding unit in different directions, including:

[0062] Determine the pixel gradient variances of the current video coding unit in the vertical, horizontal, 45-degree upward diagonal, and 45-degree downward diagonal directions. Compare the pixel gradient variances with the set variance threshold to obtain the pixel texture difference information of the current video coding unit in different directions.

[0063] By determining the pixel gradient variances of the current video coding unit in four directions, if the variance is less than the set variance threshold, skip the coding division of the current video coding unit. Among them, by calculating the pixel gradient values of the current video coding unit in four directions (vertical, horizontal, downward diagonal, and upward diagonal) respectively, and then calculating the variance of these four gradient values, if the variance is less than the set variance threshold, it indicates that the texture differences of the current video coding unit in different directions are not significant and no further division is required. Therefore, the coding division of the current video coding unit can be directly skipped.

[0064] Among them, the calculation formulas for the pixel gradient values of the current video coding unit in four directions (vertical, horizontal, downward diagonal, and upward diagonal) are as follows:

[0065] Horizontal direction gradient:

[0066]

[0067] Vertical direction gradient:

[0068]

[0069] Downward diagonal direction gradient:

[0070]

[0071] Upward diagonal direction gradient:

[0072]

[0073] Among them, I(x, y) represents the pixel value of the image at the coordinate (x, y). The above formulas give the most basic gradient calculation method, and different gradient operators can be selected for adjustment and optimization according to specific requirements in actual applications.

[0074] The variance d of the pixel gradient G The calculation formula is as follows:

[0075] avg G =(G x +G y +G dow +G dup ) / 4

[0076]

[0077] Optionally, after determining the pixel texture difference information of the current video coding unit in different directions, it further includes:

[0078] When the first pixel texture complexity information of the set multiple is greater than or equal to the second pixel texture complexity information, and the pixel gradient variances are all greater than or equal to the set variance threshold, determine to perform the coding partition judgment of the current video coding unit;

[0079] When the first pixel texture complexity information of the set multiple is less than the second pixel texture complexity information, and / or the pixel gradient variances are all less than the set variance threshold, skip the coding partition of the current video coding unit.

[0080] Based on the determined first pixel texture complexity information, second pixel texture complexity information, and pixel gradient variances, if the conditions are met, that is, the first pixel texture complexity information of the set multiple is greater than or equal to the second pixel texture complexity information, and the pixel gradient variances are all greater than or equal to the set variance threshold, then determine to perform the coding partition judgment of the current video coding unit, and further select the binary tree, ternary tree, and quadtree partition types. If the conditions are not met, that is, the first pixel texture complexity information of the set multiple is less than the second pixel texture complexity information, and / or the pixel gradient variances are all less than the set variance threshold, then skip the coding partition of the current video coding unit to save computing resources and improve coding efficiency.

[0081] S120. When it is determined to perform the coding partition judgment of the current video coding unit based on the pixel texture complexity comparison result and the pixel texture difference information, divide the current video coding unit into two sub-coding units in the specified direction, and the specified direction includes the vertical direction and the horizontal direction.

[0082] Furthermore, when it is determined to perform the coding partition judgment of the current video coding unit based on the pixel texture complexity comparison result and the pixel texture difference information, it indicates that the current video coding unit needs to further select the binary tree, ternary tree, and quadtree partition types. At this time, further determine whether the current video coding unit can skip the coding partition decision process for the binary tree / ternary tree partition type.

[0083] By dividing the current video coding unit vertically or horizontally into two parts to compare the two sub-coding units, and then judging whether to adjust the coding division decision process of the binary tree / trinary tree division type in the corresponding direction according to the comparison result. It can be understood that if the texture difference between the two sub-coding units is small, there is no need to perform the coding division decision process of the binary tree / trinary tree division type in the corresponding direction to reduce the computational complexity. Based on this, the present application divides into two sub-coding units in the vertical and horizontal directions to judge whether to skip the coding division decision process of the binary tree / trinary tree division type of the current video coding unit in the corresponding direction.

[0084] S130. Determine the pixel gradient difference between the two sub-coding units in different directions, make the binary tree division and trinary tree division decisions of the current video coding unit in the specified direction based on the pixel gradient difference, and perform the coding division of the current video coding unit according to the division decision result.

[0085] For the two sub-coding units of the current video coding unit, by calculating the pixel gradients of the coding unit in different directions (such as horizontal, vertical, diagonal, etc.) respectively, obtain the pixel gradient difference between the two sub-coding units in the corresponding direction (such as horizontal, vertical, diagonal, etc.) according to the pixel gradients. If the pixel gradient difference is small, it means that the texture difference between the two sub-coding units in the corresponding direction is small, and there is no need to perform the coding division decision process of the binary tree / trinary tree division type in the corresponding direction. Among them, the pixel gradient difference can be the difference or ratio of the pixel gradients, etc.

[0086] Optionally, determining the pixel gradient difference between the two sub-coding units in different directions includes:

[0087] Determine the pixel gradient ratio between the two sub-coding units in the vertical, horizontal, 45-degree angle upward and 45-degree angle downward directions, and use the pixel gradient ratio as the pixel gradient difference between the two sub-coding units in different directions. The pixel gradient ratio is the ratio between the larger gradient value and the smaller gradient value of the two sub-coding units in the corresponding direction.

[0088] For the two sub-coding units obtained by horizontal / vertical division of the current video coding unit, calculate the pixel gradient values of the sub-coding units in four directions (vertical, horizontal, downward diagonal, upward diagonal) respectively. The calculation method of the pixel gradient value refers to the pixel gradient calculation method of the above coding unit, except that here it is for the sub-coding unit. Optionally, the calculation of the pixel gradient value can also be divided into smaller blocks for calculation and then summed to improve the calculation efficiency.

[0089] Furthermore, calculate the ratio of the larger pixel gradient value to the smaller pixel gradient value in two sub-units in each direction. By calculating the ratio of the larger pixel gradient value to the smaller pixel gradient value, the pixel gradient difference between the two sub-units can be intuitively reflected. At the same time, the ratio can be normalized to avoid the influence of different value ranges of the ratio on the setting of the threshold.

[0090] Further, referring to Figure 4 , make binary tree partition and ternary tree partition decisions for the current video coding unit in the specified direction based on the pixel gradient difference, including:

[0091] S1301. When all pixel gradient ratios are less than the set gradient threshold, skip the binary tree partition and ternary tree partition processes of the current video coding unit in the specified direction;

[0092] S1302. When there is a pixel gradient ratio reaching the set gradient threshold, select the coding partition scheme of the current video coding unit, and the coding partition scheme includes at least binary tree partition and ternary tree partition.

[0093] If the ratios in all four directions are less than the set gradient threshold, skip the binary tree or ternary tree partition of the corresponding direction of the current video coding unit. Subsequently, the current video coding unit only needs to make a decision based on the rate-distortion cost to select whether to use a quadtree or no partition method for coding partition. If there is a pixel gradient ratio reaching the gradient threshold, it means that the pixel gradient difference between the two sub-units of the current video coding unit in the corresponding direction is large, and it is necessary to further make a decision based on the rate-distortion cost to select binary tree partition, ternary tree partition, quadtree partition or no partition method for coding partition.

[0094] Through the above steps, the binary tree or ternary tree partition decision can be made for the current video coding unit based on the pixel gradient difference, and the actual coding partition can be performed according to the decision result.

[0095] Exemplarily, referring to Figure 5 , when performing the coding partition of the coding unit, judge whether to skip the coding partition of the current video coding unit by comparing the size and pixel value variance of the current video coding unit with the maximum coding unit, and comparing the pixel texture difference information of the current video coding unit in different directions; furthermore, when it is determined to perform the coding partition of the current video coding unit, make a skip decision on the binary tree partition / ternary tree partition scheme of the current video coding unit in the corresponding direction based on the pixel gradient difference between the two sub-coding units of the current video coding unit. Finally, based on the above partition decision result, select to skip the corresponding coding partition type, thereby reducing the process of calculating the rate-distortion cost of the corresponding coding partition type and improving the partition efficiency of the coding unit.

[0096] As described above, by determining the comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs, the pixel texture difference information in different directions of the current video coding unit is determined; when it is determined to perform the coding partition determination of the current video coding unit based on the comparison result of the pixel texture complexity and the pixel texture difference information, the current video coding unit is divided into two sub-coding units in the specified direction, and the specified direction includes the vertical direction and the horizontal direction; the pixel gradient difference between the two sub-coding units in different directions is determined, and based on the pixel gradient difference, the binary tree partition and the ternary tree partition decision of the current video coding unit in the specified direction are made, and the coding partition of the current video coding unit is performed according to the partition decision result. By adopting the above technical means, the partition decision of the coding unit is made through the comparison result of the pixel texture complexity and the pixel texture difference information, and when it is determined to perform the coding partition, the binary tree partition and the ternary tree partition decision of the current video coding unit in the specified direction are made based on the pixel gradient difference, so that the rate-distortion cost calculation process of the corresponding partition type decision can be reduced, the calculation time consumption of the corresponding partition type decision process can be reduced, the calculation complexity of the video image coding partition can be reduced, the partition efficiency of the coding unit can be improved, and further the video coding efficiency can be improved.

[0097] Based on the above embodiments, Figure 6 is a schematic structural diagram of a coding partition system for a video coding unit provided by the present application. Refer to Figure 6 , the coding partition system for the video coding unit provided in this embodiment specifically includes: a judgment module 21, a partition module 22, and a decision module 23.

[0098] Among them, the judgment module 21 is configured to determine the comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs, and determine the pixel texture difference information in different directions of the current video coding unit;

[0099] The partition module 22 is configured to divide the current video coding unit into two sub-coding units in the specified direction when it is determined to perform the coding partition determination of the current video coding unit based on the comparison result of the pixel texture complexity and the pixel texture difference information, and the specified direction includes the vertical direction and the horizontal direction;

[0100] The decision module 23 is configured to determine the pixel gradient difference between the two sub-coding units in different directions, make the binary tree partition and the ternary tree partition decision of the current video coding unit in the specified direction based on the pixel gradient difference, and perform the coding partition of the current video coding unit according to the partition decision result.

[0101] Specifically, determining the comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs includes:

[0102] Determine the first pixel texture complexity information of the current video coding unit, and determine the second pixel texture complexity information of the largest coding unit to which the current video coding unit belongs;

[0103] Based on the first pixel texture complexity information and the second pixel texture complexity information, generate a comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs.

[0104] Among them, determining the first pixel texture complexity information of the current video coding unit and determining the second pixel texture complexity information of the largest coding unit to which the current video coding unit belongs includes:

[0105] Determine the pixel value variance of the current video coding unit as the first pixel texture complexity information, and determine the pixel value variance of the largest coding unit to which the current video coding unit belongs as the second pixel texture complexity information;

[0106] Based on the first pixel texture complexity information and the second pixel texture complexity information, generating a comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs includes:

[0107] Compare the first pixel texture complexity information after being magnified by a set multiple with the second pixel texture complexity information to generate a comparison result of the pixel texture complexity, and the set multiple is determined according to the sizes of the current video coding unit and the largest coding unit.

[0108] Specifically, determining the pixel texture difference information of the current video coding unit in different directions includes:

[0109] Determine the pixel gradient variances of the current video coding unit in the vertical, horizontal, 45-degree upward diagonal, and 45-degree downward diagonal directions, and compare the pixel gradient variances with a set variance threshold to obtain the pixel texture difference information of the current video coding unit in different directions.

[0110] After determining the pixel texture difference information of the current video coding unit in different directions, it further includes:

[0111] In the case where the first pixel texture complexity information after being magnified by the set multiple is greater than or equal to the second pixel texture complexity information, and the pixel gradient variances are all greater than or equal to the set variance threshold, determine to perform the coding partition judgment of the current video coding unit;

[0112] In the case where the first pixel texture complexity information after being magnified by the set multiple is less than the second pixel texture complexity information, and / or the pixel gradient variances are all less than the set variance threshold, skip the coding partition of the current video coding unit.

[0113] Specifically, determining the pixel gradient difference between two sub-coding units in different directions includes:

[0114] Determine the pixel gradient ratio between two sub - coding units in the vertical, horizontal, 45 - degree upward diagonal, and 45 - degree downward diagonal directions. Use the pixel gradient ratio as the pixel gradient difference between two sub - coding units in different directions. The pixel gradient ratio is the ratio between the larger gradient value and the smaller gradient value of the two sub - coding units in the corresponding direction.

[0115] Specifically, based on the pixel gradient difference, make binary - tree partitioning and ternary - tree partitioning decisions for the current video coding unit in the specified direction, including:

[0116] In the case where each pixel gradient ratio is less than the set gradient threshold, skip the binary - tree partitioning and ternary - tree partitioning processes for the current video coding unit in the specified direction;

[0117] In the case where there is a pixel gradient ratio reaching the set gradient threshold, select the coding partitioning scheme for the current video coding unit. The coding partitioning scheme includes at least binary - tree partitioning and ternary - tree partitioning.

[0118] As described above, by determining the comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs, determine the pixel texture difference information of the current video coding unit in different directions; in the case of determining to perform the coding partitioning judgment of the current video coding unit based on the comparison result of the pixel texture complexity and the pixel texture difference information, divide the current video coding unit into two sub - coding units in the specified direction. The specified directions include the vertical direction and the horizontal direction; determine the pixel gradient difference between the two sub - coding units in different directions, make binary - tree partitioning and ternary - tree partitioning decisions for the current video coding unit in the specified direction based on the pixel gradient difference, and perform the coding partitioning of the current video coding unit according to the partitioning decision result. By adopting the above technical means, make the partitioning decision of the coding unit through the comparison result of the pixel texture complexity and the pixel texture difference information, and in the case of determining to perform coding partitioning, make binary - tree partitioning and ternary - tree partitioning decisions for the current video coding unit in the specified direction based on the pixel gradient difference, so as to reduce the rate - distortion cost calculation process of the corresponding partitioning type decision, reduce the calculation time consumption of the corresponding partitioning type decision process, reduce the calculation complexity of the video image coding partitioning, improve the partitioning efficiency of the coding unit, and further improve the video coding efficiency.

[0119] The coding partitioning system of the video coding unit provided by the embodiments of the present application can be configured to execute the coding partitioning method of the video coding unit provided by the above - mentioned embodiments, and has the corresponding functions and beneficial effects.

[0120] Based on the above actual example, the embodiments of the present application further provide a coding partitioning device for a video coding unit. Refer to Figure 7, the encoding division device of the video encoding unit includes: a processor 31, a memory 32, a communication module 33, an input device 34, and an output device 35. The memory, as a computer-readable storage medium, can be configured to store software programs, computer-executable programs, and modules, such as the program instructions / modules corresponding to the encoding division method of the video encoding unit described in any embodiment of the present application (for example, the judgment module, division module, and decision module in the encoding division system of the video encoding unit). The communication module is configured to perform data transmission. The processor executes various functional applications and data processing of the device by running the software programs, instructions, and modules stored in the memory, that is, to implement the above-mentioned encoding division method of the video encoding unit. The input device can be configured to receive input digital or character information, and generate key signal inputs related to the user settings and function control of the device. The output device may include a display device such as a display screen. The above-provided encoding division device of the video encoding unit can be configured to execute the encoding division method of the video encoding unit provided in the above embodiment, and has corresponding functions and beneficial effects.

[0121] Based on the above embodiments, an embodiment of the present application further provides a non-volatile computer-readable storage medium. The non-volatile computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are configured to execute an encoding division method of a video encoding unit when executed by a computer processor. The storage medium can be any various types of memory devices or storage devices. Of course, for the non-volatile computer-readable storage medium provided in the embodiment of the present application, the computer-executable instructions are not limited to the encoding division method of the video encoding unit as described above, and can also execute related operations in the encoding division method of the video encoding unit provided in any embodiment of the present application.

[0122] Based on the above embodiments, an embodiment of the present application further provides a computer program product. Essentially, or the part that contributes to the prior art, or all or part of the technical solution of the present application can be embodied in the form of a software product. The computer program product is stored in a storage medium and includes several instructions to enable a computer device, a mobile terminal, or a processor therein to execute all or part of the steps of the encoding division method of the video encoding unit described in various embodiments of the present application.

Claims

1. A coding division method for a video coding unit, characterized in that, Including: Determine the comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs, and determine the pixel texture difference information of the current video coding unit in different directions; When it is determined to perform the coding partition judgment of the current video coding unit based on the pixel texture complexity comparison result and the pixel texture difference information, divide the current video coding unit into two sub-coding units in a specified direction, where the specified direction includes the vertical direction and the horizontal direction; Determine the pixel gradient difference between the two sub-coding units in different directions, make decisions on the binary tree partition and the ternary tree partition of the current video coding unit in the specified direction based on the pixel gradient difference, and perform the coding partition of the current video coding unit according to the partition decision result.

2. The encoding division method of the video encoding unit according to claim 1, wherein The determination of the pixel gradient difference between the two sub-coding units in different directions includes: Determine the pixel gradient ratio between the two sub-coding units in the vertical, horizontal, 45-degree upward diagonal and 45-degree downward diagonal directions, and use the pixel gradient ratio as the pixel gradient difference between the two sub-coding units in different directions. The pixel gradient ratio is the ratio between the larger gradient value and the smaller gradient value of the two sub-coding units in the corresponding direction.

3. The encoding division method of the video encoding unit according to claim 2, wherein The decision-making on the binary tree partition and the ternary tree partition of the current video coding unit in the specified direction based on the pixel gradient difference includes: When each of the pixel gradient ratios is less than the set gradient threshold, skip the binary tree partition and ternary tree partition processes of the current video coding unit in the specified direction; When there is a pixel gradient ratio reaching the set gradient threshold, select the coding partition scheme of the current video coding unit, and the coding partition scheme at least includes binary tree partition and ternary tree partition.

4. The encoding division method of the video encoding unit according to any one of claims 1-3, characterized in that, The determination of the comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs includes: Determine the first pixel texture complexity information of the current video coding unit, and determine the second pixel texture complexity information of the largest coding unit to which the current video coding unit belongs; Based on the first pixel texture complexity information and the second pixel texture complexity information, generate the comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs.

5. The encoding division method of the video encoding unit according to claim 4, wherein The determination of the first pixel texture complexity information of the current video coding unit and the second pixel texture complexity information of the largest coding unit to which the current video coding unit belongs includes: Determine the pixel value variance of the current video coding unit as the first pixel texture complexity information, and determine the pixel value variance of the largest coding unit to which the current video coding unit belongs as the second pixel texture complexity information; The generation of the comparison result of the pixel texture complexity between the current video coding unit and the largest coding unit to which it belongs based on the first pixel texture complexity information and the second pixel texture complexity information includes: The first pixel texture complexity information is magnified by a set multiple and compared with the second pixel texture complexity information to generate the pixel texture complexity comparison result, where the set multiple is determined according to the size of the current video coding unit and the maximum coding unit.

6. The encoding division method of the video encoding unit according to claim 5, wherein The determining the pixel texture difference information of the current video coding unit in different directions includes: Determining the pixel gradient variances of the current video coding unit in the vertical, horizontal, 45-degree upward diagonal, and 45-degree downward diagonal directions, and comparing the pixel gradient variances with a set variance threshold to obtain the pixel texture difference information of the current video coding unit in different directions.

7. The encoding division method of the video encoding unit according to claim 6, wherein After the determining the pixel texture difference information of the current video coding unit in different directions, it further includes: When the first pixel texture complexity information of the set multiple is greater than or equal to the second pixel texture complexity information, and the pixel gradient variances are all greater than or equal to the set variance threshold, determining to perform the coding partition judgment of the current video coding unit; When the first pixel texture complexity information of the set multiple is less than the second pixel texture complexity information, and / or the pixel gradient variances are all less than the set variance threshold, skipping the coding partition of the current video coding unit.

8. A coding division system for a video coding unit, characterized in that, It includes: A judgment module configured to determine the pixel texture complexity comparison result between the current video coding unit and the maximum coding unit to which it belongs, and determine the pixel texture difference information of the current video coding unit in different directions; A partition module configured to, when it is determined to perform the coding partition judgment of the current video coding unit based on the pixel texture complexity comparison result and the pixel texture difference information, partition the current video coding unit into two sub-coding units in a specified direction, where the specified direction includes the vertical direction and the horizontal direction; A decision module configured to determine the pixel gradient difference between the two sub-coding units in different directions, make a binary tree partition and a ternary tree partition decision of the current video coding unit in the specified direction based on the pixel gradient difference, and perform the coding partition of the current video coding unit according to the partition decision result.

9. An encoding division device for a video encoding unit, characterized in that, It includes: A memory and one or more processors; The memory is configured to store one or more programs; When the one or more programs are executed by the one or more processors, the one or more processors implement the coding partition method of the video coding unit as described in any one of claims 1-7.

10. A non-volatile computer-readable storage medium, characterized in that, The non-volatile computer-readable storage medium stores computer-executable instructions, and the computer-executable instructions are configured to execute the coding partition method of the video coding unit as described in any one of claims 1-7 when executed by a computer processor.

11. A computer program product, characterized in that, The computer program product contains instructions, and when the instructions run on a computer or a processor, the computer or the processor executes the coding partition method of the video coding unit as described in any one of claims 1-7.

Images