A data processing method and device, computer equipment and storage medium

By determining the prediction direction and geometric partitioning direction of video coding units through intra-frame prediction, computational complexity is reduced, video coding efficiency is improved, and the problem of computational complexity in geometric partitioning patterns is solved.

CN114697660BActive Publication Date: 2025-11-07CAMBRICON TECH CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202011637714.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-31
Publication Date
2025-11-07
Estimated Expiration
2041-05-09

AI Technical Summary

Technical Problem

In the inter-frame prediction module of the next-generation video coding and decoding standard VVC, the 64 possible geometric partitioning modes result in high computational complexity and reduce video coding efficiency.

Method used

The prediction direction of the target coding unit is determined by intra-frame prediction, and candidate geometric partitioning directions are determined based on the prediction direction. Rate-distortion cost is obtained, and the optimal geometric partitioning direction is selected to divide the target coding unit into two coding unit sub-blocks so that they can be encoded with different coding parameters.

Benefits of technology

It reduces computational complexity, improves the efficiency of video encoding, and avoids the computation of traversing all geometric partitioning patterns.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114697660B_ABST
    Figure CN114697660B_ABST
Patent Text Reader

Abstract

Embodiments of the present application disclose a data processing method and device, computer equipment and a storage medium, wherein the method comprises the following steps: determining a target coding unit in a target video frame, determining a prediction direction of the target coding unit by using an intra prediction mode; determining a candidate geometric partition direction of the target coding unit according to the prediction direction; the candidate geometric partition direction comprises at least one geometric partition direction; obtaining a rate-distortion cost of each geometric partition direction in the candidate geometric partition direction, and determining a target geometric partition direction of the target coding unit according to the rate-distortion cost; the target geometric partition direction is used to divide the target coding unit into two coding unit sub-blocks, so that the two coding unit sub-blocks are encoded by using different coding parameters. By using the present application, the calculation complexity can be reduced, and the efficiency of video encoding can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of Internet, and particularly relates to a data processing method and device, computer equipment and a storage medium. BACKGROUND

[0002] In the inter prediction module of a new generation of video coding standard VVC, a new technology called geometric partitioning mode (GPM) is introduced. The technology divides a rectangular coding unit (CU) in a video frame into two sub-blocks of geometric shapes (triangles, trapezoids, etc.) according to a geometric partitioning direction, and the two sub-blocks use different coding parameters to achieve optimal prediction results. However, there are 64 partitioning modes for geometric partitioning mode, and the position of the partitioning line of each partitioning mode is obtained according to the partitioning angle and the offset parameter. After partitioning, each region performs inter prediction according to its own motion information to determine the reference frame and the motion vector (MV). In order to select the optimal partitioning mode, the optimal prediction value of the coding unit is obtained according to the MV and the reference frame of the two sub-blocks under each mode, and the rate-distortion cost under the geometric partitioning mode is calculated. The partitioning mode with the minimum rate-distortion cost is selected as the optimal partitioning mode. Therefore, when selecting the optimal geometric partitioning mode of the rectangular coding unit each time, all geometric partitioning modes need to be traversed, and the calculation complexity is too high, which reduces the efficiency of video coding. SUMMARY

[0003] The embodiments of the present application provide a data processing method and device, computer equipment and a storage medium, which can reduce the calculation complexity and improve the efficiency of video coding.

[0004] In one aspect, the embodiments of the present application provide a data processing method, which can include:

[0005] determining a target coding unit in a target video frame, and determining a prediction direction of the target coding unit by using an intra prediction mode;

[0006] determining a candidate geometric partitioning direction of the target coding unit according to the prediction direction; the candidate geometric partitioning direction includes at least one geometric partitioning direction;

[0007] obtaining a rate-distortion cost of each geometric partitioning direction in the candidate geometric partitioning direction, and determining a target geometric partitioning direction of the target coding unit according to the rate-distortion cost; the target geometric partitioning direction is used to divide the target coding unit into two coding unit sub-blocks, so that the two coding unit sub-blocks use different coding parameters for coding.

[0008] In one aspect, the embodiments of the present application provide a data processing device, which can include:

[0009] The prediction direction determination unit is configured to determine a target coding unit in a target video frame, and determine a prediction direction of the target coding unit by using an intra-frame prediction mode.

[0010] The candidate direction determination unit is configured to determine a candidate geometric division direction of the target coding unit according to the prediction direction, and the candidate geometric division direction includes at least one geometric division direction.

[0011] The target direction determination unit is configured to obtain a rate-distortion cost of each geometric division direction in the candidate geometric division direction, and determine a target geometric division direction of the target coding unit according to the rate-distortion cost, and the target geometric division direction is used to divide the target coding unit into two coding unit sub-blocks, so that the two coding unit sub-blocks are encoded by using different coding parameters.

[0012] In an embodiment of the present application, a computer readable storage medium is provided, and the computer readable storage medium stores a computer program, and the computer program is suitable for being loaded by a processor and performing the method steps described above.

[0013] In an embodiment of the present application, a computer device is provided, and the computer device includes a processor and a memory, and the memory stores a computer program, and the computer program is suitable for being loaded by the processor and performing the method steps described above.

[0014] In an embodiment of the present application, a computer program product or a computer program is provided, and the computer program product or the computer program includes computer instructions stored in a computer readable storage medium. A processor of a computer device reads the computer instructions from the computer readable storage medium, and the processor executes the computer instructions, so that the computer device performs the method steps described above.

[0015] In the embodiment of the present application, by determining a target coding unit in a target video frame, determining a prediction direction of the target coding unit by using an intra-frame prediction mode, determining a candidate geometric division direction of the target coding unit according to the prediction direction, the candidate geometric division direction including at least one geometric division direction, further obtaining a rate-distortion cost of each geometric division direction in the candidate geometric division direction, and determining a target geometric division direction of the target coding unit according to the rate-distortion cost, the target geometric division direction being used to divide the target coding unit into two coding unit sub-blocks, so that the two coding unit sub-blocks are encoded by using different coding parameters. By determining the target geometric division direction according to the prediction direction of the target coding unit, all geometric division modes of the target coding unit are avoided to be traversed, the calculation complexity is reduced, and the efficiency of video encoding is improved. BRIEF DESCRIPTION OF DRAWINGS

[0016] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the accompanying drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced. Obviously, the accompanying drawings in the following description only represent some of the embodiments of the present application, and for those skilled in the art, other drawings can also be obtained from these drawings without any creative effort.

[0017] Figure 1 is a system architecture diagram of a data processing method provided by an embodiment of the present application;

[0018] Figure 2 is a flowchart of a data processing method provided by an embodiment of the present application;

[0019] Figure 3 is a flowchart of a data processing method provided by an embodiment of the present application;

[0020] Figure 4a is an example schematic diagram of a prediction direction provided by an embodiment of the present application;

[0021] Figure 4b is an example schematic diagram of a geometric division direction provided by an embodiment of the present application;

[0022] Figure 4c is an example schematic diagram of a candidate geometric division direction provided by an embodiment of the present application;

[0023] Figure 4d is a flowchart of a data processing method provided by an embodiment of the present application;

[0024] Figure 5 is a structural schematic diagram of a data processing device provided by an embodiment of the present application;

[0025] Figure 6 is a structural schematic diagram of a computer device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0026] The technical solutions in the embodiments of the present application will be described clearly and completely below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments only represent some of the embodiments of the present application, rather than all the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without any creative effort fall within the scope of protection of the present application.

[0027] It should be understood that the terms "comprises" and "comprising," when used in this specification and claims, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0028] It should also be understood that the terms used in the specification and claims are for the purpose of describing specific embodiments and are not intended to be limiting of the disclosure. As used in this specification and claims, the singular forms "a," "an" and "the" include plural referents unless the context clearly dictates otherwise. It should also be further understood that the term "and / or" as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items, and that the term "at least one of' encompasses one or more of the listed items.

[0029] As used in this specification and claims, the terms "if' and "when" can each be interpreted to mean "when" or "if," depending on the context. Similarly, the phrase "if it is determined" or "if [a described condition or event] is detected" can each be interpreted to mean "if it is determined that" or "if [the described condition or event] is detected," or "when it is determined that" or "when [the described condition or event] is detected," depending on the context.

[0030] See Figure 1 FIG. 1 is a system architecture diagram of a data processing system according to an embodiment of the present disclosure. A server 10f is connected to a user terminal cluster through a switch 10e and a communication bus 10d. The user terminal cluster can include a user terminal 10a, a user terminal 10b,..., and a user terminal 10c. In a video transmission application scenario, in the encoding process of the user terminal, a target coding unit in a target video frame of a video file is first determined, an intra prediction mode is used to determine a prediction direction of the target coding unit, a candidate geometric partition direction of the target coding unit is further determined according to the prediction direction, the candidate geometric partition direction includes at least one geometric partition direction, a rate-distortion cost of each geometric partition direction in the candidate geometric partition direction is obtained, a target geometric partition direction of the target coding unit is determined according to the rate-distortion cost, the target coding unit is divided into two coding unit sub-blocks using the target geometric partition direction, and the two coding unit sub-blocks are encoded using different encoding parameters. A receiving end of the video file obtains the encoded video file, and decodes and displays the encoded video file using output mode information and a motion vector corresponding to the target geometric partition direction. The receiving end can be another user terminal in the user terminal cluster.

[0031] The user terminal related to the embodiments of the present application includes: a tablet computer, a smart phone, a personal computer (PC), a notebook computer, a palm computer and the like.

[0032] Please refer to Figure 2 A flowchart of a data processing method is provided for the embodiments of the present application. The method can be applied to the terminal device described above, which can be a user terminal in Figure 1 As shown in Figure 2 The method of the embodiments of the present application can include the following steps S101-S103.

[0033] S101, determine a target coding unit in a target video frame, and determine the prediction direction of the target coding unit by using an intra prediction method;

[0034] Specifically, the terminal device determines a target coding unit in a target video frame, and determines the prediction direction of the target coding unit by using an intra prediction method. It can be understood that the target video frame is any frame in a video file, and in the application scenario of video transmission, each frame in the video file needs to be encoded and decoded at the decoding end. In the encoding process, the target video frame is divided into a plurality of Slices or Tiles, each Slice or Tile is divided into coding tree units (CTUs) of equal size, and the CTUs are encoded using a quadtree structure coding tree. Specifically, the CTUs are divided into one, two, three or four coding units using an inter or intra prediction method, and each coding unit can be further divided into one, two, three or four coding units using the same method. The target coding unit can be any one of the above coding units.

[0035] Further, the prediction direction of the target coding unit is determined by using an intra prediction method. Specifically, the target coding unit corresponds to a plurality of intra prediction directions, and the prediction direction of the target coding unit is selected from the plurality of intra prediction directions by using an intra prediction method. For example, the prediction direction can be determined according to the rate-distortion cost of the target coding unit in each intra prediction direction. In the inter prediction module of the new generation video coding standard VVC, the coding unit in the video frame is divided into two sub-blocks of geometric shapes (triangles, trapezoids, etc.) using geometric division directions, and the two sub-blocks use different coding parameters to achieve the optimal prediction result. The geometric division direction for dividing the coding unit includes the division angle and the offset, and there can be multiple offsets at the same division angle, and different offsets correspond to different geometric division directions. Because the prediction direction generated by using the intra prediction method is similar or identical to the geometric division direction, the division angle and the offset of the geometric division direction can be further determined according to the prediction direction of the target coding unit.

[0036] S102, determining a candidate geometric partition direction of the target coding unit according to the prediction direction;

[0037] Specifically, the terminal device determines the candidate geometric partition direction of the target coding unit according to the prediction direction. It can be understood that the candidate geometric partition direction includes at least one geometric partition direction, and the candidate geometric partition direction does not include all geometric partition directions corresponding to the video frame. For example, there are 64 geometric partition directions corresponding to the video frame, and the number of geometric partition directions in the candidate geometric partition direction is less than 64. Generally, the number of geometric partition directions in the candidate geometric partition direction is not more than 7. The geometric partition directions in the candidate geometric partition direction have the same or similar partition angles, and the geometric partition directions with the same partition angle in the candidate geometric partition direction have different partition offsets.

[0038] S103, obtaining a rate-distortion cost of each geometric partition direction in the candidate geometric partition direction, and determining a target geometric partition direction of the target coding unit according to the rate-distortion cost.

[0039] Specifically, the terminal device obtains the rate-distortion cost of each geometric partition direction in the candidate geometric partition direction, and determines the target geometric partition direction of the target coding unit according to the rate-distortion cost. It can be understood that the target geometric partition direction is used to divide the target coding unit into two coding unit sub-blocks, so that the two coding unit sub-blocks are encoded by using different encoding parameters. The rate-distortion cost is used to represent the performance of encoding, that is, under the limitation of a certain code rate (code rate also represents the degree of data compression, and the lower the code rate, the more data compression), the distortion of the video frame. The smaller the rate-distortion cost, the stronger the coding performance of the video, and the larger the rate-distortion cost, the weaker the coding performance of the video.

[0040] The method for obtaining the rate-distortion cost is as follows: dividing the coding unit into coding unit sub-blocks according to the geometric partition direction, determining the pixel prediction value of each pixel in the coding unit sub-block according to the reference frame corresponding to the coding unit sub-block, and determining the rate-distortion cost of the geometric partition direction according to the pixel prediction value of the pixel and the pixel true value of the pixel. The rate-distortion cost of each geometric partition direction is calculated by using the above method, and the target geometric partition direction of the target coding unit is determined according to the rate-distortion cost. Specifically, the geometric partition direction with the smallest rate-distortion cost can be selected as the target geometric partition direction of the target coding unit.

[0041] In this embodiment, by determining the target coding unit in the target video frame, the prediction direction of the target coding unit is determined using intra-frame prediction, and candidate geometric partitioning directions of the target coding unit are determined based on the prediction direction. Each candidate geometric partitioning direction includes at least one geometric partitioning direction. Furthermore, the rate-distortion cost of each candidate geometric partitioning direction is obtained, and the target geometric partitioning direction of the target coding unit is determined based on the rate-distortion cost. The target geometric partitioning direction is used to divide the target coding unit into two coding unit sub-blocks, so that the two coding unit sub-blocks are encoded using different coding parameters. Determining the target geometric partitioning direction through the prediction direction of the target coding unit avoids traversing all geometric partitioning patterns of the target coding unit, reducing computational complexity and improving the efficiency of video coding.

[0042] Please see Figure 3 This is a flowchart illustrating a data processing method provided in an embodiment of this application. This method can be applied to the aforementioned terminal device, which can be... Figure 1 User terminals in, such as Figure 3 As shown, the method described in this application embodiment may include the following steps S201-S207.

[0043] S201, determine the target coding unit in the target video frame, and determine the reference pixel corresponding to the target coding unit based on the coding units adjacent to the target coding unit;

[0044] Specifically, the terminal device determines the target coding unit in the target video frame and determines the reference pixel corresponding to the target coding unit based on the coding units adjacent to the target coding unit. It can be understood that in video transmission applications, the target video frame is any frame in the video file, and the coding units adjacent to the target coding unit include those adjacent to the left, right, top, and bottom. Typically, the reference pixel corresponding to the target coding unit is determined based on the left and top adjacent coding units. The reference pixel is usually selected as the pixel reconstruction value corresponding to the pixel on the boundary of the adjacent coding unit. Specifically, based on the left and top adjacent coding units, the reference pixel can be determined as: the pixel reconstruction value corresponding to the last column of the left adjacent coding unit and the pixel reconstruction value corresponding to the last row of the top adjacent coding unit. It should be noted that if the target coding unit does not have pixel reconstruction values ​​for the left or top adjacent units, then a preset pixel value is used as the reference pixel.

[0045] Further, a target intra prediction direction is determined from the set of intra prediction directions, the set of intra prediction directions including at least one intra prediction direction, the target intra prediction direction being any one of the set of intra prediction directions, the target intra prediction direction being used to obtain a pixel prediction value corresponding to each pixel in the target coding unit.

[0046] S202, obtaining a pixel prediction value of the target coding unit in the target intra prediction direction according to the reference pixel and the target intra prediction direction;

[0047] Specifically, the terminal device obtains the pixel prediction value of the target coding unit in the target intra prediction direction according to the reference pixel and the target intra prediction direction. It can be understood that the terminal device obtains a target pixel in the target coding unit, determines a pixel coordinate of the target pixel, determines a target reference pixel corresponding to the pixel coordinate in the target intra prediction direction, and the target reference pixel belongs to the reference pixel. The specific method of determining the target reference pixel can be: determining the reference pixel indicated by the pixel coordinate in the target intra prediction direction as the target reference pixel.

[0048] Further, the target reference pixel is determined as the pixel prediction value of the target pixel, the pixel prediction value corresponding to each pixel in the target coding unit is obtained in the above manner, and the pixel prediction value corresponding to each pixel is determined as the pixel prediction value of the target coding unit in the target intra prediction direction.

[0049] S203, obtaining a rate-distortion cost of the target coding unit in the target intra prediction direction according to the pixel prediction value, and determining a prediction direction of the target coding unit according to the rate-distortion cost of the target coding unit in each intra prediction direction.

[0050] Specifically, the terminal device obtains the rate-distortion cost of the target coding unit in the target intra prediction direction according to the pixel prediction value, and determines the prediction direction of the target coding unit according to the rate-distortion cost of the target coding unit in each intra prediction direction. It can be understood that the terminal device obtains a pixel real value of the target coding unit, determines a pixel residual corresponding to each pixel according to the pixel prediction value and the pixel real value, that is, calculates a difference value between the pixel real value and the pixel prediction value corresponding to each pixel, determines the difference value as the pixel residual, and further transforms and quantizes the pixel residual to generate a corresponding code stream and distortion degree, and generates the rate-distortion cost in the target intra prediction direction according to the code stream and the distortion degree.

[0051] Further, the rate-distortion cost of the target coding unit in each of the set of intra prediction directions is determined by using the above method, and the intra prediction direction corresponding to the minimum rate-distortion cost is determined as the prediction direction of the target coding unit.

[0052] In S204, a corresponding relationship between the prediction direction and the geometric partition direction is obtained, and the geometric partition direction corresponding to the prediction direction is determined according to the corresponding relationship. The candidate geometric partition direction of the target coding unit is determined according to the geometric partition direction.

[0053] Specifically, the terminal device obtains the corresponding relationship between the prediction direction and the geometric partition direction, and determines the geometric partition direction corresponding to the prediction direction according to the corresponding relationship. It can be understood that the corresponding relationship between the prediction direction and the geometric partition direction is pre-set. Please refer to Figure 4a An example diagram of a prediction direction is provided for the embodiments of the present application, which includes a plurality of prediction directions, and each direction arrow corresponds to a prediction direction and a number corresponding to the prediction direction; please refer to Figure 4b An example diagram of a geometric partition direction is provided for the embodiments of the present application, which includes a plurality of geometric partition directions, and each direction arrow corresponds to a geometric partition direction and a number corresponding to the geometric partition direction. Specifically, the corresponding relationship between the prediction direction and the geometric partition direction is as follows:

[0054] When the prediction direction is -10 to -5, the corresponding geometric partition direction is 16;

[0055] When the prediction direction is -4 to -1 or 2 to 4, the corresponding geometric partition direction is 15;

[0056] When the prediction direction is 5 to 10, the corresponding geometric partition direction is 14;

[0057] When the prediction direction is 11 to 15, the corresponding geometric partition direction is 13;

[0058] When the prediction direction is 16 to 20, the corresponding geometric partition direction is 12 and 0;

[0059] When the prediction direction is 21 to 26, the corresponding geometric partition direction is 11 and 23;

[0060] When the prediction direction is 27 to 31, the corresponding geometric partition direction is 10 and 22;

[0061] When the prediction direction is 32 to 37, the corresponding geometric partition direction is 9 and 21;

[0062] When the prediction direction is 38 to 45, the corresponding geometric partition direction is 8 and 20;

[0063] The prediction direction is 46-54, corresponding to geometric division directions 6 and 18;

[0064] The prediction direction is 55-62, corresponding to geometric division direction 4;

[0065] The prediction direction is 63-68, corresponding to geometric division direction 3;

[0066] The prediction direction is 69-72, corresponding to geometric division direction 2;

[0067] The prediction direction is 73-76, corresponding to geometric division direction 1.

[0068] Further, the candidate geometric division directions of the target coding unit are determined according to the geometric division directions, and the candidate geometric division directions include at least one geometric division direction. Specifically, geometric division directions with the same or similar division angles as the above geometric division directions can be selected as the candidate geometric division directions. Geometric division directions with the same division angle in the candidate geometric division directions have different division offsets. Please refer to Figure 4c An example of the candidate geometric division directions is provided for the embodiments of the present application. If the corresponding geometric division direction of the prediction direction is 3 according to the corresponding relationship between the prediction direction and the geometric division direction, the geometric division directions in the region 30 are selected as the candidate geometric division directions. The region 30 includes the geometric division directions in 7, and the geometric division directions in the region 30 have the same division angle and different offsets.

[0069] It should be noted that when the prediction direction is 0 (Plannar), it is determined that the pixels corresponding to the target coding unit are flat, and when the prediction direction is 1 (DC), it is determined that the pixels corresponding to the target coding unit are gradually changed. That is, when the prediction direction is 0 (Plannar) or 1 (DC), the target coding unit can not be divided by the geometric division direction, that is, the candidate geometric division direction does not need to be selected.

[0070] S205, determining a to-be-processed geometric division direction from the candidate geometric division directions, and dividing the target coding unit into two coding unit sub-blocks by using the to-be-processed geometric division direction;

[0071] Specifically, the terminal device determines a to-be-processed geometric partition direction from the candidate geometric partition directions. It can be understood that the to-be-processed geometric partition direction is any one of the candidate geometric partition directions. The target coding unit is divided into two coding unit sub-blocks using the to-be-processed geometric partition direction. The reference frames corresponding to the coding unit sub-blocks are further determined. The two coding unit sub-blocks can correspond to different reference frames, respectively. The pixel prediction values of the coding unit sub-blocks are determined according to the reference frames. Specifically, according to the pixel coordinates and the motion vectors of the pixels in the coding unit sub-blocks, the pixel coordinates corresponding to each pixel in the reference frames are obtained. The pixels corresponding to the pixel coordinates in the reference frames are taken as the pixel prediction values of the coding unit sub-blocks. The pixel prediction values of the two coding unit sub-blocks are obtained using the above method.

[0072] Further, the pixel prediction values of the target coding unit in the to-be-processed geometric partition direction are determined according to the pixel prediction values of the two coding unit sub-blocks. It needs to be noted that, in order to achieve better video display effect, the pixels at the geometric partition boundary are usually weighted and compensated.

[0073] S206, the rate-distortion cost of the target coding unit in the to-be-processed geometric partition direction is obtained according to the pixel prediction values. The target geometric partition direction of the target coding unit is determined according to the rate-distortion costs of the target coding unit in each geometric partition direction.

[0074] Specifically, the terminal device obtains the rate-distortion cost of the target coding unit in the to-be-processed geometric partition direction according to the pixel prediction values. The target geometric partition direction of the target coding unit is determined according to the rate-distortion costs of the target coding unit in each geometric partition direction. It can be understood that the terminal device obtains the pixel real values of the target coding unit. The pixel residual error corresponding to each pixel is determined according to the pixel prediction values and the pixel real values, that is, the difference between the pixel real value and the pixel prediction value corresponding to each pixel is calculated. The above difference is determined as the pixel residual error. The pixel residual error is transformed, quantized, and double-encoded to generate corresponding code stream and distortion degree. The rate-distortion cost in the to-be-processed geometric partition direction is generated according to the code stream and the distortion degree.

[0075] Further, the rate-distortion cost of the target coding unit in each geometric partition direction in the candidate geometric partition directions is determined using the above method. The geometric partition direction corresponding to the smallest rate-distortion cost is determined as the target geometric partition direction of the target coding unit.

[0076] S207, obtain the output mode information and the motion vector corresponding to the target geometric division direction of the target coding unit; the motion vector is used to obtain the pixel prediction value of the target coding unit from a reference frame; and the output mode information and the motion vector are outputted.

[0077] Specifically, the terminal device obtains the output mode information and the motion vector corresponding to the target geometric division direction of the target coding unit. It can be understood that the mode information is an index corresponding to the target geometric division direction, and the index can be a numerical number corresponding to the target geometric division direction. The motion vector is used to obtain the pixel prediction value of the target coding unit from a reference frame. Further, the output mode information and the motion vector are outputted, so that the decoding end decodes and displays the video according to the mode information and the motion vector. Figure 4d A flowchart of a data processing method is provided for the embodiments of the present application. As shown in Figure 4d In the encoding process of video transmission, a target video frame is divided into a plurality of coding units, a target coding unit in the target video frame is determined, the target coding unit is any one of the coding units, the prediction direction of the target coding unit is determined by using the intra prediction mode, the prediction direction is detected, if the prediction direction is 1 or 0, it is determined that the pixels corresponding to the target coding unit are flat or gradual, i.e. the target coding unit does not need to be divided by the geometric division direction, then the geometric division direction is closed, if the prediction direction is not 1 or 0, the candidate geometric division direction of the target coding unit is determined according to the prediction direction, and the rate-distortion cost corresponding to each geometric division direction in the candidate geometric division direction is calculated, the geometric division direction corresponding to the smallest rate-distortion cost is determined as the target geometric division direction of the target coding unit, further, the output mode information and the motion vector corresponding to the target geometric division direction of the target coding unit are obtained, and the output mode information and the motion vector are outputted, so that the decoding end decodes and displays the video according to the mode information and the motion vector.

[0078] In the embodiment of the present application, by determining a target coding unit in a target video frame, a prediction direction of the target coding unit is determined by using an intra prediction mode, and a candidate geometric partition direction of the target coding unit is determined according to the prediction direction, the candidate geometric partition direction at least includes one geometric partition direction, a rate-distortion cost of each geometric partition direction in the candidate geometric partition direction is further obtained, a target geometric partition direction of the target coding unit is determined according to the rate-distortion cost, and the target geometric partition direction is used to divide the target coding unit into two coding unit sub-blocks, so that the two coding unit sub-blocks are encoded by using different coding parameters. The prediction direction of the target coding unit is used to determine the target geometric partition direction, so that all geometric partition modes of the target coding unit are avoided to be traversed, the calculation complexity is reduced, and the efficiency of video encoding is improved.

[0079] Referring to Figure 5 A structural schematic diagram of a data processing apparatus is provided in the embodiment of the present application. The data processing apparatus can be a computer program (including program code) running in a computer device, for example, the data processing apparatus is an application software; and the device can be used to execute corresponding steps in the method provided in the embodiment of the present application. As shown in Figure 5 The data processing apparatus 1 in the embodiment of the present application can include a prediction direction determining unit 11, a candidate direction determining unit 12, and a target direction determining unit 13.

[0080] The prediction direction determining unit 11 is configured to determine a target coding unit in a target video frame, and determine a prediction direction of the target coding unit by using an intra prediction mode.

[0081] The candidate direction determining unit 12 is configured to determine a candidate geometric partition direction of the target coding unit according to the prediction direction; and the candidate geometric partition direction at least includes one geometric partition direction.

[0082] The target direction determining unit 13 is configured to obtain a rate-distortion cost of each geometric partition direction in the candidate geometric partition direction, and determine a target geometric partition direction of the target coding unit according to the rate-distortion cost; and the target geometric partition direction is used to divide the target coding unit into two coding unit sub-blocks, so that the two coding unit sub-blocks are encoded by using different coding parameters.

[0083] Referring to Figure 5 The prediction direction determining unit 11 in the embodiment of the present application can include a reference pixel determining sub-unit 111, a pixel prediction value obtaining sub-unit 112, and a prediction direction determining sub-unit 113.

[0084] The reference pixel determination sub-unit 111 is configured to determine a target coding unit in a target video frame, and determine reference pixels corresponding to the target coding unit according to coding units adjacent to the target coding unit.

[0085] determine a target intra-frame prediction direction from a set of intra-frame prediction directions, the set of intra-frame prediction directions including at least one intra-frame prediction direction;

[0086] The pixel prediction value acquisition sub-unit 112 is configured to acquire pixel prediction values of the target coding unit in the target intra-frame prediction direction according to the reference pixels and the target intra-frame prediction direction.

[0087] The prediction direction determination sub-unit 113 is configured to acquire rate-distortion costs of the target coding unit in the target intra-frame prediction direction according to the pixel prediction values, and determine a prediction direction of the target coding unit according to the rate-distortion costs of the target coding unit in each intra-frame prediction direction.

[0088] In an implementation, the pixel prediction value acquisition sub-unit 112 is specifically configured to:

[0089] acquire a target pixel in the target coding unit, the target pixel being any one of pixels in the target coding unit, and determine a pixel coordinate of the target pixel;

[0090] determine a target reference pixel corresponding to the pixel coordinate in the target intra-frame prediction direction, the target reference pixel belonging to the reference pixels;

[0091] determine the target reference pixel as a pixel prediction value of the target pixel, acquire a pixel prediction value corresponding to each pixel in the target coding unit, and determine the pixel prediction value corresponding to each pixel as a pixel prediction value of the target coding unit in the target intra-frame prediction direction.

[0092] In an implementation, the prediction direction determination sub-unit 113 is specifically configured to:

[0093] acquire pixel real values of the target coding unit, determine a pixel residual corresponding to each pixel according to the pixel prediction values and the pixel real values, and generate a rate-distortion cost in the target intra-frame prediction direction by transforming and quantizing the pixel residual;

[0094] determine rate-distortion costs of the target coding unit in each intra-frame prediction direction in the set of intra-frame prediction directions, and determine an intra-frame prediction direction corresponding to a minimum rate-distortion cost as the prediction direction of the target coding unit.

[0095] In an implementation, the candidate direction determination unit 12 is specifically configured to:

[0096] obtaining a correspondence between the prediction direction and the geometric partition direction, and determining the geometric partition direction corresponding to the prediction direction according to the correspondence;

[0097] determining a candidate geometric partition direction of the target coding unit according to the geometric partition direction.

[0098] Referring to Figure 5 The target direction determination unit 13 of the embodiment of the present application can include a direction to be processed determination sub-unit 131 and a target direction determination sub-unit 132.

[0099] The direction to be processed determination sub-unit 131 is configured to determine a direction to be processed from the candidate geometric partition direction, and divide the target coding unit into two coding unit sub-blocks by using the direction to be processed, wherein the direction to be processed is any one of the candidate geometric partition direction.

[0100] determining a reference frame corresponding to the coding unit sub-block, and determining a pixel prediction value of the coding unit sub-block according to the reference frame;

[0101] determining a pixel prediction value of the target coding unit in the direction to be processed according to the pixel prediction values of the two coding unit sub-blocks;

[0102] The target direction determination sub-unit 132 is configured to obtain a rate-distortion cost of the target coding unit in the direction to be processed according to the pixel prediction value, and determine a target geometric partition direction of the target coding unit according to the rate-distortion cost of the target coding unit in each geometric partition direction.

[0103] In a feasible implementation, the target direction determination sub-unit 132 is specifically configured to:

[0104] obtain a pixel real value of the target coding unit, determine a pixel residual corresponding to each pixel according to the pixel prediction value and the pixel real value, and transform and quantize the pixel residual to generate the rate-distortion cost in the direction to be processed;

[0105] determine the rate-distortion cost of the target coding unit in each geometric partition direction in the candidate geometric partition direction, and determine a geometric partition direction corresponding to the smallest rate-distortion cost as the target geometric partition direction of the target coding unit.

[0106] Referring to Figure 5 The data processing apparatus 1 of the embodiment of the present application can further include an information output unit 14.

[0107] The information output unit 14 is configured to obtain output mode information and a motion vector corresponding to a target geometric partition direction of the target coding unit, wherein the motion vector is used to obtain a pixel prediction value of the target coding unit from a reference frame.

[0108] The output mode information and the motion vector are outputted.

[0109] In the embodiments of the present application, by determining a target coding unit in a target video frame, a prediction direction of the target coding unit is determined by using an intra prediction mode, candidate geometric partition directions of the target coding unit are determined according to the prediction direction, the candidate geometric partition directions at least include one geometric partition direction, rate-distortion costs of each geometric partition direction in the candidate geometric partition directions are further obtained, a target geometric partition direction of the target coding unit is determined according to the rate-distortion costs, and the target geometric partition direction is used to divide the target coding unit into two coding unit sub-blocks so that the two coding unit sub-blocks are encoded by using different encoding parameters. By determining the target geometric partition direction according to the prediction direction of the target coding unit, all geometric partition modes of the target coding unit are avoided to be traversed, the calculation complexity is reduced, and the efficiency of video encoding is improved.

[0110] Please refer to Figure 6 A structural schematic diagram of a computer device is provided in the embodiments of the present application. As shown in the figure, Figure 6 The computer device 1000 can include at least one processor 1001, such as a CPU, at least one network interface 1004, a user interface 1003, a memory 1005, and at least one communication bus 1002. The communication bus 1002 is used to realize the connection and communication between the components. The user interface 1003 can include a display screen (Display), and the optional user interface 1003 can further include a standard wired interface and a wireless interface. The network interface 1004 can optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 can be a random access memory (RAM) or a non-volatile memory (NVM), such as at least one disk memory. The memory 1005 can also be at least one storage device located away from the aforementioned processor 1001. As shown in the figure, Figure 6 The memory 1005, as a computer storage medium, can include an operating system, a network communication module, a user interface module, and a data processing application program.

[0111] In Figure 6In the computer device 1000 shown, the network interface 1004 can provide network communication functions, the user interface 1003 is mainly used to provide an interface for user input; and the processor 1001 can be used to invoke a data processing application program stored in the memory 1005 to implement the above Figures 2-4d The description of the data processing method in any corresponding embodiment will not be repeated here.

[0112] It should be understood that the computer device 1000 described in the embodiments of the present application can perform the foregoing Figures 2-4d The description of the data processing method in any corresponding embodiment can also perform the foregoing Figure 5 The description of the data processing device in the corresponding embodiment will not be repeated here. In addition, the beneficial effects of using the same method will not be repeated.

[0113] In addition, it should be pointed out here that the embodiments of the present application also provide a computer readable storage medium, and the computer readable storage medium stores the computer program executed by the terminal device mentioned above, and the computer program includes program instructions, when the processor executes the program instructions, the foregoing Figures 2-4d The description of the data processing method in any corresponding embodiment will not be repeated here. In addition, the beneficial effects of using the same method will not be repeated. For technical details not disclosed in the computer readable storage medium embodiments involved in the present application, please refer to the description of the method embodiments of the present application. As an example, the program instructions can be deployed to execute on one computing device, or on multiple computing devices located in one place, or on multiple computing devices distributed in multiple places and interconnected through a communication network, which can constitute a blockchain system.

[0114] Those of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by a computer program instructing related hardware. The program can be stored in a computer readable storage medium, and when the program is executed, it can include the processes of the above-mentioned embodiments of the method. The storage medium can be a magnetic disk, an optical disk, an NVM, or a RAM, etc.

[0115] The above only describes the preferred embodiments of the present application, and of course cannot limit the scope of the rights of the present application, so the equivalent changes made according to the claims of the present application are still within the scope covered by the present application.

[0116] The foregoing can be better understood in accordance with the following clauses:

[0117] Clause A1, a data processing method, characterized by comprising:

[0118] determining a target coding unit in a target video frame, determining a prediction direction of the target coding unit in an intra prediction manner;

[0119] determining a candidate geometric partition direction of the target coding unit according to the prediction direction; the candidate geometric partition direction comprises at least one geometric partition direction;

[0120] obtaining a rate-distortion cost of each geometric partition direction in the candidate geometric partition direction, and determining a target geometric partition direction of the target coding unit according to the rate-distortion cost; the target geometric partition direction is used to divide the target coding unit into two coding unit sub-blocks, so that the two coding unit sub-blocks are encoded by using different coding parameters.

[0121] Clause A2, the method according to Clause A1, characterized in that the determining a target coding unit in a target video frame, determining a prediction direction of the target coding unit in an intra prediction manner comprises:

[0122] determining a target coding unit in a target video frame, and determining a reference pixel corresponding to the target coding unit according to a neighboring coding unit of the target coding unit;

[0123] determining a target intra prediction direction from an intra prediction direction set, the intra prediction direction set comprising at least one intra prediction direction;

[0124] obtaining a pixel prediction value of the target coding unit in the target intra prediction direction according to the reference pixel and the target intra prediction direction;

[0125] obtaining a rate-distortion cost of the target coding unit in the target intra prediction direction according to the pixel prediction value, and determining a prediction direction of the target coding unit according to the rate-distortion cost of the target coding unit in each intra prediction direction.

[0126] Clause A3, the method according to Clause A2, characterized in that the obtaining a pixel prediction value of the target coding unit in the target intra prediction direction according to the reference pixel and the target intra prediction direction comprises:

[0127] obtaining a target pixel in the target coding unit, the target pixel being any one pixel in the target coding unit, and determining a pixel coordinate of the target pixel;

[0128] determining a target reference pixel corresponding to the pixel coordinate in the target intra prediction direction, the target reference pixel belonging to the reference pixel;

[0129] determining the target reference pixel as a pixel prediction value of the target pixel, obtaining a pixel prediction value corresponding to each pixel in the target coding unit, and determining the pixel prediction value corresponding to each pixel as a pixel prediction value of the target coding unit in the target intra prediction direction.

[0130] Clause A4, the method according to Clause A2, characterized in that, the obtaining the rate-distortion cost of the target coding unit in the target intra prediction direction according to the pixel prediction value, and determining the prediction direction of the target coding unit according to the rate-distortion cost of the target coding unit in each intra prediction direction, comprises:

[0131] obtaining a pixel real value of the target coding unit, determining a pixel residual corresponding to each pixel according to the pixel prediction value and the pixel real value, and generating the rate-distortion cost in the target intra prediction direction by transforming and quantizing the pixel residual;

[0132] determining the rate-distortion cost of the target coding unit in each intra prediction direction in the set of intra prediction directions, and determining the intra prediction direction corresponding to the smallest rate-distortion cost as the prediction direction of the target coding unit.

[0133] Clause A5, the method according to Clause A1, characterized in that, the determining the candidate geometric partition direction of the target coding unit according to the prediction direction comprises:

[0134] obtaining a corresponding relationship between the prediction direction and the geometric partition direction, and determining the geometric partition direction corresponding to the prediction direction according to the corresponding relationship;

[0135] determining the candidate geometric partition direction of the target coding unit according to the geometric partition direction.

[0136] Clause A6, the method according to Clause A1, characterized in that, the obtaining the rate-distortion cost of each geometric partition direction in the candidate geometric partition direction, and determining the target geometric partition direction of the target coding unit according to the rate-distortion cost comprises:

[0137] determining a to-be-processed geometric partition direction from the candidate geometric partition direction, and dividing the target coding unit into two coding unit sub-blocks by using the to-be-processed geometric partition direction, the to-be-processed geometric partition direction being any one of the candidate geometric partition directions;

[0138] determining a reference frame corresponding to the coding unit sub-block, and determining a pixel prediction value of the coding unit sub-block according to the reference frame;

[0139] determine a pixel prediction value of the target coding unit in the to-be-processed geometric division direction according to the pixel prediction value of the two coding unit sub-blocks;

[0140] obtain a rate-distortion cost of the target coding unit in the to-be-processed geometric division direction according to the pixel prediction value, and determine a target geometric division direction of the target coding unit according to the rate-distortion cost of the target coding unit in each geometric division direction.

[0141] Clause A7, the method according to Clause A6, characterized in that the obtaining the rate-distortion cost of the target coding unit in the to-be-processed geometric division direction according to the pixel prediction value, and determining the target geometric division direction of the target coding unit according to the rate-distortion cost of the target coding unit in each geometric division direction comprises:

[0142] obtain a pixel real value of the target coding unit, determine a pixel residual corresponding to each pixel according to the pixel prediction value and the pixel real value, and transform and quantize the pixel residual to generate the rate-distortion cost in the to-be-processed geometric division direction;

[0143] determine the rate-distortion cost of the target coding unit in each geometric division direction in the candidate geometric division direction, and determine the geometric division direction corresponding to the smallest rate-distortion cost as the target geometric division direction of the target coding unit.

[0144] Clause A8, the method according to Clause A1, characterized in that it further comprises:

[0145] obtain output mode information and a motion vector of the target coding unit in the target geometric division direction; the motion vector is used to obtain a pixel prediction value of the target coding unit from a reference frame;

[0146] output the output mode information and the motion vector.

[0147] Clause A9, a data processing apparatus, characterized in that it comprises:

[0148] a prediction direction determination unit configured to determine a target coding unit in a target video frame, and determine a prediction direction of the target coding unit in an intra prediction manner;

[0149] a candidate direction determination unit configured to determine a candidate geometric division direction of the target coding unit according to the prediction direction; the candidate geometric division direction comprises at least one geometric division direction;

[0150] The target direction determination unit is configured to obtain a rate-distortion cost of each geometric partition direction in the candidate geometric partition directions, and determine a target geometric partition direction of the target coding unit according to the rate-distortion cost; the target geometric partition direction is used to divide the target coding unit into two coding unit sub-blocks, so that the two coding unit sub-blocks are encoded by using different coding parameters respectively.

[0151] Clause A10, the method according to Clause A9, characterized in that the prediction direction determination unit comprises:

[0152] The reference pixel determination subunit is configured to determine a target coding unit in a target video frame, and determine reference pixels corresponding to the target coding unit according to adjacent coding units of the target coding unit.

[0153] The target intra prediction direction is determined from an intra prediction direction set, and the intra prediction direction set comprises at least one intra prediction direction.

[0154] The pixel prediction value acquisition subunit is configured to obtain pixel prediction values of the target coding unit in the target intra prediction direction according to the reference pixels and the target intra prediction direction.

[0155] The prediction direction determination subunit is configured to obtain a rate-distortion cost of the target coding unit in the target intra prediction direction according to the pixel prediction values, and determine a prediction direction of the target coding unit according to the rate-distortion cost of the target coding unit in each intra prediction direction.

[0156] Clause A11, the method according to Clause A10, characterized in that the pixel prediction value acquisition subunit is specifically configured to:

[0157] A target pixel in the target coding unit is obtained, the target pixel is any one pixel in the target coding unit, and a pixel coordinate of the target pixel is determined.

[0158] A target reference pixel corresponding to the pixel coordinate in the target intra prediction direction is determined, and the target reference pixel belongs to the reference pixels.

[0159] The target reference pixel is determined as the pixel prediction value of the target pixel, a pixel prediction value corresponding to each pixel in the target coding unit is obtained, and the pixel prediction value corresponding to each pixel is determined as the pixel prediction value of the target coding unit in the target intra prediction direction.

[0160] Clause A12, the method according to Clause A10, characterized in that the prediction direction determination subunit is specifically configured to:

[0161] obtaining a pixel real value of the target coding unit, determining a pixel residual corresponding to each pixel according to the pixel prediction value and the pixel real value, and generating a rate-distortion cost in the target intra prediction direction by transforming and quantizing the pixel residual;

[0162] determining a rate-distortion cost of the target coding unit in each intra prediction direction in the set of intra prediction directions, and determining an intra prediction direction corresponding to the smallest rate-distortion cost as the prediction direction of the target coding unit.

[0163] Clause A13, the method according to Clause A9, characterized in that the candidate direction determination unit is specifically configured to:

[0164] obtaining a corresponding relationship between the prediction direction and a geometric division direction, and determining the geometric division direction corresponding to the prediction direction according to the corresponding relationship;

[0165] determining a candidate geometric division direction of the target coding unit according to the geometric division direction.

[0166] Clause A14, the method according to Clause A9, characterized in that the target direction determination unit comprises:

[0167] a to-be-processed direction determination subunit configured to determine a to-be-processed geometric division direction from the candidate geometric division direction, divide the target coding unit into two coding unit subblocks by using the to-be-processed geometric division direction, and the to-be-processed geometric division direction is any one of the candidate geometric division directions;

[0168] determining a reference frame corresponding to the coding unit subblock, and determining a pixel prediction value of the coding unit subblock according to the reference frame;

[0169] determining a pixel prediction value of the target coding unit in the to-be-processed geometric division direction according to the pixel prediction values of the two coding unit subblocks;

[0170] a target direction determination subunit configured to obtain a rate-distortion cost of the target coding unit in the to-be-processed geometric division direction according to the pixel prediction value, and determine a target geometric division direction of the target coding unit according to the rate-distortion cost of the target coding unit in each geometric division direction.

[0171] Clause A15, the method according to Clause A14, characterized in that the target direction determination subunit is specifically configured to:

[0172] obtaining pixel real values of the target coding unit, determining pixel residual values corresponding to each pixel according to the pixel prediction values and the pixel real values, and generating rate-distortion costs in the to-be-processed geometric division direction by transforming and quantizing the pixel residual values;

[0173] determining rate-distortion costs of the target coding unit in each geometric division direction of the candidate geometric division directions, and determining a geometric division direction corresponding to a minimum rate-distortion cost as a target geometric division direction of the target coding unit.

[0174] Clause A16, the method according to Clause A9, further comprising:

[0175] an information output unit configured to obtain output mode information and a motion vector corresponding to the target geometric division direction of the target coding unit, the motion vector being used to obtain pixel prediction values of the target coding unit from a reference frame;

[0176] outputting the output mode information and the motion vector.

[0177] The above detailed description of the embodiments of the present disclosure is provided, and the principles and implementation manners of the present disclosure are described by using specific examples. The above description of the embodiments is only used to help understand the method of the present disclosure and its core idea. Meanwhile, any change or deformation made by a person skilled in the art according to the idea of the present disclosure, based on the specific implementation manners and application scope of the present disclosure, all belong to the protection scope of the present disclosure. In summary, the content of the specification should not be understood as a limitation of the present disclosure.

Claims

1. A data processing method, characterized by, The method comprises the steps of: determining a target coding unit in a target video frame, and determining a prediction direction of the target coding unit in an intra prediction mode; determining a candidate geometric partition direction of the target coding unit according to the prediction direction; the candidate geometric partition direction comprises at least one geometric partition direction; obtaining a rate-distortion cost of each geometric partition direction in the candidate geometric partition direction, and determining a target geometric partition direction of the target coding unit according to the rate-distortion cost; the target geometric partition direction is used to divide the target coding unit into two coding unit sub-blocks, so that the two coding unit sub-blocks are encoded by using different coding parameters; the step of determining a target coding unit in a target video frame and determining a prediction direction of the target coding unit in an intra prediction mode comprises the steps of: determining a target coding unit in a target video frame, and determining a reference pixel corresponding to the target coding unit according to a neighboring coding unit of the target coding unit; determining a target intra prediction direction from an intra prediction direction set, wherein the intra prediction direction set comprises at least one intra prediction direction; obtaining a pixel prediction value of the target coding unit in the target intra prediction direction according to the reference pixel and the target intra prediction direction; obtaining a rate-distortion cost of the target coding unit in the target intra prediction direction according to the pixel prediction value, and determining a prediction direction of the target coding unit according to the rate-distortion cost of the target coding unit in each intra prediction direction.

2. The method of claim 1, wherein, The step of obtaining a pixel prediction value of the target coding unit in the target intra prediction direction according to the reference pixel and the target intra prediction direction comprises the steps of: obtaining a target pixel in the target coding unit, wherein the target pixel is any one pixel in the target coding unit, and determining a pixel coordinate of the target pixel; determining a target reference pixel corresponding to the pixel coordinate in the target intra prediction direction, wherein the target reference pixel belongs to the reference pixel; determining the target reference pixel as a pixel prediction value of the target pixel, obtaining a pixel prediction value corresponding to each pixel in the target coding unit, and determining the pixel prediction value corresponding to each pixel as a pixel prediction value of the target coding unit in the target intra prediction direction.

3. The method of claim 1, wherein, The step of obtaining a rate-distortion cost of the target coding unit in the target intra prediction direction according to the pixel prediction value, and determining a prediction direction of the target coding unit according to the rate-distortion cost of the target coding unit in each intra prediction direction comprises the steps of: obtaining a pixel real value of the target coding unit, determining a pixel residual corresponding to each pixel according to the pixel prediction value and the pixel real value, and generating a rate-distortion cost in the target intra prediction direction by transforming and quantizing the pixel residual; determining a rate-distortion cost of the target coding unit in each intra prediction direction in the intra prediction direction set, and determining an intra prediction direction corresponding to the smallest rate-distortion cost as the prediction direction of the target coding unit.

4. The method of claim 1, wherein, The step of determining a candidate geometric partition direction of the target coding unit according to the prediction direction comprises the steps of: obtaining a corresponding relationship between the prediction direction and a geometric partition direction, and determining the geometric partition direction corresponding to the prediction direction according to the corresponding relationship; determining a candidate geometric partition direction of the target coding unit according to the geometric partition direction.

5. The method of claim 1, wherein, The obtaining of rate-distortion costs of each geometric partition direction in the candidate geometric partition direction and the determining of a target geometric partition direction of the target coding unit according to the rate-distortion costs include: determining a to-be-processed geometric partition direction from the candidate geometric partition direction, and dividing the target coding unit into two coding unit sub-blocks by using the to-be-processed geometric partition direction, wherein the to-be-processed geometric partition direction is any one of the candidate geometric partition directions; determining a reference frame corresponding to the coding unit sub-block, and determining pixel prediction values of the coding unit sub-block according to the reference frame; determining pixel prediction values of the target coding unit in the to-be-processed geometric partition direction according to the pixel prediction values of the two coding unit sub-blocks; obtaining a rate-distortion cost of the target coding unit in the to-be-processed geometric partition direction according to the pixel prediction values, and determining a target geometric partition direction of the target coding unit according to the rate-distortion costs of the target coding unit in each geometric partition direction.

6. The method of claim 5, wherein, The obtaining of the rate-distortion cost of the target coding unit in the to-be-processed geometric partition direction according to the pixel prediction values and the determining of the target geometric partition direction of the target coding unit according to the rate-distortion costs of the target coding unit in each geometric partition direction include: obtaining pixel real values of the target coding unit, determining pixel residual errors corresponding to each pixel according to the pixel prediction values and the pixel real values, and generating the rate-distortion cost in the to-be-processed geometric partition direction by transforming and quantizing the pixel residual errors; determining the rate-distortion cost of the target coding unit in each geometric partition direction in the candidate geometric partition direction, and determining a geometric partition direction corresponding to the smallest rate-distortion cost as the target geometric partition direction of the target coding unit.

7. The method of claim 1, wherein, Further comprising: obtaining output mode information and a motion vector corresponding to the target geometric partition direction of the target coding unit, wherein the motion vector is used to obtain pixel prediction values of the target coding unit from a reference frame; outputting the output mode information and the motion vector.

8. A data processing apparatus, characterized by, The method comprises: a prediction direction determining unit configured to determine a target coding unit in a target video frame, and determine a prediction direction of the target coding unit by using an intra-frame prediction mode; a candidate direction determining unit configured to determine a candidate geometric partition direction of the target coding unit according to the prediction direction, wherein the candidate geometric partition direction comprises at least one geometric partition direction; a target direction determining unit configured to obtain rate-distortion costs of each geometric partition direction in the candidate geometric partition direction, and determine a target geometric partition direction of the target coding unit according to the rate-distortion costs, wherein the target geometric partition direction is used to divide the target coding unit into two coding unit sub-blocks, so that the two coding unit sub-blocks are encoded by using different coding parameters. ​ The prediction direction determination unit comprises: a reference pixel determination subunit, a pixel prediction value acquisition subunit, and a prediction direction determination subunit. The reference pixel determination subunit is configured to determine a target coding unit in a target video frame, determine reference pixels corresponding to the target coding unit according to coding units adjacent to the target coding unit, and determine a target intra-frame prediction direction from a set of intra-frame prediction directions, wherein the set of intra-frame prediction directions comprises at least one intra-frame prediction direction. The pixel prediction value acquisition subunit is configured to acquire pixel prediction values of the target coding unit in the target intra-frame prediction direction according to the reference pixels and the target intra-frame prediction direction. The prediction direction determination subunit is configured to acquire rate-distortion costs of the target coding unit in the target intra-frame prediction direction according to the pixel prediction values, and determine a prediction direction of the target coding unit according to the rate-distortion costs of the target coding unit in each intra-frame prediction direction.

9. A computer-readable storage medium, characterized in that, The computer readable storage medium stores a computer program, and the computer program is adapted to be loaded and executed by the processor to implement the method in any one of claims 1-7.

10. A computer device, comprising: The computer readable storage medium stores a computer program, and the computer program is adapted to be loaded and executed by the processor to implement the method in any one of claims 1-7.

Citation Information

Patent Citations

  • Encoding and decoding methods and devices for multiple image block division ways

    CN102595116A

  • CU division and PC prediction mode selection method and system in HEVC frame

    CN108184115A