Video decoding method, device, computer readable medium and electronic device

By improving the derivative mode division method in video coding technology, non-integer power of 2 prediction blocks are divided into integer power of 2 sub-blocks, which solves the problem of low coding efficiency caused by unreasonable prediction block sizes in the existing technology. Enables more efficient video encoding.

CN114615497BActive Publication Date: 2025-01-21TENCENT TECHNOLOGY (SHENZHEN) CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202011411681.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-12-03
Publication Date
2025-01-21
Estimated Expiration
2040-12-03

AI Technical Summary

Technical Problem

In the existing video encoding technology, the derivative mode division method causes the prediction block size to be not an integer power with an integer value whose size is not 2, increasing the complexity of the hardware implementation and reducing the encoding efficiency.

Method used

By improving the division method of the derivation mode, the prediction block with a side length other than an integer power of 2 in the coding block is divided into two sub-blocks with a side length that is an integer power of 2, and these sub-blocks are divided according to the adopted derivation mode. The blocks are decoded and finally a reconstructed image is generated.

Benefits of technology

This method uses larger sub-blocks to improve transformation efficiency without increasing hardware implementation costs, thereby improving the efficiency of video coding.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114615497B_ABST
    Figure CN114615497B_ABST
Patent Text Reader

Abstract

The embodiments of the present application provide a video decoding method, device, computer-readable medium and electronic device. The video decoding method includes: obtaining a coding block corresponding to a video image frame and a derivative mode adopted by the coding block; decoding multiple sub-blocks in the coding block according to a target partitioning method corresponding to the derivative mode, wherein the target partitioning method is selected from an improved partitioning method of the derivative mode, wherein the improved partitioning method of the derivative mode includes a partitioning method of dividing a prediction block in the coding block whose side length is not an integer power of 2 into 2 sub-blocks whose side length is an integer power of 2; generating a reconstructed image according to the derivative mode adopted by the coding block and multiple sub-coefficient blocks obtained by decoding the multiple sub-blocks. The technical solution of the embodiments of the present application can effectively improve the efficiency of video coding.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of computer and communication technology, and in particular to a video decoding method, device, computer-readable medium and electronic device. Background Art

[0002] In the field of video coding, for the division of coding blocks, the relevant video coding standards adopt the division structures of QT (Quad-Tree), BT (Binary-Tree), and EQT (Extended Quad-Tree). The concept of intra-frame derivative mode (Intra Derived Tree, Intra DT for short) is also proposed. However, the derivative mode division method will generate prediction blocks that are not integer powers of 2, that is, the width or height size of the prediction block is not an integer power of 2. Transform blocks generally do not cross the boundaries of prediction blocks to avoid causing too much high-frequency energy. In order to reduce the complexity of hardware implementation, the prediction block is first divided into sub-blocks and then transformed. However, due to the unreasonable division method of the corresponding sub-blocks, the coding efficiency of the video is affected. Summary of the invention

[0003] The embodiments of the present application provide a video decoding method, apparatus and electronic device, which can effectively improve the video encoding efficiency at least to a certain extent.

[0004] Other features and advantages of the present application will become apparent from the following detailed description, or may be learned in part by the practice of the present application.

[0005] According to one aspect of an embodiment of the present application, a video decoding method is provided, comprising: obtaining a coding block corresponding to a video image frame and a derivative mode adopted by the coding block; decoding a plurality of sub-blocks in the coding block according to a target division method corresponding to the derivative mode, wherein the target division method is selected from an improved division method of the derivative mode, and the improved division method of the derivative mode includes a division method of dividing a prediction block in the coding block whose side length is not an integer power of 2 into 2 sub-blocks whose side length is an integer power of 2; generating a reconstructed image according to the derivative mode adopted by the coding block and a plurality of sub-coefficient blocks obtained by decoding the plurality of sub-blocks as units.

[0006] According to one aspect of an embodiment of the present application, a video decoding device is provided, comprising: an acquisition unit, configured to acquire a coding block corresponding to a video image frame and a derivative mode adopted by the coding block; a decoding unit, configured to decode a plurality of sub-blocks in the coding block according to a target division method corresponding to the derivative mode, wherein the target division method is selected from an improved division method of the derivative mode, and the improved division method of the derivative mode includes a division method of dividing a prediction block in the coding block whose side length is not an integer power of 2 into 2 sub-blocks whose side length is an integer power of 2; a first processing unit, configured to generate a reconstructed image according to the derivative mode adopted by the coding block and a plurality of sub-coefficient blocks obtained by decoding the plurality of sub-blocks.

[0007] In some embodiments of the present application, based on the aforementioned scheme, if the derivative mode is a horizontal derivative mode, the improved division method of the horizontal derivative mode includes: dividing the prediction block in the coding block whose height is an integer power of non-2 into 2 sub-blocks with a side ratio of 1:2 or 2:1 in the height direction.

[0008] In some embodiments of the present application, based on the aforementioned scheme, if the derivative mode is a vertical derivative mode, the improved division method of the vertical derivative mode includes: dividing the prediction block in the coding block whose width is an integer power of non-2 into 2 sub-blocks with a side ratio of 1:2 or 2:1 in the width direction.

[0009] In some embodiments of the present application, based on the aforementioned scheme, the first processing unit is configured as follows: if the coding block adopts an intra-frame derivation mode, the multiple sub-coefficient blocks are dequantized and inverse transformed in sequence according to a predetermined order, and the images corresponding to the multiple sub-blocks are reconstructed in sequence according to the reconstruction residuals obtained by the dequantization and inverse transformation processes to generate the reconstructed image, wherein, during the reconstruction process, the reconstructed image corresponding to the sub-block in the preceding order is added to the intra-frame prediction reference image area of ​​the sub-block in the succeeding order.

[0010] In some embodiments of the present application, based on the aforementioned scheme, the first processing unit is configured as follows: if the intra-frame derivative mode is an intra-frame horizontal derivative mode, the multiple sub-coefficient blocks are sequentially dequantized and inversely transformed from top to bottom, and the images corresponding to the multiple sub-blocks are sequentially reconstructed according to the reconstructed residuals obtained by the dequantization and inverse transformation; if the intra-frame derivative mode is an intra-frame vertical derivative mode, the multiple sub-coefficient blocks are sequentially dequantized and inversely transformed from left to right, and the images corresponding to the multiple sub-blocks are sequentially reconstructed according to the reconstructed residuals obtained by the dequantization and inverse transformation.

[0011] In some embodiments of the present application, based on the aforementioned scheme, the first processing unit is configured as follows: if the coding block adopts the inter-frame derivation mode, then the multiple sub-coefficient blocks are respectively subjected to inverse quantization and inverse transformation processing to obtain the reconstruction residuals corresponding to the multiple sub-blocks; the reconstruction residuals corresponding to the multiple sub-blocks are respectively subjected to splicing processing to obtain the reconstruction residuals corresponding to the multiple sub-blocks as a whole; and the reconstructed image is generated according to the reconstruction residuals corresponding to the multiple sub-blocks as a whole.

[0012] In some embodiments of the present application, based on the aforementioned solution, the target division method is a preset division method selected from the improved division methods of the derived mode.

[0013] In some embodiments of the present application, based on the aforementioned scheme, the decoding unit is further configured to: determine the target division method according to the identification information decoded from the bit stream, and the target division method is selected by the encoding end from a plurality of division methods based on a rate-distortion optimization strategy, and the plurality of division methods include an improved division method of the derived mode and an original division method of the derived mode.

[0014] In some embodiments of the present application, based on the aforementioned scheme, the decoding unit is further configured to: determine whether all coding blocks using the derivative mode in the coded data need to use the target division method according to the value of the index identifier contained in the sequence header of the coded data corresponding to the video image frame sequence; or

[0015] Determining, according to a value of an index identifier contained in a sequence header of the coded data corresponding to the video image frame sequence, whether all coded blocks in the coded data that adopt an intra-frame derivation mode need to adopt the target division method; or

[0016] According to the value of the index identifier contained in the sequence header of the coded data corresponding to the video image frame sequence, it is determined whether all the coded blocks in the coded data that adopt the inter-frame derivation mode need to adopt the target division method.

[0017] According to one aspect of an embodiment of the present application, a computer-readable medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the video decoding method as described in the above embodiment is implemented.

[0018] According to one aspect of an embodiment of the present application, an electronic device is provided, comprising: one or more processors; a storage device for storing one or more programs, wherein when the one or more programs are executed by the one or more processors, the one or more processors implement the video decoding method as described in the above embodiments.

[0019] According to one aspect of the embodiments of the present application, a computer program product or a computer program is provided, the computer program product or the computer program includes computer instructions, the computer instructions are stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device performs the video decoding method provided in the above various optional embodiments.

[0020] In the technical solutions provided in some embodiments of the present application, multiple sub-blocks in the coding block are decoded according to the target division method corresponding to the derivative mode adopted by the coding block, and the improved division method of the derivative mode includes a division method of dividing the prediction block in the coding block whose side length is not an integer power of 2 into 2 sub-blocks whose side length is an integer power of 2. Since these sub-blocks belong to the same prediction block and have the same prediction information, they also have similar residual distributions. The division method in the embodiments of the present application ensures that larger sub-blocks are used to improve the transformation efficiency without increasing the hardware implementation cost, thereby improving the final coding efficiency.

[0021] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present application. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The drawings herein are incorporated into the specification and constitute a part of the specification, showing embodiments consistent with the present application, and together with the specification, are used to explain the principles of the present application. Obviously, the drawings described below are only some embodiments of the present application, and for ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work. In the drawings:

[0023] Figure 1 A schematic diagram showing an exemplary system architecture to which the technical solution of the embodiments of the present application can be applied;

[0024] Figure 2 A schematic diagram showing the placement of a video encoding device and a video decoding device in a streaming transmission system;

[0025] Figure 3 shows a basic flow chart of a video encoder;

[0026] Figure 4 shows the scan area marked by the SRCC technique;

[0027] Figure 5 A schematic diagram showing a sequence of scanning the marked scanning area;

[0028] Figure 6 A schematic diagram of the division method of EQT is shown;

[0029] Figure 7 A flowchart showing the selection of basic block partitioning structure in AVS3 is shown;

[0030] Figure 8 A schematic diagram showing a block partitioning method for an intra-frame derivative mode;

[0031] Fig. 9 A flowchart of a video decoding method according to an embodiment of the present application is shown;

[0032] Fig.10 and Fig.11 A schematic diagram showing an improved division method of a horizontal derivative mode according to an embodiment of the present application is shown;

[0033] Fig.12 and Fig.13 A schematic diagram showing an improved division method of a vertical derivative mode according to an embodiment of the present application is shown;

[0034] Fig.14 A schematic diagram showing an improved division method of a derivative mode according to an embodiment of the present application is shown;

[0035] Fig.15 A block diagram of a video decoding device according to an embodiment of the present application is shown;

[0036] Fig.16 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown. DETAILED DESCRIPTION

[0037] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the examples set forth herein; rather, these embodiments are provided so that this application will be more comprehensive and complete and fully convey the concept of the example embodiments to those skilled in the art.

[0038] In addition, described feature, structure or characteristic can be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present application. However, those skilled in the art will appreciate that the technical scheme of the present application can be put into practice without one or more of the specific details, or other methods, components, devices, steps, etc. can be adopted. In other cases, known methods, devices, realizations or operations are not shown or described in detail to avoid blurring the various aspects of the application.

[0039] The block diagrams shown in the accompanying drawings are merely functional entities and do not necessarily correspond to physically independent entities. That is, these functional entities may be implemented in software form, or in one or more hardware modules or integrated circuits, or in different networks and / or processor devices and / or microcontroller devices.

[0040] The flowcharts shown in the accompanying drawings are only exemplary and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps can be decomposed, and some operations / steps can be combined or partially combined, so the actual execution order may change according to actual conditions.

[0041] It should be noted that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of the associated objects, indicating that there can be three relationships. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the associated objects before and after are in an "or" relationship.

[0042] Figure 1 A schematic diagram of an exemplary system architecture to which the technical solution of the embodiments of the present application can be applied is shown.

[0043] like Figure 1 As shown, the system architecture 100 includes a plurality of terminal devices, which can communicate with each other through, for example, a network 150. For example, the system architecture 100 may include a first terminal device 110 and a second terminal device 120 interconnected through the network 150. Figure 1 In the embodiment of the present invention, the first terminal device 110 and the second terminal device 120 perform unidirectional data transmission.

[0044] For example, the first terminal device 110 may encode video data (e.g., a video picture stream captured by the terminal device 110) for transmission to the second terminal device 120 via the network 150. The encoded video data is transmitted in the form of one or more encoded video code streams. The second terminal device 120 may receive the encoded video data from the network 150, decode the encoded video data to restore the video data, and display the video picture based on the restored video data.

[0045] In one embodiment of the present application, the system architecture 100 may include a third terminal device 130 and a fourth terminal device 140 that perform bidirectional transmission of encoded video data, which may occur during a video conference, for example. For bidirectional data transmission, each of the third terminal device 130 and the fourth terminal device 140 may encode video data (e.g., a video picture stream collected by the terminal device) to transmit to the other terminal device of the third terminal device 130 and the fourth terminal device 140 through the network 150. Each of the third terminal device 130 and the fourth terminal device 140 may also receive the encoded video data transmitted by the other terminal device of the third terminal device 130 and the fourth terminal device 140, and may decode the encoded video data to restore the video data, and may display the video picture on an accessible display device according to the restored video data.

[0046] exist Figure 1 In the embodiment of the present invention, the first terminal device 110, the second terminal device 120, the third terminal device 130 and the fourth terminal device 140 may be servers, personal computers and smart phones, but the principles disclosed in the present application may not be limited thereto. The embodiments disclosed in the present application are applicable to laptop computers, tablet computers, media players and / or dedicated video conferencing equipment. The network 150 represents any number of networks that transmit encoded video data between the first terminal device 110, the second terminal device 120, the third terminal device 130 and the fourth terminal device 140, including, for example, wired and / or wireless communication networks. The communication network 150 may exchange data in circuit switching and / or packet switching channels. The network may include a telecommunications network, a local area network, a wide area network and / or the Internet. For the purpose of the present application, unless explained below, the architecture and topology of the network 150 may be irrelevant to the operation disclosed in the present application.

[0047] In one embodiment of the present application, Figure 2 The placement of the video encoding device and the video decoding device in the streaming environment is shown. The subject matter disclosed in the present application can be equally applicable to other video-supported applications, including, for example, video conferencing, digital TV (television), storing compressed video on digital media including CD, DVD, memory stick, etc.

[0048] The streaming system may include an acquisition subsystem 213, which may include a video source 201 such as a digital camera, which creates an uncompressed video picture stream 202. In an embodiment, the video picture stream 202 includes samples taken by a digital camera. The video picture stream 202 is depicted as a thick line to emphasize the high data volume of the video picture stream compared to the encoded video data 204 (or the encoded video code stream 204), and the video picture stream 202 can be processed by an electronic device 220, which includes a video encoding device 203 coupled to the video source 201. The video encoding device 203 may include hardware, software, or a combination of hardware and software to implement or implement various aspects of the disclosed subject matter as described in more detail below. Compared to the video picture stream 202, the encoded video data 204 (or the encoded video code stream 204) is depicted as a thin line to emphasize the lower data volume of the encoded video data 204 (or the encoded video code stream 204), which can be stored on the streaming server 205 for future use. One or more streaming client subsystems, such as Figure 2 The client subsystem 206 and the client subsystem 208 in the streaming server 205 can access the streaming server 205 to retrieve the copy 207 and the copy 209 of the encoded video data 204. The client subsystem 206 may include, for example, a video decoding device 210 in the electronic device 230. The video decoding device 210 decodes the incoming copy 207 of the encoded video data and generates an output video picture stream 211 that can be presented on a display 212 (e.g., a display screen) or another presentation device. In some streaming systems, the encoded video data 204, the video data 207, and the video data 209 (e.g., a video bitstream) may be encoded according to certain video encoding / compression standards. Examples of these standards include ITU-T H.265. In an embodiment, the video coding standard under development is informally referred to as Versatile Video Coding (VVC), and the present application may be used in the context of the VVC standard.

[0049] It should be noted that the electronic device 220 and the electronic device 230 may include other components not shown in the figure. For example, the electronic device 220 may include a video decoding device, and the electronic device 230 may also include a video encoding device.

[0050] In one embodiment of the present application, taking the international video coding standards HEVC (High Efficiency Video Coding), VVC (Versatile Video Coding), and China's national video coding standard AVS as examples, after a video frame image is input, the video frame image will be divided into several non-overlapping processing units according to a block size, and each processing unit will perform similar compression operations. This processing unit is called CTU (Coding Tree Unit), or LCU (Largest Coding Unit). CTU can continue to be divided more finely to obtain one or more basic coding units CU, which is the most basic element in a coding link. The following introduces some concepts when encoding CU:

[0051] Predictive Coding: Predictive coding includes intra-frame prediction and inter-frame prediction. The original video signal is predicted by the selected reconstructed video signal to obtain the residual video signal. The encoder needs to decide which predictive coding mode to choose for the current CU and inform the decoder. Intra-frame prediction means that the predicted signal comes from the encoded and reconstructed area in the same image; inter-frame prediction means that the predicted signal comes from other images that have been encoded and different from the current image (called reference images).

[0052] Transform & Quantization: After the residual video signal is transformed by DFT (Discrete Fourier Transform), DCT and other transformation operations, the signal is converted into the transform domain, which is called the transform coefficient. The transform coefficient is further subjected to lossy quantization operation, which loses a certain amount of information, making the quantized signal conducive to compression expression. In some video coding standards, there may be more than one transform method to choose from, so the encoder also needs to select one of the transform methods for the current CU and inform the decoder. The degree of quantization is usually determined by the quantization parameter (QP). A larger QP value means that coefficients with a larger value range will be quantized to the same output, which usually results in greater distortion and lower bit rate; on the contrary, a smaller QP value means that coefficients with a smaller value range will be quantized to the same output, which usually results in less distortion and a higher bit rate.

[0053] Entropy Coding or Statistical Coding: The quantized transform domain signal will be statistically compressed and encoded according to the frequency of occurrence of each value, and finally output as a binary (0 or 1) compressed bit stream. At the same time, the encoding generates other information, such as the selected coding mode, motion vector data, etc., which also need to be entropy encoded to reduce the bit rate. Statistical coding is a lossless coding method that can effectively reduce the bit rate required to express the same signal. Common statistical coding methods include variable length coding (VLC) or context-based binary arithmetic coding (CABAC).

[0054] Loop Filtering: The changed and quantized signal will be reconstructed through inverse quantization, inverse transformation and prediction compensation operations to obtain a reconstructed image. Compared with the original image, due to the influence of quantization, some information of the reconstructed image is different from the original image, that is, the reconstructed image will produce distortion. Therefore, the reconstructed image can be filtered, such as deblocking filter (DB), SAO (Sample Adaptive Offset) or ALF (Adaptive Loop Filter) and other filters, which can effectively reduce the degree of distortion caused by quantization. Since these filtered reconstructed images will be used as a reference for subsequent encoded images to predict future image signals, the above filtering operation is also called loop filtering, that is, filtering operation within the encoding loop.

[0055] In one embodiment of the present application, Figure 3 The basic flow chart of a video encoder is shown in FIG. 1 , in which intra-frame prediction is used as an example for explanation. In which the original image signal s k [x,y] and predicted image signal Perform difference operation to obtain the residual signal u k [x,y], residual signal u k [x,y] is transformed and quantized to obtain the quantized coefficients. The quantized coefficients are entropy coded to obtain the encoded bit stream, and the reconstructed residual signal u' is obtained through inverse quantization and inverse transformation. k [x,y], predicted image signal and reconstructed residual signal u' k [x,y] superposition generates image signal Image signal On the one hand, it is input to the intra-frame mode decision module and the intra-frame prediction module for intra-frame prediction processing, and on the other hand, the reconstructed image signal s' is output through loop filtering k [x,y], reconstructed image signal s' k [x,y] can be used as the reference image for the next frame for motion estimation and motion compensation prediction. Then based on the result of motion compensation prediction s' r [x+m x ,y+m y ] and intra prediction results Get the predicted image signal of the next frame And continue to repeat the above process until the encoding is completed.

[0056] In addition, since the non-zero coefficients in the quantized coefficient block of the residual signal after transformation and quantization are more likely to be concentrated in the left and upper areas of the block, while the right and lower areas of the block are often 0, the SRCC technology is introduced. The SRCC technology can mark the size of the upper left area SRx×SRy of the non-zero coefficients contained in each quantized coefficient block (size W×H), where SRx is the horizontal coordinate of the rightmost non-zero coefficient in the quantized coefficient block, SRy is the vertical coordinate of the bottom non-zero coefficient in the quantized coefficient block, and 1≤SRx≤W, 1≤SRy≤H, and the coefficients outside this area are all 0. The SRCC technology uses (SRx, SRy) to determine the quantized coefficient area that needs to be scanned in a quantized coefficient block, such as Figure 4 As shown, only the quantized coefficients in the scan area marked by (SRx, SRy) need to be encoded, and the encoding scanning order is as follows Figure 5 As shown, it can be a reverse Z-shaped scan from the lower right corner to the upper left corner.

[0057] Based on the above encoding process, at the decoding end, for each CU, after obtaining the compressed code stream (i.e., bit stream), entropy decoding is performed to obtain various mode information and quantization coefficients. The quantization coefficients are then dequantized and inversely transformed to obtain a residual signal. On the other hand, based on the known encoding mode information, the prediction signal corresponding to the CU can be obtained, and then the residual signal and the prediction signal are added to obtain the reconstructed signal. The reconstructed signal is then subjected to loop filtering and other operations to generate the final output signal.

[0058] For the above encoding process, AVS3 adopts the basic block partitioning structure of QT+BT+EQT, while the previous generation AVS2 standard adopts the quadtree (QT) partitioning structure, that is, a CU is divided into four sub-CUs. Among them, BT can divide a CU into two sub-CUs, left and right / upper and lower; EQT includes two I-shaped partitioning methods, horizontal and vertical, to divide a CU into 4 sub-CUs, as shown below: Figure 6 As shown, Figure 6The middle left picture shows the horizontal I-shaped division method. Figure 6 The middle right picture shows the vertical I-shaped division method.

[0059] The QT+BT+EQT basic block division structure in AVS3 is represented in the bitstream as follows: Figure 7 As shown in the figure, for a CU, first determine whether to use QT for division. If QT is used, QT division is directly performed; if QT is not used, further determine whether to not divide, if not divided, then end; if division is required, it is necessary to determine whether to use EQT or BT. At the same time, whether EQT or BT is used, it is necessary to determine whether to divide horizontally or vertically. Block division is a recursive division decision starting from LCU from top to bottom. In the recursive process, the optimal division method and encoding mode are determined by the encoding end optimization.

[0060] In addition, AVS3 also proposes an intra-frame derivative mode (i.e., Intra DT). This method mainly adds the concept of PU (Prediction Unit) on the basis of the coding unit, that is, the coding unit is further divided into PUs, and this method supports six PU division methods, as follows: Figure 8 As shown in the figure, there are three horizontal division modes (i.e., horizontal derivative modes, 2N×hN, 2N×nU, 2N×nD) and three vertical division modes (i.e., vertical derivative modes, hN×2N, nL×2N, nR×2N). At the same time, the use conditions of Intra DT include that the maximum size of the coding unit is 64x64 and the minimum is 16x16, and the aspect ratio of the coding unit is less than 4.

[0061] In the Intra DT division mode, 2N×hN and hN×2N divide the coding block into 4 prediction blocks, and the other four division modes (i.e. asymmetric derivative mode, 2N×nU, 2N×nD, nL×2N, nR×2N) divide the coding block into 2 prediction blocks, where each prediction block encodes a set of intra-frame prediction information. For the asymmetric derivative mode, the larger prediction block of the two prediction blocks will be further divided into 3 sub-blocks.

[0062] like Figure 8 As shown in the figure, the three horizontal division modes (i.e., 2N×hN, 2N×nU, and 2N×nD) divide the coding block horizontally into 4 identical sub-blocks, which are then reconstructed from top to bottom, and the sub-blocks reconstructed later can refer to the sub-blocks reconstructed previously. The three vertical division modes (i.e., hN×2N, nL×2N, and nR×2N) divide the coding block vertically into 4 identical sub-blocks, which are then reconstructed from left to right, and the sub-blocks reconstructed later can refer to the sub-blocks reconstructed previously.

[0063] The derivative mode can also be applied to inter-frame coding, so the derivative mode can also be classified into intra-frame derivative mode and inter-frame derivative mode. Among them, the intra-frame derivative mode can be further divided into intra-frame horizontal derivative mode and intra-frame vertical derivative mode; the inter-frame derivative mode can be further divided into inter-frame horizontal derivative mode and inter-frame vertical derivative mode.

[0064] It can be seen that for the intra-frame derivative mode in the AVS3 standard, for the prediction blocks of 2N×hN and hN×2N and the smaller prediction blocks of the asymmetric derivative mode ( Figure 8 The black rectangle filled with white in the middle) is not divided and directly transformed, quantized and encoded. For the larger prediction block ( Figure 8 The size (width or height) of the shaded area shown in the figure is not an integer power of 2, and it is further divided into 3 sub-blocks of the same size, and then transformed, quantized and coefficient encoded in units of sub-blocks. However, since these 3 sub-blocks share the same intra-frame prediction information, their residuals are similar, and using a larger transform block can improve the coding efficiency. Based on this, the embodiment of the present application provides the following improvement scheme:

[0065] Fig. 9 A flowchart of a video decoding method according to an embodiment of the present application is shown. The video decoding method can be executed by a device with a computing and processing function, such as a terminal device or a server. Fig. 9 As shown, the video decoding method at least includes steps S910 to S930, which are described in detail as follows:

[0066] In step S910, a coding block corresponding to a video image frame and a derivative mode adopted by the coding block are obtained.

[0067] In one embodiment of the present application, a video image frame sequence includes a series of images, each of which can be further divided into slices, which can be further divided into a series of LCUs (or CTUs), and the LCU contains several CUs. When encoding, the video image frame is encoded in blocks. In some new video coding standards, such as the H.264 standard, there are macroblocks (MB), which can be further divided into multiple prediction blocks (prediction) that can be used for predictive coding. In the HEVC standard, basic concepts such as coding units CU, prediction units PU and transform units (TU) are used to functionally divide various block units and describe them using a new tree-based structure. For example, CU can be divided into smaller CUs according to a quadtree, and the smaller CU can be further divided to form a quadtree structure. The coding block in the embodiment of the present application can be a CU, or a smaller block than a CU, such as a smaller block obtained by dividing a CU.

[0068] In one embodiment of the present application, the derivative mode adopted by the coding block (i.e., one of 2N×hN, 2N×nU, 2N×nD, hN×2N, nL×2N, and nR×2N) can be obtained by decoding the code stream.

[0069] In step S920, multiple sub-blocks in the coding block are decoded according to a target division method corresponding to the derived mode, and the target division method is selected from an improved division method of the derived mode, and the improved division method of the derived mode includes a division method of dividing a prediction block in the coding block whose side length is not an integer power of 2 into 2 sub-blocks whose side length is an integer power of 2.

[0070] In one embodiment of the present application, if the derivative mode is a horizontal derivative mode, the improved division method of the horizontal derivative mode includes: dividing the prediction block in the coding block whose height is not an integer power of 2 into 2 sub-blocks with a side ratio of 1:2 or 2:1 in the height direction.

[0071] like Fig.10 As shown, for 2N×nU in the horizontal derivative mode, two prediction blocks are obtained after asymmetric partitioning, of which the larger one ( Fig.10 The height of the shaded area in the middle is not an integer power of 2. When divided by the technical solution of the embodiment of the present application, the prediction block can be divided into two sub-blocks with a side length ratio of 1:2 or 2:1 in the height direction.

[0072] Similarly, if Fig.11 As shown, for 2N×nD in the horizontal derivative mode, two prediction blocks are obtained after asymmetric partitioning, of which the larger one ( Fig.11 The height of the shaded area in the middle is not an integer power of 2. When divided by the technical solution of the embodiment of the present application, the prediction block can be divided into two sub-blocks with a side length ratio of 2:1 or 1:2 in the height direction.

[0073] In one embodiment of the present application, if the derivative mode is a vertical derivative mode, the improved division method of the vertical derivative mode includes: dividing the prediction block in the coding block whose width is not an integer power of 2 into 2 sub-blocks with a side ratio of 1:2 or 2:1 in the width direction.

[0074] like Fig.12 As shown, for nL×2N in the vertical derivative mode, two prediction blocks are obtained after asymmetric partitioning, of which the larger one ( Fig.12 The height of the shaded area in the middle is not an integer power of 2. When divided by the technical solution of the embodiment of the present application, the prediction block can be divided into two sub-blocks with a side length ratio of 1:2 or 2:1 in the width direction.

[0075] Similarly, if Fig.13 As shown, for nR×2N in the vertical derivative mode, two prediction blocks are obtained after asymmetric partitioning, of which the larger one ( Fig.13 The height of the shaded area in the middle is not an integer power of 2. When divided by the technical solution of the embodiment of the present application, the prediction block can be divided into two sub-blocks with a side length ratio of 2:1 or 1:2 in the width direction.

[0076] Based on the technical solution of the above embodiment, each derived mode can be divided into Figures 10 to 13 For example, in one embodiment of the present application, the improved division method of the derived mode can be as follows: Fig.14 As shown: that is, for 2N×nU in the horizontal derivative mode, the larger prediction block after asymmetric division is divided into two sub-blocks with a side ratio of 1:2 in the height direction; for 2N×nD in the horizontal derivative mode, the larger prediction block after asymmetric division is divided into two sub-blocks with a side ratio of 2:1 in the height direction; for nL×2N in the vertical derivative mode, the larger prediction block after asymmetric division is divided into two sub-blocks with a side ratio of 1:2 in the width direction; for nR×2N in the vertical derivative mode, the larger prediction block after asymmetric division is divided into two sub-blocks with a side ratio of 2:1 in the width direction.

[0077] In one embodiment of the present application, the target partitioning method in step S920 may be a preset partitioning method selected from the improved partitioning methods of the derived mode, so that the encoding end may partition the prediction block according to the preset partitioning method, and the decoding end may also reconstruct according to the preset partitioning method.

[0078] In one embodiment of the present application, the encoder may also use RDO (Rate-Distortion Optimization) to make a decision to select the target partitioning method from multiple partitioning methods, and then identify the target partitioning method in the bitstream. The decoder may obtain the identification information by decoding the bitstream. Optionally, the multiple partitioning methods may include an improved partitioning method of the derived mode and an original partitioning method of the derived mode, wherein the original partitioning method of the derived mode is as follows: Figure 8 shown.

[0079] In one embodiment of the present application, it is also possible to determine which coding blocks need to be subjected to block decoding processing by the aforementioned determined target division method according to the index identifier contained in the sequence header of the coding data corresponding to the video image frame sequence.

[0080] Specifically, it is possible to determine whether all coding blocks in the coded data using the derivative mode need to use the target partitioning method according to the value of the index identifier contained in the sequence header of the coded data corresponding to the video image frame sequence. For example, if the index identifier in the sequence header is 1 (the value is only an example), it means that all coding blocks using the derivative mode corresponding to the video image frame sequence need to use the target partitioning method for block decoding processing.

[0081] Of course, it is also possible to determine whether all the coding blocks in the coded data that use the intra-frame derivative mode need to use the target partitioning method for block decoding processing according to the value of the index identifier contained in the sequence header of the coded data corresponding to the video image frame sequence. For example, if the index identifier in the sequence header is 1 (the value is only an example), it means that all the coding blocks that use the intra-frame derivative mode corresponding to the video image frame sequence need to use the target partitioning method for block decoding processing.

[0082] In addition, it is also possible to determine whether all coding blocks in the coded data that use the inter-frame derivative mode need to use the target partitioning method for block decoding processing according to the value of the index identifier contained in the sequence header of the coded data corresponding to the video image frame sequence. For example, if the index identifier in the sequence header is 1 (the value is only an example), it means that all coding blocks that use the inter-frame derivative mode corresponding to the video image frame sequence need to use the target partitioning method for block decoding processing.

[0083] Continue to refer to Fig. 9As shown, in step S930, a reconstructed image is generated according to the derivative mode adopted by the coding block and the multiple sub-coefficient blocks obtained by decoding the multiple sub-blocks.

[0084] In one embodiment of the present application, if the coding block adopts the intra-frame derivative mode, the multiple sub-coefficient blocks obtained by the decoding process can be dequantized and inversely transformed in a predetermined order, and the images corresponding to the multiple sub-blocks can be reconstructed in sequence according to the reconstruction residuals obtained by the dequantization and inverse transformation to generate a reconstructed image, wherein the sub-blocks in the latter order can refer to the reconstructed image corresponding to the sub-blocks in the former order when reconstructing the image, that is, the reconstructed image corresponding to the sub-blocks in the former order can be added to the intra-frame prediction reference image area of ​​the sub-blocks in the latter order during the reconstruction process. Specifically, if it is an intra-frame horizontal derivative mode, the multiple sub-coefficient blocks are dequantized and inversely transformed in a top-to-bottom manner, and the images corresponding to the multiple sub-blocks are reconstructed in sequence according to the reconstruction residuals obtained by the dequantization and inverse transformation; if it is an intra-frame vertical derivative mode, the multiple sub-coefficient blocks are dequantized and inversely transformed in a left-to-right manner, and the images corresponding to the multiple sub-blocks are reconstructed in sequence according to the reconstruction residuals obtained by the dequantization and inverse transformation.

[0085] In one embodiment of the present application, if the coding block adopts the inter-frame derivative mode, multiple sub-coefficient blocks can be dequantized and inversely transformed to obtain reconstruction residuals corresponding to the multiple sub-blocks, that is, each sub-coefficient block can be independently and parallelly dequantized and inversely transformed to obtain reconstruction residuals, and then the reconstruction residuals corresponding to the multiple sub-blocks are spliced ​​to obtain reconstruction residuals corresponding to the multiple sub-blocks as a whole, and then a reconstructed image is generated according to the reconstruction residuals corresponding to the multiple sub-blocks as a whole. That is, the reconstruction residuals are superimposed with the prediction information to obtain the reconstructed image.

[0086] The technical solution of the above-mentioned embodiment of the present application improves the division method of the derivative mode, so that the derivative mode is not only applicable to intra-frame coding but also to inter-frame coding. At the same time, larger sub-blocks can be used to improve the transformation efficiency without increasing the hardware implementation cost, thereby improving the final coding efficiency.

[0087] The following describes an apparatus embodiment of the present application, which can be used to execute the video decoding method in the above-mentioned embodiment of the present application. For details not disclosed in the apparatus embodiment of the present application, please refer to the above-mentioned embodiment of the video decoding method of the present application.

[0088] Fig.15A block diagram of a video decoding device according to an embodiment of the present application is shown. The video decoding device can be set in a device with a computing and processing function, such as a terminal device or a server.

[0089] Reference Fig.15 As shown, a video decoding device 1500 according to an embodiment of the present application includes: an acquisition unit 1502 , a decoding unit 1504 and a first processing unit 1506 .

[0090] Among them, the acquisition unit 1502 is configured to acquire the coding block corresponding to the video image frame and the derivative mode adopted by the coding block; the decoding unit 1504 is configured to decode the multiple sub-blocks in the coding block according to the target division method corresponding to the derivative mode, and the target division method is selected from the improved division method of the derivative mode, and the improved division method of the derivative mode includes dividing the prediction block in the coding block whose side length is not an integer power of 2 into 2 sub-blocks whose side length is an integer power of 2; the first processing unit 1506 is configured to generate a reconstructed image according to the derivative mode adopted by the coding block and the multiple sub-coefficient blocks obtained by decoding the multiple sub-blocks.

[0091] In some embodiments of the present application, based on the aforementioned scheme, if the derivative mode is a horizontal derivative mode, the improved division method of the horizontal derivative mode includes: dividing the prediction block in the coding block whose height is an integer power of non-2 into 2 sub-blocks with a side ratio of 1:2 or 2:1 in the height direction.

[0092] In some embodiments of the present application, based on the aforementioned scheme, if the derivative mode is a vertical derivative mode, the improved division method of the vertical derivative mode includes: dividing the prediction block in the coding block whose width is an integer power of non-2 into 2 sub-blocks with a side ratio of 1:2 or 2:1 in the width direction.

[0093] In some embodiments of the present application, based on the aforementioned scheme, the first processing unit 1506 is configured as follows: if the coding block adopts an intra-frame derivation mode, then the multiple sub-coefficient blocks are dequantized and inverse transformed in sequence according to a predetermined order, and the images corresponding to the multiple sub-blocks are reconstructed in sequence according to the reconstructed residuals obtained by the dequantization and inverse transformation processes to generate the reconstructed image, wherein, during the reconstruction process, the reconstructed image corresponding to the sub-block in the preceding order is added to the intra-frame prediction reference image area of ​​the sub-block in the succeeding order.

[0094] In some embodiments of the present application, based on the above-mentioned scheme, the first processing unit 1506 is configured as: if the intra-frame derivative mode is an intra-frame horizontal derivative mode, the multiple sub-coefficient blocks are dequantized and inverse transformed in sequence from top to bottom, and the images corresponding to the multiple sub-blocks are reconstructed in sequence according to the reconstructed residuals obtained by the dequantization and inverse transformation; if the intra-frame derivative mode is an intra-frame vertical derivative mode, the multiple sub-coefficient blocks are dequantized and inverse transformed in sequence from left to right, and the images corresponding to the multiple sub-blocks are reconstructed in sequence according to the reconstructed residuals obtained by the dequantization and inverse transformation.

[0095] In some embodiments of the present application, based on the aforementioned scheme, the first processing unit 1506 is configured as follows: if the coding block adopts an inter-frame derivation mode, then the multiple sub-coefficient blocks are respectively subjected to inverse quantization processing and inverse transformation processing to obtain reconstruction residuals corresponding to the multiple sub-blocks; the reconstruction residuals corresponding to the multiple sub-blocks are respectively subjected to splicing processing to obtain reconstruction residuals corresponding to the multiple sub-blocks as a whole; and the reconstructed image is generated according to the reconstruction residuals corresponding to the multiple sub-blocks as a whole.

[0096] In some embodiments of the present application, based on the aforementioned solution, the target division method is a preset division method selected from the improved division methods of the derived model.

[0097] In some embodiments of the present application, based on the aforementioned scheme, the decoding unit 1504 is further configured to: determine the target division method according to the identification information decoded from the bit stream, and the target division method is selected by the encoding end from a plurality of division methods based on a rate-distortion optimization strategy, and the plurality of division methods include an improved division method of the derived mode and an original division method of the derived mode.

[0098] In some embodiments of the present application, based on the aforementioned solution, the decoding unit 1504 is further configured to: determine whether all coding blocks using the derivative mode in the coded data need to use the target division method according to the value of the index identifier contained in the sequence header of the coded data corresponding to the video image frame sequence; or

[0099] Determining, according to a value of an index identifier contained in a sequence header of the coded data corresponding to the video image frame sequence, whether all coded blocks in the coded data that adopt an intra-frame derivation mode need to adopt the target division method; or

[0100] According to the value of the index identifier contained in the sequence header of the coded data corresponding to the video image frame sequence, it is determined whether all the coded blocks in the coded data that adopt the inter-frame derivation mode need to adopt the target division method.

[0101] Fig.16 A schematic diagram of the structure of a computer system suitable for implementing an electronic device of an embodiment of the present application is shown.

[0102] It should be noted that Fig.16 The computer system 1600 of the electronic device shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present application.

[0103] like Fig.16 As shown, the computer system 1600 includes a central processing unit (CPU) 1601, which can perform various appropriate actions and processes according to the program stored in the read-only memory (ROM) 1602 or the program loaded from the storage part 1608 to the random access memory (RAM) 1603, such as executing the method described in the above embodiment. In RAM 1603, various programs and data required for system operation are also stored. CPU 1601, ROM 1602 and RAM 1603 are connected to each other through bus 1604. Input / output (I / O) interface 1605 is also connected to bus 1604.

[0104] The following components are connected to the I / O interface 1605: an input section 1606 including a keyboard, a mouse, etc.; an output section 1607 including a cathode ray tube (CRT), a liquid crystal display (LCD), etc., and a speaker, etc.; a storage section 1608 including a hard disk, etc.; and a communication section 1609 including a network interface card such as a LAN (Local Area Network) card, a modem, etc. The communication section 1609 performs communication processing via a network such as the Internet. A drive 1610 is also connected to the I / O interface 1605 as needed. A removable medium 1611, such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, etc., is installed on the drive 1610 as needed so that a computer program read therefrom is installed into the storage section 1608 as needed.

[0105] In particular, according to an embodiment of the present application, the process described above with reference to the flowchart can be implemented as a computer software program. For example, an embodiment of the present application includes a computer program product, which includes a computer program carried on a computer-readable medium, and the computer program includes a computer program for executing the method shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network through a communication section 1609, and / or installed from a removable medium 1611. When the computer program is executed by a central processing unit (CPU) 1601, various functions defined in the system of the present application are executed.

[0106] It should be noted that the computer-readable medium shown in the embodiment of the present application may be a computer-readable signal medium or a computer-readable storage medium or any combination of the above two. The computer-readable storage medium may be, for example, - but not limited to - an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM), a flash memory, an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program, which may be used by an instruction execution system, device or device or used in combination with it. In the present application, a computer-readable signal medium may include a data signal propagated in a baseband or as part of a carrier wave, wherein a computer-readable computer program is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Computer-readable signal media may also be any computer-readable medium other than computer-readable storage media, which may send, propagate, or transmit programs for use by or in conjunction with an instruction execution system, apparatus, or device. The computer program contained on the computer-readable medium may be transmitted using any appropriate medium, including but not limited to: wireless, wired, etc., or any suitable combination of the above.

[0107] The flowchart and block diagram in the accompanying drawings illustrate the possible architecture, functions and operations of the system, method and computer program product according to various embodiments of the present application. Wherein, each box in the flowchart or block diagram can represent a module, a program segment, or a part of the code, and the above-mentioned module, program segment, or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram or flowchart, and the combination of boxes in the block diagram or flowchart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0108] The units involved in the embodiments described in this application may be implemented by software or hardware, and the units described may also be set in a processor. The names of these units do not, in some cases, constitute limitations on the units themselves.

[0109] As another aspect, the present application also provides a computer-readable medium, which may be included in the electronic device described in the above embodiment; or may exist independently without being assembled into the electronic device. The above computer-readable medium carries one or more programs, and when the above one or more programs are executed by an electronic device, the electronic device implements the method described in the above embodiment.

[0110] It should be noted that, although several modules or units of the equipment for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present application, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into being embodied by multiple modules or units.

[0111] Through the description of the above implementation methods, it is easy for those skilled in the art to understand that the example implementation methods described here can be implemented by software or by combining software with necessary hardware. Therefore, the technical solution according to the implementation methods of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, and includes several instructions to enable a computing device (which can be a personal computer, a server, a touch terminal, or a network device, etc.) to execute the method according to the implementation methods of the present application.

[0112] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. The present application is intended to cover any variations, uses or adaptations of the present application, which follow the general principles of the present application and include common knowledge or customary technical means in the art that are not disclosed in the present application.

[0113] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A video decoding method, characterized in that: include: Obtaining a coding block corresponding to a video image frame and a derivative mode adopted by the coding block; Determine, according to identification information obtained by decoding from a bitstream, a target partitioning method corresponding to the derived mode, wherein the target partitioning method is selected by the encoder from a plurality of partitioning methods based on a rate-distortion optimization strategy, wherein the plurality of partitioning methods include an improved partitioning method of the derived mode and an original partitioning method of the derived mode; wherein the improved partitioning method of the derived mode includes a partitioning method of dividing a prediction block in the coding block whose side length is not an integer power of 2 into two sub-blocks whose side lengths are integer powers of 2; Decoding multiple sub-blocks in the coding block according to the target partitioning method corresponding to the derived mode; Generate a reconstructed image according to the derivative mode adopted by the coding block and the multiple sub-coefficient blocks obtained by decoding the multiple sub-blocks; The reconstructed image is generated according to the derivative mode adopted by the coding block and the multiple sub-coefficient blocks obtained by decoding the multiple sub-blocks as units, including: If the coding block adopts the intra-frame horizontal derivation mode, the multiple sub-coefficient blocks are dequantized and inversely transformed in sequence from top to bottom; if the coding block adopts the intra-frame vertical derivation mode, the multiple sub-coefficient blocks are dequantized and inversely transformed in sequence from left to right; the images corresponding to the multiple sub-blocks are reconstructed in sequence according to the reconstruction residuals obtained by the dequantization and inverse transformation to generate the reconstructed image; wherein, during the reconstruction process, the reconstructed image corresponding to the sub-block in the previous order is added to the intra-frame prediction reference image area of ​​the sub-block in the subsequent order.

2. The video decoding method according to claim 1, characterized in that: If the derivative mode is a horizontal derivative mode, the improved division method of the horizontal derivative mode includes: A division method of dividing a prediction block in the coding block whose height is not an integer power of 2 into two sub-blocks with a side length ratio of 1:2 or 2:1 in a height direction.

3. The video decoding method according to claim 1, characterized in that: If the derivative mode is a vertical derivative mode, the improved division method of the vertical derivative mode includes: A division method of dividing a prediction block in the coding block whose width is not an integer power of 2 into two sub-blocks with a side length ratio of 1:2 or 2:1 in the width direction.

4. The video decoding method according to claim 1, characterized in that: Generating a reconstructed image according to the derivative mode adopted by the coding block and a plurality of sub-coefficient blocks obtained by decoding the plurality of sub-blocks as units, including: If the coding block adopts the inter-frame derivation mode, the multiple sub-coefficient blocks are respectively subjected to inverse quantization processing and inverse transformation processing to obtain reconstruction residuals corresponding to the multiple sub-blocks respectively; Concatenating the reconstruction residuals corresponding to the multiple sub-blocks to obtain the reconstruction residuals corresponding to the multiple sub-blocks as a whole; The reconstructed image is generated according to the reconstruction residuals corresponding to the multiple sub-blocks as a whole.

5. The video decoding method according to any one of claims 1 to 4, characterized in that: The video decoding method further comprises: According to the value of the index identifier contained in the sequence header of the coded data corresponding to the video image frame sequence, it is determined whether all the coded blocks in the coded data that adopt the derivative mode need to adopt the target division method.

6. The video decoding method according to any one of claims 1 to 4, characterized in that: The video decoding method further comprises: Determining, according to a value of an index identifier contained in a sequence header of the coded data corresponding to the video image frame sequence, whether all coded blocks in the coded data that adopt an intra-frame derivation mode need to adopt the target division method; or According to the value of the index identifier contained in the sequence header of the coded data corresponding to the video image frame sequence, it is determined whether all the coded blocks in the coded data that adopt the inter-frame derivation mode need to adopt the target division method.

7. A video decoding device, characterized in that: include: An acquisition unit, configured to acquire a coding block corresponding to a video image frame and a derivative mode adopted by the coding block; A decoding unit is configured to determine, according to identification information decoded from a bitstream, a target partitioning method corresponding to the derived mode, wherein the target partitioning method is selected by the encoder from a plurality of partitioning methods based on a rate-distortion optimization strategy, wherein the plurality of partitioning methods include an improved partitioning method of the derived mode and an original partitioning method of the derived mode; wherein the improved partitioning method of the derived mode includes a partitioning method of dividing a prediction block in the coding block whose side length is not an integer power of 2 into two sub-blocks whose side length is an integer power of 2; and performing decoding processing on a plurality of sub-blocks in the coding block according to the target partitioning method corresponding to the derived mode; A first processing unit is configured to generate a reconstructed image according to a derivative mode adopted by the coding block and a plurality of sub-coefficient blocks obtained by decoding the plurality of sub-blocks; Among them, the first processing unit is configured as follows: if the coding block adopts the intra-frame horizontal derivation mode, the multiple sub-coefficient blocks are dequantized and inversely transformed in sequence from top to bottom; if the coding block adopts the intra-frame vertical derivation mode, the multiple sub-coefficient blocks are dequantized and inversely transformed in sequence from left to right; the images corresponding to the multiple sub-blocks are reconstructed in sequence according to the reconstruction residuals obtained by the dequantization and inverse transformation processes to generate the reconstructed image; wherein, during the reconstruction process, the reconstructed image corresponding to the sub-block in the previous order is added to the intra-frame prediction reference image area of ​​the sub-block in the subsequent order.

8. A computer readable medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the video decoding method according to any one of claims 1 to 6 is implemented.

9. An electronic device, characterized in that: include: one or more processors; A storage device for storing one or more programs, when the one or more programs are executed by the one or more processors, enables the one or more processors to implement the video decoding method according to any one of claims 1 to 6.

10. A computer program product, characterized in that The computer program product includes a computer program, which is stored in a computer-readable storage medium. A processor of an electronic device reads and executes the computer program from the computer-readable storage medium, so that the electronic device performs the video decoding method according to any one of claims 1 to 6.

11. A method for processing a video code stream, characterized in that: The video code stream is decoded based on the video decoding method according to any one of claims 1 to 6.

Citation Information

Patent Citations

  • Block partitioning using tree structures

    US20180109812A1