Image decoding methods, decoders, and computer storage media
By adding control identifiers to the bitstream to control the dependencies between image components, the problem of high complexity in cross-component dependency encoding and decoding is solved, and parallel encoding and decoding and efficiency improvement are achieved in fast processing or high-parallel processing scenarios.
Patent Information
- Application Number
- CN202511458742.3
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-01-10
- Filing Date
- 2019-03-14
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2039-03-14
AI Technical Summary
In scenarios requiring fast or highly parallel processing, existing cross-component dependency encoding and decoding methods have high encoding and decoding complexity and cannot effectively perform parallel encoding and decoding.
By adding control flags to the bitstream, the dependencies between image components can be controlled, enabling or disabling cross-decoding across components, thus achieving independent or cross-decoding of image components and reducing encoding and decoding complexity.
In scenarios involving fast or highly parallel processing, parallel encoding and decoding are implemented, reducing encoding and decoding complexity and improving encoding efficiency.
Smart Images

Figure CN120980235B_ABST
Abstract
Description
Technical Field
[0001] This application relates to the field of video image encoding and decoding technology, and in particular to an image decoding method, a decoder, and a computer storage medium. Background Technology
[0002] The next-generation video coding standard H.266 or Versatile Video Coding (VVC) allows for cross-component dependencies, enabling predictions of luminance values to chrominance values, or between chrominance values, through Cross-component Linear Model Prediction (CCLM) and Direct Mode (DM).
[0003] Although cross-component dependency encoding and decoding methods such as CCLM can improve encoding efficiency, they cannot be effectively used for parallel encoding and decoding in scenarios that require fast processing or high parallel processing, and have the drawback of high complexity. Summary of the Invention
[0004] This application provides an image decoding method, a decoder, and a computer storage medium, which can achieve parallel encoding and decoding in scenarios requiring fast processing or high parallel processing, thereby reducing the complexity of encoding and decoding.
[0005] The technical solution of this application embodiment is implemented as follows: This application provides an image decoding method, the method comprising: Get the bitstream corresponding to the current video image; The bitstream is parsed to obtain the control identifier corresponding to the current video image; When the decoding method corresponding to the control identifier is image component cross-decoding, the inter-component cross-decoding function is enabled; wherein, the inter-component cross-decoding function is used to perform decoding processing based on the dependency between image components, the image components include at least two image components among a first image component, a second image component, and a third image component, and the at least two image components include two different chroma components.
[0006] This application provides an image decoding method, a decoder, and a computer storage medium. The decoder acquires the bitstream corresponding to the current video image; parses the bitstream to obtain a control identifier corresponding to the current video image; when the decoding method corresponding to the control identifier is image component cross-decoding, the inter-component cross-decoding function is enabled. The inter-component cross-decoding function is used for decoding based on the dependencies between image components. The image components include at least two of a first image component, a second image component, and a third image component, and the at least two image components include two different chroma components. In other words, in this application's embodiment, the decoder can first parse the bitstream corresponding to the current video image to obtain a control identifier in the bitstream used to determine whether dependencies between image components are allowed. If the decoding method corresponding to the control identifier is image component cross-decoding, i.e., it supports dependencies between image components, then the decoder needs to enable the inter-component cross-decoding function. That is, the decoder performs decoding processing on the current video image based on the dependencies between image components using the improved inter-component cross-decoding function. This allows for parallel encoding and decoding in scenarios requiring fast processing or high parallel processing, reducing the complexity of encoding and decoding. At the same time, in these scenarios, the bits that are not dependent on decoding between image components are omitted in the CU layer, thus improving the coding efficiency in these scenarios. Attached Figure Description
[0007] Figure 1 This is a schematic diagram of the composition and structure of a video encoding system; Figure 2 This is a schematic diagram of the composition and structure of a video decoding system; Figure 3 A schematic diagram of the implementation process of an image decoding method proposed in this application embodiment. Figure 1 ; Figure 4 A schematic diagram of the implementation process of an image decoding method proposed in this application embodiment. Figure 2 ; Figure 5 A schematic diagram of the implementation process of an image decoding method proposed in this application embodiment. Figure 3 ; Figure 6 A schematic diagram of the implementation process of an image decoding method proposed in this application embodiment. Figure 4 ; Figure 7 A schematic diagram of the implementation process of an image decoding method proposed in this application embodiment. Figure 5 ; Figure 8 A schematic diagram of the decoder structure proposed in the embodiments of this application. Figure 1 ; Figure 9A schematic diagram of the decoder structure proposed in the embodiments of this application. Figure 2 . Detailed Implementation
[0008] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. It is understood that the specific embodiments described herein are merely for explaining the relevant application and not for limiting the application. Furthermore, it should be noted that, for ease of description, only the parts relevant to the application are shown in the accompanying drawings.
[0009] Encoding video involves encoding each frame of an image; similarly, decoding the compressed video stream involves decoding each frame of the stream. In almost all international video encoding standards, encoding a single frame requires dividing it into several MxM pixel sub-images called Coding Units (CUs). These CUs are used as the basic encoding unit, and each sub-image is encoded block by block. Commonly used sizes for M are 4, 8, 16, 32, and 64. Therefore, encoding a video image sequence involves encoding each CU of each frame sequentially; decoding a video image sequence also involves decoding each CU of each frame sequentially, ultimately reconstructing the entire video image sequence.
[0010] In video images, a coding block is typically represented by a first image component, a second image component, and a third image component. Specifically, the first, second, and third image components represent a luminance component, a blue chrominance component, and a red chrominance component, respectively. The luminance component is usually represented by the symbol Y, the blue chrominance component by the symbol Cb, and the red chrominance component by the symbol Cr.
[0011] It should be noted that, in the embodiments of this application, the first image component, the second image component, and the third image component can be the luminance component Y, the blue chrominance component Cb, and the red chrominance component Cr, respectively. For example, the first image component can be the luminance component Y, the second image component can be the red chrominance component Cr, and the third image component can be the blue chrominance component Cb. The embodiments of this application do not specifically limit this.
[0012] In H.266, to further improve coding performance and efficiency, cross-component prediction (CCP) has been extended and improved. In H.266, CCLM implements prediction between a first image component and a second image component, between a first image component and a third image component, and between the second and third image components. That is, in addition to methods for predicting chrominance components using the luminance component (i.e., predicting the second image component using the first image component or the third image component using the first image component), the CCLM prediction mode also includes prediction between two chrominance components, i.e., prediction between the second and third image components. Specifically, in the embodiments of this application, the prediction method between the second and third image components can predict the Cr component from the Cb component or vice versa.
[0013] For video coding standards that allow cross-component dependencies, such as CCLM and DM, these tools are likely to be used in future media coding for 3D video, point clouds, and more. These techniques can significantly improve coding efficiency because they can use the luma component to predict chroma components, coding modes, and residuals, and prediction between chroma components is also possible. However, cross-component dependencies also present challenges for parallel encoding and decoding. In other words, in some scenarios, it may be necessary to disable dependencies between luma and chroma components, between different chroma components, or between different color components to reduce the complexity of the encoding and decoding process.
[0014] This application proposes a method to add a control flag to the bitstream to indicate whether cross-encoding and decoding between different image components is allowed. This enables technologies such as CCLM and DM, allowing the codec to be effectively used for parallel encoding and decoding, overcoming the drawback of high encoding and decoding complexity. Figure 1 This is a schematic diagram of the composition and structure of a video encoding system, such as... Figure 1As shown, the video coding system 200 includes a transform and quantization unit 201, an intra-frame estimation unit 202, an intra-frame prediction unit 203, a motion compensation unit 204, a motion estimation unit 205, an inverse transform and inverse quantization unit 206, a filter control and analysis unit 207, a filtering unit 208, an entropy coding unit 209, and a current video image buffer unit 210. Among them, the filtering unit 208 can implement deblocking filtering and sample adaptive offset (SAO) filtering, and the entropy coding unit 209 can implement header information encoding and context-based adaptive binary arithmetic coding (CABAC).
[0015] For the input raw video signal, initial partitioning yields Coding Tree Units (CTUs). Further content-adaptive partitioning of a CTU results in Coding Units (CUs), which typically contain one or more coding blocks (Coding Modules). The video coding block (CB) is then transformed by the transform and quantization unit 201 using the residual pixel information obtained after intra-frame or inter-frame prediction. This transformation includes transforming the residual information from the pixel domain to the transform domain and quantizing the resulting transform coefficients to further reduce the bit rate. The intra-frame estimation unit 202 and the intra-frame prediction unit 203 are used to perform intra-frame prediction on the video coding block. Specifically, the intra-frame estimation unit 202 and the intra-frame prediction unit 203 are used to determine the intra-frame prediction mode to be used to encode the video coding block. The motion compensation unit 204 and the motion estimation unit 205 are used to perform inter-frame prediction coding of the received video coding block relative to one or more blocks in one or more reference frames to provide temporal prediction information. The motion estimation performed by the motion estimation unit 205 is a process of generating motion vectors that can estimate the motion of the video coding block. Then, the motion compensation unit 204 performs motion compensation based on the motion vectors determined by the motion estimation unit 205. After determining the intra-prediction mode, the intra-prediction unit 203 provides the selected intra-prediction data to the entropy coding unit 209, and the motion estimation unit 205 also sends the calculated motion vector data to the entropy coding unit 209. Furthermore, the inverse transform and inverse quantization unit 206 reconstructs the video coding block, reconstructing a residual block in the pixel domain. This reconstructed residual block is then processed by the filter control analysis unit 207 and the filtering unit 208 to remove block artifacts. The reconstructed residual block is then added to a predictive block in the frame of the current video image buffer unit 210 to generate the reconstructed video coding block. The entropy coding unit 209 encodes various coding parameters and quantized transform coefficients. In the CABAC-based coding algorithm, the context content can be based on adjacent coding blocks and can be used to encode information indicating the determined intra-prediction mode, outputting the bitstream of the video signal. The current video image buffer unit 210 stores the reconstructed video coding block for prediction reference. As video image encoding proceeds, new reconstructed video encoding blocks are continuously generated, and these reconstructed video encoding blocks are stored in the current video image buffer unit 210.
[0016] Figure 2 This is a schematic diagram of the composition and structure of a video decoding system, such as... Figure 2As shown, the video decoding system 300 includes an entropy decoding unit 301, an inverse transform and inverse quantization unit 302, an intra-frame prediction unit 303, a motion compensation unit 304, a filtering unit 305, and a current video image buffer unit 306. The entropy decoding unit 301 can perform header information decoding and CABAC decoding, while the filtering unit 305 can perform deblocking filtering and SAO filtering. The input video signal is processed... Figure 2 After encoding, the video signal bitstream is output. This bitstream is input into the video decoding system 300, first passing through the entropy decoding unit 301 to obtain the decoded transform coefficients. These transform coefficients are then processed by the inverse transform and inverse quantization unit 302 to generate residual blocks in the pixel domain. The intra-frame prediction unit 303 can generate prediction data for the current video decoding block based on the determined intra-frame prediction mode and data from previously decoded blocks in the current frame or image. The motion compensation unit 304 determines the prediction information for the video decoding block by analyzing motion vectors and other associated syntax elements, and uses this prediction information to... A predictive block is generated for the video block being decoded. The decoded video block is formed by summing the residual block from the inverse transform and inverse quantization unit 302 with the corresponding predictive block generated by the intra-prediction unit 303 or the motion compensation unit 304. The decoded video signal is filtered by the filtering unit 305 to remove block artifacts, which can improve video quality. The decoded video block is then stored in the current video image buffer unit 306, which stores reference images for subsequent intra-prediction or motion compensation and is also used for the output of the video signal, thus obtaining the recovered original video signal.
[0017] The technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings.
[0018] In one embodiment, this application provides an image decoding method. Figure 3 This is a schematic diagram of the implementation process of an image decoding method proposed in an embodiment of this application. Figure 1 ,like Figure 3 As shown in the embodiments of this application, the method for image decoding by the decoder described above may include the following steps: Step 101: Obtain the bitstream corresponding to the current video image.
[0019] In the embodiments of this application, the decoder may first obtain the bitstream corresponding to the current video image.
[0020] Furthermore, in the implementation of this application, bitrate (data rate), also known as bit rate, refers to the amount of data used by a video file per unit time, and is an important part of picture quality control in video encoding.
[0021] It should be noted that, in the implementation of this application, after the encoder encodes the current video image, it can generate corresponding bitstream data for storage or transmission. Correspondingly, when the decoder decodes the current video image, it can first receive the bitstream corresponding to the current video image.
[0022] Step 102: Parse the bitstream to obtain the control identifier corresponding to the current video image.
[0023] In the embodiments of this application, after the decoder obtains the bitstream corresponding to the current video image, it can perform parsing processing on the bitstream to obtain the control identifier corresponding to the current video image.
[0024] It should be noted that, in the implementation of this application, the control identifier can be used to characterize the relationship between different image components corresponding to the current video image. Specifically, in the embodiments of this application, the relationship between different image components corresponding to the current video image can be mutually dependent, or the relationship between different image components corresponding to the current video image can be mutually independent.
[0025] Furthermore, when encoding the current video image, the encoder can determine the control flag based on the relationships between different components in the current video image. For example, if the encoder disables the dependencies between different image components during the encoding process, that is, disables the dependencies between the luma component and the chroma component, and between different chroma components, then the encoder sets the control flag to 0 in the bitstream; if the encoder enables the dependencies between different image components during the encoding process, that is, enables the dependencies between the luma component and the chroma component, and between different chroma components, then the encoder sets the control flag to 1 in the bitstream.
[0026] Accordingly, when the decoder parses the bitstream corresponding to the current video image, if the control flag in the parsed bitstream is 1, then the decoder can assume that the dependency relationship between different image components needs to be enabled when decoding the video image, that is, the dependency relationship between the luma component and the chroma component, and between different chroma components. If the control flag in the parsed bitstream is 0, then the decoder can assume that the dependency relationship between different image components needs to be disabled when decoding the video image, that is, the dependency relationship between the luma component and the chroma component, and between different chroma components.
[0027] It should be noted that, in the embodiments of this application, since the different image components corresponding to the current video image may include a first image component, a second image component, and a third image component, that is, they may include the three image components Y, Cb, and Cr, the decoder, when representing the relationship between the different image components corresponding to the current video image through the control identifier, can either represent the mutual dependence or mutual independence between the first image component, the second image component, and the third image component through the control identifier, or it can represent the mutual dependence or mutual independence between at least two of the first image component, the second image component, and the third image component through the control identifier. Furthermore, in the implementation of this application, after the decoder parses the bitstream corresponding to the current video image, the parsed control identifier may be located in one or more of the following in the bitstream: Sequence Parameter Set (SPS), Picture Parameter Set (PPS), Supplemental Enhancement Information (SEI), Coding Tree Unit, and Coding Unit.
[0028] In the H.264 / AVC video coding standard, the entire system framework is divided into two layers: the Network Abstraction Layer (NAL) and the Video Coding Layer (VCL). The VCL is responsible for effectively representing the content of the video data, while the NAL is responsible for formatting the data and providing header information to ensure that the data is suitable for transmission on various channels and storage media.
[0029] Furthermore, the H.264 standard protocol specifies several different NAL Unit types, each storing different data. Specifically, the first NAL Unit in an H.264 bitstream is SPS; the second is PPS; and the third is Instantaneous Decoding Refresh (IDR).
[0030] It should be noted that, in the embodiments of this application, apart from SPS and PPS, each frame of data corresponding to the video image is a NAL Unit.
[0031] Furthermore, in the embodiments of this application, the information in the SPS is crucial; if the data in the SPS is lost or erroneous, the decoding process is likely to fail. Specifically, the SPS is also commonly used as initialization information for decoder instances in video processing frameworks on certain platforms, such as iOS's VideoToolBox.
[0032] It should be noted that, in the embodiments of this application, the SPS stores a set of global parameters for the encoded video sequence. The so-called encoded video sequence is a sequence composed of the encoded pixel data of the original video frame by frame. The parameters upon which the encoded data of each frame depends are stored in the PPS.
[0033] Furthermore, the NAL Units of SPS and PPS are typically located at the beginning of the entire bitstream. However, in certain special cases, these two structures may also appear in the middle of the bitstream. This is because the decoder needs to start decoding in the middle of the bitstream, or it may be because the encoder changes the parameters of the bitstream (such as image resolution) during the encoding process.
[0034] Step 103: When the decoding method corresponding to the control identifier is independent decoding of image components, disable the inter-component cross-decoding function; wherein, the inter-component cross-decoding function is used to perform decoding processing based on the dependency between image components.
[0035] In the embodiments of this application, after the decoder parses the bitstream and obtains the control identifier corresponding to the current video image, if the decoding method corresponding to the control identifier is independent decoding of image components, then the decoder can disable the inter-component cross-decoding function.
[0036] It should be noted that, in the implementation of this application, the inter-component cross-decoding function is used for decoding based on the dependencies between image components. That is, when decoding the current video image, the inter-component cross-decoding function indicates that cross-component dependencies are allowed, meaning that the decoder can decode the current video image using methods such as CCLM or DM.
[0037] Furthermore, in the implementation of this application, after the decoder parses and obtains the control identifier in the bit stream, it can first determine the decoding method corresponding to the control identifier. Specifically, the decoding method corresponding to the control identifier is independent decoding of image components or cross-decoding of image components.
[0038] It should be noted that in the implementation of this application, when the decoding method corresponding to the control identifier is independent image component decoding, the decoder cannot utilize the dependencies between different image components for decoding processing; that is, it needs to perform independent decoding processing according to one image component. For example, if the control identifier in the bitstream obtained by the decoder is 0, it can be assumed that the encoder, when encoding the current video image, has closed the dependencies between the luma and chroma components, and between different chroma components. Therefore, it can be determined that the decoding method corresponding to the control identifier is independent image component decoding, and the decoder also needs to close the dependencies between the luma and chroma components, and between different chroma components, before performing decoding processing on the current video image.
[0039] It should be noted that, in the embodiments of this application, when the decoder represents the relationship between different image components corresponding to the current video image through the control identifier, it can represent the interdependence or independence between the first, second, and third image components, or it can represent the interdependence or independence between at least two of the first, second, and third image components. Therefore, the decoding method corresponding to the control identifier can include independent decoding of image components between the three image components and cross-decoding of image components between the three image components, or it can include independent decoding of image components between any two image components and cross-decoding of image components between any two image components. For example, when the control flag represents the relationship between the three image components Y, Cb, and Cr, if the control flag in the bitstream is 1, it can be assumed that the encoder has enabled the dependencies between the luma and chroma components, and between different chroma components, when encoding the current video image. In this case, the decoder can enable the dependencies between the three different image components Y, Cb, and Cr. When the control flag represents the relationship between the two image components Cb and Cr, if the control flag in the bitstream is 0, it can be assumed that the encoder has disabled the dependencies between different chroma components when encoding the current video image. In this case, the decoder can disable the dependencies between the two image components Cb and Cr, but the dependencies between the image components Y and Cb, and Y and Cr, do not need to be disabled.
[0040] In the implementation of this application, further, Figure 4 This is a schematic diagram of the implementation process of an image decoding method proposed in an embodiment of this application. Figure 2 ,like Figure 4 As shown, after parsing the bitstream and obtaining the control identifier corresponding to the current video image, i.e., after step 102, the decoder's image decoding method may further include the following steps: Step 104: When the decoding method corresponding to the control identifier is image component cross decoding, enable the inter-component cross decoding function.
[0041] In the embodiments of this application, after the decoder parses the bitstream and obtains the control identifier corresponding to the current video image, if the decoding method corresponding to the control identifier is image component cross-decoding, then the decoder can enable the inter-component cross-decoding function.
[0042] It should be noted that, in the implementation of this application, after the decoder obtains the control identifier by decoding the bitstream, if the decoding method corresponding to the control identifier is image component cross-decoding, then the decoder can utilize the dependencies between different image components for decoding processing. That is, it can decode the current video image using methods such as CCLM or DM. For example, if the control identifier in the bitstream obtained by the decoder is 1, it can be assumed that the encoder enabled the dependencies between the luma and chroma components, and between different chroma components, when encoding the current video image. Therefore, it can be determined that the decoding method corresponding to the control identifier is image component cross-decoding, and the decoder can also enable the dependencies between the luma and chroma components, and between different chroma components, and then decode the current video image.
[0043] In the implementation of this application, further, Figure 5 This is a schematic diagram of the implementation process of an image decoding method proposed in an embodiment of this application. Figure 3 ,like Figure 5 As shown, after parsing the bitstream and obtaining the control identifier corresponding to the current video image, i.e., after step 102, the decoder's image decoding method may further include the following steps: Step 105: When the decoding method corresponding to the control identifier is DM disabled, turn off the DM representation mode.
[0044] In the embodiments of this application, after the decoder parses the bitstream and obtains the control identifier corresponding to the current video image, if the decoding method corresponding to the control identifier is DM disabled, then the decoder can turn off the DM representation mode.
[0045] It should be noted that, in the implementation of this application, the control flag in the bitstream can also enable or disable DM technology. Specifically, if the decoding mode corresponding to the control flag is DM disabled, then the decoder needs to disable the DM expression mode when decoding the current video image; if the decoding mode corresponding to the control flag is DM enabled, then the decoder needs to enable the DM expression mode when decoding the current video image.
[0046] Furthermore, in the embodiments of this application, the control flag in the bitstream can also enable or disable any technology or expression mode that requires inter-image component dependency. That is to say, in the implementation of this application, the control flag in the bitstream is not only an enabling tool for DM technology, but can also be an enabling tool for other technologies that require inter-image component dependency; this application does not make specific limitations.
[0047] This application proposes an image decoding method in which a decoder acquires the bitstream corresponding to the current video image; parses the bitstream to obtain a control identifier corresponding to the current video image; and disables inter-component cross-decoding when the decoding method corresponding to the control identifier is independent image component decoding. The inter-component cross-decoding function is used for decoding based on the dependencies between image components. In other words, in the embodiments of this application, the decoder can first parse the bitstream corresponding to the current video image to obtain a control identifier in the bitstream used to determine whether dependencies between image components are allowed. If the decoding method corresponding to the control identifier is independent image component decoding, i.e., it does not support dependencies between image components, then the decoder needs to disable the inter-component cross-decoding function. That is, the decoder does not perform decoding processing on the current video image based on the dependencies between image components. This allows for parallel encoding and decoding in scenarios requiring fast processing or high parallel processing, reducing encoding and decoding complexity. Simultaneously, in these scenarios, the bits representing non-decoding dependencies between image components at the CU layer are omitted, improving encoding efficiency in these scenarios.
[0048] Based on the above embodiments, in another embodiment of this application, the image components in steps 101 to 103 may include a first image component, a second image component, and a third image component. The first image component, the second image component, and the third image component may be a luminance component Y, a blue chromaticity component Cb, and a red chromaticity component Cr, respectively. For example, the first image component may be the luminance component Y, the second image component may be the red chromaticity component Cr, and the third image component may be the blue chromaticity component Cb. This application does not specifically limit this aspect.
[0049] In the implementation of this application, further, Figure 6 This is a schematic diagram of the implementation process of an image decoding method proposed in an embodiment of this application. Figure 4 ,like Figure 6 As shown, for the method described in steps 101 to 105 above, the method of the decoder parsing the bitstream to obtain the control identifier corresponding to the current video image may include the following steps: Step 201: After parsing the bitstream, obtain the control identifier from the SPS in the bitstream.
[0050] In the implementation of this application, after the decoder obtains the bitstream corresponding to the current video image, it can perform parsing processing on the bitstream and obtain the control identifier corresponding to the current video image in the SPS in the bitstream.
[0051] It should be noted that, in the embodiments of this application, after the decoder parses the bitstream corresponding to the current video image, the parsed control identifier can be located in the SPS. Specifically, since the SPS stores a set of global parameters of the encoded video sequence, if the decoder obtains the control identifier in the SPS of the bitstream, then the control identifier can be applied to all image frames of the current video image.
[0052] Furthermore, in the implementation of this application, if the decoder obtains the control identifier in the SPS, then the decoder can perform corresponding decoding processing on all image frames of the current video image according to the control identifier. For example, if the decoding method corresponding to the control identifier is image component cross-decoding, then the decoder can enable the inter-component cross-decoding function and use the dependency relationship between different image components to decode all image frames, that is, it can decode all image frames through CCLM or DM, etc.
[0053] Step 202: After parsing the bitstream, obtain the control identifier from the PPS in the bitstream.
[0054] In the implementation of this application, after the decoder obtains the bitstream corresponding to the current video image, it can perform parsing processing on the bitstream and obtain the control identifier corresponding to the current video image from the PPS in the bitstream.
[0055] It should be noted that, in the embodiments of this application, after the decoder parses the bitstream corresponding to the current video image, the parsed control identifier can be located in the PPS. Specifically, since the PPS stores the parameters on which the encoded data of a frame of image depends, if the decoder obtains the control identifier in the PPS in the bitstream, then the control identifier can be applied to the frame of image corresponding to the PPS in the current video image.
[0056] Furthermore, in the implementation of this application, if the decoder obtains the control identifier in the PPS, then the decoder can perform corresponding decoding processing on the frame image in the current video image corresponding to the PPS according to the control identifier. For example, if the decoding method corresponding to the control identifier is image component cross-decoding, then the decoder can enable the inter-component cross-decoding function and use the dependency relationship between different image components to decode the frame image in the current video image corresponding to the PPS, that is, it can decode the frame image in the current video image corresponding to the PPS through CCLM or DM, etc.
[0057] Step 203: After parsing the bit stream, obtain the control identifier from the SEI in the bit stream.
[0058] In the implementation of this application, after the decoder obtains the bitstream corresponding to the current video image, it can perform parsing processing on the bitstream and obtain the control identifier corresponding to the current video image in the SEI of the bitstream.
[0059] It should be noted that, in the embodiments of this application, after the decoder parses the bitstream corresponding to the current video image, the parsed control identifier can be located in the SEI. Specifically, since the SEI plays an auxiliary role in the decoding process and is used to add video additional information to the bitstream, if the decoder obtains the control identifier in the SEI in the bitstream, then the control identifier can be applied to the image information corresponding to the SEI in the current video image.
[0060] In this application, the parsed control identifier can be located in one or more of the SPS, PPS, SEI, coding tree unit, and coding unit in the bitstream. Accordingly, when processing the current video image, the decoder can perform adaptive decoding processing on the corresponding video image information based on the specific position of the control identifier in the bitstream.
[0061] This application proposes an image decoding method in which a decoder obtains the bitstream corresponding to the current video image; parses the bitstream to obtain a control identifier corresponding to the current video image; and disables inter-component cross-decoding when the decoding method corresponding to the control identifier is independent image component decoding. The inter-component cross-decoding function is used for decoding based on the dependencies between image components. In other words, in the embodiments of this application, the decoder can first parse the bitstream corresponding to the current video image to obtain a control identifier in the bitstream used to determine whether dependencies between image components are allowed. If the decoding method corresponding to the control identifier is independent image component decoding, i.e., it does not support dependencies between image components, then the decoder needs to disable the inter-component cross-decoding function. That is, the decoder does not perform decoding processing on the current video image based on the dependencies between image components. This allows for parallel encoding and decoding in scenarios requiring fast processing or high parallel processing, reducing the complexity of encoding and decoding.
[0062] Based on the above embodiments, in another embodiment of this application, further, Figure 7 This is a schematic diagram of the implementation process of an image decoding method proposed in an embodiment of this application. Figure 5 ,like Figure 7As shown, when the decoding method corresponding to the control identifier is image component cross-decoding, after the decoder enables the inter-component cross-decoding function, that is, after step 104 above, the method of image decoding by the decoder may further include the following steps: Step 106: Decode the current video image according to DM.
[0063] In the embodiments of this application, if the decoding method corresponding to the control identifier is image component cross-decoding, then the decoder can perform decoding processing on the current video image according to DM after enabling the inter-component cross-decoding function.
[0064] Furthermore, in the implementation of this application, in order to reduce redundancy between luminance components and chrominance components and between different chrominance components, the DM method uses a component substitution representation of the prediction mode in the H.266 / VVC Joint Exploration Model (JEM) or VVC Test model (VTM) when predicting from luminance components to chrominance components.
[0065] In the implementation of this application, when the decoding method corresponding to the control identifier is image component cross-decoding, after the decoder enables the inter-component cross-decoding function, that is, after step 104 above, the decoder can not only decode the current video image according to CCLM or DM, but also use any technology that requires inter-component dependency to decode the current video image. This application does not make any specific limitations.
[0066] This application proposes an image decoding method in which a decoder obtains the bitstream corresponding to the current video image; parses the bitstream to obtain a control identifier corresponding to the current video image; and disables inter-component cross-decoding when the decoding method corresponding to the control identifier is independent image component decoding. The inter-component cross-decoding function is used for decoding based on the dependencies between image components. In other words, in the embodiments of this application, the decoder can first parse the bitstream corresponding to the current video image to obtain a control identifier in the bitstream used to determine whether dependencies between image components are allowed. If the decoding method corresponding to the control identifier is independent image component decoding, i.e., it does not support dependencies between image components, then the decoder needs to disable the inter-component cross-decoding function. That is, the decoder does not perform decoding processing on the current video image based on the dependencies between image components. This allows for parallel encoding and decoding in scenarios requiring fast processing or high parallel processing, reducing the complexity of encoding and decoding.
[0067] Based on the above embodiments, in another embodiment of this application, Figure 8 A schematic diagram of the decoder structure proposed in the embodiments of this application. Figure 1 ,like Figure 8 As shown, the decoder 100 proposed in this application embodiment may include an acquisition part 101, a parsing part 102, a closing part 103, an opening part 104, and a decoding part 105.
[0068] The acquisition section 101 is configured to acquire the bitstream corresponding to the current video image.
[0069] The parsing section 102 is configured to parse the bitstream and obtain the control identifier corresponding to the current video image.
[0070] The closing part 103 is configured to disable the inter-component cross-decoding function when the decoding method corresponding to the control identifier is image component independent decoding; wherein, the inter-component cross-decoding function is used to perform decoding processing based on the dependency between image components.
[0071] Furthermore, in an embodiment of this application, the enabling portion 104 is configured to enable the inter-component cross-decoding function when the decoding method corresponding to the control identifier is image component cross-decoding after parsing the bit stream and obtaining the control identifier corresponding to the current video image.
[0072] Furthermore, in embodiments of this application, the image component includes at least two of a first image component, a second image component, and a third image component.
[0073] Furthermore, in an embodiment of this application, the decoding part 105 is also configured to, when the decoding method corresponding to the control identifier is image component cross-decoding, enable the inter-component cross-decoding function and then decode the current video image according to DM.
[0074] Furthermore, in an embodiment of this application, the closing portion 103 is also configured to, after parsing the bitstream and obtaining the control identifier corresponding to the current video image, close the DM representation mode when the decoding mode corresponding to the control identifier is DM disabled.
[0075] Furthermore, in an embodiment of this application, the parsing section 102 is specifically configured to obtain the control identifier in the SPS of the bitstream after parsing the bitstream.
[0076] Furthermore, in an embodiment of this application, the parsing portion 102 is specifically configured to obtain the control identifier in the PPS of the bitstream after parsing the bitstream.
[0077] Furthermore, in an embodiment of this application, the parsing portion 102 is specifically configured to obtain the control identifier in the SEI of the bitstream after parsing the bitstream.
[0078] Figure 9 A schematic diagram of the decoder structure proposed in the embodiments of this application. Figure 2 ,like Figure 9 As shown, the decoder 100 proposed in this application embodiment may further include a processor 106, a memory 107 storing executable instructions of the processor 106, a communication interface 108, and a bus 109 for connecting the processor 106, the memory 107, and the communication interface 108.
[0079] In the embodiments of this application, the processor 106 can be at least one of the following: Application-Specific Integrated Circuit (ASIC), Digital Signal Processor (DSP), Digital Signal Processing Device (DSPD), Programmable Logic Device (PLD), Field-Programmable Gate Array (FPGA), Central Processing Unit (CPU), Controller, Microcontroller, and Microprocessor. It is understood that for different devices, the electronic device used to implement the above-mentioned processor function can also be other types, and this application embodiment does not specifically limit this. The decoder 100 may also include a memory 107, which can be connected to the processor 106. The memory 107 is used to store executable program code, which includes computer operation instructions. The memory 107 may include high-speed RAM memory and may also include non-volatile memory, such as at least two disk drives.
[0080] In embodiments of this application, bus 109 is used to connect communication interface 108, processor 106, and memory 107, as well as the mutual communication between these devices.
[0081] In embodiments of this application, memory 107 is used to store instructions and data.
[0082] Furthermore, in an embodiment of this application, the processor 106 is configured to acquire the bitstream corresponding to the current video image; parse the bitstream to obtain the control identifier corresponding to the current video image; and disable the inter-component cross-decoding function when the decoding method corresponding to the control identifier is independent decoding of image components; wherein the inter-component cross-decoding function is used for decoding processing based on the dependency between image components.
[0083] In practical applications, the aforementioned memory 107 may be a volatile first memory, such as random-access memory (RAM); or a non-volatile first memory, such as read-only memory (ROM), flash memory, hard disk drive (HDD), or solid-state drive (SSD); or a combination of the above types of first memory, and provide instructions and data to the processor 106.
[0084] Furthermore, in this embodiment, the functional modules can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional module.
[0085] If the integrated unit is implemented as a software functional module and is not sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this embodiment, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) or processor to execute all or part of the steps of the method of this embodiment. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0086] This application proposes a decoder that acquires the bitstream corresponding to the current video image; parses the bitstream to obtain a control identifier corresponding to the current video image; and disables inter-component cross-decoding when the decoding method corresponding to the control identifier is independent image component decoding. The inter-component cross-decoding function is used for decoding based on the dependencies between image components. In other words, in this application's embodiment, the decoder can first parse the bitstream corresponding to the current video image to obtain a control identifier in the bitstream used to determine whether dependencies between image components are allowed. If the decoding method corresponding to the control identifier is independent image component decoding, i.e., it does not support dependencies between image components, then the decoder needs to disable the inter-component cross-decoding function. That is, the decoder does not perform decoding processing on the current video image based on the dependencies between image components. This allows for parallel encoding and decoding in scenarios requiring fast processing or high parallel processing, reducing encoding and decoding complexity. Simultaneously, in these scenarios, bits representing non-decoding dependencies between image components at the CU layer are omitted, improving encoding efficiency in these scenarios.
[0087] This application provides a first computer-readable storage medium having a program stored thereon, which, when executed by a processor, implements the image decoding method described above.
[0088] Specifically, the program instructions corresponding to an image decoding method in this embodiment can be stored on storage media such as optical discs, hard disks, and USB flash drives. When the program instructions corresponding to an image decoding method in the storage media are read or executed by an electronic device, the following steps are included: Get the bitstream corresponding to the current video image; The bitstream is parsed to obtain the control identifier corresponding to the current video image; When the decoding method corresponding to the control identifier is independent decoding of image components, the inter-component cross-decoding function is turned off; wherein, the inter-component cross-decoding function is used to perform decoding processing based on the dependency between image components.
[0089] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of hardware embodiments, software embodiments, or embodiments combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage and optical storage) containing computer-usable program code.
[0090] This application is described with reference to schematic and / or block diagrams of implementations of methods, apparatus (systems), and computer program products according to embodiments of this application. It should be understood that each block of the schematic and / or block diagrams can be implemented by computer program instructions, and combinations of blocks in the schematic and / or block diagrams can be implemented. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create a machine for implementing the schematic and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.
[0091] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in the implementation flow diagram. Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.
[0092] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 1 The steps of the function specified in one or more boxes.
[0093] The above description is merely a preferred embodiment of this application and is not intended to limit the scope of protection of this application.
[0094] Industrial applicability This application provides an image decoding method, a decoder, and a computer storage medium. The decoder acquires the bitstream corresponding to the current video image; parses the bitstream to obtain the control identifier corresponding to the current video image; when the decoding method corresponding to the control identifier is independent image component decoding, the inter-component cross-decoding function is disabled; wherein, the inter-component cross-decoding function is used for decoding processing based on the dependencies between image components. That is, in the embodiments of this application, the decoder can first parse the bitstream corresponding to the current video image to obtain the control identifier in the bitstream used to determine whether dependencies between image components are allowed. If the decoding method corresponding to the control identifier is independent image component decoding, i.e., it does not support dependencies between image components, then the decoder needs to disable the inter-component cross-decoding function. That is, the decoder does not perform decoding processing on the current video image based on the dependencies between image components, thereby enabling parallel encoding and decoding in scenarios requiring fast processing or high parallel processing, reducing the complexity of encoding and decoding. At the same time, in these scenarios, the bits representing the lack of image component dependency decoding at the CU layer are omitted, improving the encoding efficiency in these scenarios.
Claims
1. An image decoding method, the method comprising: Parse the bitstream to obtain the control identifier corresponding to the current video image. The control identifier is used to indicate whether to start inter-component cross decoding between two chroma components. When the decoding method corresponding to the control identifier is image component cross-decoding, the inter-component cross-decoding function is enabled; wherein, the inter-component cross-decoding function is used to perform decoding processing based on the dependency between two chroma components.
2. The method according to claim 1, wherein, The parsing of the bitstream to obtain the control identifier corresponding to the current video image includes: After parsing the bitstream, the control identifier is obtained from the sequence parameter set SPS in the bitstream.
3. The method according to claim 1, wherein, The parsing of the bitstream to obtain the control identifier corresponding to the current video image includes: After parsing the bitstream, the control identifier is obtained from the image parameter set PPS in the bitstream.
4. The method according to claim 1, wherein, The parsing of the bitstream to obtain the control identifier corresponding to the current video image includes: After parsing the bitstream, the control identifier is obtained from the supplementary enhancement information (SEI) in the bitstream.
5. A decoder, the decoder comprising: The parsing section and the enabling section, The parsing section is configured to parse the bitstream and obtain the control flag corresponding to the current video image. The control flag is used to indicate whether to start inter-component cross-decoding between two chroma components. The activation part is configured to enable the inter-component cross-decoding function when the decoding method corresponding to the control identifier is image component cross-decoding; wherein, the inter-component cross-decoding function is used to perform decoding processing based on the dependency between two chroma components.
6. The decoder according to claim 5, wherein, The parsing section is specifically configured to obtain the control identifier in the SPS of the bitstream after parsing the bitstream.
7. The decoder according to claim 5, wherein, The parsing section is further configured to obtain the control identifier in the PPS of the bitstream after parsing the bitstream.
8. The decoder according to claim 5, wherein, The parsing section is further configured to obtain the control identifier in the SEI of the bitstream after parsing the bitstream.
9. A decoder, wherein, The decoder includes a processor, a memory storing processor-executable instructions, a communication interface, and a bus for connecting the processor, the memory, and the communication interface. When the instructions are executed by the processor, the method described in any one of claims 1-4 is implemented.
10. A computer-readable storage medium having a program stored thereon for use in a decoder, wherein, When the program is executed by the processor, it implements the method as described in any one of claims 1-4.
11. A computer-readable storage medium, wherein program instructions corresponding to the method of any one of claims 1-4 are stored on the computer-readable storage medium and applied in a decoder, wherein when the program instructions in the computer-readable storage medium corresponding to the method of any one of claims 1-4 are read or executed by a processor in the decoder, the method comprises the following steps: Parse the bitstream to obtain the control identifier corresponding to the current video image. The control identifier is used to indicate whether to start inter-component cross decoding between two chroma components. When the decoding method corresponding to the control identifier is image component cross-decoding, the inter-component cross-decoding function is enabled; wherein... The inter-component cross-decoding function is used to perform decoding based on the dependency between two chroma components.
