Method of reading a bitstream, method of storing a bitstream and method of transmitting a bitstream
Patent Information
- Application Number
- CN202511788557.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2019-06-25
- Publication Date
- 2026-09-25
- Estimated Expiration
- 2039-06-25
AI Technical Summary
[0028]本申请实施例中,针对输入的源视频数据,在根据预设的且属于PDPC应用模式的预测模式对所述源视频数据中的待编码块上的图像分量进行预测,得到第一预测块之后,没有对第一预测块中的预测值进行修正,而是直接确定第一预测块上的预测值与待编码块上的图像分量之间的差值;如此,在保证视频编解码性能的前提下,可以降低视频编解码中信息处理的复杂度,尤其降低帧内预测的处理复杂度。
Smart Images

Figure CN121462774B_ABST
Abstract
Description
[0001] Case Analysis This application is a divisional application of the application filed on June 25, 2019, with application number 201980096244.5 and entitled "Information Processing Method, Apparatus, Device, Storage Medium". Technical Field
[0002] The embodiments of this application relate to electronic technology, including but not limited to information processing methods and apparatus, devices, and storage media. Background Technology
[0003] In recent years, video services have developed rapidly in the field of electronic technology. Video services require encoding the source video data first, and then transmitting the encoded video data to the user terminal through the channels of the Internet or mobile communication networks.
[0004] For users, video smoothness directly impacts their viewing experience. The complexity of information processing during video encoding directly affects video smoothness. Summary of the Invention
[0005] In view of this, embodiments of this application provide information processing methods, apparatus, devices, and storage media to solve at least one problem existing in the related art.
[0006] The technical solution of this application embodiment is implemented as follows: In a first aspect, embodiments of this application provide an information processing method, the method comprising: for input source video data, predicting image components on a block to be encoded in the source video data according to a prediction mode to obtain a first prediction block, wherein the prediction mode is a preset and belongs to a mode-dependent prediction combination (PDPC) application mode; determining the difference between the image components on the block to be encoded and the predicted values on the first prediction block to obtain a residual block; and writing the residual block and the prediction mode into a bitstream.
[0007] In other embodiments, the image component is a luminance value or a chrominance value.
[0008] In other embodiments, the step of predicting the image components on the block to be encoded according to the prediction mode to obtain a first prediction block includes: performing chromaticity prediction on the chromaticity values on the block to be encoded according to any prediction mode in the first mode combination to obtain a first prediction block; wherein, the first mode combination includes the following PDPC application modes: a prediction mode with a number less than a first value and not containing a plane prediction mode and a DC component prediction mode among the preset N spatial prediction modes, a prediction mode with a number greater than the first value and less than or equal to a second value, a prediction mode with a number greater than or equal to a third value and less than a fourth value, and a prediction mode with a number greater than a fourth value.
[0009] In other embodiments, the step of predicting the image components on the block to be encoded according to the prediction mode to obtain a first prediction block includes: performing chromaticity prediction on the chromaticity values on the block to be encoded according to any prediction mode in the second mode combination to obtain a first prediction block; wherein, the second mode combination includes the following PDPC application modes: a prediction mode whose number is less than or equal to a second value and does not contain a planar prediction mode and a DC component prediction mode among the preset N spatial prediction modes, and a prediction mode whose number is greater than or equal to a third value.
[0010] In other embodiments, the step of predicting the image components on the block to be encoded according to the prediction mode to obtain a first prediction block includes: performing chromaticity prediction on the chromaticity values on the block to be encoded according to any prediction mode in the third mode combination to obtain a first prediction block; wherein, the third mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, a prediction mode whose number is less than or equal to a second value among the preset N spatial prediction modes and does not contain a plane prediction mode and a DC component prediction mode, and a prediction mode whose number is greater than or equal to a third value.
[0011] In other embodiments, the step of predicting the image components on the block to be encoded according to the prediction mode to obtain a first prediction block includes: performing chromaticity prediction on the chromaticity values on the block to be encoded according to any prediction mode in the fourth mode combination to obtain a first prediction block; wherein, the fourth mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, a prediction mode whose number is less than or equal to a second value among the preset N spatial prediction modes and includes a planar prediction mode and a DC component prediction mode, and a prediction mode whose number is greater than or equal to a third value.
[0012] In other embodiments, the step of predicting the image components on the block to be encoded in the input source video data according to the prediction mode to obtain a first prediction block includes: predicting the brightness value on the block to be encoded according to any prediction mode in any combination of the first to fourth mode combinations to obtain the first prediction block.
[0013] Secondly, embodiments of this application provide an information processing apparatus, the apparatus comprising: a prediction module configured to predict image components on a block to be encoded in the input source video data according to a prediction mode to obtain a first prediction block, wherein the prediction mode is preset and belongs to a PDPC application mode; a residual determination module configured to determine the difference between the image components on the block to be encoded and the predicted values on the first prediction block to obtain a residual block; and a writing module configured to write the residual block and the prediction mode into the bitstream.
[0014] In other embodiments, the image component is a luminance value or a chrominance value.
[0015] In other embodiments, the prediction module includes: a chromaticity prediction unit configured to: perform chromaticity prediction on the chromaticity value of the block to be encoded according to any prediction mode in the first mode combination to obtain a first prediction block; wherein, the first mode combination includes the following PDPC application modes: a prediction mode whose number is less than a first value and does not contain a plane prediction mode and a DC component prediction mode among the preset N spatial prediction modes, a prediction mode whose number is greater than the first value and less than or equal to a second value, a prediction mode whose number is greater than or equal to a third value and less than a fourth value, and a prediction mode whose number is greater than a fourth value.
[0016] In other embodiments, the prediction module includes: a chroma prediction unit configured to: perform chroma prediction on the chroma values of the block to be encoded according to any prediction mode in the second mode combination, to obtain a first prediction block; The second mode combination includes the following PDPC application modes: a prediction mode whose number is less than or equal to the second value and does not contain a plane prediction mode or a DC component prediction mode among the preset N spatial prediction modes, and a prediction mode whose number is greater than or equal to the third value.
[0017] In other embodiments, the prediction module includes: a chromaticity prediction unit configured to: perform chromaticity prediction on the chromaticity value of the block to be encoded according to any prediction mode in the third mode combination to obtain a first prediction block; wherein, the third mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, a prediction mode whose number is less than or equal to a second value among the preset N spatial prediction modes and does not contain a plane prediction mode and a DC component prediction mode, and a prediction mode whose number is greater than or equal to a third value.
[0018] In other embodiments, the prediction module includes: a chromaticity prediction unit configured to: perform chromaticity prediction on the chromaticity value on the block to be encoded according to any prediction mode in the fourth mode combination to obtain a first prediction block; wherein, the fourth mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, a prediction mode whose number is less than or equal to a second value and includes a plane prediction mode and a DC component prediction mode among the preset N spatial prediction modes, and a prediction mode whose number is greater than or equal to a third value.
[0019] In other embodiments, the prediction module includes a brightness prediction unit configured to predict the brightness value on the block to be encoded according to any prediction mode in any combination of the first to fourth mode combinations, thereby obtaining a first prediction block.
[0020] Thirdly, embodiments of this application provide an information processing method, the method comprising: for an input bitstream, predicting image components on a block to be decoded in the bitstream according to a prediction mode in the bitstream to obtain a second prediction block; the prediction mode is preset and belongs to a PDPC application mode; determining the sum of the difference on a residual block in the bitstream and the predicted value on the second prediction block to obtain a recovery block; processing the recovery block and outputting processed video data.
[0021] Fourthly, embodiments of this application provide an information processing apparatus, the apparatus comprising: a prediction module configured to: predict image components on a block to be decoded in an input bitstream according to a prediction mode in the bitstream, to obtain a second prediction block; wherein the prediction mode is preset and belongs to a PDPC application mode; a recovery module configured to: determine the sum of the difference on a residual block in the bitstream and the predicted value on the second prediction block, to obtain a recovery block; and a video output module configured to: process the recovery block and output processed video data.
[0022] Fifthly, embodiments of this application provide an information processing method, the method comprising: for input source video data, predicting image components on a block to be encoded in the source video data according to a prediction mode to obtain a third prediction block, wherein the prediction mode is preset and belongs to a PDPC application mode; correcting the third prediction block according to the prediction mode to obtain a third correction block; determining the difference between the image components on the block to be encoded and the correction value on the third correction block to obtain a residual block; and writing the residual block and the prediction mode into the bitstream.
[0023] Sixthly, embodiments of this application provide an information processing apparatus, the apparatus comprising: a prediction module configured to: predict image components on a block to be encoded in the input source video data according to a prediction mode, to obtain a third prediction block, wherein the prediction mode is preset and belongs to a PDPC application mode; a correction module configured to: correct the third prediction block according to the prediction mode, to obtain a third correction block; a residual determination module configured to: determine the difference between the image components on the block to be encoded and the correction value on the third correction block, to obtain a residual block; and a writing module configured to: write the residual block and the prediction mode into the bitstream.
[0024] In a seventh aspect, embodiments of this application provide an information processing method, the method comprising: for an input bitstream, predicting image components on a block to be decoded in the bitstream according to a prediction mode in the bitstream to obtain a fourth prediction block; the prediction mode is preset and belongs to a PDPC application mode; correcting the fourth prediction block according to the prediction mode to obtain a fourth correction block; determining the sum of the difference on the residual block in the bitstream and the correction value on the fourth correction block to obtain a recovery block; processing the recovery block and outputting processed video data.
[0025] Eighthly, embodiments of this application provide an information processing apparatus, the apparatus comprising: a prediction module configured to: predict image components on a block to be decoded in an input bitstream according to a prediction mode in the bitstream, to obtain a fourth prediction block; wherein the prediction mode is preset and belongs to a PDPC application mode; a correction module configured to: correct the fourth prediction block according to the prediction mode, to obtain a fourth correction block; a recovery module configured to: determine the sum of the difference on a residual block in the bitstream and the correction value on the fourth correction block, to obtain a recovery block; and a video output module configured to: process the recovery block and output processed video data.
[0026] Ninthly, embodiments of this application provide an electronic device, including a memory and a processor, wherein the memory stores a computer program that can run on the processor, and the processor executes the program to implement the steps in the above-described information processing method.
[0027] In a tenth aspect, embodiments of this application provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps in the above-described information processing method.
[0028] In this embodiment, for the input source video data, the image components on the block to be encoded in the source video data are predicted according to a preset prediction mode belonging to the PDPC application mode. After obtaining the first prediction block, the predicted value in the first prediction block is not corrected. Instead, the difference between the predicted value on the first prediction block and the image component on the block to be encoded is directly determined. In this way, while ensuring the performance of video encoding and decoding, the complexity of information processing in video encoding and decoding can be reduced, especially the processing complexity of intra-frame prediction. Attached Figure Description
[0029] Figure 1 This is a schematic diagram of the network architecture of an embodiment of this application; Figure 2A This is a schematic diagram of the structure of the video encoder according to an embodiment of this application; Figure 2B This is a schematic diagram of the structure of the video decoder according to an embodiment of this application; Figure 2C This is a schematic diagram of the spatial prediction modes within 94 components in the embodiments of this application; Figure 2D This is a schematic diagram of the PDPC calculation method in the DC component prediction mode according to an embodiment of this application; Figure 3A This is a schematic diagram illustrating the implementation flow of the information processing method in an embodiment of this application; Figure 3B This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application; Figure 4A This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application; Figure 4B This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application; Figure 5 This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application; Figure 6 This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application; Figure 7 This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application; Figure 8 This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application; Figure 9A This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application; Figure 9B This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application; Figure 10 This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application; Figure 11A This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application; Figure 11B This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application; Figure 12A This is a schematic diagram of the structure of the information processing device according to an embodiment of this application; Figure 12B This is a schematic diagram of the structure of another information processing device according to an embodiment of this application; Figure 13 This is a schematic diagram of the structure of another information processing device according to an embodiment of this application; Figure 14 This is a schematic diagram of the structure of another information processing device according to an embodiment of this application; Figure 15 This is a schematic diagram of the structure of another information processing device according to an embodiment of this application; Figure 16 This is a schematic diagram of the hardware entity of an electronic device according to an embodiment of this application. Detailed Implementation
[0030] To make the objectives, technical solutions, and advantages of the embodiments of this application clearer, the specific technical solutions of this application will be further described in detail below with reference to the accompanying drawings of the embodiments of this application. The following embodiments are used to illustrate this application, but are not intended to limit the scope of this application.
[0031] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs. The terminology used herein is for the purpose of describing embodiments of this application only and is not intended to limit this application.
[0032] In the following description, references are made to “some embodiments,” which describe a subset of all possible embodiments. However, it is understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.
[0033] It should be noted that the terms "first, second, and third" used in the embodiments of this application are merely to distinguish similar objects and do not represent a specific ordering of objects. It is understood that "first, second, and third" can be interchanged in a specific order or sequence where permitted, so that the embodiments of this application described herein can be implemented in an order other than that illustrated or described herein.
[0034] This embodiment first provides a network architecture. Figure 1 This is a schematic diagram of the network architecture of an embodiment of this application, as shown below. Figure 1 As shown, the network architecture includes one or more electronic devices 11 to 1N and a communication network 01, wherein the electronic devices 11 to 1N can perform video interaction through the communication network 01. The electronic devices can be various types of devices with video encoding and decoding capabilities, such as mobile phones, tablets, e-readers, drones, wearable devices (such as smart glasses), robot vacuum cleaners, personal computers, navigators, video phones, televisions, servers, etc.
[0035] The electronic device has video encoding and decoding capabilities, including a video encoder and / or a video decoder, for example, see [link to relevant documentation]. Figure 2A As shown, the video encoder 21 comprises the following components: a transform and quantization unit 211, an intra-frame estimation unit 212, an intra-frame prediction unit 213, a motion compensation unit 214, a motion estimation unit 215, an inverse transform and inverse quantization unit 216, a filter control and analysis unit 217, a filtering unit 218, an encoding unit 219, and a decoded image buffer unit 210. Among these, the filtering unit 218 can implement deblocking filtering and sample adaptive offset (SAO) filtering, and the encoding unit 219 can implement header information encoding and context-based adaptive binary arithmetic coding (CABAC).
[0036] For the input source video data, a video coding block can be obtained by partitioning it into Coding Tree Units (CTUs). Then, the residual pixel information obtained after intra-frame or inter-frame prediction is transformed by the transform and quantization unit 211, including transforming the residual information from the pixel domain to the transform domain and quantizing the resulting transform coefficients to further reduce the bit rate. Intra-frame estimation unit 212 and intra-frame prediction unit 213 are used to perform intra-frame prediction on the video coding block. Specifically, intra-frame estimation unit 212 and intra-frame prediction unit 213 are used to determine the intra-frame prediction mode to be used to encode the video coding block. Motion compensation unit 214 and motion estimation unit 215 are used to perform inter-frame prediction coding of the received video coding block relative to one or more blocks in one or more reference frames to provide temporal prediction information. The motion estimation performed by motion estimation unit 215 is a process of generating motion vectors, which can estimate the motion of the video coding block. Then, motion compensation unit 214 uses the motion vectors determined by motion estimation unit 215 as the basis for the motion estimation. The system performs motion compensation; after determining the intra-prediction mode, the intra-prediction unit 213 also provides the selected intra-prediction data to the coding unit 219, and the motion estimation unit 215 also sends the calculated motion vector data to the coding unit 219; in addition, the inverse transform and inverse quantization unit 216 is used to reconstruct the video coding block, reconstructing the residual block in the pixel domain. The reconstructed residual block is processed by the filter control analysis unit 217 and the filtering unit 218 to remove block artifacts, and then the reconstructed residual block is added to a predictive block in the frame of the decoding image buffer unit 210 to generate the reconstructed video coding block; the coding unit 219 is used to encode various coding parameters and quantized transform coefficients. In the CABAC-based coding algorithm, the context content can be based on adjacent coding blocks and can be used to encode information indicating the determined intra-prediction mode, outputting the bitstream of the source video data; while the decoding image buffer unit 210 is used to store the reconstructed video coding block for prediction reference. As video image encoding proceeds, new reconstructed video encoding blocks are continuously generated, and these reconstructed video encoding blocks are stored in the decoding image buffer unit 210.
[0037] The video decoder 22 corresponding to the video encoder 21 has the following structure: Figure 2B As shown, it includes: a decoding unit 221, an inverse transform and inverse quantization unit 222, an intra-frame prediction unit 223, a motion compensation unit 224, a filtering unit 225, and a decoded image buffer unit 226, etc. The decoding unit 221 can perform header information decoding and CABAC decoding, and the filtering unit 225 can perform deblocking filtering and SAO filtering. The input source video data is processed... Figure 2AAfter encoding, the source video data bitstream is output; this bitstream is input into the video decoder 22, first passing through the decoding unit 221 to obtain the decoded transform coefficients; the transform coefficients are then processed by the inverse transform and inverse quantization unit 222 to generate residual blocks in the pixel domain; the intra-frame prediction unit 223 can be used to generate prediction data for the current video decoding block based on the determined intra-frame prediction mode and data from the previously decoded blocks from the current frame or image; the motion compensation unit 224 determines the prediction information for the video decoding block by parsing motion vectors and other associated syntax elements, and uses this prediction information to generate The predictive block of the video block being decoded is formed by summing the residual block from the inverse transform and inverse quantization unit 222 with the corresponding predictive block generated by the intra-prediction unit 223 or the motion compensation unit 224. The decoded video data is processed by the filtering unit 225 to remove block artifacts and improve video quality. The decoded video data is then stored in the decoding image buffer unit 226, which stores reference images for subsequent intra-prediction or motion compensation and is also used for outputting video data, thus obtaining the recovered source video data.
[0038] Before describing the embodiments of this application in detail, the intra-frame prediction mode will be briefly explained first.
[0039] In the latest Versatile Video Coding (VVC) draft (also known as H.266), in order to capture finer edge directions presented in natural video, such as... Figure 2C As shown, the VVC test model VTM5.0 defines 94 spatial prediction modes within the component range, numbered from -14 to 80. These include two non-angular modes: the Planar mode (numbered 0, hereinafter referred to as the planar prediction mode) and the DC mode (numbered 1, hereinafter referred to as the DC component prediction mode). It should be noted that these numbers are used to uniquely identify the prediction mode and can be used as mode index numbers. In intra-frame prediction, intra-component spatial prediction of the current block is performed using one or more of the 94 spatial prediction modes within the component range.
[0040] It should be noted that the information processing method in the embodiments of this application is mainly applied in, for example... Figure 2A The intra-prediction unit 213 shown and as follows Figure 2BThe intra-prediction unit 223 shown is used to obtain the intra-prediction value of the current block. That is, the information processing method in this embodiment can be applied to the video encoder 21, the video decoder 22, or even simultaneously, but this embodiment does not impose specific limitations. When the method described below is used in part 213, "current block" refers to the block to be encoded in part 213; when the method described below is used in part 223, "current block" refers to the block to be decoded in part 223.
[0041] The intra-prediction process performed by the intra-prediction units 213 / 223 in related technologies is described below. Generally, the intra-prediction process mainly includes the following steps: Step S201: Before performing luminance and chrominance prediction on the current block (which can be the block to be encoded or the block to be decoded), it is necessary to obtain the reference pixel values around the current block. If none of the reference pixels exist, then the pixel value of 512 is used for filling; if only some of the reference pixels are missing, then the nearest existing reference pixel value is used for filling. Step S202: Based on the prediction mode and the size of the current block, determine whether the reference pixel needs to be filtered; if filtering is required, use a three-tap smoothing filter with coefficients [1,2,1] to filter the reference pixel. Step S203: Based on the calculation method of each prediction mode, use the reference pixel to predict the current block and obtain the predicted value of each pixel in the current block. Step S204: For the following prediction modes, after obtaining the predicted value of each pixel in the current block, the PDPC method is used to further correct the predicted value: planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, angle prediction mode with a number less than or equal to 10 (including wide-angle mode), and angle prediction mode with a number greater than or equal to 58 (including wide-angle mode); among which, the planar prediction mode is... Figure 2C The intra-frame prediction mode shown is prediction mode number 0, which is the DC component prediction mode. Figure 2C The intra-prediction mode shown is prediction mode number 1, which is the horizontal prediction mode. Figure 2C The intra-prediction mode shown is prediction mode number 18; the vertical prediction mode is... Figure 2C The intra-prediction mode shown is prediction mode number 50.
[0042] It should be noted that the principle of the PDPC method is to correct the predicted value based on the left reference pixel (left), the top reference pixel (top), and the top left reference pixel (topleft) of the current block, and then determine the residual between the corrected predicted value and the corresponding pixel value in the current block.
[0043] For example, taking the PDPC calculation method in DC component prediction mode as an example, such as Figure 2D As shown in formula (1): (1); Based on the reconstructed pixel value on the left reference pixel of the current block 24. left and the current point in the current block 24 The distance between them (which can be represented by the weight wL), and the reconstructed pixel value at the top of the uplink reference pixel. top and current point The distance between them (which can be represented by the weight wT), and the reconstructed pixel value on the top-left reference pixel topleft. topleft and current point The distance between them (which can be represented by the weight wTL) for the current point Predicted value Make corrections to obtain the corrected predicted values. .
[0044] The embodiments of this application will now be described in detail with reference to the accompanying drawings. The information processing method provided in the embodiments of this application can be applied to both the video encoder 21 and the video decoder 22, and the embodiments of this application do not specifically limit it in this regard.
[0045] This application provides an information processing method applied to a video encoder 21 of an electronic device. The function implemented by this method can be achieved by the processor in the electronic device calling program code. Of course, the program code can be stored in a computer storage medium. It can be seen that the electronic device includes at least a processor and a storage medium.
[0046] Figure 3A This is a schematic diagram illustrating the implementation flow of the information processing method in an embodiment of this application, as shown below. Figure 3A As shown, the method includes the following steps: Step S301: For the input source video data, according to the prediction mode, the image components on the block to be encoded in the source video data are predicted to obtain the first prediction block. The prediction mode is preset and belongs to the PDPC application mode. In other embodiments, the image components are chroma values or luminance values. It should be noted that the prediction mode used when predicting the current block (including the block to be encoded and the block to be decoded) before using the PDPC method is defined as the PDPC application mode. For example, in VTM 5.0, the PDPC application modes include: planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, angle prediction mode with a number less than or equal to 10 (including wide-angle mode), and angle prediction mode with a number greater than or equal to 58 (including wide-angle mode).
[0047] It should be noted that the block to be decoded refers to the image region in the source video data that requires prediction and encoding processing. In implementation, the source video data can be obtained through an image acquisition device.
[0048] Understandably, after obtaining the first prediction block, step S302 is executed directly to determine the difference between the image component on the block to be encoded and the predicted value on the first prediction block. In this way, the first prediction block is not processed by PDPC before the residual block is determined, which can reduce the processing complexity of intra-frame prediction.
[0049] Step S302: Determine the difference between the image component on the block to be encoded and the predicted value on the first prediction block to obtain the residual block; Step S303: Write the residual block and the prediction mode into the bitstream.
[0050] In this embodiment of the application, after predicting the image components on the block to be encoded in the source video data according to the preset prediction mode belonging to the PDPC application mode, and obtaining the first prediction block, no correction is made to each prediction value in the first prediction block. Instead, the difference between the prediction value on the first prediction block and the image components on the block to be encoded is directly determined. In this way, the processing complexity of intra-frame prediction can be reduced while ensuring video coding performance.
[0051] This application provides another information processing method, which is applied to the video decoder 21 of an electronic device. Figure 3B This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application, such as... Figure 3B As shown, the method includes the following steps: Step S311: For the input bitstream, predict the image components on the block to be decoded in the bitstream according to the prediction mode in the bitstream to obtain a second prediction block; wherein, the prediction mode is preset and belongs to the PDPC application mode. In other embodiments, the image components are chroma values or luminance values.
[0052] Step S312: Determine the sum of the difference on the residual block in the bitstream and the predicted value on the second prediction block to obtain the recovery block; Step S313: Process the recovery block and output the processed video data.
[0053] In this embodiment, the image components on the block to be decoded in the input bitstream are predicted according to the prediction mode in the bitstream to obtain a second prediction block. The prediction mode is preset and belongs to the PDPC application mode. After obtaining the second prediction block, each prediction value in the second prediction block is not corrected. Instead, the sum of the difference on the residual block in the bitstream and the prediction value on the second prediction block is directly determined to obtain the recovery block. In this way, the processing complexity of intra-frame prediction can be reduced while ensuring video decoding performance.
[0054] This application provides yet another information processing method, which is applied to the video encoder 21 of an electronic device. Figure 4A This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application, as shown below. Figure 4A As shown, the method includes the following steps: Step S401: For the input source video data, perform chroma prediction on the chroma values of the block to be encoded in the source video data according to the prediction mode to obtain the first prediction block. The prediction mode is preset and belongs to the PDPC application mode. Understandably, the performance improvement of video encoding and decoding using the PDPC method is based on saving coding bits and sacrificing chroma performance. Since luminance and chroma reflect different image content, correcting the first prediction block using the PDPC method cannot simultaneously improve luminance and chroma performance. In this embodiment, when performing chroma prediction on the block to be encoded, after using a preset prediction mode to predict the chroma values on the block to be encoded in the source video data, the PDPC method is not used to correct the obtained first prediction block. Instead, the chroma residual block is directly determined based on the block to be encoded and the first prediction block.
[0055] Step S402: Determine the difference between the chroma value on the block to be encoded and the chroma prediction value on the first prediction block to obtain the residual block; Here, it can be understood that the resulting residual block is a chroma residual block, which includes the difference between the chroma value on the block to be encoded and the luminance prediction value on the first prediction block.
[0056] Step S403: Write the residual block and the prediction mode into the bitstream.
[0057] In this embodiment of the application, after performing chroma prediction on the chroma values of the block to be encoded in the source video data according to the preset prediction mode belonging to the PDPC application mode, the predicted values on the first prediction block are not corrected, but the residual values are directly calculated. In this way, the processing complexity of intra-frame chroma prediction is reduced without affecting the chroma performance.
[0058] Based on the aforementioned steps S401 to S403, in other embodiments, the method further includes the following steps: Step S404: Based on the preset prediction mode that belongs to the PDPC application mode, perform brightness prediction on the brightness value of the block to be encoded to obtain the first prediction block. Step S405: Correct the predicted values in the first prediction block to obtain the first correction block; Step S406: Determine the difference between the brightness value on the block to be encoded and the corresponding correction value on the first correction block to obtain the correction residual block; Step S407: Write the corrected residual block and the prediction mode into the bitstream.
[0059] It should be noted that, in other embodiments, for brightness prediction, the video encoder may also perform steps S901 to S903 in the following embodiments, or steps S101 to S103 in the following embodiments.
[0060] This application provides another information processing method, which is applied to the video decoder 21 of an electronic device. Figure 4B This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application, such as... Figure 4B As shown, the method includes the following steps: Step S411: For the input bitstream, predict the chroma values on the block to be decoded in the bitstream according to the prediction mode in the bitstream to obtain a second prediction block; wherein, the prediction mode is preset and belongs to the PDPC application mode. Step S412: Determine the sum of the chroma difference value on the residual block in the bitstream and the chroma prediction value on the second prediction block to obtain the recovery block; Step S413: Process the recovery block and output the processed video data.
[0061] In this embodiment, for the input bitstream, the chroma values on the blocks to be decoded in the bitstream are predicted according to the prediction mode in the bitstream to obtain a second prediction block. The prediction mode is prediction and belongs to the PDPC application mode. After obtaining the second prediction block, the chroma prediction values on the obtained second prediction block are not corrected. Instead, the residual block is directly added to the second prediction block to obtain a recovery block. The recovery block is processed to output the processed video data. In this way, the processing complexity of intra-frame chroma prediction is reduced without affecting the chroma performance.
[0062] Based on the aforementioned steps S411 to S413, in other embodiments, the method further includes the following steps: Step S414: For the input bitstream, predict the brightness value of the block to be decoded in the bitstream according to the prediction mode in the bitstream to obtain a second prediction block; wherein, the prediction mode is preset and belongs to the PDPC application mode. Step S415: Correct the brightness prediction value on the second prediction block to obtain the second correction block; Step S416: Determine the sum of the brightness difference value on the residual block in the bitstream and the brightness prediction value on the second correction block to obtain the recovery block; Step S417: Process the recovery block and output the processed video data.
[0063] It should be noted that, in other embodiments, for brightness prediction, the video decoder may also perform steps S911 to S913 in the following embodiments, or, in other embodiments, the prediction mode in step S911 is any prediction mode in any combination of the following first to fourth mode combinations.
[0064] This application provides another information processing method, which is applied to the video encoder 21 of an electronic device. Figure 5 This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application, such as... Figure 5 As shown, the method includes the following steps: Step S501: For the input source video data, perform chroma prediction on the chroma values of the block to be encoded in the source video data according to any prediction mode in the first mode combination to obtain the first prediction block. The first mode combination includes the following PDPC application modes: a prediction mode whose number is less than the first value and does not contain a plane prediction mode or a DC component prediction mode among the preset N spatial prediction modes, a prediction mode whose number is greater than the first value and less than or equal to the second value, a prediction mode whose number is greater than or equal to the third value and less than the fourth value, and a prediction mode whose number is greater than the fourth value. It should be noted that the first, second, third, and fourth values are typically preset pattern index numbers (i.e., the values of the numbers). In a preferred embodiment, the spatial prediction patterns within the N components are... Figure 2C The 94 spatial prediction modes shown are configured with a first value of 2, a second value of 10, a third value of 58, and a fourth value of 66. This means that when performing chromaticity prediction using any of the following 94 spatial prediction modes: those numbered less than 2 (excluding planar and DC component prediction modes), those numbered greater than 2 and less than or equal to 10, those numbered greater than or equal to 58 and less than 66, and those numbered greater than 66, the PDPC method is not used to correct the obtained chromaticity prediction values. In other words, the PDPC method is used to correct the obtained chromaticity prediction values only in the planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, prediction mode numbered 2, and prediction mode numbered 66.
[0065] Step S502: Determine the difference between the chroma value on the block to be encoded and the chroma prediction value on the first prediction block to obtain the residual block; Step S503: Write the residual block and the prediction mode into the bitstream.
[0066] In this embodiment of the application, when using the prediction mode in the first mode combination to perform chroma prediction on the block to be encoded, the PDPC method is not used to correct the obtained chroma prediction value, and the difference between the chroma prediction value and the chroma value on the block to be encoded is directly determined; in this way, the processing complexity of chroma prediction is reduced while ensuring the performance of chroma prediction.
[0067] Based on the aforementioned steps S501 to S503, in other embodiments, the method further includes the aforementioned steps S403 to S407.
[0068] It should be noted that, in other embodiments, for brightness prediction, steps S901 to S903 in the following embodiments can also be performed, or steps S101 to S103 in the following embodiments can be performed.
[0069] It should also be noted that, for the input bitstream, the video decoder can perform decoding steps symmetrical to steps S501 to S503 described above, which will not be repeated here. In other embodiments, for brightness prediction, the video decoder can also perform steps S911 to S913 as described in the following embodiments, or, in other embodiments, the prediction mode in step S911 is any prediction mode in any combination of the first to fourth mode combinations.
[0070] This application provides yet another information processing method, which is applied to the video encoder 21 of an electronic device. Figure 6 This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application, as shown below. Figure 6 As shown, the method includes the following steps: Step S601: For the input source video data, perform chroma prediction on the chroma value of the block to be encoded in the source video data according to any prediction mode in the second mode combination to obtain the first prediction block; wherein, the second mode combination includes the following PDPC application modes: prediction modes with numbers less than or equal to the second value and excluding planar prediction mode and DC component prediction mode among the preset N spatial prediction modes and prediction modes with numbers greater than or equal to the third value. It should be noted that the second and third values are usually preset pattern index numbers (i.e., the values of the numbers). In a preferred embodiment, the spatial prediction patterns within the N components are... Figure 2C The 94 spatial prediction modes shown are configured with a second value of 10 and a third value of 58. This means that when performing chromaticity prediction, any prediction mode with a number less than or equal to 10 (excluding planar and DC component prediction modes) or any prediction mode with a number greater than or equal to 58 among these 94 spatial prediction modes will not use the PDPC method to correct the obtained chromaticity prediction values. This reduces the processing complexity of chromaticity prediction. In other words, the PDPC method is only used to correct the obtained chromaticity prediction values under the planar, DC component, horizontal, and vertical prediction modes.
[0071] For example, in another preferred embodiment, the spatial prediction mode within the N components is: Figure 2C The spatial prediction modes within the 94 components shown are set with the second value set to 8 and the third value set to 60.
[0072] Step S602: Determine the difference between the chroma value on the block to be encoded and the chroma prediction value on the first prediction block to obtain the residual block; Step S603: Write the residual block and the prediction mode into the bitstream.
[0073] In this embodiment, when predicting the block to be coded using any prediction mode in the second mode combination, the residual value is directly determined without correcting the predicted value; thus, the chroma coding performance is improved without significantly affecting the luminance coding performance. Experimental data shows that the Y component performance is reduced by 0.03%; the U component performance is improved by 0.16% and the V component performance is improved by 0.14%. It is evident that the Y component performance loss remains essentially unchanged, while the U and V component performances are significantly improved.
[0074] It should be noted that, based on the aforementioned steps S601 to S603, in other embodiments, the method further includes the aforementioned steps S403 to S407. Alternatively, in other embodiments, for brightness prediction, steps S901 to S903 in the following embodiments can also be performed, or steps S101 to S103 in the following embodiments can be performed.
[0075] It should also be noted that, for the input bitstream, the video decoder can perform decoding steps symmetrical to steps S601 to S603 described above, which will not be repeated here. In other embodiments, for brightness prediction, steps S911 to S913 in the following embodiments can also be performed. In other embodiments, the prediction mode in step S911 is any prediction mode in any combination of the first to fourth mode combinations.
[0076] This application provides another information processing method, which is applied to the video encoder 21 of an electronic device. Figure 7 This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application, as shown below. Figure 7 As shown, the method includes the following steps: Step S701: For the input source video data, perform chroma prediction on the chroma values of the block to be encoded in the source video data according to any prediction mode in the third mode combination to obtain the first prediction block; wherein, the third mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, prediction mode with a number less than or equal to the second value and not containing the planar prediction mode and the DC component prediction mode among the preset N spatial prediction modes, and prediction mode with a number greater than or equal to the third value; It should be noted that the second and third values are usually preset pattern index numbers (i.e., the values of the numbers). In a preferred embodiment, the spatial prediction patterns within the N components are... Figure 2C The 94 spatial prediction modes shown are configured with a second value of 10 and a third value of 58. Specifically, the third mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, prediction modes with numbers less than or equal to 10 (excluding planar prediction mode and DC component prediction mode), and prediction modes with numbers greater than or equal to 58. In other words, the PDPC method is used to correct the obtained chromaticity prediction values only in the planar prediction mode and the DC component prediction mode, while it is not used in the third mode combination, thereby reducing the processing complexity of chromaticity prediction.
[0077] Step S702: Determine the difference between the chroma value on the block to be encoded and the chroma prediction value on the first prediction block to obtain the residual block; Step S703: Write the residual block and the prediction mode into the bitstream.
[0078] It should be noted that, based on the aforementioned steps S701 to S703, in other embodiments, the method further includes the aforementioned steps S403 to S407. Alternatively, in other embodiments, for brightness prediction, steps S901 to S903 in the following embodiments can also be performed, or steps S101 to S103 in the following embodiments can be performed.
[0079] It should also be noted that, for the input bitstream, the video decoder performs decoding steps symmetrical to steps S701 to S703 described above, which will not be repeated here. In other embodiments, for brightness prediction, the video decoder may also perform steps S414 to S417 described above, or perform steps S911 to S913 in the following embodiments, or, in other embodiments, the prediction mode in step S911 is any prediction mode in any combination of the first to fourth mode combinations.
[0080] This application provides another information processing method, which is applied to the video encoder 21 of an electronic device. Figure 8 This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application, such as... Figure 8 As shown, the method includes the following steps: Step S801: For the input source video data, perform chroma prediction on the chroma values of the block to be encoded in the source video data according to any prediction mode in the fourth mode combination to obtain the first prediction block; wherein, the fourth mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, prediction mode with a number less than or equal to the second value and including the plane prediction mode and the DC component prediction mode among the preset N spatial prediction modes, and prediction mode with a number greater than or equal to the third value.
[0081] It should be noted that the second and third values are usually preset pattern index numbers (i.e., the values of the numbers). In a preferred embodiment, the spatial prediction patterns within the N components are... Figure 2CThe spatial prediction modes within the 94 components shown are configured with a second value of 10 and a third value of 58. This means the fourth mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, prediction modes with numbers less than or equal to 10, and prediction modes with numbers greater than or equal to 58 among the 94 spatial prediction modes. In other words, when performing chromaticity prediction under all PDPC application modes, the PDPC method is not used to correct the obtained chromaticity prediction values.
[0082] Step S802: Determine the difference between the chroma value on the block to be encoded and the chroma prediction value on the first prediction block to obtain the residual block; Step S803: Write the residual block and the prediction mode into the bitstream.
[0083] It should be noted that, based on the aforementioned steps S801 to S803, in other embodiments, the method may further include steps S401 to S403, or steps S501 to S503, or steps S601 to S603, or steps S701 to S703, or steps S901 to S903 as described in the above embodiments.
[0084] It should also be noted that, for the input bitstream, the video decoder can perform decoding steps symmetrical to steps S801 to S803 described above, which will not be repeated here. In other embodiments, for luminance prediction, the video decoder can also perform steps S414 to S417 described above, or perform steps S911 to S914 in the following embodiments, or, in other embodiments, the prediction mode in step S911 is any prediction mode in any combination of the first to fourth mode combinations.
[0085] This application provides another information processing method, which is applied to the video encoder 21 of an electronic device. Figure 9 is a schematic diagram of the implementation flow of another information processing method according to this application. Figure 9A As shown, the method includes the following steps: Step S901: For the input source video data, predict the brightness value of the block to be encoded in the source video data according to the preset prediction mode that belongs to the PDPC application mode, and obtain the first prediction block. Step S902: Determine the difference between the luminance value on the block to be encoded and the luminance prediction value on the first prediction block to obtain a residual block; Step S903: Write the residual block and the prediction mode into the bitstream.
[0086] In this embodiment of the application, when predicting the luminance value on the block to be encoded according to a preset prediction mode that belongs to the PDPC application mode, the PDPC method is not used to correct the obtained luminance prediction value, which can reduce the processing complexity of luminance prediction.
[0087] It should be noted that, based on the aforementioned steps S901 to S903, in other embodiments, the method may also include steps S401 to S403, or steps S501 to S503, or steps S601 to S603, or steps S701 to S703, or steps S801 to S803 as described in the above embodiments.
[0088] This application provides another information processing method, which is applied to the video decoder 21 of an electronic device. Figure 9B This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application, such as... Figure 9B As shown, the method includes the following steps: Step S911: For the input bitstream, predict the brightness value of the block to be decoded in the bitstream according to the prediction mode in the bitstream to obtain a second prediction block; wherein, the prediction mode is preset and belongs to the PDPC application mode. In other embodiments, the prediction mode in step S911 is any prediction mode in any combination of the first to fourth mode combinations.
[0089] Step S912: Determine the sum of the brightness difference value on the residual block in the bitstream and the brightness prediction value on the second prediction block to obtain the recovery block; Step S913: Process the recovery block and output the processed video data.
[0090] This application provides another information processing method, which is applied to the video encoder 21 of an electronic device. Figure 10 This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application, such as... Figure 10 As shown, the method includes the following steps: Step S101: For the input source video data, according to any prediction mode in any combination of the first to fourth mode combinations, perform brightness prediction on the brightness value of the block to be encoded in the source video data to obtain the first prediction block. Step S102: Determine the difference between the luminance value on the block to be encoded and the luminance prediction value on the first prediction block to obtain a residual block; Step S103: Write the residual block and the prediction mode into the bitstream.
[0091] It should be noted that, based on the aforementioned steps S101 to S103, in other embodiments, the method may further include steps S401 to S403, or steps S501 to S503, or steps S601 to S603, or steps S701 to S703, or steps S801 to S803 as described in the above embodiments.
[0092] This application provides yet another information processing method, which is applied to the video encoder 21 of an electronic device. Figure 11A This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application, as shown below. Figure 11A As shown, the method includes the following steps: Step S1101: For the input source video data, according to the prediction mode, the image components on the block to be encoded in the source video data are predicted to obtain the third prediction block. The prediction mode is preset and belongs to the PDPC application mode. In other embodiments, the image component is a luminance value or a chrominance value.
[0093] Step S1102: According to the prediction mode, the third prediction block is corrected to obtain the third correction block; Step S1103: Determine the difference between the image component on the block to be encoded and the correction value on the third correction block to obtain the residual block; Step S1104: Write the residual block and the prediction mode into the bitstream.
[0094] In other embodiments, for step S1101, predicting the image components on the block to be encoded in the source video data according to the prediction mode to obtain a third prediction block includes: predicting the chroma values on the block to be encoded according to any prediction mode in the fifth mode combination to obtain a third prediction block; wherein, the fifth mode combination includes the following PDPC application modes: planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, prediction mode numbered as the first value among the preset N spatial prediction modes, and prediction mode numbered as the fourth value among the preset N spatial prediction modes.
[0095] In other embodiments, for step S1101, predicting the image components on the block to be encoded in the source video data according to the prediction mode to obtain a third prediction block includes: predicting the image components on the block to be encoded according to the prediction mode to obtain a third prediction block when all of the following conditions 1 to 4 are met. Case 1: The block to be encoded is a luma block and intra-frame sub-block partitioning is not used; or, the block to be encoded is a chroma block; Case 2: When the block to be encoded is a luma block, the 0th reference row is used for prediction; or, the block to be encoded is a chroma block; wherein, the 0th reference row refers to the reference row closest to the block to be encoded. Case 3: The block to be encoded was not encoded using the block-based incremental pulse code modulation (BDPCM) method; Case 4: Meets any of the following conditions: The prediction mode is a horizontal prediction mode; The prediction mode is a vertical prediction mode; The prediction mode is the prediction mode numbered as the first value among the preset N spatial prediction modes. The prediction pattern is the prediction pattern with the fourth numerical value. The prediction mode is the prediction mode where the number is less than or equal to the second value and the block to be encoded is not a chroma block; The prediction mode is a prediction mode where the number is greater than or equal to the third value, and the block to be encoded is not a chroma block.
[0096] In other embodiments, for step S1101, predicting the image components on the block to be encoded in the source video data according to the prediction mode to obtain a third prediction block includes: performing chroma prediction on the chroma values on the block to be encoded according to any prediction mode in the sixth mode combination to obtain a third prediction block; wherein, the sixth mode combination includes the following PDPC application modes: planar prediction mode, DC component prediction mode, horizontal prediction mode, and vertical prediction mode.
[0097] In other embodiments, for step S1101, predicting the image components on the block to be encoded in the source video data according to the prediction mode to obtain a third prediction block includes: predicting the image components on the block to be encoded according to the prediction mode to obtain a third prediction block when all of the following conditions 1 to 4 are met. Case 1: The block to be encoded is a luma block and intra-frame sub-block partitioning is not used; or, the block to be encoded is a chroma block; Case 2: When the block to be encoded is a luma block, the 0th reference row is used for prediction; or, the block to be encoded is a chroma block; wherein, the 0th reference row refers to the reference row closest to the block to be encoded. Case 3: The block to be encoded was not encoded using the BDPCM method; Case 4: Meets any of the following conditions: The prediction mode is a planar prediction mode; The prediction mode is a DC component prediction mode; The prediction mode is a horizontal prediction mode; The prediction mode is a vertical prediction mode; The prediction mode is the prediction mode where the number is less than or equal to the second value and the block to be encoded is not a chroma block; The prediction mode is a prediction mode where the number is greater than or equal to the third value, and the block to be encoded is not a chroma block.
[0098] In other embodiments, for step S1101, predicting the image components on the block to be encoded in the source video data according to the prediction mode to obtain a third prediction block includes: Chromaticity prediction is performed on the chromaticity value of the block to be encoded according to any prediction mode in the seventh mode combination to obtain the third prediction block; wherein, the seventh mode combination includes the following PDPC application modes: planar prediction mode and DC component prediction mode.
[0099] In other embodiments, for step S1101, predicting the image components on the block to be encoded in the source video data according to the prediction mode to obtain a third prediction block includes: predicting the image components on the block to be encoded according to the prediction mode to obtain a third prediction block when all of the following conditions 1 to 4 are met. Case 1: The block to be encoded is a luma block and intra-frame sub-block partitioning is not used; or, the block to be encoded is a chroma block; Case 2: When the block to be encoded is a luma block, the 0th reference row is used for prediction; or, the block to be encoded is a chroma block; wherein, the 0th reference row refers to the reference row closest to the block to be encoded. Case 3: The block to be encoded was not encoded using the BDPCM method; Case 4: Meets any of the following conditions: The prediction mode is a planar prediction mode; The prediction mode is a DC component prediction mode; The prediction mode is a horizontal prediction mode and the block to be encoded is not a chroma block; The prediction mode is a vertical prediction mode and the block to be encoded is not a chroma block; The prediction mode is the prediction mode where the number is less than or equal to the second value and the block to be encoded is not a chroma block; The prediction mode is a prediction mode where the number is greater than or equal to the third value, and the block to be encoded is not a chroma block.
[0100] In other embodiments, for step S1101, predicting the image components on the block to be encoded in the source video data according to the prediction mode to obtain a third prediction block includes: When all of the following conditions 1 to 4 are met, the image components on the block to be encoded are predicted according to the prediction mode to obtain the third prediction block; Case 1: The block to be encoded is a luma block and intra-frame sub-block partitioning is not used; Case 2: The block to be encoded is a luma block and prediction is performed using the 0th reference row; where the 0th reference row refers to the reference row closest to the block to be encoded. Case 3: The block to be encoded was not encoded using the BDPCM method; Case 4: Meets any of the following conditions: The prediction mode is a planar prediction mode; The prediction mode is a DC component prediction mode; The prediction mode is a horizontal prediction mode; The prediction mode is a vertical prediction mode; The prediction pattern is the prediction pattern where the number is less than or equal to the second value; The prediction pattern is the prediction pattern where the number is greater than or equal to the third value.
[0101] This application provides another information processing method, which is applied to the video decoder 21 of an electronic device. Figure 11B This is a schematic diagram illustrating the implementation flow of another information processing method according to an embodiment of this application, as shown below. Figure 11B As shown, the method includes the following steps: Step S1121: For the input bitstream, predict the image components on the block to be decoded in the bitstream according to the prediction mode in the bitstream to obtain the fourth prediction block; wherein, the prediction mode is preset and belongs to the PDPC application mode. In other embodiments, the image components are chroma values or luminance values.
[0102] Step S1122: According to the prediction mode, the fourth prediction block is corrected to obtain the fourth correction block; Step S1123: Determine the sum of the difference on the residual block in the bitstream and the correction value on the fourth correction block to obtain the recovery block; Step S1124: Process the recovery block and output the processed video data.
[0103] In VTM5.0, the PDPC method is applied to the planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, and the angle prediction mode with a number less than or equal to 10 and an angle prediction mode with a number greater than or equal to 58 among the 94 spatial prediction modes. That is, after using these prediction modes to predict the current block, the PDPC method is used to correct the predicted value.
[0104] VTM5.0 specifies that the PDPC method is used when all of the following conditions (101) to (104) are met: (101) When the current block is a luma block, Intra Sub-Partitions (ISP) are not used; or, the current block is a chroma block; (102) When the current block is a luma block, use the 0th reference line for prediction; or, when the current block is a chroma block; where the 0th reference line refers to the reference line closest to the current block; (103) The current block is not encoded using the block-based delta pulse code modulation (BDPCM) method; (104) Satisfies any of the following conditions: the prediction mode is a plane prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, an angle prediction mode with a number less than or equal to 10, or an angle prediction mode with a number greater than or equal to 58.
[0105] However, the performance improvement achieved by using the PDPC method comes at the cost of saving coding bits and sacrificing chroma performance. Since luminance and chroma reflect different image content, PDPC technology cannot simultaneously improve the performance of both luminance and chroma, nor should the same PDPC method be used uniformly for both luminance and chroma.
[0106] Based on this, the contents involved in the above embodiments will be described below with reference to several preferred embodiments.
[0107] This application provides a method for modifying the PDPC application mode to reduce the use of PDPC's chroma prediction mode. This restriction reduces time complexity and improves chroma coding performance. For ease of understanding, a detailed explanation follows.
[0108] The PDPC application modes of related technologies are the same in terms of brightness and chromaticity, all of which utilize planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, angle prediction mode with a number less than or equal to 10, or angle prediction mode greater than or equal to 58.
[0109] In this embodiment of the application, the chromaticity prediction is modified to use... Figure 2CWhen performing chromaticity prediction on the current block using any of the spatial prediction modes numbered less than or equal to 10 (excluding planar and DC component prediction modes) or greater than or equal to 58, the PDPC method is not used to correct the obtained chromaticity prediction value. In other words, when performing chromaticity prediction on the current block, the number of chromaticity prediction modes using PDPC is reduced to using PDPC only for planar, DC component, horizontal, or vertical prediction modes; while when performing luminance prediction on the current block, the luminance prediction modes using PDPC remain the planar, DC component, horizontal, and vertical prediction modes, as well as the angle prediction modes numbered less than or equal to 10 and greater than or equal to 58 among the 94 spatial prediction modes. That is, the luminance prediction modes using PDPC remain unchanged.
[0110] Accordingly, the syntax and semantics in VTM5.0 are modified, that is, the mode restrictions for applying PDPC are as follows: PDPC is used when all of the following conditions (201) to (204) are met: (201) The current block is a luma block and ISP partitioning was not used; or, the current block is a chroma block; (202) If the current block is a luma block, use the 0th reference row for prediction; or, if the current block is a chroma block; (203) The current block is not encoded using the BDPCM method; (204) Satisfies any of the following conditions: the prediction mode is a plane prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, an angle prediction mode with a number less than or equal to 10 and the current block is not a chromatic block, or an angle prediction mode with a number greater than or equal to 58 and the current block is not a chromatic block.
[0111] The method for modifying the PDPC application mode provided in this application embodiment can achieve the following beneficial effects without significantly affecting performance: Firstly, chroma coding performance can be improved with minimal impact on luminance coding performance. Experimental data shows that the Y component performance is reduced by 0.03%; the U component performance is improved by 0.16% and the V component performance is improved by 0.14%. This indicates that the Y component performance loss remains essentially unchanged, while the U component performance and V component performance are significantly enhanced.
[0112] Secondly, it can reduce complexity. PDPC has many applications in related technologies. Using the method provided in this application, the chroma prediction modes using PDPC can be reduced to four, thereby saving processing complexity and significantly shortening the decoding time.
[0113] The protection point of this application's embodiments lies in modifying the application scenario of PDPC in chroma prediction. Whether the main solution uses PDPC only for the planar prediction mode, DC component prediction mode, horizontal prediction mode, and vertical prediction mode in the chroma prediction mode, or the alternative solution prohibits the use of PDPC for some chroma prediction modes, the aim is to reduce the prediction modes in chroma prediction, lower the algorithm's complexity, and improve chroma coding performance. The alternative solutions mainly include the following: Alternative Solution 1: Modify the chromaticity prediction to use horizontal prediction mode and vertical prediction mode. Figure 2C When any of the prediction modes with numbers less than or equal to 10 and greater than or equal to 58 among the 94 spatial prediction modes shown, performs chromaticity prediction for the current block, the PDPC method is not used to correct the obtained chromaticity prediction value. That is, PDPC is prohibited for all chromaticity prediction modes, while the luminance prediction mode using PDPC remains unchanged when performing luminance prediction for the current block.
[0114] Accordingly, the syntax and semantics in VTM5.0 are modified so that PDPC is used when all of the following conditions (301) to (305) are met: (301) The current block is a luminance block; (302) The current block is not partitioned using ISP; (303) The current block uses the 0th reference row for prediction; (304) The current block is not encoded using the BDPCM method; (305) Satisfies any of the following conditions: the prediction mode is a plane prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, an angle prediction mode with a number less than or equal to 10, or an angle prediction mode with a number greater than or equal to 58.
[0115] Alternative Solution 2: Modify the chromaticity prediction so that when performing chromaticity prediction on the current block using any of the following prediction modes: horizontal prediction mode, vertical prediction mode, a prediction mode numbered less than or equal to 10 among the 94 spatial prediction modes (excluding planar and DC component prediction modes), and prediction modes numbered greater than or equal to 58, the PDPC method is not used to correct the obtained chromaticity prediction values. In other words, when performing chromaticity prediction, PDPC is only used in planar and DC component prediction modes; when performing luminance prediction on the current block, the luminance prediction mode using PDPC remains unchanged.
[0116] Accordingly, the syntax and semantics in VTM5.0 are modified as follows: PDPC is used when all of the following conditions (401) to (404) are met: (401) ISP partitioning was not used when the current block was a luma block; or, the current block was a chroma block; (402) If the current block is a luma block, use the 0th reference row for prediction; or, if the current block is a chroma block; (403) The current block is not encoded using the BDPCM method; (404) Satisfies any of the following conditions: the prediction mode is a plane prediction mode, a DC component prediction mode, a horizontal prediction mode and the current block is not a chromaticity block, a vertical prediction mode and the current block is not a chromaticity block, an angle prediction mode with a number less than or equal to 10 and the current block is not a chromaticity block, or an angle prediction mode with a number greater than or equal to 58 and the current block is not a chromaticity block.
[0117] Alternative Solution 3: Modify the chromaticity prediction so that when performing chromaticity prediction on the current block using any of the following prediction modes from the 94 component spatial prediction modes: prediction mode numbered less than 2 (excluding planar and DC component prediction modes), prediction mode numbered greater than 2 and less than or equal to 10, prediction mode numbered greater than or equal to 58 and less than 66, and prediction mode numbered greater than 66, the PDPC method is not used to correct the obtained chromaticity prediction value. In other words, PDPC is only used under any of the following prediction modes: planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, prediction mode numbered 2, and prediction mode numbered 66; when performing luminance prediction on the current block, the luminance prediction mode using PDPC remains unchanged.
[0118] Accordingly, the syntax and semantics in VTM5.0 are modified so that PDPC is used when all of the following conditions (501) to (504) are met: (501) ISP partitioning was not used when the current block was a luma block; or, the current block was a chroma block; (502) If the current block is a luma block, use the 0th reference row for prediction; or, if the current block is a chroma block; (503) The current block is not encoded using the BDPCM method; (504) Satisfies any of the following conditions: the prediction mode is a plane prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, a prediction mode numbered 2, a prediction mode numbered 66, an angle prediction mode numbered less than or equal to 10 and the current block is not a chromatic block, or an angle prediction mode numbered greater than or equal to 58 and the current block is not a chromatic block.
[0119] Alternative Solution 4: Modify chromaticity and luminance prediction so that when using any of the prediction modes numbered less than or equal to 10 and greater than 8, and prediction modes numbered greater than or equal to 58 and less than 60, within the 94 spatial prediction modes for the current block, the PDPC method is not used to correct the obtained chromaticity and luminance prediction values. In other words, the number of luminance and chromaticity prediction modes using PDPC is reduced.
[0120] Accordingly, the syntax and semantics in VTM5.0 are modified so that PDPC is used when the following conditions (601) to (604) are met: (601) ISP partitioning was not used when the current block was a luma block; or, the current block was a chroma block; (602) If the current block is a luma block, use the 0th reference row for prediction; or, if the current block is a chroma block; (603) The current block is not encoded using the BDPCM method; (604) Satisfies any of the following conditions: the prediction mode is a plane prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, an angle prediction mode with a number less than or equal to 8, or an angle prediction mode with a number greater than or equal to 60.
[0121] Based on the foregoing embodiments, this application provides an information processing device. The modules and units included in the device can be implemented by a processor in an electronic device; of course, they can also be implemented by specific logic circuits. In the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP), or a field programmable gate array (FPGA), etc.
[0122] Figure 12A This is a schematic diagram of the structure of the information processing device according to an embodiment of this application, as shown below. Figure 12A As shown, the information processing device 120 includes: The prediction module 121 is configured to predict the image components on the block to be encoded in the source video data according to the prediction mode, and obtain the first prediction block. The prediction mode is preset and belongs to the PDPC application mode. The residual determination module 122 is configured to determine the difference between the image component on the block to be encoded and the predicted value on the first prediction block, thereby obtaining a residual block; The writing module 123 is configured to write the residual block and the prediction mode into the bitstream.
[0123] In other embodiments, the image component is a luminance value or a chrominance value.
[0124] In other embodiments, such as Figure 12B As shown, the prediction module 121 includes a chromaticity prediction unit 1210, configured to: perform chromaticity prediction on the chromaticity value of the block to be encoded according to any prediction mode in the first mode combination to obtain a first prediction block; wherein, the first mode combination includes the following PDPC application modes: a prediction mode whose number is less than the first value and does not contain a plane prediction mode and a DC component prediction mode among the preset N spatial prediction modes, a prediction mode whose number is greater than the first value and less than or equal to the second value, a prediction mode whose number is greater than or equal to the third value and less than the fourth value, and a prediction mode whose number is greater than the fourth value.
[0125] In other embodiments, the chromaticity prediction unit 1210 is configured to: perform chromaticity prediction on the chromaticity value on the block to be encoded according to any prediction mode in the second mode combination to obtain a first prediction block; wherein, the second mode combination includes the following PDPC application modes: a prediction mode whose number is less than or equal to the second value and does not contain a plane prediction mode and a DC component prediction mode among the preset N spatial prediction modes, and a prediction mode whose number is greater than or equal to the third value.
[0126] In other embodiments, the chromaticity prediction unit 1210 is configured to: perform chromaticity prediction on the chromaticity value of the block to be encoded according to any prediction mode in the third mode combination to obtain a first prediction block; wherein, the third mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, prediction mode whose number is less than or equal to the second value among the preset N spatial prediction modes and does not contain the planar prediction mode and the DC component prediction mode, and prediction mode whose number is greater than or equal to the third value.
[0127] In other embodiments, the chromaticity prediction unit 1210 is configured to: perform chromaticity prediction on the chromaticity value on the block to be encoded according to any prediction mode in the fourth mode combination to obtain a first prediction block; wherein, the fourth mode combination includes the following PDPC application modes: vertical prediction mode, a prediction mode whose number is less than or equal to the second value among the preset N spatial prediction modes and includes a planar prediction mode and a DC component prediction mode, and a prediction mode whose number is greater than or equal to the third value.
[0128] In other embodiments, such as Figure 12B As shown, the prediction module 121 further includes a brightness prediction unit 1212, configured to: predict the brightness value on the block to be encoded according to any prediction mode in any combination of the first to fourth mode combinations, to obtain a first prediction block.
[0129] This application provides another information processing device. Figure 13This is a schematic diagram of the structure of another information processing device according to an embodiment of this application, such as... Figure 13 As shown, the information processing device 130 includes: The prediction module 131 is configured to: predict the image components on the block to be decoded in the input bitstream according to the prediction mode in the bitstream, and obtain a second prediction block; wherein the prediction mode is preset and belongs to the PDPC application mode. Recovery module 132 is configured to: determine the sum of the difference on the residual block in the bitstream and the predicted value on the second prediction block to obtain a recovery block; The video output module 133 is configured to process the recovery block and output the processed video data.
[0130] In other embodiments, the image components are chroma values or luminance values.
[0131] In other embodiments, the prediction mode is any prediction mode in the first mode combination; wherein, the first mode combination includes the following PDPC application modes: a prediction mode whose number is less than a first value and does not contain a plane prediction mode and a DC component prediction mode among the preset N spatial prediction modes, a prediction mode whose number is greater than a first value and less than or equal to a second value, a prediction mode whose number is greater than or equal to a third value and less than a fourth value, and a prediction mode whose number is greater than a fourth value.
[0132] In other embodiments, the prediction mode is any prediction mode in the second mode combination; wherein, the second mode combination includes the following PDPC application modes: a prediction mode whose number is less than or equal to the second value and does not contain a plane prediction mode and a DC component prediction mode among the preset N spatial prediction modes, and a prediction mode whose number is greater than or equal to the third value.
[0133] In other embodiments, the prediction mode is any prediction mode in the third mode combination; wherein, the third mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, prediction mode whose number is less than or equal to the second value among the preset N spatial prediction modes and does not contain the planar prediction mode and the DC component prediction mode, and prediction mode whose number is greater than or equal to the third value.
[0134] In other embodiments, the prediction mode is any prediction mode in the fourth mode combination; wherein, the fourth mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, prediction mode with a number less than or equal to the second value among the preset N spatial prediction modes and including the plane prediction mode and the DC component prediction mode, and prediction mode with a number greater than or equal to the third value.
[0135] This application provides yet another information processing device. Figure 14 This is a schematic diagram of the structure of another information processing device according to an embodiment of this application, as shown below. Figure 14 As shown, the information processing device 140 includes: The prediction module 1401 is configured to: predict the image components on the block to be encoded in the source video data according to the prediction mode, based on the input source video data, to obtain a third prediction block, wherein the prediction mode is preset and belongs to the PDPC application mode. The correction module 1402 is configured to: correct the third prediction block according to the prediction mode to obtain a third correction block; The residual determination module 1403 is configured to: determine the difference between the image component on the block to be encoded and the correction value on the third correction block, and obtain the residual block; The writing module 1404 is configured to write the residual block and the prediction mode into the bitstream.
[0136] In other embodiments, the image component is a luminance value or a chrominance value.
[0137] In other embodiments, the prediction module 1401 is configured to: perform chromaticity prediction on the chromaticity value of the block to be encoded according to any prediction mode in the fifth mode combination to obtain a third prediction block; wherein, the fifth mode combination includes the following PDPC application modes: planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, prediction mode numbered as the first value among the preset N spatial prediction modes, and prediction mode numbered as the fourth value among the preset N spatial prediction modes.
[0138] In other embodiments, the prediction module 1401 is configured as follows: When all of the following conditions 1 to 4 are met, the image components on the block to be encoded are predicted according to the prediction mode to obtain the third prediction block; Case 1: The block to be encoded is a luma block and intra-frame sub-block partitioning is not used; or, the block to be encoded is a chroma block; Case 2: When the block to be encoded is a luma block, the 0th reference row is used for prediction; or, the block to be encoded is a chroma block; wherein, the 0th reference row refers to the reference row closest to the block to be encoded. Case 3: The block to be encoded was not encoded using the block-based incremental pulse code modulation (BDPCM) method; Case 4: Meets any of the following conditions: The prediction mode is a horizontal prediction mode; The prediction mode is a vertical prediction mode; The prediction mode is the prediction mode numbered as the first value among the preset N spatial prediction modes. The prediction pattern is the prediction pattern with the fourth numerical value. The prediction mode is the prediction mode where the number is less than or equal to the second value and the block to be encoded is not a chroma block; The prediction mode is a prediction mode where the number is greater than or equal to the third value, and the block to be encoded is not a chroma block.
[0139] In other embodiments, the prediction module 1401 is configured to: perform chromaticity prediction on the chromaticity value on the block to be encoded according to any prediction mode in the sixth mode combination to obtain a third prediction block; wherein, the sixth mode combination includes the following PDPC application modes: planar prediction mode, DC component prediction mode, horizontal prediction mode, and vertical prediction mode.
[0140] In other embodiments, the prediction module 1401 is configured as follows: When all of the following conditions 1 to 4 are met, the image components on the block to be encoded are predicted according to the prediction mode to obtain the third prediction block; Case 1: The block to be encoded is a luma block and intra-frame sub-block partitioning is not used; or, the block to be encoded is a chroma block; Case 2: When the block to be encoded is a luma block, the 0th reference row is used for prediction; or, the block to be encoded is a chroma block; wherein, the 0th reference row refers to the reference row closest to the block to be encoded. Case 3: The block to be encoded was not encoded using the BDPCM method; Case 4: Meets any of the following conditions: The prediction mode is a planar prediction mode; The prediction mode is a DC component prediction mode; The prediction mode is a horizontal prediction mode; The prediction mode is a vertical prediction mode; The prediction mode is the prediction mode where the number is less than or equal to the second value and the block to be encoded is not a chroma block; The prediction mode is a prediction mode where the number is greater than or equal to the third value, and the block to be encoded is not a chroma block.
[0141] In other embodiments, the prediction module 1401 is configured to: perform chromaticity prediction on the chromaticity value of the block to be encoded according to any prediction mode in the seventh mode combination to obtain a third prediction block; wherein, the seventh mode combination includes the following PDPC application modes: planar prediction mode and DC component prediction mode.
[0142] In other embodiments, the prediction module 1401 is configured as follows: When all of the following conditions 1 to 4 are met, the image components on the block to be encoded are predicted according to the prediction mode to obtain the third prediction block; Case 1: The block to be encoded is a luma block and intra-frame sub-block partitioning is not used; or, the block to be encoded is a chroma block; Case 2: When the block to be encoded is a luma block, the 0th reference row is used for prediction; or, the block to be encoded is a chroma block; wherein, the 0th reference row refers to the reference row closest to the block to be encoded. Case 3: The block to be encoded was not encoded using the BDPCM method; Case 4: Meets any of the following conditions: The prediction mode is a planar prediction mode; The prediction mode is a DC component prediction mode; The prediction mode is a horizontal prediction mode and the block to be encoded is not a chroma block; The prediction mode is a vertical prediction mode and the block to be encoded is not a chroma block; The prediction mode is the prediction mode where the number is less than or equal to the second value and the block to be encoded is not a chroma block; The prediction mode is a prediction mode where the number is greater than or equal to the third value, and the block to be encoded is not a chroma block.
[0143] In other embodiments, the prediction module 1401 is configured as follows: When all of the following conditions 1 to 4 are met, the image components on the block to be encoded are predicted according to the prediction mode to obtain the third prediction block; Case 1: The block to be encoded is a luma block and intra-frame sub-block partitioning is not used; Case 2: The block to be encoded is a luma block and prediction is performed using the 0th reference row; where the 0th reference row refers to the reference row closest to the block to be encoded. Case 3: The block to be encoded was not encoded using the BDPCM method; Case 4: Meets any of the following conditions: The prediction mode is a planar prediction mode; The prediction mode is a DC component prediction mode; The prediction mode is a horizontal prediction mode; The prediction mode is a vertical prediction mode; The prediction pattern is the prediction pattern where the number is less than or equal to the second value; The prediction pattern is the prediction pattern where the number is greater than or equal to the third value.
[0144] This application provides another information processing device. Figure 15 This is a schematic diagram of the structure of another information processing device according to an embodiment of this application, as shown below. Figure 15 As shown, the information processing device 150 includes: The prediction module 1501 is configured to: predict the image components on the block to be decoded in the input bitstream according to the prediction mode in the bitstream, and obtain a fourth prediction block; wherein the prediction mode is preset and belongs to the PDPC application mode. The correction module 1502 is configured to: correct the fourth prediction block according to the prediction mode to obtain a fourth correction block; Recovery module 1503 is configured to: determine the sum of the difference on the residual block in the bitstream and the correction value on the fourth correction block to obtain the recovery block; The video output module 1504 is configured to process the recovery block and output the processed video data.
[0145] In other embodiments, the image components are chroma values or luminance values.
[0146] The descriptions of the above device embodiments are similar to those of the above method embodiments, and have similar beneficial effects. For technical details not disclosed in the device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.
[0147] It should be noted that, in the embodiments of this application, if the above-described information processing method is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiments of this application, or the part that contributes to the related technology, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause electronic devices (which may be mobile phones, tablets, e-readers, drones, wearable devices (such as smart glasses), robot vacuum cleaners, personal computers, navigators, video phones, televisions, servers, etc.) to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, mobile hard drives, read-only memory (ROM), magnetic disks, or optical disks. Thus, the embodiments of this application are not limited to any specific hardware and software combination.
[0148] Correspondingly, embodiments of this application provide an electronic device, Figure 16 This is a schematic diagram of the hardware entity of an electronic device according to an embodiment of this application, such as... Figure 16As shown, the electronic device 160 includes a memory 161 and a processor 162. The memory 161 stores a computer program that can run on the processor 162. When the processor 162 executes the program, it implements the steps in the information processing method provided in the above embodiments.
[0149] It should be noted that the memory 161 is configured to store instructions and applications executable by the processor 162, and can also cache data to be processed or already processed by the processor 162 and the various modules in the electronic device 160 (e.g., image data, audio data, voice communication data and video communication data), which can be implemented by flash memory or random access memory (RAM).
[0150] This application provides a computer-readable storage medium storing a computer program thereon, which, when executed by a processor, implements the steps in the information processing method provided in the above embodiments.
[0151] It should be noted that the descriptions of the storage medium and device embodiments above are similar to the descriptions of the method embodiments above, and have similar beneficial effects. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the descriptions of the method embodiments of this application for understanding.
[0152] It should be understood that the phrase "one embodiment" or "an embodiment" throughout the specification means that a specific feature, structure, or characteristic related to the embodiment is included in at least one embodiment of this application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments. It should be understood that in the various embodiments of this application, the sequence numbers of the above-described processes do not imply a sequential order of execution; the execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application. The sequence numbers of the above-described embodiments are merely descriptive and do not represent the superiority or inferiority of the embodiments.
[0153] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.
[0154] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely illustrative. For example, the division of units is only a logical functional division, and in actual implementation, there may be other division methods, such as: multiple units or components can be combined, or integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the various components shown or discussed can be through some interfaces, and the indirect coupling or communication connection between devices or units can be electrical, mechanical, or other forms.
[0155] The units described above as separate components may or may not be physically separate. The components shown as units may or may not be physical units. They may be located in one place or distributed across multiple network units. Some or all of the units may be selected to achieve the purpose of this embodiment according to actual needs.
[0156] In addition, each functional unit in the various embodiments of this application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the integrated unit can be implemented in hardware or in the form of hardware plus software functional units.
[0157] Those skilled in the art will understand that all or part of the steps of the above method embodiments can be implemented by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it performs the steps of the above method embodiments. The aforementioned storage medium includes various media that can store program code, such as mobile storage devices, read-only memory (ROM), magnetic disks, or optical disks.
[0158] Alternatively, if the integrated units described above in this application are implemented as software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts that contribute to related technologies, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause an electronic device (which may be a mobile phone, tablet computer, e-reader, drone, wearable device (such as smart glasses), robot vacuum cleaner, personal computer, navigator, video phone, television, server, etc.) to execute all or part of the methods described in the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as mobile storage devices, ROM, magnetic disks, or optical disks.
[0159] The methods disclosed in the several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.
[0160] The features disclosed in the several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.
[0161] The features disclosed in the several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method or device embodiments.
[0162] The above description is merely an embodiment of this application, but the scope of protection of this application is not limited thereto. Any variations or substitutions that can be easily conceived by those skilled in the art within the scope of the technology disclosed in this application should be included within the scope of protection of this application. Therefore, the scope of protection of this application should be determined by the scope of the claims.
[0163] Industrial applicability In this embodiment of the application, for the input source video data, the image components on the block to be encoded in the source video data are predicted according to a preset prediction mode belonging to the PDPC application mode. After obtaining the first prediction block, each prediction value in the first prediction block is not corrected. Instead, the difference between the prediction value on the first prediction block and the image component on the block to be encoded is directly determined. In this way, the processing complexity of intra-frame prediction can be reduced while ensuring the video encoding and decoding performance.
Claims
1. A method for reading a bitstream, characterized in that, The steps of reading the bitstream and performing a video decoding method, wherein the video decoding method includes the following steps: Decode the bitstream to obtain the prediction mode, and predict the image components of the block to be decoded according to the prediction mode to obtain the third prediction block; wherein, the prediction mode is a preset PDPC mode that can be applied based on position-dependent modes. When all of the following conditions 1 to 3 are met, the third prediction block is corrected according to the prediction mode to obtain the third correction block; Case 1: The block to be decoded is a chroma block; Case 2: The block to be decoded was not encoded using the block-based incremental pulse code modulation (BDPCM) method; Case 3: Meets any of the following conditions: The prediction mode is the prediction mode numbered with the first value among the spatial prediction modes within the preset N components, where the first value is 2. The prediction pattern is the prediction pattern with the fourth numerical value, and the fourth numerical value is 66; Decode the bitstream to determine the residual block; determine the sum of the residual block and the third correction block to obtain the recovery block.
2. A method for storing a bitstream, characterized in that, The video encoding method includes the steps of performing a video encoding method to generate a bitstream and storing the bitstream, the video encoding method comprising the following steps: The image components of the block to be encoded are predicted according to the prediction mode to obtain the third prediction block; wherein, the prediction mode is a preset PDPC mode that can be applied based on position-dependent modes. When all of the following conditions 1 to 3 are met, the third prediction block is corrected according to the prediction mode to obtain the third correction block; Case 1: The block to be encoded is a chroma block; Case 2: The block to be encoded was not encoded using the block-based incremental pulse code modulation (BDPCM) method; Case 3: Meets any of the following conditions: The prediction mode is the prediction mode numbered with the first value among the spatial prediction modes within the preset N components, where the first value is 2. The prediction pattern is the prediction pattern with the fourth numerical value, and the fourth numerical value is 66; Determine the difference between the block to be encoded and the third correction block to obtain the residual block; The residual block and the prediction mode are written into the bitstream.
3. A method for transmitting a code stream, characterized in that, The video encoding method includes the steps of performing a video encoding method to generate a bitstream and transmitting the bitstream, the video encoding method comprising the following steps: The image components of the block to be encoded are predicted according to the prediction mode to obtain the third prediction block; wherein, the prediction mode is a preset PDPC mode that can be applied based on position-dependent modes. When all of the following conditions 1 to 3 are met, the third prediction block is corrected according to the prediction mode to obtain the third correction block; Case 1: The block to be encoded is a chroma block; Case 2: The block to be encoded was not encoded using the block-based incremental pulse code modulation (BDPCM) method; Case 3: Meets any of the following conditions: The prediction mode is the prediction mode numbered with the first value among the spatial prediction modes within the preset N components, where the first value is 2. The prediction pattern is the prediction pattern with the fourth numerical value, and the fourth numerical value is 66; Determine the difference between the block to be encoded and the third correction block to obtain the residual block; The residual block and the prediction mode are written into the bitstream.
Citation Information
Patent Citations
Constrained position dependent intra prediction combination (PDPC)
WO2018119167A1