Information processing method and device, equipment and storage medium
By using the prediction mode dependent prediction combination (PDPC) to predict the image components in the video encoding and decoding process and directly determine the difference, the problem of high video encoding complexity is solved and the complexity of intra-frame prediction is reduced.
Patent Information
- Application Number
- CN202511111069.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2019-06-25
- Publication Date
- 2025-10-10
AI Technical Summary
The information processing complexity in existing video coding technologies is relatively high, which affects the smoothness of the video, especially the processing complexity of intra-frame prediction.
A prediction mode-dependent prediction combination (PDPC) is used to predict the image components on the coding block, and the difference between the predicted block and the image components is directly determined to avoid correcting the predicted value.
Under the premise of ensuring the video encoding and decoding performance, the information processing complexity of video encoding and decoding, especially the processing complexity of intra-frame prediction, is reduced.
Smart Images

Figure CN120769063A_ABST
Abstract
Description
[0001] Description of the case
[0002] This application is a divisional application based on an application with an application date of June 25, 2019, application number 201980096244.5, and invention name “Information processing method, device, equipment, and storage medium”. Technical Field
[0003] The embodiments of the present application relate to electronic technology, and relate to but are not limited to information processing methods and devices, equipment, and storage media. Background Art
[0004] In recent years, video services have developed rapidly in the field of electronic technology. Video services require encoding source video data and transmitting the encoded video data to user terminals through channels of the Internet or mobile communication networks.
[0005] For users, the smoothness of the video will directly affect their video viewing experience. The complexity of information processing in video encoding directly affects the smoothness of the video. Summary of the Invention
[0006] In view of this, embodiments of the present application provide an information processing method, apparatus, device, and storage medium to solve at least one problem existing in the related art.
[0007] The technical solution of the embodiment of the present application is implemented as follows:
[0008] In a first aspect, an embodiment of the present application provides an information processing method, comprising: for input source video data, predicting an image component on a block to be encoded in the source video data according to a prediction mode to obtain a first prediction block, wherein the prediction mode is a preset and mode-dependent prediction mode combination (Position-Dependent Prediction Combination, PDPC) application mode; determining a difference between the image component on the block to be encoded and a prediction value on the first prediction block to obtain a residual block; and writing the residual block and the prediction mode into a bitstream.
[0009] In other embodiments, the image components are luminance values or chrominance values.
[0010] In other embodiments, the predicting the image component on the to-be-coded block according to the prediction mode to obtain a first prediction block comprises: predicting the chroma value on the to-be-coded block according to any prediction mode in a first mode combination to obtain the first prediction block; wherein the first mode combination comprises the following PDPC application modes: a prediction mode numbered less than a first value and not containing a planar prediction mode and a direct current component prediction mode in preset N spatial prediction modes within a component, a prediction mode numbered greater than the first value and less than or equal to a second value, a prediction mode numbered greater than or equal to a third value and less than a fourth value, and a prediction mode numbered greater than the fourth value.
[0011] In other embodiments, the predicting the image component on the to-be-coded block according to the prediction mode to obtain a first prediction block comprises: predicting the chroma value on the to-be-coded block according to any prediction mode in a second mode combination to obtain the first prediction block; wherein the second mode combination comprises the following PDPC application modes: a prediction mode numbered less than or equal to the second value and not containing a planar prediction mode and a direct current component prediction mode in preset N spatial prediction modes within a component, and a prediction mode numbered greater than or equal to the third value.
[0012] In other embodiments, the predicting the image component on the to-be-coded block according to the prediction mode to obtain a first prediction block comprises: predicting the chroma value on the to-be-coded block according to any prediction mode in a third mode combination to obtain the first prediction block; wherein the third mode combination comprises the following PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode numbered less than or equal to the second value and not containing a planar prediction mode and a direct current component prediction mode in preset N spatial prediction modes within a component, and a prediction mode numbered greater than or equal to the third value.
[0013] In other embodiments, the predicting the image component on the to-be-coded block according to the prediction mode to obtain a first prediction block comprises: predicting the chroma value on the to-be-coded block according to any prediction mode in a fourth mode combination to obtain the first prediction block; wherein the fourth mode combination comprises the following PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode numbered less than or equal to the second value and containing a planar prediction mode and a direct current component prediction mode in preset N spatial prediction modes within a component, and a prediction mode numbered greater than or equal to the third value.
[0014] In other embodiments, the method of predicting the image component on the block to be encoded in the input source video data according to the prediction mode to obtain the first prediction block includes: performing brightness prediction on the brightness value on the block to be encoded according to any prediction mode in any combination of the first to fourth mode combinations to obtain the first prediction block.
[0015] In a second aspect, an embodiment of the present application provides an information processing device, comprising: a prediction module, configured to predict the image component on the block to be encoded in the input source video data according to a prediction mode to obtain a first prediction block, wherein the prediction mode is preset and belongs to the PDPC application mode; a residual determination module, configured to determine the difference between the image component on the block to be encoded and the prediction value on the first prediction block to obtain a residual block; and a writing module, configured to write the residual block and the prediction mode into a bitstream.
[0016] In other embodiments, the image components are luminance values or chrominance values.
[0017] In other embodiments, the prediction module includes: a chrominance prediction unit, configured to: perform chrominance prediction on the chrominance value on the block to be encoded according to any prediction mode in the first mode combination to obtain a first prediction block; wherein the first mode combination includes the following PDPC application modes: a prediction mode in the spatial prediction mode within the preset N components whose number is less than the first value and does not include a plane prediction mode and a DC component prediction mode, a prediction mode whose number is greater than the first value and less than or equal to the second value, a prediction mode whose number is greater than or equal to the third value and less than the fourth value, and a prediction mode whose number is greater than the fourth value.
[0018] In other embodiments, the prediction module includes: a chroma prediction unit configured to: perform chroma prediction on the chroma value of the to-be-encoded block according to any prediction mode in the second mode combination to obtain a first prediction block;
[0019] Among them, the second mode combination includes the following PDPC application modes: prediction modes in the spatial prediction modes within the preset N components whose numbers are less than or equal to the second value and do not include planar prediction modes and DC component prediction modes, and prediction modes whose numbers are greater than or equal to the third value.
[0020] In other embodiments, the prediction module includes: a chrominance prediction unit, configured to: perform chrominance prediction on the chrominance value on the block to be encoded according to any prediction mode in the third mode combination to obtain a first prediction block; wherein, the third mode combination includes the following PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in the spatial prediction mode within the preset N components whose number is less than or equal to the second value and does not include a planar prediction mode and a DC component prediction mode, and a prediction mode whose number is greater than or equal to the third value.
[0021] In other embodiments, the prediction module includes: a chrominance prediction unit, configured to: perform chrominance prediction on the chrominance value on the block to be encoded according to any prediction mode in the fourth mode combination to obtain a first prediction block; wherein the fourth mode combination includes the following PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in the spatial prediction mode within the preset N components whose number is less than or equal to the second value and includes a planar prediction mode and a DC component prediction mode, and a prediction mode whose number is greater than or equal to the third value.
[0022] In other embodiments, the prediction module includes: a brightness prediction unit configured to: perform brightness prediction on the brightness value of the block to be encoded according to any prediction mode in any combination of the first to fourth mode combinations to obtain a first prediction block.
[0023] In a third aspect, an embodiment of the present application provides an information processing method, comprising: predicting, for an input bitstream, an image component on a block to be decoded in the bitstream according to a prediction mode in the bitstream to obtain a second prediction block; the prediction mode is preset and belongs to a PDPC application mode; determining the sum of a difference value on a residual block in the bitstream and a prediction value on the second prediction block to obtain a recovery block; processing the recovery block and outputting processed video data.
[0024] In a fourth aspect, an embodiment of the present application provides an information processing device, comprising: a prediction module, configured to: for an input bitstream, predict an image component on a block to be decoded in the bitstream according to a prediction mode in the bitstream, to obtain a second prediction block; wherein the prediction mode is preset and belongs to a PDPC application mode; a recovery module, configured to: determine the sum of a difference value on a residual block in the bitstream and a prediction value on the second prediction block, to obtain a recovery block; and a video output module, configured to: process the recovery block and output processed video data.
[0025] In a fifth aspect, an embodiment of the present application provides an information processing method, which comprises: for input source video data, predicting an image component on a to-be-encoded block in the source video data according to a prediction mode to obtain a third prediction block, the prediction mode being preset and belonging to a PDPC application mode; correcting the third prediction block according to the prediction mode to obtain a third correction block; determining a difference between the image component on the to-be-encoded block and a correction value on the third correction block to obtain a residual block; and writing the residual block and the prediction mode into a bitstream.
[0026] In a sixth aspect, an embodiment of the present application provides an information processing apparatus, which comprises: a prediction module configured to, for input source video data, predict an image component on a to-be-encoded block in the source video data according to a prediction mode to obtain a third prediction block, the prediction mode being preset and belonging to a PDPC application mode; a correction module configured to correct the third prediction block according to the prediction mode to obtain a third correction block; a residual determination module configured to determine a difference between the image component on the to-be-encoded block and a correction value on the third correction block to obtain a residual block; and a writing module configured to write the residual block and the prediction mode into a bitstream.
[0027] In a seventh aspect, an embodiment of the present application provides an information processing method, which comprises: for input bitstream, predicting an image component on a to-be-decoded block in the bitstream according to a prediction mode in the bitstream to obtain a fourth prediction block, the prediction mode being preset and belonging to a PDPC application mode; correcting the fourth prediction block according to the prediction mode to obtain a fourth correction block; determining a sum of a difference on a residual block in the bitstream and a correction value on the fourth correction block to obtain a recovery block; and processing the recovery block to output processed video data.
[0028] In an eighth aspect, an embodiment of the present application provides an information processing apparatus, which comprises: a prediction module configured to, for input bitstream, predict an image component on a to-be-decoded block in the bitstream according to a prediction mode in the bitstream to obtain a fourth prediction block, the prediction mode being preset and belonging to a PDPC application mode; a correction module configured to correct the fourth prediction block according to the prediction mode to obtain a fourth correction block; a recovery module configured to determine a sum of a difference on a residual block in the bitstream and a correction value on the fourth correction block to obtain a recovery block; and a video output module configured to:
[0029] process the recovery block to output processed video data.
[0030] In a ninth aspect, an embodiment of the present application provides an electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and the processor implements the steps in the above-mentioned information processing method when executing the program.
[0031] In a tenth aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above-mentioned information processing method are implemented.
[0032] In an embodiment of the present application, for the input source video data, the image component on the block to be encoded in the source video data is predicted according to a preset prediction mode belonging to the PDPC application mode. After obtaining the first prediction block, the prediction value in the first prediction block is not corrected, but the difference between the prediction value on the first prediction block and the image component on the block to be encoded is directly determined; in this way, under the premise of ensuring the video encoding and decoding performance, the complexity of information processing in video encoding and decoding can be reduced, especially the processing complexity of intra-frame prediction can be reduced. BRIEF DESCRIPTION OF THE DRAWINGS
[0033] Figure 1 This is a schematic diagram of the network architecture of an embodiment of the present application;
[0034] Figure 2A This is a schematic diagram of the structure of a video encoder according to an embodiment of the present application;
[0035] Figure 2B This is a schematic diagram of the structure of a video decoder according to an embodiment of the present application;
[0036] Figure 2C Schematic diagram of spatial prediction modes within 94 components in an embodiment of the present application;
[0037] Figure 2D Schematic diagram of the PDPC calculation method in the DC component prediction mode of an embodiment of the present application;
[0038] Figure 3A This is a schematic diagram of the implementation flow of the information processing method according to an embodiment of the present application;
[0039] Figure 3B This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application;
[0040] Figure 4A This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application;
[0041] Figure 4B This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application;
[0042] Figure 5This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application;
[0043] Figure 6 This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application;
[0044] Figure 7 This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application;
[0045] Figure 8 This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application;
[0046] Figure 9A This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application;
[0047] Figure 9B This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application;
[0048] Figure 10 This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application;
[0049] Figure 11A This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application;
[0050] Figure 11B This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application;
[0051] Figure 12A This is a schematic diagram of the structure of the information processing device according to an embodiment of the present application;
[0052] Figure 12B This is a schematic structural diagram of another information processing device according to an embodiment of the present application;
[0053] Figure 13 This is a structural diagram of another information processing device according to an embodiment of the present application;
[0054] Figure 14 This is a structural diagram of another information processing device according to an embodiment of the present application;
[0055] Figure 15 This is a schematic structural diagram of another information processing device according to an embodiment of the present application;
[0056] Figure 16 A hardware entity diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION
[0057] To make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the specific technical solutions of the present application will be further described in detail below in conjunction with the drawings in the embodiments of the present application. The following embodiments are used to illustrate the present application but are not intended to limit the scope of the present application.
[0058] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which this application pertains. The terms used herein are for the purpose of describing the embodiments of this application only and are not intended to limit this application.
[0059] In the following description, reference is made to “some embodiments”, which describes a subset of all possible embodiments, but it will be understood that “some embodiments” may be the same subset or different subsets of all possible embodiments and may be combined with each other without conflict.
[0060] It should be pointed out that the terms "first\second\third" involved in the embodiments of the present application are merely used to distinguish similar objects and do not represent a specific ordering of the objects. It can be understood that "first\second\third" can be interchanged with a specific order or sequence where permitted, so that the embodiments of the present application described here can be implemented in an order other than that illustrated or described here.
[0061] This embodiment first provides a network architecture. Figure 1 This is a schematic diagram of the network architecture of the embodiment of the present application. Figure 1 As shown, the network architecture includes one or more electronic devices 11 to 1N and a communication network 01, wherein the electronic devices 11 to 1N can perform video interaction through the communication network 01. During implementation, the electronic devices can be various types of devices with video encoding and decoding functions, for example, the electronic devices can include mobile phones, tablet computers, e-readers, drones, wearable devices (such as smart glasses, etc.), sweeping robots, personal computers, navigation systems, video phones, televisions, servers, etc.
[0062] The electronic device has a video encoding and decoding function, including a video encoder and / or a video decoder, for example, see Figure 2AAs shown, the video encoder 21 is composed of a transform and quantization unit 211, an intra-frame estimation unit 212, an intra-frame prediction unit 213, a motion compensation unit 214, a motion estimation unit 215, an inverse transform and inverse quantization unit 216, a filter control analysis unit 217, a filtering unit 218, an encoding unit 219, and a decoded image buffer unit 210. Among them, the filtering unit 218 can implement deblocking filtering and sample adaptive offset (SAO) filtering, and the encoding unit 219 can implement header information encoding and context-based adaptive binary arithmetic coding (CABAC).
[0063] For the input source video data, a video coding block can be obtained by dividing the coding tree unit (CTU). Then, the residual pixel information obtained after intra-frame or inter-frame prediction is transformed by the transformation and quantization unit 211, including transforming the residual information from the pixel domain to the transform domain and quantizing the obtained transform coefficients to further reduce the bit rate; the intra-frame estimation unit 212 and the intra-frame prediction unit 213 are used to perform intra-frame prediction on the video coding block; specifically, the intra-frame estimation unit 212 and the intra-frame prediction unit 213 are used to determine the intra-frame prediction mode to be used to encode the video coding block; the motion compensation unit 214 and the motion estimation unit 215 are used to perform inter-frame prediction coding of the received video coding block relative to one or more blocks in one or more reference frames to provide temporal prediction information; the motion estimation performed by the motion estimation unit 215 is a process of generating a motion vector, which can estimate the motion of the video coding block, and then the motion compensation unit 214 calculates the motion vector based on the motion vector determined by the motion estimation unit 215. After determining the intra-frame prediction mode, the intra-frame prediction unit 213 is further configured to provide the selected intra-frame prediction data to the encoding unit 219, and the motion estimation unit 215 also sends the calculated motion vector data to the encoding unit 219. In addition, the inverse transform and inverse quantization unit 216 is configured to reconstruct the video coding block and reconstruct the residual block in the pixel domain. The reconstructed residual block is subjected to the filter control analysis unit 217 and the filtering unit 218 to remove the block effect artifacts. The reconstructed residual block is then added to a predictive block in the frame of the decoded image buffer unit 210 to generate a reconstructed video coding block. The encoding unit 219 is configured to encode various coding parameters and quantized transform coefficients. In the CABAC-based coding algorithm, the context content can be based on adjacent coding blocks and can be used to encode information indicating the determined intra-frame prediction mode, thereby outputting the code stream of the source video data. The decoded image buffer unit 210 is configured to store the reconstructed video coding block for prediction reference. As the video image encoding proceeds, new reconstructed video encoding blocks are continuously generated, and these reconstructed video encoding blocks are stored in the decoded image buffer unit 210 .
[0064] The video decoder 22 corresponding to the video encoder 21 has a structure as follows: Figure 2B As shown, it includes: a decoding unit 221, an inverse transform and inverse quantization unit 222, an intra-frame prediction unit 223, a motion compensation unit 224, a filtering unit 225 and a decoded image cache unit 226, etc., wherein the decoding unit 221 can implement header information decoding and CABAC decoding, and the filtering unit 225 can implement deblocking filtering and SAO filtering. The input source video data is processed by Figure 2AAfter the encoding process, the code stream of the source video data is output; the code stream is input to the video decoder 22, and first passes through the decoding unit 221 to obtain the decoded transform coefficients; the transform coefficients are processed by the inverse transform and inverse quantization unit 222 to generate a residual block in the pixel domain; the intra-frame prediction unit 223 can be used to generate prediction data for the current video decoding block based on the determined intra-frame prediction mode and the data of the previously decoded block from the current frame or picture; the motion compensation unit 224 determines the prediction information for the video decoding block by analyzing the motion vector and other associated syntax elements, and uses the prediction information to generate A predictive block of the video decoding block being decoded; a decoded video block is formed by summing the residual block from the inverse transform and inverse quantization unit 222 and the corresponding predictive block generated by the intra-frame prediction unit 223 or the motion compensation unit 224; the decoded video data obtained is processed by the filtering unit 225 to remove block effect artifacts, which can improve the video quality; the decoded video data is then stored in the decoded image cache unit 226, which stores reference images for subsequent intra-frame prediction or motion compensation, and is also used for the output of video data, that is, the restored source video data is obtained.
[0065] Before elaborating on the embodiments of the present application in detail, the intra-frame prediction mode is first briefly described.
[0066] In the latest Versatile Video Coding (VVC) draft (also known as H.266), in order to capture finer edge directions present in natural videos, such as Figure 2C As shown, the VVC test model VTM5.0 defines 94 spatial prediction modes within the component numbered from -14 to 80, including two non-angle modes, namely the Planar mode numbered 0 (hereinafter referred to as the planar prediction mode) and the DC mode numbered 1 (hereinafter referred to as the DC component prediction mode). It should be noted that the number is used to uniquely identify the prediction mode and can be used as a mode index number when used. In intra-frame prediction, spatial prediction within the component within the frame is performed on the current block (Current Block) by using one or more prediction modes among the 94 spatial prediction modes within the component.
[0067] It should be noted that the information processing method in the embodiment of the present application is mainly used in Figure 2A The intra-frame prediction unit 213 shown is partly Figure 2BThe intra-frame prediction unit 223 shown is used to obtain the intra-frame prediction value of the current block. That is to say, the information processing method in the embodiment of the present application can be applied to the video encoder 21, the video decoder 22, and even the video encoder 21 and the video decoder 22 at the same time, but the embodiment of the present application does not specifically limit it. When the method described below is applied to the 213 part, the "current block" refers to the block to be encoded in the 213 part; when the method described below is applied to the 223 part, the "current block" refers to the block to be decoded in the 223 part.
[0068] The intra-frame prediction process performed by the intra-frame prediction unit 213 / 223 in the related art is described. Generally speaking, the intra-frame prediction process mainly includes the following steps:
[0069] Step S201: Before performing luminance and chrominance prediction on the current block (which can be a block to be encoded or decoded), it is necessary to first obtain the reference pixel values around the current block. If no reference pixels exist, fill them with a pixel value of 512; if only some reference pixels do not exist, fill them with the nearest existing reference pixel values.
[0070] Step S202: Determine whether filtering is required for the reference pixels based on the prediction mode, the size of the current block, and other specific conditions; if filtering is required, filter the reference pixels using a three-tap smoothing filter with coefficients of [1, 2, 1].
[0071] Step S203, predicting the current block using the reference pixels according to the calculation method of each prediction mode to obtain a predicted value for each pixel in the current block;
[0072] In step S204, after obtaining the predicted value of each pixel in the current block, the predicted value needs to be further corrected using the PDPC method for the following prediction modes: planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, angle prediction mode numbered less than or equal to 10 (including wide angle mode), angle prediction mode numbered greater than or equal to 58 (including wide angle mode); wherein the planar prediction mode is Figure 2C The prediction mode numbered 0 in the intra-frame prediction mode shown, the DC component prediction mode is Figure 2C The prediction mode numbered 1 in the intra-frame prediction mode shown, the horizontal prediction mode is Figure 2C The prediction mode numbered 18 in the intra-frame prediction mode shown; the vertical prediction mode is Figure 2C The intra prediction mode shown is prediction mode numbered 50.
[0073] It should be noted that the principle of the PDPC method is to correct the predicted value based on the left reference pixel left, the upper reference pixel top and the upper left corner reference pixel topleft of the current block, and then determine the residual between the corrected predicted value and the corresponding pixel value in the current block.
[0074] For example, taking the PDPC calculation method in DC component prediction mode as an example, Figure 2D And formula (1) shows:
[0075]
[0076] According to the reconstructed pixel value P on the left reference pixel left of the current block 24 left , the distance between left and the current point (x, y) in the current block 24 (which can be represented by the weight wL), the reconstructed pixel value P on the upper reference pixel top top , the distance between top and the current point (x, y) (which can be represented by the weight wT), the reconstructed pixel value P on the upper left corner reference pixel topleft topleft , the distance between topleft and the current point (x, y) (which can be represented by the weight wTL), corrects the predicted value Q(x, y) of the current point (x, y) to obtain the corrected predicted value P(x, y)
[0077] The information processing method provided in the embodiment of the present application can be applied to both the video encoder 21 and the video decoder 22, and the embodiment of the present application does not specifically limit this.
[0078] An embodiment of the present application provides an information processing method, which is applied to the video encoder 21 of an electronic device. The functions implemented by the method can be implemented by calling program codes by a processor in the electronic device. Of course, the program codes can be stored in a computer storage medium. It can be seen that the electronic device includes at least a processor and a storage medium.
[0079] Figure 3A This is a schematic diagram of the implementation flow of the information processing method of the embodiment of the present application, as shown in FIG. Figure 3A As shown, the method includes the following steps:
[0080] Step S301, predicting image components on a block to be encoded in the input source video data according to a prediction mode to obtain a first prediction block, wherein the prediction mode is preset and belongs to a PDPC application mode;
[0081] In other embodiments, the image component is a chroma value or a luma value; it should be noted that the prediction mode used when predicting the current block (including the to-be-encoded block and the to-be-decoded block) before using the PDPC method is defined as a PDPC application mode. For example, in VTM5.0, the PDPC application modes include: a planar prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, an angle prediction mode with a number less than or equal to 10 (including a wide angle mode), and an angle prediction mode with a number greater than or equal to 58 (including a wide angle mode).
[0082] It should be noted that the to-be-decoded block refers to an image region in the source video data that needs to be predicted and encoded. In implementation, the source video data can be obtained by an image acquisition device.
[0083] It can be understood that after obtaining the first prediction block, step S302 is directly performed to determine the difference between the image component on the to-be-encoded block and the prediction value on the first prediction block, so that, before determining the residual block, the first prediction block is not subjected to PDPC processing, which can reduce the processing complexity of intra prediction.
[0084] Step S302, determining the difference between the image component on the to-be-encoded block and the prediction value on the first prediction block to obtain a residual block;
[0085] Step S303, writing the residual block and the prediction mode into a bitstream.
[0086] In the embodiments of the present application, after predicting the image component on the to-be-encoded block in the source video data according to a preset prediction mode belonging to the PDPC application mode to obtain a first prediction block, each prediction value in the first prediction block is not corrected, but the difference between the prediction value on the first prediction block and the image component on the to-be-encoded block is directly determined; in this way, the processing complexity of intra prediction can be reduced under the premise of ensuring the video coding performance.
[0087] The embodiments of the present application provide another information processing method, which is applied to a video decoder 21 of an electronic device, Figure 3B For the implementation flowchart of another information processing method of the embodiments of the present application, as shown in Figure 3B The method comprises the following steps:
[0088] Step S311, predicting the image component on the to-be-decoded block in the bitstream according to the prediction mode in the bitstream to obtain a second prediction block; wherein the prediction mode is preset and belongs to a PDPC application mode;
[0089] In other embodiments, the image component is a chroma value or a luma value.
[0090] Step S312, determining the sum of the difference value of the residual block in the code stream and the prediction value of the second prediction block to obtain a restored block;
[0091] Step S313: Process the restored block and output the processed video data.
[0092] In an embodiment of the present application, an image component on a block to be decoded in an input bitstream is predicted according to a prediction mode in the bitstream to obtain a second prediction block, where the prediction mode is preset and belongs to a PDPC application mode. After obtaining the second prediction block, each prediction value in the second prediction block is not corrected. Instead, the sum of the difference value on the residual block in the bitstream and the prediction value on the second prediction block is directly determined to obtain a restored block. In this way, the processing complexity of intra-frame prediction can be reduced while ensuring video decoding performance.
[0093] The embodiment of the present application provides another information processing method, which is applied to the video encoder 21 of the electronic device. Figure 4A This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application, as shown in FIG. Figure 4A As shown, the method includes the following steps:
[0094] Step S401, for input source video data, performing chroma prediction on chroma values of a block to be encoded in the source video data according to a prediction mode to obtain a first prediction block, wherein the prediction mode is preset and belongs to a PDPC application mode;
[0095] It can be understood that the improvement of video encoding and decoding performance using the PDPC method is based on saving coding bits and sacrificing chrominance performance. Since the image content reflected by brightness and chrominance is different, correcting the first prediction block by the PDPC method cannot improve the performance of brightness and chrominance at the same time. In an embodiment of the present application, when performing chrominance prediction on the block to be encoded, after performing chrominance prediction on the chrominance value on the block to be encoded in the source video data using a preset prediction mode, the PDPC method is not used to correct the obtained first prediction block, but the chrominance residual block is directly determined based on the block to be encoded and the first prediction block.
[0096] Step S402, determining a difference between a chroma value on the block to be coded and a chroma prediction value on the first prediction block to obtain a residual block;
[0097] Here, it can be understood that the obtained residual block is a chrominance residual block, that is, it includes the difference between the chrominance value of the block to be encoded and the luminance prediction value of the first prediction block.
[0098] Step S403: writing the residual block and the prediction mode into a bitstream.
[0099] In an embodiment of the present application, for the input source video data, after performing chroma prediction on the chroma value on the to-be-encoded block in the source video data according to a preset prediction mode belonging to the PDPC application mode, the prediction value on the obtained first prediction block is not corrected, but the residual value is directly calculated. In this way, the processing complexity of the chroma intra-frame prediction is reduced without affecting the chroma performance.
[0100] Based on the aforementioned steps S401 to S403, in other embodiments, the method further includes the following steps:
[0101] Step S404, performing brightness prediction on the brightness value of the block to be encoded according to a preset prediction mode belonging to the PDPC application mode to obtain a first prediction block;
[0102] Step S405, correcting the predicted value on the first prediction block to obtain a first corrected block;
[0103] Step S406, determining the difference between the brightness value of the block to be encoded and the corresponding correction value of the first correction block to obtain a corrected residual block;
[0104] Step S407: writing the corrected residual block and the prediction mode into a bitstream.
[0105] It should be noted that, in other embodiments, for brightness prediction, the video encoder may also execute steps S901 to S903 in the following embodiment, or execute steps S101 to S103 in the following embodiment.
[0106] The embodiment of the present application provides another information processing method, which is applied to the video decoder 21 of the electronic device. Figure 4B This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application, as shown in FIG. Figure 4B As shown, the method includes the following steps:
[0107] Step S411, predicting the chrominance value of the block to be decoded in the input bitstream according to a prediction mode in the bitstream to obtain a second prediction block; wherein the prediction mode is preset and belongs to the PDPC application mode;
[0108] Step S412, determining the sum of the chrominance difference value on the residual block in the code stream and the chrominance prediction value on the second prediction block to obtain a restored block;
[0109] Step S413: Process the restored block and output the processed video data.
[0110] In the embodiment of the present application, for an input bitstream, chroma values on a to-be-decoded block in the bitstream are predicted according to a prediction mode in the bitstream to obtain a second prediction block, the prediction mode is a prediction mode and belongs to a PDPC application mode, after the second prediction block is obtained, the chroma prediction values on the obtained second prediction block are not corrected, but the residual block is directly added to the second prediction block to obtain a recovery block, the recovery block is processed, and processed video data is output; in this way, the processing complexity of chroma intra prediction is reduced without affecting the chroma performance.
[0111] Based on the foregoing steps S411 to S413, in other embodiments, the method further includes the following steps:
[0112] Step S414, for an input bitstream, luminance values on a to-be-decoded block in the bitstream are predicted according to a prediction mode in the bitstream to obtain a second prediction block; wherein the prediction mode is a preset mode and belongs to a PDPC application mode;
[0113] Step S415, the luminance prediction values on the second prediction block are corrected to obtain a second correction block;
[0114] Step S416, the sum of the luminance difference values on the residual block in the bitstream and the luminance prediction values on the second correction block is determined to obtain a recovery block;
[0115] Step S417, the recovery block is processed, and processed video data is output.
[0116] It should be noted that, in other embodiments, for luminance prediction, the video decoder can also perform steps S911 to S913 in the following embodiments, or, in other embodiments, the prediction mode in step S911 is any prediction mode in any combination of the following first to fourth mode combinations.
[0117] The embodiment of the present application provides another information processing method, which is applied to a video encoder 21 of an electronic device, Figure 5 The implementation flowchart of another information processing method of the embodiment of the present application is shown in Figure 5 The method includes the following steps:
[0118] Step S501, for input source video data, chroma values on a to-be-encoded block in the source video data are chroma predicted according to any prediction mode in a first mode combination to obtain a first prediction block;
[0119] The first mode combination includes the following PDPC application modes: prediction modes with numbers less than the first value and excluding the planar prediction mode and the DC component prediction mode, prediction modes with numbers greater than the first value and less than or equal to the second value, prediction modes with numbers greater than or equal to the third value and less than the fourth value, and prediction modes with numbers greater than the fourth value, among the preset N components of spatial prediction modes;
[0120] It should be noted that the first value, the second value, the third value and the fourth value are usually preset mode index sequence values (ie, the values of the number). In a preferred embodiment, the spatial prediction mode within the N components is Figure 2C In the 94 spatial prediction modes within the components shown, the first value is set to 2, the second value is set to 10, the third value is set to 58, and the fourth value is set to 66. That is, when performing chrominance prediction, the PDPC method is not used to correct the obtained chrominance prediction value when using any of the prediction modes numbered less than 2 and excluding the planar prediction mode and the DC component prediction mode, the prediction modes numbered greater than 2 and less than or equal to 10, the prediction modes numbered greater than or equal to 58 and less than 66, and the prediction modes numbered greater than 66 among the 94 spatial prediction modes within the components. In other words, the PDPC method is used to correct the obtained chrominance prediction value only in the planar prediction mode, the DC component prediction mode, the horizontal prediction mode, the vertical prediction mode, the prediction mode numbered 2, and the prediction mode numbered 66.
[0121] Step S502, determining the difference between the chrominance value on the block to be encoded and the chrominance prediction value on the first prediction block to obtain a residual block;
[0122] Step S503: writing the residual block and the prediction mode into a bitstream.
[0123] In an embodiment of the present application, when using the prediction mode in the first mode combination to perform chrominance prediction on the block to be coded, the PDPC method is not used to correct the obtained chrominance prediction value, and the difference between the chrominance prediction value and the chrominance value on the block to be coded is directly determined; in this way, the processing complexity of the chrominance prediction is reduced while ensuring the chrominance prediction performance.
[0124] Based on the aforementioned steps S501 to S503, in other embodiments, the method further includes the aforementioned steps S403 to S407.
[0125] It should be noted that, in other embodiments, for brightness prediction, steps S901 to S903 in the following embodiment may also be performed, or steps S101 to S103 in the following embodiment may be performed.
[0126] It should also be noted that, for the input bitstream, the video decoder may perform decoding steps symmetrical to steps S501 to S503 above, which are not described in detail here. In other embodiments, for luma prediction, the video decoder may also perform steps S911 to S913 in the following embodiments, or, in other embodiments, the prediction mode in step S911 is any prediction mode in any combination of the first to fourth mode combinations.
[0127] The embodiment of the present application provides another information processing method, which is applied to the video encoder 21 of the electronic device. Figure 6 This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application, as shown in FIG. Figure 6 As shown, the method includes the following steps:
[0128] Step S601: For input source video data, perform chroma prediction on chroma values of a block to be encoded in the source video data according to any prediction mode in a second mode combination to obtain a first prediction block; wherein the second mode combination includes the following PDPC application modes: prediction modes numbered less than or equal to a second value and excluding a planar prediction mode and a direct current component prediction mode, and prediction modes numbered greater than or equal to a third value, among the preset N components of spatial prediction modes;
[0129] It should be noted that the second value and the third value are usually preset mode index sequence values (ie, the values of the number). In a preferred embodiment, the spatial prediction mode within the N components is Figure 2C In the 94 spatial prediction modes shown, the second value is set to 10 and the third value is set to 58. That is, when performing chrominance prediction using any of the prediction modes numbered less than or equal to 10 and excluding the planar prediction mode and the DC component prediction mode, and any of the prediction modes numbered greater than or equal to 58, the PDPC method is not used to correct the obtained chrominance prediction value. This can reduce the processing complexity of chrominance prediction. In other words, the PDPC method is only used to correct the obtained chrominance prediction value in the planar prediction mode, the DC component prediction mode, the horizontal prediction mode, and the vertical prediction mode.
[0130] For example, in another preferred embodiment, the spatial prediction mode within the N components is Figure 2C For the spatial prediction modes within the 94 components shown, the second value is set to 8 and the third value is set to 60.
[0131] Step S602, determining a difference between a chroma value on the block to be coded and a chroma prediction value on the first prediction block to obtain a residual block;
[0132] Step S603: writing the residual block and the prediction mode into a bitstream.
[0133] In this embodiment of the present application, when predicting a block to be coded using any prediction mode in the second mode combination, the residual value is directly determined without modifying the predicted value. This improves chrominance coding performance without substantially affecting luminance coding performance. Experimental data shows that the Y component performance is reduced by 0.03%, while the U component performance is improved by 0.16% and the V component performance is improved by 0.14%. Therefore, the Y component performance loss remains essentially unchanged, while the U and V component performance are significantly improved.
[0134] It should be noted that, based on the aforementioned steps S601 to S603, in other embodiments, the method further includes the aforementioned steps S403 to S407. Alternatively, in other embodiments, for brightness prediction, steps S901 to S903 in the following embodiment may be performed, or steps S101 to S103 in the following embodiment may be performed.
[0135] It should also be noted that, for the input bitstream, the video decoder can perform decoding steps symmetrical to the above steps S601 to S603, which will not be repeated here. In other embodiments, for luma prediction, steps S911 to S913 in the following embodiments may also be performed. In other embodiments, the prediction mode in step S911 is any prediction mode in any combination of the first to fourth mode combinations.
[0136] The embodiment of the present application provides another information processing method, which is applied to the video encoder 21 of the electronic device. Figure 7 This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application, as shown in FIG. Figure 7 As shown, the method includes the following steps:
[0137] Step S701: For input source video data, perform chroma prediction on chroma values of a block to be encoded in the source video data according to any prediction mode in a third mode combination to obtain a first prediction block; wherein the third mode combination includes the following PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode of the preset N components whose number is less than or equal to a second value and does not include a planar prediction mode and a direct current component prediction mode, and a prediction mode whose number is greater than or equal to a third value;
[0138] It should be noted that the second value and the third value are usually preset mode index sequence values (ie, the values of the number). In a preferred embodiment, the spatial prediction mode within the N components is Figure 2CThe second number is set to 10, and the third number is set to 58, that is, the third mode combination includes the following PDPC application modes: the horizontal prediction mode, the vertical prediction mode, and the prediction modes in the 94 in-component spatial prediction modes whose numbers are less than or equal to 10 and do not include the planar prediction mode and the direct current component prediction mode and whose numbers are greater than or equal to 58. In other words, the PDPC method is used to correct the obtained chroma prediction value only in the planar prediction mode and the direct current component prediction mode, and the PDPC method is not used to correct the obtained chroma prediction value in the third mode combination, so as to reduce the processing complexity of chroma prediction.
[0139] In step S702, a difference between the chroma value on the to-be-encoded block and the chroma prediction value on the first prediction block is determined to obtain a residual block.
[0140] In step S703, the residual block and the prediction mode are written into a bitstream.
[0141] It should be noted that based on the foregoing steps S701 to S703, in other embodiments, the method further includes the steps S403 to S407 described above. Alternatively, in other embodiments, for the luminance prediction, the steps S901 to S903 in the following embodiments can be performed, or the steps S101 to S103 in the following embodiments are performed.
[0142] It should be further noted that the video decoder performs a decoding step symmetrical to the steps S701 to S703 described above for the input bitstream, which will not be described herein. In other embodiments, for the luminance prediction, the video decoder can further perform the steps S414 to S417 described above, or the steps S911 to S913 in the following embodiments are performed, or in other embodiments, the prediction mode in step S911 is any prediction mode in any combination of the first to fourth mode combinations.
[0143] The embodiment of the present application provides another information processing method, which is applied to a video encoder 21 of an electronic device, Figure 8 For the implementation flowchart of another information processing method of the embodiment of the present application, as shown in Figure 8 The method includes the following steps:
[0144] Step S801, for the input source video data, perform chroma prediction on the chroma value on the block to be encoded in the source video data according to any prediction mode in the fourth mode combination to obtain a first prediction block; wherein, the fourth mode combination includes the following PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in the spatial prediction mode within the preset N components whose number is less than or equal to the second value and includes a planar prediction mode and a DC component prediction mode, and a prediction mode whose number is greater than or equal to the third value.
[0145] It should be noted that the second value and the third value are usually preset mode index sequence values (ie, the values of the number). In a preferred embodiment, the spatial prediction mode within the N components is Figure 2C In the 94 spatial prediction modes within the components shown, the second value is set to 10 and the third value is set to 58. That is, the fourth mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, prediction modes numbered less than or equal to 10 among the 94 spatial prediction modes within the components, and prediction modes numbered greater than or equal to 58. In other words, when performing chroma prediction in all PDPC application modes, the PDPC method is not used to correct the obtained chroma prediction value.
[0146] Step S802, determining a difference between a chroma value on the block to be coded and a chroma prediction value on the first prediction block to obtain a residual block;
[0147] Step S803: writing the residual block and the prediction mode into a bitstream.
[0148] It should be noted that, based on the aforementioned steps S801 to S803, in other embodiments, the method also includes steps S401 to S403 described in the above embodiments, or steps S501 to S503, or steps S601 to S603, or steps S701 to S703, or the following steps S901 to S903.
[0149] It should also be noted that, for the input bitstream, the video decoder can perform decoding steps symmetrical to the above steps S801 to S803, which will not be repeated here. In other embodiments, for luma prediction, the video decoder can also perform the above steps S414 to S417, or perform steps S911 to S914 in the following embodiment, or, in other embodiments, the prediction mode in step S911 is any prediction mode in any combination of the first to fourth mode combinations.
[0150] The embodiment of the present application provides another information processing method, which is applied to the video encoder 21 of the electronic device. FIG9 is a schematic diagram of the implementation flow of another information processing method of the embodiment of the present application. Figure 9A As shown, the method includes the following steps:
[0151] Step S901: For input source video data, predict the luminance value of a block to be encoded in the source video data according to a preset prediction mode belonging to the PDPC application mode to obtain a first prediction block;
[0152] Step S902, determining a difference between the luminance value of the block to be coded and the luminance prediction value of the first prediction block to obtain a residual block;
[0153] Step S903: writing the residual block and the prediction mode into a bitstream.
[0154] In an embodiment of the present application, when predicting the brightness value on the coding block according to a preset prediction mode belonging to the PDPC application mode, the PDPC method is not used to correct the obtained brightness prediction value, thereby reducing the processing complexity of the brightness prediction.
[0155] It should be noted that, based on the aforementioned steps S901 to S903, in other embodiments, the method also includes steps S401 to S403, or steps S501 to S503, or steps S601 to S603, or steps S701 to S703, or steps S801 to S803 described in the above embodiments.
[0156] The embodiment of the present application provides another information processing method, which is applied to the video decoder 21 of the electronic device. Figure 9B This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application, as shown in FIG. Figure 9B As shown, the method includes the following steps:
[0157] Step S911: predicting the luminance value of a block to be decoded in the input bitstream according to a prediction mode in the bitstream to obtain a second prediction block; wherein the prediction mode is preset and belongs to a PDPC application mode;
[0158] In other embodiments, the prediction mode in step S911 is any prediction mode in any combination of the first to fourth mode combinations.
[0159] Step S912, determining the sum of the luminance difference value on the residual block in the code stream and the luminance prediction value on the second prediction block to obtain a restored block;
[0160] Step S913: Process the restored block and output the processed video data.
[0161] The embodiment of the present application provides another information processing method, which is applied to a video encoder 21 of an electronic device. Figure 10 This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application. Figure 10 As shown, the method includes the following steps:
[0162] Step S101, for input source video data, performing brightness prediction on the brightness value of a block to be encoded in the source video data according to any prediction mode in any combination of the first to fourth mode combinations to obtain a first prediction block;
[0163] Step S102, determining a difference between the luminance value of the block to be encoded and the luminance prediction value of the first prediction block to obtain a residual block;
[0164] Step S103: writing the residual block and the prediction mode into a bitstream.
[0165] It should be noted that, based on the aforementioned steps S101 to S103, in other embodiments, the method also includes steps S401 to S403, or steps S501 to S503, or steps S601 to S603, or steps S701 to S703, or steps S801 to S803 described in the above embodiments.
[0166] The embodiment of the present application provides another information processing method, which is applied to the video encoder 21 of the electronic device. Figure 11A This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application, as shown in FIG. Figure 11A As shown, the method includes the following steps:
[0167] Step S1101, predicting an image component of a block to be encoded in the input source video data according to a prediction mode to obtain a third prediction block, wherein the prediction mode is preset and belongs to a PDPC application mode;
[0168] In other embodiments, the image components are luminance values or chrominance values.
[0169] Step S1102: correcting the third predicted block according to the prediction mode to obtain a third corrected block;
[0170] Step S1103, determining the difference between the image component on the to-be-encoded block and the correction value on the third correction block to obtain a residual block;
[0171] Step S1104: writing the residual block and the prediction mode into a bitstream.
[0172] In other embodiments, for step S1101, predicting the image component on the block to be encoded in the source video data according to the prediction mode to obtain a third prediction block includes: performing chroma prediction on the chroma value on the block to be encoded according to any prediction mode in the fifth mode combination to obtain the third prediction block; wherein, the fifth mode combination includes the following PDPC application modes: planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, a prediction mode numbered as the first numerical value in the spatial prediction mode within the preset N components, and a prediction mode numbered as the fourth numerical value in the spatial prediction mode within the preset N components.
[0173] In other embodiments, for step S1101, predicting the image component of the block to be encoded in the source video data according to the prediction mode to obtain the third prediction block includes: when all of the following conditions 1 to 4 are satisfied, predicting the image component of the block to be encoded according to the prediction mode to obtain the third prediction block;
[0174] Case 1: the block to be encoded is a luminance block and intra-frame sub-block division is not used; or the block to be encoded is a chrominance block;
[0175] Case 2: When the block to be coded is a luminance block, prediction is performed using the 0th reference row; or, when the block to be coded is a chrominance block, the 0th reference row refers to the reference row closest to the block to be coded;
[0176] Case 3: the block to be encoded is not encoded using the block-based delta pulse code modulation (BDPCM) method;
[0177] Case 4: Any of the following conditions is met:
[0178] The prediction mode is a horizontal prediction mode;
[0179] The prediction mode is a vertical prediction mode;
[0180] The prediction mode is a prediction mode numbered as a first value among the preset N component spatial prediction modes;
[0181] The prediction mode is the prediction mode numbered as the fourth value;
[0182] The prediction mode is a prediction mode whose number is less than or equal to the second value, and the block to be encoded is not a chroma block;
[0183] The prediction mode is a prediction mode whose number is greater than or equal to a third value, and the block to be encoded is not a chroma block.
[0184] In other embodiments, for step S1101, predicting the image component on the block to be encoded in the source video data according to the prediction mode to obtain a third prediction block includes: performing chroma prediction on the chroma value on the block to be encoded according to any prediction mode in a sixth mode combination to obtain the third prediction block; wherein the sixth mode combination includes the following PDPC application modes: planar prediction mode, DC component prediction mode, horizontal prediction mode, and vertical prediction mode.
[0185] In other embodiments, for step S1101, predicting the image component of the block to be encoded in the source video data according to the prediction mode to obtain the third prediction block includes: when all of the following conditions 1 to 4 are satisfied, predicting the image component of the block to be encoded according to the prediction mode to obtain the third prediction block;
[0186] Case 1: the block to be encoded is a luminance block and intra-frame sub-block division is not used; or the block to be encoded is a chrominance block;
[0187] Case 2: When the block to be coded is a luminance block, prediction is performed using the 0th reference row; or, when the block to be coded is a chrominance block, the 0th reference row refers to the reference row closest to the block to be coded;
[0188] Case 3: the block to be encoded is not encoded using the BDPCM method;
[0189] Case 4: Any of the following conditions is met:
[0190] The prediction mode is a planar prediction mode;
[0191] The prediction mode is a DC component prediction mode;
[0192] The prediction mode is a horizontal prediction mode;
[0193] The prediction mode is a vertical prediction mode;
[0194] The prediction mode is a prediction mode whose number is less than or equal to the second value, and the block to be encoded is not a chroma block;
[0195] The prediction mode is a prediction mode whose number is greater than or equal to a third value, and the block to be encoded is not a chroma block.
[0196] In other embodiments, for step S1101, predicting the image component of the to-be-encoded block in the source video data according to the prediction mode to obtain the third prediction block includes:
[0197] Perform chroma prediction on the chroma value on the block to be encoded according to any prediction mode in a seventh mode combination to obtain a third prediction block; wherein the seventh mode combination includes the following PDPC application modes: planar prediction mode, and DC component prediction mode.
[0198] In other embodiments, for step S1101, predicting the image component of the block to be encoded in the source video data according to the prediction mode to obtain the third prediction block includes: when all of the following conditions 1 to 4 are satisfied, predicting the image component of the block to be encoded according to the prediction mode to obtain the third prediction block;
[0199] Case 1: the block to be encoded is a luminance block and intra-frame sub-block division is not used; or the block to be encoded is a chrominance block;
[0200] Case 2: When the block to be coded is a luminance block, prediction is performed using the 0th reference row; or, when the block to be coded is a chrominance block, the 0th reference row refers to the reference row closest to the block to be coded;
[0201] Case 3: the block to be encoded is not encoded using the BDPCM method;
[0202] Case 4: Any of the following conditions is met:
[0203] The prediction mode is a planar prediction mode;
[0204] The prediction mode is a DC component prediction mode;
[0205] The prediction mode is a horizontal prediction mode and the block to be encoded is not a chroma block;
[0206] The prediction mode is a vertical prediction mode and the block to be encoded is not a chroma block;
[0207] The prediction mode is a prediction mode whose number is less than or equal to the second value, and the block to be encoded is not a chroma block;
[0208] The prediction mode is a prediction mode whose number is greater than or equal to a third value, and the block to be encoded is not a chroma block.
[0209] In other embodiments, for step S1101, predicting the image component of the to-be-encoded block in the source video data according to the prediction mode to obtain the third prediction block includes:
[0210] When all of the following conditions 1 to 4 are satisfied, predict the image component on the to-be-encoded block according to the prediction mode to obtain a third prediction block;
[0211] Case 1: the block to be encoded is a luminance block and intra-frame sub-block division is not used;
[0212] Case 2: the block to be coded is a luminance block and is predicted using the 0th reference row; wherein the 0th reference row refers to the reference row closest to the block to be coded;
[0213] Case 3: the block to be encoded is not encoded using the BDPCM method;
[0214] Case 4: Any of the following conditions is met:
[0215] The prediction mode is a planar prediction mode;
[0216] The prediction mode is a DC component prediction mode;
[0217] The prediction mode is a horizontal prediction mode;
[0218] The prediction mode is a vertical prediction mode;
[0219] The prediction mode is a prediction mode whose number is less than or equal to a second value;
[0220] The prediction mode is a prediction mode whose number is greater than or equal to a third value.
[0221] The embodiment of the present application provides another information processing method, which is applied to the video decoder 21 of the electronic device. Figure 11B This is a schematic diagram of the implementation flow of another information processing method according to an embodiment of the present application, as shown in FIG. Figure 11B As shown, the method includes the following steps:
[0222] Step S1121: predicting an image component on a block to be decoded in an input bitstream according to a prediction mode in the bitstream to obtain a fourth prediction block; wherein the prediction mode is preset and belongs to a PDPC application mode;
[0223] In other embodiments, the image components are chrominance values or luminance values.
[0224] Step S1122: correcting the fourth predicted block according to the prediction mode to obtain a fourth corrected block;
[0225] Step S1123, determining the sum of the difference value of the residual block in the bitstream and the correction value of the fourth correction block to obtain a restored block;
[0226] Step S1124: Process the restored block and output the processed video data.
[0227] In VTM5.0, the PDPC method is applied to the planar prediction mode, the direct current component prediction mode, the horizontal prediction mode, the vertical prediction mode, the angle prediction mode with the number less than or equal to 10 and the angle prediction mode with the number greater than or equal to 58 in the 94 kinds of spatial prediction modes in the prediction mode of the luminance block and the chrominance block, that is, after the current block is predicted using these prediction modes, the PDPC method is used to correct the predicted value obtained by prediction.
[0228] In VTM5.0, it is stipulated that the PDPC method is used when all the following (101) to (104) conditions are met:
[0229] (101) the current block is a luminance block and the intra sub-partition (ISP) is not used; or, the current block is a chrominance block;
[0230] (102) the 0th reference line prediction is used when the current block is a luminance block; or, the current block is a chrominance block; wherein, the 0th reference line refers to the reference line closest to the current block;
[0231] (103) the current block is not encoded using the block-based delta pulse code modulation (BDPCM) method;
[0232] (104) any one of the following conditions is met: the prediction mode is the planar prediction mode, the direct current component prediction mode, the horizontal prediction mode, the vertical prediction mode, the angle prediction mode with the number less than or equal to 10, or the angle prediction mode with the number greater than or equal to 58.
[0233] However, the improvement of the coding performance using the PDPC method is based on saving the coding bits and sacrificing the chrominance performance. Since the image content reflected by the luminance and the chrominance is different, the PDPC technology cannot improve the performance of the luminance and the chrominance at the same time, and the same PDPC method should not be used for the luminance and the chrominance.
[0234] Therefore, the following describes the content involved in the above embodiments in combination with a plurality of preferred embodiments.
[0235] The embodiment of the present application provides a method for modifying the application mode of PDPC, reducing the chrominance prediction mode using PDPC, so that after the limitation, the time complexity is reduced and the chrominance coding performance is improved. In order to facilitate understanding, the following is described in detail.
[0236] The PDPC application modes of the related technologies are the same under brightness and chrominance, and all utilize a plane prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, an angle prediction mode numbered less than or equal to 10, or an angle prediction mode numbered greater than or equal to 58.
[0237] In the embodiment of the present application, the chroma prediction is modified to use Figure 2C When performing chroma prediction on the current block using any of the prediction modes numbered less than or equal to 10 and excluding the plane prediction mode and the direct current component prediction mode, and the prediction modes numbered greater than or equal to 58 in the spatial prediction modes within the 94 components shown, the PDPC method is not used to correct the obtained chroma prediction value. In other words, when performing chroma prediction on the current block, the chroma prediction modes using PDPC are reduced to using PDPC only for the plane prediction mode, the direct current component prediction mode, the horizontal prediction mode, or the vertical prediction mode; and when performing luminance prediction on the current block, the luminance prediction modes using PDPC are still the plane prediction mode, the direct current component prediction mode, the horizontal prediction mode, the vertical prediction mode, the angular prediction mode numbered less than or equal to 10 and the angular prediction mode numbered greater than or equal to 58 in the spatial prediction modes within the 94 components, that is, the luminance prediction mode using PDPC remains unchanged.
[0238] Accordingly, the syntax and semantics in VTM5.0 are modified, that is, the mode restrictions of applying PDPC are as follows:
[0239] PDPC is used when all of the following conditions (201) to (204) are met:
[0240] (201) ISP partitioning is not used when the current block is a luminance block; or, the current block is a chrominance block;
[0241] (202) When the current block is a luminance block, use the 0th reference row for prediction; or, when the current block is a chrominance block;
[0242] (203) The current block is not encoded using the BDPCM method;
[0243] (204) Any of the following conditions is met: the prediction mode is a planar prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, an angular prediction mode numbered less than or equal to 10 and the current block is not a chroma block, or an angular prediction mode numbered greater than or equal to 58 and the current block is not a chroma block.
[0244] The method for modifying the PDPC application mode provided in the embodiment of the present application can achieve the following beneficial effects without substantially affecting performance:
[0245] First, chroma encoding performance can be improved without significantly impacting luma encoding performance. Experimental data shows that while Y component performance suffers a 0.03% loss, U component performance improves by 0.16%, and V component performance improves by 0.14%. This shows that the Y component performance loss remains essentially unchanged, while U component performance improves significantly, and V component performance is significantly enhanced.
[0246] Secondly, it can reduce complexity. PDPC has many application scenarios in related technologies. Using the method provided in the embodiments of this application can reduce the number of chroma prediction modes using PDPC to four, thereby reducing processing complexity and ultimately significantly shortening decoding time.
[0247] The protection point of the embodiment of the present application is to modify the usage scenario of PDPC in chroma prediction. Whether it is to use PDPC only for the planar prediction mode, DC component prediction mode, horizontal prediction mode and vertical prediction mode in the main scheme, or to prohibit the use of PDPC in some chroma prediction modes in the alternative scheme, it is to reduce the prediction mode in which PDPC is applied in chroma prediction, reduce the complexity of the algorithm, and improve the coding performance of chroma. Among them, the alternative scheme mainly includes the following schemes:
[0248] Alternative 1: Modify the chroma prediction to use horizontal prediction mode, vertical prediction mode, Figure 2C When performing chroma prediction for the current block in any of the 94 component spatial prediction modes with prediction modes numbered less than or equal to 10 and prediction modes numbered greater than or equal to 58, the PDPC method is not used to correct the obtained chroma prediction value. That is, the use of PDPC is prohibited for all chroma prediction modes, while when performing luma prediction for the current block, the luma prediction mode using PDPC remains unchanged.
[0249] Accordingly, the syntax and semantics in VTM5.0 are modified to use PDPC when the following conditions (301) to (305) are all met:
[0250] (301) The current block is a luminance block;
[0251] (302) The current block does not use ISP partitioning;
[0252] (303) The current block is predicted using the 0th reference row;
[0253] (304) The current block is not encoded using the BDPCM method;
[0254] (305) Any of the following conditions is met: the prediction mode is a planar prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, an angular prediction mode numbered less than or equal to 10, or an angular prediction mode numbered greater than or equal to 58.
[0255] Alternative 2: Modify the chroma prediction as follows: when any of the following prediction modes is used to perform the chroma prediction for the current block, the PDPC method is not used to modify the obtained chroma prediction value: the horizontal prediction mode, the vertical prediction mode, any of the spatial prediction modes within the 94 components with the mode number less than or equal to 10 and excluding the planar prediction mode and the DC component prediction mode, and the prediction mode with the mode number greater than or equal to 58. In other words, the PDPC is only used in the planar prediction mode and the DC component prediction mode when performing the chroma prediction; the luma prediction modes using the PDPC remain unchanged when performing the luma prediction for the current block.
[0256] Correspondingly, the syntax semantics in VTM5.0 is modified as follows: the PDPC is used when the following conditions (401) to (404) are all satisfied:
[0257] (401) the ISP partition is not used when the current block is a luma block; or, the current block is a chroma block;
[0258] (402) the 0th reference line prediction is used when the current block is a luma block; or, the current block is a chroma block;
[0259] (403) the current block is not encoded using the BDPCM method;
[0260] (404) any of the following conditions is satisfied: the prediction mode is the planar prediction mode, the DC component prediction mode, the horizontal prediction mode and the current block is not a chroma block, the vertical prediction mode and the current block is not a chroma block, the angle prediction mode with the mode number less than or equal to 10 and the current block is not a chroma block, or the angle prediction mode with the mode number greater than or equal to 58 and the current block is not a chroma block.
[0261] Alternative 3: Modify the chroma prediction as follows: when any of the following prediction modes is used to perform the chroma prediction for the current block, the PDPC method is not used to modify the obtained chroma prediction value: the prediction mode with the mode number less than 2 and excluding the planar prediction mode and the DC component prediction mode, the prediction mode with the mode number greater than 2 and less than or equal to 10, the prediction mode with the mode number greater than or equal to 58 and less than 66, and the prediction mode with the mode number greater than 66. In other words, the PDPC is only used in the planar prediction mode, the DC component prediction mode, the horizontal prediction mode, the vertical prediction mode, the prediction mode with the mode number 2, and the prediction mode with the mode number 66; the luma prediction modes using the PDPC remain unchanged when performing the luma prediction for the current block.
[0262] Correspondingly, the syntax semantics in VTM5.0 is modified as follows: the PDPC is used when the following conditions (501) to (504) are all satisfied:
[0263] (501) the current block is a luma block and ISP partition is not used; or, the current block is a chroma block;
[0264] (502) the current block is a luma block and the 0th reference line prediction is used; or, the current block is a chroma block;
[0265] (503) the current block is not coded using the BDPCM method;
[0266] (504) any one of the following conditions is met: the prediction mode is the planar prediction mode, the DC component prediction mode, the horizontal prediction mode, the vertical prediction mode, the prediction mode numbered 2, the prediction mode numbered 66, the angle prediction mode numbered less than or equal to 10 and the current block is not a chroma block, or the angle prediction mode numbered greater than or equal to 58 and the current block is not a chroma block.
[0267] Alternative 4: modify the chroma prediction and luma prediction to, when using any one of the prediction modes numbered less than or equal to 10 and greater than 8 and the prediction modes numbered greater than or equal to 58 and less than 60 in the 94 spatial prediction modes, chroma prediction and luma prediction are performed on the current block, the obtained chroma prediction value and luma prediction value are not modified using the PDPC method. In other words, the luma and chroma prediction modes using PDPC are simultaneously reduced.
[0268] Correspondingly, the syntax semantics in VTM5.0 is modified to use PDPC when the following conditions (601) to (604) are met:
[0269] (601) the current block is a luma block and ISP partition is not used; or, the current block is a chroma block;
[0270] (602) the current block is a luma block and the 0th reference line prediction is used; or, the current block is a chroma block;
[0271] (603) the current block is not coded using the BDPCM method;
[0272] (604) any one of the following conditions is met: the prediction mode is the planar prediction mode, the DC component prediction mode, the horizontal prediction mode, the vertical prediction mode, the angle prediction mode numbered less than or equal to 8, the angle prediction mode numbered greater than or equal to 60.
[0273] Based on the foregoing embodiments, an embodiment of the present application provides an information processing device, and the modules included in the device, as well as the units included in each module, can be implemented by a processor in an electronic device; of course, they can also be implemented by a specific logic circuit; in the implementation process, the processor can be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP) or a field programmable gate array (FPGA), etc.
[0274] Figure 12A This is a structural diagram of the information processing device according to an embodiment of the present application. Figure 12A As shown, the information processing device 120 includes:
[0275] The prediction module 121 is configured to predict the image components of the to-be-encoded block in the input source video data according to a prediction mode to obtain a first prediction block, wherein the prediction mode is preset and belongs to the PDPC application mode;
[0276] a residual determination module 122 configured to determine a difference between an image component on the to-be-encoded block and a predicted value on the first prediction block, to obtain a residual block;
[0277] The writing module 123 is configured to write the residual block and the prediction mode into the bitstream.
[0278] In other embodiments, the image components are luminance values or chrominance values.
[0279] In other embodiments, Figure 12B As shown, the prediction module 121 includes a chrominance prediction unit 1210, which is configured to: perform chrominance prediction on the chrominance value on the block to be encoded according to any prediction mode in the first mode combination to obtain a first prediction block; wherein the first mode combination includes the following PDPC application modes: a prediction mode in the spatial prediction mode within the preset N components whose number is less than the first value and does not include a plane prediction mode and a DC component prediction mode, a prediction mode whose number is greater than the first value and less than or equal to the second value, a prediction mode whose number is greater than or equal to the third value and less than the fourth value, and a prediction mode whose number is greater than the fourth value.
[0280] In other embodiments, the chrominance prediction unit 1210 is configured to: perform chrominance prediction on the chrominance value on the block to be encoded according to any prediction mode in the second mode combination to obtain a first prediction block; wherein the second mode combination includes the following PDPC application modes: prediction modes in the spatial prediction modes within the preset N components whose numbers are less than or equal to the second value and do not include a planar prediction mode and a DC component prediction mode, and prediction modes whose numbers are greater than or equal to a third value.
[0281] In other embodiments, the chrominance prediction unit 1210 is configured to: perform chrominance prediction on the chrominance value on the block to be encoded according to any prediction mode in the third mode combination to obtain a first prediction block; wherein the third mode combination includes the following PDPC application modes: horizontal prediction mode, vertical prediction mode, a prediction mode in the spatial prediction mode within the preset N components whose number is less than or equal to the second value and does not include a planar prediction mode and a DC component prediction mode, and a prediction mode whose number is greater than or equal to the third value.
[0282] In other embodiments, the chrominance prediction unit 1210 is configured to: perform chrominance prediction on the chrominance value on the block to be encoded according to any prediction mode in the fourth mode combination to obtain a first prediction block; wherein the fourth mode combination includes the following PDPC application modes: a vertical prediction mode, a prediction mode in the spatial prediction mode within the preset N components whose number is less than or equal to the second value and includes a planar prediction mode and a DC component prediction mode, and a prediction mode whose number is greater than or equal to the third value.
[0283] In other embodiments, Figure 12B As shown, the prediction module 121 further includes a brightness prediction unit 1212, which is configured to: perform brightness prediction on the brightness value of the block to be encoded according to any prediction mode in any combination of the first to fourth mode combinations to obtain a first prediction block.
[0284] This embodiment of the present application provides another information processing device, Figure 13 This is a structural diagram of another information processing device according to an embodiment of the present application. Figure 13 As shown, the information processing device 130 includes:
[0285] The prediction module 131 is configured to: predict an image component of a to-be-decoded block in an input bitstream according to a prediction mode in the bitstream to obtain a second prediction block; wherein the prediction mode is preset and belongs to a PDPC application mode;
[0286] The recovery module 132 is configured to: determine the sum of the difference value of the residual block in the code stream and the prediction value of the second prediction block to obtain a recovery block;
[0287] The video output module 133 is configured to process the recovery block and output the processed video data.
[0288] In other embodiments, the image components are chrominance values or luminance values.
[0289] In other embodiments, the prediction mode is any prediction mode in the first mode combination; wherein the first mode combination includes the following PDPC application modes: a prediction mode in the spatial prediction mode within the preset N components whose number is less than the first value and does not include a plane prediction mode and a DC component prediction mode, a prediction mode whose number is greater than the first value and less than or equal to the second value, a prediction mode whose number is greater than or equal to the third value and less than the fourth value, and a prediction mode whose number is greater than the fourth value.
[0290] In other embodiments, the prediction mode is any prediction mode in the second mode combination; wherein the second mode combination includes the following PDPC application modes: prediction modes in the spatial prediction modes within the preset N components whose numbers are less than or equal to the second value and do not include planar prediction modes and DC component prediction modes, and prediction modes whose numbers are greater than or equal to the third value.
[0291] In other embodiments, the prediction mode is any prediction mode in a third mode combination; wherein the third mode combination includes the following PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in the spatial prediction mode within the preset N components whose number is less than or equal to the second value and does not include a planar prediction mode and a DC component prediction mode, and a prediction mode whose number is greater than or equal to the third value.
[0292] In other embodiments, the prediction mode is any prediction mode in a fourth mode combination; wherein the fourth mode combination includes the following PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in a spatial prediction mode within the preset N components whose number is less than or equal to a second value and includes a planar prediction mode and a DC component prediction mode, and a prediction mode whose number is greater than or equal to a third value.
[0293] The embodiment of the present application provides another information processing device, Figure 14 This is a structural diagram of another information processing device according to an embodiment of the present application. Figure 14 As shown, the information processing device 140 includes:
[0294] The prediction module 1401 is configured to: predict the image components of the to-be-encoded block in the input source video data according to a prediction mode to obtain a third prediction block, wherein the prediction mode is preset and belongs to the PDPC application mode;
[0295] The correction module 1402 is configured to: correct the third predicted block according to the prediction mode to obtain a third corrected block;
[0296] The residual determination module 1403 is configured to: determine the difference between the image component on the to-be-encoded block and the correction value on the third correction block to obtain a residual block;
[0297] The writing module 1404 is configured to write the residual block and the prediction mode into a bitstream.
[0298] In other embodiments, the image components are luminance values or chrominance values.
[0299] In other embodiments, the prediction module 1401 is configured to: perform chrominance prediction on the chrominance value on the block to be encoded according to any prediction mode in the fifth mode combination to obtain a third prediction block; wherein the fifth mode combination includes the following PDPC application modes: planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, a prediction mode numbered as the first numerical value in the spatial prediction mode within the preset N components, and a prediction mode numbered as the fourth numerical value in the spatial prediction mode within the preset N components.
[0300] In other embodiments, the prediction module 1401 is configured to:
[0301] When all of the following conditions 1 to 4 are satisfied, predict the image component on the to-be-encoded block according to the prediction mode to obtain a third prediction block;
[0302] Case 1: the block to be encoded is a luminance block and intra-frame sub-block division is not used; or the block to be encoded is a chrominance block;
[0303] Case 2: When the block to be coded is a luminance block, prediction is performed using the 0th reference row; or, when the block to be coded is a chrominance block, the 0th reference row refers to the reference row closest to the block to be coded;
[0304] Case 3: the block to be encoded is not encoded using the block-based delta pulse code modulation (BDPCM) method;
[0305] Case 4: Any of the following conditions is met:
[0306] The prediction mode is a horizontal prediction mode;
[0307] The prediction mode is a vertical prediction mode;
[0308] The prediction mode is a prediction mode numbered as a first value among the preset N component spatial prediction modes;
[0309] The prediction mode is the prediction mode numbered as the fourth value;
[0310] The prediction mode is a prediction mode whose number is less than or equal to the second value, and the block to be encoded is not a chroma block;
[0311] The prediction mode is a prediction mode whose number is greater than or equal to a third value, and the block to be encoded is not a chroma block.
[0312] In other embodiments, the prediction module 1401 is configured to: perform chrominance prediction on the chrominance value on the block to be encoded according to any prediction mode in the sixth mode combination to obtain a third prediction block; wherein the sixth mode combination includes the following PDPC application modes: planar prediction mode, DC component prediction mode, horizontal prediction mode, and vertical prediction mode.
[0313] In other embodiments, the prediction module 1401 is configured to:
[0314] When all of the following conditions 1 to 4 are satisfied, predict the image component on the to-be-encoded block according to the prediction mode to obtain a third prediction block;
[0315] Case 1: the block to be encoded is a luminance block and intra-frame sub-block division is not used; or the block to be encoded is a chrominance block;
[0316] Case 2: When the block to be coded is a luminance block, prediction is performed using the 0th reference row; or, when the block to be coded is a chrominance block, the 0th reference row refers to the reference row closest to the block to be coded;
[0317] Case 3: the block to be encoded is not encoded using the BDPCM method;
[0318] Case 4: Any of the following conditions is met:
[0319] The prediction mode is a planar prediction mode;
[0320] The prediction mode is a DC component prediction mode;
[0321] The prediction mode is a horizontal prediction mode;
[0322] The prediction mode is a vertical prediction mode;
[0323] The prediction mode is a prediction mode whose number is less than or equal to the second value, and the block to be encoded is not a chroma block;
[0324] The prediction mode is a prediction mode whose number is greater than or equal to a third value, and the block to be encoded is not a chroma block.
[0325] In other embodiments, the prediction module 1401 is configured to: perform chrominance prediction on the chrominance value on the block to be encoded according to any prediction mode in the seventh mode combination to obtain a third prediction block; wherein the seventh mode combination includes the following PDPC application modes: planar prediction mode, and DC component prediction mode.
[0326] In other embodiments, the prediction module 1401 is configured to:
[0327] When all of the following conditions 1 to 4 are satisfied, predict the image component on the to-be-encoded block according to the prediction mode to obtain a third prediction block;
[0328] Case 1: the block to be encoded is a luminance block and intra-frame sub-block division is not used; or the block to be encoded is a chrominance block;
[0329] Case 2: When the block to be coded is a luminance block, prediction is performed using the 0th reference row; or, when the block to be coded is a chrominance block, the 0th reference row refers to the reference row closest to the block to be coded;
[0330] Case 3: the block to be encoded is not encoded using the BDPCM method;
[0331] Case 4: Any of the following conditions is met:
[0332] The prediction mode is a planar prediction mode;
[0333] The prediction mode is a DC component prediction mode;
[0334] The prediction mode is a horizontal prediction mode and the block to be encoded is not a chroma block;
[0335] The prediction mode is a vertical prediction mode and the block to be encoded is not a chroma block;
[0336] The prediction mode is a prediction mode whose number is less than or equal to the second value, and the block to be encoded is not a chroma block;
[0337] The prediction mode is a prediction mode whose number is greater than or equal to a third value, and the block to be encoded is not a chroma block.
[0338] In other embodiments, the prediction module 1401 is configured to:
[0339] When all of the following conditions 1 to 4 are satisfied, predict the image component on the to-be-encoded block according to the prediction mode to obtain a third prediction block;
[0340] Case 1: the block to be encoded is a luminance block and intra-frame sub-block division is not used;
[0341] Case 2: the block to be coded is a luminance block and is predicted using the 0th reference row; wherein the 0th reference row refers to the reference row closest to the block to be coded;
[0342] Case 3: the block to be encoded is not encoded using the BDPCM method;
[0343] Case 4: Any of the following conditions is met:
[0344] The prediction mode is a planar prediction mode;
[0345] The prediction mode is a DC component prediction mode;
[0346] The prediction mode is a horizontal prediction mode;
[0347] The prediction mode is a vertical prediction mode;
[0348] The prediction mode is a prediction mode whose number is less than or equal to a second value;
[0349] The prediction mode is a prediction mode whose number is greater than or equal to a third value.
[0350] The embodiment of the present application provides another information processing device, Figure 15 This is a structural diagram of another information processing device according to an embodiment of the present application. Figure 15 As shown, the information processing device 150 includes:
[0351] The prediction module 1501 is configured to: predict an image component of a to-be-decoded block in an input bitstream according to a prediction mode in the bitstream to obtain a fourth prediction block; wherein the prediction mode is preset and belongs to a PDPC application mode;
[0352] The correction module 1502 is configured to: correct the fourth predicted block according to the prediction mode to obtain a fourth corrected block;
[0353] The restoration module 1503 is configured to: determine the sum of the difference value of the residual block in the bitstream and the correction value of the fourth correction block to obtain a restored block;
[0354] The video output module 1504 is configured to process the recovery block and output the processed video data.
[0355] In other embodiments, the image components are chrominance values or luminance values.
[0356] The description of the above device embodiment is similar to the description of the above method embodiment and has similar beneficial effects as the method embodiment. For technical details not disclosed in the device embodiment of this application, please refer to the description of the method embodiment of this application for understanding.
[0357] It should be noted that, in the embodiment of the present application, if the above-mentioned information processing method is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on such an understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable an electronic device (which can be a mobile phone, a tablet computer, an e-reader, a drone, a wearable device (such as smart glasses, etc.), a sweeping robot, a personal computer, a navigator, a video phone, a television, a server, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a U disk, a mobile hard disk, a read-only memory (ROM), a magnetic disk or an optical disk. In this way, the embodiment of the present application is not limited to any specific combination of hardware and software.
[0358] Correspondingly, an embodiment of the present application provides an electronic device, Figure 16 This is a hardware entity diagram of an electronic device according to an embodiment of the present application, such as Figure 16 As shown, the electronic device 160 includes a memory 161 and a processor 162. The memory 161 stores a computer program that can be run on the processor 162. When the processor 162 executes the program, the steps of the information processing method provided in the above embodiment are implemented.
[0359] It should be noted that the memory 161 is configured to store instructions and applications executable by the processor 162, and can also cache data to be processed or processed by the processor 162 and various modules in the electronic device 160 (for example, image data, audio data, voice communication data and video communication data), which can be implemented through flash memory (FLASH) or random access memory (Random Access Memory, RAM).
[0360] An embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, the steps of the information processing method provided in the above embodiment are implemented.
[0361] It should be noted that the description of the above storage medium and device embodiments is similar to the description of the above method embodiments and has similar beneficial effects as the method embodiments. For technical details not disclosed in the storage medium and device embodiments of this application, please refer to the description of the method embodiments of this application for understanding.
[0362] It should be understood that "one embodiment" or "an embodiment" mentioned throughout the specification means that the specific features, structures or characteristics related to the embodiment are included in at least one embodiment of the present application. Therefore, "in one embodiment" or "in an embodiment" appearing throughout the specification does not necessarily refer to the same embodiment. In addition, these specific features, structures or characteristics can be combined in one or more embodiments in any suitable manner. It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. The above-mentioned serial numbers of the embodiments of the present application are for description only and do not represent the advantages and disadvantages of the embodiments.
[0363] It should be noted that, in this document, the terms "comprises," "includes," or any other variations thereof are intended to encompass non-exclusive inclusion, such that a process, method, article, or apparatus comprising a series of elements includes not only those elements but also other elements not explicitly listed, or elements inherent to such process, method, article, or apparatus. In the absence of further limitations, an element defined by the phrase "comprising a ..." does not exclude the presence of other identical elements in the process, method, article, or apparatus comprising the element.
[0364] In the several embodiments provided in this application, it should be understood that the disclosed devices and methods can be implemented in other ways. The device embodiments described above are merely schematic. For example, the division of the units is merely a logical function division. In actual implementation, there may be other division methods, such as: multiple units or components can be combined, or can be integrated into another system, or some features can be ignored or not executed. In addition, the coupling, direct coupling, or communication connection between the components shown or discussed can be through some interfaces, and the indirect coupling or communication connection of the devices or units can be electrical, mechanical or other forms.
[0365] The units described above as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units; they may be located in one place or distributed across multiple network units; some or all of the units may be selected according to actual needs to achieve the purpose of the scheme of this embodiment.
[0366] In addition, all functional units in the embodiments of the present application can be integrated into one processing unit, or each unit can be a separate unit, or two or more units can be integrated into one unit; the above-mentioned integrated units can be implemented in the form of hardware or in the form of hardware plus software functional units.
[0367] Those skilled in the art will understand that all or part of the steps of implementing the above-mentioned method embodiment can be completed by hardware related to program instructions, and the aforementioned program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps of the above-mentioned method embodiment; and the aforementioned storage medium includes: mobile storage devices, read-only memories (ROM), magnetic disks or optical disks, and other media that can store program codes.
[0368] Alternatively, if the above-mentioned integrated unit of the present application is implemented in the form of a software function module and sold or used as an independent product, it can also be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application can be essentially or the part that contributes to the relevant technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable an electronic device (which can be a mobile phone, tablet computer, e-reader, drone, wearable device (such as smart glasses, etc.), sweeping robot, personal computer, navigator, video phone, TV, server, etc.) to execute all or part of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as mobile storage devices, ROM, magnetic disks or optical disks.
[0369] The methods disclosed in the several method embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments.
[0370] The features disclosed in the several product embodiments provided in this application can be arbitrarily combined without conflict to obtain new product embodiments.
[0371] The features disclosed in the several method or device embodiments provided in this application can be arbitrarily combined without conflict to obtain new method embodiments or device embodiments.
[0372] The above is merely an embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.
[0373] Industrial Applicability
[0374] In an embodiment of the present application, for the input source video data, the image component on the block to be encoded in the source video data is predicted according to a preset prediction mode belonging to the PDPC application mode. After obtaining the first prediction block, each prediction value in the first prediction block is not corrected, but the difference between the prediction value on the first prediction block and the image component on the block to be encoded is directly determined; in this way, the processing complexity of intra-frame prediction can be reduced while ensuring the video encoding and decoding performance.
Claims
1. An information processing method, applied to a decoder, characterized in that: The method comprises: Decoding a bitstream to obtain a prediction mode, and predicting an image component of a to-be-decoded block according to the prediction mode to obtain a third prediction block; wherein the prediction mode is a preset position-dependent mode combination PDPC mode to which a position-dependent mode combination PDPC mode can be applied; and wherein the image component is a luminance component or a chrominance component; When all of the following conditions 1 to 4 are satisfied, the third predicted block is corrected according to the prediction mode to obtain a third corrected block; Case 1: the block to be decoded is a luminance block and intra-frame sub-block division is not used; or the block to be decoded is a chrominance block; Case 2: When the block to be decoded is a luminance block, prediction is performed using the 0th reference row; or, when the block to be decoded is a chrominance block, the 0th reference row refers to the reference row closest to the block to be decoded; Case 3: the block to be decoded is not encoded using the block-based delta pulse code modulation (BDPCM) method; Case 4: Any of the following conditions is met: The prediction mode is a horizontal prediction mode; The prediction mode is a vertical prediction mode; The prediction mode is a prediction mode numbered as a first value among the preset N component spatial prediction modes; The prediction mode is the prediction mode numbered as the fourth value; The code stream is decoded to determine a residual block; and a sum of the residual block and the third correction block is determined to obtain a restored block.
2. An information processing method, applied to an encoder, characterized in that: The method comprises: Predicting an image component of the block to be coded according to a prediction mode to obtain a third prediction block; wherein the prediction mode is a preset position-dependent mode combination PDPC mode to which a position-dependent mode combination can be applied; wherein the image component is a luminance component or a chrominance component; When all of the following conditions 1 to 4 are satisfied, the third predicted block is corrected according to the prediction mode to obtain a third corrected block; Case 1: the block to be encoded is a luminance block and intra-frame sub-block division is not used; or the block to be encoded is a chrominance block; Case 2: When the block to be coded is a luminance block, prediction is performed using the 0th reference row; or, when the block to be coded is a chrominance block, the 0th reference row refers to the reference row closest to the block to be coded; Case 3: the block to be encoded is not encoded using the block-based delta pulse code modulation (BDPCM) method; Case 4: Any of the following conditions is met: The prediction mode is a horizontal prediction mode; The prediction mode is a vertical prediction mode; The prediction mode is a prediction mode numbered as a first value among the preset N component spatial prediction modes; The prediction mode is the prediction mode numbered as the fourth value; Determine a difference between the block to be encoded and the third corrected block to obtain a residual block; The residual block and the prediction mode are written into a bitstream.
3. A video decoding device, characterized in that: include: a prediction module configured to decode a bitstream, obtain a prediction mode, and predict an image component of a to-be-decoded block according to the prediction mode to obtain a third prediction block; wherein the prediction mode is a preset position-dependent mode combination PDPC mode to which a position-dependent mode combination PDPC mode can be applied; and wherein the image component is a luminance component or a chrominance component; a correction module configured to correct the third predicted block according to the prediction mode to obtain a third corrected block when all of the following conditions 1 to 4 are satisfied; Case 1: the block to be decoded is a luminance block and intra-frame sub-block division is not used; or the block to be decoded is a chrominance block; Case 2: When the block to be decoded is a luminance block, prediction is performed using the 0th reference row; or, when the block to be decoded is a chrominance block, the 0th reference row refers to the reference row closest to the block to be decoded; Case 3: the block to be decoded is not encoded using the block-based delta pulse code modulation (BDPCM) method; Case 4: Any of the following conditions is met: The prediction mode is a horizontal prediction mode; The prediction mode is a vertical prediction mode; The prediction mode is a prediction mode numbered as a first value among the preset N component spatial prediction modes; The prediction mode is the prediction mode numbered as the fourth value; The recovery module is configured to decode the code stream and determine a residual block; and determine the sum of the residual block and the third correction block to obtain a recovery block.
4. A video encoding device, characterized in that include: A prediction module is configured to predict an image component of the block to be coded according to the prediction mode to obtain a third prediction block; wherein the prediction mode is a preset position-dependent mode combination PDPC mode to which a position-dependent mode combination PDPC mode can be applied; wherein the image component is a luminance component or a chrominance component; a correction module configured to correct the third predicted block according to the prediction mode to obtain a third corrected block when all of the following conditions 1 to 4 are satisfied; Case 1: the block to be encoded is a luminance block and intra-frame sub-block division is not used; or the block to be encoded is a chrominance block; Case 2: When the block to be coded is a luminance block, prediction is performed using the 0th reference row; or, when the block to be coded is a chrominance block, the 0th reference row refers to the reference row closest to the block to be coded; Case 3: the block to be encoded is not encoded using the block-based delta pulse code modulation (BDPCM) method; Case 4: Any of the following conditions is met: The prediction mode is a horizontal prediction mode; The prediction mode is a vertical prediction mode; The prediction mode is a prediction mode numbered as a first value among the preset N component spatial prediction modes; The prediction mode is the prediction mode numbered as the fourth value; a residual determination module configured to determine a difference between the block to be encoded and the third corrected block to obtain a residual block; and The writing module is configured to write the residual block and the prediction mode into a bitstream.
5. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, the steps of the information processing method according to claim 1 are implemented.
6. A computer-readable storage medium, characterized in that A computer program is stored thereon, and when the computer program is executed by a processor, the steps of the information processing method according to claim 1 are implemented.
7. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the memory stores a computer program that can be run on the processor, and when the processor executes the program, the steps in the information processing method according to claim 2 are implemented.
8. A computer-readable storage medium, characterized in that A computer program is stored thereon, and when the computer program is executed by a processor, the steps of the information processing method according to claim 2 are implemented.
9. A computer-readable storage medium, characterized in that A computer program and a code stream are stored thereon, and when the computer program is executed by a processor, the information processing method according to claim 2 is implemented to generate the code stream.