Information processing methods and apparatus, equipment, and storage media
By employing a PDPC application mode to predict and determine residual blocks in video encoding and decoding without modifying predicted values, the method reduces processing complexity and ensures video encoding and decoding performance.
Patent Information
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
- Filing Date
- 2026-02-27
- Publication Date
- 2026-06-02
AI Technical Summary
The complexity of information processing in video encoding and decoding, particularly intra-prediction, affects the smoothness of video viewing experiences, which existing technologies have not adequately addressed.
The method involves predicting image components in encoding and decoding blocks using a position-dependent prediction combination (PDPC) application mode, determining differences without modifying predicted values, and writing residual blocks and modes to a bitstream, thereby reducing processing complexity.
This approach reduces the complexity of video encoding and decoding while maintaining performance by directly determining residual blocks based on pre-set prediction modes, specifically targeting intra-prediction processes.
Smart Images

Figure 2026090537000001_ABST
Abstract
Description
Technical Field
[0001] The embodiments of the present application relate to electronic technologies, and are related to, but not limited to, information processing methods and apparatuses, equipment, and storage media.
Background Art
[0002] In recent years, video services have been rapidly developing in the field of electronic technologies. Video services need to first encode source video data and transmit the encoded video data to user terminals through channels of the Internet or mobile communication networks.
[0003] For users, the smoothness of videos directly affects the user's video viewing experience. And the complexity of information processing in video encoding directly affects the smoothness of videos.
Summary of the Invention
Problems to be Solved by the Invention
[0004] In view of this, the embodiments of the present application provide an information processing method and apparatus, equipment, and storage medium to solve at least one problem in the related art.
Means for Solving the Problems
[0005] The technical solution of the embodiments of the present application is realized as follows.
[0006] In a first aspect, the embodiments of the present application provide an information processing method, and the method includes: Predicting an image component in an encoding target block in the source video data based on a prediction mode for the input source video data to obtain a first prediction block, where the prediction mode is preset and belongs to a position-dependent prediction combination (PDPC) application mode; The difference between the image component in the aforementioned encoding target block and the predicted value in the first prediction block is determined, and the residual block is obtained. This includes writing the residual block and the prediction mode to a bitstream.
[0007] In other embodiments, the image component is a luminance value or a chromaticity value.
[0008] In other embodiments, the image components in the target-to-encode block are predicted based on the prediction mode to obtain the first predicted block. This includes performing a chromaticity prediction on the chromaticity value in the encoding target block based on any one prediction mode in the first mode combination, and obtaining a first prediction block. The first mode combination includes PDPC application modes such as: a prediction mode in which the number in the spatial prediction mode among the preset N types of components is smaller than a first numerical value and does not include a planar prediction mode or a DC component prediction mode; a prediction mode in which the number is greater than a first numerical value and less than or equal to a second numerical value; a prediction mode in which the number is greater than or equal to a third numerical value and less than a fourth numerical value; and a prediction mode in which the number is greater than a fourth numerical value.
[0009] In other embodiments, the image components in the target-to-encode block are predicted based on the prediction mode to obtain the first predicted block. This includes performing a chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the second mode combination, and obtaining a first prediction block. The second mode combination includes PDPC application modes: a prediction mode in which the number in the spatial prediction mode within the preset N types of components is less than or equal to the second numerical value and does not include the planar prediction mode or the DC component prediction mode; and a prediction mode in which the number is greater than or equal to the third numerical value.
[0010] In other embodiments, the image components in the target-to-encode block are predicted based on the prediction mode to obtain the first predicted block. This includes performing a chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the third mode combination, and obtaining a first prediction block. The third mode combination includes PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in which the number in the spatial prediction mode within a preset N types of components is 2 or less and does not include the planar prediction mode or the DC component prediction mode, and a prediction mode in which the number is 3 or greater.
[0011] In other embodiments, the image components in the target-to-encode block are predicted based on the prediction mode to obtain the first predicted block. This includes performing a chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the fourth mode combination, and obtaining a first prediction block. The fourth mode combination includes PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in which the number in the spatial prediction mode within a preset N types of components is 2 or less and includes a planar prediction mode and a DC component prediction mode, and a prediction mode in which the number is 3 or greater.
[0012] In other embodiments, the image components in the encoding target block of the input source video data are predicted based on the prediction mode to obtain a first predicted block, This includes performing a brightness prediction on the brightness value in the encoding target block based on any one prediction mode in any one of the first to fourth mode combinations, and obtaining a first prediction block.
[0013] In a second aspect, an embodiment of the present application provides an information processing device, the device is A prediction module is configured to predict the image components in the encoding target block of the input source video data based on a prediction mode and to acquire a first prediction block, wherein the prediction mode is pre-set and belongs to the PDPC application mode, A residual determination module is configured to determine the difference between the image component in the encoding target block and the predicted value in the first prediction block, and to acquire the residual block. The system includes a writing module configured to write the residual block and the prediction mode to a bitstream.
[0014] In other embodiments, the image component is a luminance value or a chromaticity value.
[0015] In other embodiments, the prediction module comprises a chromaticity prediction unit, which is configured to perform chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the first mode combination, and to obtain a first prediction block. The first mode combination includes PDPC application modes such as: a prediction mode in which the number in the spatial prediction mode among the preset N types of components is smaller than a first numerical value and does not include a planar prediction mode or a DC component prediction mode; a prediction mode in which the number is greater than a first numerical value and less than or equal to a second numerical value; a prediction mode in which the number is greater than or equal to a third numerical value and less than a fourth numerical value; and a prediction mode in which the number is greater than a fourth numerical value.
[0016] In other embodiments, the prediction module comprises a chromaticity prediction unit, which is configured to perform chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the second mode combination, and to obtain a first prediction block. The second mode combination includes PDPC application modes: a prediction mode in which the number in the spatial prediction mode within the preset N types of components is less than or equal to the second numerical value and does not include the planar prediction mode or the DC component prediction mode; and a prediction mode in which the number is greater than or equal to the third numerical value.
[0017] In other embodiments, the prediction module comprises a chromaticity prediction unit, which is configured to perform chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the third mode combination, and to obtain a first prediction block. The third mode combination includes PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in which the number in the spatial prediction mode within a preset N types of components is 2 or less and does not include the planar prediction mode or the DC component prediction mode, and a prediction mode in which the number is 3 or greater.
[0018] In other embodiments, the prediction module comprises a chromaticity prediction unit, which is configured to perform chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the fourth mode combination, and to obtain a first prediction block. The fourth mode combination includes PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in which the number in the spatial prediction mode within a preset N types of components is 2 or less and includes a planar prediction mode and a DC component prediction mode, and a prediction mode in which the number is 3 or greater.
[0019] In other embodiments, the prediction module includes a brightness prediction unit, which is configured to perform brightness prediction on the brightness value in the encoding target block based on any one prediction mode in any one of the first to fourth mode combinations, and to obtain a first prediction block.
[0020] In a third aspect, the embodiment of the present application provides an information processing method, the method is For the input bitstream, predict the image components in the decoding target block in the bitstream based on the prediction mode in the bitstream to obtain a second prediction block, the prediction mode being preset and belonging to the PDPC application mode, and determine the sum of the difference in the residual block in the bitstream and the predicted value in the second prediction block to obtain a restored block, and process the restored block and output the processed video data.
[0021] In a fourth aspect, an embodiment of the present application provides an information processing apparatus, the apparatus comprising: a prediction module configured to predict image components in a decoding target block in the bitstream based on the prediction mode in the bitstream to obtain a second prediction block, the prediction mode being preset and belonging to the PDPC application mode; a restoration module configured to determine the sum of the difference in the residual block in the bitstream and the predicted value in the second prediction block to obtain a restored block; a video output module configured to process the restored block and output the processed video data.
[0022] In a fifth aspect, an embodiment of the present application provides an information processing method, the method comprising: for the input source video data, predict the image components in the encoding target block in the source video data based on the prediction mode to obtain a third prediction block, the prediction mode being preset and belonging to the PDPC application mode, and modify the third prediction block based on the prediction mode to obtain a third modified block; determine the difference between the image components in the encoding target block and the modified value in the third modified block to obtain a residual block; This includes writing the residual block and the prediction mode to a bitstream.
[0023] In the sixth aspect, an embodiment of the present application provides an information processing device, the device is A prediction module is configured to predict the image components in the encoding target block of the source video data based on a prediction mode, and to acquire a third prediction block, wherein the prediction mode is pre-set and belongs to the PDPC application mode. A modification module configured to modify the third prediction block based on the prediction mode and obtain a third modification block, A residual determination module is configured to determine the difference between the image components in the encoding target block and the correction value in the third correction block, and to obtain a residual block. The system includes a writing module configured to write the residual block and the prediction mode to a bitstream.
[0024] In the seventh aspect, the embodiment of the present application provides an information processing method, the method is For the input bitstream, the image components in the bitstream to be decoded are predicted based on the prediction mode in the bitstream, and a fourth predicted block is obtained, and the prediction mode is set in advance and belongs to the PDPC application mode. The process involves modifying the fourth prediction block based on the prediction mode to obtain the fourth modified block, The sum of the difference in the residual block in the bitstream and the correction value in the fourth correction block is determined, and the restored block is obtained. This includes processing the aforementioned restoration block and outputting the processed video data.
[0025] In the eighth aspect, an embodiment of the present application provides an information processing device, the device is A prediction module is configured to predict the image components in the bitstream to be decoded based on the prediction mode in the input bitstream, and to acquire a fourth prediction block, wherein the prediction mode is pre-set and belongs to the PDPC application mode, A modification module configured to modify the fourth prediction block based on the prediction mode and obtain a fourth modification block, A recovery module is configured to determine the sum of the difference in the residual block in the bitstream and the correction value in the fourth correction block, and to obtain a recovery block. The system includes a video output module configured to process the aforementioned restoration block and output the processed video data.
[0026] In the ninth aspect, an embodiment of the present application provides an electronic device comprising a memory and a processor, wherein the memory stores a computer program that can be executed by the processor, and the processor implements the steps of the above-described information processing method when executing the program.
[0027] In the tenth aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the steps in the above-described information processing method are realized. [Effects of the Invention]
[0028] In the embodiment of the present invention, based on a pre-set prediction mode belonging to the PDPC application mode, the image components in the blocks to be encoded in the input source video data are predicted, and a first prediction block is obtained. Then, without modifying the predicted values in the first prediction block, the difference between the predicted values in the first prediction block and the image components in the blocks to be encoded is directly determined. In this way, the complexity of information processing in video encoding and decoding can be reduced, and in particular the processing complexity of intra-prediction can be reduced, while ensuring video encoding and decoding performance. [Brief explanation of the drawing]
[0029] [Figure 1] Figure 1 is a schematic diagram of a network architecture according to an embodiment of the present invention. [Figure 2A] Figure 2A is a schematic diagram of the structure of a video encoder according to an embodiment of the present invention. [Figure 2B] Figure 2B is a schematic diagram of the structure of a video decoder according to an embodiment of the present invention. [Figure 2C] Figure 2C is a schematic diagram of the spatial prediction modes within 94 components according to an embodiment of the present application. [Figure 2D] Figure 2D is a schematic diagram of the PDPC calculation method in the DC component prediction mode according to an embodiment of the present invention. [Figure 3A] Figure 3A is a flowchart illustrating the implementation of the information processing method according to an embodiment of the present invention. [Figure 3B] Figure 3B is a flowchart illustrating the implementation of another information processing method according to the embodiment of the present invention. [Figure 4A] Figure 4A is a flowchart illustrating the implementation of another information processing method according to an embodiment of the present invention. [Figure 4B] Figure 4B is a flowchart illustrating the implementation of a further information processing method according to an embodiment of the present invention. [Figure 5] Figure 5 is a flowchart illustrating the implementation of another information processing method according to the embodiment of the present invention. [Figure 6] Figure 6 is a flowchart illustrating the implementation of another information processing method according to an embodiment of the present invention. [Figure 7] Figure 7 is a flowchart illustrating the implementation of a further information processing method according to an embodiment of the present invention. [Figure 8] Figure 8 is a flowchart illustrating the implementation of another information processing method according to an embodiment of the present invention. [Figure 9A] Figure 9A is a flowchart illustrating the implementation of another information processing method according to an embodiment of the present invention. [Figure 9B] Figure 9B is a flowchart illustrating the implementation of a further information processing method according to an embodiment of the present invention. [Figure 10] Figure 10 is a flowchart illustrating the implementation of another information processing method according to an embodiment of the present invention. [Figure 11A] Figure 11A is a flowchart illustrating the implementation of another information processing method according to an embodiment of the present invention. [Figure 11B] Figure 11B is a flowchart illustrating the implementation of a further information processing method according to an embodiment of the present invention. [Figure 12A] Figure 12A is a schematic diagram of the structure of an information processing device according to an embodiment of the present invention. [Figure 12B] Figure 12B is a schematic diagram of the structure of another information processing device according to an embodiment of the present invention. [Figure 13] Figure 13 is a schematic diagram of the structure of another information processing device according to an embodiment of the present invention. [Figure 14] Figure 14 is a schematic diagram of the structure of a further information processing device according to an embodiment of the present invention. [Figure 15] Figure 15 is a schematic diagram of the structure of another information processing device according to an embodiment of the present invention. [Figure 16] Figure 16 is a schematic diagram of the hardware entity of an electronic device according to an embodiment of the present invention. [Modes for carrying out the invention]
[0030] To further clarify the purpose, technical proposal, and advantages of the embodiments of this application, the specific technical proposal of this application will be described in more detail below with reference to the drawings of the embodiments. The embodiments described below are for illustrative purposes only and are not intended to limit the scope of this application.
[0031] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those generally understood by those skilled in the art. The terms used herein are solely for illustrative purposes of the embodiments of this application and are not intended to limit it.
[0032] In the following description, “some embodiments” describes a subset of all possible embodiments, but as should be understood, “some embodiments” may be the same subset or different subsets of all possible embodiments and can be combined with each other as long as they do not conflict.
[0033] Furthermore, the terms "1st\2nd\3rd" relating to the embodiments of this application are merely for distinguishing similar objects and do not represent a specific order of objects. To be understood, "1st\2nd\3rd" may be interchanged in any permitted order or sequence to allow the embodiments of this application described herein to be carried out in an order other than that illustrated or described herein.
[0034] This embodiment first provides a network architecture, and Figure 1 is a schematic diagram of the structure of the network architecture according to this embodiment. As shown in Figure 1, the network architecture comprises one or more electronic devices 11 to 1N and a communication network 01, and the electronic devices 11 to 1N can perform video interaction via the communication network 01. The electronic devices may be devices that have various types of video encoding and decoding functions in the implementation process, for example, the electronic devices may include mobile phones, tablet computers, e-readers, unmanned aerial vehicles, wearable devices (e.g., smart glasses, etc.), robotic vacuum cleaners, personal computers, car navigation systems, video phones, televisions, servers, etc.
[0035] The aforementioned electronic device has video coding and decoding functions and includes a video encoder and / or video decoder. For example, as shown in Figure 2A, the configuration of the video encoder 21 includes a conversion and quantization unit 211, an intra estimation unit 212, an intra prediction unit 213, a motion compensation unit 214, a motion estimation unit 215, an inverse conversion and inverse quantization unit 216, a filter control analysis unit 217, a filtering unit 218, an coding unit 219, and a decoding image buffer unit 210, etc. The filtering unit 218 can implement deblocking filtering and sample adaptive offset (SAO) filtering, and the coding unit 219 can implement header information coding and context-based adaptive binary arithmetic coding (CABAC).
[0036] A single video coding block can be obtained from the input source video data by dividing it into a coding tree unit (CTU). Next, the video coding block is transformed by a transformation and quantization unit 211 using residual pixel information obtained after intra or interprediction. This transformation includes converting the residual information from pixel fields to transformation fields and quantizing the obtained transformation coefficients to further reduce the bitrate. Intraestimation units 212 and intraprediction units 213 are used to perform intraprediction on the video coding block, and obviously, intraestimation units 212 and intraprediction units 213 are used to determine the intraprediction mode for coding the video coding block. Motion compensation units 214 and motion estimation units 215 are used to provide time prediction information by performing interprediction coding on one or more blocks in one or more reference frames of the received video coding block. The motion estimation performed by the motion estimation unit 215 is a motion vector generation process, and the motion vector can estimate the motion of the video coding block. Next, the motion compensation unit 214 performs motion compensation based on the motion vector determined by the motion estimation unit 215. After determining the intra-prediction mode, the intra-prediction unit 213 is used to provide further selected intra-prediction data to the coding unit 219, and the motion estimation unit 215 also transmits the computationally determined motion vector data to the coding unit 219. The inverse transform and inverse quantization unit 216 is used to reconstruct the video coding block, reconstructing the residual block in the pixel field. The reconstructed residual block is then filtered by the filter control analysis unit 217 and the filtering unit 218 to remove blocking effect artifacts. The reconstructed residual block is then added to one prediction block in the frame of the decoding image buffer unit 210 to generate a reconstructed video coding block.The encoding unit 219 is used to encode various encoding parameters and quantized conversion coefficients, and in a CABAC-based encoding algorithm, the context content may be based on adjacent encoding blocks, and it may be used to encode information indicating the determined intra-prediction mode and output the bitstream of the source video data, while the decoding image buffer unit 210 is used to store the reconstructed video encoding blocks and is used for prediction reference. As video image encoding progresses, new reconstructed video encoding blocks are constantly generated, and all of these reconstructed video encoding blocks are stored in the decoding image buffer unit 210.
[0037] The video decoder 22, which corresponds to the video encoder 21, has a configuration shown in Figure 2B and includes a decoding unit 221, an inverse transform and inverse quantization unit 222, an intra-prediction unit 223, a motion compensation unit 224, a filtering unit 225, and a decoded image buffer unit 226, etc. The decoding unit 221 can perform header information decoding and CABAC decoding, and the filtering unit 225 can perform deblocking filtering and SAO filtering. The input source video data undergoes the encoding process shown in Figure 2A and then outputs a bitstream of the source video data. This bitstream is input to the video decoder 22 and first passes through the decoding unit 221 to obtain the decoded conversion coefficients. These conversion coefficients are processed by the inverse transform and inverse quantization unit 222 to generate residual blocks in the pixel field. The intra-prediction unit 223 may be used to generate prediction data for the current video decoding block based on the determined intra-prediction mode and the data that has passed through the decoding block from the current frame or picture. The motion compensation unit 224 determines prediction information to be used for the video decoding block by analyzing the motion vector and other relevant grammatical elements, and uses this prediction information to generate a prediction block for the video decoding block being decoded. The decoded video block is formed by summing the residual block from the inverse transform and inverse quantization unit 222 with the corresponding prediction block generated by the intra-prediction unit 223 or the motion compensation unit 224. The acquired decoded video data can be processed by the filtering unit 225 to remove blocking effect artifacts and improve video quality. Next, the decoded video data is stored in the decoded image buffer unit 226, which is used to store reference images used for subsequent intra-prediction or motion compensation, and is also used to output the video data, i.e., to acquire the restored source video data.
[0038] Before detailing the embodiments of this invention, let's first briefly explain the intra-prediction mode.
[0039] In the latest Versatile Video Coding (VVC) draft (also known as H.266), to capture finer edge directions in natural video, 94 spatial prediction modes within components numbered -14 to 80 are defined in the VVC test model VTM5.0, as shown in Figure 2C. These spatial prediction modes include two non-angle modes: the Planar mode (number 0, hereinafter referred to as the Planar prediction mode) and the DC mode (number 1, hereinafter referred to as the DC component prediction mode). The numbers are used to uniquely identify the prediction mode and may be used as mode index numbers. In intra-prediction, one or more prediction modes from the 94 components are used to perform intra-component spatial prediction for the current block.
[0040] The information processing method of the embodiment of this application is mainly applied to the intra-prediction unit 213 shown in Figure 2A and the intra-prediction unit 223 shown in Figure 2B, and is used to obtain the intra-predicted value of the current block. That is, the information processing method of the embodiment of this application can be applied not only to the video encoder 21 but also to the video decoder 22, and by extension, to both the video encoder 21 and the video decoder 22 simultaneously, but the embodiment of this application is not specifically limited. When the method described below is used in part 213, "current block" refers to the block to be encoded in part 213, and when the method described below is used in part 223, "current block" refers to the block to be decoded in part 223.
[0041] This section describes how the intra-prediction units 213 / 223 in related technologies perform the intra-prediction process. Generally, the intra-prediction process mainly consists of: Before performing brightness and chromaticity prediction for the current block (which may be either an encoding target block or a decoding target block), it is necessary to first obtain the reference pixel values around the current block. If all reference pixels are missing, the pixel value 512 is used to fill them in. If only some reference pixels are missing, the values of the nearest adjacent reference pixels are used to fill them in (step S201). Step S202 involves determining whether it is necessary to filter the reference pixels depending on specific circumstances such as the prediction mode and the current block size, and if filtering is necessary, filtering the reference pixels using a 3-tap smoothing filter with coefficients [1,2,1]. Step S203 involves predicting the current block using a reference pixel based on the calculation method for each prediction mode, and obtaining the predicted value for each pixel in the current block. Step S204 includes obtaining the predicted value for each pixel in the current block and then further correcting the predicted value using the PDPC method for several prediction modes, such as a planar prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, an angle prediction mode with a number of 10 or less (including a wide-angle mode), and an angle prediction mode with a number of 58 or more.
[0042] The principle of the PDPC method is to correct the predicted value based on the left reference pixel (left) of the current block, the reference pixel (top) of the row above, and the top-left corner reference pixel (topleft), and then determine the residual between the corrected predicted value and the corresponding pixel value in the current block.
[0043] JPEG2026090537000002.jpg92150
[0044] The embodiments of the present application will be described in detail below with reference to the drawings. The information processing method according to the embodiments of the present application can be applied not only to the video encoder 21 but also to the video decoder 22, and the embodiments of the present application are not specifically limited thereto.
[0045] Embodiments of the present invention provide an information processing method, which is applied to a video encoder 21 of an electronic device, and the functions realized by the method may be realized by the processor of the electronic device calling program code, which, of course, may be stored in a computer storage medium. As can be seen from the above, the electronic device comprises at least a processor and a storage medium.
[0046] Figure 3A is a flowchart illustrating the implementation of an information processing method according to an embodiment of the present invention. As shown in Figure 3A, the method includes the following steps S301 to S303.
[0047] In step S301, the image components in the encoding target block of the input source video data are predicted based on the prediction mode, and a first predicted block is obtained. The prediction mode is preset and belongs to the PDPC application mode. In other embodiments, the image component is a chromaticity value or a luminance value. Before using the PDPC method, the prediction mode used when predicting the current block (including the block to be encoded and the block to be decoded) is defined as the PDPC application mode. For example, in VTM5.0, the PDPC application modes include a planar prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, an angle prediction mode with a number of 10 or less (including a wide-angle mode), and an angle prediction mode with a number of 58 or more (including a wide-angle mode).
[0048] The decoded target block refers to the image region in the source video data that requires prediction and encoding processing. When this is implemented, the source video data can be acquired by an image acquisition device.
[0049] As can be understood, after obtaining the first prediction block, step S302 is executed directly to determine the difference between the image component in the block to be encoded and the predicted value in the first prediction block. In this way, the processing complexity of intra-prediction can be reduced without performing PDPC processing on the first prediction block before determining the residual block.
[0050] In step S302, the difference between the image component in the block to be encoded and the predicted value in the first prediction block is determined, and the residual block is obtained.
[0051] Step S303: Write the residual block and the prediction mode to the bitstream.
[0052] In the embodiment of the present invention, based on a pre-set prediction mode belonging to the PDPC application mode, the image components in the source video data to be encoded are predicted, and a first prediction block is obtained. Then, without modifying each predicted value in the first prediction block, the difference between the predicted value in the first prediction block and the image components in the codeable block is determined directly. In this way, the complexity of the intra-prediction process can be reduced while ensuring video encoding performance.
[0053] Embodiments of the present application provide another information processing method, which is applied to a video decoder 22 of an electronic device. Figure 3B is a flowchart illustrating the implementation of the other information processing method according to an embodiment of the present application. As shown in Figure 3B, the method includes steps S311 to S313. In step S311, the image components in the bitstream to be decoded are predicted based on the prediction mode in the bitstream, and a second predicted block is obtained, wherein the prediction mode is preset and belongs to the PDPC application mode. In other embodiments, the image component is a chromaticity value or a luminance value. In step S312, the sum of the difference in the residual block in the bitstream and the predicted value in the second prediction block is determined, and the restored block is obtained. In step S313, the restored block is processed and the processed video data is output.
[0054] In the embodiment of this application, a second predicted block is obtained by predicting the image components in the block to be decoded in the bitstream based on the prediction mode in the input bitstream, and the prediction mode is preset and belongs to the PDPC application mode. After obtaining the second predicted block, the sum of the difference in the residual block in the bitstream and the predicted value in the second predicted block is directly determined without modifying each predicted value in the second predicted block, and the restored block is obtained therefrom. In this way, the processing complexity of intra-prediction can be reduced in order to ensure video decoding performance.
[0055] An embodiment of the present application provides another information processing method, which is applied to a video encoder 21 of an electronic device. Figure 4A is a flowchart of the implementation of the other information processing method according to an embodiment of the present application. As shown in Figure 4A, the method includes the following steps S401 to S403.
[0056] In step S401, a chromaticity prediction is performed on the input source video data based on the prediction mode for the chromaticity value in the encoding target block of the source video data, and a first prediction block is obtained. The prediction mode is preset and belongs to the PDPC application mode. As is understood, improving video encoding and decoding performance using the PDPC method is based on saving encoding bits and sacrificing chromaticity performance. Because luminance and chromaticity reflect different image content, it is impossible to simultaneously improve luminance and chromaticity performance by modifying the first prediction block using the PDPC method. In the embodiments of this application, when performing chromaticity prediction on a block to be encoded, a preset prediction mode is used to perform chromaticity prediction on the chromaticity value of the block to be encoded in the source video data. Then, without modifying the first prediction block obtained using the PDPC method, the chromaticity residual block is determined directly based on the block to be encoded and the first prediction block.
[0057] In step S402, the difference between the chromaticity value in the block to be encoded and the chromaticity prediction value in the first prediction block is determined, and the residual block is obtained. As can be understood here, the acquired residual block is a chromatic residual block, which means that it contains the difference between the chromaticity value in the block to be encoded and the chromaticity predicted value in the first prediction block.
[0058] In step S403, the residual block and the prediction mode are written to the bitstream.
[0059] In the embodiment of this invention, chromaticity prediction is performed on the input source video data based on a pre-set prediction mode belonging to the PDPC application mode, for the chromaticity values in the encoding target blocks of the source video data. Then, the residual value is directly calculated without modifying the predicted value in the acquired first prediction block. In this way, the processing complexity of intra-chromaticity prediction is reduced without affecting chromaticity performance.
[0060] Based on steps S401 to S403 described above, in other embodiments, the method further, Step S404 involves performing a brightness prediction on the brightness value in the encoding target block based on a pre-set prediction mode belonging to the PDPC application mode, and obtaining a first prediction block. Step S405 involves correcting the predicted value in the first prediction block to obtain the first corrected block, Step S406 involves determining the difference between the luminance value in the encoding target block and the corresponding correction value in the first correction block, and obtaining a corrected residual block. The process includes step S407 of writing the corrected residual block and the prediction mode to a bitstream.
[0061] In other embodiments, the video encoder may further perform steps S901 to S903 of the following embodiment in addition to the brightness prediction, or it may perform steps S101 to S103 of the following embodiment.
[0062] Embodiments of the present application provide a further information processing method, which is applied to a video decoder 22 of an electronic device. Figure 4B is a flowchart illustrating the implementation of the further information processing method according to an embodiment of the present application. As shown in Figure 4B, the method is Step S411 involves predicting the chromaticity value in the bitstream to be decoded based on the prediction mode in the bitstream, obtaining a second prediction block, and setting the prediction mode to be preset and belonging to the PDPC application mode. Step S412 involves determining the sum of the chromaticity difference in the residual block of the bitstream and the chromaticity prediction value in the second prediction block, and obtaining the restored block. The process includes step S413, which processes the restored block and outputs the processed video data.
[0063] In the embodiment of the present invention, a second predicted block is obtained by predicting the chromaticity value in the decoded block of the bitstream based on the prediction mode in the bitstream, and the prediction mode is predicted and belongs to the PDPC application mode. After obtaining the second predicted block, the residual block and the second predicted block are directly added together without modifying the chromaticity prediction value in the obtained second predicted block to obtain a restored block, the restored block is processed, and the processed video data is output. In this way, the processing complexity of intra-chromaticity prediction is reduced without affecting chromaticity performance.
[0064] Based on steps S411 to S413 described above, in other embodiments, the method further, Step S414 involves predicting the brightness value in the bitstream to be decoded based on the prediction mode in the bitstream, obtaining a second prediction block, and setting the prediction mode to be preset and belonging to the PDPC application mode. Step S415 involves correcting the brightness prediction value in the second prediction block to obtain the second corrected block, Step S416 involves determining the sum of the luminance difference in the residual block in the bitstream and the luminance prediction value in the second correction block, and obtaining the restored block. The process includes step S417, which processes the recovery block and outputs the processed video data.
[0065] In other embodiments, the video decoder may further perform steps S911 to S913 of the following embodiment for brightness prediction, or in other embodiments, the prediction mode in step S911 is one of the prediction modes in any one of the first to fourth mode combinations described below.
[0066] Embodiments of the present invention provide another information processing method, which is applied to a video encoder 21 of an electronic device. Figure 5 is a flowchart showing the implementation of the other information processing method according to embodiments of the present invention. As shown in Figure 5, the method includes the following steps S501 to S503.
[0067] In step S501, a chromaticity prediction is performed on the input source video data based on one prediction mode in the first mode combination, and a first prediction block is obtained. The first mode combination includes PDPC application modes such as: a prediction mode in which the number in the spatial prediction mode among the preset N types of components is smaller than a first numerical value and does not include a planar prediction mode or a DC component prediction mode; a prediction mode in which the number is greater than a first numerical value and less than or equal to a second numerical value; a prediction mode in which the number is greater than or equal to a third numerical value and less than a fourth numerical value; and a prediction mode in which the number is greater than a fourth numerical value. The first, second, third, and fourth numerical values are generally preset mode index number values (i.e., the values of the aforementioned numbers). In a preferred embodiment, the spatial prediction modes within the N types of components are the spatial prediction modes within the 94 types of components shown in Figure 2C, and the first numerical value is set to 2, the second numerical value to 10, the third numerical value to 58, and the fourth numerical value to 66. That is, when performing chromaticity prediction, if any one of the following prediction modes is used among the prediction modes within these 94 types of components where the number is less than 2 and does not include the planar prediction mode or the DC component prediction mode, the prediction mode where the number is greater than 2 and 10 or less, the prediction mode where the number is 58 or greater and less than 66, and the prediction mode where the number is greater than 66, the chromaticity prediction value obtained by the PDPC method is not modified in any of these cases. In other words, the chromaticity prediction value obtained by the PDPC method is modified only in the planar prediction mode, the DC component prediction mode, the horizontal prediction mode, the vertical prediction mode, the prediction mode with a number of 2, and the prediction mode with a number of 66.
[0068] In step S502, the difference between the chromaticity value in the block to be encoded and the chromaticity prediction value in the first prediction block is determined, and the residual block is obtained.
[0069] In step S503, the residual block and the prediction mode are written to the bitstream.
[0070] In the embodiments of this invention, when performing chromaticity prediction for a block to be encoded using the prediction mode in the first mode combination, the difference between the chromaticity prediction value and the chromaticity value in the block to be encoded is determined directly without modifying the chromaticity prediction value obtained by the PDPC method. In this way, the complexity of the chromaticity prediction process is reduced while ensuring chromaticity prediction performance.
[0071] Based on steps S501 to S503 described above, in other embodiments, the method further includes steps S403 to S407 described above.
[0072] In addition, in other embodiments, steps S901 to S903 of the following embodiment may be performed for brightness prediction, or steps S101 to S103 of the following embodiment may be performed.
[0073] Furthermore, the video decoder may perform decoding steps corresponding to steps S501 to S503 above on the input bitstream, and a detailed explanation is omitted here. In other embodiments, for brightness prediction, the video decoder may further perform steps S911 to S913 of the following embodiment, or in other embodiments, the prediction mode in step S911 is one of the prediction modes in any one of the first to fourth mode combinations.
[0074] An embodiment of the present application provides another information processing method, which is applied to a video encoder 21 of an electronic device. Figure 6 is a flowchart showing the implementation of another information processing method according to an embodiment of the present application. As shown in Figure 6, the method includes the following steps S601 to S603.
[0075] In step S601, a chromaticity prediction is performed on the input source video data based on one of the prediction modes in the second mode combination to obtain a first prediction block. The second mode combination includes a PDPC application mode in which the number in the spatial prediction mode within the preset N components is less than or equal to the second numerical value and does not include the planar prediction mode or the DC component prediction mode, and a prediction mode in which the number is greater than or equal to the third numerical value. The second and third numerical values are generally preset mode index number values (i.e., the values of the aforementioned numbers). In a preferred embodiment, the spatial prediction modes within the N types of components are the spatial prediction modes within the 94 types of components shown in Figure 2C, and the second numerical value is set to 10 and the third numerical value is set to 58. That is, when performing chromaticity prediction, if one of the prediction modes is used from among those in which the number in the spatial prediction mode within these 94 types of components is 10 or less and does not include the planar prediction mode or the DC component prediction mode, and those in which the number is 58 or more, the chromaticity prediction value obtained by the PDPC method is not modified in any case. In this way, the complexity of the chromaticity prediction process can be reduced. In other words, the chromaticity prediction value obtained by the PDPC method is modified only in the planar prediction mode, DC component prediction mode, horizontal prediction mode, and vertical prediction mode.
[0076] Furthermore, in another preferred embodiment, for example, the spatial prediction modes within the N types of components are the spatial prediction modes within the 94 types of components shown in Figure 2C, with the second value set to 8 and the third value set to 60.
[0077] In step S602, the difference between the chromaticity value in the block to be encoded and the chromaticity prediction value in the first prediction block is determined, and the residual block is obtained.
[0078] In step S603, the residual block and the prediction mode are written to the bitstream.
[0079] In the embodiments of this invention, when predicting a block to be coded using any one prediction mode in the second mode combination, the residual value is determined directly and the predicted value is not modified. In this way, the chromaticity coding performance is improved without affecting the luminance coding performance. According to experimental data, the Y component performance decreased by 0.03%, the U component performance improved by 0.16%, and the V component performance improved by 0.14%. As can be seen from the above, the Y component performance remained basically unchanged, while the improvements in the U component performance and the V component performance were significant.
[0080] Furthermore, in other embodiments, based on steps S601 to S603 above, the method further includes steps S403 to S407 above. Alternatively, in other embodiments, steps S901 to S903 of the following embodiment may be performed for luminance prediction, or steps S101 to S103 of the following embodiment may be performed.
[0081] Furthermore, the video decoder may perform decoding steps corresponding to steps S601 to S603 above on the input bitstream, and a detailed explanation is omitted here. In other embodiments, steps S911 to S913 of the following embodiments may be performed on the brightness prediction, and in other embodiments, the prediction mode in step S911 is one of the prediction modes in any one of the first to fourth mode combinations.
[0082] Embodiments of the present invention provide a further information processing method, which is applied to a video encoder 21 of an electronic device. Figure 7 is a flowchart illustrating the implementation of the further information processing method according to an embodiment of the present invention. As shown in Figure 7, the method includes the following steps S701 to S703.
[0083] In step S701, a chromaticity prediction is performed on the input source video data based on one of the prediction modes in the third mode combination to obtain a first prediction block. The third mode combination includes PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in which the number in the spatial prediction mode within the preset N types of components is less than or equal to the second numerical value and does not include the planar prediction mode or the DC component prediction mode, and a prediction mode in which the number is greater than or equal to the third numerical value. The second and third numerical values are generally preset mode index number values (i.e., the values of the aforementioned numbers). In a preferred embodiment, the spatial prediction modes within the N types of components are the spatial prediction modes within the 94 types of components shown in Figure 2C, with the second numerical value set to 10 and the third numerical value set to 58. That is, the third mode combination includes PDPC application modes such as a horizontal prediction mode, a vertical prediction mode, a prediction mode whose number in the spatial prediction modes within the 94 types of components is 10 or less and does not include the planar prediction mode or the DC component prediction mode, and a prediction mode whose number is 58 or more. In other words, the chromaticity prediction values obtained by the PDPC method are corrected only in the planar prediction mode and the DC component prediction mode, while the chromaticity prediction values obtained by the PDPC method are not corrected in the third mode combination, thereby reducing the complexity of the chromaticity prediction process.
[0084] In step S702, the difference between the chromaticity value in the block to be encoded and the chromaticity prediction value in the first prediction block is determined, and the residual block is obtained.
[0085] In step S703, the residual block and the prediction mode are written to the bitstream.
[0086] Furthermore, in other embodiments, based on steps S701 to S703 above, the method further includes steps S403 to S407 above. Alternatively, in other embodiments, steps S901 to S903 of the following embodiment may be performed for luminance prediction, or steps S101 to S103 of the following embodiment may be performed.
[0087] Furthermore, the video decoder performs decoding steps corresponding to steps S701 to S703 above on the input bitstream, but a detailed explanation is omitted here. In other embodiments, the video decoder may further perform steps S414 to S417 above for brightness prediction, or perform steps S911 to S913 of the embodiment below, or in other embodiments, the prediction mode in step S911 is one of the prediction modes in any one of the first to fourth mode combinations.
[0088] Embodiments of the present invention provide another information processing method, which is applied to a video encoder 21 of an electronic device. Figure 8 is a flowchart showing the implementation of the other information processing method according to embodiments of the present invention. As shown in Figure 8, the method includes the following steps S801 to S803.
[0089] In step S801, a chromaticity prediction is performed on the input source video data based on one of the prediction modes in the fourth mode combination to obtain a first prediction block. The fourth mode combination includes PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in which the number in the spatial prediction mode within a set of N components is less than or equal to the second numerical value and includes a planar prediction mode and a DC component prediction mode, and a prediction mode in which the number is greater than or equal to the third numerical value.
[0090] The second and third numerical values are generally preset mode index number values (i.e., the values of the aforementioned numbers). In a preferred embodiment, the spatial prediction modes within the N types of components are the spatial prediction modes within the 94 types of components shown in Figure 2C, with the second numerical value set to 10 and the third numerical value set to 58. That is, the fourth mode combination includes PDPC application modes of horizontal prediction mode, vertical prediction mode, prediction modes where the number in the spatial prediction mode within the 94 types of components is 10 or less, and prediction modes where the number is 58 or more. In other words, when chromaticity prediction is performed in all PDPC application modes, the chromaticity prediction values obtained by the PDPC method are not modified in any case.
[0091] In step S802, the difference between the chromaticity value in the block to be encoded and the chromaticity prediction value in the first prediction block is determined, and the residual block is obtained.
[0092] In step S803, the residual block and the prediction mode are written to the bitstream.
[0093] Furthermore, based on steps S801 to S803 described above, in other embodiments, the method further includes steps S401 to S403, or steps S501 to S503, or steps S601 to S603, or steps S701 to S703, or the following steps S901 to S903.
[0094] Furthermore, the video decoder may perform decoding steps corresponding to steps S801 to S803 above on the input bitstream, and a detailed explanation is omitted here. In other embodiments, the video decoder may further perform steps S414 to S417 above on the brightness prediction, or perform steps S911 to S913 of the embodiment below, or in other embodiments, the prediction mode in step S911 is one of the prediction modes in any one of the first to fourth mode combinations.
[0095] An embodiment of the present application provides another information processing method, which is applied to a video encoder 21 of an electronic device. Figure 9 is a flowchart of the implementation of another information processing method according to an embodiment of the present application. As shown in Figure 9A, the method is Step S901 involves predicting the luminance value in the encoding target block of the input source video data based on a pre-set prediction mode belonging to the PDPC application mode, and obtaining a first prediction block. Step S902 involves determining the difference between the luminance value in the block to be encoded and the luminance prediction value in the first prediction block, and obtaining the residual block. The process includes step S903 of writing the residual block and the prediction mode to a bitstream.
[0096] In the embodiments of this invention, when predicting the luminance value in a block to be encoded based on a prediction mode that is pre-set and belongs to the PDPC application mode, the luminance prediction value obtained by the PDPC method is not modified. In this way, the processing complexity of luminance prediction can be reduced.
[0097] Furthermore, in other embodiments, based on steps S901 to S903 described above, the method further includes steps S401 to S403, or steps S501 to S503, or steps S601 to S603, or steps S701 to S703, or steps S801 to S803 described in the above embodiments.
[0098] Embodiments of the present invention provide a further information processing method, which is applied to a video decoder 22 of an electronic device. Figure 9B is a flowchart illustrating the implementation of the further information processing method according to an embodiment of the present invention. As shown in Figure 9B, the method includes steps S911 to S913. In step S911, the brightness value in the bitstream to be decoded is predicted based on the prediction mode in the bitstream, and a second prediction block is obtained, wherein the prediction mode is preset and belongs to the PDPC application mode. In other embodiments, the prediction mode in step S911 is one of the prediction modes in any one of the first to fourth mode combinations. In step S912, the sum of the luminance difference in the residual block of the bitstream and the luminance prediction value in the second prediction block is determined, and the restored block is obtained. In step S913, the restored block is processed and the processed video data is output.
[0099] Embodiments of the present application provide another information processing method, which is applied to a video encoder 21 of an electronic device. Figure 10 is a flowchart illustrating the implementation of the other information processing method according to embodiments of the present application. As shown in Figure 10, the method is Step S101 involves performing a brightness prediction on the brightness value in the encoding target block of the source video data based on one prediction mode in any one of the first to fourth mode combinations, and obtaining a first prediction block. Step S102 involves determining the difference between the luminance value in the block to be encoded and the luminance prediction value in the first prediction block, and obtaining the residual block. The process includes step S103 of writing the residual block and the prediction mode to a bitstream.
[0100] Furthermore, in other embodiments, based on steps S101 to S103 described above, the method further includes steps S401 to S403, or steps S501 to S503, or steps S601 to S603, or steps S701 to S703, or steps S801 to S803 described in the above embodiments.
[0101] Embodiments of the present application provide another information processing method, which is applied to a video encoder 21 of an electronic device. Figure 11A is a flowchart of the implementation of another information processing method according to embodiments of the present application. As shown in Figure 11A, the method includes steps S1101 to S1104. In step S1101, the image components in the encoding target block of the input source video data are predicted based on the prediction mode, and a third prediction block is obtained, wherein the prediction mode is preset and belongs to the PDPC application mode. In other embodiments, the image component is a luminance value or a chromaticity value. In step S1102, the third prediction block is modified based on the prediction mode to obtain the third modification block. In step S1103, the difference between the image component in the encoding target block and the modified value in the third modification block is determined, and the residual block is obtained. In step S1104, the residual block and the prediction mode are written to the bitstream.
[0102] In other embodiments, step S1101 involves obtaining a third predicted block by predicting the image components in the source video data to be encoded based on the prediction mode, which includes obtaining a third predicted block by performing a chromaticity prediction on the chromaticity value in the code to be encoded based on any one of the prediction modes in the fifth mode combination, the fifth mode combination including PDPC application modes: a planar prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, a prediction mode whose number in the spatial prediction mode among the preset N components is a first numerical value, and a prediction mode whose number in the spatial prediction mode among the preset N components is a fourth numerical value.
[0103] In other embodiments, step S1101 involves predicting the image components in the source video data to be encoded based on the prediction mode to obtain a third predicted block. If all of conditions 1, 2, 3, and 4 are satisfied, the process includes predicting the image components in the target-to-encode block based on the prediction mode and obtaining a third predicted block. Situation 1 is when the block to be encoded is a luminance block and intra-subdivision is not used, or when the block to be encoded is a chromaticity block. Situation 2 is when the block to be encoded is a luminance block and is predicted using the 0th reference row, or when the block to be encoded is a chromaticity block, where the 0th reference row refers to the reference row closest to the block to be encoded. Situation 3 is that the block to be encoded is not encoded using block-based delta pulse code modulation (BDPCM), The aforementioned situation 4 is, The prediction mode is a horizontal prediction mode. The prediction mode is a vertical prediction mode. The prediction mode is a prediction mode in which the number in the spatial prediction mode among the N types of components set in advance is the first numerical value. The prediction mode is a prediction mode in which the number is the fourth numerical value. The prediction mode is a prediction mode in which the number is less than or equal to the second numerical value, and the block to be encoded is not a chromaticity block. The prediction mode satisfies one of the following conditions: the prediction mode is one in which the number is the third digit or greater, and the block to be encoded is not a chromaticity block.
[0104] In other embodiments, step S1101 involves obtaining a third predicted block by predicting the image components in the source video data to be encoded based on the prediction mode, which includes obtaining a third predicted block by performing a chromaticity prediction on the chromaticity value in the code to be encoded based on any one of the sixth mode combinations, the sixth mode combinations including PDPC application modes of planar prediction mode, DC component prediction mode, horizontal prediction mode and vertical prediction mode.
[0105] In other embodiments, step S1101 involves predicting the image components in the source video data to be encoded based on the prediction mode to obtain a third predicted block. If all of conditions 1, 2, 3, and 4 are satisfied, the process includes predicting the image components in the target-to-encode block based on the prediction mode and obtaining a third predicted block. Situation 1 is when the block to be encoded is a luminance block and intra-subdivision is not used, or when the block to be encoded is a chromaticity block. Situation 2 is when the block to be encoded is a luminance block and is predicted using the 0th reference row, or when the block to be encoded is a chromaticity block, where the 0th reference row refers to the reference row closest to the block to be encoded. Situation 3 is that the block to be encoded is not encoded using the BDPCM method. The aforementioned situation 4 is, The prediction mode is a planar prediction mode. The prediction mode is a DC component prediction mode. The prediction mode is a horizontal prediction mode. The prediction mode is a vertical prediction mode. The prediction mode is a prediction mode in which the number is less than or equal to the second numerical value, and the block to be encoded is not a chromaticity block. The prediction mode satisfies one of the following conditions: the prediction mode is one in which the number is the third digit or greater, and the block to be encoded is not a chromaticity block.
[0106] In other embodiments, step S1101 involves obtaining a third predicted block by predicting the image components in the source video data to be encoded based on the prediction mode, which includes obtaining a third predicted block by performing a chromaticity prediction on the chromaticity values in the code to be encoded based on any one of the seventh mode combinations, the seventh mode combination including the PDPC application modes of the planar prediction mode and the DC component prediction mode.
[0107] In other embodiments, step S1101 involves predicting the image components in the source video data to be encoded based on the prediction mode to obtain a third predicted block. If all of conditions 1, 2, 3, and 4 are satisfied, the process includes predicting the image components in the target-to-encode block based on the prediction mode and obtaining a third predicted block. Situation 1 is when the block to be encoded is a luminance block and intra-subdivision is not used, or when the block to be encoded is a chromaticity block. Situation 2 is when the block to be encoded is a luminance block and is predicted using the 0th reference row, or when the block to be encoded is a chromaticity block, where the 0th reference row refers to the reference row closest to the block to be encoded. Situation 3 is that the block to be encoded is not encoded using the BDPCM method. The aforementioned situation 4 is, The prediction mode is a planar prediction mode. The prediction mode is a DC component prediction mode. The prediction mode is a horizontal prediction mode and the block to be encoded is not a chromaticity block. The prediction mode is a vertical prediction mode and the block to be encoded is not a chromaticity block, The prediction mode is a prediction mode in which the number is less than or equal to the second numerical value and the block to be encoded is not a chromaticity block, The prediction mode satisfies one of the following conditions: the prediction mode is one in which the number is the third digit or greater, and the block to be encoded is not a chromaticity block.
[0108] In other embodiments, step S1101 involves predicting the image components in the source video data to be encoded based on the prediction mode to obtain a third predicted block. If all of conditions 1, 2, 3, and 4 are satisfied, the process includes predicting the image components in the target-to-encode block based on the prediction mode and obtaining a third predicted block. Situation 1 is that the block to be encoded is a luminance block and intra-subdivision is not used. Situation 2 is that the block to be encoded is a luminance block and prediction is made using the 0th reference row, where the 0th reference row refers to the reference row closest to the block to be encoded. Situation 3 is that the block to be encoded is not encoded using the BDPCM method. The aforementioned situation 4 is, The prediction mode is a planar prediction mode. The prediction mode is a DC component prediction mode. The prediction mode is a horizontal prediction mode. The prediction mode is a vertical prediction mode. The prediction mode is a prediction mode in which the number is less than or equal to the second numerical value. The prediction mode satisfies one of the following conditions: the prediction mode is a prediction mode in which the number is the third digit or greater.
[0109] Embodiments of the present invention provide a further information processing method, which is applied to a video decoder 22 of an electronic device. Figure 11B is a flowchart illustrating the implementation of the further information processing method according to an embodiment of the present invention. As shown in Figure 11B, the method includes steps S1121 to S1124. In step S1121, the image components in the bitstream to be decoded are predicted based on the prediction mode in the bitstream, and a fourth prediction block is obtained, wherein the prediction mode is preset and belongs to the PDPC application mode. In other embodiments, the image component is a chromaticity value or a luminance value. In step S1122, the fourth prediction block is modified based on the prediction mode to obtain the fourth modification block. In step S1123, the sum of the difference in the residual block in the bitstream and the correction value in the fourth correction block is determined, and the restored block is obtained. In step S1124, the restored block is processed and the processed video data is output.
[0110] In VTM5.0, the PDPC method is simultaneously applied to the planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode in the luminance block and chromaticity block prediction modes, and to the angle prediction mode with a number of 10 or less and the angle prediction mode with a number of 58 or more in the spatial prediction mode within the 94 types of components. That is, after predicting the current block using these prediction modes, the predicted values obtained by the prediction are corrected using the PDPC method.
[0111] According to the provisions of VTM5.0, if all of conditions (101), (102), (103), and (104) are met, the PDPC method shall be used. Situation (101) is when intra-sub-partitions (ISP) are not used when the current block is a luminance block, or when the current block is a chromaticity block. Situation (102) is when the current block is a luminance block and the prediction is made using the 0th reference row, or when the current block is a chromaticity block, where the 0th reference row refers to the reference row closest to the current block. Situation (103) is that the block is not currently encoded using the Block-based Delta Pulse Code Modulation (BDPCM) method. Situation (104) satisfies one of the following conditions: the prediction mode is a planar prediction mode, the prediction mode is a DC component prediction mode, the prediction mode is a horizontal prediction mode, the prediction mode is a vertical prediction mode, the prediction mode is an angle prediction mode with a number of 10 or less, or the prediction mode is an angle prediction mode with a number of 58 or more.
[0112] However, improving encoding and decoding performance using the PDPC method is based on saving encoding bits and sacrificing chromaticity performance. Since luminance and chromaticity reflect different image content, PDPC technology cannot simultaneously improve luminance and chromaticity performance, and the same PDPC method should not be used for both luminance and chromaticity.
[0113] Based on this, the details of the above embodiment will be described below with reference to several preferred embodiments.
[0114] Embodiments of this application provide a method for modifying the PDPC application mode, reducing the chromaticity prediction mode that uses PDPC, thereby reducing time complexity and improving chromaticity coding performance. For ease of understanding, this is described in detail below.
[0115] The PDPC application modes in related technologies are similar for luminance and chromaticity, and all utilize the following modes: planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, angle prediction mode with a number of 10 or less, or angle prediction mode with a number of 58 or more.
[0116] In the embodiments of the present invention, when performing chromaticity prediction for the current block using one of the following prediction modes: a prediction mode in which the spatial prediction mode number among the 94 components shown in Figure 2C is 10 or less and does not include the planar prediction mode or the DC component prediction mode, or a prediction mode in which the number is 58 or more, the chromaticity prediction value obtained by the PDPC method is modified so as not to be modified. In other words, when performing chromaticity prediction for the current block, the chromaticity prediction modes for which PDPC is used are reduced to using PDPC only for the planar prediction mode, DC component prediction mode, horizontal prediction mode, or vertical prediction mode. When performing luminance prediction for the current block, the luminance prediction modes for which PDPC is used remain the planar prediction mode, DC component prediction mode, horizontal prediction mode, vertical prediction mode, angle prediction mode in which the spatial prediction mode number among the 94 components is 10 or less, and angle prediction mode in which the number is 58 or more. That is, the luminance prediction modes for which PDPC is used do not change.
[0117] Accordingly, the grammatical meaning in VTM5.0 is modified, and the mode that applies PDPC is restricted to using PDPC only when all of the following conditions are met: (201), (202), (203), and (204). Situation (201) is when ISP partitioning is not used when the current block is a luminance block, or when the current block is a chromaticity block. Situation (202) is when the current block is a luminance block and the 0th reference row is used for prediction, or when the current block is a chromaticity block. Situation (203) is that the current block is not encoded in the BDPCM method, and Situation (204) is that one of the following conditions is satisfied: the prediction mode is a planar prediction mode, the prediction mode is a DC component prediction mode, the prediction mode is a horizontal prediction mode, the prediction mode is a vertical prediction mode, the prediction mode is an angle prediction mode with a number of 10 or less and the current block is not a chromaticity block, or the prediction mode is an angle prediction mode with a number of 58 or more and the current block is not a chromaticity block.
[0118] The method for modifying the PDPC application mode according to the embodiment of this application can obtain the following beneficial effects without affecting performance in any way.
[0119] In the first embodiment, chromaticity coding performance can be improved without fundamentally affecting luminance coding performance. According to experimental data, the Y component performance decreased by 0.03%, the U component performance improved by 0.16%, and the V component performance improved by 0.14%. As can be seen from the above, the Y component performance remained basically unchanged, while the improvements in U component performance and V component performance were significant.
[0120] In the second embodiment, complexity can be reduced. There are relatively many application scenarios for PDPC in related technologies. By using the method according to the embodiment of the present invention, the number of chromaticity prediction modes using PDPC can be reduced to four, thereby reducing processing complexity and ultimately significantly shortening the decoding time.
[0121] The protection point of the embodiments of this application is to modify the usage scenarios of PDPC during chromaticity prediction. Whether the main embodiment uses PDPC only for the planar prediction mode, DC component prediction mode, horizontal prediction mode, and vertical prediction mode in the chromaticity prediction mode, or whether the alternative embodiment prohibits the use of PDPC for some chromaticity prediction modes, the aim is to reduce the number of prediction modes that apply PDPC in chromaticity prediction, thereby reducing the complexity of the algorithm and improving the chromaticity coding performance. The alternative embodiments mainly include the embodiments described below.
[0122] Alternative Embodiment 1 When performing chromaticity prediction for the current block using any one of the following prediction modes: horizontal prediction mode, vertical prediction mode, prediction mode where the spatial prediction mode number in the 94 components shown in Figure 2C is 10 or less, and prediction mode where the number is 58 or more, the chromaticity prediction value obtained by the PDPC method is modified so as not to be corrected. In other words, the use of PDPC is prohibited for all chromaticity prediction modes, and when performing luminance prediction for the current block, the luminance prediction mode that uses PDPC does not change.
[0123] Accordingly, the grammatical meaning in VTM5.0 has been modified to use PDPC if all of the following conditions are met: (301), (302), (303), (304), and (305). Situation (301) is that the block is currently a luminance block. Situation (302) is that the block currently does not use ISP segmentation. Situation (303) is that the current block is predicting using the 0th reference row, Situation (304) is that the current block is not encoded in the BDPCM method, and Situation (305) is that one of the following conditions is satisfied: the prediction mode is a planar prediction mode, the prediction mode is a DC component prediction mode, the prediction mode is a horizontal prediction mode, the prediction mode is a vertical prediction mode, the prediction mode is an angle prediction mode with a number of 10 or less, or the prediction mode is an angle prediction mode with a number of 58 or more.
[0124] Alternative Embodiment 2 When performing chromaticity prediction for the current block using one of the following prediction modes: horizontal prediction mode, vertical prediction mode, a prediction mode in which the number in the spatial prediction mode among the 94 types of components is 10 or less and does not include the planar prediction mode or the DC component prediction mode, or a prediction mode in which the number is 58 or more, the chromaticity prediction value obtained by the PDPC method is modified so as not to be altered. In other words, when performing chromaticity prediction, PDPC is used only in the planar prediction mode and the DC component prediction mode, and when performing luminance prediction for the current block, the luminance prediction mode in which PDPC is used does not change.
[0125] Accordingly, the grammatical meaning in VTM5.0 has been modified to use PDPC if all of the following conditions are met: (401), (402), (403), and (404). Situation (401) is when ISP partitioning is not used when the current block is a luminance block, or when the current block is a chromaticity block. Situation (402) is when the current block is a luminance block and the 0th reference row is used for prediction, or when the current block is a chromaticity block. Situation (403) is that the current block is not encoded in the BDPCM method, and Situation (404) is that one of the following conditions is satisfied: the prediction mode is a planar prediction mode, the prediction mode is a DC component prediction mode, the prediction mode is a horizontal prediction mode and the current block is not a chromaticity block, the prediction mode is a vertical prediction mode and the current block is not a chromaticity block, the prediction mode is an angle prediction mode with a number of 10 or less and the current block is not a chromaticity block, or the prediction mode is an angle prediction mode with a number of 58 or more and the current block is not a chromaticity block.
[0126] Alternative Embodiment 3 When performing chromaticity prediction for the current block using one of the following prediction modes: a prediction mode in which the spatial prediction mode number within the 94 components is less than 2 and does not include the planar prediction mode or the DC component prediction mode; a prediction mode in which the number is greater than 2 and 10 or less; a prediction mode in which the number is 58 or greater and less than 66; and a prediction mode in which the number is greater than 66, the chromaticity prediction value obtained by the PDPC method is modified in such a way that it is not modified. In other words, when performing luminance prediction for the current block using PDPC in only one of the following prediction modes: the planar prediction mode, the DC component prediction mode, the horizontal prediction mode, the vertical prediction mode, the prediction mode with a number of 2, and the prediction mode with a number of 66, the luminance prediction mode using PDPC does not change.
[0127] Accordingly, the grammatical meaning in VTM5.0 has been modified to use PDPC when all of the following conditions are met: (501), (502), (503), and (504). Situation (501) is when ISP partitioning is not used when the current block is a luminance block, or when the current block is a chromaticity block. Situation (502) is when the current block is a luminance block and the 0th reference row is used for prediction, or when the current block is a chromaticity block. Situation (503) is that the current block is not encoded in the BDPCM method, and Situation (504) is that one of the following conditions is satisfied: the prediction mode is a planar prediction mode, the prediction mode is a DC component prediction mode, the prediction mode is a horizontal prediction mode, the prediction mode is a vertical prediction mode, the prediction mode is a prediction mode with number 2, the prediction mode is a prediction mode with number 66, the prediction mode is an angle prediction mode with number 10 or less and the current block is not a chromaticity block, or the prediction mode is an angle prediction mode with number 58 or more and the current block is not a chromaticity block.
[0128] Alternative Embodiment 4 When performing chromaticity and luminance predictions for the current block using one of the following prediction modes within the 94 components: a prediction mode whose spatial prediction mode number is 10 or less and greater than 8, and a prediction mode whose number is 58 or greater and less than 60, the chromaticity and luminance prediction values obtained by the PDPC method are modified so as not to be altered. In other words, the luminance and chromaticity prediction modes using PDPC are simultaneously reduced.
[0129] Accordingly, the grammatical meaning in VTM5.0 has been modified to use PDPC if all of the following conditions are met: (601), (602), (603), and (604). Situation (601) is when ISP partitioning is not used when the current block is a luminance block, or when the current block is a chromaticity block. Situation (602) is when the current block is a luminance block and the 0th reference row is used for prediction, or when the current block is a chromaticity block. Situation (603) is that the current block is not encoded in the BDPCM method, and Situation (604) is that one of the following conditions is satisfied: the prediction mode is a planar prediction mode, the prediction mode is a DC component prediction mode, the prediction mode is a horizontal prediction mode, the prediction mode is a vertical prediction mode, the prediction mode is an angle prediction mode with a number of 8 or less, or the prediction mode is an angle prediction mode with a number of 60 or more.
[0130] Based on the above embodiment, the embodiment of the present application provides an information processing device in which each module and each unit included in the device may be implemented by an electronic processor, or, of course, by a specific logic circuit. In the implementation, the processor may be a central processing unit (CPU), a microprocessor (MPU), a digital signal processor (DSP), or a field-programmable gate array (FPGA), etc.
[0131] Figure 12A is a schematic diagram of the structure of an information processing device according to an embodiment of the present invention. As shown in Figure 12A, the information processing device 120 is A prediction module 121 is configured to predict the image components in the encoding target block of the input source video data based on a prediction mode and to acquire a first prediction block, wherein the prediction mode is pre-set and belongs to the PDPC application mode. The system includes a residual determination module 122 configured to determine the difference between the image components in the encoding target block and the predicted values in the first prediction block, and to acquire a residual block; and a writing module 123 configured to write the residual block and the prediction mode to a bitstream.
[0132] In other embodiments, the image component is a luminance value or a chromaticity value.
[0133] In another embodiment, as shown in Figure 12B, the prediction module 121 includes a chromaticity prediction unit 1210. The chromaticity prediction unit 1210 is configured to perform chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the first mode combination, and to obtain a first prediction block. The first mode combination includes PDPC application modes such as: a prediction mode in which the number in the spatial prediction mode within a preset N types of components is less than a first numerical value and does not include the planar prediction mode or the DC component prediction mode; a prediction mode in which the number is greater than the first numerical value and less than or equal to the second numerical value; a prediction mode in which the number is greater than or equal to the third numerical value and less than the fourth numerical value; and a prediction mode in which the number is greater than the fourth numerical value.
[0134] In other embodiments, the chromaticity prediction unit 1210 is configured to perform chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the second mode combination to obtain the first prediction block. The second mode combination includes PDPC application modes: a prediction mode in which the number in the spatial prediction mode within a preset N types of components is less than or equal to the second numerical value and does not include the planar prediction mode or the DC component prediction mode; and a prediction mode in which the number is greater than or equal to the third numerical value.
[0135] In other embodiments, the chromaticity prediction unit 1210 is configured to perform chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the third mode combination to obtain a first prediction block. The third mode combination includes PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in which the number in the spatial prediction mode within a preset N types of components is less than or equal to the second numerical value and does not include the planar prediction mode or the DC component prediction mode, and a prediction mode in which the number is greater than or equal to the third numerical value.
[0136] In other embodiments, the chromaticity prediction unit 1210 is configured to perform chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the fourth mode combination to obtain a first prediction block. The fourth mode combination includes PDPC application modes: a vertical prediction mode, a prediction mode in which the number in the spatial prediction mode within a preset N types of components is less than or equal to the second numerical value and which includes a planar prediction mode and a DC component prediction mode, and a prediction mode in which the number is greater than or equal to the third numerical value.
[0137] In another embodiment, as shown in Figure 12B, the prediction module 121 further comprises a luminance prediction unit 1212. The luminance prediction unit 1212 is configured to perform a luminance prediction on the luminance value in the encoding target block based on any one prediction mode in any one of the first to fourth mode combinations, and to obtain a first prediction block.
[0138] The embodiments of this application provide other information processing devices, and Figure 13 is a schematic diagram of the structure of other information processing devices according to embodiments of this application. As shown in Figure 13, the information processing device 130 is A prediction module 131 is configured to predict the image components in the bitstream to be decoded based on the prediction mode in the input bitstream, and to acquire a second prediction block, wherein the prediction mode is pre-set and belongs to the PDPC application mode, A recovery module 132 is configured to determine the sum of the difference in the residual block in the bitstream and the predicted value in the second prediction block, and to obtain a recovery block. The system includes a video output module 133 configured to process the aforementioned restoration block and output the processed video data.
[0139] In other embodiments, the image component is a chromaticity value or a luminance value.
[0140] In other embodiments, the prediction mode is any one of the prediction modes in the first mode combination. The first mode combination includes PDPC application modes: a prediction mode in which the number in the spatial prediction mode within a preset N types of components is less than a first numerical value and does not include the planar prediction mode or the DC component prediction mode; a prediction mode in which the number is greater than the first numerical value and less than or equal to the second numerical value; a prediction mode in which the number is greater than or equal to the third numerical value and less than the fourth numerical value; and a prediction mode in which the number is greater than the fourth numerical value.
[0141] In other embodiments, the prediction mode is any one of the prediction modes in the second mode combination. The second mode combination includes PDPC application modes: prediction modes in which the number in the spatial prediction mode among the preset N components is less than or equal to the second numerical value and does not include the planar prediction mode or the DC component prediction mode; and prediction modes in which the number is greater than or equal to the third numerical value.
[0142] In other embodiments, the prediction mode is any one of the prediction modes in the third mode combination. The third mode combination includes PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in which the number in the spatial prediction mode within a preset N types of components is less than or equal to the second numerical value and does not include the planar prediction mode or the DC component prediction mode, and a prediction mode in which the number is greater than or equal to the third numerical value.
[0143] In other embodiments, the prediction mode is any one of the prediction modes in the fourth mode combination. The fourth mode combination includes PDPC application modes: a horizontal prediction mode, a vertical prediction mode, a prediction mode in which the number in the spatial prediction mode within a preset N types of components is 2 or less and includes a planar prediction mode and a DC component prediction mode, and a prediction mode in which the number is 3 or greater.
[0144] The embodiment of the present application provides another information processing device, and Figure 14 is a schematic diagram of the structure of another information processing device according to the embodiment of the present application. As shown in Figure 14, the information processing device 140 is A prediction module 1401 is configured to predict the image components in the encoding target block of the source video data based on a prediction mode, and to acquire a third prediction block, wherein the prediction mode is pre-set and belongs to the PDPC application mode. A modification module 1402 is configured to modify the third prediction block based on the prediction mode and obtain a third modification block, A residual determination module 1403 is configured to determine the difference between the image component in the encoding target block and the correction value in the third correction block, and to obtain a residual block. The system includes a writing module 1404 configured to write the residual block and the prediction mode to a bitstream.
[0145] In other embodiments, the image component is a luminance value or a chromaticity value.
[0146] In other embodiments, the prediction module 1401 is configured to perform chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the fifth mode combination to obtain the third prediction block. The fifth mode combination includes PDPC application modes: a planar prediction mode, a DC component prediction mode, a horizontal prediction mode, a vertical prediction mode, a prediction mode whose number in the spatial prediction mode within a preset N components is a first numerical value, and a prediction mode whose number in the spatial prediction mode within a preset N components is a fourth numerical value.
[0147] In other embodiments, the prediction module 1401 is configured to predict the image components in the target-to-encode block based on the prediction mode and obtain a third prediction block if all conditions 1, 2, 3, and 4 are satisfied. Situation 1 is when the block to be encoded is a luminance block and intra-subdivision is not used, or when the block to be encoded is a chromaticity block. Situation 2 is when the block to be encoded is a luminance block and is predicted using the 0th reference row, or when the block to be encoded is a chromaticity block, where the 0th reference row refers to the reference row closest to the block to be encoded. Situation 3 is that the block to be encoded is not encoded using block-based delta pulse code modulation (BDPCM), The aforementioned situation 4 is, The prediction mode is a horizontal prediction mode. The prediction mode is a vertical prediction mode. The prediction mode is a prediction mode in which the number in the spatial prediction mode among the N types of components set in advance is the first numerical value. The prediction mode is a prediction mode in which the number is the fourth numerical value. The prediction mode is a prediction mode in which the number is less than or equal to the second numerical value, and the block to be encoded is not a chromaticity block. The prediction mode satisfies one of the following conditions: the prediction mode is one in which the number is the third digit or greater, and the block to be encoded is not a chromaticity block.
[0148] In other embodiments, the prediction module 1401 is configured to perform chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the sixth mode combination to obtain the third prediction block. The sixth mode combination includes PDPC application modes of planar prediction mode, DC component prediction mode, horizontal prediction mode, and vertical prediction mode.
[0149] In other embodiments, the prediction module 1401 is configured to predict the image components in the target-to-encode block based on the prediction mode and obtain a third prediction block if all conditions 1, 2, 3, and 4 are satisfied. Situation 1 is when the block to be encoded is a luminance block and intra-subdivision is not used, or when the block to be encoded is a chromaticity block. Situation 2 is when the block to be encoded is a luminance block and is predicted using the 0th reference row, or when the block to be encoded is a chromaticity block, where the 0th reference row refers to the reference row closest to the block to be encoded. Situation 3 is that the block to be encoded is not encoded using the BDPCM method. The aforementioned situation 4 is, The prediction mode is a planar prediction mode. The prediction mode is a DC component prediction mode. The prediction mode is a horizontal prediction mode. The prediction mode is a vertical prediction mode. The prediction mode is a prediction mode in which the number is less than or equal to the second numerical value, and the block to be encoded is not a chromaticity block. The prediction mode satisfies one of the following conditions: the prediction mode is one in which the number is the third digit or greater, and the block to be encoded is not a chromaticity block.
[0150] In other embodiments, the prediction module 1401 is configured to perform chromaticity prediction on the chromaticity value in the target-to-encode block based on any one prediction mode in the seventh mode combination to obtain a third prediction block. The seventh mode combination includes PDPC application modes of planar prediction mode and DC component prediction mode.
[0151] In other embodiments, the prediction module 1401 is configured to predict the image components in the target-to-encode block based on the prediction mode and obtain a third prediction block if all conditions 1, 2, 3, and 4 are satisfied. Situation 1 is when the block to be encoded is a luminance block and intra-subdivision is not used, or when the block to be encoded is a chromaticity block. Situation 2 is when the block to be encoded is a luminance block and is predicted using the 0th reference row, or when the block to be encoded is a chromaticity block, where the 0th reference row refers to the reference row closest to the block to be encoded. Situation 3 is that the block to be encoded is not encoded using the BDPCM method. The aforementioned situation 4 is, The prediction mode is a planar prediction mode. The prediction mode is a DC component prediction mode. The prediction mode is a horizontal prediction mode and the block to be encoded is not a chromaticity block. The prediction mode is a vertical prediction mode and the block to be encoded is not a chromaticity block. The prediction mode is a prediction mode in which the number is less than or equal to the second numerical value, and the block to be encoded is not a chromaticity block. The prediction mode satisfies one of the following conditions: the prediction mode is one in which the number is the third digit or greater, and the block to be encoded is not a chromaticity block.
[0152] In other embodiments, the prediction module 1401 is configured to predict the image components in the target-to-encode block based on the prediction mode and obtain a third prediction block if all conditions 1, 2, 3, and 4 are satisfied. Situation 1 is that the block to be encoded is a luminance block and intra-subdivision is not used. Situation 2 is that the block to be encoded is a luminance block and prediction is made using the 0th reference row, where the 0th reference row refers to the reference row closest to the block to be encoded. Situation 3 is that the block to be encoded is not encoded using the BDPCM method. The aforementioned situation 4 is, The prediction mode is a planar prediction mode. The prediction mode is a DC component prediction mode. The prediction mode is a horizontal prediction mode. The prediction mode is a vertical prediction mode. The prediction mode is a prediction mode in which the number is less than or equal to the second numerical value. The prediction mode satisfies one of the following conditions: the prediction mode is a prediction mode in which the number is the third digit or greater.
[0153] The embodiments of the present application provide further information processing devices, and Figure 15 is a schematic diagram of the structure of another information processing device according to the embodiments of the present application. As shown in Figure 15, the information processing device 150 is A prediction module 1501 is configured to predict the image components in the bitstream to be decoded based on the prediction mode in the bitstream, and to acquire a fourth prediction block, wherein the prediction mode is pre-set and belongs to the PDPC application mode. A modification module 1502 is configured to modify the fourth prediction block based on the prediction mode and obtain a fourth modification block, A recovery module 1503 is configured to determine the sum of the difference in the residual block in the bitstream and the correction value in the fourth correction block, and to obtain a recovery block. The system includes a video output module 1504 configured to process the restoration block and output the processed video data.
[0154] In other embodiments, the image component is a chromaticity value or a luminance value.
[0155] The description of the apparatus embodiment described above is similar to the description of the method embodiment described above and has similar beneficial effects. Technical details not described in the apparatus embodiment of this application may be understood by referring to the description of the method embodiment of this application.
[0156] In the embodiments of this application, the above information processing method is implemented in the form of a software function module and may be stored on a single computer-readable storage medium when sold or used as an independent product. Based on this understanding, the essential or prior art-contributing parts of the technical solutions of the embodiments of this application may be embodied in the form of a software product. The computer software product is stored on a single storage medium containing several instructions for causing an electronic device (which may be a mobile phone, tablet computer, e-reader, unmanned aerial vehicle, wearable device (e.g., smart glasses), robotic vacuum cleaner, personal computer, car navigation system, video phone, television, server, etc.) to execute all or part of the methods described in each embodiment of this application. The storage medium includes various media capable of storing program code, such as USB memory, portable hard disk, read-only memory (ROM), magnetic disk, or optical disk. Thus, the embodiments of this application are not limited to any specific combination of hardware and software.
[0157] Accordingly, the embodiment of the present application provides an electronic device, and Figure 16 is a schematic diagram of the hardware entity of the electronic device according to the embodiment of the present application. As shown in Figure 16, the electronic device 160 comprises a memory 161 and a processor 162, the memory 161 stores a computer program that can be executed by the processor 162, and the processor 162 implements the steps of the information processing method according to the embodiment when executing the program.
[0158] Furthermore, the memory 161 is configured to store instructions and applications that can be executed by the processor 162, and can also buffer data to be processed or processed by each module of the processor 162 and the electronic device 160 (e.g., image data, audio data, audio communication data, and video communication data), and can be implemented using flash memory (FLASH) or random access memory (RAM).
[0159] Embodiments of the present invention provide a computer-readable storage medium on which a computer program is stored, and which, when executed by a processor, realizes the steps in the information processing method according to the above embodiment.
[0160] The above description of the storage medium and apparatus embodiments is similar to the description of the method embodiments and has similar beneficial effects. Technical details not described in the storage medium and apparatus embodiments of this application may be understood by referring to the description of the method embodiments of this application.
[0161] To be understood, the phrase "one embodiment" or "one example" as used throughout the specification means that a particular feature, structure, or characteristic relating to the embodiment is included in at least one embodiment of the Application. Therefore, "in one embodiment" or "in one example" appearing elsewhere in the specification does not necessarily refer to the same embodiment. Furthermore, these particular features, structures, or characteristics may be combined in one or more embodiments in any appropriate manner. To be understood, in the various embodiments of the Application, the numbering of the processes described above does not indicate the order of execution, and the order of execution of each process should be determined by its function and internal logic, and is not intended to limit the execution of the embodiments of the Application. The numbering of the embodiments of the Application described above is for illustrative purposes only and does not represent any superiority or inferiority of the embodiments.
[0162] In this specification, the terms “equipment,” “include,” or any other variation thereof are intended to include non-exclusive inclusion, so that a process, method, article, or apparatus that includes a set of elements includes not only those elements but also other elements not explicitly listed, or further elements specific to such process, method, article, or apparatus. Unless more restrictive, an element limited by the phrase “includes XX” does not preclude the existence of other identical elements in a process, method, article, or apparatus that includes such element.
[0163] As can be understood in some embodiments relating to this application, the disclosed apparatus and methods may be implemented in other ways. The apparatus embodiments described above are schematic, and for example, the distinctions between the units are merely logical functional distinctions, and in actual implementation, other methods of distinction may exist, for example, multiple units or components may be coupled or integrated into other systems, or some features may be omitted or not performed. Furthermore, the coupling, direct coupling, or communication connection between each component shown or considered may be an indirect coupling or communication connection by some interface, apparatus, or unit, and may be in electrical, mechanical, or other forms.
[0164] The units described as separation members may or may not be physically separated, and the members shown as units may or may not be physical units; that is, they may be located in one place or arranged in multiple network units. Depending on the actual needs, some or all of the units may be selected to achieve the objectives of this embodiment.
[0165] Furthermore, in each embodiment of the present invention, each functional unit may be integrated into a single processing unit, each unit may be an independent unit, or two or more units may be integrated into a single unit. The integrated unit may be implemented in hardware form, or in the form of a hardware plus software functional unit.
[0166] As those skilled in the art will understand, all or some of the steps to implement the above method embodiment may be performed by hardware associated with program instructions, and the program may be stored in a computer-readable storage medium, which executes the steps including the above method embodiment at runtime. The storage medium includes various media capable of storing program code, such as mobile storage devices, read-only memory (ROM), magnetic disks, or optical disks.
[0167] Alternatively, the integrated unit described above in the present application may be implemented in the form of a software function module and, when sold or used as an independent product, may be stored on a single computer-readable storage medium. Based on this understanding, the essential or prior art contributions of the inventions of the present application may be embodied in the form of a software product, which is stored on a single storage medium containing some instructions for causing a single electronic device (which may be a mobile phone, tablet computer, e-reader, unmanned aerial vehicle, wearable device (e.g., smart glasses), robotic vacuum cleaner, personal computer, car navigation system, video phone, television, server, etc.) to perform all or part of the methods described in each embodiment of the present application. The storage medium may include various media capable of storing program code, such as mobile storage devices, ROMs, magnetic disks, or optical disks.
[0168] The methods disclosed in some of the method embodiments of this application can be arbitrarily combined to obtain new method embodiments, as long as they do not conflict with each other.
[0169] The features disclosed in some product embodiments relating to this application can be arbitrarily combined to obtain new product embodiments, as long as they do not conflict.
[0170] The features disclosed in some of the method or equipment embodiments relating to this application can be arbitrarily combined to obtain new method or equipment embodiments, provided they do not conflict.
[0171] The above description is merely an embodiment of the present application and is not intended to limit the scope of protection. Any modifications or substitutions that a person skilled in the art could easily conceive within the technical scope disclosed herein should be included within the scope of protection. Therefore, the scope of protection should be the same as the claims. [Industrial applicability]
[0172] In the embodiment of this invention, based on a pre-set prediction mode belonging to the PDPC application mode, the image components in the blocks to be encoded in the input source video data are predicted, and a first prediction block is obtained. Then, without modifying each predicted value in the first prediction block, the difference between the predicted value in the first prediction block and the image components in the blocks to be encoded is directly determined. In this way, the complexity of the intra-prediction process can be reduced while ensuring the video encoding and decoding performance.
Claims
1. An information processing method applied to a decoder, The process involves decoding a stream to obtain a prediction mode, predicting the image components of the block to be decoded based on the prediction mode to obtain a third prediction block, wherein the prediction mode is a preset mode that can modify the third prediction block using a position-dependent prediction combination (PDPC), and the image component is a chromaticity component. If both Situation 1 and Situation 2 are satisfied, the image components in the target block to be decoded are predicted based on the prediction mode, and a third predicted block is obtained. Situation 1 is that the block to be decoded is not encoded using a block-based delta pulse code modulation (BDPCM) method. The aforementioned situation 2 is, The prediction mode is a prediction mode whose number is 2 in the spatial prediction modes among the N types of components set in advance. The prediction mode is the prediction mode in which the number is 66. It is that one of the following conditions is satisfied, Based on the prediction mode, the third prediction block is modified to obtain the third modified block, An information processing method comprising: decoding a stream to obtain the sum of the residual block and the third modified block, and obtaining a restored block.
2. An information processing method applied to an encoder, The method involves predicting the image components of a block to be encoded based on a prediction mode to obtain a third predicted block, wherein the prediction mode is a preset mode that can modify the third predicted block using a position-dependent prediction combination (PDPC), and the image component is a chromaticity component. If both Situation 1 and Situation 2 are satisfied, the image components in the target encoding block are predicted based on the prediction mode, and a third predicted block is obtained. Situation 1 is that the block to be encoded is not encoded using a block-based delta pulse code modulation (BDPCM) method. The aforementioned situation 2 is, The prediction mode is a prediction mode whose number is 2 in the spatial prediction modes among the N types of components set in advance. The prediction mode is the prediction mode in which the number is 66. It is that one of the following conditions is satisfied, Based on the prediction mode, the third prediction block is modified to obtain the third modified block, The difference between the aforementioned block to be encoded and the aforementioned third modified block is determined, and the residual block is obtained. An information processing method comprising writing the residual block and the prediction mode to a stream.
3. A video decoding device comprising a prediction module, a correction module, and a restoration module, The prediction module is configured to decode a stream to obtain a prediction mode, predict the image components of the block to be decoded based on the prediction mode to obtain a third prediction block, wherein the prediction mode is a preset mode and can modify the third prediction block using a position-dependent prediction combination (PDPC), and the image components are chromaticity components. The prediction module is further configured to predict the image components in the target block for decoding based on the prediction mode and acquire a third prediction block when both conditions 1 and 2 are satisfied. Situation 1 is that the block to be decoded is not encoded using a block-based delta pulse code modulation (BDPCM) method. The aforementioned situation 2 is, The prediction mode is a prediction mode whose number is 2 in the spatial prediction modes among the N types of components set in advance. The prediction mode is the prediction mode in which the number is 66. Satisfying any one of the following conditions: The modification module is configured to modify the third prediction block based on the prediction mode to obtain the third modification block. The recovery module is configured to decode the stream to obtain the sum of the residual block and the third modified block, and to obtain the recovered block, in a video decoding device.
4. A video encoding device comprising a prediction module, a correction module, a residual determination module, and a write module, The prediction module is configured to decode a stream to obtain a prediction mode, predict the image components of the block to be encoded based on the prediction mode to obtain a third prediction block, wherein the prediction mode is a preset mode and can modify the third prediction block using a position-dependent prediction combination (PDPC), and the image components are either luminance components or chromaticity components. The prediction module is further configured to predict the image components in the target-to-encode block based on the prediction mode and obtain a third prediction block when both conditions 1 and 2 are satisfied. Situation 1 is that the block to be encoded is not encoded using a block-based delta pulse code modulation (BDPCM) method. The aforementioned situation 2 is, The prediction mode is such that the number in the spatial prediction mode among the N types of components set in advance is 2. The prediction mode is the prediction mode in which the number is 66. Satisfying any one of the following conditions: The modification module is configured to modify the third prediction block based on the prediction mode to obtain the third modification block. The residual determination module is configured to determine the difference between the encoding target block and the third modification block, and to obtain the residual block. The writing module is a video encoding device configured to write the residual block and the prediction mode to a stream.
5. An electronic device comprising memory and a processor, The memory stores a computer program that can be executed by the processor, and the processor, when executing the program, realizes the steps in the information processing method described in claim 1.
6. A computer-readable storage medium, A computer-readable storage medium that stores a computer program and a bitstream, wherein the computer program causes a processor to execute the information processing method described in claim 1 to decode the bitstream.
7. An electronic device comprising memory and a processor, The memory stores a computer program that can be executed by the processor, and the processor, when executing the program, realizes the steps in the information processing method described in claim 2.
8. A computer-readable storage medium, A computer-readable storage medium that stores a computer program and a bitstream, wherein the computer program causes a processor to execute the information processing method described in claim 2 to generate the bitstream.