Chroma component prediction method, chroma component prediction device, terminal, readable storage medium, chip, computer program product, and electronic device
By fitting chroma reconstruction, prediction, and luminance values to obtain model parameters, the method improves the accuracy of chroma component prediction, addressing the limitations of existing weight combinations in chroma fusion processes.
Patent Information
- Application Number
- JP2025521424
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-10-13
- Filing Date
- 2023-10-08
- Publication Date
- 2025-10-03
AI Technical Summary
The accuracy of chroma prediction values in existing methods is limited due to constraints on the number of weight combinations used in chroma component fusion.
A method that involves fitting a first chroma reconstruction value, a first chroma prediction value, and a first luminance value corresponding to a template pixel to obtain model parameters, and using these parameters to determine a target chroma prediction value, thereby adjusting the linear relationship between the chroma and luminance values to improve accuracy.
This approach enhances the accuracy of chroma component prediction by eliminating the limitations of weight combinations, ensuring the target chroma prediction value is closely related to the fitting results of the reconstruction and prediction values.
Smart Images

Figure 2025533300000001_ABST
Abstract
Description
[Technical Field]
[0001] This application claims priority from Chinese Patent Application No. 202211248936.7, filed on October 12, 2022, the entire contents of which are incorporated herein by reference. This application also claims priority from Chinese Patent Application No. 202211255923.2, filed on October 13, 2022, the entire contents of which are incorporated herein by reference.
[0002] The present application relates to the field of codec technology, and more particularly to a chroma component prediction method, apparatus and device. [Background technology]
[0003] In the related art, generally, a chroma component predicted value corresponding to an image block is determined using an intra prediction mode and an inter-component linear prediction mode. Specifically, one chroma predicted value corresponding to the image block is determined based on the intra prediction mode, and another chroma predicted value corresponding to the image block is determined based on the inter-component linear prediction mode. The two chroma predicted values may be chroma-component-fused using a preset weight combination to obtain a final chroma predicted value.
[0004] In the above process, the chroma component fusion is performed on two chroma predicted values according to a preset weight combination to obtain a final chroma predicted value. However, there is a limitation in the number of weight combinations, which makes the accuracy of the final chroma predicted value relatively low. Summary of the Invention [Problem to be solved by the invention]
[0005] The embodiments of the present application provide a chroma component prediction method, apparatus, and device that can solve the problem that the accuracy of the chroma prediction value is relatively low in the conventional solutions. [Means for solving the problem]
[0006] According to a first aspect, there is provided a method for chroma component prediction, comprising: fitting a first chroma reconstruction value, a first chroma prediction value, and a first luminance value corresponding to a template pixel of a target image block to obtain model parameters, the model parameters being parameters of a chroma component prediction model corresponding to the target image block, and the template pixel being at least a part of pixels in a pixel area adjacent to the target image block; determining a target chroma prediction value corresponding to the target image block based on the model parameters and a second chroma prediction value and a second luminance value corresponding to the target image block.
[0007] According to a second aspect, there is provided a chroma component prediction apparatus, comprising: a fitting module, the fitting module being used to fit a first chroma reconstruction value, a first chroma prediction value, and a first luminance value corresponding to a template pixel of a target image block to obtain model parameters, the model parameters being parameters of a chroma component prediction model corresponding to the target image block, and the template pixel being at least a portion of pixels in a pixel area adjacent to the target image block; and a second determination module for determining a target chroma prediction value corresponding to the target image block based on the model parameters and a second chroma prediction value and a second luminance value corresponding to the target image block.
[0008] According to a third aspect, there is provided a terminal including a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions, when executed by the processor, implementing the steps of the method according to the first aspect.
[0009] According to a fourth aspect, there is provided a readable storage medium having stored thereon a program or instructions which, when executed by a processor, implement the steps of the method according to the first aspect.
[0010] According to a fifth aspect, there is provided a chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being adapted to execute programs or instructions and to implement the method of the first aspect.
[0011] According to a sixth aspect, there is provided a computer program / program product stored on a storage medium, the computer program / program product being used to implement the steps of the method according to the first aspect when executed by at least one processor.
[0012] According to a seventh aspect, there is provided an electronic device configured to perform the steps of the method according to the first aspect.
[0013] In an embodiment of the present application, a template pixel corresponding to the target image block is determined based on a target identifier corresponding to the target image block, where the template pixel is at least a portion of a pixel in a pixel area adjacent to the target image block, and a first chroma reconstruction value, a first chroma prediction value, and a first luminance value corresponding to the template pixel are fitted to obtain model parameters, where the model parameters are parameters of a chroma component prediction model corresponding to the target image block, and the chroma component prediction model is determined based on the target identifier, and a target chroma prediction value corresponding to the target image block is determined based on the model parameters, and a second chroma prediction value and a second luminance value corresponding to the target image block. [Effects of the Invention]
[0014] In an embodiment of the present application, a first chroma reconstruction value, a first chroma predicted value, and a first luminance value corresponding to a template pixel are fitted together, and a linear relationship between the first chroma predicted value and the first luminance value is adjusted to fit the first chroma predicted value and the first luminance value toward the first chroma reconstruction value, thereby obtaining model parameters. In the related art, chroma component fusion is performed on two chroma predicted values corresponding to an image block using a preset weight combination, but the weight combination has a numerical limitation, which reduces the accuracy of the chroma component predicted value. In an embodiment of the present application, a first chroma reconstruction value, a first chroma predicted value, and a first luminance value corresponding to a template pixel are fitted together, and a linear relationship between the first chroma predicted value and the first luminance value is adjusted to fit the first chroma predicted value and the first luminance value toward the first chroma reconstruction value, thereby obtaining model parameters. A target chroma predicted value is determined based on the model parameters. In the process of determining the target chroma predicted value, the target chroma predicted value is strongly related to the fitting result of the first chroma reconstruction value, the first chroma predicted value, and the first luminance value, and is not subject to the limitation on the number of weight combinations, thereby improving the accuracy of the chroma component predicted value. [Brief explanation of the drawings]
[0015] [Figure 1] 1 is a schematic diagram of a template pixel and an image block in the related art; [Figure 2] 1 is a flowchart of a chroma component prediction method according to an embodiment of the present application; [Figure 3] 1 is a schematic diagram of a template pixel and an image block according to an embodiment of the present application; [Figure 4] 1 is a second schematic diagram of template pixels and image blocks according to an embodiment of the present application; [Figure 5] FIG. 1 is a structural diagram of a chroma component prediction device according to an embodiment of the present application; [Figure 6] 1 is a structural diagram of a communication device according to an embodiment of the present application; [Figure 7] 1 is a hardware structure schematic diagram of a terminal according to an embodiment of the present application; DETAILED DESCRIPTION OF THE INVENTION
[0016] The following clearly and completely describes the technical solutions in the embodiments of the present application, in conjunction with the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only some of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present application fall within the scope of protection of the present application.
[0017] The terms "first," "second," etc. in the specification and claims of this application are intended to distinguish between similar objects and are not intended to describe a particular order or sequence. It should be understood that terms used in this manner are interchangeable where appropriate, so that embodiments of this application may be performed in orders other than those illustrated or described herein, and that objects distinguished by "first" and "second" are generally of the same type and do not limit the number of objects; for example, a first object may be one or more. Furthermore, "and / or" in the specification and claims indicates at least one of the connected objects, and the character " / " generally indicates an "or" relationship between the related objects.
[0018] In the related technology, one chroma prediction value corresponding to an image block is determined based on an intra prediction mode, and another chroma prediction value corresponding to the image block is determined based on an inter-component linear prediction mode. Then, chroma component fusion is performed on the two chroma prediction values using a preset weight combination to obtain a final chroma prediction value.
[0019] TIFF2025533300000002.tif72169
[0020] Optionally, the inter-component linear prediction mode includes an inter-component linear single-model prediction mode and an inter-component linear multi-model prediction mode.
[0021] TIFF2025533300000003.tif64169
[0022] 1, the template pixels include a row of pixels located above and adjacent to the image block, and a column of pixels located to the left of and adjacent to the image block, as shown in Fig. 1. Optionally, the template pixels include a row of pixels located above and adjacent to the image block, or a column of pixels located to the left of the image block and adjacent to the image block.
[0023] For the inter-component linear multi-model prediction mode, the luminance values of the image block are divided into two types based on the average luminance value of the image block, and the chroma predicted values can be calculated and obtained using the above formula (1) for each type.
[0024] However, in the above process, chroma component fusion is performed on the chroma component predicted value using a preset weight combination, and there is a limitation in the number of weight combinations, which results in a relatively low accuracy of the final chroma component predicted value.
[0025] In order to solve the above technical problems, the embodiments of the present application provide a chroma component prediction method. Hereinafter, the chroma component prediction method according to the embodiments of the present application will be described in detail with reference to several embodiments and their application scenarios in conjunction with the drawings.
[0026] Referring to Figure 2, Figure 2 is a flowchart of a chroma component prediction method in an embodiment of the present application. The chroma component prediction method according to this embodiment includes the following steps:
[0027] In S201, a template pixel corresponding to a target image block is determined based on a target identifier corresponding to the target image block.
[0028] In this step, a target identifier corresponding to the target image block may be obtained through the bitstream, and the target identifier is used to characterize template pixels corresponding to the target image block, thereby determining the template pixels corresponding to the target image block, where the template pixels are at least some pixels in a pixel region adjacent to the target image block. It should be noted that a chroma intra prediction mode corresponding to the target image block may also be obtained through the bitstream, and a first chroma predicted value and a second chroma predicted value corresponding to the target image block may further be determined based on the chroma intra prediction mode.
[0029] Alternatively, the module pixel is adjacent to the target image block and is located above and / or to the left of the target image block, or The module pixels are located at the top and / or left side within the target image block.
[0030] Referring to Fig. 3, in one alternative embodiment, the template pixel is adjacent to the target image block and located above and / or to the left of the target image block, as shown in Fig. 3. Referring to Fig. 4, in another alternative embodiment, the module pixel is located above and / or to the left of the target image block.
[0031] Optionally, the target identifier can be further used to characterize a chroma component prediction model, and the chroma component prediction model corresponding to the target image block can be determined according to the target identifier. It should be understood that the chroma component prediction model can be classified into a linear model and a nonlinear model, or a single model and a multi-model, that is, the chroma component prediction model includes, but is not limited to, an inter-component linear prediction single model, an inter-component linear prediction multi-model, an inter-component nonlinear prediction single model, and an inter-component nonlinear prediction multi-model.
[0032] In S202, the first chroma reconstruction value, the first chroma prediction value and the first luminance value corresponding to the template pixel are fitted to obtain model parameters.
[0033] In this step, as an optional embodiment, a matrix decomposition method is used to fit the first chroma reconstruction value, the first chroma prediction value, and the first luma value to obtain model parameters, and the matrix decomposition method includes but is not limited to LDL matrix decomposition, QR matrix decomposition, and LU matrix decomposition. It should be understood that the template pixel is an already reconstructed pixel, and the first chroma reconstruction value corresponding to the template pixel may also be directly obtained.
[0034] In another alternative embodiment, a minimum linear mean square error calculation is performed on the first chroma reconstruction value, the first chroma prediction value and the first luminance value to obtain the model parameters.
[0035] It should be noted that the above-mentioned process of fitting the first chroma reconstruction value, the first chroma predicted value, and the first luminance value is to fit the first chroma predicted value and the first luminance value towards the first chroma reconstruction value by adjusting a linear relationship between the first chroma predicted value and the first luminance value, i.e., to adjust the first chroma predicted value and the first luminance value so that the first chroma predicted value and the first luminance value approach the first chroma reconstruction value.
[0036] In S203, a target chroma prediction value corresponding to the target image block is determined based on the model parameters and the second chroma prediction value and second luminance value corresponding to the target image block.
[0037] In this step, a target chroma predicted value corresponding to the target image block is determined based on the model parameters, the second chroma predicted value, and the second luminance value corresponding to the target image block. For specific embodiments, see the following examples.
[0038] In an embodiment of the present application, a template pixel corresponding to the target image block is determined based on a target identifier corresponding to the target image block, the template pixel being at least a portion of pixels in a pixel region adjacent to the target image block, a first chroma reconstruction value, a first chroma predicted value, and a first luminance value corresponding to the template pixel are fitted to obtain model parameters, the model parameters being parameters of a chroma component prediction model corresponding to the target image block, the chroma component prediction model being determined based on the target identifier, and a target chroma predicted value corresponding to the target image block is determined based on the model parameters, and a second chroma predicted value and a second luminance value corresponding to the target image block. In the related art, chroma component fusion is performed on two chroma predicted values corresponding to an image block using a preset weight combination, but there is a numerical limitation in the weight combination, which reduces the accuracy of the chroma component predicted value. In an embodiment of the present application, a first chroma reconstruction value, a first chroma prediction value, and a first luminance value corresponding to a template pixel are fitted, and a linear relationship between the first chroma prediction value and the first luminance value is adjusted to fit the first chroma prediction value and the first luminance value toward the first chroma reconstruction value, thereby obtaining model parameters, and determining a target chroma prediction value based on the model parameters. In the process of determining the target chroma prediction value, the target chroma prediction value is strongly related to the fitting result of the first chroma reconstruction value, the first chroma prediction value, and the first luminance value, and is not subject to the limitation on the number of weight combinations, thereby improving the accuracy of the chroma component prediction value.
[0039] Optionally, determining a target chroma prediction value corresponding to the target image block based on the model parameters, and a second chroma prediction value and a second luminance value corresponding to the target image block, as described above, may include: Calculating the model parameters, and a second chroma prediction value and a second luminance value corresponding to the target image block using the chroma component prediction model to obtain a target chroma prediction value corresponding to the target image block.
[0040] As mentioned above, the target identifier may characterize a chroma component prediction model, which includes an inter-component linear prediction model or an inter-component non-linear prediction model.
[0041] In this embodiment, the model parameters, the second chroma prediction value corresponding to the target image block, and the second luminance value corresponding to the target image block may be input to a chroma component prediction model, and the chroma component prediction model calculates the model parameters, the second chroma prediction value, and the second luminance value, and outputs a target chroma prediction value corresponding to the target image block.
[0042] TIFF2025533300000004.tif75165
[0043] TIFF2025533300000005.tif100165
[0044] Here, the median value is related to the video bit depth, and optionally, if the video bit depth is 10, the median value is 512.
[0045] For the inter-component linear prediction multi-model, the second luminance value corresponding to the target image block is divided into two types based on the average luminance value corresponding to the target image block, and the target chroma prediction value can be calculated and obtained using the above formula (3).
[0046] For the inter-component nonlinear prediction multi-model, the second luminance value corresponding to the target image block is divided into two types based on the average luminance value corresponding to the target image block, and the target chroma prediction value can be calculated and obtained using the above equation (4).
[0047] Example 1: If the target identifier includes a 0, it indicates that no chroma component blending is performed on the target image block; If the target identifier includes 1, it indicates that the template pixel is located above and to the left of the target image block, and chroma component fusion is performed using an inter-component linear prediction multi-model according to the related art; If the target identifier includes 2, it indicates that the template pixel is located above and to the left of the target image block, and chroma component fusion is performed using the inter-component linear prediction single model according to this embodiment; If the target identifier includes 3, it indicates that the template pixel is located above and to the left of the target image block, and the inter-component linear prediction multi-model according to this embodiment is used to perform chroma component fusion.
[0048] Example 2: If the target identifier includes a 0, it indicates that no chroma component blending is performed on the target image block; If the target identifier includes 1, it indicates that the template pixel is located above and to the left of the target image block, or the template pixel is located above and to the left of the target image block, and chroma component fusion is performed using an inter-component linear prediction multi-model according to an embodiment of the present application; If the target identifier includes 2, it indicates that the template pixels are located above and to the left of the target image block, or the template pixels are located above and to the left inside the target image block, and chroma component fusion is performed using an inter-component nonlinear prediction multi-model according to an embodiment of the present application.
[0049] Example 3: If the target identifier includes a 0, it indicates that no chroma component blending is performed on the target image block; If the target identifier includes 1, it indicates that the template pixel is located above and to the left of the target image block, or the template pixel is located above and to the left of the target image block, and chroma component fusion is performed using an inter-component linear prediction multi-model according to an embodiment of the present application; If the target identifier includes 2, it indicates that the template pixels are located above and to the left of the target image block, or the template pixels are located above and to the left inside the target image block, and chroma component fusion is performed using an inter-component linear prediction single model according to an embodiment of the present application.
[0050] Example 4: If the target identifier includes a 0, it indicates that no chroma component blending is performed on the target image block; If the target identifier includes 1, it indicates that the chrominance component prediction model is a linear model, and if the target identifier does not include 1, it indicates that the chrominance component prediction model is a nonlinear model; If the target identifier includes 2, it indicates that the template pixels are located above and to the left of the target image block, or the template pixels are located above and to the left of the target image block, and chroma component fusion is performed using an inter-component prediction multi-model according to an embodiment of the present application; If the target identifier includes 3, it indicates that the template pixels are located above and to the left of the target image block, or the template pixels are located above and to the left of the target image block, and the chrominance component fusion is performed using the inter-component prediction single model according to the embodiment of the present application; If the target identifier includes 4, it indicates that the template pixel is located above the target image block, or the template pixel is located above the inside of the target image block, and chroma component fusion is performed using the inter-component prediction single model according to the embodiment of the present application; If the target identifier includes 5, it indicates that the template pixel is located on the left side of the target image block, or the template pixel is located on the left side inside the target image block, and the chroma component fusion is performed using the inter-component prediction single model according to the embodiment of the present application; If the target identifier includes 6, it indicates that the template pixel is located above the target image block, or the template pixel is located above the inside of the target image block, and chroma component fusion is performed using the inter-component prediction multi-model according to the embodiment of the present application; If the target identifier includes 7, it indicates that the template pixel is located on the left side of the target image block, or the template pixel is located on the left side inside the target image block, and chroma component fusion is performed using the inter-component prediction multi-model according to the embodiment of the present application.
[0051] For example, if the target identifier includes 1 and 7, it indicates that the template pixel is located on the left side of the target image block, or the template pixel is located on the left side inside the target image block, and chroma component fusion is performed using an inter-component linear prediction multi-model according to an embodiment of the present application.
[0052] For example, if the target identifier is 5, it indicates that the template pixel is located on the left side of the target image block, or the template pixel is located on the left side inside the target image block, and chroma component fusion is performed using the inter-component nonlinear prediction single model according to the embodiment of the present application.
[0053] Optionally, before fitting the first chroma reconstruction value, the first chroma prediction value, and the first luminance value corresponding to the template pixel as described above, the method further comprises: performing intra prediction on the template pixel based on a chroma intra prediction mode corresponding to the template pixel to determine the first chroma predicted value; performing intra prediction on the template pixel based on a luma intra prediction mode corresponding to the template pixel, and determining the first luma value; or determining the first luma value based on a luma reconstruction value of the template pixel.
[0054] In this embodiment, optionally, intra prediction may be performed on the template pixel based on the chroma intra prediction mode corresponding to the template pixel to determine a first reference pixel, and the chroma value of this first reference pixel may be determined as the first chroma prediction value corresponding to the template pixel.
[0055] In one alternative embodiment, intra prediction may be performed on the template pixel based on a luma intra prediction mode corresponding to the template pixel to determine a second reference pixel, and a first luma value corresponding to the template pixel may be determined based on the luma value of this second reference pixel.
[0056] In another alternative embodiment, a luminance reconstruction value of the template pixel is obtained, and a first luminance value corresponding to the template pixel is determined based on the luminance reconstruction value.
[0057] Optionally, determining the first luminance value as described above may be performed by the method comprising: and determining whether to downsample the first luminance value based on a sampling format of a video corresponding to the target image block, for example, if the video sampling format is YUV444, downsampling is not required, and if the video sampling format is YUV420, downsampling is required.
[0058] If downsampling is required, the first luminance value corresponding to the target image block is the luminance value after downsampling.
[0059] Optionally, before determining a target chroma prediction value corresponding to the target image block based on the model parameters and the second chroma prediction value and second luminance value corresponding to the target image block, the method further comprises: performing intra prediction on the target image block based on a chroma intra prediction mode corresponding to the target image block to determine the second chroma predicted value; The method includes performing intra prediction on the target image block based on a luma intra prediction mode corresponding to the target image block and determining the second luma value, or determining the second luma value based on a luma reconstruction value of the target image block.
[0060] In this embodiment, a chrominance intra prediction mode and a luma intra prediction mode corresponding to the target image block may be optionally obtained through a bitstream, and intra prediction is performed on the target image block based on the chrominance intra prediction mode corresponding to the target image block to determine a third reference pixel, and the chrominance value of the third reference pixel is determined as a second chrominance predicted value corresponding to the target image block.
[0061] As one optional embodiment, intra prediction may be performed on the target image block based on a luminance intra prediction mode corresponding to the target image block to determine a fourth reference pixel, and a second luminance value corresponding to the target image block may be determined based on the luminance value of this fourth reference pixel.
[0062] In another alternative embodiment, a luminance reconstruction value of the target image block is obtained, and a second luminance value corresponding to the target image block is determined based on the luminance reconstruction value.
[0063] Optionally, determining the second luminance value as described above may be performed by the method comprising: and determining whether to downsample the second luminance value based on a sampling format of a video corresponding to the target image block, for example, if the video sampling format is YUV444, downsampling is not required, and if the video sampling format is YUV420, downsampling is required.
[0064] If downsampling is required, the second luminance value corresponding to the target image block is the luminance value after downsampling.
[0065] The chroma component prediction method according to the embodiment of the present application may be performed by a chroma component prediction device. In the embodiment of the present application, the chroma component prediction device according to the embodiment of the present application will be described by taking as an example a case in which the chroma component prediction method is performed by the chroma component prediction device.
[0066] As shown in FIG. 5 , an embodiment of the present application further provides a chroma component prediction device 500, a fitting module 502, which is used to fit a first chroma reconstruction value, a first chroma prediction value, and a first luminance value corresponding to a template pixel of a target image block to obtain model parameters, the model parameters being parameters of a chroma component prediction model corresponding to the target image block, and the template pixel being at least a part of pixels in a pixel area adjacent to the target image block; and a second determination module 503 for determining a target chroma prediction value corresponding to the target image block based on the model parameters and a second chroma prediction value and a second luminance value corresponding to the target image block.
[0067] Optionally, the second determination module 503 specifically: The chroma component prediction model is used to calculate the model parameters, and a second chroma prediction value and a second luminance value corresponding to the target image block, to obtain a target chroma prediction value corresponding to the target image block.
[0068] TIFF2025533300000006.tif84165
[0069] TIFF2025533300000007.tif95165
[0070] Optionally, the chroma component prediction device 500 comprises: a third determination module for performing intra prediction on the template pixel based on a chroma intra prediction mode corresponding to the template pixel to determine the first chroma prediction value; and a fourth determination module for performing intra prediction on the template pixel and determining the first luminance value based on a luminance intra prediction mode corresponding to the template pixel, or for determining the first luminance value based on a luminance reconstruction value of the template pixel.
[0071] Optionally, the chroma component prediction device 500 comprises: a fifth determination module for performing intra prediction on the target image block based on a chroma intra prediction mode corresponding to the target image block, and determining the second chroma prediction value; The sixth determination module further includes a sixth determination module for performing intra prediction on the target image block based on a luma intra prediction mode corresponding to the target image block and determining the second luma value, or for determining the second luma value based on a luma reconstruction value of the target image block.
[0072] Alternatively, the module pixel is adjacent to the target image block and is located above and / or to the left of the target image block, or The module pixels are located at the top and / or left side within the target image block.
[0073] Optionally, the chroma component prediction device 500 comprises: It further includes a first determining module 501 for determining, based on a target identifier corresponding to a target image block, a template pixel corresponding to the target image block.
[0074] Optionally, the chroma component prediction model is determined based on a target identifier of the target image block.
[0075] Optionally, the target identifier includes a first target identifier or a second target identifier, where the first target identifier corresponds to a chroma component prediction single model and the second target identifier corresponds to a chroma component prediction multi-model.
[0076] In related art, chroma component fusion is performed on two chroma prediction values corresponding to an image block using a preset weight combination, but the weight combination has a numerical limitation, which reduces the accuracy of the chroma component prediction value. In an embodiment of the present application, a first chroma reconstruction value, the first chroma prediction value, and a first luminance value corresponding to a template pixel are fitted, and the first chroma prediction value and the first luminance value are fitted toward the first chroma reconstruction value by adjusting the linear relationship between the first chroma prediction value and the first luminance value, thereby obtaining model parameters, and determining a target chroma prediction value based on the model parameters. In the process of determining the target chroma prediction value, the target chroma prediction value is strongly related to the fitting result of the first chroma reconstruction value, the first chroma prediction value, and the first luminance value, and is not subject to the numerical limitation of the weight combination, thereby improving the accuracy of the chroma component prediction value.
[0077] This embodiment of the device corresponds to the embodiment of the chroma component prediction method shown in Figure 2 above, and all of the implementation processes and realization methods in the above method embodiments can be applied to this embodiment of the device, and the same technical effects can be achieved.
[0078] The chroma component prediction device in the embodiments of the present application may be an electronic device, for example, an electronic device having an operating system, or may be a component of the electronic device, for example, an integrated circuit or a chip. The electronic device may be a terminal or other devices other than a terminal. Exemplarily, the terminal may include, but is not limited to, the types of terminals listed above. The other devices may be, for example, a server, a network-attached storage (NAS), etc., and the embodiments of the present application are not specifically limited thereto.
[0079] Optionally, as shown in FIG. 6 , an embodiment of the present application further provides a communication device 600, including a processor 601 and a memory 602, wherein the memory 602 stores a program or instruction that can be executed on the processor 601. For example, when the communication device 600 is a terminal, when the program or instruction is executed by the processor 601, each step of the embodiment of the above-mentioned chroma component prediction method can be realized and the same technical effect can be achieved.
[0080] An embodiment of the present application further provides a terminal, including a processor 601 and a communication interface, wherein the processor 601: an operation of fitting a first chroma reconstruction value, a first chroma prediction value, and a first luminance value corresponding to a template pixel of a target image block to obtain model parameters, the model parameters being parameters of a chroma component prediction model corresponding to the target image block, and the template pixel being at least a portion of pixels in a pixel area adjacent to the target image block; and determining a target chroma prediction value corresponding to the target image block based on the model parameters and a second chroma prediction value and a second luminance value corresponding to the target image block.
[0081] This terminal embodiment corresponds to the above terminal-side method embodiment, and the implementation processes and embodiments of the above method embodiments can be applied to this terminal embodiment, and the same technical effects can be achieved. Specifically, Figure 7 is a schematic diagram of the hardware structure realizing the terminal of the embodiment of this application.
[0082] The terminal 700 includes components such as, but not limited to, a radio frequency unit 701, a network module 702, an audio output unit 703, an input unit 704, a sensor 705, a display unit 706, a user input unit 707, an interface unit 708, a memory 709, and a processor 710.
[0083] As will be understood by those skilled in the art, the terminal 700 may further include a power source (e.g., a battery) for powering each component, and the power source may be logically connected to the processor 710 by a power management system, thereby enabling the power management system to realize functions such as charge / discharge management and power consumption management. The terminal structure shown in Figure 7 does not constitute a limitation on the terminal, and the terminal may include more or fewer components than those shown, or a combination of some components, or a different configuration of components, which will not be further described here.
[0084] It should be understood that in the embodiment of the present application, the input unit 704 may include a graphics processing unit (GPU) 7041 and a microphone 7042, and the graphics processor 7041 processes image data of still or video images captured by an image capture device (e.g., a camera) in a video capture mode or an image capture mode. The display unit 706 may include a display panel 7061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, or the like. The user input unit 707 includes at least one of a touch panel 7071 and other input devices 7072. The touch panel 7071 is also called a touch screen. The touch panel 7071 may include two parts: a touch detection device and a touch controller. The other input devices 7072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control buttons, switch buttons, etc.), a trackball, a mouse, and a control lever, which will not be further described herein.
[0085] In the embodiment of the present application, the radio frequency unit 701 can receive downlink data from the network side device and then transmit the data to the processor 710 for processing, and the radio frequency unit 701 can transmit uplink data to the network side device. Generally, the radio frequency unit 701 includes, but is not limited to, an antenna, an amplifier, a transceiver, a coupler, a low-noise amplifier, a duplexer, etc.
[0086] The memory 709 may be used to store software programs or instructions and various data. The memory 709 may include a first storage area that mainly stores programs or instructions and a second storage area that stores data. Here, the first storage area may store an operating system, an application program or instructions necessary for at least one function (e.g., audio playback function, image playback function, etc.), etc. The memory 709 may include volatile memory or nonvolatile memory, or may include both volatile and nonvolatile memory. Here, the nonvolatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. The volatile memory may be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus random access memory (DRRAM). Memory 709 in embodiments of the present application includes, but is not limited to, these and any other suitable types of memory.
[0087] The processor 710 may include one or more processing units, and optionally, the processor 710 may integrate an application processor and a modem processor, where the application processor mainly processes operations related to the operating system, user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. As can be appreciated, the modem processor does not have to be integrated into the processor 710.
[0088] Here, the processor 710: determining a template pixel corresponding to the target image block based on a target identifier corresponding to the target image block; fitting a first chroma reconstruction value, a first chroma prediction value, and a first luminance value corresponding to the template pixel to obtain model parameters; and determining a target chroma prediction value corresponding to the target image block based on the model parameters and a second chroma prediction value and a second luminance value corresponding to the target image block.
[0089] The embodiments of the present application further provide a readable storage medium, on which a program or instruction is stored, which, when executed by a processor, can realize each process of the above-mentioned embodiment of the chroma component prediction method and achieve the same technical effect. In order to avoid repetition, no further description will be given here.
[0090] Wherein, the processor is the processor in the terminal described in the above embodiment. The readable storage medium includes a computer readable storage medium, such as a computer read only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0091] The embodiments of the present application further provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to execute programs or instructions to realize each process of the embodiments of the above chroma component prediction method, and can achieve the same technical effects. In order to avoid repetition, no further description will be given here.
[0092] It should be understood that the chips referred to in the embodiments of this application may be referred to as system level chips, system chips, chip systems, or system-on-chips.
[0093] The embodiments of the present application further provide a computer program / program product, which is stored in a storage medium and can be executed by at least one processor to implement each process of the above-mentioned chroma component prediction method embodiments and achieve the same technical effects. In order to avoid repetition, no further description will be given here.
[0094] It should be noted that, in this specification, the terms "comprises," "includes," or any other variations thereof are intended to cover the non-exclusive "comprises," whereby a process, method, article, or apparatus comprising a set of elements not only includes those elements, but also other elements not expressly listed or inherent in such process, method, article, or apparatus. Absent further limitations, an element defined by the phrase "comprises one of" does not preclude the presence of other identical elements in the process, method, article, or apparatus comprising that element. It should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may include performing functions in an essentially simultaneous manner or in the reverse order based on the functions involved; for example, a described method may be performed in a different order than described, and various steps may be added, omitted, or combined. Furthermore, features described with reference to some examples may be combined in other examples.
[0095] From the above description of the embodiments, it will be apparent to those skilled in the art that the methods of the above embodiments can be realized in the form of software and a required general-purpose hardware platform. Of course, they can also be realized in hardware, but in many cases the former is a more preferred embodiment. From this understanding, the substantial or prior art contributions of the technical solutions of the present application may be embodied in the form of a computer software product, which may be stored in a storage medium (e.g., ROM / RAM, magnetic disk, optical disk) and include some instructions for causing a terminal (which may be a mobile phone, computer, server, air conditioner, network device, etc.) to execute the methods described in each embodiment of the present application.
[0096] Although the above describes the embodiments of the present application in conjunction with the drawings, the present application is not limited to the above specific embodiments. The above specific embodiments are merely illustrative and not limiting. Those skilled in the art can implement many forms under the guidance of the present application without departing from the spirit and scope of protection of the claims, and all forms fall within the scope of protection of the present application.
Claims
1. 1. A chroma component prediction method, comprising: fitting a first chroma reconstruction value, a first chroma prediction value, and a first luminance value corresponding to a template pixel of a target image block to obtain model parameters, the model parameters being parameters of a chroma component prediction model corresponding to the target image block, and the template pixel being at least a part of pixels in a pixel area adjacent to the target image block; determining a target chroma prediction value corresponding to the target image block based on the model parameters and a second chroma prediction value and a second luminance value corresponding to the target image block.
2. Determining a target chroma prediction value corresponding to the target image block based on the model parameters, and a second chroma prediction value and a second luminance value corresponding to the target image block, as described above, includes:
2. The method of claim 1, further comprising: calculating the model parameters, and a second chroma prediction value and a second luminance value corresponding to the target image block using the chroma component prediction model, wherein the chroma component prediction model comprises an inter-component linear prediction model or an inter-component nonlinear prediction model.
3.
4.
5. Prior to fitting the first chroma reconstruction value, the first chroma prediction value, and the first luminance value corresponding to the template pixel as described above, the method may further include: performing intra prediction on the template pixel based on a chroma intra prediction mode corresponding to the template pixel to determine the first chroma predicted value; 5. The method of claim 1, further comprising: performing intra prediction on the template pixel based on a luma intra prediction mode corresponding to the template pixel, and determining the first luma value; or determining the first luma value based on a luma reconstruction value of the template pixel.
6. As described above, before determining a target chroma prediction value corresponding to the target image block based on the model parameters, and the second chroma prediction value and the second luminance value corresponding to the target image block, the method further comprises: performing intra prediction on the target image block based on a chroma intra prediction mode corresponding to the target image block to determine the second chroma predicted value; 6. The method of claim 1, further comprising: performing intra prediction on the target image block based on a luma intra prediction mode corresponding to the target image block, and determining the second luma value; or determining the second luma value based on a luma reconstruction value of the target image block.
7. The module pixel is adjacent to the target image block and is located above and / or to the left of the target image block, or The method according to any one of claims 1 to 6, wherein the module pixels are located at the top and / or left side within the target image block.
8. The method comprises: The method of claim 1 , further comprising determining template pixels for the target image block based on a target identifier for the target image block.
9. The method of claim 1 , wherein the chroma component prediction model is determined based on a target identifier of the target image block.
10. 10. The method of claim 9, wherein the target identifier comprises a first target identifier or a second target identifier, the first target identifier corresponding to a chroma component prediction single model, and the second target identifier corresponding to a chroma component prediction multi-model.
11. 1. A chroma component prediction device, comprising: a fitting module, the fitting module being used to fit a first chroma reconstruction value, a first chroma prediction value, and a first luminance value corresponding to a template pixel of a target image block to obtain model parameters, the model parameters being parameters of a chroma component prediction model corresponding to the target image block, and the template pixel being at least a portion of pixels in a pixel area adjacent to the target image block; a second determination module for determining a target chroma prediction value corresponding to the target image block based on the model parameters, and a second chroma prediction value and a second luma value corresponding to the target image block.
12. The second determination module specifically:
12. The device of claim 11, wherein the chroma component prediction model is used to calculate the model parameters, and a second chroma prediction value and a second luminance value corresponding to the target image block, and to obtain a target chroma prediction value corresponding to the target image block, wherein the chroma component prediction model includes an inter-component linear prediction model or an inter-component nonlinear prediction model.
13. The device comprises: The apparatus according to claim 11 or 12, further comprising a first determination module for determining a template pixel corresponding to a target image block based on a target identifier corresponding to the target image block.
14. The device comprises: a third determination module for performing intra prediction on the template pixel based on a chroma intra prediction mode corresponding to the template pixel to determine the first chroma prediction value; 14. The device of claim 11, further comprising: a fourth determination module for performing intra prediction on the template pixel and determining the first luminance value based on a luminance intra prediction mode corresponding to the template pixel; or for determining the first luminance value based on a luminance reconstruction value of the template pixel.
15. The device comprises: a fifth determination module for performing intra prediction on the target image block based on a chroma intra prediction mode corresponding to the target image block, and determining the second chroma prediction value; 14. The device of claim 11, further comprising a sixth determination module for performing intra prediction on the target image block based on a luma intra prediction mode corresponding to the target image block and determining the second luma value, or for determining the second luma value based on a luma reconstruction value of the target image block.
16. The module pixel is adjacent to the target image block and is located above and / or to the left of the target image block, or 16. The device according to any one of claims 11 to 15, wherein the module pixels are located at the top and / or left side within the target image block.
17. A terminal including a processor and a memory, the memory storing a program or instructions executable on the processor, the program or instructions implementing the steps of the chroma component prediction method according to any one of claims 1 to 10 when executed by the processor.
18. A readable storage medium having a program or instructions stored thereon, the program or instructions implementing the steps of the chroma component prediction method according to any one of claims 1 to 10 when executed by a processor.
19. A chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor executing a program or instructions and used to implement the steps of the chroma component prediction method according to any one of claims 1 to 10.
20. A computer program product stored on a storage medium and executed by at least one processor to implement the steps of the chroma component prediction method according to any one of claims 1 to 10.
21. Electronic equipment configured to perform the steps of the chroma component prediction method according to any one of claims 1 to 10.
Citation Information
Patent Citations
Chrominance linear prediction method and device based on position weighting, equipment and medium
CN113365067A
Inter-component prediction in video coding
JP2017538381A
Adaptive prediction of intercomponent residuals
JP2018509035A
Simplifying Cross-Component Linear Models
JP2022500967A