Video image chroma reduction method and device, storage medium and electronic device

By using a Gaussian distribution upsampling method to restore the chroma of video images, the problem of poor chroma restoration in existing technologies is solved, user experience is improved and data transmission efficiency is optimized.

CN119031106APending Publication Date: 2024-11-26SANECHIPS TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202310568967.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2023-05-18
Publication Date
2024-11-26

AI Technical Summary

Technical Problem

Existing video image transmission methods are not good at color reproduction, resulting in a poor user experience and high data transmission bandwidth consumption.

Method used

A Gaussian distribution upsampling method is used to upsample the chromaticity information of a video image based on the distance parameter between adjacent pixel blocks in order to restore the chromaticity information of the video image.

Benefits of technology

It improves the quality and efficiency of color reproduction in video images, enhances the user experience, and reduces data transmission bandwidth consumption.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119031106A_ABST
    Figure CN119031106A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a video image chromaticity reduction method and device, a storage medium and an electronic device. The method comprises the following steps: on the basis of distance parameters between adjacent pixel blocks, performing up-sampling on chrominance information of a video image in a second YUV format through a Gaussian distribution up-sampling method so as to restore the chrominance information of the video image and obtain a video image in a first YUV format. According to the embodiment of the invention, since the chromaticity of the video image is restored by adopting the Gaussian distribution up-sampling method, the quality of the video image when the video image is up-sampled from the first YUV format to the second YUV format can be improved, the original RGB image is better restored, and the restoration efficiency is high. Therefore, the problem that a chromaticity reduction method for transmission of the video image in the YUV format capable of better reducing the chromaticity of the video image is needed in the related technology can be solved, and the effect of improving the user experience is achieved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The embodiments of the present invention relate to the field of video transmission technology, and in particular, to a method, device, storage medium and electronic device for chromaticity restoration of a video image. Background Art

[0002] YUV is a color encoding method commonly used in various video processing components. Y represents the brightness of the pixel color, and UV represents the chromaticity of the pixel color. People's perception of brightness is much greater than that of chromaticity, so small changes in color chromaticity are less noticeable.

[0003] When transmitting video images, in order to save transmission bandwidth and reduce the amount of video image transmission data, the chrominance information is often downsampled for transmission, that is, the RGB data of each frame of the image is converted into YUV444 format, and the chrominance is downsampled to obtain YUV420 or YUV422 before video encoding and transmission. After transmission, the chrominance is upsampled to obtain the restored YUV444, and finally the RGB information is restored; among them, YUV444 is a lossless format for both chrominance and brightness, and YUV422 and YUV420 are lossless formats for brightness but lossy chrominance.

[0004] The video image transmission method in the related art includes:

[0005] 1. First, use a general downsampling method to downsample, such as average downsampling and downsampling with single pixel information preserved; then use a general interpolation method to upsample the chromaticity value, such as nearest neighbor interpolation, bilinear interpolation, bicubic interpolation, and Lanczos interpolation. This method does not consider the correlation between the chromaticity value at the domain position and the chromaticity value at the interpolated position, so the restoration of the chromaticity value is limited and the effect is poor.

[0006] 2. First, use the general downsampling method to perform chroma downsampling from YUV444 to YUV420 format; then use the general interpolation method to upsample the chroma value; finally, adjust the brightness value to compensate for the loss of chroma and obtain a restored value closer to the original RGB information. However, the brightness value has a range of values, and this method cannot adjust the brightness value infinitely, so it cannot completely restore the original RGB information; and this method will also destroy the lossless brightness domain information; the optimal value of the brightness value still needs to be found by exhaustive method, so the restoration efficiency is also relatively low.

[0007] 3. First, use the average downsampling method to perform YUV chromaticity downsampling; then, according to the three domain chromaticity values ​​of the interpolated position, the chromaticity value of the interpolated position is determined according to the specified formula. This method refers to the domain information after the nearest neighbor interpolation, but its domain information is not completely accurate, and the reference domain information is incomplete, which will lead to limited restoration of the chromaticity value of the interpolated position.

[0008] 4. Directly use the YUV444 format to transmit video images. This method ensures that the chrominance of the video image is lossless, but consumes bandwidth during data transmission, and the large amount of data transmitted affects the smoothness of the playback of the transmitted video image.

[0009] Given that the transmitted image has chroma loss due to chroma downsampling and the chroma upsampling has limited restoration, which will lead to a poor user experience and an increasing demand for chroma restoration in video image transmission, a chroma restoration method for YUV format video image transmission that can better restore the chroma of the video image is now needed. Summary of the invention

[0010] Embodiments of the present invention provide a method, device, storage medium and electronic device for restoring the chromaticity of a video image, so as to at least solve the problem in the related art that a chromaticity restoration method for transmitting a YUV format video image that can better restore the chromaticity of the video image is needed.

[0011] According to one embodiment of the present invention, a method for chromaticity restoration of a video image is provided, comprising: based on a distance parameter between adjacent pixel blocks, upsampling the chromaticity information of a video image in a second YUV format by a Gaussian distribution upsampling method to restore the chromaticity information of the video image and obtain a video image in a first YUV format.

[0012] According to another embodiment of the present invention, a chromaticity restoration device for a video image is provided, comprising: an upsampling module, for upsampling the chromaticity information of a video image in a second YUV format by a Gaussian distribution upsampling method based on a distance parameter between adjacent pixel blocks, so as to restore the chromaticity information of the video image and obtain a video image in a first YUV format.

[0013] According to yet another embodiment of the present invention, a computer-readable storage medium is provided, in which a computer program is stored, wherein the computer program is configured to execute the steps of any one of the above method embodiments when run.

[0014] According to yet another embodiment of the present invention, there is provided an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0015] Through the present invention, since the chroma of the video image is restored by using the Gaussian distribution upsampling method, the quality of the video image when upsampling from the first YUV format to the second YUV format can be improved, and the original RGB image can be better restored with high restoration efficiency. Therefore, the problem in the related art that a chroma restoration method for YUV format video image transmission that can better restore the chroma of the video image can be solved, and the effect of improving the user experience can be achieved. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] Figure 1 It is a hardware structure block diagram of a computer terminal for running a chromaticity restoration method for video images according to an embodiment of the present invention;

[0017] Figure 2 is a flow chart of a method for chromaticity restoration of a video image according to an embodiment of the present invention;

[0018] Figure 3 is a structural block diagram of a chromaticity restoration device for a video image according to an embodiment of the present invention;

[0019] Figure 4 is a structural block diagram of a chromaticity restoration device for a video image according to an embodiment of the present invention;

[0020] Figure 5 is a structural block diagram of a chromaticity restoration device for a video image according to an embodiment of the present invention;

[0021] Figure 6 is a structural block diagram of a YUV chroma up- and down-sampling and chroma restoration device according to an embodiment of the present invention;

[0022] Figure 7 is a flowchart of a method for jointly restoring chrominance by upsampling and downsampling the chrominance of YUV according to an embodiment of the present invention;

[0023] Figure 8 is a schematic diagram of a downsampling process according to an embodiment of the present invention;

[0024] Fig. 9 is a schematic diagram of an upsampling process according to an embodiment of the present invention;

[0025] Fig.10 Schematic diagram of the two-dimensional Gaussian distribution probability density function distribution. DETAILED DESCRIPTION

[0026] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings and in combination with the embodiments.

[0027] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0028] The method embodiments provided in the embodiments of the present application can be executed in a mobile terminal, a computer terminal or a similar computing device. Taking running on a computer terminal as an example, Figure 1 1 is a hardware structure block diagram of a computer terminal for executing a chromaticity restoration method for video images according to an embodiment of the present invention. Figure 1 As shown, the computer terminal may include one or more ( Figure 1 Only one is shown in the figure) a processor 102 (the processor 102 may include but is not limited to a microprocessor or a processing device such as a programmable logic device (Field Programmable Gate Array, FPGA)) and a memory 104 for storing data, wherein the above-mentioned computer terminal may also include a transmission device 106 and an input and output device 108 for communication functions. It can be understood by those skilled in the art that Figure 1 The structure shown is only for illustration and does not limit the structure of the above-mentioned computer terminal. Figure 1 More or fewer components as shown, or with Figure 1 Different configurations shown.

[0029] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the color restoration method of the video image in the embodiment of the present invention. The processor 102 executes various functional applications and data processing by running the computer program stored in the memory 104, that is, to implement the above method. The memory 104 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely arranged relative to the processor 102, and these remote memories may be connected to the computer terminal via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0030] The transmission device 106 is used to receive or send data via a network. The specific example of the above network may include a wireless network provided by a communication provider of a computer terminal. In one example, the transmission device 106 includes a network adapter (Network Interface Controller, referred to as NIC), which can be connected to other network devices through a base station so as to communicate with the Internet. In one example, the transmission device 106 can be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0031] In this embodiment, a method for chromaticity restoration of a video image running on the above-mentioned computer terminal is provided. Figure 2 is a flow chart of a method for chromaticity restoration of a video image according to an embodiment of the present invention. Figure 2 As shown, the process includes the following steps:

[0032] Step S202 , based on the distance parameter between adjacent pixel blocks, up-sample the chromaticity information of the video image in the second YUV format by a Gaussian distribution up-sampling method to restore the chromaticity information of the video image and obtain the video image in the first YUV format.

[0033] The Gaussian distribution curve is bell-shaped, low at both ends, high in the middle, and symmetrical on both sides. Because its curve is bell-shaped, it is also called a bell curve. In image processing, the closer the pixel is to a certain pixel a, the greater its influence on a and the more important it should be. It can be seen that the relationship between pixels is not a linear relationship, but is more consistent with the function image of the Gaussian distribution. Therefore, the Gaussian distribution upsampling method is used in this embodiment to improve the image chromaticity restoration rate to a certain extent.

[0034] The idea of ​​image pixel correlation based on Gaussian distribution can fully consider the influence of domain downsampling value on the chromaticity of the interpolated position, improve the idea of ​​linear interpolation of image chromaticity, and significantly improve the performance of chromaticity information at the receiving end.

[0035] Before step S202 of this embodiment, the method also includes: reading the RGB format of each frame of video image from the received video, and converting the RGB format of the video image into a first YUV format; down-sampling the chromaticity information of the video image in the first YUV format to obtain a video image in a second YUV format, and transmitting the video in the second YUV format.

[0036] That is, the relevant process at the video transmission end includes: reading the RGB three-channel information of each frame of the input video, converting the video image in RGB format into the first YUV format, and then downsampling the video image in YUV format to obtain a second YUV format to reduce the amount of transmitted data, and transmitting the video in the second YUV format.

[0037] In an exemplary embodiment, the first YUV format is YUV444, and the second YUV format is YUV420 format.

[0038] The relevant process at the receiving video end includes: receiving a video image in a second YUV format, upsampling the second YUV format to a video image in a first YUV format through a Gaussian distribution upsampling method to restore the chromaticity information of the video image, and then converting the video image in the first YUV format to an RGB format, so that a clear video image can be displayed on the user terminal.

[0039] In an exemplary embodiment, downsampling the chrominance information of the video image in the first YUV format to obtain the video image in the second YUV format includes: downsampling the chrominance information of the video image in the first YUV format by an average downsampling method.

[0040] In an exemplary embodiment, when downsampling the chrominance information of the video image in the first YUV format, the chrominance average value of all pixels in a pixel block of a preset size is taken as the chrominance downsampling value.

[0041] In an exemplary embodiment, when upsampling the chroma information of the video image in the second YUV format, a chroma upsampling value is determined based on interpolation of the chroma downsampling value.

[0042] Because the data of each channel in the image is two-dimensional data, the connection between pixels can be regarded as a two-dimensional Gaussian distribution with position as a parameter.

[0043] In an exemplary embodiment, the chrominance information of a video image in a second YUV format is upsampled by a Gaussian distribution upsampling method based on a distance parameter between adjacent pixel blocks, including: based on the distance parameter between the adjacent pixel blocks, converting the connection between different pixels into a Gaussian distribution probability density function with position as a parameter; determining the influence weight of each chrominance downsampling value on different pixels by using the Gaussian distribution probability density function; based on the influence weight of each chrominance downsampling value on different pixels, determining the upsampling value of each pixel block to upsample the chrominance information of the video image in the second YUV format.

[0044] In an exemplary embodiment, after obtaining the first YUV format video image, the method further includes: converting the first YUV format video image into RGB format, and using the obtained RGB format video image for user terminal display.

[0045] Through the above steps, the present invention uses a Gaussian distribution upsampling method to restore the chrominance of the video image, which can improve the quality of the video image when upsampling from the first YUV format to the second YUV format, better restore the original RGB image, and the restoration efficiency is high. Therefore, the problem of the need for a chrominance restoration method for YUV format video image transmission that can better restore the chrominance of the video image in the related art can be solved, achieving the effect of improving the user experience.

[0046] Through the description of the above implementation methods, those skilled in the art can clearly understand that the method according to the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, in essence or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as a read-only memory / random access memory (ROM / RAM), a magnetic disk, or an optical disk), and includes a number of instructions for a terminal device (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0047] In the present embodiment, a chromaticity restoration device for a video image is also provided, and the device is used to implement the above-mentioned embodiment and preferred implementation mode, and the descriptions that have been made are not repeated. As used below, the term "module" can implement a combination of software and / or hardware of a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware is also possible and conceived.

[0048] Figure 3 is a structural block diagram of a chromaticity restoration device for a video image according to an embodiment of the present invention. Figure 3 As shown, the device comprises:

[0049] The upsampling module 10 is used to upsample the chrominance information of the video image in the second YUV format by a Gaussian distribution upsampling method based on the distance parameter between adjacent pixel blocks to restore the chrominance information of the video image and obtain the video image in the first YUV format.

[0050] Figure 4 is a structural block diagram of a chromaticity restoration device for a video image according to an embodiment of the present invention. Figure 4 As shown, the device includes Figure 3 All modules shown, plus:

[0051] A first conversion module 20 is used to read the RGB format of each frame of video image from the received video, and convert the RGB format of the video image into a first YUV format;

[0052] The down-sampling module 30 is used to down-sample the chrominance information of the video image in the first YUV format to obtain the video image in the second YUV format, and perform video transmission in the second YUV format.

[0053] Figure 5is a structural block diagram of a chromaticity restoration device for a video image according to an embodiment of the present invention. Figure 5 As shown, the device includes Figure 4 All modules shown, plus:

[0054] The second conversion module 40 is used to convert the first YUV format video image into RGB format, and use the obtained RGB format video image for user terminal display.

[0055] It should be noted that the above modules can be implemented by software or hardware. For the latter, it can be implemented in the following ways, but not limited to: the above modules are all located in the same processor; or the above modules are located in different processors in any combination.

[0056] To facilitate the understanding of the technical solution provided by the present invention, a detailed description will be given below in conjunction with embodiments of specific scenarios.

[0057] In the embodiment of the present invention, a method for YUV chroma up-sampling and down-sampling combined with chroma restoration is proposed based on the idea of ​​image pixel correlation based on Gaussian distribution. The method includes: converting the original RGB information into YUV444 format; down-sampling the chroma information of YUV444 using an average down-sampling method; treating the chroma connection of the YUV420 image after chroma down-sampling as a Gaussian distribution, and up-sampling the chroma according to the distance parameter of the adjacent chroma down-sampling values; converting the YUV444 image obtained by chroma up-sampling to obtain a restored RGB image. This method can improve the quality of upsampling YUV420 to YUV444, can better restore the original RGB image, and has a high restoration efficiency, which improves the user experience.

[0058] Figure 6 1 is a structural block diagram of a YUV chroma up-sampling and down-sampling joint chroma restoration device according to an embodiment of the present invention, and the device is used to run the YUV chroma up-sampling and down-sampling joint chroma restoration method. Figure 6 As shown, the device comprises:

[0059] RGB to YUV444 format conversion module 61 , YUV chroma down-sampling module 62 , YUV chroma up-sampling module 63 , YUV444 to RGB format conversion module 64 .

[0060] The video input module 60 is used to input video images and read out the RGB three-channel information of each frame of the video.

[0061] The RGB to YUV444 format conversion module 61 is used to read the RGB format of each frame of video image and convert the RGB format into the format required for video image transmission encoding, including YUV444, YUV420 and other formats; the RGB to YUV444 format conversion module 61 is functionally equivalent to the first conversion module 20 in the above embodiment.

[0062] The YUV chroma downsampling module 62 includes: before the video image is transmitted, the YUV444 format chroma of each frame of video image is downsampled to the YUV420 format by using an average downsampling method; the YUV chroma downsampling module 62 is functionally equivalent to the downsampling module 30 in the above embodiment.

[0063] The YUV chroma upsampling module 63 is used to upsample the chroma of each frame of video image in YUV420 format to YUV444 format according to the Gaussian distribution interpolation algorithm after the video image is transmitted; the YUV chroma upsampling module 63 is functionally equivalent to the upsampling module 10 in the above embodiment.

[0064] The YUV444 to RGB format conversion module 64 is used to convert each frame of video image from the YUV444 format to the RGB format.

[0065] The video image display module 65 is used to display the video image converted into RGB format on the user end.

[0066] The second conversion module 40 in the above embodiment functionally includes the functions of the YUV444 to RGB format conversion module 64 and the functions of the video image display module 65 .

[0067] Specifically, the specific process of the above-mentioned YUV chromaticity up-sampling and down-sampling combined chromaticity restoration method is as follows Figure 7 As shown, the following steps are included:

[0068] Step S701, the RGB to YUV444 format conversion module uses the SDTV standard based on BT.601-6 of the digital television to convert the RGB information of each frame of the video image into the YUV444 format, wherein the conversion formula is:

[0069]

[0070] Step S702, the YUV chroma downsampling module uses an average downsampling method to downsample the chroma information of the image within a 2×2 block, and the downsampling value is the chroma average of the 4 pixels in the 2×2 block. Figure 8 As shown, For example, the chroma downsampling value formula is as follows:

[0071]

[0072] The chromaticity values ​​of the remaining pixels of the image are calculated and determined by the above method.

[0073] After downsampling, the data volume of brightness and chromaticity is 4:1, and the chromaticity is downsampled both horizontally and vertically, which reduces the amount of data to be transmitted. The reduction in data volume also reduces the bandwidth consumption during video image data transmission.

[0074] Step S703, the YUV chroma upsampling module uses an upsampling method based on Gaussian distribution to perform chroma upsampling on the transmitted YUV420 information. The upsampling process is as follows: Fig. 9 As shown, even if the chrominance information of the image is upsampled within a 2×2 block, the upsampled value is an interpolation of the four chrominance downsampled values ​​within the 2×2 block.

[0075] Gaussian distribution is a convenient model for quantitative phenomena in natural science and behavioral science. Because the data of each channel of the image is two-dimensional data, the YUV chroma upsampling module can regard the relationship between pixels as a two-dimensional Gaussian distribution with position as a parameter. Fig.10 is the distribution image of the probability density function of the two-dimensional Gaussian distribution. The calculation formula of the probability density function of the two-dimensional Gaussian distribution is as follows:

[0076]

[0077] Among them, because its influence is set to be isotropic with respect to the direction, μ 1 =μ 2 , σ 1 =σ 2 .

[0078] In this embodiment, the influence of the down-sampling values ​​in the four areas of the interpolation position on it is considered, and right The influence of is almost 0, and the distance parameter When the probability density function of the two-dimensional Gaussian distribution is three times the variance, the probability of the two-dimensional Gaussian distribution is approximately 0, so the variance of three times is equal to After rounding, 3 times the variance equals 3. Therefore, the expectation (μ) is 0 and the variance (σ) is 1. For example, For example, downsampling In Y 8 The chromaticity influence weight of the position is:

[0079]

[0080] In Y 9 The influence weight of the position is:

[0081]

[0082] In Y 14 The influence weight of the position is:

[0083]

[0084] In Y 15 The influence weight of the position is:

[0085]

[0086] In Y 10 , Y 20 The influence weight of the position is extremely small, and it is not within the range of the downsampling values ​​of the four interpolation areas, so it is ignored.

[0087] Therefore, Y 8 The chroma upsampling value of the position is the interpolation of the chroma downsampling values ​​of the four fields, and the formula is:

[0088]

[0089]

[0090] The chroma upsampling values ​​at other positions of the image can be obtained in the same way as above.

[0091] Step S704, the YUV444 to RGB format conversion module uses the SDTV standard based on BT.601-6 of the digital television to convert the YUV444 information of each frame of the video image into RGB format, and the formula is as follows:

[0092]

[0093] Finally, the RGB information of each frame of video image is output.

[0094] The application scenarios of the above-mentioned embodiments of the present invention include: video image transmission scenarios, such as video conferencing, cloud desktop and other scenarios, as well as live broadcasting, cloud sharing and other scenarios that require real-time transmission of video image data.

[0095] The above-mentioned embodiments of the present invention are applicable to products related to the field of video transmission.

[0096] Video conferencing refers to a meeting in which people in two or more locations have face-to-face conversations through communication equipment and networks. Video conferencing requires a stable and secure network, reliable conference quality, and a formal conference environment. Therefore, it is necessary to use professional video conferencing equipment and build a dedicated video conferencing system. Real-time sharing of pages or video conversations in a meeting involves the real-time transmission of video image data.

[0097] Cloud desktop, also known as desktop virtualization or cloud computer, is a new model that replaces traditional computers. After adopting cloud desktop, users no longer need to buy a computer host. The CPU, memory, hard disk and other components contained in the host are all virtualized in the back-end server. When using cloud desktop in real time, it involves the real-time transmission of desktop video image data.

[0098] Through the restoration method in the above embodiment of the present invention, the restored RGB video image has improved chromaticity restoration compared with other restoration algorithms, and the CPSNR index is improved by 0.8dB compared with the closest existing technology.

[0099] In an embodiment of the present invention, an average downsampling method is used for YUV chromaticity downsampling, which can retain chromaticity information as much as possible and reduce the loss of chromaticity information; an idea of ​​image pixel correlation based on Gaussian distribution is established, which can fully consider the influence of the domain downsampling value on the chromaticity of the interpolated position, improve the idea of ​​linear interpolation of image chromaticity, significantly improve the performance of chromaticity information at the receiving end, enhance user experience, ensure lossless brightness information, and avoid brightness errors; and ensure that a narrower video data transmission bandwidth is consumed, thereby improving transmission efficiency.

[0100] An embodiment of the present invention further provides a computer-readable storage medium, in which a computer program is stored, wherein the computer program is configured to execute the steps of any of the above method embodiments when running.

[0101] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk.

[0102] An embodiment of the present invention further provides an electronic device, including a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the steps in any one of the above method embodiments.

[0103] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0104] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail herein.

[0105] Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general computing device, they can be concentrated on a single computing device, or distributed on a network composed of multiple computing devices, they can be implemented by a program code executable by a computing device, so that they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be executed in a different order than here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.

[0106] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A method for restoring the chromaticity of a video image, characterized in that: include: Based on the distance parameter between adjacent pixel blocks, the chromaticity information of the video image in the second YUV format is up-sampled by a Gaussian distribution up-sampling method to restore the chromaticity information of the video image and obtain the video image in the first YUV format.

2. The method according to claim 1, characterized in that Before up-sampling the chrominance information of the video image in the second YUV format by using the Gaussian distribution up-sampling method, the method further includes: Reading the RGB format of each frame of video image from the received video, and converting the RGB format of the video image into a first YUV format; The chrominance information of the video image in the first YUV format is down-sampled to obtain the video image in the second YUV format, and the video is transmitted in the second YUV format.

3. The method according to claim 2, characterized in that Downsampling the chrominance information of the video image in the first YUV format to obtain a video image in a second YUV format includes: The chrominance information of the video image in the first YUV format is downsampled by an average downsampling method.

4. The method according to claim 3, characterized in that: in, When downsampling the chrominance information of the video image in the first YUV format, the chrominance average value of all pixels in a pixel block of a preset size is taken as the chrominance downsampling value.

5. The method according to claim 4, characterized in that in, When upsampling the chroma information of the video image in the second YUV format, a chroma upsampling value is determined based on interpolation of the chroma downsampling value.

6. The method according to claim 1, characterized in that Based on the distance parameter between adjacent pixel blocks, upsampling the chrominance information of the video image in the second YUV format by a Gaussian distribution upsampling method includes: Based on the distance parameter between the adjacent pixel blocks, the connection between different pixels is converted into a Gaussian distribution probability density function with position as a parameter; Determine the influence weight of each chroma downsampling value on different pixels by using the Gaussian distribution probability density function; Based on the influence weights of the chroma down-sampling values ​​on different pixels, an up-sampling value of each pixel block is determined to up-sample the chroma information of the video image in the second YUV format.

7. The method according to claim 1, characterized in that After obtaining the video image in the first YUV format, the method further includes: The video image in the first YUV format is converted into RGB format, and the obtained video image in RGB format is used for user terminal display.

8. A chromaticity restoration device for a video image, characterized in that: include: The upsampling module is used to upsample the chrominance information of the video image in the second YUV format by a Gaussian distribution upsampling method based on the distance parameter between adjacent pixel blocks to restore the chrominance information of the video image and obtain the video image in the first YUV format.

9. The device according to claim 8, characterized in that Also includes: A first conversion module, used for reading the RGB format of each frame of video image from the received video, and converting the RGB format of the video image into a first YUV format; The down-sampling module is used to down-sample the chrominance information of the video image in the first YUV format to obtain the video image in the second YUV format, and transmit the video in the second YUV format.

10. The device according to claim 8, characterized in that Also includes: The second conversion module is used to convert the video image in the first YUV format into RGB format, and use the obtained video image in RGB format for user terminal display.

11. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores a computer program, wherein the computer program implements the steps of the method described in any one of claims 1 to 7 when executed by a processor.

12. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that: When the processor executes the computer program, the steps of the method described in any one of claims 1 to 7 are implemented.

Citation Information

Patent Citations

  • Field deinterlacing method based on bilateral filtering multidirectional interpolation

    CN106303338A

  • ISP color interpolation method and device based on self-adaptive Gaussian kernel

    CN112233019A

  • Image data transmission method and device and nonvolatile storage medium

    CN113949855A

  • Video image processing method, processing equipment, electronic equipment and storage medium

    CN114025168A

  • System and Method of Image Upsampling

    US20130121568A1