Image enhancement processing method and device

Through color gamut conversion matrix coefficient processing and brightness and saturation enhancement, the color difference problem in image processing is solved, the image display effect of low color gamut terminals is improved, and the true color restoration and visual improvement of the image is achieved.

WO2024239703A1PCT designated stage expired Publication Date: 2024-11-28SANECHIPS TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/CN2024/074104
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-05-25
Filing Date
2024-01-25
Publication Date
2024-11-28

AI Technical Summary

Technical Problem

In the prior art, there is a significant color difference problem in the image processing process, especially when the low color gamut terminal is displayed, the color display effect is lower than the true color of the original image and has not been effectively solved.

Method used

The display effect of the image is improved by determining the color gamut conversion matrix coefficients of the input image and the terminal display screen, performing color gamut conversion on the image, and enhancing brightness and saturation in the YUV color space.

Benefits of technology

It effectively solves the chromatic aberration problem of image display, especially in low color gamut terminals, which significantly improves the brightness and saturation of the image, and improves the display authenticity and visual quality of the image.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN2024074104_28112024_PF_FP_ABST
    Figure CN2024074104_28112024_PF_FP_ABST
Patent Text Reader

Abstract

Embodiments of the present disclosure provide an image enhancement processing method and device. The method comprises: determining a gamut conversion matrix coefficient according to a gamut of an input image and a gamut of a display screen of a terminal; performing gamut conversion on the input image according to the gamut conversion matrix coefficient to obtain a converted input image; and performing brightness and saturation enhancement processing on the converted input image to obtain an output image. The problems in the prior art that the display of images exhibit an obvious color difference during image processing, and a color display effect during displaying of a low-gamut terminal is lower than the true colors of an original image a can be solved. Conversion between gamuts of different input images and gamuts of terminals having different gamut coverage rates is realized by means of gamut conversion matrix coefficients, the true colors of images can be better restored, and the image brightness and saturation can be quickly enhanced.
Need to check novelty before this filing date? Find Prior Art

Description

Image enhancement processing method and device

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This disclosure is based on Chinese patent application CN2023106037901 filed on May 25, 2023, entitled “A Method and Device for Image Enhancement Processing”, and claims the priority of the patent application, and all the contents disclosed therein are incorporated into this disclosure by reference. Technical Field

[0003] The present disclosure relates to the field of image processing, and more particularly, to an image enhancement processing method and apparatus. Background Art

[0004] In the current image processing field, the color gamut conversion relationship and conversion parameters are calculated based on the color gamut of the display screen and the coordinate information of the three primary colors of the target color gamut, and the image display has obvious color difference problems; when displayed on a low color gamut terminal (80% and below SRGB color gamut coverage), the color display effect is lower than the true color of the original image.

[0005] There is no solution to the problem that in the image processing process in the related art, the image display has obvious color difference, and when displayed on a low color gamut terminal, the color display effect is lower than the true color of the original image.

[0006] Summary of the Invention

[0007] The embodiments of the present disclosure provide an image enhancement processing method and device to at least solve the problem in the related art that the image display has obvious color difference during the image processing process, and the color display effect is lower than the true color of the original image when displayed on a low color gamut terminal.

[0008] According to one embodiment of the present disclosure, an image enhancement processing method is provided, the method comprising: determining a color gamut conversion matrix coefficient based on the color gamut of an input image and the color gamut of a display screen of a terminal; performing color gamut conversion on the input image according to the color gamut conversion matrix coefficient to obtain a converted input image; and performing brightness and saturation enhancement processing on the converted input image to obtain an output image.

[0009] According to another embodiment of the present disclosure, an image enhancement processing device is also provided, which includes: a determination module, configured to determine the color gamut conversion matrix coefficients based on the color gamut of the input image and the color gamut of the terminal display screen; a color gamut conversion module, configured to perform color gamut conversion on the input image according to the color gamut conversion matrix coefficients to obtain a converted input image; and an enhancement processing module, configured to perform brightness and saturation enhancement processing on the converted input image to obtain an output image.

[0010] According to another embodiment of the present disclosure, a computer-readable storage medium is provided, in which a computer program is stored. The computer program is configured to execute the steps of any one of the above method embodiments when running.

[0011] According to another embodiment of the present disclosure, an electronic device is provided, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any one of the above method embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] FIG1 is a hardware structure block diagram of a computer device for an image enhancement processing method according to an embodiment of the present disclosure;

[0013] FIG2 is a flowchart of an image enhancement processing method according to an embodiment of the present disclosure;

[0014] FIG3 is a flowchart of an image enhancement processing method according to an optional embodiment of the present disclosure;

[0015] FIG4 is a flowchart of a method for color enhancement display of a terminal across a color gamut according to an embodiment of the present disclosure;

[0016] FIG5 is a block diagram of an image enhancement processing apparatus according to an embodiment of the present disclosure;

[0017] FIG6 is a block diagram of an image enhancement processing apparatus according to an optional embodiment of the present disclosure. DETAILED DESCRIPTION

[0018] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings and in conjunction with embodiments.

[0019] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence.

[0020] The method embodiments provided in the embodiments of the present disclosure can be executed in a computer device or a similar computing device. Taking operation on a computer device as an example, FIG1 is a hardware structure block diagram of a computer device of the image enhancement processing method of the embodiment of the present disclosure. As shown in FIG1 , the computer device may include one or more (only one is shown in FIG1 ) processors 102 (the processor 102 may include but is not limited to a processing device such as a microprocessor MCU or a programmable logic device) and a memory 104 for storing data, wherein the above-mentioned computer device may also include a transmission device 106 and an input and output device 108 for communication functions. It can be understood by those skilled in the art that the structure shown in FIG1 is only for illustration and does not limit the structure of the above-mentioned computer device. For example, the computer device may also include more or fewer components than those shown in FIG1 , or have a configuration different from that shown in FIG1 .

[0021] The memory 104 can be used to store computer programs, for example, software programs and modules of application software, such as the computer program corresponding to the image enhancement processing method in the embodiment of the present disclosure. The processor 102 executes various functional applications and single-board matching by running the computer program stored in the memory 104, that is, implementing the above-mentioned method. The memory 104 may include a high-speed random access memory and may also include a non-volatile memory, such as one or more magnetic storage devices, flash memory, or other non-volatile solid-state memory. In some examples, the memory 104 may further include a memory remotely located relative to the processor 102, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0022] The transmission device 106 is used to receive or send data via a network. A specific example of the aforementioned network may include a wireless network provided by a communications provider of a computer device. In one embodiment, the transmission device 106 includes a network interface controller (NIC), which can be connected to other network devices via a base station to enable communication with the Internet. In another embodiment, the transmission device 106 may be a radio frequency (RF) module, which is used to communicate with the Internet wirelessly.

[0023] In this embodiment, an image enhancement processing method running on the above-mentioned computer device is provided. FIG2 is a flow chart of the image enhancement processing method according to an embodiment of the present disclosure. As shown in FIG2 , the flow chart includes the following steps:

[0024] Step S202, determining color gamut conversion matrix coefficients according to the color gamut of the input image and the color gamut of the terminal display screen;

[0025] In this embodiment, the above step S202 may specifically include:

[0026] S2021, detecting the three primary colors and white point coordinate information of the color gamut of the input image and the three primary colors and white point coordinate information of the color gamut of the terminal display screen respectively;

[0027] S2022: Determine a conversion matrix for converting the color gamut of the input image into an XYZ color space based on the three primary colors of the color gamut of the input image and the white point coordinate information, and determine a conversion matrix for converting the color gamut of the terminal's display screen into an XYZ color space based on the three primary colors of the color gamut of the terminal's display screen and the white point coordinate information;

[0028] S2023 , determining a color gamut conversion matrix coefficient as a product of a conversion matrix for converting the color gamut of the input image to the XYZ color space and an inverse matrix of a conversion matrix for converting the color gamut of the display screen of the terminal to the XYZ color space.

[0029] Furthermore, the above step S2022 may specifically include:

[0030] The conversion matrix from the color gamut of the input image to the XYZ color space is determined by the following formula:

[0031] The conversion matrix from the terminal's display color gamut to the XYZ color space is determined using the following formula:

[0032] Among them, M1 is the conversion matrix of the color gamut of the input image to the XYZ color space, M2 is the conversion matrix of the terminal display screen color gamut to the XYZ color space, and the three primary colors and white point coordinate information of the color gamut of the input image are expressed as R1(r x1 ,r y1 ,r z1 )、G1(g x1 ,g y1 ,g z1 )、B1(b x1 ,b y1 ,b z1 )、W1(w x1 ,w y1 ,w z1 ), the three primary colors and white point coordinate information of the terminal display screen color gamut are expressed as R2(r x2 ,r y2 ,r z2 )、G2(g x2 ,g y2 ,g z2 )、B2(b x2 ,b y2 ,b z2)、W2(w x2 ,w y2 ,w z2 ).

[0033] Step S204, performing color gamut conversion on the input image according to the color gamut conversion matrix coefficients to obtain a converted input image;

[0034] Step S206 , performing brightness and saturation enhancement processing on the converted input image to obtain an output image.

[0035] In this embodiment, the above step S206 may specifically include:

[0036] S2061, converting the processed normalized nonlinear RGB electrical signal into the YUV domain to obtain the Y channel value, U channel value, and V channel value of the input image;

[0037] S2062, performing brightness and saturation enhancement processing on the Y channel value, U channel value, and V channel value of the input image according to a pre-configured brightness enhancement coefficient and a pre-set saturation enhancement coefficient to obtain enhanced Y channel value, U channel value, and V channel value;

[0038] Furthermore, the above-mentioned S2062 may specifically include: determining the enhanced Y channel value by multiplying the above-mentioned brightness enhancement coefficient and the Y channel value of the input image; determining the enhanced U channel value by multiplying the saturation enhancement coefficient and the U channel value of the input image; and determining the enhanced V channel value by multiplying the saturation enhancement coefficient and the V channel value of the input image.

[0039] S2063 , converting the enhanced Y channel value, U channel value, and V channel value into the RGB domain to obtain an output image.

[0040] Through the above steps S202 to S206, the problem in the related art that the image display has obvious color difference during the image processing process, and the color display effect is lower than the true color of the original image when displayed on a low color gamut terminal can be solved. Through the color gamut conversion matrix coefficient, the conversion between different input image color gamuts and terminal color gamuts with different color gamut coverage rates can be realized, which can restore the true color of the image to a higher degree and can quickly enhance the brightness and saturation of the image.

[0041] FIG3 is a flow chart of an image enhancement processing method according to an optional embodiment of the present disclosure. As shown in FIG3 , the above step S204 may specifically include:

[0042] Step S302, performing electro-optical conversion on the input image to obtain a linear RGB display light signal of the input image;

[0043] In an optional embodiment, the above step S302 may specifically include:

[0044] S3021, normalizing the nonlinear RGB electrical signal of the input image according to the digital RGB values ​​of the input image to obtain a normalized nonlinear RGB electrical signal. Specifically, determining a maximum pixel value according to the bit width of the input image, and determining the ratio of the digital RGB value of the input image to the maximum pixel value as the normalized nonlinear RGB electrical signal;

[0045] S3022: Perform electro-optical conversion on the normalized nonlinear RGB electrical signal to obtain a linear RGB display light signal. Specifically, when the input image is a standard dynamic range (SDR) image, perform electro-optical conversion on the normalized nonlinear RGB electrical signal to obtain a linear RGB display light signal using the following formula:

[0046] When the input image is a High Dynamic Range (HDR) image, the normalized nonlinear RGB electrical signal is converted into a linear RGB display light signal using the following formula:

[0047] Wherein, E′1 represents the normalized nonlinear RGB electrical signal, O1 and Y1 represent the linear RGB display light signal, γ is a preset constant, m1=0.1593017578125, m2=78.84375, c1=0.8359375, c2=18.8515625, c3=18.6875.

[0048] Step S304, performing color gamut conversion on the linear RGB display light signal according to the color gamut conversion matrix coefficient to obtain a converted linear RGB display light signal;

[0049] Furthermore, the linear RGB display light signal is converted into a color gamut by the following formula to obtain a converted linear display light signal:

[0050] Among them, R in , G in 、B in is a linear RGB display light signal, R out , G out 、B out is the converted linear RGB display light signal, M1 is the conversion matrix from the color gamut of the RGB image to the XYZ color space, M2 is the conversion matrix from the color gamut of the terminal display screen to the XYZ color space, and the color gamut conversion matrix coefficient is the product of the conversion matrix from the color gamut of the input image to the XYZ color space and the inverse matrix of the conversion matrix from the color gamut of the terminal display screen to the XYZ color space.

[0051] Step S306 , performing photoelectric conversion on the converted linear RGB display light signal to obtain a processed normalized nonlinear RGB electrical signal. The converted input image is the processed normalized nonlinear RGB electrical signal.

[0052] Furthermore, when the converted linear RGB display light signal is SDR, the converted linear RGB display light signal is photoelectrically converted by the following formula to obtain a processed normalized nonlinear RGB electrical signal: E'2=O2 Υ ;

[0053] When the converted linear RGB display light signal is HDR, the converted linear RGB display light signal is photoelectrically converted using the following formula to obtain a processed normalized nonlinear RGB electrical signal:

[0054] Wherein, E'2 represents the processed normalized nonlinear RGB electrical signal, O2 and Y2 represent the converted linear RGB display light signals, γ is a preset constant, m1 = 0.1593017578125, m2 = 78.84375, c1 = 0.8359375, c2 = 18.8515625, c3 = 18.6875.

[0055] The following describes this embodiment in detail by taking the above-mentioned input image as an input RGB image, the corresponding output image as an output GRB image, the above-mentioned electro-optical conversion as electro-optical conversion of an electro-optical conversion function (EOTF), and the photoelectric conversion as photoelectric conversion of an optoelectronic conversion function (OEFT).

[0056] This embodiment relates to display quality enhancement in the field of image processing, with the goal of converting the input image color gamut to the display screen color gamut (including converting high color gamut input to low color gamut output, and converting low color gamut input to high color gamut output) to better restore the true color of the image. In low-color gamut terminal displays, due to device hardware factors, the image saturation and brightness are usually low. This invention enhances the brightness and saturation of the image in the YUV color space through an adjustable matrix method to improve the human sensory quality. Figure 4 is a flow chart of the cross-color gamut terminal color enhancement display method according to an embodiment of the present disclosure, as shown in Figure 4, including:

[0057] Step S401, obtaining an input RGB image;

[0058] Step S402, performing EOTF electro-optical conversion on the input RGB image;

[0059] The nonlinear electrical signal is converted into a linear display optical signal by:

[0060] When the input signal is SDR (Stander Dynamic Range),

[0061] When the input signal is HDR (High Dynamic Range),

[0062] Where E′1 represents the normalized nonlinear RGB electrical signal. The normalization method is to divide the digital RGB value by the maximum pixel value. For example, the digital signal value of an 8-bit image is 100, which is 100 / 255 after normalization. γ can be selected as 2.2 or 2.4. O1 represents the linear RGB display light signal. M2 = 78.84375, c1 = 0.8359375, c2 = 18.8515625, c3 = 18.6875, M1 = 0.1593017578125, and Y represents the linear RGB display light signal.

[0063] In addition to the above methods, you can also quantize and form a corresponding LUT for lookup. The LUT table calculation process is as follows: Since SDR data is usually 8-bit wide, the digital signal is normalized (such as 100 / 255) and substituted into the formula Get the normalized display light signal, and then quantize it into a digital signal (such as int(0.5*255)), and then get the corresponding LUT table;

[0064] Since HDR data is usually 10 bits wide, the digital signal is normalized (such as 100 / 1023) and substituted into the above formula The normalized display light signal is obtained and then quantized into a digital signal (such as int(0.5*1023)), thereby obtaining the corresponding LUT table.

[0065] Step S403, calculating the color gamut conversion matrix coefficients and performing color gamut conversion according to the color gamut conversion matrix coefficients;

[0066] Use software or other methods to detect the input image color gamut and the three primary colors and white point coordinate information of the terminal display color gamut. The input image color gamut information is expressed as R in (r x1 ,r y1 ,r z1 ), G in (g x1 ,g y1 ,g z1 ), B in (b x1 ,b y1 ,b z1 ), Win (w x1 ,w y1 ,w z1 ), the terminal display color gamut information is represented by R out (r x2 ,r y2 ,r z2 ), G out (g x2 ,g y2 ,g z2 ), B out (b x2 ,b y2 ,b z2 ), W out (w x2 ,w y2 ,w z2 ), using the XYZ color space as the intermediate space, the calculation method for converting the input image color space to XYZ is as follows:

[0067] Solve the three-variable linear equation according to the above formula to obtain the x, y, and z values. The matrix on the right side of the equal sign is the input image color gamut to XYZ color space matrix M1. The terminal display color gamut is converted to XYZ calculation method as follows:

[0068] Solve the three-variable linear equation according to the above formula to obtain the x, y, and z values. The matrix on the right side of the equal sign is the terminal display color gamut conversion XYZ color space matrix M2.

[0069] Where R in , G in 、B in is the linear display light signal corresponding to the calculated input color gamut, R out , G out 、B out is the linear display light signal corresponding to the converted display color gamut, M1 is the conversion matrix from the color gamut of the RGB image to the XYZ color space, and M2 is the conversion matrix from the color gamut of the terminal display screen to the XYZ color space.

[0070] Step S404, performing OEFT photoelectric conversion;

[0071] The linear display optical signal is converted into a nonlinear electrical signal using the following formula:

[0072] When the output signal is SDR, E′2=O2 Υ ;

[0073] When the output signal is HDR,

[0074] Where E′2 represents the normalized nonlinear RGB electrical signal; γ can be selected as 1 / 2.2 or 1 / 2.4; O2 represents the linear RGB display light signal; m1 = 0.1593017578125, m2 = 78.84375, c1 = 0.8359375, c2 = 18.8515625, c3 = 18.6875, and Y represents the linear RGB display light signal. Quantization can also be performed to form a corresponding LUT for lookup.

[0075] Step S405 , performing image enhancement based on matrix-enhanced brightness and saturation to obtain an output RGB image.

[0076] First, convert from RGB domain to YUV domain by the following method: y=(54*r+183*g+18*b+128)>>8 u=((-29*r-99*g+128*b+128)>>8)+128 v=((128*r-116*g-12*b+128)>>8)+128;

[0077] Where r, g, and b are the digital signal values ​​of r, g, and b, which are calculated by multiplying the normalized RGB value by the maximum value of the pixel. For example, if the normalized signal value of an 8-bit image is 0.1, the corresponding digital signal value is int(0.1*255). y, u, and v represent the y, u, and v channel values ​​of the converted pixel.

[0078] Afterwards, the following formula is used to enhance the brightness and saturation of the y, u, and v channel values ​​of the converted pixels in the YUV domain based on the pre-configured brightness enhancement coefficient and the set saturation enhancement coefficient:

[0079] Where l_en represents the brightness enhancement coefficient, a floating-point value in the range [1, 2]. s_en represents the saturation enhancement coefficient, a floating-point value in the range [1, 2]. This matrix parameter can be manually adjusted by the user. The output Y value is the input Y value multiplied by the l_en coefficient, the output U value is the input U value multiplied by the s_en coefficient, and the output V value is the input V value multiplied by the s_en coefficient.

[0080] Finally, the output image is converted from the YUV domain back to the RGB domain using the following formula: r = (256*y + 403*(v-128) + 128) >> 8 g ​​= (256*y-48*(u-128)-416*(v-128) + 128) >> 8 b = (256*y + 475*(u-128) + 128) >> 8;

[0081] Where y, u, and v are the enhanced y, u, and v digital signal values, and r, g, and b represent the r, g, and b channel values ​​of the converted pixel.

[0082] According to another aspect of the present disclosure, an image enhancement processing device is further provided. FIG5 is a block diagram of the image enhancement processing device according to the present disclosure. As shown in FIG5 , the device includes:

[0083] A determination module 52 is configured to determine color gamut conversion matrix coefficients based on the color gamut of the input image and the color gamut of the terminal display screen;

[0084] A color gamut conversion module 54 is configured to perform color gamut conversion on the input image according to the color gamut conversion matrix coefficients to obtain a converted input image;

[0085] The enhancement processing module 56 is configured to perform brightness and saturation enhancement processing on the converted input image to obtain an output image.

[0086] FIG6 is a block diagram of an image enhancement processing device according to an optional embodiment of the present disclosure. As shown in FIG6 , the color gamut conversion module 54 includes:

[0087] The electro-optical conversion submodule 62 is configured to perform electro-optical conversion on the input image to obtain a linear RGB display light signal of the input image;

[0088] a color gamut conversion submodule 64 configured to perform color gamut conversion on the linear RGB display light signal according to the color gamut conversion matrix coefficients to obtain a converted linear RGB display light signal;

[0089] The photoelectric conversion submodule 66 is configured to perform photoelectric conversion on the converted linear RGB display light signal to obtain a processed normalized nonlinear RGB electrical signal, wherein the converted input image is the processed normalized nonlinear RGB electrical signal.

[0090] In one embodiment, the electro-optical conversion submodule 62 includes:

[0091] a normalization unit configured to perform normalization processing on the nonlinear RGB electrical signal of the input image according to the digital RGB value of the input image to obtain a normalized nonlinear RGB electrical signal;

[0092] The electro-optical conversion unit is configured to perform electro-optical conversion on the normalized nonlinear RGB electrical signal to obtain the linear RGB display light signal.

[0093] In one embodiment, the normalization unit is further configured to determine a pixel maximum value according to a bit width of the input image; and determine a ratio of a digital RGB value of the input image to the pixel maximum value as the normalized nonlinear RGB electrical signal.

[0094] In one embodiment, the electro-optical conversion unit is further configured to, when the input image is a standard dynamic range (SDR) image, perform electro-optical conversion on the normalized nonlinear RGB electrical signal using the following formula to obtain the linear RGB display light signal:

[0095] When the input image is a high dynamic range (HDR) image, the normalized nonlinear RGB electrical signal is electro-optically converted using the following formula to obtain the linear RGB display light signal:

[0096] Wherein, E′1 represents the normalized nonlinear RGB electrical signal, O1 and Y1 represent the linear RGB display light signal, γ is a preset constant, m1=0.1593017578125, m2=78.84375, c1=0.8359375, c2=18.8515625, c3=18.6875.

[0097] In one embodiment, the color gamut conversion submodule 64 is further configured to

[0098] The linear RGB display light signal is subjected to color gamut conversion by the following formula to obtain the converted linear display light signal:

[0099] Among them, R in , G in 、B in For the linear RGB display light signal, R out , G out 、B out is the converted linear RGB display light signal, M1 is the conversion matrix of the color gamut of the RGB image to the XYZ color space, M2 is the conversion matrix of the color gamut of the terminal's display screen to the XYZ color space, and the color gamut conversion matrix coefficient is the product of the conversion matrix of the color gamut of the input image to the XYZ color space and the inverse matrix of the conversion matrix of the color gamut of the terminal's display screen to the XYZ color space.

[0100] In one embodiment, the photoelectric conversion submodule 66 is further configured to perform photoelectric conversion on the converted linear RGB display light signal according to the following formula when the converted linear RGB display light signal is SDR to obtain the processed normalized nonlinear RGB electrical signal: E'2=O2 Υ ;

[0101] When the converted linear RGB display light signal is HDR, the converted linear RGB display light signal is photoelectrically converted using the following formula to obtain the processed normalized nonlinear RGB electrical signal:

[0102] Wherein, E'2 represents the processed normalized nonlinear RGB electrical signal, O2 and Y2 represent the converted linear RGB display light signal, γ is a preset constant, m1=0.1593017578125, m2=78.84375, c1=0.8359375, c2=18.8515625, c3=18.6875.

[0103] In one embodiment, the enhancement processing module 56 includes:

[0104] A first conversion submodule is configured to convert the processed normalized nonlinear RGB electrical signal into a YUV domain to obtain a Y channel value, a U channel value, and a V channel value of the input image;

[0105] an enhancement processing submodule, configured to perform brightness and saturation enhancement processing on the Y channel value, U channel value, and V channel value of the input image according to a pre-configured brightness enhancement coefficient and a pre-configured saturation enhancement coefficient, to obtain enhanced Y channel value, U channel value, and V channel value;

[0106] The second conversion submodule is configured to convert the enhanced Y channel value, U channel value, and V channel value into an RGB domain to obtain the output image.

[0107] In one embodiment, the enhancement processing submodule is further configured to determine the enhanced Y channel value by multiplying the brightness enhancement coefficient and the Y channel value of the input image; determine the enhanced U channel value by multiplying the saturation enhancement coefficient and the U channel value of the input image; and determine the enhanced V channel value by multiplying the saturation enhancement coefficient and the V channel value of the input image.

[0108] In one embodiment, the determination module 52 includes:

[0109] a detection submodule, configured to respectively detect the three primary colors and white point coordinate information of the color gamut of the input image, and the three primary colors and white point coordinate information of the color gamut of the display screen of the terminal;

[0110] a first determination submodule, configured to determine a conversion matrix for converting the color gamut of the input image into an XYZ color space based on the three primary colors and white point coordinate information of the color gamut of the input image, and to determine a conversion matrix for converting the color gamut of the display screen of the terminal into the XYZ color space based on the three primary colors and white point coordinate information of the color gamut of the display screen of the terminal;

[0111] The second determination submodule is configured to determine the product of the conversion matrix of the input image's color gamut to XYZ color space and the inverse matrix of the conversion matrix of the terminal's display screen's color gamut to XYZ color space as the color gamut conversion matrix coefficient.

[0112] In one embodiment, the first determining submodule is further configured to:

[0113] The conversion matrix of the color gamut of the input image to the XYZ color space is determined by the following formula:

[0114] The conversion matrix from the terminal's display screen color gamut to the XYZ color space is determined by the following formula:

[0115] Wherein, M1 is the conversion matrix of the color gamut of the input image to the XYZ color space, M2 is the conversion matrix of the color gamut of the terminal display screen to the XYZ color space, and the three primary colors and white point coordinate information of the color gamut of the input image are expressed as R1(r x1 ,r y1 ,r z1 )、G1(g x1 ,g y1 ,g z1 )、B1(b x1 ,b y1 ,b z1 )、W1(w x1 ,w y1 ,w z1 ), the three primary colors and white point coordinate information of the display screen color gamut of the terminal are expressed as R2(r x2 ,r y2 ,r z2 )、G2(g x2 ,g y2 ,g z2 )、B2(b x2 ,b y2 ,b z2 )、W2(w x2 ,w y2 ,w z2 ).

[0116] An embodiment of the present disclosure further provides a computer-readable storage medium, in which a computer program is stored. The computer program is configured to execute the steps of any one of the above method embodiments when run.

[0117] In an exemplary embodiment, the computer-readable storage medium may include, but is not limited to, various media that can store computer programs, such as a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk, or an optical disk.

[0118] An embodiment of the present disclosure further provides an electronic device, including a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any one of the above method embodiments.

[0119] In an exemplary embodiment, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0120] For specific examples in this embodiment, reference may be made to the examples described in the above embodiments and exemplary implementation modes, and this embodiment will not be described in detail here.

[0121] Obviously, those skilled in the art should understand that the modules or steps of the present disclosure described above can be implemented using a general-purpose computing device, they can be concentrated on a single computing device, or distributed across a network composed of multiple computing devices, they can be implemented using program code executable by the computing device, and thus, they can be stored in a storage device and executed by the computing device, and in some cases, the steps shown or described can be performed in a different order than herein, or they can be fabricated into separate integrated circuit modules, or multiple modules or steps can be fabricated into a single integrated circuit module for implementation. Thus, the present disclosure is not limited to any particular combination of hardware and software.

[0122] The foregoing description is merely a preferred embodiment of the present disclosure and is not intended to limit the present disclosure. Those skilled in the art will readily appreciate that various modifications and variations of the present disclosure are possible. Any modifications, equivalent substitutions, or improvements made within the principles of the present disclosure shall be included within the scope of protection of the present disclosure.

Claims

1. An image enhancement processing method, the method comprising: Determine the color gamut conversion matrix coefficients according to the color gamut of the input image and the color gamut of the terminal display screen; Performing color gamut conversion on the input image according to the color gamut conversion matrix coefficients to obtain a converted input image; The converted input image is subjected to brightness and saturation enhancement processing to obtain an output image.

2. The method according to claim 1, wherein: Performing color gamut conversion on the input image according to the color gamut conversion matrix coefficients to obtain the converted input image comprises: Performing electro-optical conversion on the input image to obtain a linear RGB display light signal of the input image; Performing color gamut conversion on the linear RGB display light signal according to the color gamut conversion matrix coefficients to obtain a converted linear RGB display light signal; The converted linear RGB display light signal is subjected to photoelectric conversion to obtain a processed normalized nonlinear RGB electrical signal, wherein the converted input image is the processed normalized nonlinear RGB electrical signal.

3. The method according to claim 2, wherein: Performing electro-optical conversion on the input image to obtain a linear RGB display light signal of the input image includes: Normalizing the nonlinear RGB electrical signal of the input image according to the digital RGB value of the input image to obtain a normalized nonlinear RGB electrical signal; The normalized nonlinear RGB electrical signal is subjected to electrical-optical conversion to obtain the linear RGB display light signal.

4. The method according to claim 3, wherein: Normalizing the nonlinear RGB electrical signal of the input image according to the digital RGB value of the input image to obtain the normalized nonlinear RGB electrical signal includes: Determine a pixel maximum value according to the bit width of the input image; The ratio of the digital RGB value of the input image to the maximum value of the pixel is determined as the normalized nonlinear RGB electrical signal.

5. The method according to claim 3, wherein: Performing electro-optical conversion on the normalized nonlinear RGB electrical signal to obtain the linear RGB display light signal comprises: When the input image is a standard dynamic range SDR image, the normalized nonlinear RGB electrical signal is electro-optically converted using the following formula to obtain the linear RGB display light signal: When the input image is a high dynamic range HDR image, the normalized nonlinear RGB electrical signal is electro-optically converted using the following formula to obtain the linear RGB display light signal: Wherein, E′1 represents the normalized nonlinear RGB electrical signal, O1 and Y1 represent the linear RGB display light signals, γ is a preset constant, m1=0.1593017578125, m2=78.84375, c1=0.8359375, c2=18.8515625, c3=18.6875.

6. The method according to claim 2, wherein: Performing color gamut conversion on the linear RGB display light signal according to the color gamut conversion matrix coefficients to obtain the converted linear RGB display light signal comprises: The linear RGB display light signal is converted into a color gamut by the following formula to obtain the converted linear display light signal: Among them, R in , G in , B in For the linear RGB display light signal, R out , G out , B out is the converted linear RGB display light signal, M1 is the conversion matrix of the color gamut of the RGB image to the XYZ color space, M2 is the conversion matrix of the display screen color gamut of the terminal to the XYZ color space, and the color gamut conversion matrix coefficient is the product of the conversion matrix of the color gamut of the input image to the XYZ color space and the inverse matrix of the conversion matrix of the display screen color gamut of the terminal to the XYZ color space.

7. The method according to claim 2, wherein: Performing photoelectric conversion on the converted linear RGB display light signal to obtain the processed normalized nonlinear RGB electrical signal comprises: When the converted linear RGB display light signal is SDR, the converted linear RGB display light signal is photoelectrically converted by the following formula to obtain the processed normalized nonlinear RGB electrical signal: E'2=O2 Υ ; When the converted linear RGB display light signal is HDR, the converted linear RGB display light signal is photoelectrically converted by the following formula to obtain the processed normalized nonlinear RGB electrical signal: Wherein, E'2 represents the processed normalized nonlinear RGB electrical signal, O2 and Y2 represent the converted linear RGB display light signals, γ is a preset constant, m1=0.1593017578125, m2=78.84375, c1=0.8359375, c2=18.8515625, c3=18.6875.

8. The method according to claim 2, wherein: The converted input image is subjected to brightness and saturation enhancement processing to obtain an output image including: Converting the processed normalized nonlinear RGB electrical signal into a YUV domain to obtain a Y channel value, a U channel value, and a V channel value of the input image; Performing brightness and saturation enhancement processing on the Y channel value, U channel value, and V channel value of the input image according to a pre-configured brightness enhancement coefficient and a pre-set saturation enhancement coefficient to obtain enhanced Y channel value, U channel value, and V channel value; The enhanced Y channel value, U channel value, and V channel value are converted to the RGB domain to obtain the output image.

9. The method according to claim 8, wherein: According to the pre-configured brightness enhancement coefficient and the set saturation enhancement coefficient, the Y channel value, the U channel value, and the V channel value of the input image are enhanced by brightness and saturation enhancement processing, and the enhanced Y channel value, the U channel value, and the V channel value are obtained, including: Determine the product of the brightness enhancement coefficient and the Y channel value of the input image as the enhanced Y channel value; Determine an enhanced U channel value by multiplying the saturation enhancement coefficient by the U channel value of the input image; The enhanced V channel value is determined by multiplying the saturation enhancement coefficient by the V channel value of the input image.

10. The method according to any one of claims 1 to 9, wherein: Determining the color gamut conversion matrix coefficients according to the color gamut of the input image and the color gamut of the display screen of the terminal includes: Respectively detecting the three primary colors and white point coordinate information of the color gamut of the input image, and the three primary colors and white point coordinate information of the color gamut of the display screen of the terminal; Determine the conversion matrix of the color gamut of the input image into the XYZ color space according to the three primary colors of the color gamut of the input image and the white point coordinate information, and determine the display screen of the terminal according to the three primary colors of the color gamut of the display screen of the terminal and the white point coordinate information. Conversion matrix from display color gamut to XYZ color space; The product of the conversion matrix of the color gamut of the input image to the XYZ color space and the inverse matrix of the conversion matrix of the display screen of the terminal to the XYZ color space is determined as the color gamut conversion matrix coefficient.

11. The method according to claim 10, wherein: Determining a conversion matrix of the color gamut of the input image to an XYZ color space according to the three primary colors of the color gamut of the input image and the white point coordinate information, and determining a conversion matrix of the display screen color gamut of the terminal to an XYZ color space according to the three primary colors of the color gamut of the display screen of the terminal and the white point coordinate information includes: The conversion matrix of the color gamut of the input image to the XYZ color space is determined by the following formula: The conversion matrix of the terminal display screen color gamut to XYZ color space is determined by the following formula: Wherein, M1 is the conversion matrix of the color gamut of the input image to the XYZ color space, M2 is the conversion matrix of the color gamut of the display screen of the terminal to the XYZ color space, and the three primary colors and white point coordinate information of the color gamut of the input image are expressed as R1(r x1 ,r y1 ,r z1 )、G1(g x1 ,g y1 ,g z1 )、B1(b x1 ,b y1 ,b z1 )、W1(w x1 ,w y1 ,w z1 ), the three primary colors and white point coordinate information of the display screen color gamut of the terminal are expressed as R2(r x2 ,r y2 ,r z2 )、G2(g x2 ,g y2 ,g z2 )、B2(b x2 ,b y2 ,b z2 )、W2(w x2 ,w y2 ,w z2 ).

12. An image enhancement processing device, the device comprising: A determination module, configured to determine a color gamut conversion matrix coefficient according to a color gamut of an input image and a color gamut of a display screen of a terminal; A color gamut conversion module, configured to perform color gamut conversion on the input image according to the color gamut conversion matrix coefficients to obtain a converted input image; The enhancement processing module is configured to perform brightness and saturation enhancement processing on the converted input image to obtain an input image. out image.

13. A computer-readable storage medium, wherein a computer program is stored in the storage medium, wherein: The computer program is configured to execute the method according to any one of claims 1 to 11 when executed.

14. An electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the method according to any one of claims 1 to 11.

Citation Information

Patent Citations

  • Image signal conversion method and apparatus, and terminal device

    CN108370405A

  • Video signal processing method and device

    CN108882028A

  • Color gamut matching method and device, display terminal and readable storage medium

    CN109286802A

  • Color gamut conversion method and device, electronic equipment and storage medium

    CN111724324A

  • Color gamut mapping method and device, projection equipment and storage medium

    CN115174881A