Image processing apparatus, image processing method and display device

Abstract

This disclosure provides an image processing apparatus, an image processing method, and a display device, relating to the fields of display and digital video processing and analysis. The image processing apparatus includes: a first processing module configured to adjust the saturation of an image to be displayed to obtain first image data; a second processing module configured to adjust the brightness of the first image data to obtain second image data; and a third processing module configured to adjust the brightness of the second image data using brightness parameters of a display panel to obtain third image data, the third image data being output to the display panel for display.

Description

Technical Field

[0001] This disclosure relates to the fields of display and digital video processing and analysis technology, and in particular to an image processing apparatus, an image processing method, and a display apparatus. Background Technology

[0002] The principle of Organic Light Emitting Diode (OLED) displays is that organic semiconductor materials and light-emitting materials emit light through carrier injection and recombination under the drive of an electric field. During the OLED light emission process, the resistance in the circuit generates heat, and the OLED light emission also causes the surface of the display module to heat up due to light radiation.

[0003] For OLED display modules, higher power consumption in the circuitry leads to more severe heat generation. The accumulated heat from high power consumption causes the module temperature to rise. When the temperature is too high, electronic components will be rapidly damaged, reducing their lifespan and thus affecting the image display quality of the OLED module. Summary of the Invention

[0004] This disclosure provides an image processing apparatus, an image processing method, and a display device.

[0005] According to a first aspect, this disclosure provides an image processing apparatus, comprising: a first processing module configured to adjust the saturation of an image to be displayed to obtain first image data; a second processing module configured to adjust the brightness of the first image data to obtain second image data; and a third processing module configured to adjust the brightness of the second image data using brightness parameters of a display panel to obtain third image data, wherein the third image data is used to output to the display panel for display.

[0006] According to a second aspect, this disclosure provides an image processing method, comprising: adjusting the saturation of an image to be displayed to obtain first image data; adjusting the brightness of the first image data to obtain second image data; and adjusting the brightness of the second image data using brightness parameters of a display panel to obtain third image data, wherein the third image data is used to output to a display panel for display.

[0007] According to a third aspect, this disclosure provides a display device, including: a display panel; and an image processing device provided in the embodiments of this disclosure, configured to output third image data based on an image to be displayed; wherein the display panel displays the third image data.

[0008] According to a fourth aspect, this disclosure provides another display device, comprising: a processor configured to perform an image processing method provided in embodiments of this disclosure; and a display panel configured to display third image data output by the processor. Attached Figure Description

[0009] Figure 1 This is a schematic diagram of the structure of an image processing apparatus according to an embodiment of the present disclosure;

[0010] Figure 2A This is a schematic diagram of the structure of the first processing module according to an embodiment of the present disclosure;

[0011] Figure 2B This is a schematic diagram of the structure of the first processing module according to another embodiment of the present disclosure;

[0012] Figure 3 This is a schematic diagram of the structure of the second preset lookup table according to an embodiment of the present disclosure;

[0013] Figure 4A This is a schematic diagram of the structure of the second processing module according to an embodiment of the present disclosure;

[0014] Figure 4B This is a schematic diagram of the structure of the second processing module according to another embodiment of the present disclosure;

[0015] Figure 5A This is a schematic diagram of the structure of the third processing module according to an embodiment of the present disclosure;

[0016] Figure 5B This is a schematic diagram of the structure of a third processing module according to another embodiment of the present disclosure;

[0017] Figure 6 This is a schematic diagram of the structure of an image processing apparatus according to another embodiment of the present disclosure;

[0018] Figure 7 This is a flowchart of an image processing method according to an embodiment of the present disclosure;

[0019] Figure 8 This is a schematic diagram of the structure of a display device according to an embodiment of the present disclosure; and

[0020] Figure 9 This is a schematic diagram of the structure of a display device according to another embodiment of the present disclosure. Detailed Implementation

[0021] To make the objectives, technical solutions, and advantages of the embodiments of this disclosure clearer, the technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this disclosure. Based on the described embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure. It should be noted that throughout the accompanying drawings, the same elements are represented by the same or similar reference numerals. In the following description, some specific embodiments are used for descriptive purposes only and should not be construed as limiting this disclosure in any way, but are merely examples of embodiments of this disclosure. Conventional structures or configurations will be omitted where they may cause confusion in understanding this disclosure. It should be noted that the shapes and dimensions of the components in the figures do not reflect actual size and proportion, but are only schematic representations of the embodiments of this disclosure.

[0022] Unless otherwise defined, the technical or scientific terms used in the embodiments of this disclosure shall have the ordinary meaning as understood by those skilled in the art. The terms "first," "second," and similar words used in the embodiments of this disclosure do not indicate any order, quantity, or importance, but are merely used to distinguish different components.

[0023] Due to the self-emissive nature of OLEDs, power consumption in the pixel circuitry of an OLED display device only occurs when the pixels are illuminated. When displaying video and images at high brightness, the high power consumption of the pixel circuitry can cause severe overheating of the display module. Prolonged high-power operation may lead to overheating of the display module, thereby damaging the OLED light-emitting devices and shortening the lifespan of the display components within the module. Therefore, reducing the display module's power consumption is beneficial for extending its lifespan.

[0024] Based on the potential display defects of the aforementioned OLED display devices, this application optimizes the display brightness of the display module in real time. While maintaining image quality, it reduces the average display brightness of the display module, thereby reducing the display power consumption. By reducing the high power consumption and heat generation caused by excessive image brightness in the OLED display module, the aging rate of the display device can be reduced, extending the service life of the OLED display module.

[0025] Figure 1 This is a schematic diagram of the structure of an image processing apparatus according to an embodiment of the present disclosure.

[0026] like Figure 1 As shown, the image processing device 100 includes a first processing module 101, a second processing module 102, and a third processing module 103.

[0027] In this embodiment of the disclosure, the first processing module 101 adjusts the saturation of the image to be displayed to obtain first image data. The image to be displayed is the image that the display panel in the display module needs to display. For example, the image to be displayed may be a video frame image from a video that the display panel needs to display. Before the display panel displays the video frame image, the first processing module 101 adjusts the saturation of the video frame image.

[0028] In this embodiment of the disclosure, saturation indicates the vividness of the colors in the image to be displayed. Based on saturation, the intensity and vividness of colors in the image to be displayed can be determined. High saturation results in bright colors, while low saturation results in dark colors.

[0029] In this embodiment, the first processing module 101 can adjust the saturation according to the distribution characteristics of the saturation of the image to be displayed. For example, the first processing module 101 can adjust the saturation of areas with different saturation levels in the image to be displayed by different magnitudes. For example, for areas with vibrant colors, the saturation can be increased by a smaller magnitude. For areas with dull colors, the saturation can be increased by a larger magnitude. This allows the originally dull areas in the image to be displayed to retain more color details even after the brightness is reduced. The first processing module 101 enhances the saturation of the image to be displayed, so that the image to be displayed still has good color performance after the brightness is reduced.

[0030] In this embodiment of the disclosure, the second processing module 102 adjusts the brightness of the first image data to obtain second image data. For example, the first image data represents a displayable image after saturation enhancement, and the second processing module 102 adjusts the brightness of the saturation-enhanced image to reduce the image brightness. The second image data represents a displayable image after saturation enhancement and brightness reduction.

[0031] The second processing module 102 can adjust the brightness according to the specific brightness distribution in the first image data. For example, based on the brightness values ​​of regions with different brightness values ​​in the image represented by the first image data, different levels of brightness adjustment can be performed. For regions with higher brightness, the brightness can be reduced by a larger amount. For regions with lower brightness, the brightness can be reduced by a smaller amount. This can preserve the detail information in the originally lower-brightness regions while also significantly reducing the overall brightness of the image.

[0032] In this embodiment of the present disclosure, the third processing module 103 uses the brightness parameters of the display panel to adjust the brightness of the second image data to obtain the third image data, which is then output to the display panel for display.

[0033] The brightness parameter is a display parameter of the display panel. The display panel can support multiple brightness parameters, allowing it to display images based on different brightness levels. For example, the brightness parameter can be the Display Brightness Value (DBV) of the display panel. DBV has different effects on the brightness of the image displayed on the display panel; images with the same brightness value will also have different display brightness under different DBVs. The third processing module 103 reduces the brightness of the second image data based on the brightness parameters of the display panel, so that the resulting third image data is adapted to the display brightness of the display panel.

[0034] For example, the brightness parameter can be the peak brightness value of the display panel, that is, the maximum display brightness supported by the display panel. Adjusting the brightness of the second image data based on the peak brightness value of the display panel can preserve the details and color levels in the second image data to the greatest extent, thereby avoiding a reduction in display quality.

[0035] In this embodiment, the first processing module 101 and the second processing module 102 adjust the image to be displayed based on its own color and brightness. This ensures that the adjustment process meets the color and brightness characteristics of the image to be displayed, achieving adaptive adjustment of the content of the image to be displayed. The third processing module 103 adjusts the image to be displayed based on the display parameters of the display panel used to display the image. This ensures that the adjustment process meets the brightness characteristics of the display environment of the image to be displayed, achieving adaptive adjustment of the environment of the image to be displayed.

[0036] In this embodiment, the image to be displayed is dynamically adjusted based on its color and brightness to control the overall power consumption of the display module. During the adjustment process, saturation is enhanced and brightness is reduced, resulting in an overall reduction in brightness while maintaining color performance. This adjustment process ensures maximum preservation of detail in the image, including saturation, contrast, and dark areas, maintaining the same visual effect on the display panel as the original image. After saturation and brightness adjustment, the overall brightness of the image is reduced without affecting the display quality. Reducing the overall brightness also lowers the power consumption of the display module, mitigating heat generation and reducing the negative impact of power consumption on the display device.

[0037] For example, the video to be displayed on the display panel includes multiple video frame images. During the display panel's display of the video, the image processing device 100 can adjust the multiple video frame images sequentially in real time and output the adjusted video frame images sequentially, so that the adjustment of the frame image is completed before the display panel displays the video frame image, thereby achieving real-time optimization of the display image of the display module.

[0038] The process of the display panel displaying an image and the process of the image processing device 100 adjusting the video frame image can be performed synchronously. For example, when the display panel displays the first frame image, the image processing device 100 adjusts the second frame image. When the display panel displays the second frame image, the image processing device 100 adjusts the third frame image. It should be noted that this disclosure does not limit the speed at which the display panel displays the image and the image processing device 100 processes the image; the synchronous processing scenario described above is only illustrative.

[0039] In this embodiment of the disclosure, the image processing device 100 may be located within the display driver IC (DDIC) of the display device. For example, the image processing device 100 may be implemented based on a register-transfer level (RTL) design. The image processing device 100 may be packaged as an integrated circuit intellectual property core (IP core). The image processing device 100 may be disposed as an IP core on the timing controller (TCON) of the DDIC, for example, on a TCON board.

[0040] For example, the DDIC can receive video data via the Mobile Industry Processor Interface (MIPI) and the Serial Peripheral Interface (SPI). The received video data can be decompressed and sent to the data processor, or it can be buffered in the graphics RAM (GRAM). The data processor can then read the video frame data to be processed from the GRAM.

[0041] The data processor performs operations such as conversion, scaling, and color correction on video frame images from received video data. For example, the data processor can improve the brightness deviation of video frame images using a demura function. For example, the data processor receives instructions from TCON to perform format conversion, brightness adjustment, contrast adjustment, and color adjustment on video frame images. For example, the data processor can also perform current-resistance voltage drop compensation on the supply voltage ELVDD to prevent brightness differences after the converted data signal from the video frame image is written to the pixel circuit. For example, the data processor can also perform gamma correction on the video frame data to perform color correction, brightness adjustment, and contrast adjustment on the video frame image.

[0042] For example, the display image acquired by the image processing device 100 may be a video frame image that has undergone operations such as gamma correction, demura correction, color correction, contrast adjustment, brightness adjustment, and format conversion. The image processing device 100 adjusts the received video frame, thereby reducing the brightness of the video frame image.

[0043] For example, the third image data output by the image processing device 100 may be grayscale values, etc. The image processing device 100 sends the third image data to the source driver IC. The source driver IC converts the third image data into a data signal based on the timing control signal provided by the TCON. The data signal is written into the pixel circuit of the display panel, thereby displaying the image represented by the third image data through the display panel.

[0044] Combination Figure 2A The process of saturation adjustment performed by the first processing module is illustrated. Figure 2A This is a schematic diagram of the structure of the first processing module according to an embodiment of the present disclosure.

[0045] In this embodiment of the disclosure, the method for the first processing module to adjust the saturation of the image to be displayed may include: calculating the pixel values ​​of the pixels in the image to be displayed based on a first preset parameter to obtain a target correction coefficient for the pixels; calculating the pixel values ​​to obtain saturation data of the pixels; calculating the saturation data and the target correction coefficient to obtain a first adjustment coefficient for the pixels; and adjusting the saturation of the pixel values ​​using the first adjustment coefficient to output first image data.

[0046] like Figure 2A As shown, the first processing module 201a may include a first arithmetic unit 211, a second arithmetic unit 212, a third arithmetic unit 213, and a first regulator 214. The first arithmetic unit 211, the second arithmetic unit 212, the third arithmetic unit 213, and the first regulator 214 are used to adjust the saturation of the image to be displayed.

[0047] In this embodiment, the first processing module 201a adjusts the saturation of multiple pixels in the image to be displayed. For any pixel among the multiple pixels in the image to be displayed, the first arithmetic unit 211 adjusts the saturation based on a first preset parameter param. sat The first arithmetic unit 212 calculates the pixel value (RGB) of the pixel and outputs the target correction coefficient (k2) for that pixel. The second arithmetic unit 212 calculates the pixel value (RGB) of the pixel and outputs the saturation data (sat) of the pixel. The third arithmetic unit 213 calculates the saturation data (sat) of the pixel and the target correction coefficient (k2) for that pixel and outputs the first adjustment coefficient (ratio) for that pixel. sat The first regulator 214 utilizes the first adjustment coefficient ratio. sat Adjust the saturation of the pixel value (RGB) for that pixel and output the first pixel value (RGB) for that pixel. sat The first image data includes the first pixel values ​​(RGB) of all pixels in the image to be displayed. sat .

[0048] In this embodiment of the disclosure, the first preset parameter param sat Indicates the adjustment range of saturation. First preset parameter (param) sat It can be preset, for example, the first preset parameter param sat The value can be obtained by observing and adjusting the display effect of the display panel. The first preset parameter, param, is determined while satisfying the user's visual experience. sat Numerical value. For example, during the debugging process of a display product, the debugging determines the first preset parameter param. sat The value, and the first preset parameter param sat The parameter is programmed into the chip. During the use of the display product, the first arithmetic unit 211 reads the first preset parameter param. sat And perform related calculations to output the target correction coefficient k2 for that pixel.

[0049] In this embodiment of the disclosure, the adjustment range of the pixel value by the first processing module 201 is related to the first preset parameter param. sat The values ​​can be positively correlated. When the first preset parameter param sat The larger the value, the more pronounced the saturation adjustment effect. The first arithmetic unit 211 is based on the same first preset parameter param. sat Calculate the target correction coefficient k2 for each pixel in the image to be displayed, which ensures the uniformity of saturation adjustment in the image to be displayed.

[0050] In this embodiment, the pixel value is the RGB pixel value. The second arithmetic unit 212 determines the color vibrancy of the pixel based on the difference between the maximum and minimum values ​​of the RGB pixel values, thereby calculating the pixel's saturation data (sat). The third arithmetic unit 213 calculates a first adjustment coefficient (ratio) for the pixel based on the pixel's own saturation data (sat) and a target correction coefficient (k2) for that pixel. sat The first adjustment coefficient ratio sat It is adapted to the pixel value of the pixel itself.

[0051] The first adjustment coefficient (ratio) of each pixel in the image to be displayed sat Each pixel's initial adjustment coefficient (ratio) is determined based on its own pixel value, thus allowing each pixel to have its own initial adjustment coefficient (ratio). sat Each pixel is adapted to its own color characteristics, based on multiple pixels at their respective first adjustment coefficients (ratios). sat Saturation adjustment is performed on multiple pixels to make the adjusted first pixel value RGB. sat It can preserve the color characteristics of the pixels themselves.

[0052] Figure 2B This is a schematic diagram of the structure of a first processing module according to another embodiment of the present disclosure.

[0053] like Figure 2B As shown, the first processing module 201b includes a first arithmetic unit 211, a second arithmetic unit 212, a third arithmetic unit 213, a first regulator 214, and a first delay unit 215.

[0054] In this embodiment of the disclosure, the first delayer 215 includes a maximum value operator Max, a minimum value operator Min, an average value operator Avg, a trigger FF1, and a trigger FF2.

[0055] For any pixel value in the image to be displayed, the maximum value operator Max determines the maximum value among the RGB pixel values ​​of the pixel, the minimum value operator Min determines the minimum value among the RGB pixel values ​​of the pixel, and the average value operator Avg determines the average value among the RGB pixel values ​​of the pixel.

[0056] For example, the maximum value operator MaX, the minimum value operator Min, and the average value operator Avg can determine the maximum, minimum, and average values ​​of a pixel's RGB pixel values ​​based on formula (1):

[0057]

[0058] Where r, g, and b are the R, G, and B values ​​of the RGB pixel values, respectively. maxRGB represents the maximum value among the R, G, and B values ​​of a pixel. min RGB represents the minimum value among the R, G, and B values ​​of a pixel. avg This is the average of the R, G, and B values ​​of a pixel. The maximum value operator (Max) and the minimum value operator (Min) can be implemented using comparators, and the average value operator (Avg) can be implemented using accumulators and multipliers.

[0059] In this embodiment of the disclosure, the first regulator 214 utilizes a first adjustment coefficient ratio. sat Before adjusting the saturation of the pixel value, the first delay unit 215 adjusts the pixel value and the first adjustment coefficient ratio. sat Time-delay alignment is performed. For example, the first delay unit 215 delays the output of the pixel value to the first adjuster 214, so that the first adjuster 214 synchronously receives the pixel value and the first adjustment coefficient ratio. sat For example, the first delay unit 215 will set the maximum value to RGB. max Write to the storage unit, and at the target time, the first delay unit 215 reads the maximum value (rgb) from the storage unit. max and set the maximum value to rgb max The output is sent to the first regulator 214. The target time is based on the first regulation coefficient ratio received by the first regulator 214. sat The timing is determined. The storage unit can be double data rate synchronous dynamic random access memory (DDR).

[0060] In this embodiment of the disclosure, trigger FF2 receives the maximum value rgb. max It can be used for the maximum value RGB. max Temporary storage is performed. Triggered by the rising edge of the clock signal, flip-flop FF2 will set the maximum value to RGB. max And output to the first regulator 214, thereby realizing the maximum value RGB max The delayed output is sent to the first regulator 214. For example, the arrival time of the rising edge of the clock signal can be used in conjunction with the second arithmetic unit 212 and the third arithmetic unit 213 to adjust the first adjustment coefficient ratio. sat The calculation is time-dependent.

[0061] In some embodiments, the first arithmetic unit 211 is based on the maximum value rgb max Average RGB avg and the first preset parameter param sat The target correction coefficient k2 is calculated. For example, the first arithmetic unit 211 determines the saturation enhancement data LUT1(rgb) from the first preset lookup table. max ), and based on the first preset parameter param satThe pixel values ​​are adjusted to determine the initial correction coefficient k1. The first arithmetic unit 211 uses the initial correction coefficient k1 to adjust the saturation enhancement data LUT1(rgb). max The correction is performed to obtain the target correction coefficient k2.

[0062] In this embodiment of the disclosure, the first preset lookup LUT1 table indicates the maximum value rgb. max And saturation enhancement data LUT1(rgb) max The mapping relationship between saturation-enhanced data LUT1(rgb) and other data types. For example, the mapping relationship between saturation-enhanced data LUT1(rgb) and other data types. max This indicates the maximum RGB value based on the pixel. max The determined correction magnitude for the initial correction factor k1. The maximum pixel value in RGB. max The maximum value of a pixel (rgb) can show a negative correlation with the correction magnitude. max The larger the value, the smaller the correction, which preserves more color details in the pixel.

[0063] For example, the first arithmetic unit 211 can determine the target correction coefficient k2 of the pixel based on formulas (2) and (3):

[0064]

[0065] k2=k1*LUT(rgb max (3)

[0066] Where abs represents the absolute value, and the maximum value is rgb. max Compared with the average RGB avg The difference can represent the vibrancy of a pixel's color. Based on the maximum value RGB... max Average RGB avg and the first preset parameter param sat The initial correction coefficient k1 for a pixel value can be determined based on the color vibrancy and saturation adjustment range. Adjusting the pixel value's RGB value based on this initial correction coefficient k1 can satisfy the user's visual requirements. The maximum RGB value can then be used as the basis for further adjustments. max The initial correction factor k1 for the pixel value is determined and then corrected to obtain the target correction factor k2. Adjusting the pixel value RGB based on the target correction factor k2 can preserve more color details within the pixel.

[0067] In this embodiment of the present disclosure, the subtractor S1 and multiplier M1 in the first arithmetic unit 211 implement formula (2) to calculate the initial correction coefficient k1. The subtractor S1 and multiplier M1 in the first arithmetic unit 211 implement formula (2) to calculate the initial correction coefficient k1. The multiplier M2 in the first arithmetic unit 211 implements formula (3) to calculate the target correction coefficient k2.

[0068] In this embodiment of the disclosure, the first arithmetic unit 211 queries the first preset table LUT1 to determine the saturation enhancement data LUT1(rgb). max The required processing time is greater than the operation time of subtractor S1 and multiplier M1. Therefore, the flip-flop FF3 in the first arithmetic unit 211 delays the output of the initial correction coefficient k1 to multiplier M2, so that multiplier M2 can synchronously receive the saturation enhancement data LUT1 (rgb). max ) and initial correction coefficient k1.

[0069] In this embodiment of the disclosure, the second arithmetic unit 212 is based on the maximum value rgb max and minimum value RGB min Determine the saturation data (sat) of the pixel. For example, the second arithmetic unit 212 can determine the saturation data (sat) of the pixel based on formula (4):

[0070]

[0071] In this embodiment of the disclosure, formula (4) includes a division operation and the dividend is a variable, which is implemented by establishing a lookup table LUT5 to calculate 1 / rgb. max The operation, using the lookup table LUT5, indicates the maximum value rgb. max With 1 / rgb max Mapping relationship. The input value of the lookup table LUT5 is the maximum value 'rgb'. max The output value of the lookup table LUT5 is LUT5(rgb). max ) is 1 / rgb max The multiplier M3 and subtractor S2 in the second arithmetic unit 212 can implement formula (4) to calculate the saturation data sat.

[0072] In this embodiment of the disclosure, the second arithmetic unit 212 queries the lookup table LUT2 to determine 1 / rgb max It takes a certain amount of time, therefore the delay of trigger FF1 in the first delay unit 215 will be the minimum value RGB. min The output is sent to multiplier M3, enabling multiplier M3 to synchronously receive LUT5 (rgb) signals. max ) and minimum value rgb min .

[0073] In this embodiment of the disclosure, the third arithmetic unit 213 combines the pixel's saturation data *sat* and the pixel's target correction coefficient *k2* to determine a first adjustment coefficient *ratio* that satisfies the pixel's color characteristics. sat For example, the third arithmetic unit 213 can determine the first adjustment coefficient ratio of the pixel based on formula (5). sat :

[0074] ratio sat =k2 sat (5)

[0075] In this embodiment, formula (5) includes power operation, and both the saturation data *sat* and the target correction coefficient *k2* are variables. *k2* is implemented by establishing a second preset table *LUT2*. sat The calculation shows that the second preset table LUT2 indicates the target correction coefficient k2, the saturation data sat, and the first adjustment coefficient ratio. sat The second preset table LUT2 of the mapping relationship takes the target correction coefficient k2 and saturation data sat as inputs and outputs the first adjustment coefficient ratio. sat .

[0076] In this embodiment of the disclosure, the second arithmetic unit 212 calculates the saturation data sat later than the first arithmetic unit 211 calculates the target correction coefficient k2. Therefore, the trigger FF4 in the first arithmetic unit 211 delays the output of the target correction coefficient k2 to the third arithmetic unit 213, so that the third arithmetic unit 213 can receive the saturation data sat and the target correction coefficient k2 synchronously.

[0077] In this embodiment of the disclosure, the first regulator 214 is based on a first adjustment coefficient ratio. sat and maximum value RGB max Adjusting the pixel value RGB yields the first pixel value RGB. sat For example, the first regulator 214 can determine the first pixel value (rgb) of a pixel based on formula (6). sat :

[0078]

[0079] First pixel value RGB sat Including the R value r after saturation adjustment sat G value g sat and B value b sat The multiplier M4, subtractor S3, subtractor S4 and subtractor S5 in the first regulator 214 can implement formula (6) to calculate the first pixel value rgb of the pixel. sat .

[0080] In this embodiment, since the first arithmetic unit 211, the second arithmetic unit 212, and the third arithmetic unit 213 calculate data at inconsistent rates, flip-flops FF1, FF2, FF3, and FF4 are used to delay the output of data. This prevents data processing errors caused by data asynchrony when one of the two required data sets arrives first. For example, flip-flop FF1 can delay the output of the minimum value rgb to multiplier M3 by six rising edges of clock signals. min Flip-flop FF1 can output the maximum value RGB to multiplier M4 after a 16-clock rising edge delay. max For example, flip-flop FF3 can output the initial correction coefficient k1 to multiplier M2 after a 5-clock rising edge. Flip-flop FF4 can output the target correction coefficient k2 to the third arithmetic unit 213 after a 1-clock rising edge.

[0081] In this embodiment, after performing a multiplication operation, the multiplier shifts the output of the multiplier using a shifter to ensure that the position of the data output to the next arithmetic unit is consistent with the number of bits of the data input to the multiplier. For example, if the data input to multiplier M3 is 12 bits and the data output by multiplier M3 is 24 bits, the output data is shifted 12 bits to the left using a shifter, making the data input to subtractor S2 12 bits. In this case, both the multiplier and subtractor perform 12-bit operations.

[0082] In some embodiments, since the output value of the second preset table LUT2 is determined based on two input variables, the second preset table LUT2 can be a two-dimensional lookup table. The third arithmetic unit 213, based on the target correction coefficient k2 and the saturation data sat, performs two traversals of the two-dimensional lookup table based on the two-dimensional lookup address to obtain the input value k2. sat .

[0083] In this embodiment of the disclosure, the third arithmetic unit 213 can also convert the two-dimensional lookup address into a one-dimensional lookup address, thereby performing a traversal of the second preset table LUT2 based on the one-dimensional lookup address to obtain the input value k2. sat This simplifies the search process.

[0084] In this embodiment of the disclosure, the third arithmetic unit 213 converts the saturation data sat and the target correction coefficient k2 into a lookup address; and based on the lookup address, determines the first adjustment coefficient ratio from the second preset lookup LUT2 table. sat The second preset lookup table indicates the lookup address and the first adjustment coefficient ratio. sat The mapping relationship between them.

[0085] Combination Figure 3The search process is illustrated below. Figure 3 This is a schematic diagram of the structure of the second preset lookup table according to an embodiment of the present disclosure.

[0086] like Figure 3 As shown, the second preset table LUT2 can be a two-dimensional lookup table 2DLUT, which is then converted into a one-dimensional lookup table 1DLUT. In this case, the two-dimensional lookup address is converted into a one-dimensional lookup address, and the first adjustment coefficient ratio is determined from the one-dimensional lookup table 1DLUT based on the one-dimensional lookup address. sat .

[0087] For example, a two-dimensional lookup table (2DLUT) can be a 3x3 table, with each cell storing a value. The row address of the table can be the address of the target correction coefficient k2 (addr k2), and the column address can be the address of the saturation data (sat) (addrsat). The address addr k2 can be 0, 1, or 2, representing the 1st, 2nd, and 3rd rows, respectively. The address addr sat can be 1, 2, or 3, representing the 1st, 2nd, and 3rd columns, respectively. For example, based on address addr k2 = 0 and address addr sat = 1, the third arithmetic unit can determine that the value located in the 1st row and 1st column of the two-dimensional lookup table (2DLUT) is the first adjustment coefficient ratio for output. sat .

[0088] In this embodiment of the disclosure, the two-dimensional lookup table 2DLUT is split into multiple one-dimensional sub-tables along the row direction, and the multiple one-dimensional sub-tables are concatenated into a one-dimensional lookup table 1DLUT. At this time, the last cell of the first row is adjacent to the first cell of the second row.

[0089] In this embodiment, the third arithmetic unit converts the address of the saturation data *sat* and the address of the target correction coefficient *k2* into a lookup address *addr* = *addr*k2*SIZE + *addr*sat. *SIZE* is the depth of a single-dimensional address, i.e., the number of values ​​stored in each row of the two-dimensional lookup table 2DLUT.

[0090] For example, if the address of the saturation data sat, addr_sat, is 1, and the address of the target correction coefficient k2, addr_k2, is 1, then the lookup address addr = 1 * 3 + 1. In the one-dimensional lookup table 1DLUT, the fourth value is determined to be the first adjustment coefficient ratio. sat Based on this, the third arithmetic unit takes an input value as input and, after one iteration, can obtain an output value, thus simplifying the search process.

[0091] In some embodiments, the data size of the second preset table is determined based on the data depth. Reducing the data depth of the second preset table can reduce the consumption of storage resources.

[0092] In this embodiment, a second preset table is constructed using multiple preset lookup addresses and multiple preset first adjustment coefficients. The multiple preset lookup addresses and multiple preset first adjustment coefficients are quantized to reduce the data size of the second preset table.

[0093] For example, the preset lookup address and preset first adjustment coefficient are 12-bit fixed-point numbers, and the data depth of a single dimension in the constructed second preset table is 2. 12 +1. Quantize the dimensions of the second preset table to obtain the third preset table. The data depth of a single dimension in the third preset table is 2. 5 +1. In the third preset table, two adjacent values ​​in a single dimension can include 2. 12 / 2% 128 values.

[0094] In this embodiment of the disclosure, the third preset lookup table is pre-set based on first type data in multiple preset lookup addresses and first type data in multiple preset first adjustment coefficients. For example, the first type data can be the high-order data in the preset lookup address and the high-order data in the preset first adjustment coefficient. For example, the preset lookup address and the multiple preset first adjustment coefficients are 12-bit fixed-point numbers, the first type data in the preset lookup address is the high 5 bits of the 12-bit data, and the first type data in the preset first adjustment coefficient is the high 5 bits of the 12-bit data.

[0095] In this embodiment of the present disclosure, the third arithmetic unit converts the first type of saturation data and the first type of target correction coefficient into a lookup address; determines a lookup range from a third preset lookup table based on the lookup address; and determines a first adjustment coefficient within the lookup range using the second type of saturation data and the second type of target correction coefficient.

[0096] In this embodiment, both the saturation data and the target correction coefficient can be 12-bit data. The first type of saturation data is the high 5 bits of the 12-bit data, and the first type of target correction coefficient data is also the high 5 bits of the 12-bit data. The lookup address is determined based on the conversion formula addr = addr_k2 * SIZE + addr_sat. It should be noted that the values ​​stored in the third preset table are based on the data depth increasing sequentially, so the value itself is equal to the data address. For example, each row of the third preset table stores 1, 2, 3, ... sequentially, and the row addresses are also 1, 2, 3, ... sequentially.

[0097] In this embodiment of the disclosure, there are multiple values ​​between two adjacent values ​​in a single dimension of the third preset table. Therefore, the search range can be determined based on the search address. The search range is the data range formed by the unit cell located by the search address in the third preset table and the adjacent cells.

[0098] The second type of data can be the low-order bits of the data, and the precise address can be determined within the lookup range based on this low-order data. For example, the second type of data for saturation data can be the lower 7 bits of a 12-bit dataset, and the second type of data for the target correction coefficient can also be the lower 7 bits of a 12-bit dataset. Within the lookup range, the precise address can be determined using bilinear interpolation, thereby determining the first adjustment coefficient.

[0099] For example, the target correction coefficient is k2 = k2[11:0], the saturation data is sat = sat[11:0], the first type of data is addr_k2 = k2[11:7] and addr_sat = sat[11:7]. The second type of data is rmd_k2 = [6:0] and rmd_sat = [6:0].

[0100] Based on the first type of data, the lookup address is determined as addr_a = addr_k2 * SIZE + addr_sat. Based on the lookup address addr_a, the lookup result is determined in the third preset table as result_a = 2DLUT(addr_a). Then, three lookup addresses adjacent to addr_a are determined in the third preset table: addr_b, addr_c, and addr_d. The lookup address addr_b = addr_k2 * SIZE + addr_sat + 1. Based on the lookup address addr_b, the lookup result is determined in the third preset table as result_b = 2DLUT(addr_b). The lookup address addr_c = (addr_k2 + 1) * SIZE + addr_sat. Based on the lookup address addr_c, the lookup result is determined in the third preset table as result_c = 2DLUT(addr_c). The lookup address is addr_d = (addr_k2+1)*SIZE+addr_sat+1. Based on the lookup address addr_d, the lookup result is determined in the third preset table: result d = 2DLUT(addrd).

[0101] The lookup addresses addr_a, addr_b, addr_c, and addr_d form a rectangular range. For example, lookup address addr_a represents the cell in row addr_k2+1 and column addr_sat of the third preset table. Lookup address addr_b represents the cell in row addr_k2+1 and column addr_sat+1 of the third preset table. Lookup address addr_c represents the cell in row addr_k2+2 and column addr_sat of the third preset table. Lookup address addr_d represents the cell in row addr_k2+2 and column addr_sat+1 of the third preset table.

[0102] The value at the precise address is obtained using bilinear interpolation. For example, the first adjustment coefficient at the precise address is Result = Result_1 + (Result_2 - Result_1) * rmd_k2.

[0103] Result1 is determined by linear interpolation of result_a and result_b, i.e., Result1 = result_a + (result_b - result_a) * rmd_sat. Result2 is determined by linear interpolation of result_c and result_d, i.e., Result2 = result_c + (result_d - result_c) * rmd_sat.

[0104] In this embodiment, the single dimension SIZE of the third preset table is 32. Using a step size of 1 / 32, all values ​​(0≤k2≤1, 0≤sat≤1) within the floating-point range of the target correction coefficient k2 and the saturation data sat are traversed to establish a complete second preset lookup table. The address of the second preset lookup table and the corresponding mapping result (preset first adjustment coefficient) are converted to 12-bit fixed-point to obtain a fixed-point mapping table, i.e., the third preset table. The third arithmetic unit can realize the calculation result of formula (5) by looking up the third preset table.

[0105] In this embodiment, the two-dimensional lookup address is converted into a one-dimensional lookup address, requiring only one lookup operation to obtain the result of the two-dimensional lookup table, thus simplifying the lookup process. Furthermore, reducing the address depth SIZE of the two-dimensional lookup table reduces the consumption of chip storage resources. The lookup result is processed using bilinear interpolation to ensure data accuracy.

[0106] Combination Figure 4A The process of brightness adjustment performed by the second processing module is illustrated. Figure 4A This is a schematic diagram of the structure of an image processing apparatus according to another embodiment of the present disclosure.

[0107] In this embodiment of the disclosure, the process of the second processing module adjusting the brightness of the first image data may include: converting the pixel values ​​of the pixels in the first image data into brightness values ​​based on a second preset parameter; converting a preset adjustment range for the brightness values ​​into a second adjustment coefficient for the pixels based on the brightness values; and adjusting the brightness of the first image data using the second adjustment coefficient to output the second image data.

[0108] like Figure 4A As shown, the second processing module 402a may include a first converter 421, a second converter 422, and a first regulator 423. The first converter 421, the second converter 422, and the first regulator 423 can be used to adjust the brightness of the first image data.

[0109] In this embodiment, the first processing module 201a adjusts the brightness of multiple pixels in the first image data. For any pixel among the multiple pixels in the first image data, the first arithmetic unit 211 adjusts the brightness based on the second preset parameter p. ry / p rg / p rb The first pixel value of the pixel (RGB) sat Convert to brightness value y sat The second converter 422 is based on the brightness value y. sat This will target the brightness value y sat The preset adjustment range gamma is converted into a second adjustment coefficient ratio for pixels. luma The second regulator 423 utilizes the second adjustment coefficient ratio. luma For the first pixel value RGB sat Adjust the brightness and output the second pixel value (RGB). luma The second image data includes the second pixel values ​​(RGB) of all pixels. luma .

[0110] In this embodiment of the disclosure, the second preset parameters Pry / Prg / Prb are RGB-YUV conversion coefficients. The brightness value is ysa. t This is the grayscale value of the pixel after saturation adjustment. The appropriate conversion factor can be selected based on the color standard of the image to be displayed on the display panel.

[0111] In this embodiment, the preset adjustment amplitude gamma can be pre-set. For example, the value of the preset adjustment amplitude gamma can also be obtained by observing the display effect of the display panel. The value of the preset adjustment amplitude gamma is determined while satisfying the user's visual experience. For example, during the debugging process of the display product, the value of the preset adjustment amplitude gamma is determined and burned into the chip. During the use of the display product, the second converter 422 reads the preset adjustment amplitude gamma and performs related calculations to output a second adjustment coefficient ratio for that pixel. luma The second converter 422 determines the second adjustment coefficient ratio for each pixel based on the same preset adjustment amplitude gamma. luma This ensures uniformity in brightness adjustment.

[0112] The second adjustment coefficient ratio for each of the multiple pixels luma Each pixel's second adjustment coefficient (ratio) is determined based on its own brightness value, which makes each pixel's second adjustment coefficient (ratio) unique. luma Each pixel is adapted to its own brightness characteristics, based on the second adjustment coefficient ratio of each pixel. luma Brightness is adjusted for multiple pixels, resulting in the adjusted second pixel value being RGB. luma It can preserve the brightness characteristics of the pixels themselves. The second adjustment coefficient, ratio. luma The value and the pixel brightness value y sat It can be positively correlated. When the second adjustment coefficient ratio... luma The larger the value, the more noticeable the effect on pixel brightness adjustment. Because the human eye is more sensitive to pixels in low-light areas, the second adjustment coefficient, ratio... luma It can preserve the detail information in low-brightness areas to the greatest extent, while reducing the number of high-brightness pixels by a large margin to reduce power consumption.

[0113] Figure 4B This is a schematic diagram of the structure of a second processing module according to another embodiment of the present disclosure.

[0114] like Figure 4B As shown, the second processing module 402b includes a first converter 421, a second converter 422, a second regulator 423, and a second delayer 424.

[0115] In this embodiment of the disclosure, the first converter 421 is based on the second preset parameter p ry / p rg / p rb The first pixel value is RGB sat Convert to brightness value y satFor example, the first converter 421 can convert the pixel's brightness value y based on formula (7). sat :

[0116] y sat =P ry *r sat +p gy *g sat +p by *b sat (7)

[0117] In this embodiment of the disclosure, the second preset parameter p ry / p rg / p rb The conversion coefficients are specified in the color standard. The multipliers M5, M6, M7 and adder A1 in the first converter 421 can implement formula (7) to calculate the brightness value y. sat .

[0118] In some embodiments, the second converter 422 is based on the brightness value y sat Calculate the second adjustment coefficient ratio based on the preset adjustment amplitude gamma. luma For example, the second converter 422 converts the preset adjustment amplitude gamma into a brightness correction coefficient, and uses the brightness correction coefficient to adjust the brightness value ysa. t The second adjustment coefficient, ratio, is obtained by correcting the preset adjustment range gamma. luma .

[0119] For example, the second converter 422 can determine the second adjustment coefficient ratio of the pixel based on formulas (8) and (9). luma :

[0120]

[0121] Among them, P luma This is the brightness correction factor. Since the preset adjustment range gamma can be a pre-set fixed value, P... luma The brightness correction factor can also be a fixed value; 255 is determined based on the pixel's grayscale value range, with 255 being the maximum grayscale value. The second adjustment factor is ratio. luma Based on the preset adjustment range gamma and the pixel brightness value y sat This is confirmed to satisfy the user's visual experience and preserve the brightness characteristics of the pixels.

[0122] In this embodiment, formula (9) includes exponentiation and division operations, with the dividend being a variable. The operation of formula (9) is implemented by establishing a lookup table LUT6, which indicates the brightness value y. satWith the second adjustment coefficient ratio luma The mapping relationship is such that the input value of the second preset table LUT2 is the brightness value y. sat The output value is the second adjustment coefficient, ratio. luma .

[0123] In this embodiment of the disclosure, the second regulator 423 utilizes a second adjustment coefficient ratio. luma For the first pixel value RGB sat Adjust the brightness to obtain the second pixel value (RGB) of the pixel. luma For example, the second regulator 423 can determine the second pixel value RGB of the pixel based on formula (10). luma :

[0124]

[0125] Second pixel value RGB luma Including the R value r after brightness adjustment luma G value g luma and B value b luma The multipliers M8, M9, and M10 in the second regulator 423 can implement formula (10) to calculate the second pixel value RGB of the pixel. luma .

[0126] In this embodiment of the disclosure, before the second regulator 423 adjusts the brightness of the first image data using the second adjustment coefficient, the second delay unit 424 adjusts the first pixel value RGB. sat Second adjustment coefficient ratio luma Perform time-delay alignment. For example, the second delay unit 424 will adjust the first pixel value (RGB). sat The delayed output is sent to the second regulator 423, so that the second regulator 423 synchronously receives the first pixel value RGB. sat Second adjustment coefficient ratio luma For example, the second delay unit 424 may include triggers FF4-1, FF4-2, and FF4-3. Trigger FF4-1 receives the value r. sat The value of R, r, can be used. sat Temporary storage is performed. Triggered by the rising edge of the clock signal, flip-flop FF4-1 sets the value of R to r. sat The output is sent to the second regulator 423, thereby realizing the adjustment of the R value r sat The delayed output is sent to the second regulator 423. For example, the arrival time of the rising edge of the clock signal can be correlated with the second regulation coefficient ratio output by the second converter 422. luma The timing is relevant. The delayed output process of triggers FF4-2 and FF4-3 is similar to that of trigger FF4-1, and will not be described in detail here.

[0127] For example, the first converter 421 and the second converter 422 convert the first pixel value RGB sat Convert to the second adjustment coefficient ratio luma The required duration can be 10 clock cycles, with one clock cycle being the time interval between two adjacent rising edges. Flip-flops FF4-1, FF4-2, and FF4-3 can delay the rising edge of the 10-clock signal by outputting the value r to multipliers M8, M9, and M10 respectively. sat G value g sat and B value b sat .

[0128] Combination Figure 5A The process of brightness adjustment performed by the third processing module is illustrated. Figure 5A This is a schematic diagram of the structure of the third processing module according to an embodiment of the present disclosure.

[0129] In this embodiment of the disclosure, the process of the third processing module adjusting the brightness of the second image data may include: generating brightness difference data based on the pixel values ​​of the pixels in the second image data and the pixel values ​​of the pixels in the image to be displayed; determining a third adjustment coefficient from a fourth preset lookup table based on the brightness parameter; and adjusting the brightness of the brightness difference data using the third adjustment coefficient and the pixel values ​​of the pixels in the image to be displayed to obtain the third image data.

[0130] like Figure 5A As shown, the third processing module 503a includes a first generator 531, a second generator 532, and a third adjuster 533. The first generator 531, the second generator 532, and the third adjuster 533 are used to adjust the brightness of the second image data.

[0131] In this embodiment, the third processing module 503a adjusts the brightness of multiple pixels in the second image data based on the brightness parameters of the display panel. For any pixel in the second image data, the first generator 531 adjusts the brightness based on the second pixel value (RGB) of the pixel in the second image data. luma The RGB values ​​of the pixels in the image to be displayed are used to generate RGB data for brightness difference. diff The second generator 532 determines the third adjustment coefficient ratio from the fourth preset lookup table based on the brightness parameter DBV. DBV The third regulator 533 utilizes a third adjustment coefficient ratio. DBV And pixel values ​​in RGB, for brightness difference data in RGB diff Adjust the brightness and output the third pixel value (RGB) of that pixel. DBV The third image data includes the third pixel values ​​(RGB) of all pixels in the image to be displayed. DBV .

[0132] In this embodiment of the disclosure, the brightness parameter DBV can be determined by reading the display parameters of the display panel. The third adjustment coefficient ratio... DBV It is determined based on the brightness parameters of the display panel, which makes the third adjustment coefficient ratio... DBV Adapted to the brightness characteristics of the display panel itself, based on a third adjustment coefficient ratio. DBV Adjust the brightness of multiple pixels so that the adjusted third pixel value is RGB. DBV It can adapt to the brightness characteristics of the display panel. Third adjustment coefficient ratio DBV The value of can be positively correlated with the luminance parameter DBV. The larger the luminance parameter DBV, the higher the value of the third adjustment coefficient ratio. DBV The larger the value, the more noticeable the effect on pixel brightness adjustment.

[0133] Figure 5B This is a schematic diagram of the structure of a third processing module according to another embodiment of the present disclosure.

[0134] like Figure 5B As shown, the third processing module 503b includes a first generator 531, a second generator 532, a third regulator 533, and a third delayer 534.

[0135] In this embodiment of the disclosure, the first generator 531 is based on the second pixel value RGB after brightness adjustment. luma The RGB values ​​of the pixels in the image to be displayed are used to generate RGB data for brightness difference. diff Brightness difference data (RGB) diff It can characterize the difference in pixel brightness before and after saturation and brightness adjustment.

[0136] For example, the first generator 531 can generate pixel brightness difference data RGB based on formula (11). diff :

[0137]

[0138] Brightness difference data RGB diff Including after the R value r diff G value g diff and B value b diff The subtractors S6, S7, and S8 in the first generator 531 can implement formula (11) to calculate the pixel brightness difference data RGB. diff .

[0139] In this embodiment of the disclosure, the second generator 532 determines the third adjustment coefficient ratio from the fourth preset lookup table LUT4. DBVThe fourth preset lookup table (LUT4) indicates the brightness parameter DBV and the third adjustment coefficient ratio. DBV The mapping relationship between them. For example, the third adjustment coefficient ratio. DBV The indicator specifies the RGB value of the second pixel, determined based on the brightness parameter DBV of the display panel. luma The adjustment range. The adjustment range and the brightness parameter DBV can show a positive correlation; the larger the brightness parameter DBV, the larger the adjustment range, which can reduce the brightness of pixels to a greater extent, thereby reducing display power consumption. The brightness parameter DBV and the third adjustment coefficient ratio. DBV The mapping relationship between them can be determined based on actual adjustment needs, with the brightness parameter DBV and the third adjustment coefficient ratio being... DBV The mapping function formed between them can be a linear function, a nonlinear curve function, or a piecewise function, etc.

[0140] For example, the second generator 532 can generate a third adjustment coefficient ratio based on formula (12). DBV :

[0141] ratio DBV =LUT(DBV) (12)

[0142] In this embodiment of the disclosure, the third regulator 533 utilizes a third adjustment coefficient ratio. DBV And pixel values ​​RGB, for brightness difference data RGBDIF f Adjust the brightness to obtain the third pixel value (RGB). DBV For example, the third regulator 533 can determine the third pixel value RGB of a pixel based on formula (13). DBV :

[0143]

[0144] Third pixel value RGB DBV Including the R value r after brightness adjustment DBV G value g DBV and B value b DBV The multipliers M11, M12, M13 and the subtractors S9, S10, S11 in the third regulator 533 can implement formula (13) to calculate the third pixel value RGB of the pixel. DBV .

[0145] In this embodiment of the disclosure, the third regulator 533 utilizes a third adjustment coefficient ratio. DBV And the pixel values ​​(RGB) of the pixels in the image to be displayed, for brightness difference data (RGB). diff Before brightness adjustment, the third delay unit 534 processes the pixel value RGB and the brightness difference data RGB.diff and the third adjustment coefficient ratio DBV Time-delay alignment is performed. For example, the third delay unit 534 delays the output of the pixel values ​​(RGB) of the pixels in the image to be displayed to the third regulator 533, so that the third regulator 533 synchronously receives the pixel values ​​(RGB) and the brightness difference data (RGB). diff and the third adjustment coefficient ratio DBV .

[0146] In this embodiment, the third delay unit 534 delays the output of the pixel value RGB to the subtractors S9, S10, and S11 in the third regulator 533. For example, the third delay unit 534 may include flip-flops FF5-1, FF5-2, and FF5-3. Flip-flop FF5-1 receives the value R r and can temporarily store it. Triggered by the rising edge of the clock signal, flip-flop FF5-1 outputs the value R r to the subtractor S9, thereby delaying the output of the value R r to the subtractor S9, ensuring that the value R r and the result of the multiplier M11 are received synchronously. For example, the arrival time of the rising edge of the clock signal can be related to the time when the multiplier M11 outputs the result. The delayed output process of flip-flops FF5-2 and FF5-3 is similar to that of flip-flop FF5-1 and will not be described again.

[0147] For example, the first generator 531 and the second generator 532 are based on the second pixel value RGB. luma Generate and convert to the third adjustment coefficient ratio DBV The required duration can be one clock cycle. Flip-flops FF5-1, FF5-2, and FF5-3 can delay the rising edge of one clock signal to output R value r, G value g, and B value b to subtractors S9, S10, and S11, respectively.

[0148] In this embodiment of the disclosure, Figure 2B , Figure 4B and Figure 5B The structure shown can be implemented using RTL (Real-Time Language). In RTL design of integrated circuits, a clock signal is used as the excitation to drive the register circuit to perform calculations on the data stream. To improve the timing performance of integrated circuits and reduce timing violations, complex calculation processes are broken down into multi-stage calculations, changing the way complex calculation formulas are calculated. This simplifies the calculation process, saves computing resources, and reduces hardware costs. In the calculation flow, each group of registers completes a data calculation once per clock cycle and passes it to the next-stage register for further calculations. Therefore, the calculation of a single formula may take multiple clock cycles to complete. Flip-flops are used to delay the output of relevant data.

[0149] Figure 6 This is a schematic diagram of the structure of an image processing apparatus according to another embodiment of the present disclosure.

[0150] like Figure 6 As shown, the image processing device 600 includes a first processing module 601, a second processing module 602, a third processing module 603, and a control module 604. The first processing module 601, the second processing module 602, and the third processing module 603 are similar to the first processing module 101, the second processing module 102, and the third processing module 103, and will not be described in detail for the sake of simplicity.

[0151] In this embodiment of the present disclosure, the control module 604 can control the timing of the clock signal, thereby achieving the data synchronization required in the computation pipeline of the first processing module 601, the second processing module 602, and the third processing module 603.

[0152] In this embodiment of the disclosure, the control module 604 can also send relevant parameters to the first processing module 601, the second processing module 602, and the third processing module 603 based on control signals. For example, the control module 604 can send a first preset parameter to the first processing module 601, causing the first processing module 601 to calculate and output first image data. For example, the control module 604 can send a second preset parameter to the second processing module 602, causing the second processing module 602 to calculate and output second image data. For example, the control module 604 can also send a brightness parameter to the third processing module 603, causing the third processing module 603 to calculate and output third image data.

[0153] In this embodiment of the present disclosure, the image processing device 600 adjusts the saturation and brightness of the image to be displayed, thereby reducing the overall brightness of the image to be displayed while ensuring the display quality of the image and reducing the display power consumption of the display module.

[0154] Figure 7 This is a flowchart of an image processing method according to another embodiment of the present disclosure.

[0155] In this embodiment of the disclosure, the image processing method 700 may include operations S710 to S740.

[0156] In operation S710, the saturation of the image to be displayed is adjusted to obtain the first image data.

[0157] In operation S720, the brightness of the first image data is adjusted to obtain the second image data.

[0158] When operating the S730, the brightness of the second image data is adjusted using the brightness parameters of the display panel to obtain the third image data, which is then output to the display panel for display.

[0159] In this embodiment of the disclosure, operations S710 to S730 are similar to the execution operations of the image processing apparatus 100 described above, and will not be repeated for the sake of brevity.

[0160] In this embodiment of the disclosure, operation S710, adjusting the saturation of the image to be displayed to obtain first image data, includes: calculating the pixel values ​​of pixels in the image to be displayed based on a first preset parameter, and outputting a target correction coefficient for the pixel, wherein the first preset parameter indicates the adjustment range of saturation; calculating the pixel values ​​and outputting pixel saturation data; calculating the saturation data and the target correction coefficient and outputting a first adjustment coefficient for the pixel; and adjusting the saturation of the pixel values ​​using the first adjustment coefficient and outputting the first image data.

[0161] In this embodiment of the disclosure, the calculation of pixel values ​​of pixels in the image to be displayed based on a first preset parameter, and the output of a target correction coefficient for the pixel, includes: determining saturation enhancement data from a first preset lookup table based on the pixel value, wherein the first preset lookup table indicates the mapping relationship between pixel values ​​and saturation enhancement data; adjusting the pixel value based on the first preset parameter to determine an initial correction coefficient; and correcting the saturation enhancement data using the initial correction coefficient to obtain a target correction coefficient.

[0162] In this embodiment of the disclosure, the calculation of saturation data and target correction coefficient to output a first adjustment coefficient for a pixel includes: converting the first type of saturation data and the first type of target correction coefficient into a lookup address; determining a lookup range from a third preset lookup table based on the lookup address; and determining the first adjustment coefficient within the lookup range using the second type of saturation data and the second type of target correction coefficient; wherein the third preset lookup table is preset based on the first type of data in a plurality of preset lookup addresses and the first type of data in a plurality of preset first adjustment coefficients.

[0163] In this embodiment of the disclosure, operation S710, adjusting the saturation of the image to be displayed to obtain first image data, further includes: caching pixel values; and, upon determining that a first adjustment coefficient has been obtained, reading the pixel values, thereby adjusting the saturation of the pixel data based on the first adjustment coefficient, and outputting the first image data.

[0164] In this embodiment of the disclosure, operation S720, which adjusts the brightness of the first image data to obtain the second image data, includes: converting the pixel values ​​of the pixels in the first image data into brightness values ​​based on a second preset parameter, wherein the second preset parameter indicates the conversion coefficient between the pixel values ​​and the brightness values; converting a preset adjustment range for the brightness values ​​into a second adjustment coefficient for the pixels based on the brightness values; and adjusting the brightness of the first image data using the second adjustment coefficient to output the second image data.

[0165] In this embodiment of the disclosure, operation S720, which adjusts the brightness of the first image data to obtain the second image data, further includes: caching the first image data; and, if a second adjustment coefficient is determined, reading the first image data, so that the brightness of the first image data is adjusted using the second adjustment coefficient, and outputting the second image data.

[0166] In this embodiment of the present disclosure, operation S730 involves adjusting the brightness of the second image data using the brightness parameters of the display panel to obtain the third image data. This includes: generating brightness difference data based on the pixel values ​​of pixels in the second image data and the pixel values ​​of pixels in the image to be displayed; determining a third adjustment coefficient from a fourth preset lookup table based on the brightness parameters; and adjusting the brightness of the brightness difference data using the third adjustment coefficient and the pixel values ​​of pixels in the image to be displayed to obtain the third image data.

[0167] In this embodiment of the disclosure, operation S730, which adjusts the brightness of the second image data using the brightness parameters of the display panel to obtain the third image data, further includes: caching pixel values; and, upon determining that brightness difference data and a third adjustment coefficient have been obtained, reading pixel values ​​so that the brightness difference data is adjusted using the third adjustment coefficient and the pixel values ​​to obtain the third image data.

[0168] Figure 8 This is a schematic diagram of the structure of a display device according to an embodiment of the present disclosure.

[0169] like Figure 8 As shown, the display device 800 includes a display panel 801 and an image processing device 802.

[0170] In this embodiment of the disclosure, the image processing device 802 outputs third image data based on the image to be displayed, and the display panel 801 displays the third image data.

[0171] In this embodiment of the disclosure, the image processing device 802 is the image processing device 100 or the image processing device 600 described above, and will not be repeated for the sake of brevity.

[0172] Figure 9 This is a schematic diagram of the structure of a display device according to another embodiment of the present disclosure.

[0173] like Figure 9 As shown, the display device 900 includes a display panel 901 and a processor 902.

[0174] In this embodiment of the disclosure, the processor 902 executes the image processing method 700 described above for the image to be displayed, and outputs third image data. The display panel 901 displays the third image data.

[0175] In this embodiment of the disclosure, the processor 902 may also perform the operations performed by the image processing device 100 or the image processing device 600, which will not be described in detail for the sake of brevity.

[0176] It should be noted that the collection, storage, use, processing, transmission, provision, disclosure, and application of user personal information in this disclosed technical solution comply with relevant laws and regulations, necessary confidentiality measures have been taken, and it does not violate public order and good morals. In this disclosed technical solution, user authorization or consent has been obtained before acquiring or collecting user personal information.

[0177] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of this disclosure. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two consecutively indicated blocks may actually be executed substantially in parallel, and they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram or flowchart, and combinations of blocks in a block diagram or flowchart, may be implemented using a dedicated hardware-based system that performs the specified function or operation, or using a combination of dedicated hardware and computer instructions.

[0178] Those skilled in the art will understand that the features described in the various embodiments and / or claims of this disclosure can be combined and / or combined in various ways, even if such combinations or combinations are not explicitly described in this disclosure. In particular, the features described in the various embodiments and / or claims of this disclosure can be combined and / or combined in various ways without departing from the spirit and teachings of this disclosure. All such combinations and / or combinations fall within the scope of this disclosure.

[0179] The embodiments of this disclosure have been described above. However, these embodiments are for illustrative purposes only and are not intended to limit the scope of this disclosure. Although various embodiments have been described above, this does not mean that the measures in the various embodiments cannot be used advantageously in combination. The scope of this disclosure is defined by the appended claims and their equivalents. Various substitutions and modifications can be made by those skilled in the art without departing from the scope of this disclosure, and all such substitutions and modifications should fall within the scope of this disclosure.

Claims

1. An image processing apparatus, comprising: a first processing module configured to adjust saturation of a to-be-displayed image to obtain first image data; a second processing module configured to adjust luminance of the first image data to obtain second image data; and a third processing module configured to adjust luminance of the second image data by using a luminance parameter of a display panel to obtain third image data, the third image data being used for output to the display panel for display. The first processing module is further configured to: calculate a pixel value of a pixel in the to-be-displayed image based on a first preset parameter to obtain a target correction coefficient for the pixel, the first preset parameter indicating an adjustment range of saturation; calculate the pixel value to obtain saturation data of the pixel; calculate the saturation data and the target correction coefficient to obtain a first adjustment coefficient for the pixel; and adjust the pixel value by using the first adjustment coefficient to output the first image data. The first calculator is further configured to: determine saturation enhancement data from a first preset lookup table based on the pixel value, the first preset lookup table indicating a mapping relationship between a pixel value and saturation enhancement data; adjust the pixel value based on the first preset parameter to determine an initial correction coefficient; and correct the saturation enhancement data by using the initial correction coefficient to obtain the target correction coefficient. The third calculator is further configured to: convert the saturation data and the target correction coefficient into a lookup address; and determine the first adjustment coefficient from a second preset lookup table based on the lookup address, the second preset lookup table indicating a mapping relationship between a lookup address and a first adjustment coefficient. The third calculator is further configured to: convert first type data of the saturation data and first type data of the target correction coefficient into a lookup address; determine a lookup range from a third preset lookup table based on the lookup address; and determine the first adjustment coefficient within the lookup range by using second type data of the saturation data and second type data of the target correction coefficient; wherein the third preset lookup table is preset based on first type data in a plurality of preset lookup addresses and first type data in a plurality of preset first adjustment coefficients. The first processing module is further configured to perform time delay alignment on the pixel value and the first adjustment coefficient before adjusting the pixel value by using the first adjustment coefficient. The second processing module is further configured to: convert a pixel value of a pixel in the first image data into a luminance value based on a second preset parameter, the second preset parameter indicating a conversion coefficient between the pixel value and the luminance value; convert a preset adjustment range for the luminance value into a second adjustment coefficient for the pixel based on the luminance value; and adjust luminance of the first image data by using the second adjustment coefficient to output the second image data. The second processing module is further configured to: ​ ​ ​ ​ 2. The apparatus of claim 1, wherein, ​ ​ ​ ​ ​ ​ 3. The apparatus of claim 2, wherein, ​ ​ ​ ​ ​ 4. The apparatus of claim 2, wherein, ​ ​ ​ 5. The apparatus of claim 2, wherein, ​ ​ ​ ​ ​ ​ 6. The apparatus of claim 2, wherein, ​ 7. The apparatus of claim 1, wherein, ​ ​ ​ ​ ​ 8. The apparatus of claim 7, wherein, ​ The first image data and the second adjustment coefficient are time-delay aligned before the first image data is brightness-adjusted by using the second adjustment coefficient.

9. The apparatus of claim 1, wherein, The third processing module is further configured to: generate brightness difference data based on pixel values of pixels in the second image data and pixel values of pixels in the to-be-displayed image; determine a third adjustment coefficient from a fourth preset lookup table based on the brightness parameter; and brightness-adjust the brightness difference data by using the third adjustment coefficient and the pixel values of the pixels in the to-be-displayed image to obtain the third image data. The third processing module is further configured to:

10. The apparatus of claim 9, wherein, time-delay align the pixel values, the brightness difference data and the third adjustment coefficient before the brightness difference data is brightness-adjusted by using the third adjustment coefficient and the pixel values of the pixels in the to-be-displayed image.

11. An image processing method, comprising: adjusting saturation of a to-be-displayed image to obtain first image data; brightness-adjusting the first image data to obtain second image data; and brightness-adjusting the second image data by using a brightness parameter of a display panel to obtain third image data, the third image data being used for output to the display panel for display. The adjusting saturation of a to-be-displayed image to obtain first image data comprises:

12. The method of claim 11, wherein, operating on pixel values of pixels in the to-be-displayed image based on a first preset parameter to obtain a target correction coefficient for the pixels, the first preset parameter indicating an adjustment range of saturation; operating on the pixel values to obtain saturation data of the pixels; operating on the saturation data and the target correction coefficient to obtain a first adjustment coefficient for the pixels; and saturation-adjusting the pixel values by using the first adjustment coefficient to output the first image data. The operating on the saturation data and the target correction coefficient to obtain a first adjustment coefficient for the pixels comprises:

13. The method of claim 12, wherein, converting the saturation data and the target correction coefficient into a lookup address; and determining the first adjustment coefficient from a second preset lookup table based on the lookup address, the second preset lookup table indicating a mapping relationship between a lookup address and a first adjustment coefficient. The operating on the saturation data and the target correction coefficient to obtain a first adjustment coefficient for the pixels comprises:

14. The method of claim 12, wherein, converting first type data of the saturation data and first type data of the target correction coefficient into a lookup address; determining a lookup range from a third preset lookup table based on the lookup address; and determining the first adjustment coefficient within the lookup range by using second type data of the saturation data and second type data of the target correction coefficient; wherein the third preset lookup table is preset based on first type data in a plurality of preset lookup addresses and first type data in a plurality of preset first adjustment coefficients. The brightness-adjusting the first image data to obtain second image data comprises:

15. The method of claim 11, wherein, ​ convert, based on a second preset parameter, a pixel value of a pixel in the first image data into a luminance value, the second preset parameter indicating a conversion coefficient between the pixel value and the luminance value; convert, based on the luminance value, a preset adjustment range for the luminance value into a second adjustment coefficient for the pixel point; and perform luminance adjustment on the first image data using the second adjustment coefficient, and output the second image data.

16. The method of claim 11, wherein, The performing luminance adjustment on the second image data using the luminance parameter of the display panel to obtain third image data comprises: generating luminance difference data based on a pixel value of a pixel in the second image data and a pixel value of a pixel in the image to be displayed; determining a third adjustment coefficient from a fourth preset lookup table based on the luminance parameter; and performing luminance adjustment on the luminance difference data using the third adjustment coefficient and the pixel value of the pixel in the image to be displayed to obtain the third image data.

17. A display device comprising: a display panel; and the image processing device of any one of claims 1-10, configured to output third image data based on the image to be displayed; wherein the display panel displays the third image data.

18. A display device comprising: a processor configured to perform the method of any one of claims 11-16; and a display panel configured to display third image data output by the processor.

Images