System and display device for high dynamic range post-processing

By analyzing and selectively processing the image using an HDR post-processing device, the jitter phenomenon in HDR images was resolved, resulting in a more natural image display effect.

CN114387914BActive Publication Date: 2026-04-21SAMSUNG DISPLAY CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
SAMSUNG DISPLAY CO LTD
Filing Date
2021-08-18
Publication Date
2026-04-21

AI Technical Summary

Technical Problem

When generating high dynamic range (HDR) images, jitter often occurs, causing unnatural or discontinuous motion of image objects.

Method used

The HDR post-processing unit uses an HDR post-processing analysis block and processor to analyze image data to determine the post-processing function, and selectively performs HDR forward processing or HDR backward processing based on the backward selection signal to reduce or prevent jitter.

Benefits of technology

It effectively reduces or prevents discontinuous jitter in the motion of objects in HDR images, thereby improving image quality.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114387914B_ABST
    Figure CN114387914B_ABST
Patent Text Reader

Abstract

Systems and display apparatuses for high dynamic range post-processing are provided. The system includes a first logic configured to determine a post-processing function by analyzing input image data, and a processor configured to receive a backward selection signal and selectively perform, in response to the backward selection signal, a high dynamic range (HDR) forward processing corresponding to the post-processing function or a HDR backward processing corresponding to an inverse function of the post-processing function on the input image data.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] One or more embodiments described herein relate to a high dynamic range post-processing apparatus and a display device including a high dynamic range post-processing apparatus. Background Technology

[0002] Various processing techniques have been developed to display high dynamic range (HDR) images. These techniques can be used to reduce the brightness of low-grayscale or low-brightness images and increase the brightness of high-grayscale or high-brightness images. The expected result is improved image quality. However, unlike in standard dynamic range (SDR) images, jitter may occur when generating HDR images. This phenomenon can cause image objects to move unnaturally or in a discontinuous manner. Summary of the Invention

[0003] One or more embodiments described herein provide a high dynamic range (HDR) post-processing device that can prevent or reduce jitter, and one or more additional embodiments provide a display device that includes such an HDR post-processing device.

[0004] According to one or more embodiments, a system for high dynamic range post-processing includes: first logic configured to analyze image data to determine a post-processing function; and a processor configured to receive a backward selection signal and selectively perform high dynamic range (HDR) forward processing or HDR backward processing on the image data in response to the backward selection signal, wherein the HDR forward processing corresponds to the post-processing function, and wherein the HDR backward processing corresponds to the inverse function of the post-processing function.

[0005] According to one or more embodiments, a system for high dynamic range post-processing includes: first logic configured to analyze image data to determine a first post-processing function corresponding to high dynamic range (HDR) forward processing; second logic configured to receive a backward selection signal and, in response to the backward selection signal, select either the first post-processing function or a second post-processing function corresponding to HDR backward processing; and a processor configured to: perform HDR forward processing on the image data corresponding to the first post-processing function when the first post-processing function is selected, and perform HDR backward processing on the image data corresponding to the second post-processing function when the second post-processing function is selected.

[0006] According to one or more embodiments, a display device includes: a display panel including a plurality of pixels; a data driver configured to provide data signals to the plurality of pixels; a scan driver configured to provide scan signals to the plurality of pixels; and a controller configured to control the data driver and the scan driver, the controller including: logic configured to receive a backward selection signal, analyze image data to determine a post-processing function, and selectively perform high dynamic range (HDR) forward processing or HDR backward processing on the image data in response to the backward selection signal, wherein the HDR forward processing corresponds to the post-processing function, and wherein the HDR backward processing corresponds to the inverse function of the post-processing function.

[0007] According to one or more embodiments, a non-transitory computer-readable medium storing instructions that, when executed by one or more processors, cause one or more processors to: analyze image data to determine a post-processing function; and selectively perform high dynamic range (HDR) forward processing or HDR backward processing on the image data in response to a backward selection signal, wherein the HDR forward processing corresponds to the post-processing function, and wherein the HDR backward processing corresponds to the inverse function of the post-processing function. Attached Figure Description

[0008] The illustrative, non-limiting embodiments will be more clearly understood through the following detailed description taken in conjunction with the accompanying drawings.

[0009] Figure 1 An implementation of the HDR post-processing device is shown.

[0010] Figure 2 Examples of brightness ranges for SDR and HDR images are shown.

[0011] Figure 3 An example of a post-processing function is shown.

[0012] Figure 4A and Figure 4B An example of performing HDR post-processing analysis is shown.

[0013] Figure 5A and Figure 5B An example of performing HDR post-processing analysis is shown.

[0014] Figure 6 An example operation of the HDR post-processor is shown.

[0015] Figure 7 An example operation of the HDR post-processor is shown.

[0016] Figure 8 An implementation of the HDR post-processing device is shown.

[0017] Figure 9 An implementation of the HDR post-processing user settings block is shown.

[0018] Figure 10 An implementation of the HDR post-processing device is shown.

[0019] Figure 11 An implementation of the HDR post-processing forward and backward control block is shown.

[0020] Figure 12 An embodiment of the display device is shown.

[0021] Figure 13 An embodiment of the display device is shown.

[0022] Figure 14A Examples of images at low frame rates or with large motion are shown, and Figure 14B Examples of images at high frame rates or with small motion are shown.

[0023] Figure 15 An embodiment of the display device is shown.

[0024] Figure 16 An embodiment of the electronic device is shown. Detailed Implementation

[0025] The embodiments are described more fully below with reference to the accompanying drawings. The same or similar reference numerals refer to the same or similar elements.

[0026] Figure 1 This is a block diagram illustrating an embodiment of a high dynamic range (HDR) post-processing device. Figure 2 This is a diagram showing examples of the brightness range of standard dynamic range (SDR) and HDR images. Figure 3 This is a diagram illustrating an example of the post-processing function determined by the HDR post-processing analysis block. Figure 4A and Figure 4B This is a diagram illustrating an example operation of the HDR post-processing analysis block that determines the input and output luminance values. Figure 5A and Figure 5B This is a diagram illustrating an example operation of an HDR post-processing analysis block that applies a gain coefficient to the difference between the input luminance value and the output luminance value. Figure 6 This is a diagram illustrating an example operation of an HDR post-processor that calculates the output brightness value for each input brightness value. Figure 7 This is a diagram illustrating examples of post-processing functions and their inverses that can be used by an HDR post-processor.

[0027] Reference Figure 1The high dynamic range (HDR) post-processing device 100 may include an HDR post-processing analysis block 120 and an HDR post-processing processor 160. In some embodiments, such as Figure 1 As shown, the HDR post-processing device 100 may further include an RGB-to-YCbCr converter 110 and a YCbCr-to-RGB converter 170. The HDR post-processing device 100 may be included in or coupled to a display device.

[0028] The HDR post-processing device 100 can receive input image data IDAT for HDR images from an external main processor (e.g., application processor (AP), graphics processing unit (GPU), graphics card, etc.) or from the HDR device of the display device controller. In the HDR image, the brightness of low-grayscale or low-brightness images can be reduced, and the brightness of high-grayscale or high-brightness images can be increased. Accordingly, as... Figure 2 As shown in the example, an HDR image may have a luminance distribution 230, which has a dynamic range or luminance range greater than that of a normal image or a standard dynamic range (SDR) image, or a luminance distribution 210, or a luminance range SDR_LR.

[0029] The RGB-to-YCbCr converter 110 can receive input image data IDAT (in RGB_IN format) from an external main processor or from the HDR device of the controller, and can generate YCbCr data YCC_IN, including luminance and chrominance data, by performing an RGB-to-YCbCr conversion operation on the input image data IDAT. The RGB-to-YCbCr converter 110 can then provide the input image data IDAT in YCbCr data YCC_IN format to the HDR post-processing analysis block 120. For example, the YCbCr data YCC_IN may include, but is not limited to, luminance data, blue chrominance data, and red chrominance data.

[0030] The HDR post-processing analysis block 120 can determine the post-processing function HPP_FUNC by analyzing the input image data IDAT. In some embodiments, the post-processing function HPP_FUNC may correspond to HDR forward processing that reduces low grayscale or low brightness and increases high grayscale or high brightness. For example, low grayscale or low brightness may be within a first predetermined range of grayscale value or brightness, and high grayscale or high brightness may be within a second predetermined range of grayscale value or brightness, respectively.

[0031] like Figure 3As shown, for example, regarding an input brightness value in a low grayscale or low brightness region, the post-processing function HPP_FUNC determined by the HDR post-processing analysis block 120 can generate an output brightness value lower than the input brightness value. Similarly, regarding an input brightness value in a high grayscale or high brightness region, the post-processing function HPP_FUNC determined by the HDR post-processing analysis block 120 can also generate an output brightness value higher than the input brightness value. Therefore, in this example, the post-processing function HPP_FUNC can correspond to the S-curve 300.

[0032] In some implementations, in order to determine the post-processing function HPP_FUNC and provide it to the HDR post-processing processor 160, the HDR post-processing analysis block 120 may determine the following values ​​corresponding to the post-processing function HPP_FUNC: low grayscale input luminance value IN_LOW, medium grayscale input luminance value IN_MID, high grayscale input luminance value IN_HIGH, low grayscale output luminance value OUT_LOW, medium grayscale output luminance value OUT_MID, and high grayscale output luminance value OUT_HIGH. Furthermore, the HDR post-processing analysis block 120 may provide the low grayscale input luminance value IN_LOW, medium grayscale input luminance value IN_MID, high grayscale input luminance value IN_HIGH, low grayscale output luminance value OUT_LOW, medium grayscale output luminance value OUT_MID, and high grayscale output luminance value OUT_HIGH to the HDR post-processing processor 160.

[0033] In some implementations, the HDR post-processing analysis block 120 can determine the low grayscale average luminance value, mid grayscale luminance value, and high grayscale average luminance value of the input image data IDAT by analyzing the luminance values ​​represented by the luminance data of the input image data IDAT. The HDR post-processing analysis block 120 can determine the low grayscale input luminance value IN_LOW, mid grayscale input luminance value IN_MID, high grayscale input luminance value IN_HIGH, low grayscale output luminance value OUT_LOW, mid grayscale output luminance value OUT_MID, and high grayscale output luminance value OUT_HIGH corresponding to the post-processing function HPP_FUNC based on the low grayscale average luminance value, mid grayscale luminance value, and high grayscale average luminance value of the input image data IDAT.

[0034] like Figure 4A As shown, for example, the HDR post-processing analysis block 120 can use equation 310: Y_AVG = ΣY_IN / Y_IN's #, to calculate the average luminance value Y_AVG of the luminance values ​​of the input image data IDAT. Here, Y_AVG can represent the average luminance value, and Y_IN can represent each luminance value of the input image data IDAT or each input luminance value. Additionally, # can represent the corresponding quantity.

[0035] When the average luminance value Y_AVG is lower than the first reference average luminance value RAYV1 (e.g., 3072), the HDR post-processing analysis block 120 can determine the low grayscale average luminance value Y_LOW by calculating the average of luminance values ​​lower than the first reference intermediate luminance value (e.g., 2048) using equation 322: Y_LOW = Σ(Y_IN<2048) / (Y_IN<2048). Furthermore, the HDR post-processing analysis block 120 can determine the mid-grayscale luminance value Y_MID as the first reference intermediate luminance value using equation 324: Y_MID = 2048, and can determine the high grayscale average luminance value Y_HIGH by calculating the average of luminance values ​​higher than the first reference intermediate luminance value using equation 326: Y_HIGH = Σ(Y_IN>2048) / (Y_IN>2048). In these equations, Y_IN can represent each brightness value of the input image data IDAT or each input brightness value, Y_LOW can represent the low grayscale average brightness value, Y_MID can represent the medium grayscale brightness value, and Y_HIGH can represent the high grayscale average brightness value.

[0036] When the average luminance value Y_AVG is higher than or equal to the first reference average luminance value RAYV1 and lower than the second reference average luminance value RAYV2 (e.g., 5120), the HDR post-processing analysis block 120 can determine the low grayscale average luminance value Y_LOW by calculating the average of luminance values ​​lower than the second reference intermediate luminance value (e.g., 4096) using equation 332: Y_LOW = Σ(Y_IN<4096) / (Y_IN<4096). Furthermore, the HDR post-processing analysis block 120 can determine the mid-grayscale luminance value Y_MID as the second reference intermediate luminance value using equation 334: Y_MID = 4096, and can determine the high grayscale average luminance value Y_HIGH by calculating the average of luminance values ​​higher than the second reference intermediate luminance value using equation 336: Y_HIGH = Σ(Y_IN>4096) / (Y_IN>4096).

[0037] When the average luminance value Y_AVG is higher than or equal to the second reference average luminance value RAYV2, the HDR post-processing analysis block 120 can determine the low grayscale average luminance value Y_LOW by calculating the average of luminance values ​​lower than the third reference intermediate luminance value (e.g., 6144) using equation 342: Y_LOW = Σ(Y_IN<6144) / (Y_IN<6144). Furthermore, the HDR post-processing analysis block 120 can determine the mid-grayscale luminance value Y_MID as the third reference intermediate luminance value using equation 344: Y_MID = 6144, and can determine the high grayscale average luminance value Y_HIGH by calculating the average of luminance values ​​higher than the third reference intermediate luminance value using equation 346: Y_HIGH = Σ(Y_IN>6144) / (Y_IN>6144).

[0038] like Figure 4B As shown, for example, the HDR post-processing analysis block 120 can use equation 352: IN_LOW = Y_MID / 2 to determine the low grayscale input brightness value IN_LOW. Furthermore, the HDR post-processing analysis block 120 can use equation 354: IN_MID = Y_MID to determine the mid-grayscale input brightness value IN_MID, and can use equation 356: IN_HIGH = Y_MID + (Y_MAX - Y_MID) / 2 to determine the high grayscale input brightness value IN_HIGH. Additionally, the HDR post-processing analysis block 120 can use equation 362: OUT_LOW = IN_LOW - |(Y_LOW - IN_LOW)| to determine the low grayscale output brightness value OUT_LOW, and can use equation 364: OUT_MID = IN_MID to determine the mid-grayscale output brightness value OUT_MID. In addition, the HDR post-processing analysis block 120 can use equation 366: OUT_HIGH=IN_HIGH+|(Y_HIGH-IN_HIGH)| to determine the high grayscale output brightness value OUT_HIGH.

[0039] In the above equations, IN_LOW represents a low grayscale input brightness value, IN_MID represents a medium grayscale input brightness value, IN_HIGH represents a high grayscale input brightness value, Y_LOW represents a low grayscale average brightness value, Y_MID represents a medium grayscale brightness value, Y_HIGH represents a high grayscale average brightness value, Y_MAX represents the maximum brightness value of the input image data IDAT or the output image data ODAT, OUT_LOW represents a low grayscale output brightness value, OUT_MID represents a medium grayscale output brightness value, and OUT_HIGH represents a high grayscale output brightness value.

[0040] In this way, the HDR post-processing analysis block 120 can determine the input luminance values ​​IN_LOW, IN_MID, and IN_HIGH and the output luminance values ​​OUT_LOW, OUT_MID, and OUT_HIGH suitable for the input image data IDAT, or it can determine the input luminance values ​​IN_LOW, IN_MID, and IN_HIGH and the output luminance values ​​OUT_LOW, OUT_MID, and OUT_HIGH corresponding to the S-shaped curve 300 used for HDR forward processing. Figure 4A and Figure 4B Example operation of HDR post-processing analysis block 120 for determining input luminance values ​​IN_LOW, IN_MID, and IN_HIGH, and output luminance values ​​OUT_LOW, OUT_MID, and OUT_HIGH is shown. In another embodiment, HDR post-processing analysis block 120 may determine the input and output luminance values ​​based on different equations.

[0041] In some implementations, after determining the input luminance values ​​IN_LOW, IN_MID, and IN_HIGH, and the output luminance values ​​OUT_LOW, OUT_MID, and OUT_HIGH, the HDR post-processing analysis block 120 can use gain coefficients to change the output luminance values ​​OUT_LOW, OUT_MID, and OUT_HIGH (or the low grayscale output luminance value OUT_LOW and the high grayscale output luminance value OUT_HIGH). For example, in some implementations, the HDR post-processing analysis block 120 can apply the gain coefficients to the difference between the low grayscale input luminance value IN_LOW and the low grayscale output luminance value OUT_LOW to determine a low grayscale output luminance value OUT_LOW' that may have an increased difference with respect to the low grayscale input luminance value IN_LOW.

[0042] like Figure 5A As shown, for example, the HDR post-processing analysis block 120 can use equation 372: DIFF_LOW = IN_LOW - OUT_LOW to calculate the low grayscale brightness difference DIFF_LOW, and can use equation 374: OUT_LOW' = IN_LOW - (DIFF_LOW * GAIN) to calculate the low grayscale output brightness value OUT_LOW' with the increased difference. Here, IN_LOW can represent the low grayscale input brightness value, OUT_LOW can represent the low grayscale output brightness value, DIFF_LOW can represent the low grayscale brightness difference, GAIN can represent the gain coefficient, and OUT_LOW' can represent the low grayscale output brightness value with the increased difference.

[0043] In addition, the HDR post-processing analysis block 120 can apply a gain coefficient to the difference between the high grayscale input brightness value IN_HIGH and the high grayscale output brightness value OUT_HIGH to determine the high grayscale output brightness value OUT_HIGH' which has an increased difference with respect to the high grayscale input brightness value IN_HIGH.

[0044] like Figure 5A As shown, for example, the HDR post-processing analysis block 120 can use equation 382: DIFF_HIGH = OUT_HIGH - IN_HIGH to calculate the high grayscale brightness difference DIFF_HIGH, and can use equation 384: OUT_HIGH' = IN_HIGH + (DIFF_HIGH * GAIN) to calculate the high grayscale output brightness value OUT_HIGH' with the increased difference. Here, IN_HIGH can represent the high grayscale input brightness value, OUT_HIGH can represent the high grayscale output brightness value, DIFF_HIGH can represent the high grayscale brightness difference, GAIN can represent the gain coefficient, and OUT_HIGH' can represent the high grayscale output brightness value with the increased difference.

[0045] like Figure 5B As shown, when applying the gain coefficient, the low grayscale output brightness value OUT_LOW can be reduced to a low grayscale output brightness value OUT_LOW' with an increased difference, and the high grayscale output brightness value OUT_HIGH can be increased to a high grayscale output brightness value OUT_HIGH' with an increased difference. Therefore, the S-shaped curve 300 corresponding to the input brightness values ​​IN_LOW, IN_MID, and IN_HIGH and the output brightness values ​​OUT_LOW, OUT_MID, and OUT_HIGH can be changed to curve 390 represented by the input brightness values ​​IN_LOW, IN_MID, and IN_HIGH and the output brightness values ​​OUT_LOW', OUT_MID, and OUT_HIGH'.

[0046] The HDR post-processor 160 can receive a post-processing function HPP_FUNC or input luminance values ​​IN_LOW, IN_MID, and IN_HIGH corresponding to the post-processing function HPP_FUNC, and output luminance values ​​OUT_LOW, OUT_MID, and OUT_HIGH, from the HDR post-processing analysis block 120. Furthermore, the HDR post-processor 160 can receive a backward selection signal BACKWARD_SEL from an external main processor or from a backward selection signal generator of the controller. Then, in response to the backward selection signal BACKWARD_SEL, the HDR post-processor 160 can selectively perform HDR forward processing (corresponding to the post-processing function HPP_FUNC) or HDR backward processing (corresponding to the inverse function of HPP_FUNC) on the input image data IDAT.

[0047] The value of the back selection signal BACKWARD_SEL can be determined based on one or more of the following factors: the frame rate of the display device, the amount of motion of the object represented by the input image data IDAT, and / or the average brightness value of the input image data IDAT. Therefore, in some embodiments, the back selection signal BACKWARD_SEL may have a value indicating HDR forward processing at high frame rates, in images with low motion and / or in low-brightness images, and may have a value indicating HDR backward processing at low frame rates, in images with high motion and / or in high-brightness images. In one embodiment, for example, the terms low, high, large, small, and other relative terms may be determined relative to one or more corresponding predetermined reference levels.

[0048] In the example, the back selection signal BACKWARD_SEL may have a first value (e.g., '0') indicating that HDR forward processing should be performed when the display device's frame rate is higher than or equal to the reference frame rate, and may have a second value (e.g., '1') indicating that HDR backward processing should be performed when the display device's frame rate is lower than the reference frame rate.

[0049] In the example, the backward selection signal BACKWARD_SEL may have a first value indicating that HDR forward processing should be performed when the amount of motion of the object represented by the input image data IDAT is less than the reference amount of motion, and may have a second value indicating that HDR backward processing should be performed when the amount of motion of the object represented by the input image data IDAT is greater than or equal to the reference amount of motion.

[0050] In the example, the backward selection signal BACKWARD_SEL may have a first value indicating that HDR forward processing should be performed when the average brightness value of the input image data IDAT is lower than the reference brightness value, and may have a second value indicating that HDR backward processing should be performed when the average brightness value of the input image data IDAT is higher than or equal to the reference brightness value.

[0051] In some implementations, the HDR post-processor 160 may receive from the HDR post-processing analysis block 120 the low grayscale input luminance value IN_LOW, the mid grayscale input luminance value IN_MID, the high grayscale input luminance value IN_HIGH, the low grayscale output luminance value OUT_LOW, the mid grayscale output luminance value OUT_MID, and the high grayscale output luminance value OUT_HIGH corresponding to the post-processing function HPP_FUNC. The HDR post-processor 160 may determine the conversion difference between each luminance value of the input image data IDAT and the post-processing function HPP_FUNC based on the low grayscale input luminance value IN_LOW, the mid grayscale input luminance value IN_MID, the high grayscale input luminance value IN_HIGH, the low grayscale output luminance value OUT_LOW, the mid grayscale output luminance value OUT_MID, and the high grayscale output luminance value OUT_HIGH.

[0052] When the back selection signal BACKWARD_SEL has a first value (e.g., '0'), the HDR post-processor 160 can calculate the output brightness value corresponding to the brightness value of the input image data IDAT by adding the conversion difference to the brightness value of the input image data IDAT. Therefore, when the back selection signal BACKWARD_SEL has a first value, HDR forward processing that reduces low grayscale or low brightness and increases high grayscale or high brightness can be performed on the input image data IDAT. Then, output image data ODAT with the output brightness value can be generated by the HDR forward processing.

[0053] Furthermore, when the back selection signal BACKWARD_SEL has a second value (e.g., '1'), the HDR post-processor 160 can calculate the output brightness value corresponding to the brightness value of the input image data IDAT by subtracting the conversion difference from the brightness value of the input image data IDAT. Therefore, when the back selection signal BACKWARD_SEL has a second value, HDR back-processing that increases low grayscale or low brightness and decreases high grayscale or high brightness can be performed on the input image data IDAT. Then, output image data ODAT with the output brightness value can be generated through HDR back-processing.

[0054] like Figure 6 As shown, for example, for each brightness value of the input image data IDAT below the mid-grayscale input brightness value IN_MID, the HDR post-processor 160 can use equation 410: CONV_DIFF = 2*(OUT_LOW - IN_LOW)*Y_IN / IN_LOW - (OUT_LOW - IN_LOW)*(Y_IN) 2 / (IN_LOW) 2To determine the conversion difference CONV_DIFF for the brightness value. Here, CONV_DIFF can represent the conversion difference, OUT_LOW can represent the low grayscale output brightness value, IN_LOW can represent the low grayscale input brightness value, and Y_IN can represent the brightness value of the input image data IDAT.

[0055] Furthermore, for each brightness value of the input image data IDAT that is higher than the mid-grayscale input brightness value IN_MID, the HDR post-processor 160 can use equation 430: CONV_DIFF = 2*(OUT_HIGH-IN_HIGH)*(Y_IN-IN_MID) / (IN_HIGH-IN_MID)-(OUT_HIGH-IN_HIGH)*(Y_IN-IN_MID) 2 / (IN_HIGH-IN_MID) 2 The conversion difference CONV_DIFF for the luminance values ​​is determined. Here, CONV_DIFF can represent the conversion difference, OUT_HIGH can represent the high grayscale output luminance value, IN_HIGH can represent the high grayscale input luminance value, Y_IN can represent the luminance value of the input image data IDAT, and IN_MID can represent the mid-grayscale input luminance value. For each luminance value of the input image data IDAT, which is the mid-grayscale input luminance value IN_MID, the HDR post-processor 160 can determine the conversion difference to be zero (or 0).

[0056] When the backward selection signal BACKWARD_SEL has a first value, the HDR post-processor 160 can use equation 450: Y_OUT = Y_IN + CONV_DIFF to calculate the output brightness value Y_OUT corresponding to the brightness value of the input image data IDAT, where Y_OUT can represent the output brightness value, Y_IN can represent the brightness value of the input image data IDAT, and CONV_DIFF can represent the conversion difference.

[0057] Accordingly, HDR forward processing can be implemented to reduce low grayscale or low brightness and increase high grayscale or high brightness, and the input brightness value Y_IN of the input image data IDAT and the output brightness value Y_OUT of the output image data ODAT can have a relationship with the S-shaped curve 300 corresponding to the post-processing function HPP_FUNC, for example, as Figure 7 As shown in the image.

[0058] Furthermore, when the backward selection signal BACKWARD_SEL has a second value, the HDR post-processor 160 can use equation 470: Y_OUT = Y_IN - CONV_DIFF to calculate the output brightness value Y_OUT corresponding to the brightness value of the input image data IDAT, where Y_OUT can represent the output brightness value, Y_IN can represent the brightness value of the input image data IDAT, and CONV_DIFF can represent the conversion difference.

[0059] Therefore, HDR backprocessing can be performed to increase low grayscale or low brightness and decrease high grayscale or high brightness, and the input brightness value Y_IN of the input image data IDAT and the output brightness value Y_OUT of the output image data ODAT can have a relationship with an inverted S-shaped curve 400 corresponding to the inverse function HPP_FUNC (e.g., reversed about the "Y=X" axis), for example, as Figure 7 As shown in the image.

[0060] The YCbCr to RGB converter 170 can receive output image data ODAT in the format of YCbCr data YCC_OUT from the HDR post-processor 160, generate RGB data RGB_OUT by performing a YCbCr to RGB conversion operation on the output image data ODAT, and provide the output image data ODAT in the format of RGB data RGB_OUT to an external device, such as a data driver of a display device.

[0061] As described above, in the HDR post-processing apparatus 100 according to the embodiment, the HDR post-processing analysis block 120 can determine the post-processing function HPP_FUNC by analyzing the input image data IDAT, and the HDR post-processing processor 160 can selectively perform HDR forward processing corresponding to the post-processing function HPP_FUNC or HDR backward processing corresponding to the inverse function of HPP_FUNC on the input image data IDAT in response to the backward selection signal BACKWARD_SEL. Therefore, HDR backward processing can be performed at low frame rates, in images with a large amount of motion, and / or in high-brightness images. Therefore, jitter (discontinuous motion of objects) perceived in HDR images can be reduced or prevented.

[0062] Figure 8 This is a block diagram illustrating an embodiment of the HDR post-processing device 500, and Figure 9 This is a block diagram showing an example of the HDR post-processing user settings block.

[0063] Reference Figure 8The HDR post-processing device 500 may be included in the display device, and according to embodiments, may include: an RGB to YCbCr converter 110, an HDR post-processing analysis block 120, an HDR post-processing user setting block 540, an HDR post-processing processor 160, and a YCbCr to RGB converter 170. In addition to the HDR post-processing device 500 further including the HDR post-processing user setting block 540 between the HDR post-processing analysis block 120 and the HDR post-processing processor 160, Figure 8 The HDR post-processing device 500 can have similar features Figure 1 Configuration and operation of the HDR post-processing device 100.

[0064] The HDR post-processing user setting block 540 can receive from the HDR post-processing analysis block 120 the input brightness values ​​IN_LOW, IN_MID, and IN_HIGH corresponding to the post-processing function, determined by analyzing the input image data IDAT, and the output brightness values ​​OUT_LOW, OUT_MID, and OUT_HIGH. Furthermore, the HDR post-processing user setting block 540 can store user setting input brightness values ​​U_IN_LOW, U_IN_MID, and U_IN_HIGH and user setting output brightness values ​​U_OUT_LOW, U_OUT_MID, and U_OUT_HIGH set by an external main processor or user settings. In response to the user setting signal USER_SEL from the controller of the external main processor or display device, it can selectively provide the input brightness values ​​IN_LOW, IN_MID, and IN_HIGH and the output brightness values ​​OUT_LOW, OUT_MID, and OUT_HIGH, or the user setting input brightness values ​​U_IN_LOW, U_IN_MID, and U_IN_HIGH and the user setting output brightness values ​​U_OUT_LOW, U_OUT_MID, and U_OUT_HIGH to the HDR post-processing processor 160.

[0065] like Figure 9As shown, in some embodiments, the HDR post-processing user settings block 540 may include a user settings storage block 542 and a multiplexer 544. The user settings storage block 542 may store user-set input luminance values ​​U_IN_LOW, U_IN_MID, and U_IN_HIGH, and user-set output luminance values ​​U_OUT_LOW, U_OUT_MID, and U_OUT_HIGH, set by an external main processor or user settings. The multiplexer 544 may receive input luminance values ​​IN_LOW, IN_MID, and IN_HIGH and output luminance values ​​OUT_LOW, OUT_MID, and OUT_HIGH corresponding to the post-processing function from the HDR post-processing analysis block 120, and may also receive user-set input luminance values ​​U_IN_LOW, U_IN_MID, and U_IN_HIGH and user-set output luminance values ​​U_OUT_LOW, U_OUT_MID, and U_OUT_HIGH from the user settings storage block 542. Then, in response to the user setting signal USER_SEL, the multiplexer 544 can selectively output the input luminance values ​​IN_LOW, IN_MID, and IN_HIGH and the output luminance values ​​OUT_LOW, OUT_MID, and OUT_HIGH, or the user-set input luminance values ​​U_IN_LOW, U_IN_MID, and U_IN_HIGH and the user-set output luminance values ​​U_OUT_LOW, U_OUT_MID, and U_OUT_HIGH to the HDR post-processor 160.

[0066] The HDR post-processor 160 can receive from the HDR post-processing user setting block 540 the input luminance values ​​IN_LOW, IN_MID, and IN_HIGH and the output luminance values ​​OUT_LOW, OUT_MID, and OUT_HIGH corresponding to the post-processing function, or the user-set input luminance values ​​U_IN_LOW, U_IN_MID, and U_IN_HIGH and the user-set output luminance values ​​U_OUT_LOW, U_OUT_MID, and U_OUT_HIGH corresponding to the user setting function. When the input luminance values ​​IN_LOW, IN_MID, and IN_HIGH and the output luminance values ​​OUT_LOW, OUT_MID, and OUT_HIGH are received, the HDR post-processor 160 can selectively perform HDR forward processing corresponding to the post-processing function or HDR backward processing corresponding to the inverse function of the post-processing function on the input image data IDAT in response to the backward selection signal BACKWARD_SEL. When user-defined input brightness values ​​U_IN_LOW, U_IN_MID, and U_IN_HIGH, and user-defined output brightness values ​​U_OUT_LOW, U_OUT_MID, and U_OUT_HIGH are received, the HDR post-processor 160 may selectively perform processing corresponding to the user-defined function or the inverse function of the user-defined function on the input image data IDAT in response to the back selection signal BACKWARD_SEL.

[0067] Figure 10 This is a block diagram illustrating an embodiment of the HDR post-processing device 600, and Figure 11 This is a block diagram illustrating an example of the HDR post-processing forward and backward control block.

[0068] Reference Figure 10 The HDR post-processing device 600 may be included in or connected to the display device, and according to various embodiments, may include: an RGB-to-YCbCr converter 110, an HDR post-processing analysis block 120, an HDR post-processing forward and backward control block 640, an HDR post-processing processor 660, and a YCbCr-to-RGB converter 170. In addition to the HDR post-processing forward and backward control block 640 and the HDR post-processing processor 660, Figure 10 The HDR post-processing unit 600 may have similar features Figure 1The HDR post-processing unit 100 is configured and operated. The HDR post-processing forward / backward control block 640 can determine, in response to the backward selection signal BACKWARD_SEL, either HDR forward processing corresponding to the first post-processing function HPP_FUNC1 or HDR backward processing corresponding to the second post-processing function HPP_FUNC2. Then, the HDR post-processing processor 660 can execute the HDR forward processing or HDR backward processing determined by the HDR post-processing forward / backward control block 640.

[0069] The HDR post-processing forward and backward control block 640 can receive a first post-processing function HPP_FUNC1 for HDR forward processing determined by analyzing the input image data IDAT from the HDR post-processing analysis block 120, and can store a second post-processing function HPP_FUNC2 for HDR backward processing previously determined by an external main processor or a controller of the display device. In response to a backward selection signal BACKWARD_SEL from the external main processor or controller, the HDR post-processing forward and backward control block 640 can selectively provide either the first post-processing function HPP_FUNC1 for HDR forward processing or the second post-processing function HPP_FUNC2 for HDR backward processing to the HDR post-processing processor 660.

[0070] In some implementations, such as Figure 11 As shown, the HDR post-processing forward and backward control block 640 may include a backward function storage block 642 and a multiplexer 644. The backward function storage block 642 may store the second input luminance values ​​BACK_IN_LOW, BACK_IN_MID, and BACK_IN_HIGH, and the second output luminance values ​​BACK_OUT_LOW, BACK_OUT_MID, and BACK_OUT_OUT, corresponding to the second post-processing function HPP_FUNC2 previously determined by an external main processor or controller.

[0071] The multiplexer 644 can receive from the HDR post-processing analysis block 120 the first input luminance values ​​IN_LOW, IN_MID, and IN_HIGH corresponding to the first post-processing function HPP_FUNC1 used for HDR forward processing, and the second input luminance values ​​BACK_IN_LOW, BACK_IN_MID, and BACK_IN_HIGH corresponding to the second post-processing function HPP_FUNC2 used for HDR backward processing, and the second output luminance values ​​BACK_OUT_LOW, BACK_OUT_MID, and BACK_OUT_HIGH corresponding to the second post-processing function HPP_FUNC2 used for HDR backward processing, and the second output luminance values ​​BACK_OUT_LOW, BACK_OUT_MID, and BACK_OUT_HIGH. Then, in response to the backward selection signal BACKWARD_SEL, multiplexer 644 may selectively output the first input luminance values ​​IN_LOW, IN_MID, and IN_HIGH and the first output luminance values ​​OUT_LOW, OUT_MID, and OUT_HIGH corresponding to the first post-processing function HPP_FUNC1 for HDR forward processing, or the second input luminance values ​​BACK_IN_LOW, BACK_IN_MID, and BACK_IN_HIGH and the second output luminance values ​​BACK_OUT_LOW, BACK_OUT_MID, and BACK_OUT_HIGH corresponding to the second post-processing function HPP_FUNC2 for HDR backward processing to HDR post-processing processor 660.

[0072] The HDR post-processing processor 660 can perform either HDR forward processing or HDR backward processing as determined by the HDR post-processing forward-backward control block 640. When the first post-processing function HPP_FUNC1 for HDR forward processing is selected by the HDR post-processing forward-backward control block 640, the HDR post-processing processor 660 can perform HDR forward processing corresponding to the first post-processing function HPP_FUNC1 on the input image data IDAT. Furthermore, when the second post-processing function HPP_FUNC2 for HDR backward processing is selected by the HDR post-processing forward-backward control block 640, the HDR post-processing processor 660 can perform HDR backward processing corresponding to the second post-processing function HPP_FUNC2 on the input image data IDAT.

[0073] Figure 12 This is a block diagram illustrating an embodiment of the display device 700, which may include a display panel 710 having a plurality of pixels PX, a data driver 720 providing data signals DS to the plurality of pixels PX, a scan driver 730 providing scan signals SS to the plurality of pixels PX, and a controller 740 controlling the data driver 720 and the scan driver 730.

[0074] Display panel 710 may include multiple data lines, multiple scan lines, and multiple pixels PX connected to the multiple data lines and multiple scan lines. In some embodiments, each pixel PX may include at least one capacitor, at least two transistors, and an organic light-emitting diode (OLED). For example, display panel 710 may be an organic light-emitting display (OLED) panel. In other embodiments, display panel 710 may be a liquid crystal display (LCD) panel or another type of display panel.

[0075] The data driver 720 can generate a data signal DS based on the data control signal DCTRL received from the controller 740 and the output image data ODAT, and can provide the data signal DS corresponding to the output image data ODAT to the pixel PX via a data line. In some embodiments, the data control signal DCTRL may include, but is not limited to, an output data enable signal, a level start signal, a load signal, and / or different signals. In some embodiments, the data driver 720 and the controller 740 may be implemented as a single integrated circuit. For example, the single integrated circuit may be referred to as a timing controller embedded data driver (TED). In other embodiments, the data driver 720 and the controller 740 may be implemented using separate integrated circuits.

[0076] The scan driver 730 can generate scan signals SS based on scan control signals SCTRL received from the controller 740, and can sequentially provide scan signals SS to pixels PX on a line-by-line basis via scan lines. In some embodiments, the scan control signal SCTRL may include, but is not limited to, a scan start signal, a scan clock signal, and / or other signals. In some embodiments, the scan driver 730 may be integrated or included in a peripheral portion of the display panel 710. In other embodiments, the scan driver 730 may be implemented using one or more integrated circuits.

[0077] Controller 740 (e.g., a timing controller (TCON)) may receive input image data IDAT and control signal CTRL from an external host processor (e.g., an application processor (AP), a graphics processing unit (GPU), or a graphics card). In some embodiments, the control signal CTRL may include a back selection signal BACKWARD_SEL for selecting HDR forward processing or HDR backward processing for the input image data IDAT. In some embodiments, the control signal CTRL may also include, but is not limited to, a vertical synchronization signal, a horizontal synchronization signal, an input data enable signal, a master clock signal, and / or other signals. Controller 740 may generate output image data ODAT, a data control signal DCTRL, and a scan control signal SCTRL based on the input image data IDAT and the control signal CTRL. Controller 740 may control data driver 720 by providing output image data ODAT and data control signal DCTRL to data driver 720, and may control scan driver 730 by providing scan control signal SCTRL to scan driver 730.

[0078] According to the embodiment, the controller 740 of the display device 700 can receive HDR image data HDR_DAT, representing an HDR image, as input image data IDAT from an external main processor. Compared to normal images or SDR images, HDR images can have an extended dynamic range, and the image quality of the display device 700 displaying HDR images can be improved compared to display devices displaying normal images or SDR images. However, unlike SDR images, HDR images tend to exhibit jitter (unnatural movement of objects or discontinuous movement of objects).

[0079] To prevent jitter, the controller 740 may include an HDR post-processing device 750. According to one embodiment, the HDR post-processing device 750 may be... Figure 1 HDR post-processing device 100 Figure 8 HDR post-processing device 500 or Figure 10 HDR post-processing device 600, etc.

[0080] The HDR post-processing device 750 can receive a backward selection signal BACKWARD_SEL, determine a post-processing function by analyzing the input image data IDAT, and selectively perform HDR forward processing corresponding to the post-processing function or HDR backward processing corresponding to the inverse function of the post-processing function on the input image data IDAT in response to the backward selection signal BACKWARD_SEL. Accordingly, HDR backward processing can be performed at low frame rates, in images with high motion, and / or in high-brightness images. Therefore, jitter (discontinuous motion of objects) perceived in HDR images can be reduced or prevented.

[0081] Figure 13 This is a block diagram illustrating an embodiment of the display device 800. Figure 14A This is a diagram illustrating examples of images at low frame rates or with high motion. Figure 14B This is a diagram showing examples of images at high frame rates or with low motion.

[0082] Reference Figure 13 According to an embodiment, the display device 800 may include a display panel 710, a data driver 720, a scan driver 730, and a controller 840. The controller 840 may include an HDR post-processing device 850 and a backselect signal generator 860. Except that the controller 840 may not receive the backselect signal BACKWARD_SEL from an external main processor and may include a backselect signal generator 860 for generating the backselect signal BACKWARD_SEL, Figure 13 The display device 800 may have a similar Figure 12 Configuration and operation of the display device 700.

[0083] The backward selection signal generator 860 can generate a backward selection signal BACKWARD_SEL that indicates HDR forward processing or HDR backward processing based on the frame rate of the display device 800, the amount of motion of the object represented by the input image data IDAT, and / or the average brightness value of the input image data IDAT.

[0084] In some embodiments, the backward selection signal generator 860 can detect the frame rate of the display device 800, generate a backward selection signal BACKWARD_SEL with a first value indicating that HDR forward processing should be performed when the frame rate is higher than or equal to a reference frame rate, and generate a backward selection signal BACKWARD_SEL with a second value indicating that HDR backward processing should be performed when the frame rate is lower than the reference frame rate. The HDR post-processing device 850 can selectively perform HDR forward processing or HDR backward processing in response to the backward selection signal BACKWARD_SEL.

[0085] like Figure 14A and Figure 14BAs shown, even when the display device 800 displays HDR images 910 and 940 with substantially the same amount of motion, the amount of motion of objects 920 and 930 in the previous and current frames of HDR image 910 (when the display device 800 displays HDR image 910 at a low frame rate (e.g., about 30 Hz)) can be greater than the amount of motion of objects 950 and 960 in the previous and current frames of HDR image 940 (when the display device 800 displays HDR image 940 at a high frame rate (e.g., about 120 Hz)). Accordingly, at low frame rates, jitter (discontinuous motion of objects 920 and 930) is perceptible in HDR image 910.

[0086] However, in the display device 800 according to the embodiment, when the display device 800 displays the HDR image 910 at a low frame rate, the back selection signal generator 860 can generate a back selection signal BACKWARD_SEL with a second value. Furthermore, the HDR post-processing device 850 can perform HDR back-processing in response to the back selection signal BACKWARD_SEL with the second value. Accordingly, in the HDR image 910 displayed based on the output image data ODAT after performing HDR back-processing, the dynamic range of the HDR image 910 can be reduced, and jitter in the HDR image 910 can be reduced or prevented.

[0087] In other embodiments, the backward selection signal generator 860 can detect the amount of motion of an object represented by input image data IDAT, generate a backward selection signal BACKWARD_SEL with a first value indicating that HDR forward processing should be performed when the amount of motion of the object is less than a reference amount of motion, and generate a backward selection signal BACKWARD_SEL with a second value indicating that HDR backward processing should be performed when the amount of motion of the object is greater than or equal to the reference amount of motion. Figure 14A and Figure 14B As shown, even if the display device 800 displays HDR images 910 and 940 at substantially the same frame rate, jitter may be perceived in HDR image 910 where objects 920 and 930 have a large amount of motion.

[0088] However, in the display device 800 according to the embodiment, when the display device 800 displays an HDR image 910 in which objects 920 and 930 have large motion, the back selection signal generator 860 can generate a back selection signal BACKWARD_SEL with a second value. Furthermore, the HDR post-processing device 850 can perform HDR back processing in response to the back selection signal BACKWARD_SEL with the second value. Accordingly, in the HDR image 910 displayed based on the output image data ODAT after performing HDR back processing, the dynamic range of the HDR image 910 can be reduced, and thus jitter can be reduced or prevented from being perceived in the HDR image 910.

[0089] In some implementations, the backward selection signal generator 860 can calculate the average luminance value of the input image data IDAT and generate a backward selection signal BACKWARD_SEL with a first value indicating that HDR forward processing should be performed when the average luminance value is lower than a reference luminance value. Furthermore, the backward selection signal generator 860 can generate a backward selection signal BACKWARD_SEL with a second value indicating that HDR backward processing should be performed when the average luminance value is higher than or equal to the reference luminance value. In this case, there is a tendency for perceived jitter in high-brightness images.

[0090] However, in the display device 800 according to the embodiment, when the display device 800 displays a high-brightness image, the back-selection signal generator 860 can generate a back-selection signal BACKWARD_SEL with a second value. Furthermore, the HDR post-processing device 850 can perform HDR back-processing in response to the back-selection signal BACKWARD_SEL with the second value. Accordingly, in the HDR image displayed based on the output image data ODAT after performing HDR back-processing, the dynamic range of the high-brightness image can be reduced, and thus jitter in the high-brightness image can be reduced or prevented.

[0091] Figure 15 This is a block diagram illustrating an embodiment of a display device 1000, which may include a display panel 710, a data driver 720, a scan driver 730, and a controller 1040. Except that the controller 1040 can receive SDR image data SDR_DAT representing an SDR image, instead of HDR image data HDR_DAT representing an HDR image, as input image data IDAT from an external main processor, Figure 15 The display device 1000 may have a similar Figure 12The controller 1040 is configured and operated by the display device 700. Furthermore, the controller 1040 may include an HDR device 1070 and an HDR post-processing device 1050. The HDR device 1070 can perform HDR processing on the input image data IDAT.

[0092] The HDR device 1070 can receive SDR image data SDR_DAT representing an SDR image as input image data IDAT, perform HDR processing on the input image data IDAT, and provide the HDR-processed input image data IDAT to the HDR post-processing device 1050. In some embodiments, HDR processing may be, but is not limited to, reducing low grayscale or low brightness and increasing high grayscale or high brightness. The HDR post-processing device 1050 can selectively perform HDR forward processing on the HDR-processed input image data IDAT, further reducing low grayscale or low brightness and further increasing high grayscale or high brightness, or HDR backward processing, increasing low grayscale or low brightness and reducing high grayscale or high brightness.

[0093] In the display device 1000 according to the embodiment, HDR backprocessing can be performed at low frame rates (e.g., below a predetermined level), in images with large amounts of motion (e.g., above a predetermined level), and / or in high-brightness images (e.g., above a predetermined level). Therefore, jitter (where the motion of an object appears discontinuous) perceived in HDR images can be reduced or prevented.

[0094] Figure 16 This is a block diagram illustrating an embodiment of electronic device 1200, which may include a processor 1210, a memory device 1220, a storage device 1230, an input / output (I / O) device 1240, a power supply 1250, and a display device 1260. Electronic device 1200 may also include multiple ports for communicating with video cards, sound cards, memory cards, universal serial bus (USB) devices, and / or other electronic devices.

[0095] Processor 1210 can perform various computing functions or tasks. Processor 1210 can be an application processor (AP), a microprocessor, a central processing unit (CPU), or other processing logic. Processor 1210 can be connected to other components via address buses, control buses, data buses, etc. Furthermore, in some embodiments, processor 1210 can be further connected to an expansion bus such as a peripheral component interconnect (PCI) bus.

[0096] The memory device 1220 may store data for the operation of the electronic device 1200. For example, the memory device 1220 may include at least one non-volatile memory device such as an erasable programmable read-only memory (EPROM) device, an electrically erasable programmable read-only memory (EEPROM) device, a flash memory device, a phase-change random access memory (PRAM) device, a resistive random access memory (RRAM) device, a nano-floating gate memory (NFGM) device, a polymer random access memory (PoRAM) device, a magnetic random access memory (MRAM) device, a ferroelectric random access memory (FRAM) device, and / or at least one volatile memory device such as a dynamic random access memory (DRAM) device, a static random access memory (SRAM) device, or a mobile dynamic random access memory (mobile DRAM) device.

[0097] Storage device 1230 may be a solid-state drive (SSD), hard disk drive (HDD), CD-ROM, or another type of storage device. I / O device 1240 may be an input device such as a keyboard, keypad, mouse, or touchscreen, and an output device such as a printer or speaker. Power supply 1250 provides power to the operation of electronic device 1200. Display device 1260 can be connected to other components via a bus or other communication link.

[0098] In the display device 1260, the HDR post-processing device can receive a backward selection signal, determine a post-processing function by analyzing the input image data, and selectively perform HDR forward processing corresponding to the post-processing function or HDR backward processing corresponding to the inverse function of the post-processing function on the input image data in response to the backward selection signal. Accordingly, HDR backward processing can be performed at low frame rates, in images with a large amount of motion, and / or in high-brightness images to reduce or prevent perceptible jitter in HDR images.

[0099] One or more embodiments of the present invention can be applied to any type of display device 1260 and any type of electronic device 1200 including the display device 1260. For example, embodiments of the present invention can be applied to mobile phones, smartphones, tablet computers, televisions (TVs), digital TVs, 3D TVs, wearable electronic devices, personal computers (PCs), home appliances, laptops, personal digital assistants (PDAs), portable multimedia players (PMPs), digital cameras, music players, portable game consoles, navigation devices, etc.

[0100] According to the implementation described herein, relative terms such as “low,” “medium,” and “high” may be represented, for example, as “first,” “second,” and “third,” respectively.

[0101] The methods, processes, and / or operations described herein may be performed by code or instructions executable by a computer, processor, controller, or other signal processing device. The computer, processor, controller, or other signal processing device may be any of the elements described herein or an additional element besides those described herein. Because the algorithms underlying the methods (or the operations of the computer, processor, controller, or other signal processing device) are described in detail, the code or instructions used to implement the operations of the method embodiments may transform the computer, processor, controller, or other signal processing device into a dedicated processor for executing the methods herein.

[0102] Furthermore, another embodiment may include a computer-readable medium for storing the code or instructions described above, such as a non-transitory computer-readable medium. The computer-readable medium may be a volatile or non-volatile memory or other storage device, which may be removably or permanently coupled to a computer, processor, controller, or other signal processing device that will execute the code or instructions for performing the operations of the method embodiment or the device embodiment described herein.

[0103] For example, in one embodiment, a non-transitory computer-readable medium stores instructions that, when executed by one or more processors or logic as described herein, cause one or more processors or logic to analyze image data to determine a post-processing function and selectively perform high dynamic range (HDR) forward processing or HDR backward processing on the image data in response to a backward selection signal. HDR forward processing may correspond to a post-processing function, and HDR backward processing may correspond to the inverse function of the post-processing function. The instructions may also cause one or more processors or logic to perform the operations according to any of the embodiments described herein.

[0104] The controllers, processors, devices, modules, units, blocks, converters, multiplexers, generators, logic, decoders, drivers, and other signal generation and signal processing features disclosed herein may be implemented, for example, with non-transitory logic that may include hardware, software, or both. When implemented at least partially in hardware, the controllers, processors, devices, modules, units, blocks, converters, multiplexers, generators, logic, decoders, drivers, and other signal generation and signal processing features may be, for example, any of a variety of integrated circuits including, but not limited to, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), combinations of logic gates, systems-on-a-chip (SoCs), microprocessors, or other types of processing or control circuitry.

[0105] When implemented at least partially in software, controllers, processors, devices, modules, units, blocks, converters, multiplexers, generators, logic, decoders, drivers, and other signal generation and signal processing features may include, for example, memory or other storage devices for storing code or instructions to be executed by, for example, a computer, processor, microprocessor, controller, or other signal processing device. The computer, processor, microprocessor, controller, or other signal processing device may be any of the elements described herein or an additional element beyond those described herein. Because the algorithms underlying the method (or the operation of the computer, processor, microprocessor, controller, or other signal processing device) are described in detail, the code or instructions for implementing the operation of the method implementation can transform the computer, processor, microprocessor, controller, or other signal processing device into a dedicated processor for performing the methods described herein.

[0106] The foregoing is illustrative of the embodiments and is not to be construed as limiting them. Although several embodiments have been described, those skilled in the art will readily appreciate that many modifications can be made to the embodiments without substantially departing from the novel teachings of the inventive concept. Accordingly, all such modifications are intended to be included within the scope of the inventive concept as defined in the claims. Therefore, it will be understood that the foregoing is illustrative of various embodiments and is not to be construed as limiting to the specific embodiments disclosed, and modifications to the disclosed embodiments and other embodiments are intended to be included within the scope of the appended claims. The embodiments may be combined to form additional embodiments.

Claims

1. A system for high dynamic range post-processing, comprising: The first logic is configured to analyze image data to determine the post-processing function; as well as A processor is configured to receive a backward selection signal and, in response to the backward selection signal, selectively perform high dynamic range forward processing or high dynamic range backward processing on the image data, wherein the high dynamic range forward processing corresponds to the post-processing function and includes reducing low grayscale or low brightness in the image data and increasing high grayscale or high brightness in the image data, and wherein the high dynamic range backward processing corresponds to the inverse function of the post-processing function. The value of the backward selection signal is determined based on at least one of the frame rate of the display device, the amount of motion of the object represented by the image data, and the average brightness value of the image data.

2. The system of claim 1, wherein, The first logical configuration is as follows: The first average grayscale brightness value, the second average grayscale brightness value, and the third average grayscale brightness value of the image data are determined by analyzing the brightness values ​​of the image data. and Based on the first gray-scale average brightness value, the second gray-scale brightness value, and the third gray-scale average brightness value of the image data, determine the first gray-scale input brightness value, the second gray-scale input brightness value, the third gray-scale input brightness value, the first gray-scale output brightness value, the second gray-scale output brightness value, and the third gray-scale output brightness value corresponding to the post-processing function.

3. The system as described in claim 2, wherein: The first logic configuration is to calculate the average brightness value of the brightness values ​​in the image data. When the average brightness value is lower than the first reference average brightness value, the first logic configuration is as follows: The first average grayscale brightness value is determined by calculating the average of the brightness values ​​that are lower than the first reference intermediate brightness value. The second grayscale brightness value is determined as the first reference intermediate brightness value, and The third grayscale average brightness value is determined by calculating the average of the brightness values ​​higher than the first reference intermediate brightness value, and When the average brightness value is higher than or equal to the first reference average brightness value and lower than the second reference average brightness value, the first logic configuration is as follows: The first average grayscale brightness value is determined by calculating the average of the brightness values ​​that are lower than the second reference intermediate brightness value. The second grayscale brightness value is determined as the second reference intermediate brightness value, and The third grayscale average brightness value is determined by calculating the average of the brightness values ​​higher than the second reference intermediate brightness value, and When the average brightness value is higher than or equal to the second reference average brightness value, the first logic configuration is as follows: The first average grayscale brightness value is determined by calculating the average of the brightness values ​​that are lower than the third reference intermediate brightness value. The second grayscale brightness value is determined as the third reference intermediate brightness value, and The third grayscale average brightness value is determined by calculating the average of the brightness values ​​that are higher than the third reference intermediate brightness value.

4. The system of claim 3, wherein, The first logical configuration is as follows: The first grayscale input brightness value is determined using the equation: IN_LOW = Y_MID / 2; The second grayscale input brightness value is determined using the equation: IN_MID=Y_MID; The third grayscale input brightness value is determined using the equation: IN_HIGH=Y_MID+(Y_MAX-Y_MID) / 2; The first grayscale output brightness value is determined using the equation: OUT_LOW = IN_LOW - |(Y_LOW - IN_LOW)|. The second grayscale output brightness value is determined using the equation: OUT_MID = IN_MID; and The third grayscale output brightness value is determined using the equation: OUT_HIGH = IN_HIGH + |(Y_HIGH - IN_HIGH)|. Wherein, IN_LOW represents the first grayscale input brightness value, IN_MID represents the second grayscale input brightness value, IN_HIGH represents the third grayscale input brightness value, Y_LOW represents the first grayscale average brightness value, Y_MID represents the second grayscale brightness value, Y_HIGH represents the third grayscale average brightness value, Y_MAX represents the maximum brightness value, OUT_LOW represents the first grayscale output brightness value, OUT_MID represents the second grayscale output brightness value, and OUT_HIGH represents the third grayscale output brightness value.

5. The system of claim 4, wherein, The first logical configuration is as follows: The gain factor is applied to the difference between the first grayscale input brightness value and the first grayscale output brightness value to determine the first grayscale output brightness value that has an increased difference with respect to the first grayscale input brightness value. and The gain coefficient is applied to the difference between the third grayscale input brightness value and the third grayscale output brightness value to determine the third grayscale output brightness value that has an increased difference with respect to the third grayscale input brightness value.

6. The system of claim 1, wherein, The backward selection signal will have: A first value indicating that the high dynamic range forward processing should be performed when the frame rate of the display device is higher than or equal to a reference frame rate, and The second value indicates that the high dynamic range backward processing should be performed when the frame rate of the display device is lower than the reference frame rate.

7. The system of claim 1, wherein, The backward selection signal will have: A first value indicating that the high dynamic range forward processing should be performed when the amount of motion of the object represented by the image data is less than a reference amount of motion, and A second value indicating that the high dynamic range backward processing should be performed when the amount of motion of the object represented by the image data is greater than or equal to the reference amount of motion.

8. The system of claim 1, wherein, The backward selection signal will have: A first value indicating that the high dynamic range forward processing should be performed when the average brightness value of the image data is lower than a reference brightness value, and A second value indicating that the high dynamic range backward processing should be performed when the average brightness value of the image data is higher than or equal to the reference brightness value.

9. A system for high dynamic range post-processing, comprising: The first logic is configured to analyze image data to determine a first post-processing function corresponding to high dynamic range forward processing; The second logic is configured to receive a backward selection signal and, in response to the backward selection signal, select either the first post-processing function or a second post-processing function corresponding to high dynamic range backward processing. as well as The processor is configured as follows: When the first post-processing function is selected, the high dynamic range forward processing corresponding to the first post-processing function is performed on the image data, and When the second post-processing function is selected, the high dynamic range post-processing corresponding to the second post-processing function is performed on the image data. The high dynamic range forward processing includes reducing low grayscale or low brightness in the image data and increasing high grayscale or high brightness in the image data. The value of the backward selection signal is determined based on at least one of the frame rate of the display device, the amount of motion of the object represented by the image data, and the average brightness value of the image data.

10. A display device, comprising: The display panel includes multiple pixels; A data driver configured to provide data signals to the plurality of pixels; A scan driver configured to provide scan signals to the plurality of pixels; as well as A controller, configured to control the data driver and the scan driver, the controller comprising: The logic is configured to receive a backward selection signal, analyze image data to determine a post-processing function, and selectively perform high dynamic range forward processing or high dynamic range backward processing on the image data in response to the backward selection signal. The high dynamic range forward processing corresponds to the post-processing function and includes reducing low grayscale or low brightness in the image data and increasing high grayscale or high brightness in the image data. The high dynamic range backward processing corresponds to the inverse function of the post-processing function. The value of the backward selection signal is determined based on at least one of the frame rate of the display device, the amount of motion of the object represented by the image data, and the average brightness value of the image data.

Citation Information

Patent Citations

  • Signal reshaping approximation

    US20180020224A1