Display driving apparatus and driving method
By calculating and adjusting brightness data in the LCD display, the problem of blurred image edges was solved, contrast and image resolution were improved, and high-quality image display was achieved.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2021-05-12
- Publication Date
- 2026-04-07
AI Technical Summary
Existing LCD displays suffer from blurry image edges, especially when using a combination of a high-resolution first LCD panel and a low-resolution second LCD panel, resulting in reduced contrast and poor perceived image resolution.
A brightness calculator and an offset calculator are used to calculate the first brightness data corresponding to the first resolution and the second brightness data corresponding to the second resolution, respectively. Output image data and brightness data for the first and second panels are generated through an input image converter and a data output unit. The brightness value is adjusted using the offset calculator to reduce image edge blurring.
It effectively prevents image edge blurring, improves the contrast and image perception resolution of LCD displays, and achieves high-quality image display.
Smart Images

Figure CN113658559B_ABST
Abstract
Description
TECHNICAL FIELD
[0001] The present application relates to a display, and more particularly, to control of brightness of an image displayed on a display. BACKGROUND
[0002] With the development of multimedia technology, various types of display devices such as smart phones and tablet devices in addition to a conventional television system have also been developed and popularized. In particular, large-screen display devices have recently been used as instrument panels in vehicles such as cars. Also, various displays such as liquid crystal displays (LCDs), plasma display panels (PDPs), and organic light emitting displays (OLEDs) have recently been used.
[0003] A conventional LCD includes a backlight that provides light and a liquid crystal panel that displays an image. Since the backlight provides light having uniform brightness, the liquid crystal panel has high offset brightness when a black level is achieved. Korean Patent No. 10-0758986 (hereinafter referred to as Patent Document 1) discloses a liquid crystal display in which an additional second liquid crystal panel is provided between a backlight that provides light and a first liquid crystal panel that displays an image to achieve high-quality image expression having high contrast.
[0004] However, the first liquid crystal panel in Patent Document 1 can have a higher resolution than that of the second liquid crystal panel. In this case, there is a problem that blur occurs at an edge of an image.
[0005] [PATENT DOCUMENT]
[0006] Patent Document 1: Korean Patent No. 10-0758986 (Invention title: Dual liquid crystal display). SUMMARY
[0007] Accordingly, the present application has been made in view of the above problems, and it is an object of the present application to provide a display driving apparatus and driving method capable of preventing blur from occurring at an edge of an image.
[0008] It is another object of the present application to provide a display driving apparatus and driving method for causing a liquid crystal display device to provide high contrast and perform display to improve perceived resolution of an image.
[0009] According to an aspect of the present application, the above and other objects can be achieved by providing a display driving apparatus including a luminance calculator for calculating first luminance data corresponding to a first resolution and second luminance data corresponding to a second resolution smaller than the first resolution using input image data, an offset calculator for calculating an offset based on the first luminance data and the second luminance data, an input image converter for converting the input image data into input image data to which the calculated offset has been applied, a first data output unit for generating output image data for a first panel using the converted input image data, and outputting the generated output image data, and a second data output unit for generating output luminance data for a second panel using the second luminance data, and outputting the generated output luminance data.
[0010] According to another aspect of the present application, there is provided a display driving method for controlling luminance of an image in response to ambient illuminance, the display driving method including the steps of calculating first luminance data corresponding to a first resolution and second luminance data corresponding to a second resolution smaller than the first resolution using input image data, calculating an offset based on the first luminance data and the second luminance data, converting the input image data into input image data to which the calculated offset has been applied, and generating output image data for a first panel using the converted input image data, and generating output luminance data for a second panel using the second luminance data. BRIEF DESCRIPTION OF DRAWINGS
[0011] Figure 1 FIG. 1 is a diagram schematically illustrating a configuration of a display system according to an embodiment of the present application.
[0012] Figure 2 FIG. 2 is a diagram schematically illustrating a configuration of a first panel, a second panel, and a backlight of FIG. 1. Figure 1
[0013] Figure 3
[0014] Figure 4 FIG. 6 is a diagram illustrating a configuration of a data converter of FIG. 1. Figure 1
[0015] Figure 5 FIG. 8 is a diagram illustrating a configuration of an offset calculator of FIG. 1. Figure 4
[0016] Figure 6 FIG. 10 is a diagram for describing a first unit pixel of a first panel and a second unit pixel of a second panel in FIG. 1. Figure 5 A diagram showing the method for calculating the first offset in the first offset calculator.
[0017] Figure 7 It is used to describe in Figure 5 The method for calculating the second offset in the second offset calculator and in Figure 5 A diagram illustrating the method for calculating the third offset in the third offset calculator.
[0018] Figure 8 This is a graph showing the weighting according to brightness level.
[0019] Figure 9A This is a diagram illustrating an example where no offset is applied to the image data.
[0020] Figure 9B This is a diagram showing an example where an offset was applied to the image data.
[0021] Figure 10 This is a flowchart illustrating a display driving method according to an embodiment of the present invention. Detailed Implementation
[0022] The advantages and features of this disclosure, and its implementation methods, will be illustrated by the following description of embodiments with reference to the accompanying drawings. However, this disclosure may be implemented in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete, and will fully convey the scope of this disclosure to those skilled in the art. Furthermore, this disclosure is limited only by the scope of the claims.
[0023] The shapes, dimensions, ratios, angles, and quantities disclosed in the accompanying drawings to describe embodiments of the present disclosure are merely examples, and therefore, the present disclosure is not limited to the details shown. Throughout the text, similar reference numerals refer to similar elements. In the following description, detailed descriptions of relevant known technologies will be omitted where such omissions would unnecessarily obscure the essential points of the present disclosure.
[0024] When using the terms “comprising,” “having,” and “including” as described in this disclosure, another component may be added unless “only” is used. Unless there is an indication to the contrary, singular terms may include plural forms.
[0025] Although not explicitly described, when interpreting a component, it is interpreted as including a range of errors.
[0026] When describing positional relationships, for example, when the positional relationship between two components is described as “~above,” “~above,” “~below,” and “adjacent to~,” one or more other components may be positioned between the two components unless “exactly” or “directly” is used.
[0027] When describing temporal relationships, such as when time sequence is described as “after,” “following,” “next,” and “before,” discontinuous cases may be included unless “exactly” or “directly” is used.
[0028] It will be understood that although the terms “first,” “second,” etc., may be used herein to describe various elements, these elements should not be limited by these terms. These terms are used only to distinguish one element from another. For example, without departing from the scope of this disclosure, a first element may be referred to as a second element, and similarly, a second element may be referred to as a first element.
[0029] Terms such as first and second may be used to describe elements of this disclosure. These terms are used only to distinguish one element from another, and the nature, order, sequence, or number of elements are not limited by these terms. When an element is described as “connected,” “linked,” or “coupled” to another element, it should be understood that the element may be directly connected or coupled to another element, another element may be “inserted” between elements, or these elements may be “connected,” “linked,” or “coupled” to each other via yet another element.
[0030] The “X-axis direction”, “Y-axis direction” and “Z-axis direction” should not be interpreted solely by their geometric relationship of being perpendicular to each other, and can have a wider range of directions within the scope of the functions that the elements of this disclosure can perform.
[0031] The term "at least one" should be understood to include any and all combinations of one or more of the related listed items. For example, "at least one of the first, second and third items" means a combination of all items drawn from two or more of the first, second and third items, as well as the first, second or third item.
[0032] Features of the various embodiments of this disclosure can be partially or wholly linked or combined with each other, and can be technically interoperable and driven in various ways. Embodiments of this disclosure can be performed independently of each other, or they can be performed together in an interdependent relationship.
[0033] Exemplary embodiments of this disclosure will now be described in detail, examples of which are illustrated in the accompanying drawings. Throughout the drawings, the same reference numerals will be used wherever possible to refer to the same or similar parts.
[0034] Figure 1 This is a diagram schematically illustrating the configuration of a display system according to an embodiment of the present invention; Figure 2 It is shown schematically. Figure 1 A diagram showing the configuration of the first panel, the second panel, and the backlight.Figure 3 It is a diagram used to describe the first unit pixel of the first panel and the second unit pixel of the second panel.
[0035] like Figure 1 and Figure 2 As shown, a display system 1 using a display driving device according to an embodiment of the present invention includes a first panel 10, a second panel 20, a backlight 30, a first panel driver 11, a second panel driver 21, and a display driving device 40.
[0036] The first panel 10 includes a plurality of first unit pixels UP10 and can display color images. Each of the plurality of first unit pixels UP10 may include a plurality of sub-pixels with different colors. For example, each of the plurality of first unit pixels UP10 may include a red sub-pixel, a green sub-pixel, and a blue sub-pixel, but the invention is not limited thereto. As another example, each of the plurality of first unit pixels UP10 may include a red sub-pixel, a green sub-pixel, a blue sub-pixel, and a white sub-pixel. In one embodiment, the sub-pixels may be repeatedly formed in the row direction or formed in a 2×2 matrix form.
[0037] According to one embodiment of the present invention, the first panel 10 may be a liquid crystal panel including a first lower substrate 110, a first lower electrode 120, a first liquid crystal layer 130, a first upper electrode 140, a plurality of color filters 150 and a first upper substrate 160.
[0038] Specifically, the first lower substrate 110 may be a transparent substrate and may include a plurality of thin-film transistors formed at the intersection of a plurality of gate lines and a plurality of data lines. Each of the plurality of thin-film transistors provides a data signal provided by the data lines to the corresponding sub-pixel in response to a scan pulse provided by the gate lines.
[0039] The first lower electrode 120 can be disposed on and connected to the plurality of thin-film transistors formed thereon on the first lower substrate 110. The first upper electrode 140 can be formed on the first upper substrate 160. The first liquid crystal layer 130 is disposed between the first lower electrode 120 and the first upper electrode 140. The first liquid crystal layer 130 can be aligned according to the vertical electric field formed between the first lower electrode 120 and the first upper electrode 140. The first panel 10 can control the transmittance of light L2 irradiated from the second panel 20 according to the alignment of the first liquid crystal layer 130.
[0040] Additionally, the first panel 10 includes a plurality of color filters 150 formed on the first upper substrate 160 to correspond to sub-pixels. The color filters 150 corresponding to each color can be configured to correspond to the sub-pixels representing that color, respectively. For example, the color filters 150 corresponding to red, green, and blue can be configured to correspond to red, green, and blue sub-pixels, respectively, but the invention is not limited thereto. As another example, the color filters 150 corresponding to red, green, blue, and white can be configured to correspond to red, green, blue, and white sub-pixels, respectively. A color filter may not be provided for the white sub-pixels.
[0041] In the first panel 10, the amount of light L2 emanating from the second panel 20 changes as the light L2 passes through the first liquid crystal layer 130, and then the light L2 becomes colored light L3 as it passes through the color filter 150 and is emanating to the outside. Therefore, the first panel 10 can display a color image.
[0042] The second panel 20 may include multiple unit pixels UP20 and display a monochrome image. The second unit pixels UP20 are larger than the first unit pixels UP10. Each second unit pixel UP20 may correspond to two or more first unit pixels UP10. For example, as... Figure 3 As shown, a single second unit pixel UP20 can correspond to four first unit pixels UP11, UP12, UP13, and UP14. Here, the size of a single second unit pixel UP20 can be equal to the size of the four first unit pixels UP11, UP12, UP13, and UP14.
[0043] As described above, the second panel 20 includes a second unit pixel UP20 that is larger than the first unit pixel UP10 included in the first panel 10, and therefore can have a lower resolution than the first panel 10. The first panel 10 may include a plurality of first unit pixels UP10 and have a first resolution, while the second panel 20 may include a plurality of second unit pixels UP20 and have a second resolution lower than the first resolution. For example, as... Figure 3 As shown, when a single second unit pixel UP20 corresponds to four first unit pixels UP11, UP12, UP13 and UP14, the resolution of the second panel 20 can be one-quarter of the resolution of the first panel 10.
[0044] According to one embodiment of the present invention, the second panel 20 may be a liquid crystal panel including a second lower substrate 210, a second lower electrode 220, a second liquid crystal layer 230, a second upper electrode 240, and a second upper substrate 250.
[0045] Specifically, the second lower substrate 210 may be a transparent substrate and may include a plurality of thin-film transistors formed at the intersection of a plurality of gate lines and a plurality of data lines. Each of the plurality of thin-film transistors provides a data signal provided via the data lines to the corresponding second unit pixel UP20 in response to a scan pulse provided via the gate lines.
[0046] The second lower electrode 220 can be disposed on and connected to the plurality of thin-film transistors formed thereon on the second lower substrate 210. The second upper electrode 240 can be formed on the second upper substrate 250. The second liquid crystal layer 230 is disposed between the second lower electrode 220 and the second upper electrode 240. The second liquid crystal layer 230 can be aligned according to the vertical electric field formed between the second lower electrode 220 and the second upper electrode 240. The second panel 20 can control the transmittance of light L1 irradiated from the backlight 30 according to the alignment of the second liquid crystal layer 230.
[0047] Unlike the first panel 10, the second panel 20 may not include a color filter. Therefore, the second panel 20 cannot display a color image, and the amount of light supplied to the first panel 10 can only be controlled by adjusting the transmittance of the light L1 emitted from the backlight 30.
[0048] The backlight 30 provides light. The backlight 30 includes multiple light sources. These multiple light sources can be controlled as a whole, but the invention is not limited thereto. The backlight 30 may include multiple light sources that can be controlled independently.
[0049] Specifically, the backlight 30 can generate a uniform initial light L1 from multiple light sources. The backlight 30 is positioned below the second panel 20 and illuminates the bottom side of the second panel 20 with the initial light L1. The transmittance of the light L1 illuminating the bottom side of the second panel 20 from the backlight 30 can be primarily controlled by the second liquid crystal layer 230 of the second panel 20, and then the light with the controlled transmittance can be illuminated on the bottom side of the first panel 10. The transmittance of the light L2 illuminating the bottom side of the first panel 10 from the second panel 20 can be secondary controlled by the first liquid crystal layer 130 of the first panel 10, and then the light with the controlled transmittance can be emitted to the outside. Here, the light with the transmittance controlled by the first liquid crystal layer 130 of the first panel 10 has color after passing through the color filter 150. Therefore, the first panel 10 can display a color image.
[0050] Because the light transmittance is controlled in the second panel 20 and the first panel 10, the display system 1 according to an embodiment of the present invention can effectively block light emitted from the backlight 30 when representing a black level. Therefore, the display system 1 according to an embodiment of the present invention can display high-quality images with high contrast.
[0051] Despite Figure 1 and Figure 2 In one embodiment, the second panel 20 is disposed between the first panel 10 and the backlight 30, but the invention is not limited thereto. In another embodiment, the second panel 20 may be disposed on the first panel 10. That is, the first panel 10 may be disposed between the second panel 20 and the backlight 30. In this case, the backlight 30 is disposed below the first panel 10 and illuminates the bottom side of the first panel 10 with initial light. The transmittance of the light illuminating the bottom side of the first panel 10 from the backlight 30 can be initially controlled by the first liquid crystal layer 130 of the first panel 10, and then the light with the controlled transmittance can be illuminated to the bottom side of the second panel 20. Here, the light with the transmittance controlled by the first liquid crystal layer 130 of the first panel 10 can be converted into colored light when passing through the color filter 150. The transmittance of the colored light illuminating the bottom side of the second panel 20 from the first panel 10 can be secondary controlled by the second liquid crystal layer 230 of the second panel 20, and then the light with the controlled transmittance can be emitted to the outside.
[0052] The display system 1 according to one embodiment of the present invention may further include a polarizing film (not shown) to utilize the polarization characteristics of light, the polarizing film being disposed at at least one of the following locations: on the first panel 10, between the first panel 10 and the second panel 20, and between the second panel 20 and the backlight 30.
[0053] The first panel driver 11 receives control signals from the display driver 40 and controls the driving of the first panel 10. For this purpose, the first panel driver 11 includes a first gating driver and a first data driver.
[0054] The first gating driver can generate gating signals for driving gating lines of the first panel 10 in response to a gating control signal input from the display driver 40. The first gating driver can provide the generated gating signals to the sub-pixels of the first unit pixel UP10 included in the first panel 10 via the gating lines.
[0055] The first data driver can receive data control signals and image data signals from the display driver 40. In response to the data control signals input from the display driver 40, the first data driver can convert the digital image data signals into analog image data signals. The first data driver can provide the converted image data signals to the sub-pixels of the first unit pixel UP10 included in the first panel 10 via data lines.
[0056] The second panel driver 21 receives control signals from the display driver 40 and controls the driving of the second panel 20. For this purpose, the second panel driver 21 includes a second gating driver and a second data driver.
[0057] The second gating driver can generate gating signals for driving the gating lines of the second panel 20 in response to a gating control signal input from the display driver 40. The second gating driver can provide the generated gating signals to the second unit pixel UP20 included in the second panel 20 via the gating lines.
[0058] The second data driver can receive data control signals and brightness data signals from the display driver 40. In response to the data control signals input from the display driver 40, the second data driver can convert the digital brightness data signals into analog brightness data signals. The second data driver can then provide the converted brightness data signals to the second unit pixel UP20 included in the second panel 20 via a data line.
[0059] The display driver 40 includes a data converter 41, a first timing controller 42, and a second timing controller 43.
[0060] Data converter 41 converts input image data from an external system into output image data for a first panel 10 having a first resolution, and outputs the output image data to a first timing controller 42. Furthermore, data converter 41 converts input image data from an external system into output brightness data for a second panel 20 having a second resolution, and outputs the output brightness data to a second timing controller 43. (See below for further details.) Figures 4 to 6 Detailed description of the data converter 41.
[0061] The first timing controller 42 receives timing signals from the data converter 41 and generates control signals for controlling the first panel driver 11. Specifically, the first timing controller 42 can receive various timing signals, including vertical synchronization signals, horizontal synchronization signals, data enable signals, and clock signals. The first timing controller 42 can generate data control signals for controlling the data driver of the first panel driver 11 and gating control signals for controlling the gating driver of the first panel driver 11.
[0062] The first timing controller 42 can receive output image data from the data converter 41 and generate an image data signal based on the received output image data. Here, the image data signal can be a digital signal converted into a data signal format that can be processed by the data driver of the first panel driver 11.
[0063] The first timing controller 42 can output data control signals, gating control signals and image data signals to the first panel driver 11.
[0064] The second timing controller 43 can receive timing signals from the data converter 41 and generate control signals for controlling the second panel driver 21. Specifically, the second timing controller 43 can receive various timing signals, including vertical synchronization signals, horizontal synchronization signals, data enable signals, and clock signals. The second timing controller 43 can generate data control signals for controlling the data driver of the second panel driver 21 and gating control signals for controlling the gating driver of the second panel driver 21.
[0065] The second timing controller 43 can receive output brightness data from the data converter 41 and generate a brightness data signal based on the received output brightness data. Here, the brightness data signal can be a digital signal converted into a data signal format that can be processed by the data driver of the second panel driver 21.
[0066] The second timing controller 43 can output data control signals, gating control signals and brightness data signals to the second panel driver 21.
[0067] In the following text, reference will be made to Figures 4 to 8 Detailed description of the data converter 41.
[0068] Figure 4 It is shown Figure 1 A diagram showing the configuration of the data converter, and Figure 5 It is shown Figure 4 A diagram showing the configuration of the offset calculator. Figure 6 It is used to describe in Figure 5 A diagram showing the method for calculating the first offset in the first offset calculator, and... Figure 7 It is used to describe in Figure 5 The method for calculating the second offset in the second offset calculator and in Figure 5 A diagram illustrating the method for calculating the third offset in the third offset calculator. Figure 8 It is a graph showing the weights according to brightness level.
[0069] Reference Figures 4 to 8 The data converter 41 includes a preprocessor 410, a brightness calculator 420, an interpolator 430, an offset calculator 440, an input image converter 450, a first data output unit 460, a brightness converter 470, and a second data output unit 480.
[0070] The preprocessor 410 preprocesses the input image data RGB M×N from the external system and provides the preprocessed data to the brightness calculator 420. Specifically, the preprocessor 410 can receive non-linear input image data RGB M×N from the external system. Here, the input image data RGB M×N corresponds to 3-color source image data corresponding to a first resolution.
[0071] The preprocessor 410 can convert nonlinear input image data RGB M×N into linear input image data RGB M×N. In one embodiment, the preprocessor 410 can use the inverse function of the gamma curve to convert the nonlinear input image data RGB M×N into linear input image data RGB M×N.
[0072] The brightness calculator 420 calculates the first brightness data YM×N corresponding to the first resolution and the second brightness data BV m×n corresponding to the second resolution based on the linear input image data RGB M×N.
[0073] Specifically, the brightness calculator 420 can calculate the brightness values of a plurality of first unit pixels UP10 included in the first panel 10 based on linear input image data RGB M×N.
[0074] In one implementation, the luminance calculator 420 can convert 3-color input image data RGB M×N into a luminance component Y and a chrominance component CbCr. Here, the luminance calculator 420 can generate first luminance data YM×N including the luminance component Y for each unit pixel UP10. The operation of the luminance calculator 420 is not limited to using the luminance component Y obtained by applying weights to red (R), green (G), and blue (B) and summing the weights. The luminance calculator 420 can calculate the maximum value among red (R), green (G), and blue (B) as the luminance value, or calculate the average value among red (R), green (G), and blue (B) as the luminance value. The luminance calculator 420 can calculate the luminance value using various known methods.
[0075] The brightness calculator 420 can calculate the brightness value of multiple second unit pixels UP20 included in the second panel based on linear input image data RGB M×N.
[0076] In one embodiment, the brightness calculator 420 can calculate the brightness value of the second unit pixel UP20 using the brightness values of a plurality of first unit pixels UP10 set at positions corresponding to the second unit pixel UP20. For example, the brightness calculator 420 can calculate the average brightness value of the plurality of first unit pixels UP10 set at positions corresponding to the second unit pixel UP20. For example, a single second unit pixel UP20 may correspond to four first unit pixels UP10. In this case, the brightness calculator 420 can calculate the average brightness value of the four first unit pixels UP10 set at positions corresponding to the second unit pixel UP20, and generate second brightness data BV m×n including the calculated average value as the brightness value of the second unit pixel UP20.
[0077] However, the present invention is not limited thereto, and the brightness calculator 420 can calculate the brightness value of the second unit pixel UP20 by using the brightness values of a plurality of first unit pixels UP10 set at positions corresponding to the second unit pixel UP20 in various ways.
[0078] The brightness calculator 420 provides the first brightness data YM×N and the second brightness data BV m×n to the offset calculator 440, and provides the second brightness data BV m×n to the interpolator 430.
[0079] Interpolator 430 performs interpolation based on the second luminance data BV m×n corresponding to the second resolution to generate first interpolated luminance data BV'M×N corresponding to the first resolution. Interpolator 430 can use the luminance values of multiple second unit pixels UP20 to generate the first interpolated luminance data BV'M×N for multiple third unit pixels. Here, the multiple third unit pixels are arbitrary unit pixels used to generate the first interpolated luminance data BV'M×N, and can have the same size, number, and positional relationship as the multiple first unit pixels UP10 of the first panel 10.
[0080] In one embodiment, interpolator 430 can determine the luminance value of the second unit pixel UP20 as the luminance value of each of a plurality of third unit pixels corresponding to the second unit pixel UP20. In another embodiment, interpolator 430 can determine one of the values between the luminance value of a particular second unit pixel UP20 and the luminance values of second unit pixels UP20 adjacent to that particular unit pixel UP20 as the luminance value of one of a plurality of third unit pixels corresponding to that particular second unit pixel UP20. However, the invention is not limited thereto, and interpolator 430 can use the luminance values of the plurality of second unit pixels UP20 in various methods to generate first interpolated luminance data BV'M×N corresponding to the first resolution.
[0081] Interpolator 430 provides the generated first interpolated brightness data BV'M×N to offset calculator 440.
[0082] The offset calculator 440 calculates the offset M×N for each of the multiple first unit pixels UP10 based on the first luminance data YM×N corresponding to the first resolution and the second luminance data BV m×n corresponding to the second resolution. For example... Figure 5 As shown, the offset calculator 440 includes a first offset calculator 441, a second offset calculator 442, a third offset calculator 443, and a fourth offset calculator 444.
[0083] The first offset calculator 441 calculates the first offset offset1 for each of the plurality of first unit pixels UP10 based on the first luminance data YM×N corresponding to the first resolution, the second luminance data BVm×n corresponding to the second resolution, and the first interpolated luminance data BV'M×N corresponding to the first resolution.
[0084] Specifically, such as Figure 6 As shown, the first offset calculator 441 can generate second interpolated brightness data BV”M×N corresponding to the first resolution by performing interpolation based on the first brightness data YM×N corresponding to the first resolution and the second brightness data BV m×n corresponding to the second resolution.
[0085] In one implementation, the first offset calculator 441 can generate second interpolated brightness data BV”M×N corresponding to the first resolution by performing joint bilateral filtering on the first brightness data YM×N corresponding to the first resolution and the second brightness data BV m×n corresponding to the second resolution.
[0086] The first offset calculator 441 calculates the difference between the brightness value of the second interpolated brightness data BV”M×N and the brightness value of the first interpolated brightness data BV'M×N as a first value V1M×N. Additionally, the first offset calculator 441 can calculate the difference between the brightness value of the first brightness data YM×N and the brightness value of the first interpolated brightness data BV'M×N as a second value V2M×N.
[0087] In one implementation, the first offset calculator 441 can calculate the first offset of the corresponding unit pixel offset1 using the first value V1 and the second value V2 according to the following formula 1.
[0088] [Formula 1]
[0089] offset1 = a × V1 + β × V2
[0090] Here, offset1 represents the first offset, V1 represents the first value, and V2 represents the second value. Furthermore, α and β are greater than 0 and less than 1, and the sum of α and β is a constant satisfying 1.
[0091] The first offset calculator 441 can generate first offset data offset1 M×N, which includes a first offset1 for each of the plurality of first unit pixels UP10. The first offset calculator 441 can provide the first offset data offset1 M×N to the fourth offset calculator 444.
[0092] The second offset calculator 442 calculates a second offset offset2 for the first unit pixel UP10 corresponding to the edge of the image. The second offset calculator 442 calculates the second offset offset2 for each of the plurality of first unit pixels UP10 based on the first luminance data YM×N corresponding to the first resolution and the second luminance data BV m×n corresponding to the second resolution.
[0093] Specifically, the second offset calculator 442 can determine a first edge unit pixel EUP10 corresponding to the edge of the image from a plurality of first unit pixels UP10. The second offset calculator 442 can determine a second edge unit pixel EUP20 set at a position corresponding to the first edge unit pixel EUP10 from a plurality of second unit pixels UP20.
[0094] Additionally, the second offset calculator 442 can calculate the desired brightness value for the second edge unit pixel EUP20. The second offset calculator 442 can calculate the desired brightness value for the second edge unit pixel EUP20 by applying weights to the brightness values of second unit pixels adjacent to the second edge unit pixel EUP20. The second offset calculator 442 can calculate the second offset offset2 based on the brightness value of the first edge unit pixel EUP10, the desired brightness value of the second edge unit pixel EUP20, and the edge intensity of the first edge unit pixel EUP10.
[0095] The methods for calculating the desired brightness value for the second edge unit pixel EUP20 and the methods for calculating the second offset 2 for the first edge unit pixel EUP10 will be described below with specific examples.
[0096] Reference Figure 7Assume that a single second unit pixel UP20 corresponds to four first unit pixels UP10. For example, a single second unit pixel UP21 can correspond to four first unit pixels UP11, UP12, UP13, and UP14.
[0097] like Figure 7 As shown, the second offset calculator 442 can determine the first edge unit pixel EUP10 from a plurality of first unit pixels UP10 that corresponds to the edge of the image. The second offset calculator 442 can determine the second edge unit pixel EUP20 from a plurality of second unit pixels UP20 that is set at the position corresponding to the first edge unit pixel EUP10.
[0098] The second offset calculator 442 can calculate the weights W1, W2, W3, W4, and W5 of a plurality of first unit pixels UP15, UP16, UP17, UP18, and UP19 that are adjacent to the first edge unit pixel EUP10. In one embodiment, the weights can be calculated using a predetermined function according to Equation 2 below.
[0099] [Equation 2]
[0100] W = f(x, y)
[0101] Here, x corresponds to the brightness value of the first edge unit pixel EUP10, and y corresponds to the brightness value of any one of the first adjacent unit pixels UP15, UP16, UP17, UP18, and UP19 that are adjacent to the first edge unit pixel EUP10. W corresponds to the weights of the first adjacent unit pixels UP15, UP16, UP17, UP18, and UP19.
[0102] For example, five first unit pixels UP15, UP16, UP17, UP18, and UP19 can be set adjacent to the first edge unit pixel EUP10. In this case, W1, W2, W3, W4, and W5 for the five first adjacent unit pixels UP15, UP16, UP17, UP18, and UP19 can be calculated according to Equation 3 below.
[0103] [Formula 3]
[0104] W1 = f(50, 50)
[0105] W2 = f(50, 50)
[0106] W3 = f(50, 50)
[0107] W4 = f(50, 50)
[0108] W5 = f(50, 150)
[0109] W1, W2, W3, W4, and W5 are greater than 0 and less than 1, and the sum of W1, W2, W3, W4, and W5 is a value that satisfies 1.
[0110] Then, the second offset calculator 442 can calculate the desired brightness value for the second edge unit pixel EUP20 by applying weights to the brightness values of the second unit pixels adjacent to the second edge unit pixel EUP20. To this end, the second offset calculator 442 can identify second unit pixels UP22, UP23, UP24, and UP24 from among the multiple second unit pixels UP20, which are located at positions corresponding to the first adjacent unit pixels UP15, UP16, UP17, UP18, and UP19 adjacent to the first edge unit pixel EUP10.
[0111] The second offset calculator 442 can calculate the expected brightness value of the second edge unit pixel EUP20 by multiplying the brightness values of the second adjacent unit pixels UP22, UP22, UP23, UP24 and UP24 by weights W1, W2, W3, W4 and W5 and summing the multiplication results.
[0112] Calculated according to the following formula 4 Figure 7 The expected brightness value of the second edge unit pixel EUP20 is shown.
[0113] [Formula 4]
[0114] EBV=BV1×W1+BV2×W2+BV3×W3+BV4×W4+BV5×W5
[0115] BV1 corresponds to the brightness value of the second neighboring pixel UP22, located at the position corresponding to the first neighboring pixel UP15, and W1 corresponds to the weight for the first neighboring pixel UP15. BV2 corresponds to the brightness value of the second neighboring pixel UP22, located at the position corresponding to the first neighboring pixel UP16, and W2 corresponds to the weight for the first neighboring pixel UP16. BV3 corresponds to the brightness value of the second neighboring pixel UP23, located at the position corresponding to the first neighboring pixel UP17, and W3 corresponds to the weight for the first neighboring pixel UP17. BV4 corresponds to the brightness value of the second neighboring pixel UP24, located at the position corresponding to the first neighboring pixel UP18, and W4 corresponds to the weight for the first neighboring pixel UP18. BV5 corresponds to the brightness value of the second neighboring pixel UP24, located at the position corresponding to the first neighboring pixel UP19, and W5 corresponds to the weight for the first neighboring pixel UP19. EBV corresponds to the expected brightness value of the second edge unit pixel EUP20.
[0116] In one implementation, the second offset calculator 442 can calculate the second offset offset2 by multiplying the difference between the brightness value of the first edge unit pixel EUP10 and the expected brightness value of the second edge unit pixel EUP20 by the edge intensity. Specifically, the second offset calculator 442 can calculate the second offset offset2 of the first edge unit pixel EUP10 according to the following formula 5.
[0117] [Formula 5]
[0118] offset2 = α × (Y - EBV) × EI
[0119] Y corresponds to the luminance value of the first edge unit pixel EUP10, EBV corresponds to the expected luminance value of the second edge unit pixel EUP20, and EI corresponds to the edge intensity of the first edge unit pixel EUP10. α is a constant and a positive number.
[0120] Edge intensity represents the degree of likelihood that the corresponding first unit pixel UP10 is the first edge unit pixel EUP10, and can be calculated using various known methods based on the RGB M×N 3-color input image data.
[0121] The second offset calculator 442 can generate second offset data offset2 M×N, which includes a second offset2 for each of the plurality of first unit pixels UP10.
[0122] In one implementation, the second offset calculator 442 can set the second offset 2 of the first unit pixel UP10 that does not correspond to the first edge unit pixel EUP10 to 0.
[0123] The second offset calculator 442 can provide the second offset data offset2 M×N to the fourth offset calculator 444.
[0124] The third offset calculator 443 calculates a third offset 3 for increasing or decreasing the brightness value, taking into account the brightness deviation among the plurality of first unit pixels UP10 corresponding to each second unit pixel UP20. The third offset calculator 443 calculates the third offset 3 for each of the plurality of first unit pixels UP10 based on the first brightness data YM×N corresponding to the first resolution and the second brightness data BV m×n corresponding to the second resolution.
[0125] Specifically, the third offset calculator 443 can check the brightness deviation among the plurality of first unit pixels UP10 corresponding to each second unit pixel UP20. When the number of first unit pixels UP10 with negative brightness deviation is different from the number of first unit pixels UP10 with positive brightness deviation, the third offset calculator 443 can calculate a third offset offset3 for increasing or decreasing the brightness value of the plurality of first unit pixels UP10 corresponding to the corresponding second unit pixel UP20.
[0126] The method for calculating the third offset, offset3, will be described below with specific examples.
[0127] Reference Figure 7 Assume that a single unit pixel UP20 corresponds to four first unit pixels UP10. For example, a single second unit pixel UP21 can correspond to four first unit pixels UP11, UP12, UP13, and UP14.
[0128] The third offset calculator 443 can check the brightness deviation in multiple first unit pixels UP10 corresponding to each second unit pixel UP20. For example... Figure 7 As shown, when there are three first unit pixels UP11, UP12 and UP13 with negative brightness deviations and a single first unit pixel UP14 with positive brightness deviation, the third offset calculator 443 can calculate the third offset offset3 for increasing or decreasing the brightness values of the first unit pixels UP11, UP12, UP13 and UP14 corresponding to the second unit pixel UP21.
[0129] Despite Figure 7The description refers to the case where the number of first unit pixels UP10 with negative brightness deviations is greater than the number of first unit pixels UP10 with positive brightness deviations, but the present invention is not limited thereto. When the number of first unit pixels UP10 with negative brightness deviations is less than the number of first unit pixels UP10 with positive brightness deviations, the third offset calculator 443 can also calculate a third offset 3 for increasing or decreasing the brightness values of the plurality of first unit pixels UP10 corresponding to the corresponding second unit pixel UP20.
[0130] When the number of first unit pixels UP10 with negative brightness deviations is greater than the number of first unit pixels UP10 with positive brightness deviations, the third offset 3 can have a value less than 0 to reduce the brightness value of the plurality of first unit pixels UP10 corresponding to the corresponding second unit pixel UP20. On the other hand, when the number of first unit pixels UP10 with negative brightness deviations is less than the number of first unit pixels UP10 with positive brightness deviations, the third offset 3 can have a value greater than 0 to increase the brightness value of the plurality of first unit pixels UP10 corresponding to the corresponding second unit pixel UP20.
[0131] The third offset calculator 443 can calculate the third offset offset3 for each of the plurality of first unit pixels UP11, UP12, UP13, and UP14 corresponding to the second unit pixel UP21. Although for ease of description, the method for calculating the third offset offset3 for the first unit pixel UP12 will be described below, the third offset calculator 443 can calculate the third offset offset3 for the other first unit pixels UP11, UP13, and UP14 in the same way.
[0132] In order to calculate the third offset, the third offset calculator 443 can calculate the brightness change value for the second unit pixel UP21 corresponding to the first unit pixel UP11, and calculate the third offset offset3 based on the calculated brightness change value.
[0133] Specifically, the third offset calculator 443 can extract first adjacent unit pixels UP15, UP16, UP17, UP18, and UP19, which have a brightness value deviation from the first unit pixel UP11 within a predetermined range, from the first adjacent unit pixels UP15, UP16, UP17, UP18, and UP19, which are arranged adjacent to the first unit pixel UP11. The first adjacent unit pixel UP19 has a brightness value of 150, which has a large deviation from the brightness value of 50 of the first unit pixel UP11, and therefore can be excluded from extraction.
[0134] The third offset calculator 443 can calculate the average brightness values of the second adjacent unit pixels UP22, UP23, and UP24, which correspond to the extracted first adjacent unit pixels UP15, UP16, UP17, and UP18, respectively. The third offset calculator 443 can add the brightness value of the second unit pixel UP21 to the deviation between the calculated average brightness value and the brightness value of the second unit pixel UP21 to calculate the brightness change value.
[0135] In one implementation, the third offset calculator 443 can calculate the brightness change value for the second unit pixel UP21 according to the following formula 6.
[0136] [Formula 6]
[0137] BV out =BV + α × (mean(ABV) - BV)
[0138] BV represents the luminance value of the second unit pixel UP20, and mean(ABV) represents the average luminance value of the second unit pixel UP20 corresponding to the first neighboring unit pixel UP10, which has a luminance value deviating from the corresponding first unit pixel UP10 within a predetermined range. α is a constant greater than 0 and less than or equal to 1. out This represents the brightness change value for the corresponding second unit pixel UP20.
[0139] The third offset calculator 443 can calculate the third offset offset3 based on the difference between the brightness change value of the corresponding second unit pixel UP20 and the brightness value of the corresponding second unit pixel UP20.
[0140] In one implementation, the third offset calculator 443 can calculate the third offset offset3 for the corresponding first unit pixel UP10 according to the following formula 7.
[0141] [Formula 7]
[0142] offset3=β×(BV out -BV)
[0143] BV out This represents the brightness change for the corresponding second unit pixel UP20, and BV represents the brightness value of the corresponding second unit pixel UP20. β is a constant and a positive number greater than 0.
[0144] The third offset calculator 443 can generate third offset data offset3 M×N, which includes the third offset3 for each of the multiple first unit pixels UP10.
[0145] In one implementation, the third offset calculator 443 can check the brightness deviation among the plurality of first unit pixels UP10 corresponding to each second unit pixel UP20, and when the number of first unit pixels UP11, UP12 and UP13 with negative brightness deviation is equal to the number of first unit pixels UP14 with positive brightness deviation, the third offset 3 for each of the plurality of first unit pixels UP10 corresponding to the corresponding unit pixel UP20 is set to 0.
[0146] The third offset calculator 443 can provide the generated third offset data offset3 M×N to the fourth offset calculator 444.
[0147] In addition, the third offset calculator 443 can generate brightness change values BV for multiple second unit pixels UP20. out Brightness change data BV out m×n.
[0148] In one implementation, the third offset calculator 443 can check the brightness deviation among the plurality of first unit pixels UP10 corresponding to each second unit pixel UP20, and when the number of first unit pixels UP11, UP12, and UP13 with negative brightness deviations is equal to the number of first unit pixels UP14 with positive brightness deviations, the brightness change value BV for the corresponding second unit pixel UP20 is adjusted. out Set it to the corresponding brightness value BV.
[0149] The third offset calculator 443 can change the brightness data BV. out m×n is provided to the brightness converter 470.
[0150] The fourth offset calculator 444 calculates the fourth offset based on the first offset offset1, the second offset offset2, and the third offset offset3. Specifically, the fourth offset calculator 444 can receive the first offset data offset1 M×N from the first offset calculator 441, the second offset data offset2 M×N from the second offset calculator 442, and the third offset data offset3 M×N from the third offset calculator 443.
[0151] The fourth offset calculator 444 can calculate the fourth offset for the corresponding first unit pixel UP10 by summing the first offset offset1, the second offset offset2, and the third offset offset3.
[0152] In one implementation, the fourth offset calculator 444 can calculate the fourth offset for the corresponding first unit pixel UP10 according to the following formula 8.
[0153] [Formula 8]
[0154] offset=(offset1+offset2+offset3)×W
[0155] offset1 represents the first offset relative to the first unit pixel UP10, offset2 represents the second offset relative to the first unit pixel UP10, offset3 represents the third offset relative to the first unit pixel UP10, and offset represents the fourth offset relative to the first unit pixel UP10.
[0156] W represents the weight based on the luminance value of the corresponding first unit pixel UP10. When the luminance value is low or high, a weight can be applied to the luminance value so that it can exceed or become less than the luminance value that the first unit pixel UP can have. For example, the luminance value can be between 0 and 255. When the luminance value of the corresponding first unit pixel UP10 is 255, if a positive offset is applied to the luminance value of the corresponding first unit pixel UP10, then the luminance value of the corresponding first unit pixel UP10 exceeds 255. That is, the corresponding first unit pixel UP10 has a luminance value that exceeds the defined luminance range.
[0157] To prevent this, a fourth offset calculator 444 according to one embodiment of the present invention can calculate the fourth offset by applying weights to the brightness value. Here, as Figure 8 As shown, when the brightness value falls into, for example, a low range of 0 to 20 or a high range of 235 to 255, the weight W can have a value less than 1. Here, as... Figure 8 As shown, the weights can increase or decrease linearly, but the invention is not limited thereto. The weights can increase or decrease in a curved form, such as an sigmoid function or other nonlinear function.
[0158] The fourth offset calculator 444 can generate fourth offset data offset M×N, which includes a fourth offset for each of the plurality of first unit pixels UP10. The fourth offset calculator 444 can provide the generated fourth offset data offset M×N to the input image converter 450.
[0159] The input image converter 450 converts the input image data RGB M×N into input image data RGB'M×N with an applied offset. Specifically, the input image converter 450 receives the linearized input image data RGB M×N from the preprocessor 410 and the fourth offset data offset M×N from the offset calculator 440. The input image converter 450 can generate the converted input image data RGB'M×N based on the input image data RGB M×N and the fourth offset data offset M×N.
[0160] In one implementation, the input image converter 450 can convert input image data RGB M×N received from the preprocessor 410 into a luminance component Y and a chrominance component CbCr for a plurality of first unit pixels UP10. The input image converter 450 can apply a fourth offset to the luminance component Y for the plurality of first unit pixels UP10. The input image converter 450 can generate input image data RGB'M×N with the fourth offset applied based on the luminance component Y' and chrominance component CbCr with the fourth offset applied.
[0161] In another embodiment, the input image converter 450 can receive data from the luminance calculator 420 relating to the luminance component Y and chrominance component CbCr for a plurality of first unit pixels UP10. The input image converter 450 can apply a fourth offset to the luminance component Y received from the luminance calculator 420. The input image converter 450 can generate input image data RGB'M×N with the fourth offset applied based on the luminance component Y' and chrominance component CbCr with the fourth offset applied.
[0162] The first data output unit 460 performs post-processing on the input image data RGB'M×N converted by the input image converter 450 to generate output image data RGB”M×N for the first panel 10. The first data output unit 460 outputs the output image data RGB”M×N to the first timing controller 42.
[0163] Specifically, the first data output unit 460 can receive the converted linear input image data RGB'M×N from the input image converter 450. The first data output unit 460 can convert the converted linear input image data RGB'M×N into converted non-linear input image data RGB'M×N.
[0164] In one implementation, the first data output unit 460 may use a gamma curve function to convert linear input image data RGB'M×N into non-linear output image data RGB”M×N. The first data output unit 460 may use a lookup table to gamma-correct the input image data RGB'M×N received from the input image converter 450 into output image data RGB”M×N suitable for the first timing controller 42.
[0165] The first data output unit 460 outputs the nonlinear output image data RGB”M×N to the first timing controller 42.
[0166] Despite Figure 4 The first data output unit 460 outputs 3-color output image data RGB'M×N to the first timing controller 42, but the invention is not limited thereto. In another embodiment, the first data output unit 460 can output 4-color output image data to the first timing controller 42. The first data output unit 460 can receive converted 3-color input image data RGB'M×N from the input image converter 450. The first data output unit 460 can convert the converted 3-color input image data RGB'M×N to 4-color input image data. The first data output unit 460 can use a lookup table to gamma-correct the converted 4-color input image data to 4-color output image data suitable for the first timing controller 42. The first data output unit 460 can output non-linear 4-color output image data to the first timing controller 42.
[0167] The brightness converter 470 converts the second brightness data BV m×n into a brightness change value BV that has already been applied. out The second brightness data BV'm×n. Specifically, the brightness converter 470 can receive the second brightness data BV m×n from the brightness calculator 420, and the brightness change data BV from the offset calculator 440. out m×n. The brightness converter 470 can be based on the second brightness data BV m×n and the brightness change data BV. out The converted second luminance data BV'm×n is generated using m×n. Here, the second luminance data BV m×n includes the luminance values of multiple second unit pixels UP20, and the luminance change data BV out m×n includes the brightness change values of multiple second unit pixels UP20.
[0168] The brightness converter 470 can set the value calculated based on the brightness value and brightness change value of each second unit pixel UP20 as the brightness value of each second unit pixel UP20.
[0169] In one implementation, the brightness converter 470 can apply weights to the brightness value and brightness change value of each second unit pixel UP20, and set the sum of the brightness value and brightness change value to which the weights have been applied as the brightness value of each second unit pixel UP20.
[0170] In another embodiment, the brightness converter 470 can set the value between the brightness value and the brightness change value of each second unit pixel UP20 to the brightness value of each second unit pixel UP20.
[0171] The second data output unit 480 generates output brightness data BV”M×N for the second panel 20 based on the second brightness data BV’M×N converted by the brightness converter 470. The second data output unit 480 outputs the output brightness data BV”M×N to the second timing controller 43.
[0172] According to one embodiment of the present invention, the data converter 41 can prevent blurring at the edges of the image by applying an offset to the output image data RGB”M×N output to the first panel 10. Therefore, according to the present invention, the edges of the image displayed on the first panel 10 can be made sharper and the perceptual resolution can be improved.
[0173] Furthermore, according to one embodiment of the present invention, the data converter 41 can calculate the final offset by considering multiple offsets offset1, offset2, and offset3, thereby more accurately controlling the brightness value at the edge of the image for the first panel 10 and making the edge of the image sharper. In other words, the present invention can improve the sharpness of the image.
[0174] Furthermore, according to one embodiment of the present invention, the data converter 41 can control the brightness value of the second unit pixel UP20 according to the distribution of a plurality of first unit pixels UP10 corresponding to the second unit pixel UP20, thereby representing the brightness more effectively in the second panel 20.
[0175] Figure 9A This is a diagram illustrating an example of not applying offsets to image data, and Figure 9B This is a diagram illustrating an example of applying an offset to image data.
[0176] Reference Figure 9A and Figure 9B According to one embodiment of the present invention, a display system 1 includes a first panel 10 having a first resolution, a second panel 20 having a second resolution, and a backlight 30.
[0177] The first panel 10 includes a plurality of first unit pixels. The second panel 20 includes a plurality of second unit pixels, and each second unit pixel may correspond to a plurality of first unit pixels. For ease of description, it is assumed that a single second unit pixel corresponds to two first unit pixels.
[0178] For example, a single second unit pixel UP21 can correspond to two first unit pixels UP11 and UP12, another second unit pixel UP22 can correspond to two first unit pixels UP13 and UP14, and another second unit pixel UP23 can correspond to two first unit pixels UP15 and UP16.
[0179] The first panel 10 can have different brightness values for the first unit pixels UP11, UP12, UP13, UP14, UP15, and UP16. For example... Figure 9A As shown, in the first panel 10, the three first unit pixels UP11, UP12, and UP13 included in the first group can have the same brightness value, and the remaining three first unit pixels UP14, UP15, and UP16 included in the second group can have the same brightness value. There may be a large difference in brightness value between the first group and the second group.
[0180] The second panel 20 can have different brightness values for the second unit pixels UP21, UP22, and UP23. For example... Figure 9A As shown, in the second panel 20, the second unit pixels UP21, UP22 and UP23 can have different brightness values.
[0181] Backlight 30 can have a constant brightness value for all pixels.
[0182] Because the brightness value is Figure 9A The brightness gradually decreases in region A, so the image is displayed to the user as if it were blurred by the display system 1, which includes the first panel 10, the second panel 20, and the backlight 30. This is because the two first unit pixels UP13 and UP14, which correspond to a single second unit pixel UP22, have different brightness values that deviate significantly from each other, while the single second unit pixel UP22 has a single brightness value.
[0183] In other words, due to the difference in resolution between the first panel 10 and the second panel 20, the sizes of the first unit pixels UP11, UP12, UP13, UP14, UP15 and UP16 included in the first panel 10 are different from the sizes of the second unit pixels UP21, UP22 and UP23 included in the second panel 20, thus causing blurring.
[0184] According to one embodiment of the present invention, the display system 1 can apply an offset to the brightness values of the first edge unit pixels UP13 and UP14, which are corresponding to the edges, among the first unit pixels UP11, UP12, UP13, UP14, UP15 and UP16 of the first panel 10.
[0185] In this case, such as Figure 9B As shown in region B, in the display system 1 including the first panel 10, the second panel 20, and the backlight 30, the sharpness of the brightness value can be increased. Therefore, it is possible to prevent... Figure 9A The blurriness appears in region A.
[0186] Figure 10 This is a flowchart illustrating a display driving method according to an embodiment of the present invention.
[0187] First, the display system 1 receives input image data RGB M×N from an external system (S1001). Here, the input image data RGB M×N received from the external system is non-linear data corresponding to three-color source image data with a first resolution.
[0188] Next, the display system 1 calculates the first brightness data YM×N corresponding to the first resolution and the second brightness data BVm×n corresponding to the second resolution based on the input image data RGB M×N (S1002).
[0189] Specifically, the display system 1 can convert non-linear input image data RGB M×N into linear input image data RGB M×N. In one embodiment, the preprocessor 410 can use the inverse function of the gamma curve to convert the non-linear input image data RGB M×N into linear input image data RGB M×N.
[0190] Subsequently, the display system 1 can calculate the first luminance data YM×N corresponding to the first resolution and the second luminance data BVm×n corresponding to the second resolution based on the linear input image data RGB M×N.
[0191] The display system 1 can calculate the luminance value of each of a plurality of first unit pixels included in the first panel 10 based on linear input image data RGB M×N. In one embodiment, the display system 1 can convert the three-color input image data RGB M×N into a luminance component Y and a chromaticity component CbCr. Here, the display system 1 can generate first luminance data YM×N including the luminance component Y of the first unit pixel. The display system 1 is not limited to using the luminance component Y obtained by applying weights to red (R), green (G), and blue (B) and summing the resulting values. The display system 1 can calculate the maximum value among red (R), green (G), and blue (B) as the luminance value, or calculate the average value among red (R), green (G), and blue (B) as the luminance value. The display system 1 can calculate the luminance value using various known methods.
[0192] Additionally, the display system 1 can calculate the brightness value of each of the plurality of second unit pixels included in the second panel 20 based on linear input image data RGB M×N. In one embodiment, the display system 1 can use the brightness values of a plurality of first unit pixels located at positions corresponding to the second unit pixels to calculate the brightness value of the second unit pixel.
[0193] Next, the display system 1 calculates the offset for each of the plurality of first unit pixels based on the first brightness data YM×N corresponding to the first resolution and the second brightness data BVm×n corresponding to the second resolution (S1003).
[0194] The display system 1 can calculate the first offset, the second offset, and the third offset.
[0195] The first offset can be calculated based on the first luminance data YM×N corresponding to the first resolution, the second luminance data BVm×n corresponding to the second resolution, and the first interpolated luminance data BV'M×N corresponding to the first resolution.
[0196] Specifically, the display system 1 can generate second interpolated luminance data BV”M×N corresponding to the first resolution by performing interpolation based on first luminance data YM×N corresponding to the first resolution and second luminance data BV m×n corresponding to the second resolution. In one embodiment, the display system 1 can generate the second interpolated luminance data BV”M×N by performing joint bilateral filtering on the first luminance data YM×N corresponding to the first resolution and the second luminance data BV m×n corresponding to the second resolution.
[0197] The display system 1 can calculate the difference between the brightness value of the second interpolated brightness data BV”M×N and the brightness value of the first interpolated brightness data BV'M×N as a first value V1M×N, and calculate the difference between the brightness value of the first brightness data YM×N and the brightness value of the first interpolated brightness data BV'M×N as a second value V2M×N. The display system 1 can use Equation 1 above to calculate the first offset for the corresponding first unit pixel.
[0198] Furthermore, the second offset can be calculated based on the first luminance data YM×N corresponding to the first resolution and the second luminance data BVm×n corresponding to the second resolution.
[0199] Specifically, the display system 1 can determine a first edge unit pixel corresponding to the edge of the image from a plurality of first unit pixels, and determine a second edge unit pixel disposed at a position corresponding to the first edge unit pixel from a plurality of second unit pixels.
[0200] Then, the display system 1 can calculate the desired brightness value for the second edge unit pixel. The display system 1 can calculate the desired brightness value for the second edge unit pixel by applying weights to the brightness values of the second unit pixels arranged adjacent to the second edge unit pixel.
[0201] The display system 1 can calculate the second offset based on the luminance value of a first edge unit pixel, the desired luminance value of a second edge unit pixel, and the edge intensity of the first edge unit pixel. In one embodiment, the second offset can be calculated by multiplying the difference between the luminance value of the first edge unit pixel and the desired luminance value of the second edge unit pixel by the edge intensity. The display system 1 can use Equation 5 above to calculate the second offset for the corresponding first unit pixel.
[0202] Furthermore, the third offset can be calculated based on the first luminance data YM×N corresponding to the first resolution and the second luminance data BVm×n corresponding to the second resolution.
[0203] Specifically, the display system 1 can check the brightness deviation among a plurality of first unit pixels corresponding to each second unit pixel. When the number of first unit pixels with negative brightness deviation is different from the number of first unit pixels with positive brightness deviation, the display system 1 can calculate the brightness change value for the corresponding second unit pixel.
[0204] To calculate the brightness change value, the display system 1 can extract a first neighboring unit pixel having a brightness deviation from the brightness value of the corresponding first unit pixel within a predetermined range from the first neighboring unit pixels adjacent to the corresponding first unit pixel. The display system 1 can calculate the average brightness value of the second neighboring unit pixels corresponding to the extracted first neighboring unit pixels. The display system 1 can calculate the brightness change value by adding the brightness value of the corresponding second unit pixel to the deviation between the brightness value of the corresponding second unit pixel and the calculated average brightness value. In one embodiment, the display system 1 can calculate the brightness change value for the corresponding second unit pixel according to Equation 6 above.
[0205] The display system 1 can calculate the third offset based on the difference between the brightness change value for the corresponding second unit pixel and the brightness value of the corresponding second unit pixel. In one embodiment, the display system 1 can calculate the third offset for the corresponding first unit pixel according to Equation 7 above.
[0206] Subsequently, the display system 1 can calculate the fourth offset based on the first offset, the second offset, and the third offset.
[0207] The display system 1 can calculate a fourth offset for the corresponding first unit pixel by summing the first offset, the second offset, and the third offset and applying a weight depending on the brightness value to the sum. In one embodiment, the display system 1 can calculate the fourth offset for the corresponding first unit pixel according to Equation 8 above.
[0208] Next, the display system 1 converts the input image data RGB M×N into input image data RGB'M×N with the fourth offset applied, and converts the second brightness data BV m×n into brightness change value BV with the brightness change applied. out The second brightness data is BV'm×n(S1004).
[0209] Display system 1 can generate converted input image data RGB'M×N based on input image data RGB M×N and fourth offset data offset M×N. Display system 1 can convert the input image data RGB M×N into a luminance component Y and a chrominance component CbCr for multiple first unit pixels. Then, display system 1 can apply the fourth offset to the luminance component Y for multiple first unit pixels. Display system 1 can generate input image data RGB'M×N with the fourth offset applied based on the luminance component Y' and chrominance component CbCr with the fourth offset applied.
[0210] Additionally, the display system 1 can be based on the second brightness data BV m×n and the brightness change data BVout The converted second luminance data BV'm×n is generated using m×n. Here, the second luminance data BV m×n includes the luminance values of multiple second unit pixels, and the luminance change data BV out m×n includes the brightness change values of multiple second-unit pixels.
[0211] The display system 1 can change the brightness value of the corresponding second unit pixel UP20 to a value calculated based on the brightness value and brightness change value of each of the plurality of second unit pixels. In one embodiment, the display system 1 can change the brightness value of the second unit pixel to a value obtained by applying weights to the brightness value and brightness change value of the second unit pixel and summing the weighted brightness value and brightness change value. In another embodiment, the display system 1 can change the brightness value of the second unit pixel to a value between the brightness value and brightness change value of the second unit pixel.
[0212] Next, the display system 1 generates output image data RGB”M×N for the first panel 10 based on the converted input image data RGB'M×N, and generates output brightness data BV”m×n for the second panel 20 based on the converted brightness data BV'm×n (S1005).
[0213] Specifically, the display system 1 can generate output image data RGB”M×N for the first panel 10 by post-processing the converted input image data RGB'M×N. The display system 1 can convert the converted linear input image data RGB'M×N into a converted non-linear input image data RGB'M×N. In one embodiment, the display system 1 can use a gamma curve function to convert the linear input image data RGB'M×N into non-linear output image data RGB”M×N. The display system 1 can use a lookup table to gamma-correct the input image data RGB'M×N to output image data RGB”M×N suitable for the first timing controller 42.
[0214] Additionally, the display system 1 can generate output brightness data BV”m×n for the second panel 20 based on the converted second brightness data BV’m×n. The output brightness data BV”m×n can have a form that can be processed in the second timing controller 43.
[0215] According to the present invention, blurring at the edges of an image can be prevented by applying an offset to the output image data output to the first panel. Therefore, the present invention can make the edges of the image displayed on the first panel sharper and improve perceptual resolution.
[0216] Furthermore, according to the present invention, the brightness value at the edges of the image can be more accurately controlled for the first panel by considering multiple offsets to calculate the final offset, thereby making the image edges sharper. The present invention can improve image clarity.
[0217] Furthermore, according to the present invention, the brightness value of the second unit pixel can be controlled according to the distribution of a plurality of first unit pixels corresponding to the second unit pixel, thereby achieving a more efficient brightness representation in the second panel.
Claims
1. A display driving device, the display driving device comprising: A brightness calculator, which is used to calculate, using input image data, first brightness data corresponding to a first resolution and second brightness data corresponding to a second resolution less than the first resolution; An offset calculator is used to calculate an offset based on the first brightness data and the second brightness data; An input image converter is used to convert the input image data into input image data for which the calculated offset has been applied. A first data output unit is configured to generate output image data for a first panel comprising a plurality of first unit pixels using the converted input image data, and to output the generated output image data. The second data output unit is used to generate output brightness data for a second panel including a plurality of second unit pixels using the second brightness data, and output the generated output brightness data. as well as A preprocessor configured to convert non-linear input image data into linear input image data and provide the linear input image data to the brightness calculator. The offset calculator includes a second offset calculator, which is used to determine a first edge unit pixel from the plurality of first unit pixels, determine a second edge unit pixel set at a position corresponding to the first edge unit pixel from the plurality of second unit pixels, calculate the expected brightness value of the second edge unit pixel, and calculate a second offset for each of the plurality of first unit pixels based on the edge intensity and the difference between the brightness value of the first edge unit pixel and the expected brightness value of the second edge unit pixel.
2. The display driving device according to claim 1, wherein, The plurality of first unit pixels have the first resolution. The plurality of second unit pixels have the second resolution. The first brightness data includes the brightness values of the plurality of first unit pixels, and The second brightness data includes the brightness values of the plurality of second unit pixels.
3. The display driving device according to claim 2, wherein, A single second unit pixel corresponds to multiple first unit pixels.
4. The display driving device according to claim 1, further comprising an interpolator, the interpolator being configured to generate first interpolated brightness data corresponding to the first resolution by performing interpolation based on the second brightness data. in, The offset calculator calculates the offset based on the first brightness data, the second brightness data, and the first interpolated brightness data.
5. The display driving device according to claim 4, wherein, The offset calculator further includes a first offset calculator, which is used to generate second interpolated brightness data corresponding to the first resolution by performing interpolation based on the first brightness data and the second brightness data, and to calculate a first offset for each of a plurality of first unit pixels based on the difference between the first interpolated brightness data and the second interpolated brightness data and the difference between the first interpolated brightness data and the first brightness data.
6. The display driving device according to claim 5, wherein, The first offset calculator generates the second interpolated brightness data by performing a joint bilateral filter on the first brightness data and the second brightness data.
7. The display driving device according to claim 2, wherein, The second offset calculator calculates the weights for a plurality of first adjacent unit pixels set adjacent to the first edge unit pixel, and calculates the desired brightness value of the second edge unit pixel by applying the weights to the brightness values of the second adjacent unit pixels set at positions corresponding to the plurality of first adjacent unit pixels.
8. The display driving device according to claim 2, wherein, The offset calculator also includes a third offset calculator, which is used to check the brightness deviation among a plurality of first unit pixels corresponding to the second unit pixel, and calculates a third offset for increasing or decreasing the brightness value of the plurality of first unit pixels corresponding to the second unit pixel when the number of first unit pixels with negative brightness deviation is different from the number of first unit pixels with positive brightness deviation.
9. The display driving device according to claim 8, wherein, When the number of first unit pixels with negative brightness deviation is greater than the number of first unit pixels with positive brightness deviation, the value of the third offset calculated by the third offset calculator is less than 0, and when the number of first unit pixels with negative brightness deviation is less than the number of first unit pixels with positive brightness deviation, the value of the third offset calculated by the third offset calculator is greater than 0.
10. The display driving device according to claim 8, wherein, The third offset calculator calculates the brightness change value for the corresponding second unit pixel when the number of first unit pixels with negative brightness deviation is different from the number of first unit pixels with positive brightness deviation, and calculates the third offset based on the difference between the brightness value of the corresponding second unit pixel and the brightness change value.
11. The display driving apparatus of claim 10, further comprising a brightness converter, the brightness converter being configured to convert the second brightness data into second brightness data having the brightness change value applied. in, The second data output unit uses the converted second brightness data to generate the output brightness data for the second panel.
12. The display driving device according to claim 2, wherein, The offset calculator also includes: A first offset calculator is used to calculate a first offset based on first interpolated brightness data generated by interpolating based on the second brightness data and second interpolated brightness data generated by interpolating based on the first brightness data and the second brightness data. A third offset calculator is used to check the brightness deviation among a plurality of first unit pixels corresponding to the second unit pixel, and calculates a third offset for increasing or decreasing the brightness value of the plurality of first unit pixels corresponding to the second unit pixel when the number of first unit pixels with negative brightness deviations is different from the number of first unit pixels with positive brightness deviations; and A fourth offset calculator is used to calculate a fourth offset based on the first offset, the second offset, and the third offset.
13. The display driving device according to claim 12, wherein, The fourth offset calculator calculates the fourth offset by multiplying the sum of the first offset, the second offset, and the third offset by a weight that depends on the brightness value.
14. A display driving method, the display driving method comprising the following steps: Calculate first brightness data corresponding to a first resolution and second brightness data corresponding to a second resolution that is smaller than the first resolution using the input image data; The offset is calculated based on the first brightness data and the second brightness data; The input image data is converted into input image data with the calculated offset applied. as well as The converted input image data is used to generate output image data for the first panel, and the second brightness data is used to generate output brightness data for the second panel. The display driving method further includes the following step before calculating the first brightness data and the second brightness data: converting the non-linear input image data into linear input image data. The step of calculating the offset includes the following steps: A first edge unit pixel is determined from a plurality of first unit pixels having the first resolution, and a second edge unit pixel is determined from a plurality of second unit pixels having the second resolution, which is disposed at a position corresponding to the first edge unit pixel. Calculate the desired brightness value of the second edge unit pixel; and A second offset is calculated for each of the plurality of first unit pixels based on the edge strength and the difference between the brightness value of the first edge unit pixel and the desired brightness value of the second edge unit pixel.
15. The display driving method according to claim 14, wherein, The first panel has the first resolution and includes the plurality of first unit pixels, and the second panel has the second resolution and includes the plurality of second unit pixels. In this context, a single second unit pixel corresponds to at least two first unit pixels.
16. The display driving method according to claim 15, wherein, The step of calculating the offset also includes the following steps: Calculate the first offset and the third offset; and The fourth offset is calculated by multiplying the sum of the first offset, the second offset, and the third offset by a weight that depends on the brightness value.
17. The display driving method according to claim 16, wherein, The steps for calculating the first offset and the third offset include the following steps: The first offset is calculated based on first interpolated brightness data generated by interpolating based on the second brightness data and second interpolated brightness data generated by interpolating based on the first brightness data and the second brightness data; and Check the brightness deviation among a plurality of first unit pixels corresponding to the second unit pixel, and when the number of first unit pixels with negative brightness deviation is different from the number of first unit pixels with positive brightness deviation, calculate the brightness change value of the second unit pixel, and calculate the third offset based on the brightness value of the second unit pixel and the brightness change value.
18. The display driving method of claim 17, further comprising the step of converting the second brightness data into second brightness data having been applied with the brightness change value. in, The step of generating the output brightness data includes the step of generating output brightness data for the second panel based on the converted second brightness data.
Citation Information
Patent Citations
Dual Liquid Crystal Display
KR100758986B1
Display control method and display system
US20190355330A1