Display device

Abstract

A display device is disclosed, configured to: select a gaze focus area as a scan drive start point based on the gaze focus position and gaze point rendering information, wherein the gaze focus area is the area focused by the user's gaze; and first provide a scan signal to the gaze focus area, which serves as the scan drive start point. This improves response characteristics and reduces latency.

Description

Technical Field

[0001] This disclosure relates to a display device, and more particularly to a display device capable of responding immediately to changes in the gaze point of the eye. Background Technology

[0002] Virtual reality (VR) refers to the use of stereoscopic imaging technology to experience a specific environment and situation similar to the real world. Virtual reality devices are being developed as structures for various types of display devices, such as head-mounted displays (HMDs), face-mounted displays (FMDs), and eyeglass-mounted displays (EGDs).

[0003] Because the display device used in virtual reality devices performs graphics rendering in real time, the total latency of the image data from the image source displayed as an image on the display panel changes in real time.

[0004] The description of related technologies should not be construed as prior art simply because they are mentioned or associated with this section. The description of related technologies includes information describing one or more aspects of the subject matter, and the description in this section does not limit the scope of the invention. Summary of the Invention

[0005] Foveated rendering technique can be applied to display devices. It is configured to achieve full resolution in the gaze focus area, while using lower resolution for the central and peripheral areas, taking into account human cognitive characteristics. This reduces the amount of data to be rendered, thereby increasing the processing power of the graphics processing device and reducing the amount of data transmitted when displaying virtual reality, thus lowering latency caused by data processing and transmission delays.

[0006] Virtual reality devices use eye tracking to detect the portion of the image where the gaze is focused, rendering a resolution that differs between the gaze-focused area and other areas outside it, implementing different resolutions for each area. However, since the gaze-focused area is not fixed on the actual panel, the actual panel cannot physically reduce its resolution but must represent all resolutions.

[0007] Foveated rendering technology is applied to display devices. In this regard, a horizontal line is sequentially driven across the entire screen area. However, since the display device renders the image according to a predetermined frame rate, it does not immediately respond to changes in the eye's gaze point, resulting in a delay until the next frame is sequentially driven.

[0008] Therefore, the inventors of this disclosure have invented a display device that can immediately respond to changes in the eye's gaze point and reduce latency.

[0009] One technical objective of this disclosure is to provide a display device that can immediately respond to changes in eye gaze and reduce latency.

[0010] The purposes of this disclosure are not limited to those described above. Other purposes and advantages not mentioned in this disclosure may be understood based on the following description, and may be more clearly understood based on embodiments of this disclosure. Furthermore, it will be readily understood that the purposes and advantages of this disclosure may be achieved using the modules shown in the claims or combinations thereof.

[0011] A display device according to embodiments of the present disclosure is provided. The display device can be configured to select a scan drive start point as the gaze focus area, and control a gate driver to first provide a scan signal to the gaze focus area.

[0012] According to an embodiment, the display device can be configured to drive the gaze focus area at full resolution, drive the middle area at medium resolution, and drive the peripheral area at low resolution.

[0013] According to an embodiment, the display device can be configured to sequentially drive the gaze focus area on a single scan line, and to drive each of the intermediate and peripheral areas on a sequential and grouped basis on at least two scan lines.

[0014] According to an embodiment, the display device can be configured to sequentially drive the gaze focus area on a single scan line in a vertically alternating manner, and to drive each of the intermediate and peripheral regions in a sequential and grouped manner and in a vertically alternating manner on a basis of at least two scan lines.

[0015] According to an embodiment, the display device can be configured to apply a data voltage to the gaze focus area on a single data line, and can be configured to drive each of the intermediate and peripheral areas in a grouped manner on a basis of at least two data lines.

[0016] According to an embodiment, the display device can be configured to maintain the brightness of the gaze focus area and control the brightness of each of the middle and peripheral areas to be lower than the brightness of the gaze focus area.

[0017] According to embodiments of this disclosure, the display device can improve its response characteristics by selecting the gaze focus area as the scan drive start point.

[0018] In addition, the display device displays the gaze focus area with high quality or high resolution, and displays other areas with low quality or low resolution, thereby reducing latency.

[0019] In addition, the display device can immediately respond to changes in the eye's gaze point by selecting the gaze focus area as the scan drive start point.

[0020] In addition, the display device can calculate the brightness gain value of each of the focusing area, the middle area, and the peripheral area, and control the brightness of the focusing area, the middle area, and the peripheral area to be different from each other based on the calculation results, thereby reducing power consumption and thus allowing the display device to be used for a longer period of time.

[0021] In addition, in response to changes in the user's gaze point, the display device can be configured to first perform a scan drive on the area focused by the gaze, thereby improving response characteristics and reducing latency.

[0022] In addition, the display device uses dynamic foveated rendering to track gaze in real time to ensure the stable performance of the graphics processing equipment of the external system.

[0023] Furthermore, the display device can first respond to changes in gaze to drive the user's eye focus area, thereby improving response characteristics without delay caused by sequential driving, and can control the brightness of different areas to be different from each other, thereby reducing power consumption.

[0024] Furthermore, the display device can first perform a scan drive of the gaze-focused area, and can perform scan drives in the vertical direction alternately with each other, thereby further improving response characteristics and further reducing latency.

[0025] The effects of this disclosure are not limited to those described above, and other effects not mentioned will be clearly understood by those skilled in the art based on the following description.

[0026] In addition to the effects described above, the specific effects of this disclosure are also described along with the specific details used to implement this disclosure. Attached Figure Description

[0027] Figure 1 This is a block diagram illustrating a display device according to an embodiment of the present disclosure.

[0028] Figure 2 This is a diagram illustrating sequential driving in a display device according to an embodiment of the present disclosure.

[0029] Figure 3 It is a graph showing the change in the eye's gaze point on the display panel.

[0030] Figure 4This is a diagram illustrating an operation method in a display device based on changes in eye gaze point according to an embodiment of the present disclosure.

[0031] Figure 5 This is a diagram illustrating different resolutions in different regions based on the eye's gaze point in a display device according to an embodiment of the present disclosure.

[0032] Figures 6 to 11 This is a diagram illustrating an operation method in a display device according to an embodiment of the present disclosure in response to gaze point movement.

[0033] Figure 12 and Figure 13 This is a diagram illustrating an operation method in a display device according to another embodiment of the present disclosure in response to gaze point movement.

[0034] Figure 14 This is a circuit diagram illustrating a gate driver in a display device according to an embodiment of the present disclosure.

[0035] Figure 15 It is shown Figure 14 A diagram showing the operating timing of the gate driver.

[0036] Figure 16 This is a diagram illustrating data processing based on eye gaze points in a display device according to an embodiment of the present disclosure.

[0037] Figure 17 This is a block diagram illustrating a controller for a display device according to an embodiment of the present disclosure.

[0038] Figure 18 This is a flowchart illustrating a method for controlling a display device according to an embodiment. Detailed Implementation

[0039] The advantages and features of this disclosure, as well as methods for achieving these advantages and features, will become apparent from the embodiments described in detail below with reference to the accompanying drawings. However, this disclosure is not limited to the embodiments disclosed below, but can be implemented in various different forms. Therefore, these embodiments are set forth only to complete this disclosure and to fully inform those skilled in the art of the subject of this disclosure of its scope, which is limited only by the scope of the claims.

[0040] For simplicity and clarity, the elements in the accompanying drawings are not necessarily drawn to scale. The same reference numerals in different drawings denote the same or similar elements and therefore perform similar functions. Furthermore, for the sake of simplicity, descriptions and details of well-known steps and elements have been omitted. In addition, numerous specific details are set forth in the following detailed description of this disclosure to provide a thorough understanding of the disclosure. However, it should be understood that this disclosure can be practiced without these specific details. In other instances, well-known methods, processes, components, and circuits have not been described in detail so as not to unnecessarily obscure aspects of this disclosure. Examples of various embodiments are further shown and described below. It should be understood that the description herein is not intended to limit the claims to the specific embodiments described. Rather, it is intended to cover various alternatives, modifications, and equivalents that may be included within the spirit and scope of this disclosure as defined by the appended claims.

[0041] The shapes, dimensions, scales, angles, quantities, etc., disclosed in the accompanying drawings illustrating embodiments of this disclosure are illustrative and are not intended to limit this disclosure. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit this disclosure. As used herein, the singular forms “a” and “an” are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that, when used in this disclosure, the terms “comprising,” “having,” “containing,” and “including” specify the presence of the stated features, integers, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, operations, elements, components, and / or portions thereof. As used herein, the term “and / or” includes any and all combinations of one or more associated listed items. When following a list of elements, expressions such as “at least one” may modify the entire list of elements and may not modify individual elements in the list. Errors or tolerances may occur in the interpretation of numerical values, even when not explicitly described therein.

[0042] In descriptions of temporal relationships, such as those between two events (e.g., "after," "following," "before," etc.), another event may occur between them unless it is indicated that it "immediately after," "follows immediately after," or "immediately before." When an embodiment can be implemented in different ways, the functions or operations specified in a particular box may occur in a different order than that specified in the flowchart. For example, two consecutive boxes may actually be executed substantially simultaneously, or two boxes may be executed in reverse order depending on the functions or operations involved.

[0043] It should be understood that although the terms “first,” “second,” “third,” etc., may be used herein to describe various elements, components, regions, layers, and / or time periods, these elements, components, regions, layers, and / or time periods should not be limited by these terms. These terms are used to distinguish one element, component, region, layer, or time period from another. Therefore, without departing from the spirit and scope of this disclosure, the first element, component, region, layer, or time period described below may be referred to as the second element, component, region, layer, or time period.

[0044] When embodiments can be implemented in different ways, the functions or operations specified within a particular block can be performed in an order different from that specified in the flowchart. For example, two consecutive blocks can be performed substantially simultaneously, or these blocks can be performed in reverse order according to the associated functions or operations. Features of the various embodiments of this disclosure can be combined partially or completely with each other and can be technically related to or operable on each other. Multiple embodiments can be implemented independently of each other and can be implemented together in an associated relationship.

[0045] Unless otherwise defined, all terms used herein (including technical and scientific terms) shall have the same meaning as commonly understood by one of ordinary skill in the art to which the inventive concept pertains. It should also be understood that terms (such as those defined in common dictionaries) shall be interpreted as having a meaning consistent with their meaning in the context of the relevant field and shall not be interpreted in an idealized or overly formal sense unless expressly defined herein.

[0046] In the description of signal flow, for example, when a signal is transmitted from node A to node B, this can include cases where the signal is transmitted from node A to node B via another node, unless the phrases "immediate transmission" or "direct transmission" are used. Throughout this disclosure, unless otherwise stated, "A and / or B" means A, B, or A and B, and unless otherwise stated, "C to D" means not only including C to D, but also including C and D. In interpreting numerical values, the value is interpreted to include a range of errors unless explicitly described separately. Furthermore, the term "or" means "inclusive or" rather than "exclusive or". That is, unless otherwise stated or clear from the context, an expression such as "x uses a or b" indicates one of the naturally inclusive permutations.

[0047] The following section describes a display device that can immediately respond to changes in the eye's gaze and reduce latency.

[0048] Various embodiments of this disclosure will be described in detail below with reference to the accompanying drawings.

[0049] Figure 1This is a block diagram illustrating a display device according to an embodiment of the present disclosure.

[0050] refer to Figure 1 The display device 10 includes: a display panel 100 including a plurality of pixels P; a controller 200; a gate driver 300 configured to provide a scan signal SC to the plurality of pixels P; a data driver 400 configured to provide a data voltage Vdata to the plurality of pixels P; and a power supply 500 configured to provide the voltage required to drive the plurality of pixels P.

[0051] In the display panel 100, multiple scan lines SCL and multiple data lines DL intersect each other, and each of the multiple pixels P is connected to the scan lines SCL and data lines DL. Specifically, a pixel P receives the scan signal SC through the scan line SCL, receives the data voltage Vdata through the data line DL, and receives the reference voltage Vref, the high-level drive voltage ELVDD, and the low-level drive voltage ELVSS from the power supply 500.

[0052] The scan line SCL provides the scan signal SC and the sensing signal to pixel P, and the data line DL provides the data voltage Vdata to pixel P. Alternatively, according to various embodiments, the scan line SCL and the sensing line providing the sensing signal can be connected to pixel P separately.

[0053] In addition, the display panel 100 includes power lines. Multiple pixels P can receive a high-potential driving voltage ELVDD and a low-potential driving voltage ELVSS via the power lines. Furthermore, the display panel 100 includes a reference voltage line RL. Multiple pixels P can receive a reference voltage Vref via the reference voltage line RL.

[0054] Additionally, each pixel P includes a light-emitting element (LD) and a pixel circuit (PC) for driving the LD. The pixel circuit includes multiple switching elements, driving elements, and capacitors. In this regard, each of the switching elements and driving elements may include a thin-film transistor. In the pixel circuit, the driving element controls the amount of current supplied to the LD based on the data voltage to adjust the amount of light emitted from the LD. Furthermore, the switching elements transmit the data voltage Vdata and the reference voltage Vref to the driving elements and capacitors in response to the scan signal SC.

[0055] Display panel 100 can be implemented as a non-transmissive display panel or a transmissive display panel. Transmissive display panels can be applied to transparent display devices, where an image is displayed on the screen, and real objects in the background are visible to a viewer in front of the display device. Display panel 100 can be manufactured as a flexible display panel. Flexible display panels can be implemented as OLED panels using a plastic substrate.

[0056] Pixel P can include red, green, and blue pixels used for color implementation. Pixel P can also include white pixels.

[0057] A touch sensor (TS) may be disposed on the display panel 100. Touch input may be sensed using a separate touch sensor or by a pixel P. The touch sensor may be disposed on the screen of the display panel in an on-cell or additional manner, or implemented as an in-cell touch sensor embedded in the display panel 100.

[0058] The controller 200 receives image information DP from the host system, processes the image data RGB included in the image information DP to suit the size and resolution of the display panel 100, and provides the processed image data RGB to the data driver 400. The controller 200 uses synchronization signals input from an external source (e.g., clock signal CLK, data enable signal DE, horizontal synchronization signal Hsync, and vertical synchronization signal Vsync) to generate a gate control signal GCS and a data control signal DCS. The gate control signal GCS and the data control signal DCS are provided to the gate driver 300 and the data driver 400, respectively, to control the gate driver 300 and the data driver 400.

[0059] The voltage level of the gate control signal GCS output from controller 200 can be converted into gate on-voltage and gate off-voltage via a level shifter, and then provided to gate driver 300. The level shifter converts the low level voltage of the gate control signal GCS to gate low voltage VGL, and the high level voltage of the gate control signal GCS to gate high voltage VGH. The gate control signal GCS includes a start pulse and a shift clock.

[0060] The gate driver 300 provides the scan signal SC to the scan line SCL according to the gate control signal GCS. The gate driver 300 can be disposed on one side or on each of the two opposite sides of the display panel 100 in the manner of a gate in the panel (GIP).

[0061] The gate driver 300 outputs a scan pulse in response to a start pulse and a shift clock from the controller 200, and shifts the scan pulse sequentially according to the shift clock.

[0062] The data driver 400 converts image data RGB into data voltage Vdata according to the data control signal DCS, and provides the converted data voltage Vdata to the pixel P through the data line DL.

[0063] although Figure 1A data driver 400 is shown disposed on one side of the display panel 100, but the number and arrangement of the data drivers 400 are not limited thereto. That is, the data driver 400 can be implemented as multiple integrated circuits (ICs), which can be separately disposed on multiple sides of the display panel 100.

[0064] Power supply 500 generates the DC power required to drive the pixel array, gate driver 300, and data driver 400 of display panel 100. Power supply 500 may include a charge pump, regulator, buck converter, boost converter, etc.

[0065] Power supply 500 can receive input voltage from the host system and can generate DC voltages such as gate high voltage VGH, gate low voltage VGL, high-level drive voltage ELVDD, low-level drive voltage ELVSS, and reference voltage Vref. Gate low voltage VGL and gate high voltage VGH can be supplied to gate driver 300, and high-level drive voltage ELVDD, low-level drive voltage ELVSS, and reference voltage Vref can be supplied to pixel P.

[0066] The host system can be the graphics processing device of a virtual reality device. The image information DP received from the host system can include real-time eye tracking information.

[0067] The controller 200 can divide the area of ​​the display panel into a gaze focus area, a central area, and a peripheral area based on real-time eye tracking information. As used herein, the gaze focus area Z can be defined as a predetermined area focused by the user's eye gaze, the central area Y can be defined as the area located outside and around the gaze focus area Z, and the peripheral area X can be defined as the area located outside and around the central area Y.

[0068] The controller 200 can be configured to drive the focal area Z of the display panel 100 at full resolution, the central area Y of the display panel 100 at medium resolution, and the peripheral area X of the display panel 100 at low resolution. Furthermore, the controller 200 can control the brightness of the focal area, central area, and peripheral area of ​​the display panel to be different from each other.

[0069] This disclosure discloses a display device that can apply FR (focal point rendering) technology. Focal point rendering technology can be defined as a technology that can increase the processing power of a graphics processing device by considering human cognitive characteristics and driving the user's eye focus area at full resolution (or high resolution), while driving the central and peripheral areas at low resolution, thereby reducing the amount of data to be rendered and reducing the amount of data transmission when realizing virtual reality, thereby reducing latency caused by data processing and transmission delays.

[0070] Figure 2 This is a diagram illustrating sequential driving in a display device according to an embodiment of the present disclosure. Figure 3 It is a graph showing the change in the eye's gaze point on the display panel.

[0071] refer to Figure 2 and Figure 3 The display device 10 has a structure in which, in response to changes in the eye's gaze point, scan signals SC1 to SC6 are sequentially applied to all areas of the display panel 100, such that a data voltage is applied to it on a single scan line basis.

[0072] The DAC in the data driver 400 represents a digital-to-analog converter that converts image data into data voltage as an analog signal. Additionally, the data driver 400 may also include an output buffer that outputs the data voltage converted by the DAC to the display panel 100.

[0073] In sequential driving of the display panel, the image is rendered according to a predetermined frame rate. Therefore, this approach cannot immediately respond to changes in the gaze point and results in a delay until the next frame is sequentially driven, thus increasing latency. In other words, in sequential driving, even when the display device receives gaze point rendering information from the graphics processing device of an external system, the display device may not immediately respond to changes in the gaze point based on the gaze point rendering information.

[0074] Therefore, there is a need for an operational method that can improve latency based on changes in eye fixation.

[0075] Figure 4 This is a diagram illustrating an operation method in a display device based on changes in eye gaze point according to an embodiment of the present disclosure. Figure 5 This is a diagram illustrating different resolutions in different regions based on the eye's gaze point in a display device according to an embodiment of the present disclosure.

[0076] The display device according to an embodiment of the present disclosure is configured to identify the area of ​​the display panel that the eye is focused on based on gaze point rendering information received from an external system and the focus position of the gaze, and define the area of ​​the display panel that the gaze is focused on as the gaze focus area, and first drive the gaze focus area to reduce latency.

[0077] refer to Figure 4 and Figure 5The display device 10 first applies a scanning signal to the gaze focusing area. For example, in response to the user's eye gaze point being the center of the display panel, the display device sequentially applies a scanning signal to the center of the display panel first. Additionally, in response to the user's eye gaze point changing from the center of the display panel to the bottom, the display device first applies a scanning signal to the bottom of the display panel.

[0078] Furthermore, based on the foveation rendering information, the display device 10 can be configured to drive the foveation focus area Z at 100% full resolution, the middle area Y at 80% medium resolution, and the peripheral area X at 60% low resolution.

[0079] To achieve this scheme, the display device 10 can be configured to apply a scan signal to the gaze focus region Z on a single scan line basis, to the intermediate region Y on a basis of at least two scan lines, and to the peripheral region X on a basis of at least four scan lines. Furthermore, the display device 10 can be configured to apply a data voltage to the gaze focus region Z on a single pixel basis (e.g., each associated pixel receives its own data voltage), to the intermediate region Y on a basis of at least two pixels (e.g., two associated pixels receive the same data voltage), and to the peripheral region X on a basis of at least four pixels (e.g., four associated pixels receive the same additional data voltage).

[0080] Furthermore, the display device can control the brightness of the focusing area Z, the intermediate area Y, and the peripheral area X to be different from each other. For example, the display device can gradually reduce the brightness in the order of the focusing area Z, the intermediate area Y, and the peripheral area X; that is, the display device can control the brightness of the focusing area Z to the highest brightness, the brightness of the intermediate area Y to a medium brightness, and the brightness of the peripheral area X to the lowest brightness. To this end, the gamma reference voltages applied to the data driver 400 for the focusing area Z, the intermediate area Y, and the peripheral area X can be set to be different from each other, thereby controlling the brightness of the different areas to be different from each other.

[0081] The method for operating a display device capable of reducing latency based on changes in the gaze point will be described in more detail below.

[0082] Figures 6 to 11 This diagram illustrates an operation method in a display device according to an embodiment of the present disclosure, responsive to gaze movement. For ease of description, an example including a first to a twentieth scan line in the display panel is described below. However, embodiments of the present disclosure are not limited thereto.

[0083] refer to Figure 6 and Figure 7In the display device 10, when the eye's focal point Z is located at the center of the display panel 100, the gate driver 300 is configured to first apply a scan signal to the focal point Z of the display panel 100. For example, when the focal point Z is located at the center of the display screen, the display device selects its center as the scan starting point, taking into account the focal point position and the focal point rendering area. The display device 10 can be configured to apply sequential driving and group driving to the intermediate region Y and the peripheral region X, excluding the focal point Z, at a low resolution, thereby driving the intermediate region Y and the peripheral region X, excluding the focal point Z, at a lower resolution.

[0084] For example, firstly, the gate driver 300 can be configured to sequentially apply the ninth to twelfth scan signals SC9, SC10, SC11 and SC12 to the gaze focus area Z located at the center of the display panel 100 on a single scan line basis (for example, the scan lines for SC9, SC10, SC11 and SC12 can be configured to be non-electrically connected to each other, each scan signal can be applied to the corresponding scan line, and the scan signals can be applied sequentially).

[0085] Then, the gate driver 300 can be configured to sequentially apply the 13th scan signal SC13 and the 14th scan signal SC14, and the 15th scan signal SC15 and the 16th scan signal SC16 to the intermediate region Y located below the gaze focus region Z based on two scan lines (for example, the two scan lines for SC13 and SC14 can be configured to be electrically connected to each other and driven together simultaneously, and the two scan lines for SC15 to SC16 can be configured to be electrically connected to each other and driven together simultaneously).

[0086] Subsequently, the gate driver 300 can be configured to simultaneously apply the 17th scan signal SC17 to the 20th scan signal SC20 to the peripheral region X located below the intermediate region Y, based on four scan lines (for example, the four scan lines for SC17 to SC20 can be configured to be electrically connected to each other and driven together simultaneously).

[0087] Subsequently, the gate driver 300 can be configured to simultaneously apply the first scan signal SC1 to the fourth scan signal SC4 to the peripheral region X located on top of the intermediate region Y, based on four scan lines.

[0088] Subsequently, the gate driver 300 can be configured to sequentially apply the fifth scan signal SC5 and the sixth scan signal SC6, as well as the seventh scan signal SC7 and the eighth scan signal SC8, to the middle region Y located on top of the gaze focus region Z, based on two scan lines.

[0089] When the gate driver 300 is operating, the data driver 400 can be configured to apply a data voltage to the gaze focus region Z on a single data line basis, to the intermediate region Y on two data lines basis, and to the peripheral region X on four data lines basis.

[0090] An example of applying a data voltage to the gaze focus region Z based on a single data line (e.g., see...). Figure 6 In the middle column of the focusing area Z), four data lines can be configured to be electrically disconnected from each other, each data voltage can be applied to the corresponding data line, and the data voltages can be applied sequentially.

[0091] In the example of applying a data voltage to the intermediate region Y based on two data lines (for example, see...), Figure 6 In the middle region Y of the column to the right of the middle column, a first set with two data lines can be configured to be electrically connected to each other, and a second set with two other data lines can be configured to be electrically connected to each other. A first data voltage can be applied to the first set simultaneously, and a second data voltage can be applied to the second set simultaneously.

[0092] In the example of applying a data voltage to the peripheral region X based on four data lines (for example, see...), Figure 6 In the outer region X of the last column, the four data lines can be configured to be electrically connected to each other, and data voltage can be applied to the four data lines simultaneously.

[0093] As described above, the display device can first perform a scan drive of the gaze focus area to improve response characteristics. Additionally, the display device can reduce latency by displaying the gaze focus area with high quality and other areas with low quality. However, this is merely an example. When the gate driver 300 operates, the data driver 400 can apply data voltages to the gaze focus area Z, the intermediate area Y, and the peripheral area X on an equal number of data lines (e.g., on a single data line basis).

[0094] Furthermore, the display device can control the brightness of the focusing area Z, the central area Y, and the peripheral area X to be different from each other. For example... Figure 8 As shown, in response to the user's eye gaze point being located at the center of the display panel 100, the brightness gain value of the gaze focus area Z at the center is the largest, the brightness gain value of the middle area Y is the middle value, and the brightness gain value of the outer area X is the smallest.

[0095] The display device can calculate the brightness gain value of each of the gaze focus area Z, the central area Y, and the peripheral area X based on gaze-focus rendering information received from an external system. The display's gamma characteristics are taken into account to adjust the brightness. For this reason, a process of converting grayscale data into brightness data can be performed, and brightness compensation methods can be selectively applied based on the gaze-focus rendering information.

[0096] When the focusing area Z is located at the center of the screen of the display panel 100, the display device 10 can be configured to use vertical and horizontal symmetric Gaussian functions to calculate the brightness gain factor.

[0097] As described above, the display device 10 can be configured to calculate the brightness gain values ​​of the focusing area Z, the central area Y, and the peripheral area X, and control its brightness based on the calculation results, thereby reducing power consumption. Therefore, the usage time of the display device can be further extended.

[0098] Figures 9 to 11 This illustrates the operation of a display device in response to a change in the user's eye gaze point from the center of the display panel to its lower right point.

[0099] refer to Figures 9 to 11 In the display device, when the gaze focus area Z changes from the center point of the display panel 100 to its lower right point, the gate driver 300 can be configured to first apply a scan signal to the changed gaze focus area Z. For example, the display device 10 can be configured to select a scan start point as the gaze focus area Z by considering the gaze focus position and the gaze point rendering area, and to drive the gaze focus area Z first. The display device 10 can be configured to apply sequential driving and group driving to the intermediate area Y and the peripheral area X other than the gaze focus area Z, so that the intermediate area Y and the peripheral area X are displayed at a low resolution.

[0100] For example, firstly, the gate driver 300 can be configured to sequentially apply the 13th scan signal to the 16th scan signal SC13, SC14, SC15 and SC16 on a single scan line to the gaze focus area Z located in the lower right region of the center of the display panel 100.

[0101] Subsequently, the gate driver 300 can be configured to sequentially apply the 17th scan signal SC17 and the 18th scan signal SC18, as well as the 19th scan signal SC19 and the 20th scan signal SC20, to the intermediate region Y located below the gaze focus region Z, based on two scan lines.

[0102] Subsequently, the gate driver 300 can be configured to sequentially apply the first scan signal SC1 to the fourth scan signal SC4 and the fifth scan signal SC5 to the eighth scan signal SC8 to the peripheral area X located above the central area Y of the display panel 10, based on four scan lines.

[0103] Subsequently, the gate driver 300 can be configured to sequentially apply the ninth scan signal SC9 and the tenth scan signal SC10, as well as the eleventh scan signal SC11 and the twelfth scan signal SC12, to the intermediate region Y located below the peripheral region X, based on two scan lines.

[0104] When the gate driver 300 is operating, the data driver 400 can be configured to apply a data voltage to the gaze focus region Z on a single data line basis, to the intermediate region Y on two data lines basis, and to the peripheral region X on four data lines basis.

[0105] As described above, in response to the user's eye gaze point changing from the center of the display panel to the lower right area, the display device can first perform a scan drive of the gaze focus area, thereby improving response characteristics and reducing latency.

[0106] In addition, such as Figure 11 As shown, in the display device 10, when the gaze focus position is located in the lower right area of ​​the display panel 100, the brightness gain value of the gaze focus area Z in the lower right area is the largest, the brightness gain value of the middle area Y is the middle value, and the brightness gain value of the outer area X is the smallest.

[0107] When the gaze focus area Z is located in the lower right region of the display device, the brightness gain factor is calculated using only a portion of the vertical and horizontal symmetric Gaussian functions.

[0108] As described above, in response to a change in the user's eye gaze point from the center of the display panel to the lower right area, the display device can calculate the brightness gain value of each of the changed gaze focus area Z, the central area Y, and the peripheral area X, and control the brightness of each of the changed gaze focus area Z, the central area Y, and the peripheral area X based on the calculation results, thereby reducing power consumption. Therefore, the display device can be used for a longer duration than usual.

[0109] In addition, the display device uses dynamic foveated rendering to track gaze in real time to ensure the stable performance of the graphics processing equipment of the external system, and first drives the gaze-focused area to improve response characteristics.

[0110] Furthermore, the display device can first respond to changes in gaze to drive the user's eye focus area, thereby improving response characteristics without delay caused by sequential driving, and can control the brightness of different areas to be different from each other, thereby reducing power consumption.

[0111] Figure 12 and Figure 13 This is a diagram illustrating an operation method in a display device according to another embodiment of the present disclosure in response to gaze point movement.

[0112] Figure 12 The operation of the gate driver 300 is shown when the gaze focus area Z, which serves as the user's gaze point, is located at the center of the display panel 100.

[0113] refer to Figure 12 and its corresponding Figure 6 First, the gate driver 300 can be configured to sequentially apply scan signals in an alternating manner to the gaze focus area Z located at the center of the display panel 100 in the vertical direction.

[0114] For example, the gate driver 300 can be configured to sequentially apply the 10th scan signal SC10, the 11th scan signal SC11, the 9th scan signal SC9 and the 12th scan signal SC12 in an alternating manner in the vertical direction on a single scan line to the gaze focus area Z located at the center of the display panel 100.

[0115] Subsequently, the gate driver 300 can be configured to sequentially apply, in a vertical direction, the seventh scan signal SC7 and the eighth scan signal SC8, the 13th scan signal SC13 and the 14th scan signal SC14, the fifth scan signal SC5 and the sixth scan signal SC6, and the 15th scan signal SC15 and the 16th scan signal SC16 to the middle region Y, which is located above and below the gaze focus region Z, respectively, on the basis of two scan lines.

[0116] Subsequently, the gate driver 300 can be configured to sequentially apply the 17th scan signal SC17 to the 20th scan signal SC20, and the first scan signal SC1 to the fourth scan signal SC4 to the peripheral regions X located above and below the respective intermediate regions Y, based on four scan lines.

[0117] In addition, the display device uses vertical and horizontal symmetrical Gaussian functions to calculate the brightness gain of each of the gaze focus area Z, the middle area Y, and the peripheral area X, and controls the brightness of each of the gaze focus area Z, the middle area Y, and the peripheral area X based on the calculation results.

[0118] As described above, the display device 10 can first perform a scan drive of the gaze focus area Z, and can perform a scan drive in the vertical direction in an alternating manner, thereby further improving the response characteristics and further reducing the latency.

[0119] Figure 13 The operation of the gate driver 300 is shown when the gaze focus area Z, which serves as the user's gaze point, changes from the center of the display panel 100 to the lower right.

[0120] refer to Figure 13 and its corresponding Figure 9 First, the gate driver 300 can be configured to sequentially apply scan signals to the gaze focus area Z located at the lower right end of the display panel 100 in a vertically alternating manner.

[0121] For example, the gate driver 300 can be configured to sequentially apply the 14th scan signal SC14, the 15th scan signal SC15, the 13th scan signal SC13 and the 16th scan signal SC16 on a single scan line in a vertically alternating manner to the gaze focus area Z located at the lower right end of the display panel 100.

[0122] Subsequently, the gate driver 300 can be configured to sequentially apply the 11th scan signal SC11 and the 12th scan signal SC12, the 17th scan signal SC17 and the 18th scan signal SC18, the 9th scan signal SC9 and the 10th scan signal SC10, the 19th scan signal SC19 and the 20th scan signal SC20, respectively, to the middle region Y located above and below the gaze focus region Z, respectively, on a vertically alternating basis, based on two scan lines.

[0123] Subsequently, the gate driver 300 can be configured to sequentially apply the fifth scan signal SC5 to the eighth scan signal SC8 and the first scan signal SC1 to the fourth scan signal SC4 to the peripheral region X located on top of the central region Y of the display panel 10, based on four scan lines.

[0124] As described above, in response to the user's eye gaze point changing from the center of the display panel to the lower right, the display device can first execute a scan drive of the gaze-focused area, and can execute the scan drive in a vertical alternation manner, thereby improving the response characteristics of the gaze-focused area and reducing latency.

[0125] Furthermore, the display device can immediately drive the focusing area of ​​the gaze in response to changes in the gaze's focusing position, thereby improving response characteristics. Additionally, the display device can control the brightness of different areas differently, thereby reducing power consumption.

[0126] Figure 14 This is a circuit diagram illustrating a gate driver in a display device according to an embodiment of the present disclosure. Figure 15 It is shown Figure 14 A diagram showing the operating timing of the gate driver. For ease of explanation, Figure 14 and Figure 15 Only a partial configuration of the output first scan signal SC1 to the eighth scan signal SC8 is shown.

[0127] refer to Figure 14 and Figure 15 The gate driver 300 includes first to eighth logic circuits 311, 312, 313, 314, 315, 316, 317 and 318, first to eighth enable transistors TA1, TA2, TA3, TA4, TA5, TA6, TA7 and TA8, first to eighth connecting transistors TB1, TB2, TB3, TB4, TB5, TB6, TB7 and TB8, and first to eighth output circuits OC1, OC2, OC3, OC4, OC5, OC6, OC7 and OC8.

[0128] The first through eighth logic circuits 311, 312, 313, 314, 315, 316, 317, and 318 operate in response to a carry signal or a clock signal CLK2. In this respect, the first logic circuit 311 receives a start signal GST as a carry signal, and each of the second through eighth logic circuits 312, 313, 314, 315, 316, 317, and 318 receives the output signal of a corresponding enable transistor from the first through seventh enable transistors TA1, TA2, TA3, TA4, TA5, TA6, and TA7 of the previous stage as a carry signal.

[0129] In this regard, the pulse width of the clock signal CLK2 applied to the first to eighth logic circuits 311, 312, 313, 314, 315, 316, 317 and 318 can vary based on the gaze focus area Z, the intermediate area Y and the peripheral area X, wherein the gaze focus area Z, the intermediate area Y and the peripheral area X are defined based on the distance from the gaze point.

[0130] For example, the clock signal CLK2 of the gaze focus area Z can be switched with a first pulse width PW1, the clock signal CLK2 of the middle area Y can be switched with a first pulse width and then switched with a second pulse width PW2 that is greater than the first pulse width, and the clock signal CLK2 of the peripheral area X can be switched with a first pulse width and then switched with a third pulse width PW3 that is greater than the second pulse width.

[0131] The second pulse width allows the output of the logic circuit connected to the first scan line of the intermediate region Y to remain at the on level, such that the output of the logic circuit connected to the first scan line of the intermediate region Y is output from the logic circuit connected to the last scan line of the intermediate region Y. For example, the output signal from the third logic circuit 313 can be provided as a carry signal to the fourth logic circuit 314 through the third enable transistor TA3, which is turned on in response to the third group enable signal GEM3.

[0132] Simultaneously, the third scan signal SC3 can be output to the third scan line via the third output circuit OC3 in response to the output signal. Meanwhile, the output signal of the third logic circuit 313 can be provided to the fourth output circuit OC4 via the third connection transistor TB3, which is turned on in response to the third group signal GS3, and the fourth output circuit OC4 can output a fourth scan signal SC4 having the same turn-on timing as the third scan signal SC3. Furthermore, the output signal of the third logic circuit 313 can be provided to the fifth logic circuit 315 via the second node (second electrode) of the third connection transistor TB3 and the fourth enable transistor TA4. That is, the fifth logic circuit 315 can receive the output of the third logic circuit 313 (e.g., a carry signal) during the third time period 3.

[0133] In the sequential scan scheme, the fourth scan signal SC4 is output during the time period (fourth time period 4). However, in this method, the fourth scan signal SC4 is not output during the fourth time period 4. In this case, each of the fourth group enable signal GEM4 and the fourth group signal GS4 can be at a turn-off level. In addition, since the clock signal CLK2 remains at the on level during the fourth time period 4, the carry signal provided to the fifth logic circuit 315 can remain at the on level.

[0134] During the fifth time period 5, the fifth enable transistor TA5 and the fifth connection transistor TB5 can be turned on in response to the fifth group enable signal GEM5 and the fifth group signal GS5. Therefore, the fifth scan signal SC5 can be output during the fifth time period 5.

[0135] In other words, the clock signal CLK2 can be kept on until the first scan signal (e.g., the fifth scan signal SC5) of the peripheral region X switches to the on level, so that the first scan signal (e.g., the fifth scan signal SC5) of the peripheral region X can be output. For example, the third pulse width PW3 can be greater than the first pulse width and can correspond to the number of scan lines corresponding to the peripheral region X. When the peripheral region X includes four scan lines, the third pulse width PW3 can be four times the first pulse width PW1.

[0136] The driving mechanism for the outer region X is essentially the same as the scanning drive for the middle region Y, except that only multiple scan lines output scan signals simultaneously. Therefore, its redundant description will be omitted.

[0137] For example, when the peripheral region X includes 16 scan lines, the third pulse width PW3 of the clock signal CLK 2 corresponding to the peripheral region X can be 16 times the first pulse width PW1.

[0138] The first to eighth enable transistors TA1, TA2, TA3, TA4, TA5, TA6, TA7, and TA8 may have a corresponding first electrode connected to the corresponding output terminals of the first to eighth logic circuits 311, 312, 313, 314, 315, 316, 317, and 318, and a corresponding second electrode connected to the corresponding input terminals of the second to eighth logic circuits 312, 313, 314, 315, 316, 317, and 318, and a ninth logic circuit (not shown). In this respect, the first electrode and the second electrode may be the source electrode and the drain electrode of the transistor. In one or more aspects, the source electrode may be called the drain electrode, and vice versa. In one example, the first to eighth enable transistors TA1, TA2, TA3, TA4, TA5, TA6, TA7, and TA8 may be p-type metal-oxide-semiconductor field-effect transistors (MOSFETs), wherein the first electrode and the second electrode may be the source electrode and the drain electrode of the respective transistor. In another example, the first through eighth enable transistors TA1, TA2, TA3, TA4, TA5, TA6, TA7 and TA8 can be n-type MOSFETs, wherein the first electrode and the second electrode can be the drain electrode and source electrode of the respective transistor.

[0139] The first to eighth enable transistors TA1, TA2, TA3, TA4, TA5, TA6, TA7, and TA8 operate in response to the first to eighth group enable signals GEM1, GEM2, GEM3, GEM4, GEM5, GEM6, GEM7, and GEM8, respectively. The first to eighth group enable signals GEM1, GEM2, GEM3, GEM4, GEM5, GEM6, GEM7, and GEM8 may be included in the gate control signal GCS provided from the controller 200 and provided to the gate driver 300.

[0140] The first to eighth enable transistors TA1, TA2, TA3, TA4, TA5, TA6, TA7 and TA8 can be configured to transmit the corresponding output signals of the first to eighth logic circuits 311, 312, 313, 314, 315, 316, 317 and 318 to the first to eighth output circuits OC1, OC2, OC3, OC4, OC5, OC6, OC7 and OC8, respectively.

[0141] Furthermore, the first to eighth enable transistors TA1, TA2, TA3, TA4, TA5, TA6, TA7 and TA8 can be configured to transmit the corresponding output signals of the first to eighth logic circuits 311, 312, 313, 314, 315, 316, 317 and 318 to the second to eighth logic circuits 312, 313, 314, 315, 316, 317, 318 and a ninth logic circuit (not shown), respectively.

[0142] Each of the first to eighth connecting transistors TB1, TB2, TB3, TB4, TB5, TB6, TB7, and TB8 is connected to the second electrode of the corresponding enabling transistor among the first to eighth enabling transistors TA1, TA2, TA3, TA4, TA5, TA6, TA7, and TA8, and is disposed between the second electrodes of the corresponding enabling transistor among the first to eighth enabling transistors TA1, TA2, TA3, TA4, TA5, TA6, TA7, and TA8. For example, the first connecting transistor TB1 is connected to the second electrode of the first enabling transistor TA1 and the second enabling transistor TA2, and is disposed between the second electrodes of the first enabling transistor TA1 and the second enabling transistor TA2. The second connecting transistor TB2 is connected to the second electrode of the second enabling transistor TA2 and the second electrode of the third enabling transistor TA3, and is disposed between the second electrodes of the second enabling transistor TA2 and the third enabling transistor TA3.

[0143] The first to eighth connecting transistors TB1, TB2, TB3, TB4, TB5, TB6, TB7, and TB8 operate in response to the first to eighth group signals GS1, GS2, GS3, GS4, GS5, GS6, GS7, and GS8, respectively. The first to eighth group signals GS1, GS2, GS3, GS4, GS5, GS6, GS7, and GS8 may be included in the gate control signal GCS provided from the controller 200 and provided to the gate driver 300.

[0144] The first to eighth connecting transistors TB1, TB2, TB3, TB4, TB5, TB6, TB7 and TB8 can be used to selectively group scan signals by selectively connecting the corresponding outputs of the first to eighth enabling transistors TA1, TA2, TA3, TA4, TA5, TA6, TA7 and TA8.

[0145] The first to eighth output circuits OC1, OC2, OC3, OC4, OC5, OC6, OC7, and OC8 are respectively connected to the corresponding second electrodes of the first to eighth enable transistors TA1, TA2, TA3, TA4, TA5, TA6, TA7, and TA8, and are configured to perform pull-up or pull-down operations to output the first to eighth scan signals. Each of the first to eighth output circuits OC1, OC2, OC3, OC4, OC5, OC6, OC7, and OC8 may include a pull-up transistor and a pull-down transistor, which perform pull-up and pull-down operations respectively in response to the output signal of the corresponding enable transistor among the first to eighth enable transistors TA1, TA2, TA3, TA4, TA5, TA6, TA7, and TA8. The global clock GCLK can be applied to the source electrode of the pull-up transistor. Its drain electrode can be connected to the output terminal of the output scan signal. The drain electrode of the pull-down transistor can be connected to the output terminal of the output scan signal, while a gate low voltage can be applied to the source electrode of the pull-down transistor. In this example, the pull-up transistor can be a p-type MOSFET and the pull-down transistor can be an n-type MOSFET; however, the subject matter is not limited to this.

[0146] refer to Figure 14 and Figure 15 The operation of the gate driver 300 is shown based on a frame time period according to the vertical synchronization signal Vsync.

[0147] The gate driver 300 can be configured to sequentially apply a first scan signal SC1 and a second scan signal SC2 to the gaze focus area Z of the display panel 100 on a single scan line basis. In this regard, a first enable transistor TA1 and a second enable transistor TA2, which operate in response to the corresponding first group enable signal GEM1 and the second group enable signal GEM2, are turned on (ON), and a first connection transistor TB1 and a second connection transistor TB2, which operate in response to the corresponding first group signal GS1 and the second group signal GS2, are turned off (OFF).

[0148] The gate driver 300 is configured to group the third scan signal SC3 and the fourth scan signal SC4 into a group (i.e., Group 2) based on two scan lines, and apply the third scan signal SC3 and the fourth scan signal SC4 to the intermediate region Y. In this regard, among the third enable transistor TA3 and the fourth enable transistor TA4, which operate in response to the corresponding third group enable signal GEM3 and the fourth group enable signal GEM4, the third enable transistor TA3 is turned on, and the fourth enable transistor TA4 is turned off. Among the third connection transistor TB3 and the fourth connection transistor TB4, which operate in response to the corresponding third group signal GS3 and the fourth group signal GS4, the third connection transistor TB3 is turned on, and the fourth connection transistor TB4 is turned off.

[0149] The gate driver 300 is configured to group the fifth to eighth scan signals SC5, SC6, SC7, and SC8 into a group (i.e., Group 4) based on four scan lines, and apply the fifth to eighth scan signals SC5, SC6, SC7, and SC8 to the peripheral region X. In this regard, among the fifth to eighth transistors TA5, TA6, TA7, and TA8 that operate in response to the corresponding fifth to eighth group enable signals GEM5, GEM6, GEM7, and GEM8, the fifth enable transistor TA5 is turned on, and the sixth to eighth enable transistors TA6, TA7, and TA8 are turned off. Among the fifth to eighth connecting transistors TB5, TB6, TB7, and TB8 that operate in response to the corresponding fifth to eighth group signals GS5, GS6, GS7, and GS8, the fifth to seventh connecting transistors TB5, TB6, and TB7 are turned on, and the eighth connecting transistor TB8 is turned off.

[0150] As described above, the display device can drive the gaze focus area Z, the central area Y, and the peripheral area X at high, medium, and low resolutions respectively, thereby reducing latency. Furthermore, the reduced latency ensures stable performance of the external system's graphics processing device when applying foveated rendering technology.

[0151] Figure 16 This is a diagram illustrating data processing based on the user's eye gaze point in a display device according to an embodiment of the present disclosure. Figure 16 This demonstrates the operation of a horizontal line period.

[0152] refer to Figure 16 During the data enable period (Den), the controller 200 sequentially receives image data D1, D2, D3, D4, D5, D6, D7, D8 and D9 according to the video timing clock CLK input from the external system.

[0153] The controller 200 is configured to define the area of ​​the display panel as a gaze focus region, a central region, and a peripheral region based on gaze focus position information. In this regard, the input image is displayed at high resolution in the gaze focus region, at medium resolution in the central region, and at low resolution in the peripheral region.

[0154] The controller 200 is configured to generate data packet (DG) signals corresponding to each of the gaze focus area, the intermediate area, and the peripheral area, and to align image data based on the DG signals, and to transmit the aligned image data to the source driver D-IC of the data driver 400.

[0155] For example, controller 200 can be configured to transmit image data of the gaze-focused region to be driven at high resolution to the source driver D-IC in an unmodified manner. Controller 200 can be configured to group image data of the intermediate region to be driven at medium resolution on a two-line basis, process the image data, and transmit the processed image data to the source driver D-IC. Controller 200 can be configured to group image data of the peripheral region to be driven at low resolution on a four-line basis, process the image data, and transmit the processed image data to the source driver D-IC.

[0156] In one example, when the image data D3 and D4 of two lines are grouped together, the controller 200 can process the image data D3 and D4 into a single image data D3. Similarly, when the image data D5, D6, D7, and D8 of four lines are grouped together, the controller 200 can process the image data D5, D6, D7, and D8 into a single image data D5.

[0157] Image data that has completed image processing can be sequentially transmitted to the source driver D-IC, latched in the source driver D-IC, and simultaneously transmitted to the display panel for each horizontal line.

[0158] refer to Figure 16 The aforementioned terms "two lines" and "four lines" can refer to "two data lines" and "four data lines," respectively.

[0159] Figure 17 This is a block diagram illustrating a controller for a display device according to an embodiment of the present disclosure. Figure 18 This is a flowchart illustrating a method for controlling a display device according to an embodiment.

[0160] refer to Figure 17 and Figure 18In S11, the controller 200 analyzes image data and gaze point rendering information received from the graphics processing device 700 of the external system. The external system can use sensing information received from one or more sensors to generate gaze focus position information of the user's eyes and can provide the gaze focus position information to the display device.

[0161] In one aspect, the sensor used to generate sensing information can be any device configured to detect eye position, movement, or gaze direction. In some examples, the sensor can include an image-based device, such as an infrared or visible light camera, optionally used in conjunction with an illumination source. In other examples, the sensor can include an electrooculography (EOG) sensor with electrodes proximal to the eye, a scleral contact lens sensor with embedded elements, or a magnetic or inertial sensor for tracking orientation. In one or more examples, the sensor can include any optical, electromagnetic, or biosignal-based device capable of determining eye gaze.

[0162] In S12, controller 200 converts the grayscale data of the image data into luminance data, and in S13, determines whether foveation rendering information exists. If foveation rendering information is determined to exist, controller 200 sets the resolutions of the foveation focus area, the intermediate area, and the peripheral area defined based on the foveation rendering information to be different from each other. In S14, controller 200 calculates the luminance gain of the foveation focus area, the intermediate area, and the peripheral area.

[0163] In S15, controller 200 compensates for the variable brightness of each of the gaze focus area, the intermediate area, and the peripheral area, and in S16, converts the brightness data into grayscale data. In S17, controller 200 selects the scanning start point based on the user's eye gaze point, and in S18, generates gate control signals and data control signals corresponding to each of the gaze focus area, the intermediate area, and the peripheral area.

[0164] When it is determined that there is no foveated rendering information, the controller 200 calculates data and brightness gain based on the center area of ​​the display panel in S19, compensates for variable brightness in S20, and converts the brightness data into grayscale data in S21.

[0165] In S22, the controller 200 selects the first scan line as the scan start line, and in S23 generates the gate control signal and data control signal corresponding to each scan line.

[0166] The controller 200 generates information related to the gaze focus area, the central area, and the peripheral area based on the display resolution. Furthermore, because the display's gamma characteristics are taken into account when adjusting brightness, the controller 200 converts grayscale data into brightness data and selectively applies brightness compensation methods based on the gaze point rendering information.

[0167] When the brightness compensation is completed, the controller 200 converts the compensated brightness data into grayscale data again, defines the scan drive start point based on the foveation rendering information, changes the output timing of the image data according to the scan drive start point, and outputs the image data with the changed output timing.

[0168] In the scan-driven scheme, the user's gaze point and gaze point rendering information can be considered to select the scan-driven starting point, and the scan line can be driven in a sequential manner N+1, N+2, etc. and / or in a vertical alternating manner N+1, N-1, N+2 and N-2, etc., where N can be an integer.

[0169] The brightness compensation checking method will be described below. Brightness compensation can be checked via voltage data transmission between the gamma voltage generator 600 and the controller 200, and based on the presence or absence of changes in the output level of the gamma voltage generator 600. Optionally, brightness compensation can be checked based on brightness changes in the gaze tracking information area within the virtual reality (VR) environment. Optionally, brightness compensation can be checked based on the maximum brightness in the central area of ​​the display panel and brightness changes in the gaze tracking information area.

[0170] In one example, controller 200, power supply 500, gamma voltage generator 600, and connector 15 can be mounted on control board 11. Cables for electrically connecting the source driver D-ICs of controller 200 and data driver 400 to each other can be mounted on source board 12. The source driver D-IC of data driver 400 can be mounted on membrane 13. Display panel 100, GIP and demultiplexer, and ADC 16 can be mounted on panel 14.

[0171] In one or more examples, the controller may include one or more processors configured to execute instructions. The controller may also include memory for storing instructions and data, an interface for communicating with other components, and circuitry for generating control signals based on received data. The processor may include a microprocessor, a microcontroller, and / or a digital signal processor.

[0172] In one or more aspects, foveated rendering information can refer to data and / or parameters used by a graphics processing device to control rendering quality based on a user's gaze. In examples, foveated rendering information can specify one or more regions of an image, including a gaze-focused region, a central region, and a peripheral region. In one or more examples, foveated rendering information can include resolution, level of detail, shading rate, texture resolution, other rendering characteristics for each region, and / or a transition function that controls the gradual change in rendering quality from the gaze-focused region to the peripheral region.

[0173] In one or more examples, foveated rendering information may include dynamic parameters that adjust rendering behavior in response to real-time foveated data, user-specific calibration, and / or predicted eye movements. In one or more examples, it may also include control metadata for instructing timing, sequence, and / or grouping of scanline updates for different regions to improve rendering efficiency and reduce processing load on the graphics processing device. In one or more examples, foveated rendering information enables a graphics system to render a high-detail image that the user is viewing, while reducing detail in the central and peripheral regions to optimize computational resources without significant loss of visual quality.

[0174] In one aspect, unless the context explicitly indicates otherwise, an element may include multiple elements. For example, a gate control signal may include multiple gate control signals, and a data control signal may include multiple data control signals, unless the context explicitly indicates otherwise. For example, a scan signal may include multiple scan signals, and a data voltage may include multiple data voltages, unless the context explicitly indicates otherwise.

[0175] The term "scan start point" can sometimes be referred to as "scan drive start point," and vice versa.

[0176] A “subset” of an element (e.g., a subset of scan signals or a subset of data voltages) may include one element among the elements, or it may include multiple elements among the elements. For example, if an element includes a first element, a second element, and a third element, then a subset of the element may include one, some, or all of the first, second, and third elements. The terms “first subset of an element,” “second subset of an element,” “third subset of an element,” etc. (e.g., a first subset of scan signals, a second subset of scan signals, a third subset of scan signals, a first subset of data voltages, a second subset of data voltages, and a third subset of data voltages) are intended to identify a subset relative to another subset, and these are not used to define the nature, basis, order, or number of subsets or elements. In the example, a first subset may refer to a second subset, and similarly, a second subset may refer to a first subset. For clarity, the function or structure of these subsets (e.g., first subset, second subset, etc.) is not limited by the ordinal number or name preceding these subsets.

[0177] The following describes various examples and aspects of this disclosure. These are provided by way of example and do not limit the scope of this disclosure.

[0178] One or more aspects of this disclosure provide a display device comprising: a display panel configured to display an image; a data driver configured to provide a data voltage to the display panel; a gate driver configured to provide a scan signal to the display panel; and a controller configured to: select a gaze focus region as a scan drive start point based on the gaze focus position and gaze point rendering information, wherein the gaze focus region is the region focused by the user's gaze; and control the gate driver to first provide a first subset of scan signals to the gaze focus region serving as the scan drive start point.

[0179] In one or more examples, the controller is also configured to: divide a region of the display panel into a gaze focus region, a middle region, and a peripheral region based on the distance from the gaze focus position; and control the data driver and gate driver to drive the gaze focus region at full resolution, drive the middle region at medium resolution, and drive the peripheral region at low resolution, wherein the full resolution is higher than the medium resolution, and the medium resolution is higher than the low resolution.

[0180] In one or more examples, the controller is also configured to control the gate driver to output a first subset of the scan signal to the gaze focus region on a single scan line, a second subset of the scan signal to the intermediate region on a basis of at least two scan lines, and a third subset of the scan signal to the peripheral region on a basis of at least four scan lines.

[0181] In one or more examples, the controller is also configured to control the data driver to apply a first subset of the data voltage to the gaze focus region on a single pixel basis, a second subset of the data voltage to the intermediate region on a basis of at least two pixels, and a third subset of the data voltage to the peripheral region on a basis of at least four pixels.

[0182] In one or more examples, the controller is also configured to: calculate a luminance gain value for each of the gaze focus region, the intermediate region, and the peripheral region; and maintain the luminance of the gaze focus region, and based on the calculated luminance gain value, control the luminance of the intermediate region to be lower than the luminance of the gaze focus region, and control the luminance of the peripheral region to be lower than the luminance of the intermediate region.

[0183] In one or more examples, the controller is configured to adjust the gamma reference voltage of a gamma voltage generator configured to provide a gamma reference voltage to a data driver, thereby controlling the brightness of each of the gaze focus area, the intermediate area, and the peripheral area.

[0184] In one or more examples, the gate driver includes: a first logic circuit to a (N+1)th logic circuit, the first logic circuit to the (N+1)th logic circuit being configured to operate in response to a carry signal or a clock signal; a first enable transistor to a (N+1)th enable transistor, wherein the first electrodes of the first enable transistor to the Nth enable transistor are respectively connected to corresponding output terminals of the first logic circuit to the Nth logic circuit, and the second electrodes of the first enable transistor to the Nth enable transistor are respectively connected to corresponding input terminals of the second logic circuit to the (N+1)th logic circuit, the (N+1)th enable transistor having a second electrode; a first connection transistor to an Nth connection transistor, the first connection transistor to the Nth connection transistor respectively A first output circuit to a (N+1)th output circuit are connected to the respective second electrodes of the first to (N+1)th enable transistors and are respectively disposed between the respective second electrodes of the first to (N+1)th enable transistors; and a first output circuit to a (N+1)th output circuit are respectively connected to the respective second electrodes of the first to (N+1)th enable transistors, wherein each of the first to (N+1)th output circuits is configured to perform a pull-up or pull-down operation to output a corresponding scan signal among the first to (N+1)th scan signals, wherein the scan signal includes the first to (N+1)th scan signals, and wherein N is an integer.

[0185] In one or more examples, the first enable transistor to the (N+1)th enable transistor is configured to operate in response to the first group enable signal to the (N+1)th group enable signal, respectively, wherein the first connection transistor to the Nth connection transistor is configured to operate in response to the first group signal to the Nth group signal, respectively, wherein the first enable transistor to the (N+1)th enable transistor is configured to be selectively enabled based on the first group enable signal to the (N+1)th group enable signal, respectively, and the first connection transistor to the Nth connection transistor is configured to be selectively enabled based on the first group signal to the Nth group signal, thereby selectively grouping the first scan signal to the (N+1)th scan signal.

[0186] In one or more examples, the controller is also configured to include the first group enable signal to the (N+1)th group enable signal and the first group signal to the Nth group signal in the gate control signal, and to provide the gate control signal to the gate driver.

[0187] In one or more examples, the pulse width of the clock signal is determined based on the number of scan signals grouped together.

[0188] In one or more examples, the controller is configured to group the image data of each of the intermediate and peripheral regions, in addition to the gaze focus region, to align the grouped image data and transfer the aligned image data to the data driver.

[0189] In one or more examples, the controller is also configured to control the gate driver to first provide a first subset of scan signals to the gaze focus region in a sequential manner; and subsequently provide subsets of scan signals to each of the intermediate and peripheral regions other than the gaze focus region in a sequential and grouped manner.

[0190] In one or more examples, the controller is also configured to control the gate driver to first provide a first subset of scan signals to the gaze focus region in a sequential and vertically alternating manner; and subsequently provide a second subset of scan signals to the intermediate region in a sequential and grouped manner and vertically alternating manner, and a third subset of scan signals to the peripheral region, without providing the second and third subsets to the gaze focus region.

[0191] One or more aspects of this disclosure provide a display device, the display device comprising: a display panel, wherein a plurality of pixels are disposed in regions where data lines in a data line and scan lines in a scan line intersect each other, wherein the display device is configured to: select a gaze focus region as a scan drive start point on the display panel based on the focus position of a user's gaze; and firstly provide a first subset of scan signals to the gaze focus region via a first subset of the scan lines.

[0192] In one or more examples, the display device is further configured to: divide a region of the display panel into a gaze focus area, a middle area, and a peripheral area based on the gaze focus position; and drive the gaze focus area at full resolution, drive the middle area at medium resolution, and drive the peripheral area at low resolution, wherein the full resolution is higher than the medium resolution, and the medium resolution is higher than the low resolution.

[0193] In one or more examples, the display device is also configured to: sequentially drive the gaze focus area on a single scan line; and sequentially and in groups drive each of the intermediate and peripheral areas on a basis of at least two scan lines.

[0194] In one or more examples, the display device is further configured to: drive the gaze focus area sequentially and vertically alternately on a single scan line; and drive each of the intermediate and peripheral regions sequentially and in groups and vertically alternately on at least two scan lines.

[0195] In one or more examples, the display device is further configured to: apply a subset of data voltages to the gaze focus area on a single data line; and apply subsets of data voltages in groups to each of the intermediate and peripheral areas on at least two data lines.

[0196] In one or more examples, the display device is also configured to maintain the brightness of the gaze focus area and, based on image data, control the brightness of each of the central and peripheral areas to be lower than the brightness of the gaze focus area.

[0197] In one or more examples, the display device further includes a gate driver configured to sequentially drive scan lines and / or drive at least two scan lines in a grouped manner, wherein the gate driver includes: a first logic circuit to a (N+1)th logic circuit configured to operate in response to a carry signal or a clock signal; a first enable transistor to a (N+1)th enable transistor, wherein the first electrodes of the first enable transistor to the Nth enable transistor are respectively connected to corresponding output terminals of the first logic circuit to the Nth logic circuit, and the second electrodes of the first enable transistor to the Nth enable transistor are respectively connected to corresponding input terminals of the second logic circuit to the (N+1)th logic circuit, the (N+1)th enable transistor having a second electrode; a first connection transistor to The Nth connecting transistor, the first connecting transistor to the Nth connecting transistor are respectively connected to the corresponding second electrodes of the first enabling transistor to the (N+1)th enabling transistor, and are respectively disposed between the corresponding second electrodes of the first enabling transistor to the (N+1)th enabling transistor; and the first output circuit to the (N+1)th output circuit, the first output circuit to the (N+1)th output circuit are respectively connected to the corresponding second electrodes of the first enabling transistor to the (N+1)th enabling transistor, wherein each output circuit in the first output circuit to the (N+1)th output circuit is configured to perform a pull-up operation or a pull-down operation to output a corresponding scan signal among the first scan signal to the (N+1)th scan signal, wherein the scan signal includes the first scan signal to the (N+1)th scan signal, and wherein N is an integer.

[0198] One or more aspects of this disclosure provide a display device including: a plurality of pixels; data lines; and scan lines, wherein the data lines and scan lines intersect each other, and wherein the display device is configured to: select a gaze focus area on a display panel based on the gaze focus position; and first apply a first subset of data voltages to the gaze focus area via a first subset of the data lines.

[0199] In one or more examples, the display device further includes a data driver, wherein the data driver is configured to first apply a first subset of data voltages to the gaze focus area on a single data line, and then apply a second subset of data voltages to an intermediate area on a first plurality of data lines, and apply a third subset of data voltages to a peripheral area on a second plurality of data lines.

[0200] In one or more examples, the number of the first multiple data lines differs from the number of the second multiple data lines.

[0201] In one or more examples, the first plurality of data lines includes two data lines, and the second plurality of data lines includes four data lines.

[0202] In one or more examples, the data driver is configured to first apply a first subset of data voltages sequentially to the gaze focus region; and then apply subsets of data voltages sequentially and in groups to each of the intermediate and peripheral regions in addition to the gaze focus region.

[0203] In one or more examples, the data driver is configured to first apply a first subset of data voltage to the gaze focus region in a sequential and horizontally alternating manner; and then apply a second subset of data voltage to the middle region in a sequential and grouped manner and horizontally alternating manner, and apply a third subset of data voltage to the peripheral region, without applying the second and third subsets of data voltage to the gaze focus region.

[0204] In one or more examples, the data driver is configured to sequentially apply a first subset of data voltages to the gaze focus region on a single scan line basis; and to apply subsets of data voltages sequentially and in groups to each of the intermediate and peripheral regions on a basis of at least two data lines.

[0205] Although some embodiments of the present disclosure have been described above with reference to the accompanying drawings, the present disclosure is not limited to these embodiments and can be implemented in various different forms. Those skilled in the art to which this disclosure pertains will understand that the present disclosure can be implemented in other specific forms without altering the technical concept or essential characteristics of the present disclosure. Therefore, it should be understood that the embodiments described above are not limiting in all respects but rather illustrative.

Claims

1. A display device, comprising: Display panel, the display panel being configured to display images; A data driver configured to provide data voltage to the display panel; A gate driver configured to provide a scan signal to the display panel; as well as The controller is configured to: The gaze focus area is selected as the scan drive start point based on the gaze focus position and gaze point rendering information, wherein the gaze focus area is the area focused by the user's gaze. as well as The gate driver is controlled to first provide a first subset of the scan signal to the gaze focusing region, which serves as the starting point of the scan drive.

2. The display device according to claim 1, wherein The controller is also configured to: The display panel area is divided into the focusing area, the middle area, and the peripheral area based on the distance from the focusing position of the gaze; as well as The data driver and the gate driver are controlled to drive the gaze focusing region at full resolution, the intermediate region at medium resolution, and the peripheral region at low resolution. The full resolution is higher than the medium resolution, and the medium resolution is higher than the low resolution.

3. The display device of claim 2, wherein, The controller is also configured to control the gate driver to output a first subset of the scan signal to the gaze focusing region on a single scan line, a second subset of the scan signal to the intermediate region on a basis of at least two scan lines, and a third subset of the scan signal to the peripheral region on a basis of at least four scan lines.

4. The display device according to claim 3, wherein The controller is also configured to control the data driver to apply a first subset of the data voltage to the gaze focus region on a single pixel basis, a second subset of the data voltage to the intermediate region on a basis of at least two pixels, and a third subset of the data voltage to the peripheral region on a basis of at least four pixels.

5. The display device according to claim 2, wherein The controller is also configured to: Calculate the luminance gain value for each of the gaze focus area, the middle area, and the peripheral area; as well as Maintain the brightness of the gaze focus area, and based on the calculated brightness gain value, control the brightness of the middle area to be lower than the brightness of the gaze focus area, and control the brightness of the outer area to be lower than the brightness of the middle area.

6. The display device of claim 5, wherein, The controller is configured to adjust the gamma reference voltage of a gamma voltage generator configured to provide a gamma reference voltage to the data driver, thereby controlling the brightness of each of the gaze focus area, the intermediate area, and the peripheral area.

7. The display device according to claim 1, wherein The gate driver includes: The first logic circuit to the (N+1)th logic circuit are configured to operate in response to a carry signal or a clock signal; The first enable transistor to the (N+1)th enable transistor, wherein the first electrodes of the first enable transistor to the Nth enable transistor are respectively connected to the corresponding output terminals of the first logic circuit to the Nth logic circuit, and the second electrodes of the first enable transistor to the Nth enable transistor are respectively connected to the corresponding input terminals of the second logic circuit to the (N+1)th logic circuit, and the (N+1)th enable transistor has a second electrode. A first connecting transistor to a Nth connecting transistor, wherein the first connecting transistor to the Nth connecting transistor are respectively connected to the corresponding second electrodes of the first enabling transistor to the (N+1)th enabling transistor, and are respectively disposed between the corresponding second electrodes of the first enabling transistor to the (N+1)th enabling transistor; and The first output circuit to the (N+1)th output circuit are respectively connected to the corresponding second electrode of the first enable transistor to the (N+1)th enable transistor, wherein each of the first output circuits to the (N+1)th output circuit is configured to perform a pull-up operation or a pull-down operation to output a corresponding scan signal among the first scan signal to the (N+1)th scan signal. Wherein, the scanning signal includes the first scanning signal to the (N+1)th scanning signal, and Where N is an integer.

8. The display device of claim 7, wherein, The first enabling transistor through the (N+1)th enabling transistor are configured to operate in response to the first group enabling signal through the (N+1)th group enabling signal, respectively. Wherein, the first to the Nth connection transistors are configured to operate in response to the first to the Nth packet signals, respectively, and The first enabling transistor to the (N+1)th enabling transistor is configured to be selectively enabled based on the first grouping enable signal to the (N+1)th grouping enable signal, and the first connecting transistor to the Nth connecting transistor is selectively enabled based on the first grouping signal to the Nth grouping signal, thereby selectively grouping the first scan signal to the (N+1)th scan signal.

9. The display device of claim 8, wherein, The controller is also configured to include the first group enable signal to the (N+1)th group enable signal and the first group signal to the Nth group signal in the gate control signal, and to provide the gate control signal to the gate driver.

10. The display device of claim 7, wherein, The pulse width of the clock signal is determined based on the number of scan signals grouped together.

11. The display device according to claim 1, wherein, The controller is configured to group the image data of each of the intermediate and peripheral regions, in addition to the gaze focus region, to align the grouped image data, and to transmit the aligned image data to the data driver.

12. The display device according to claim 1, wherein, The controller is also configured to control the gate driver: First, a first subset of the scanning signal is provided to the gaze focus area in a sequential manner; as well as Subsequently, a subset of the scan signal is provided sequentially and in groups to each of the intermediate and peripheral regions, excluding the gaze focus area.

13. The display device according to claim 1, wherein, The controller is also configured to control the gate driver: First, a first subset of the scanning signal is provided to the gaze focus area in a sequential and vertically alternating manner; as well as Subsequently, a second subset of the scan signal is provided to the central region in a sequential and grouped manner, and a third subset of the scan signal is provided to the peripheral region, without providing the second subset and the third subset to the gaze focus area.

14. A display device, comprising: The display panel contains multiple pixels positioned in the areas where the data lines and scan lines intersect. The display device is configured as follows: The user's gaze focus area is selected as the scan drive start point on the display panel based on the user's gaze focus position; and First, a first subset of the scanning signal is provided to the gaze focus area via a first subset of the scanning lines.

15. The display device according to claim 14, wherein, The display device is further configured to: The display panel area is divided into the gaze focus area, the middle area, and the outer area based on the gaze focus position; as well as The gaze focus area is driven at full resolution, the central area at medium resolution, and the peripheral area at low resolution. The full resolution is higher than the medium resolution, and the medium resolution is higher than the low resolution.

16. The display device according to claim 15, wherein, The display device is further configured to: The gaze focusing area is driven sequentially based on a single scan line; as well as Each of the intermediate region and the peripheral region is driven sequentially and in groups based on at least two scan lines.

17. The display device according to claim 15, wherein, The display device is further configured to: The gaze focus area is driven sequentially and in a vertically alternating manner based on a single scan line; as well as Each of the intermediate region and the peripheral region is driven sequentially and in groups, and in a vertically alternating manner, based on at least two scan lines.

18. The display device according to claim 15, wherein, The display device is further configured to: A subset of the data voltage is applied to the gaze focus area based on a single data line; as well as A subset of the data voltage is applied in groups to each of the intermediate region and the peripheral region, based on at least two data lines.

19. The display device according to claim 15, wherein, The display device is also configured to maintain the brightness of the gaze focus area and, based on image data, control the brightness of each of the central area and the peripheral area to be lower than the brightness of the gaze focus area.

20. The display device according to claim 14, wherein, The display device further includes a gate driver, which is configured to sequentially drive the scan lines, drive at least two scan lines in a grouped manner, or drive the scan lines sequentially and drive at least two scan lines in a grouped manner. The gate driver includes: The first logic circuit to the (N+1)th logic circuit are configured to operate in response to a carry signal or a clock signal; The first enable transistor to the (N+1)th enable transistor, wherein the first electrodes of the first enable transistor to the Nth enable transistor are respectively connected to the corresponding output terminals of the first logic circuit to the Nth logic circuit, and the second electrodes of the first enable transistor to the Nth enable transistor are respectively connected to the corresponding input terminals of the second logic circuit to the (N+1)th logic circuit, and the (N+1)th enable transistor has a second electrode. A first connecting transistor to a Nth connecting transistor, wherein the first connecting transistor to the Nth connecting transistor are respectively connected to the corresponding second electrodes of the first enabling transistor to the (N+1)th enabling transistor, and are respectively disposed between the corresponding second electrodes of the first enabling transistor to the (N+1)th enabling transistor; and The first output circuit to the (N+1)th output circuit are respectively connected to the corresponding second electrode of the first enable transistor to the (N+1)th enable transistor, wherein each of the first output circuits to the (N+1)th output circuit is configured to perform a pull-up operation or a pull-down operation to output a corresponding scan signal among the first scan signal to the (N+1)th scan signal. Wherein, the scanning signal includes the first scanning signal to the (N+1)th scanning signal, and Where N is an integer.

Images