Display module and method of controlling display panel

Abstract

The invention relates to a display module and a method of controlling a display panel. The display module includes: a display panel including a display area for displaying an image; a lens unit disposed on the display area; an image generator receiving visual sensing data from the outside by sensing an eye of a user, the image generator identifying a reference area on the display area based on parameter data and the visual sensing data, the image generator generates a converted image by adjusting a gray level of a target region adjacent to the reference region in an input image; and a controller for controlling the display panel based on the converted image. An image generator determines a size of the reference region according to the parameter data.

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the priority of Korean Patent Application No. 10-2023-0084441 filed in the Korean Intellectual Property Office on June 29, 2023, the disclosure of which is incorporated herein by reference in its entirety. Technical Field

[0003] The present disclosure generally relates to a display module, and more particularly, to a display module, a display device including the display module, and a method of controlling a display panel. Background Art

[0004] The display device includes a display panel and a driver. The display panel may display an image in a display area corresponding to a signal provided from a driver.

[0005] Meanwhile, when a user views an image displayed in a display area by using a display device, an area (e.g., a visible area or a cognitive area) visually recognized by the user (or focused on by the user) in the display area according to the user's line of sight or viewing angle, etc. may vary for each user or each viewing environment. When the display device displays an image with the same brightness in the visible area and in an area other than the visible area, unnecessary power consumption may occur in the area other than the visible area.

[0006] The above information disclosed in this related background section is only for enhancement of understanding of the background of the present disclosure and therefore, the above information disclosed in this related background section may contain information that does not form the prior art that is already known to a person of ordinary skill in the art. Summary of the invention

[0007] Embodiments provide a display module capable of operating with reduced power consumption, a display device including the display module, and a method of controlling a display panel.

[0008] According to one aspect of the present disclosure, a display module is provided, the display module comprising a display panel, a lens unit, an image generator and a controller. The display panel comprises a display area for displaying an image. The lens unit is arranged on the display area. The image generator is configured to receive visual sensing data from the outside by sensing the eyes of a user, the image generator identifies a reference area on the display area based on parameter data and the visual sensing data, and the image generator generates a converted image by adjusting the grayscale level of a target area adjacent to the reference area in an input image. The controller is configured to control the display panel based on the converted image, wherein the image generator is configured to determine the size of the reference area according to the parameter data.

[0009] The grayscale level of the target area in the converted image may be lower than the grayscale level of the target area in the input image.

[0010] The image generator may be configured to extract a reference position corresponding to a line of sight of the eyes of the user on the display area according to the visual sensing data, and the image generator identifies an area adjacent to the reference position as the reference area.

[0011] The image generator may include a coordinate generator, an image processor, and a grayscale converter. The coordinate generator is configured to determine a viewpoint coordinate on the display area corresponding to the user's line of sight based on the visual sensing data. The image processor is configured to identify the reference area on the display area based on the determined viewpoint coordinates and the parameter data, and the image processor generates gain mapping data including a gain value corresponding to the grayscale of the target area in the input image based on the reference area. The grayscale converter is configured to generate the converted image from the input image based on the gain value corresponding to the grayscale of the target area in the input image.

[0012] The controller may further include a storage medium configured to store the parameter data.

[0013] The lens unit may allow the image displayed by the display area to pass through the lens unit so that brightness of the image expressed by the lens unit is uniformly perceived by the user.

[0014] The parametric data may be provided based on the field of view and pixels per degree of the image rendered by the lens unit.

[0015] The parameter data may be provided based on a maximum brightness of the image displayed by the display panel.

[0016] The visual sensing data may be generated from each of a first frame and a second frame subsequent to the first frame. The image generator may generate the converted image corresponding to the first frame based on the visual sensing data generated in the first frame, and the image generator may generate the converted image corresponding to the second frame based on the visual sensing data generated in the second frame.

[0017] According to one aspect of the present disclosure, a display device is provided, the display device comprising a display module, a visual sensor and an image generator. The display module comprises a display panel and a lens unit, the display panel comprises a display area for displaying an image, and the lens unit is arranged on the display area. The visual sensor is configured to generate visual sensing data by sensing the eyes of a user. The image generator is configured to: identify a reference area on the display area based on parameter data and the visual sensing data, and generate a converted image by adjusting the grayscale level of a target area adjacent to the reference area in an input image. The display module controls the display panel based on the converted image, and the image generator is configured to determine the size of the reference area according to the parameter data.

[0018] The grayscale level of the target area in the converted image may be lower than the grayscale level of the target area in the input image.

[0019] The display device may further comprise a memory device configured to store the parameter data.

[0020] According to one aspect of the present disclosure, there is provided a method for controlling a display panel, the display panel comprising a lens unit and a display area arranged to overlap the lens unit. The method comprises: generating visual sensing data by sensing eyes of a user; identifying a reference area on the display area based on parameter data and the visual sensing data, and generating a converted image by adjusting the grayscale level of a target area adjacent to the reference area in an input image; and controlling the display panel based on the converted image. The size of the reference area is determined according to the parameter data.

[0021] The method may also include: determining viewpoint coordinates on the display area corresponding to the user's line of sight based on the visual sensing data; identifying the reference area on the display area based on the determined viewpoint coordinates and the parameter data; generating gain mapping data based on the identified reference area, the gain mapping data including a gain value corresponding to the grayscale level of the target area in the input image; and generating the converted image from the input image based on the gain value corresponding to the grayscale level of the target area in the input image. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Example embodiments will now be described more fully hereinafter with reference to the accompanying drawings; however, they may be implemented in different forms and should not be construed as limited to the embodiments set forth herein. Rather, these embodiments are provided so that this disclosure will be thorough and complete and will fully convey the scope of the example embodiments to those skilled in the art.

[0023] In the accompanying drawings, dimensions may be exaggerated for clarity of illustration. It will be understood that when an element is referred to as being "between" two elements, the element may be the only element between the two elements, or one or more intervening elements may also be present. The same reference numerals always represent the same elements.

[0024] Figure 1 is a perspective view showing an embodiment of a head mounted display device.

[0025] Figure 2 is a block diagram showing a head mounted display device according to an embodiment of the present disclosure.

[0026] Figure 3 It is shown Figure 2 0036] A cross-sectional view of an embodiment of a display module is shown in FIG.

[0027] Figure 4 It is shown Figure 2 A block diagram of an embodiment of a display module is shown in FIG.

[0028] Figure 5 is a conceptual illustration of the storage Figure 4 FIG. 4 is a diagram of an embodiment of a parameter data table in a storage medium shown in FIG.

[0029] Figure 6 It is shown Figure 4 A block diagram of an embodiment of an image generator is shown in FIG.

[0030] Figure 7 , Figure 8 and Fig. 9 It is shown that the Figure 6 0047 is a view of an example of the operation of a coordinate generator in an image generator shown in .

[0031] Fig.10 It is shown Figure 6 A view of an example of the operation of the image generator shown in FIG.

[0032] Fig.11 It shows that when Fig.10 A view of an example of a display area when the grayscale level is reduced compared to a target area.

[0033] Fig.12 It shows that Fig.10 When the coordinates of the first viewpoint shown in Figure 6 A view of the operation of the image generator shown in FIG.

[0034] Fig.13 It shows that when Fig.12 A view of an example of a display area when the grayscale level is reduced compared to a target area.

[0035] Fig.14 is a block diagram illustrating an embodiment of a head mounted display device.

[0036] Fig.15 and Fig.16 is a flowchart illustrating a method of operating a display module and a display device according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0037] Hereinafter, embodiments of the present disclosure will be described in more detail with reference to the accompanying drawings. In the following description, only the parts necessary for understanding the operation according to the present disclosure are described, and the description of other parts is omitted so as not to unnecessarily obscure the subject matter of the present disclosure. In addition, the present disclosure is not limited to the exemplary embodiments described herein, but can be implemented in various different forms. On the contrary, the exemplary embodiments described herein are provided to describe the disclosed content in detail and completely, and to fully convey the ideas of the present disclosure to those of ordinary skill in the art.

[0038] Throughout the specification, when an element is referred to as "connected" or "coupled" to another element, the element may be directly connected or directly coupled to the other element, or indirectly connected or indirectly coupled to the other element, with one or more intermediate elements between the element and the other element. The technical terms used in this article are only for the purpose of illustrating a specific embodiment, and are not intended to limit the embodiment. It will be understood that when a component "includes" an element, unless there is another description to the contrary, it will be understood that the component does not exclude another element, but may further include another element. It will be understood that, for the purpose of this disclosure, "at least one of X, Y and Z" can be interpreted as only X, only Y, only Z or any combination of two or more items X, Y and Z (e.g., XYZ, XY, YZ, XZ). Similarly, for the purpose of this disclosure, "at least one selected from the group consisting of X, Y and Z" can be interpreted as only X, only Y, only Z or any combination of two or more items X, Y and Z (e.g., XYZ, XY, YZ, XZ).

[0039] It will be understood that although the terms "first", "second", etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. Therefore, without departing from the teachings of the present disclosure, the "first" element discussed below may also be referred to as the "second" element.

[0040] For ease of description, spatially relative terms (such as, "below" and "above", etc.) may be used herein to describe the relationship of one element to another element as shown in the accompanying drawings. It will be understood that, in addition to the orientations described herein and depicted in the accompanying drawings, the spatially relative terms and the configurations (configurations) shown are also intended to include different orientations of the device in use or operation. For example, if the device in the accompanying drawings is flipped, the elements described as "below" or "below" other elements or features will subsequently be oriented as "above" other elements or features. Therefore, the exemplary term "above" can include both above and below orientations. The device can be oriented in other ways (e.g., rotated 90 degrees or in other orientations), and the spatially relative descriptors used in this article are interpreted accordingly.

[0041] In addition, embodiments of the present disclosure are described herein with reference to schematic diagrams of idealized embodiments (and intermediate structures) of the present disclosure, such that variations in the shapes shown due to, for example, manufacturing techniques and / or tolerances are anticipated. Thus, embodiments of the present disclosure should not be limited to the particular shapes of the regions shown herein, but rather include deviations in shapes due to, for example, manufacturing techniques. The regions shown in the drawings are schematic in nature, and the shapes of these regions do not represent the actual shapes of the regions of the device and do not limit the scope of the present disclosure.

[0042] Figure 1 is a perspective view showing an embodiment of a head mounted display device HMD.

[0043] Reference Figure 1 The head mounted display device HMD may include a display module DM, a housing HS, and a mounting portion MT. The head mounted display device HMD may be mounted on a user's head to provide image information to the user.

[0044] The display module DM can display an image based on the image signal. The display module DM can provide images to the left eye and right eye of the user respectively. The left eye image corresponding to the left eye of the user and the right eye image corresponding to the right eye of the user can be the same or different from each other. The head-mounted display device HMD can provide 2D images, 3D images, virtual reality images, 360-degree panoramic images, etc. through the display module DM. The display module DM may include at least one of a liquid crystal display (LCD), an organic light emitting display (OLED), an inorganic light emitting display, and a flexible display. The display module DM may be built in the housing HS or coupled to the housing HS. The display module DM may receive commands through an interface unit provided in the housing HS, etc.

[0045] The housing HS may be located in front of the user's eyes. Components for operating the head mounted display device HMD may be housed in the housing HS. These components will be referred to as Figure 2 Describe in detail.

[0046] The housing HS may include a wireless communication unit and an interface unit, etc. The wireless communication unit may perform wireless communication with an external terminal, thereby receiving an image signal from the external terminal. For example, the wireless communication unit may communicate with an external terminal using Bluetooth, radio frequency identification (RFID), infrared data association (IrDA), ZigBee, near field communication (NFC), wireless fidelity (Wi-Fi), and ultra-wideband (UWB). The interface unit may connect the head-mounted display device HMD to an external device. For example, the interface unit of the head-mounted display device HMD may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory card port, a port for connecting a device provided with an identification module, an audio input / output (I / O) port, a video I / O port, and at least one of a headphone port.

[0047] The mounting portion MT may be connected to the housing HS to allow the head mounted display device HMD to be fixed to the user's head. For example, the mounting portion MT may be implemented as a belt or an elastic band or the like.

[0048] exist Figure 1 , a head mounted display device HMD is exemplarily shown. However, the embodiment is not limited thereto and may be applied to various types of display devices including the display module DM.

[0049] Figure 2 is a block diagram showing a head mounted display device HMD according to an embodiment of the present disclosure.

[0050] Reference Figure 2 The head mounted display device HMD may include a processor PRC, a memory device MEM, an input / output device IO, a power supply PS, a sensing device SD, a display module DM and a visual sensor VS.

[0051] The processor PRC can perform specific calculations or tasks. The processor PRC can control the overall operation of the head-mounted display device HMD. The processor PRC can process signals and data information input through the input / output device IO, or execute an application stored in the memory device MEM to provide appropriate information or functions to the user by processing the signals and data information. In an embodiment, the processor PRC can be a microprocessor, a central processing unit (CPU), a graphics processing unit (GPU), an application processor (AP) or a communication processor (CP), etc. The processor PRC can be connected to other components via an address bus, a control bus, and a data bus. In addition, the processor PRC can also be connected to an expansion bus (such as a peripheral component interconnect (PCI) bus).

[0052] The memory device MEM may store data required for the operation of the electronic device. The memory device MEM may store a plurality of applications executed in the head mounted display device HMD, data and commands for the operation of the head mounted display device HMD, and the like. At least some of the applications may be downloaded from an external server through the input / output device IO. For example, the memory device MEM may include a volatile memory device (such as a dynamic random access memory (DRAM), a static random access memory (SRAM), or a mobile DRAM) and / or a non-volatile memory device (such as an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a flash memory, a phase change random access memory (PRAM), a resistive random access memory (RRAM), a magnetic random access memory (MRAM), or a ferroelectric random access memory (FRAM)).

[0053] The input / output device IO may include an input device including a camera or an image input unit for inputting an image signal, a microphone or an audio input unit for inputting an audio signal, and a user input unit for receiving information from a user (e.g., a touch key, a press key, a joystick or a wheel key, etc.). The input / output device IO may also include an output device for generating an output signal related to vision, hearing, or touch, etc., including an audio output unit, a tactile module, and an optical output unit, etc. The display module DM may be provided in the input / output device IO.

[0054] The power supply PS may supply power required for the operation of the head mounted display device HMD. The power supply PS may be applied with an external power supply and an internal power supply to supply power to each of the components included in the head mounted display device HMD. The power supply PS may include a battery, and the battery may be implemented as an embedded battery or a replaceable battery.

[0055] The sensing device SD may include at least one sensor for sensing peripheral environment information around the head mounted display device HMD, user information, etc. For example, the sensing device SD may include a velocity sensor, an acceleration sensor, a gravity sensor, an illumination sensor, a motion sensor, a fingerprint recognition sensor, an optical sensor, an ultrasonic sensor, a thermal sensor, etc.

[0056] The display module DM can be connected to other components through a bus or other communication links. The display module DM can display information processed by the head mounted display device HMD.

[0057] The visual sensor VS may include a camera for photographing the user's eyes. The visual sensor VS may acquire an image corresponding to the photographed user's eyes. For example, the visual sensor VS may include an infrared camera using a bright pupil method or an infrared camera using a dark pupil method. In the bright pupil method, the visual sensor VS (or infrared camera) may acquire an image corresponding to the user's eyes in the following manner: by irradiating light (infrared light) parallel to the central axis of the pupil at a predetermined distance from the user's eyes as a detection target to illuminate the center of the pupil of the user's eyes, and detecting the light reflected from the retina of the user's eyes. In the dark pupil method, the visual sensor VS (or infrared camera) may acquire an image corresponding to the user's eyes in the following manner: by irradiating light (infrared light) at a predetermined angle to the central axis of the pupil of the user's eyes as a detection target to enable the center of the pupil of the user's eyes to be darker than the iris of the user's eyes, and detecting the light reflected from the retina of the user's eyes. However, the embodiments of the present disclosure are not limited thereto, and the visual sensor VS may include both an infrared camera using a bright pupil method and an infrared camera using a dark pupil method.

[0058] The visual sensor VS can generate visual sensing data VSD based on the acquired image (see, for example, Figure 4 ). The generated visual sensing data VSD may be transmitted to the display module DM.

[0059] Figure 3 It is shown Figure 2 A cross-sectional view of an embodiment of a display module DM is shown in FIG.

[0060] Reference Figure 3 , the display module DM may include a display panel DP, a first lens unit LU1, a light screen LSC and a second lens unit LU2.

[0061] The display panel DP may display an image in the display area DA based on the data signal. In an embodiment, the display panel DP may include a first sub-display area and a second sub-display area as the display area DA. For example, when the display module DM includes a reference Figure 1 and Figure 2 In the described head mounted display device HMD, the display panel DP may include a first sub display area for displaying a left eye image and a second sub display area for displaying a right eye image, so as to provide images to the left eye and the right eye of the user US, respectively.

[0062] The first lens unit LU1 may include a microlens array MLA and a thin film layer TF. The first lens unit LU1 may provide a natural image to the user US through the microlens array MLA. For example, when the display panel DP is formed as a flat panel, the display panel DP may display a distorted image. The microlens array MLA may correct the distortion by performing inverse distortion on the image of the display panel DP. Therefore, the display module DM may provide a natural image to the user US.

[0063] The thin film layer TF may support the micro lens array MLA. The thin film layer TF may be made of polycarbonate (PC) or polymethyl methacrylate (PMMA), etc. However, the material is not limited thereto as long as the material has a high light transmittance to effectively transmit the light of the image passing through the thin film layer TF to the user US.

[0064] The light screen LSC may be disposed between the first lens unit LU1 and the second lens unit LU2. The light screen LSC may be disposed at a right angle relative to the first lens unit LU1. For example, a plane on which the light screen LSC is located (e.g., a plane parallel to the first direction D1) may be perpendicular to a plane on which the first lens unit LU1 is located (e.g., a plane parallel to the second direction D2 and the third direction D3).

[0065] The light screen LSC is configured so that the light beam representing the 3D virtual image can be projected along a pre-designed path. Therefore, it is possible to prevent crosstalk from being caused when the light beam is projected onto the user's eyes. For example, the light screen LSC can project only the light field image to be projected onto the left eye onto the left eye. Similarly, the light screen LSC can project only the light field image to be projected onto the right eye onto the right eye. The light field image can be an image projected onto the eye of the user US through the first lens unit LU1. Therefore, the light screen LSC prevents crosstalk, thereby ensuring optimal image quality.

[0066] The second lens unit LU2 may allow light from the display area DA to pass through the second lens unit LU2 so that the brightness of the image is uniformly perceived by the user US. For example, the light from the display area DA may be inversely distorted by the first lens unit LU1 to mostly travel in a straight line in the first direction D1. Therefore, the brightness of the image that passes only through the first lens unit LU1 may not be uniformly perceived by the user US. For example, the brightness of the image within a range in which the field of view (FOV) is large may be perceived by the user US as dark. The brightness of the image that passes through the second lens unit LU2 may be uniformly perceived by the user US in a specific FOV.

[0067] The second lens unit LU2 may include a left eye lens LEL corresponding to the left eye of the user US and a right eye lens REL corresponding to the right eye of the user US. The FOV and the pixel per degree (PPD) of the display module DM may vary according to the left eye lens LEL and the right eye lens REL included in the second lens unit LU2. For example, the FOV of the image provided to the user US may be increased by the left eye lens LEL and the right eye lens REL included in the second lens unit LU2. Since a larger number of pixels are included in the field of view of the user US, the PPD may be increased. Therefore, the user may view a clearer image in the set FOV.

[0068] As such, the FOV and the PPD of the display module DM may be changed according to the first lens unit LU1 and the second lens unit LU2 disposed on the display area DA.

[0069] Figure 4 It is shown Figure 2 A block diagram of an embodiment of a display module DM is shown in FIG.

[0070] Reference Figure 4 , the display module DM may include a display panel DP, a controller 100, a scan driver 200, and a data driver 300. The present disclosure is not limited thereto, and in another embodiment, the display module DM may include a display panel DP, a controller 100, an image generator 120, a scan driver 200, and a data driver 300, and the controller 100 may include a storage medium 110 and a timing controller 130.

[0071] The display panel DP may include a plurality of scan lines SL1, SL2, . . . and SLn (where n is an integer greater than 0), a plurality of data lines DL1, DL2, . . . and DLm (where m is an integer greater than 0), and a plurality of pixels PX.

[0072] Each of the pixels PX may be connected to at least one of the scan lines SL1 to SLn and at least one of the data lines DL1 to DLm. The pixel PX may emit light of a brightness corresponding to a data signal provided by a corresponding data line in response to a scan signal provided by a corresponding scan line. At the same time, the pixel PX may be supplied with a voltage of a first power source VDD and a voltage of a second power source VSS. For example, the display module DM may further include a voltage generator for providing a voltage of a first power source VDD and a voltage of a second power source VSS. The voltage of the first power source VDD and the voltage of the second power source VSS are voltages required for the operation of the pixel PX. For example, the first power source VDD may have a voltage level higher than a voltage level of the second power source VSS.

[0073] Each of the pixels PX may include a light emitting element and a pixel driving circuit connected to the light emitting element. For example, the light emitting element may be configured as an organic light emitting diode or an inorganic light emitting diode, such as a micro light emitting diode (LED) or a quantum dot light emitting diode. In addition, the light emitting element may be a light emitting element configured using a combination of organic materials and inorganic materials. In an embodiment, each of the pixels PX may include a single light emitting element. In an embodiment, each of the pixels PX may include a plurality of light emitting elements, and the plurality of light emitting elements may be connected in series, in parallel, or in series / parallel to each other.

[0074] The controller 100 may include a storage medium 110 , an image generator 120 , and a timing controller 130 .

[0075] The storage medium 110 may store the parameter data table PDT in advance. For example, the parameter data table PDT may be stored in the storage medium 110 during the manufacturing process of the display module DM. Figure 3 Before the display panel DP shown in FIG. 1 is coupled to the first lens unit LU1 and the second lens unit LU2, the parameter data table PDT may be stored in the storage medium 110. In another example, in a test phase after the head mounted display device HMD is manufactured, the parameter data table PDT may be stored in the storage medium 110. The stored parameter data table PDT may be transmitted to the image generator 120.

[0076] In an embodiment, the storage medium 110 may include a non-volatile memory device such as an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), flash memory, phase change random access memory (PRAM), resistive random access memory (RRAM), magnetic random access memory (MRAM), or ferroelectric random access memory (FRAM).

[0077] The image generator 120 may receive the identifier IDFR from the outside. For example, when the head mounted display device HMD is powered on, an external host (such as Figure 2 The processor PRC shown in FIG. 1 may provide the identifier IDFR to the controller 100 of the display module DM. The provided identifier IDFR may be provided to the image generator 120.

[0078] The image generator 120 may be configured from Figure 2 The visual sensor VS shown in FIG. 1 receives visual sensing data VSD. For example, the visual sensing data VSD may include the user US (see FIG. 1 ) Figure 3 )'s eyes.

[0079] In addition, the image generator 120 can be obtained from the processor PRC (see, for example, Figure 2 ) receives an input image IMG1. The input image IMG1 may include a stream of multiple frames. Each of the multiple frames may include a data pixel corresponding to a pixel PX of the display panel DP, and each of the data pixels may include at least one grayscale.

[0080] In addition, the image generator 120 may generate the converted image IMG2 by adjusting the grayscale in the partial area of ​​the input image IMG1 based on the received identifier IDFR, the received visual sensing data VSD, and the received parameter data table PDT. The image generator 120 may transmit the generated converted image IMG2 to the timing controller 130.

[0081] Figure 2 The head mounted display device HMD shown in FIG. 1 is operated after the head mounted display device HMD is mounted on the head of the user, and therefore, Figure 3 The distance between the display module DM (or display panel DP) shown in FIG. 1 and the eyes of the user US may be relatively short. In addition, since the viewing range of the user US is restricted, the user US may not be able to visually recognize the entire display area DA. For example, the display area DA may include an area that is not visually recognized by the user US and / or an area that is recognized by the user with a visually lower stimulation than another area.

[0082] Therefore, when the user US views the image displayed in the display area DA of the display module DM, the display area DA may be divided into a visible area visually recognized by the user US and a non-visible area according to the line of sight and viewing range of the user US. The non-visible area may mean an area that is not visually recognized by the user US or an area that is recognized by the user with a visually lower stimulation than another area. The non-visible area may correspond to an area other than the visible area in the display area DA. Since the image displayed in the non-visible area is not recognized by the user US (or is relatively less recognized), when the display module DM (or display panel DP) displays an image in the non-visible area with the same brightness as the visible area, unnecessary power consumption may occur in the non-visible area.

[0083] According to an embodiment of the present disclosure, the image generator 120 can generate a converted image IMG2 by adjusting the grayscale in a partial area of ​​the input image IMG1 based on the received identifier IDFR, the received visual sensing data VSD, and the received parameter data table PDT. For example, the image generator 120 can extract visual information about the line of sight of the user US and the viewing range of the user US based on the visual sensing data VSD, and determine the visible area and the non-visible area in the display area DA based on the visual information. The image generator 120 can generate the converted image IMG2 by adjusting (e.g., reducing) the grayscale of the data pixels corresponding to the area at the periphery of the visible area in the input image IMG1. For example, the image generator 120 can generate the converted image IMG2 by adjusting the grayscale of the data pixels of the non-visible area in the input image IMG1. Therefore, the display module DM can minimize or at least reduce power consumption without degrading the visibility felt by the user US.

[0084] The timing controller 130 may receive a signal from an external processor (eg, Figure 2 The processor PRC shown in FIG. 1 receives a control signal CS. The control signal CS may include a horizontal synchronization signal, a vertical synchronization signal, a clock signal, etc. The timing controller 130 may generate a first control signal SCS and a second control signal DCS based on the control signal CS. The first control signal SCS may be provided to the scan driver 200, and the second control signal DCS may be provided to the data driver 300.

[0085] In addition, the timing controller 130 may generate the image data DATA based on the converted image IMG2 provided from the image generator 120 .

[0086] At the same time, Figure 4 , it is shown that the image generator 120 and the timing controller 130 are components separated from each other. However, this is only illustrative, and the image generator 120 may be included in the timing controller 130. For example, the image generator 120 may be implemented in a form in which the image generator 120 is built in the timing controller 130.

[0087] The scan driver 200 may receive a first control signal SCS from the timing controller 130 and provide scan signals to the scan lines SL1 to SLn based on the first control signal SCS. For example, the scan signals may be sequentially supplied to the scan lines SL1 to SLn.

[0088] The scan signal may be set to a gate-on voltage (eg, a low voltage or a high voltage). When the scan signal is supplied to a transistor receiving the scan signal, the transistor may be set to be in an on state.

[0089] The data driver 300 may receive the second control signal DCS and the image data DATA from the timing controller 130. The data driver 300 may provide data signals (or data voltages) corresponding to the converted image IMG2 (or image data DATA) to the data lines DL1 to DLm in response to the second control signal DCS.

[0090] Figure 5 is a conceptual illustration of the storage Figure 4 A diagram of an embodiment of a parameter data table PDT in the storage medium 110 is shown in FIG.

[0091] Reference Figure 5 The parameter data table PDT may include first parameter data PD1, second parameter data PD2, third parameter data PD3, ... and nth parameter data PDn (where n is an integer greater than 0) corresponding to the first identifier IDFR1, the second identifier IDFR2, the third identifier IDFR3, ... and the nth identifier IDFRn, respectively.

[0092] Each of the first to nth identifiers IDFR1 to IDFRn may represent Figure 3 For example, each of the first identifier IDFR1 to the nth identifier IDFRn may indicate a display module DM including Figure 3 A combination of any one of the types of the first lens unit LU1 included in the display module DM, any one of the types of the second lens unit LU2 included in the display module DM, and any one of the types of the display panel DP included in the display module DM shown in FIG.

[0093] The first parameter data PD1 to the nth parameter data PDn may correspond to the first identifier IDFR1 to the nth identifier IDFRn, respectively. In an embodiment, each parameter data may be determined in association with the FOV and PPD of the display module DM corresponding to the corresponding identifier. For example, the FOV and PPD of the display module DM may be determined by the first lens unit LU1 and / or the second lens unit LU2. In an embodiment, each parameter data may be further determined in association with the maximum brightness value of the image displayed by the display module DM corresponding to the corresponding identifier. For example, the maximum brightness value may be determined by the display panel DP. In this way, each parameter data may be determined by a combination of the type of the first lens unit LU1 included in the display module DM corresponding to the corresponding identifier, the type of the second lens unit LU2 included in the display module DM, and the type of the display panel DP included in the display module DM.

[0094] Figure 6 It is shown Figure 4A block diagram of an embodiment of an image generator 120 is shown in FIG. Figures 7 to 9 It is shown that the Figure 6 0 is a diagram of an example of the operation of the coordinate generator 610 in the image generator 120 shown in FIG.

[0095] Reference Figure 6 , the image generator 120 may include a coordinate generator 610 , an image processor 620 , and a grayscale converter 630 .

[0096] The coordinate generator 610 may determine the user US on the display area DA based on the visual sensing data VSD (eg, see Figure 3 ) A sight line reference point for viewing the display area DA. For example, the coordinate generator 610 may sense the position of the pupil of the eye of the user US based on the visual sensing data VSD, and estimate the sight line of the user US according to the sensed position of the pupil of the eye of the user US. Therefore, the coordinate generator 610 may determine the sight line reference point of the user US on the display area DA according to the estimated sight line of the user US.

[0097] and Figure 6 Refer to Figure 7 , also refer to Figure 3 When the center position of the pupil PU of the user eye UE is the first position P1, the coordinate generator 610 can estimate the line of sight of the user US (for example, the first line of sight ST1, sometimes referred to as the first sight line ST1) according to the extension line of the normal direction of the user eye UE at the first position P1 corresponding to the spherical shape.

[0098] The coordinate generator 610 may determine a point at which the sight line of the user US corresponding to the first position P1 (eg, first sight line ST1) and the virtual plane VP meet each other as a sight line reference point of the user US (eg, first reference point RP1). The virtual plane VP may correspond to the display area DA.

[0099] In addition, the coordinate generator 610 may extract the size of the pupil PU of the user US based on the visual sensing data VSD, and determine the range of the line of sight of the user US. For example, the coordinate generator 610 may extract the size of the pupil PU based on the visual sensing data VSD, and determine a viewing range corresponding to an area (hereinafter referred to as a viewing area) that the user US can visually recognize through the pupil PU on the display area DA based on the extracted size of the pupil PU.

[0100] and Figure 6 Refer to Figure 7 , also refer to Figure 2 and Figure 3, when the size (or diameter) of the pupil PU of the user eye UE is the first size T1, the coordinate generator 610 may determine the first viewing range ROV1 corresponding to the area (e.g., the first viewing area A1) that the user US can visually recognize through the pupil PU by using the first size T1. The viewing range may correspond to an angle from the retina of the user eye UE relative to both ends of the pupil PU. The coordinate generator 610 may determine the first viewing area A1 by using the distance S between the virtual plane VP and the retina of the user eye UE and the first viewing range ROV1. In an embodiment, the head mounted display device HMD (or Figure 2 The visual sensor VS shown in FIG. 1 may also include a distance measuring sensor to measure the distance S between the retina of the user's eye UE and the display area DA (ie, the virtual plane VP). For example, the distance measuring sensor may be an ultrasonic sensor that measures the distance between the retina of the user's eye UE and the display panel DP (or the display area DA) by measuring the time it takes for an ultrasonic wave to be reflected and then returned.

[0101] Meanwhile, when the user US views an image using the head mounted display device HMD, the line of sight of the user US may change according to the viewing environment of the image by the user US and changes in line of sight caused by movement of the image, etc. Therefore, the position of the viewing area visually recognized by the user US on the display area DA may change.

[0102] For example, Figure 8 As shown in Figure 3 , the center position of the pupil PU of the user eye UE is the second position P2, and the coordinate generator 610 can estimate the extension line according to the normal direction relative to the user eye UE at the second position P2 as the line of sight of the user US (for example, the second line of sight ST2, sometimes referred to as the second sight line ST2).

[0103] The coordinate generator 610 may determine a point at which the line of sight of the user US (eg, second line of sight ST2 ) corresponding to the second position P2 and the virtual plane VP meet each other as a line of sight reference point of the user US (eg, second reference point RP2 ).

[0104] At the same time, Figure 7 and Figure 8 In the example, since the size (or diameter) of the pupil PU of the user's eye UE is the same as the first size T1, Figure 8 The viewing area and viewing range estimated by the coordinate generator 610 in Figure 7 The first viewing area A1 estimated by the coordinate generator 610 in FIG. 6 is the same as the first viewing range ROV1 .

[0105] In addition, when the user US views an image using the head mounted display device HMD, the viewing range of the user US may change as the size of the pupil PU of the user US changes according to the brightness of the displayed image or the brightness of the external light, for example, when the brightness of the displayed image or the brightness of the external light increases, the size of the pupil PU of the user US becomes smaller. The size (or range) of the viewing area of ​​the user US on the display area DA may change.

[0106] For example, Fig. 9 As shown in Figure 3 and Figure 6 , when the size (or diameter) of the pupil PU of the user eye UE is the second size T2, the coordinate generator 610 can determine the second viewing range ROV2 corresponding to the area (e.g., the second viewing area A2) that the user US can visually recognize from the retina of the user eye UE through the pupil PU by using the second size T2. Figure 7 As described similarly, the coordinate generator 610 can determine the second viewing area A2 by using the distance S between the virtual plane VP and the pupil PU of the user's eye UE and the second viewing range ROV2. Since the range of the area that the user US can visually perceive becomes wider as the size of the pupil PU becomes larger, the viewing range may also become larger. For example, the first viewing range ROV1 corresponding to the first size T1 may be smaller than the second viewing range ROV2 corresponding to the second size T2 larger than the first size T1.

[0107] Return to reference Figure 6 , also refer to Figure 3 and Figure 5 , the coordinate generator 610 can generate viewpoint coordinate data VCD by determining the viewpoint coordinates of the user based on the determined line of sight reference point of the user and the determined viewing area. For example, the coordinate generator 610 can extract the position of the user's line of sight reference point on the determined viewing area, and determine the viewpoint coordinates on the display area based on the position of the user's line of sight reference point. The viewpoint coordinates may be the coordinates of a point in the display area DA that corresponds to the line of sight reference point. The viewpoint coordinates may be determined by referring to the viewing area and the line of sight reference point. The coordinate generator 610 may include viewpoint coordinates VC1 and VC2 (for example, see Figures 10 to 13 )’s viewpoint coordinate data VCD is transmitted to the image processor 620.

[0108] The image processor 620 can extract parameter data corresponding to the received identifier IDFR from the parameter data table PDT. Figure 5 , when the first identifier IDFR1 is received, the first parameter data PD1 corresponding to the first identifier IDFR1 can be extracted.

[0109] In an embodiment, the image processor 620 may determine the size (or range) of an area (hereinafter, referred to as an expression area) in which an image can be expressed by the display module DM based on the extracted parameter data. For example, the size of the expression area of ​​the image provided to the user US may vary according to the second lens unit LU2 embedded in the head mounted display device HMD. The image processor 620 may determine the maximum FOV of the image expressed by the second lens unit LU2 based on the parameter data. Therefore, the image processor 620 may determine the size (or range) of the expression area.

[0110] The image processor 620 may generate the gain map data GMD based on the viewpoint coordinate data VCD and the parameter data. For example, the image processor 620 may identify the display area DA (eg, see FIG. 1 ) based on the viewpoint coordinate data VCD and the parameter data. Figure 3 ) The reference area (or expression area) of the user US on the display area DA. For example, the coordinate generator 610 may generate viewpoint coordinate data VCD for each frame, and the image processor 620 defines a reference area including viewpoint coordinates of the viewpoint coordinate data VCD on the display area DA based on the parameter data.

[0111] Afterwards, the image processor 620 may identify a target area in which the display area DA and the reference area in the input image IMG1 do not overlap each other. For example, an area at the periphery of the reference area in the display area DA may be set as the target area. The image processor 620 may generate gain mapping data GMD corresponding to the target area. For example, the gain mapping data GMD may include a first gain value corresponding to a data pixel of the target area and a second gain value corresponding to a data pixel of an area different from the target area. Each of the first gain values ​​may be less than each of the second gain values. For example, each gain value corresponding to a data pixel of the target area may gradually decrease as the corresponding data pixel becomes farther away from the reference area.

[0112] The grayscale converter 630 may receive the input image IMG1 and convert the input image IMG1 into a converted image IMG2 based on the gain map data GMD provided from the image processor 620 .

[0113] In an embodiment, the grayscale converter 630 may generate a converted image IMG2 by adjusting the grayscale values ​​of the data pixels of the input image IMG1 according to the gain mapping data GMD. For example, the grayscale converter 630 may generate the converted image IMG2 by multiplying the first gain value and the second gain value of the gain mapping data GMD by the grayscale values ​​of the data pixels of the input image IMG1.

[0114] The grayscale of the pixels corresponding to the target area in the converted image IMG2 may be lower than the grayscale of the pixels corresponding to the target area in the input image IMG1. For example, when the input image IMG1 has the same grayscale in the target area, the grayscale of the pixels corresponding to the target area in the converted image IMG2 may gradually decrease as the pixels become farther away from the reference area.

[0115] In an embodiment, the grayscale converter 630 may generate a converted image IMG2 by converting the grayscale of some pixels corresponding to the target area in the input image IMG1 to grayscale 0 (or black grayscale). For example, the grayscale of some pixels corresponding to the target area among the grayscale of the converted image IMG2 may correspond to grayscale 0. Therefore, the image is not displayed in a portion of the target area in the display area DA.

[0116] Fig.10 It is shown Figure 6 2 is a diagram of an example of the operation of the image generator 120 shown in FIG. Fig.11 It shows that when Fig.10 A view of an example of a display area when the grayscale level is reduced compared to a target area.

[0117] Reference Figure 6 and Fig.10 The image processor 620 may determine the first viewpoint coordinate VC1 of the user on the display area 1010 (or the expression area) based on the viewpoint coordinate data VCD. The image processor 620 may determine the reference area 1020 including the first viewpoint coordinate VC1 on the display area 1010 based on the parameter data. In an embodiment, referring to Figure 7 , the reference area 1020 may be determined by further referring to the first viewing area A1. For example, as the first viewing area A1 becomes wider, the reference area 1020 may also become wider.

[0118] The image processor 620 may determine the reference area 1020 by considering various elements of the display module DM. For example, the image processor 620 may determine the reference area 1020 based on parameter data, and as described above, the parameter data may be determined in relation to the FOV, PPD, brightness of an image displayed by the display panel DP, etc. of the display module DM.

[0119] The image processor 620 may identify the target area 1030 based on the determined reference area 1020. For example, an area other than the reference area 1020 may be set as the target area 1030. In an embodiment, the image processor 620 may determine the size of the target area 1030 based on the parameter data.

[0120] The image processor 620 may generate gain map data GMD corresponding to the target area 1030. The image processor 620 may transmit the generated gain map data GMD to the gray scale converter 630.

[0121] Reference Figure 6 and Fig.11 , also refer to Figure 4 , the grayscale converter 630 may generate a converted image IMG2 by adjusting the grayscale values ​​of the data pixels of the input image IMG1 according to the gain mapping data GMD. For example, the grayscale converter 630 may generate the converted image IMG2 by multiplying the gain mapping data GMD by the grayscale values ​​of the data pixels of the input image IMG1. The grayscale levels of the pixels corresponding to the target area 1030 in the converted image IMG2 may be lower than the grayscale levels of the pixels corresponding to the target area 1030 in the input image IMG1. In other words, Fig.11 As shown in Fig.10 1030, the grayscale of the pixels in the display area 1010 corresponding to the target area 1030 may be reduced compared to the target area 1030 shown in . For example, when the input image IMG1 has the same grayscale in the target area 1030 as in the reference area 1020, the grayscale of the pixels in the converted image IMG2 corresponding to the target area 1030 may be gradually reduced as the pixels become farther away from the reference area 1020.

[0122] According to an embodiment of the present disclosure, the image processor 620 may determine the reference area 1020 including the first viewpoint coordinate VC1 on the display area DA based on the parameter data, and adjust the grayscale of the target area 1030 adjacent to the determined reference area 1020. Since the parameter data is determined in relation to various factors (e.g., FOV, PPD of the display module DM, brightness of the image displayed by the display panel DP, etc.), the reference area 1020 may be adaptively determined with respect to the display module DM. Therefore, the display module DM can reduce power consumption while preventing the user from feeling visibility degradation.

[0123] Fig.12 It shows that Fig.10 When the coordinates of the first viewpoint VC1 shown in Figure 6 2 is a diagram of the operation of the image generator 120 shown in FIG. Fig.13 It shows that when Fig.12 A view of an example of a display area when the grayscale level is reduced compared to a target area.

[0124] Reference Figure 6 and Fig.12, the image processor 620 can determine the second viewpoint coordinates VC2 of the user on the display area 1210 (or expression area) based on the viewpoint coordinate data VCD.

[0125] The image processor 620 may determine a reference area 1220 including the second viewpoint coordinate VC2 on the display area 1210 based on the parameter data. Figure 8 , the reference area 1220 may be determined by further referring to the first viewing area A1. For example, as the first viewing area A1 becomes wider, the reference area 1220 may also become wider.

[0126] When the frame is displayed in the display area 1210, the user's line of sight may change. Therefore, the user's viewpoint coordinates may change from the first viewpoint coordinates VC1 to the second viewpoint coordinates VC2. According to an embodiment of the present disclosure, Fig.10 The reference area 1020 shown in FIG. 1 can be changed to Fig.12 The reference area 1220 shown in FIG. 1 includes the peripheral area of ​​the second viewpoint coordinate VC2. Therefore, Fig.10 The target area 1030 shown in FIG. 1 can be changed to Fig.12 The image processor 620 may generate gain map data GMD based on the changed target area 1230.

[0127] Then, refer to Figure 6 and Fig.13 , the grayscale converter 630 may generate a converted image IMG2 by adjusting the grayscale value of the data pixel of the input image IMG1 according to the gain mapping data GMD. The grayscale of the pixel corresponding to the target area 1230 in the converted image IMG2 may be lower than the grayscale of the pixel corresponding to the target area 1230 in the input image IMG1. In other words, Fig.13 As shown in Fig.12 1230, the grayscale level of the pixels in the display area 1210 corresponding to the target area 1230 may be reduced compared to the target area 1230 shown in . For example, when the input image IMG1 has the same grayscale level in the target area 1230 as in the reference area 1220, the grayscale level of the pixels in the converted image IMG2 corresponding to the target area 1230 may be gradually reduced as the pixels become farther away from the reference area 1220.

[0128] Fig.14 is a block diagram showing an embodiment of a head mounted display device HMD′.

[0129] Reference Fig.14 , also refer to Figure 4The head mounted display device HMD' may include a processor PRC, a memory device MEM, an input / output device IO, a power supply PS, a sensing device SD, a display module DM', a visual sensor VS and an image generator IG.

[0130] The processor PRC, the memory device MEM, the input / output device IO, the power supply PS, the sensing device SD and the visual sensor VS are connected to the Figure 2 The processor PRC, the memory device MEM, the input / output device IO, the power supply PS, the sensing device SD, and the visual sensor VS shown in FIG. 1 are identically described. Hereinafter, repeated descriptions will be omitted.

[0131] The memory device MEM can store Figure 4 The parameter data table PDT shown in . For example, the parameter data table PDT may be stored in the memory device MEM during the manufacturing process of the head mounted display device HMD'. In addition, the parameter data table PDT may be stored in the memory device MEM during the testing phase after the head mounted display device HMD' is manufactured. The stored parameter data table PDT may be transmitted to the image generator IG.

[0132] In addition to the image generator IG being provided at the outside of the display module DM' to communicate with the components of the head mounted display device HMD' through the system bus, Fig.14 The image generator IG shown in Figure 4 The image generator 120 shown in FIG. 1 is identically described. In addition, the display module DM′ is Figure 4 The image generator 120 shown in FIG. Figure 4 In addition to the converted image IMG2 shown in Fig.14 The display module DM' shown in FIG. Figure 4 The display module DM shown in is identically described.

[0133] The image generator IG may receive the identifier IDFR from the processor PRC.The image generator IG may receive the parameter data table PDT from the memory device MEM and the visual sensing data VSD from the visual sensor VS.

[0134] like Figure 4 Like the image generator 120 shown in FIG. 1 , the image generator IG can generate the converted image IMG2 by adjusting the grayscale level of a partial area in the input image. The image generator IG can transmit the converted image IMG2 to the display module DM′. The timing controller of the display module DM′ (for example, see Figure 4 The timing controller 130 shown in FIG. 1 may receive the converted image IMG2.

[0135] The display module DM' may display an image based on the received converted image IMG2.

[0136] Fig.15 and Fig.16 is a flowchart illustrating a method of operating a display module and a display device according to an embodiment of the present disclosure.

[0137] Fig.15 is a flowchart illustrating a method of controlling a display panel according to an embodiment of the present disclosure.

[0138] Reference Fig.15 According to an embodiment of the present disclosure, a method for operating a display module DM and a display device may include: an operation S1510 of generating visual sensing data by sensing eyes of a user; an operation S1510 of identifying a reference area on a display area based on parameter data and the visual sensing data; an operation S1520 of generating a converted image by adjusting a gray level of a target area adjacent to the reference area in an input image; and an operation S1530 of controlling a display panel based on the converted image.

[0139] Reference Figure 2 and Fig.15 In operation S1510, visual sensing data may be generated by sensing the user's eyes. Figure 2 and Fig.14 The visual sensor VS shown in captures the user's eyes and can acquire an image corresponding to the captured eyes of the user as visual sensing data.

[0140] In operation S1520, a reference area may be identified based on the visual sensing data and the parameter data. A target area adjacent to the reference area may be identified. In addition, a converted image may be generated by adjusting the grayscale of the target area in the input image. In some embodiments, operation S1520 may be performed by Figure 2 In other embodiments, operation S1520 may be performed by the display module DM shown in FIG. Fig.14 The image generator IG shown in is executed.

[0141] In operation S1530, the display panel may be controlled based on the converted image. Figure 2 The display module DM shown in Fig.14 The display module DM′ shown in FIG. 1 may receive the converted image and output an image based on the converted image to a user.

[0142] Fig.16 It is shown Fig.15 Flowchart of an embodiment of operation S1520 shown in .

[0143] Reference Fig.16, the method of operating the display module DM and the display device according to the embodiment of the present disclosure may include: an operation S1610 of determining viewpoint coordinates on the display area corresponding to the user's line of sight based on visual sensing data; an operation S1620 of identifying a reference area on the display area based on the determined viewpoint coordinates and parameter data; an operation S1630 of generating gain mapping data including a gain value corresponding to the grayscale level of a target area in an input image based on the identified reference area; and an operation S1640 of generating a converted image from the input image based on the gain value corresponding to the grayscale level of the target area.

[0144] Reference Figure 6 and Fig.16 In operation S1610, based on the visual sensing data VSD, a display area (eg, see Figure 3 The viewpoint coordinates corresponding to the user's eyes on the display area DA shown in FIG. Viewpoint coordinate data VCD indicating the determined viewpoint coordinates may be provided.

[0145] In operation S1620, a reference area on the display area may be identified based on the determined viewpoint coordinates and parameter data.

[0146] In operation S1630, a target region adjacent to the identified reference region may be determined based on the reference region. Subsequently, gain map data GMD including a gain value corresponding to a grayscale level of the target region in the input image IMG1 may be generated.

[0147] In operation S1640, a converted image IMG2 may be generated from the input image IMG1 based on a gain value corresponding to the grayscale of the target area. Each of the gain values ​​corresponding to the grayscale of the target area may be smaller than each of the gain values ​​corresponding to the grayscale of the reference area. The grayscale of the pixel corresponding to the target area in the converted image IMG2 may be lower than the grayscale of the pixel according to the target area in the input image IMG1. Therefore, the brightness of the image displayed in the target area on the display area DA may be low. Therefore, power consumption may be reduced without deteriorating visibility felt by the user.

[0148] According to the present disclosure, a display module capable of operating with reduced power consumption, a display device including the display module, and a method of operating the display device may be provided.

[0149] Example embodiments have been disclosed herein, and although specific terms are employed, they are used and interpreted in a general and descriptive sense only, and not for the purpose of limitation. In some cases, as will be apparent to one of ordinary skill in the art from the date of filing of this application, unless otherwise specifically noted, the features, characteristics, and / or elements (elements) described in conjunction with a specific embodiment may be used alone or in combination with the features, characteristics, and / or elements (elements) described in conjunction with other embodiments. Therefore, it will be understood by those skilled in the art that various changes in form and detail may be made without departing from the spirit and scope of the present disclosure as set forth in the appended claims.

Claims

1. A display module, wherein: The display module comprises: A display panel including a display area for displaying an image; A lens unit, arranged on the display area; an image generator configured to receive visual sensing data from the outside by sensing eyes of a user, the image generator identifying a reference area on the display area based on parameter data and the visual sensing data, and the image generator generating a converted image by adjusting a gray level of a target area adjacent to the reference area in an input image; and a controller configured to control the display panel based on the converted image, Wherein, the image generator is configured to determine the size of the reference area according to the parameter data.

2. The display module according to claim 1, wherein: The grayscale level of the target area in the converted image is lower than the grayscale level of the target area in the input image.

3. The display module according to claim 1, wherein: The image generator is configured to extract a reference position corresponding to a line of sight of the eyes of the user on the display area according to the visual sensing data, and the image generator identifies an area adjacent to the reference position as the reference area.

4. The display module according to claim 1, wherein: The image generator comprises: a coordinate generator configured to determine viewpoint coordinates on the display area corresponding to the user's line of sight based on the visual sensing data; an image processor configured to identify the reference area on the display area based on the determined viewpoint coordinates and the parameter data, and the image processor generates gain mapping data including a gain value corresponding to the grayscale level of the target area in the input image based on the reference area; and A grayscale converter is configured to generate the converted image from the input image based on the gain value corresponding to the grayscale of the target area in the input image.

5. The display module according to claim 4, wherein: The controller also includes a storage medium configured to store the parameter data.

6. The display module according to claim 1, wherein: The lens unit allows the image displayed by the display area to pass through the lens unit so that brightness of the image expressed by the lens unit is uniformly perceived by the user.

7. The display module according to claim 6, wherein: The parametric data is provided based on the field of view and pixels per degree of the image rendered by the lens unit.

8. The display module according to claim 7, wherein: The parameter data is provided according to a maximum brightness of the image displayed by the display panel.

9. The display module according to claim 1, wherein: The visual sensing data is generated from each of a first frame and a second frame subsequent to the first frame, and wherein the image generator generates the converted image corresponding to the first frame based on the visual sensing data generated in the first frame, and the image generator generates the converted image corresponding to the second frame based on the visual sensing data generated in the second frame.

10. A method for controlling a display panel, wherein: The display panel includes a lens unit and a display area arranged to overlap with the lens unit, and the method includes: generating visual sensing data by sensing eyes of a user; identifying a reference area on the display area based on parameter data and the visual sensing data, and generating a converted image by adjusting the grayscale level of a target area adjacent to the reference area in the input image; and controlling the display panel based on the converted image, Wherein, the size of the reference area is determined according to the parameter data.

Images