Display device and control method thereof

Abstract

This display device comprises: a sensor; a display screen; a memory configured to store instructions; and at least one processor configured to individually and / or collectively execute the stored instructions, wherein the at least one processor may track a user's gaze on the basis of information obtained by the sensor so as to obtain, on the display screen, a movement path of viewpoint coordinates corresponding to the movement path of the tracked gaze, determine, on the basis of the movement path of the viewpoint coordinates, predicted viewpoint coordinates to which the user's gaze is predicted to move on the display screen, control a first luminance value for a first display area of the display screen including the predicted viewpoint coordinates, and control a second luminance value for a second display area of the display screen excluding the first display area, wherein the second luminance value is different from the first luminance value.

Description

Display device and control method thereof

[0001] The present invention relates to a display device for controlling the brightness of a display and a method for controlling the same.

[0002] A display device is a type of device that converts acquired or stored electrical information into visual information and displays it to a user, and is used in various fields such as homes, schools, or workplaces.

[0003] Display devices may include personal digital assistants (PDAs), portable terminal devices such as cellular phones, monitor devices connected to electronic devices such as personal computers or server computers, portable computer devices, navigation terminal devices, general television devices, Internet Protocol television (IPTV) devices, smartphones, tablet PCs, various display devices used to play images such as advertisements or movies in industrial settings, stereoscopic display devices for playing 3D content, or various other types of audio / video systems.

[0004] As the size and / or resolution of display panels increase, various technologies are being researched to reduce power consumption.

[0005] The information described above may be provided as related art for the purpose of aiding understanding of this document. None of the foregoing is to be claimed as prior art related to this document, nor is it to be used to determine prior art.

[0006] The present disclosure provides a display device for controlling the brightness of a display and a method for controlling the same. The term "brightness" as used in the present disclosure may be used interchangeably with the term "luminance" unless otherwise specified.

[0007] According to one embodiment of the present disclosure, a display device comprises a sensor, a display screen, a memory configured to store instructions, and at least one processor configured to execute the stored instructions individually and / or collectively, wherein the at least one processor tracks a user's gaze based on information obtained by the sensor, obtains a movement path of viewpoint coordinates corresponding to a movement path of the tracked gaze on the display screen, determines a predicted viewpoint coordinate where the user's gaze is predicted to move on the display screen based on the movement path of the viewpoint coordinates, controls a first luminance value for a first display area of ​​the display screen including the predicted viewpoint coordinate, and controls a second luminance value for a second display area of ​​the display screen excluding the first display area, wherein the second luminance value is different from the first luminance value.

[0008] The above instructions may be configured to control the second luminance value to decrease based on the distance from the predicted time point coordinates.

[0009] The above instructions may be configured to control the second luminance value so that the brightness of the second display area can be lowered over time intervals.

[0010] The above instructions may be configured to control the first luminance value so that the brightness of the first display area can be increased immediately.

[0011] The above instructions may be configured to identify a dimming block of the display screen containing the predicted time point coordinates among a plurality of dimming blocks dividing the display screen, and to independently control the luminance value of the identified dimming block and the luminance values ​​of the dimming blocks surrounding the identified dimming block among the plurality of dimming blocks.

[0012] Among the dimming blocks surrounding the identified dimming block, the first dimming block has a first distance from the predicted time point coordinates, and among the dimming blocks surrounding the identified dimming block, the second dimming block has a second distance from the predicted time point coordinates, and the instructions may be configured to reduce the luminance value of the second dimming block by a greater margin than the luminance value of the first dimming block.

[0013] The above instructions may be configured to control a third luminance value for a third display area of ​​the display screen including the viewpoint coordinates corresponding to the user's gaze, and to control a fourth luminance value for a fourth display area of ​​the display screen excluding the third display area, based on the fact that the viewpoint coordinates corresponding to the user's gaze do not match the predicted viewpoint coordinates.

[0014] The above instructions may be configured to control the brightness value of the entire display screen to have a brightness below a threshold level based on the determination that the user's gaze is not detected during the time interval.

[0015] The above instructions may be configured to control the luminance value of the entire display screen to have a reference brightness based on the determination that multiple users are looking at the display screen.

[0016] The above instructions may be configured to obtain the separation distance between the display screen and the user based on the information obtained by the sensor, and to control the second brightness value based on the separation distance between the display screen and the user.

[0017] According to one embodiment of the present disclosure, a display device comprises a sensor, a display screen, a memory configured to store instructions, and at least one processor configured to perform the method by executing the stored instructions individually and / or collectively, and a control method of the display device may include: tracking a user's gaze based on information acquired by the sensor and obtaining a movement path of viewpoint coordinates corresponding to a movement path of the tracked gaze on the display screen; determining a predicted viewpoint coordinate on the display screen where the user's gaze is predicted to move based on the movement path of the viewpoint coordinates; controlling a first luminance value for a first display area of ​​the display screen including the predicted viewpoint coordinates; and controlling a second luminance value for a second display area of ​​the display screen excluding the first display area, wherein the second luminance value is different from the first luminance value.

[0018] The above method may further include an operation to control the second luminance value to decrease based on the distance from the predicted time point coordinates.

[0019] The above method may further include an operation to control the second luminance value so that the brightness of the second display area can be lowered over time intervals.

[0020] The above method may further include an operation to control the first luminance value so that the brightness of the first display area can be increased immediately.

[0021] The above method may further include: an operation of identifying a dimming block of the display screen containing the predicted time point coordinates among a plurality of dimming blocks dividing the display screen; and an operation of independently controlling the luminance value of the identified dimming block and the luminance values ​​of the dimming blocks surrounding the identified dimming block among the plurality of dimming blocks.

[0022] Among the dimming blocks surrounding the identified dimming block, the first dimming block has a first distance from the predicted time point coordinates, and among the dimming blocks surrounding the identified dimming block, the second dimming block has a second distance from the predicted time point coordinates, and the method may further include an operation of reducing the luminance value of the second dimming block by a greater margin than the luminance value of the first dimming block.

[0023] The above method may further include, based on the fact that the viewpoint coordinates corresponding to the user's gaze do not match the predicted viewpoint coordinates, an operation of controlling a third luminance value for a third display area of ​​the display screen including the viewpoint coordinates corresponding to the user's gaze, and an operation of controlling a fourth luminance value for a fourth display area of ​​the display screen excluding the third display area.

[0024] The above method may further include an operation to control the brightness value of the entire display screen to have a brightness below a threshold level, based on the determination that the user's gaze is not detected during the time interval.

[0025] The above method may further include an operation of controlling the luminance value of the entire display screen to have a reference brightness based on the determination that multiple users are looking at the display screen.

[0026] The above method may further include the operation of obtaining a separation distance between the display screen and the user based on the information obtained by the sensor; and the operation of controlling the second brightness value based on the separation distance between the display screen and the user.

[0027] FIG. 1 is a block diagram of an exemplary display device capable of performing the operations described in the present disclosure.

[0028] FIG. 2 illustrates a structure relating to a display panel of a display device according to one example.

[0029] FIG. 3 illustrates a light source device included in a display device according to one example.

[0030] Figure 4 is a diagram illustrating a procedure for controlling brightness based on a user's gaze in a display device according to one example.

[0031] FIG. 5 is a block diagram for implementing local dimming based on the user's gaze in a display device according to one example.

[0032] FIG. 6 is a flowchart illustrating a procedure for controlling local dimming in a display device according to one example.

[0033] FIGS. 7a and 7b are flowcharts illustrating a procedure for controlling local dimming in a display device according to one example.

[0034] FIG. 8 illustrates an operation to control the brightness of a display when no user is detected in a display device according to one example.

[0035] Figure 9 illustrates the operation of obtaining a set brightness adjustment ratio when performing local dimming based on the user's gaze.

[0036] FIG. 10 illustrates the operation of changing the brightness adjustment ratio in a display device according to one example.

[0037] FIG. 11 illustrates the operation of updating the brightness adjustment ratio in response to the user's gaze in a display device according to one example.

[0038] FIG. 12 illustrates the determination of prediction time point coordinates in a display device according to one example.

[0039] Figures 13a and 13b illustrate simulation results regarding brightness control of a display according to one example.

[0040] The display device according to the various examples disclosed in this document may be a device of various forms. The display device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The display device according to the examples in this document is not limited to the devices described above.

[0041] The various examples and terms used in this document are not intended to limit the technical features described in this document to specific examples, and should be understood to include various modifications, equivalents, or substitutions of such examples. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another corresponding component and do not limit the components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0042] The term "module" as used in the various examples of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed as a whole, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one example, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0043] FIG. 1 is a block diagram of an exemplary display device (100) capable of performing the operations described in the present disclosure.

[0044] Referring to FIG. 1, the display device (100) may be one of various types of electronic devices, such as a liquid crystal display (LCD) type television (TV), a mini LED (light emitting diodes) type monitor, a tablet, or other similar devices (not shown). The components, their relationships, and their functions illustrated in FIG. 1 are illustrative only and are not intended to limit the implementations described or claimed herein.

[0045] The display device (100) can communicate with an external electronic device (103) (e.g., a smartphone) through a first network (101) (e.g., a short-range wireless communication network) in a network environment. The display device (100) can communicate with at least one of an external electronic device (104) (e.g., a smartphone) or a server (105) (e.g., a smart home server) through a second network (102) (e.g., a long-range wireless communication network) in a network environment. The display device (100) can communicate with an external electronic device (e.g., a refrigerator, a washing machine, a vacuum cleaner, an air conditioner, or lighting, etc.) through the server (105). Each of the external electronic devices (103 or 104) may be the same as the display device (100) or a different type of device. All or part of the operations performed on the display device (100) may be performed on one or more of the external electronic devices (103, 104, or 105). For example, if a display device (100) needs to perform a function or service automatically or in response to a request from a user or another device, the display device (100) may request one or more external electronic devices to perform at least a part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the request may perform at least a part of the requested function or service, or additional functions or services related to the request, and transmit the result of the execution to the display device (100). The display device (100) may provide the transmitted result as is or additionally processed as at least part of the response to the request. To this end, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technologies may be used.The display device (100) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. The external electronic device (104) may include an Internet of Things (IoT) device. The server (105) may be an intelligent server using machine learning and / or neural networks. The external electronic device (104) or the server (105) may be included within the second network (102). The display device (100) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology. For example, the display device (100) may receive video signals and / or audio signals through a network (e.g., the first and / or second network (101, 102)).

[0046] The display device (100) may include, as components, a communication circuit (110), a processor (120), a sensor (130), a speaker (140), a display (150), and / or memory (160) (e.g., volatile memory (161) and / or non-volatile memory (162)). The components may be connected to each other based on a specific communication method (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) or may exchange signals (e.g., commands or data) with each other. The components are merely exemplary. For example, the display device (100) may include other components (e.g., PMIC (power management integrated circuit), connection terminals, or input / output interfaces). At least one of the components included in the display device (100) may be omitted, or one or more other components may be added. Some of the components included in the display device (100) may be integrated into a single component.

[0047] The processor (120) can control at least one other component (e.g., hardware or software component) of the display device (100) by executing software (e.g., application, driving program, and / or system program). To this end, the processor (120) can perform various data processing and / or operations. As at least part of the data processing and / or operations, the processor (120) can store commands or data received from other components (e.g., communication circuit (110) or sensor (130)) in the volatile memory (161). The processor (120) can process the commands or data stored in the volatile memory (161) and store the resulting data in the non-volatile memory (162).

[0048] The above processor (120) can be implemented with one or more IC (integrated circuit) chips and can perform various data processing. For example, the processor (120) (or application processor, AP) may be implemented as a system on chip (SoC) (e.g., a single chip or chipset). The processor (120) may, for example, execute software to control at least one other component (e.g., a hardware or software component) of the display device (100) connected to the processor (120) and may perform various data processing or operations. According to one example, as at least part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a communication circuit (110) or a sensor (130)) in volatile memory (161), process the commands or data stored in volatile memory (161), and store result data resulting from the processing in non-volatile memory (162). According to one example, the processor (120) may operate independently of or together with the main processor (121) (e.g., a central processing unit (CPU) or AP) or an auxiliary processor (120). It may include a processor (123) (e.g., a graphic processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), or a communication processor (CP)). For example, if the display device (100) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function.The auxiliary processor (123) can be implemented separately from the main processor (121) or as part thereof.

[0049] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the display device (100) (e.g., communication circuit (110), sensor (130), speaker (140), or display (150)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one example, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., communication circuit (110)). According to one example, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the display device (100) itself where the artificial intelligence is performed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0050] The communication circuit (110) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between a display device (100) and an external electronic device (e.g., electronic device (103, 104), or server (105)), and the performance of communication through the established communication channel. The communication circuit (110) can support direct (e.g., wired) communication or wireless communication. The communication circuit (110) may include a wireless communication module (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among the above communication modules can communicate with an external electronic device (104) through a first network (101) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (102) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). For example, a display device (100) can receive video signals and / or audio signals through a communication circuit (110).

[0051] The sensor (130) can detect the operating state of the display device (100) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. The sensor (130) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor. According to one example, the sensor (130) may include a camera. The camera may include a plurality of cameras (stereo cameras), an RGB-D camera, a ToF (Time of Flight) camera, etc. However, it is not limited to this example, and the sensor (130) may include various sensors capable of acquiring frame and depth information.

[0052] The speaker (140) can output a sound signal (or audio signal) to the outside of the display device (100). The speaker (140) can be used for general purposes, such as multimedia playback or recording playback. The volume of the speaker (140) can be increased or decreased in response to control by the processor (120).

[0053] The display (150) can visually output information to the outside of the display device (100) (e.g., a user). The display (150) may include a display panel that substantially displays a screen. The display (150) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. The display (150) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0054] The memory (160) may store various data used by at least one component of the display device (100) (e.g., processor (120) or sensor (130)). The data may include, for example, input data or output data for software (e.g., program) and / or related commands. The memory (160) may include volatile memory (161) or non-volatile memory (162). The memory (160) may store programs and data for processing video signals and / or audio signals. The memory (160) may temporarily store data generated during the processing of video signals and / or audio signals.

[0055] The display device (100) may further include an interface or a connection terminal. The interface may support one or more designated protocols that can be used to connect the display device (100) directly or wirelessly to an external electronic device (e.g., electronic device (103)). The interface may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface. The connection terminal may include a connector through which the display device (100) can be physically connected to an external electronic device (e.g., electronic device (103)). The connection terminal may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector). For example, the display device (100) may receive video signals and / or audio signals through the interface or the connection terminal.

[0056] According to one example, the method according to the various examples disclosed in this document may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0057] According to various examples, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various examples, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various examples, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0058] FIG. 2 illustrates a structure relating to a display panel of a display device (e.g., the display device (100) of FIG. 1) according to one example.

[0059] Referring to FIG. 2, the display panel included in the display device (100) is a component that substantially outputs a screen using various materials such as LCD, LED, or OLED. For example, if the display panel is implemented as an LCD panel, the display device (100) may include a light source device (210) and a liquid crystal panel (230) that blocks or passes light emitted from the light source device (210).

[0060] According to one example, the light source device (210) includes a plurality of light sources and can output surface light by diffusing light emitted from the plurality of light sources. For example, the light source device (210) is as shown in FIG. 3.

[0061] According to one example, the liquid crystal panel (230) includes a plurality of pixels, and the plurality of pixels can be controlled so that each of the plurality of pixels allows light to pass through or blocks light. An image can be formed by the light passing through each of the plurality of pixels.

[0062] According to one example, a liquid crystal panel (230) is provided in front of the light source device (210) in the direction from which light is emitted, and blocks or passes the light emitted from the light source device (210) to form an image.

[0063] According to one example, the front surface of the liquid crystal panel (230) can display a still image or a video. The liquid crystal panel (230) may have a plurality of pixels (P). Each of the plurality of pixels (P) can independently block or pass light from the light source device (210). The light passed through the plurality of pixels (P) can provide an image for a viewer to view.

[0064] According to one example, a plurality of pixels (P) can emit light of various brightness and various colors. In order to emit light of various colors, the plurality of pixels (P) each have subpixels (P R , P G , P B It may include ). Subpixels (P R , P G , P B ) is a red subpixel (P) capable of emitting red light. R It may include ). Subpixels (P R , P G , P B ) is a green subpixel (P) capable of emitting green light. GIt may include ). Subpixels (P R , P G , P B ) is a blue subpixel (P) capable of emitting blue light. B It may include ). For example, red light can represent light with wavelengths ranging from approximately 700 nm (nanometer, one-billionth of a meter) to 800 nm. Green light can represent light with wavelengths ranging from approximately 500 nm to 600 nm. Blue light can represent light with wavelengths ranging from approximately 400 nm to 500 nm.

[0065] According to one example, the red subpixel (P R )'s red light, green subpixel (P G The green light and / or blue subpixel (P) of ) B By means of a combination of blue light or a single light, light of various brightness and various colors can be output from multiple pixels (P).

[0066] FIG. 3 illustrates a light source device included in a display device according to one example (e.g., the display device (100) of FIG. 1).

[0067] Referring to FIG. 3, a light source device (e.g., the light source device (210) of FIG. 2) may include a plurality of dimming blocks (301) arranged in a matrix form. The plurality of dimming blocks (301) may each include, for example, at least one light source (311) and / or a substrate (313) that supports / fixes the plurality of light sources (311).

[0068] Multiple dimming blocks (301) may be configured in the form of an M*N matrix (M and N are natural numbers). An M*N matrix means a matrix with M rows and N columns. For example, multiple dimming blocks (301) may be configured with 5 rows and 12 columns. In this case, the light source device (210) may include a total of 60 dimming blocks (301). However, the number of dimming blocks (301) is not limited to a specific number and may be changed as needed.

[0069] According to one example, the light source (311) may use a device capable of emitting monochromatic light (light of a specific wavelength, e.g., blue light) or white light (e.g., light mixed with red, green, and blue light). The light source (311) may emit monochromatic light or white light in various directions. For example, a device that can be used as the light source (311) may include a light-emitting diode (LED). The light-emitting diode may be implemented in various sizes. The light-emitting diode may include, for example, a Mini LED and / or a Micro LED.

[0070] According to one example, the substrate (313) may fix a plurality of light sources (311) so that the position of the light source (311) is not changed. The substrate (313) may supply power to the light source (311) for the light source (311) to emit light. According to one example, the substrate (313) may include a synthetic resin, reinforced glass, and / or a printed circuit board (PCB) having a conductive power supply line formed therein for fixing a plurality of light sources (311) and supplying power to the light source (311).

[0071] According to one example, light sources (311) belonging to a dimming block (301) can emit light of the same intensity. According to one example, light sources belonging to different dimming blocks can emit light of different intensities.

[0072] According to one example, the display device (100) may divide the light source device (210) into a plurality of blocks and independently adjust the current (or voltage or both current and voltage) according to the input image for each block. For example, the display device (100) may use local dimming technology that controls brightness in units of one or more dimming blocks.

[0073] A display device (100) receives content including video signals and audio signals from one or more content sources and can output video (or image) and audio (or sound) corresponding to the video signals and audio signals. Local dimming technology is applied to the display device (100) to improve power consumption while improving the contrast ratio of the video. Local dimming technology is, for example, a technology that individually controls the brightness of light to be emitted for one or more dimming blocks based on the content. A display device (100) with local dimming technology applied can control the emission of light of different brightness for each dimming block. For example, the display device (100) can reduce the brightness of a light source (311) corresponding to a dark part of the image from a light source device (210) and increase the brightness of a light source (311) corresponding to a bright part of the image.

[0074] For example, if dimming is applied to the entire screen in a display device (100) to control brightness uniformly, it may be inefficient in terms of energy consumption. For example, the display device (100) can output a bright screen even when the user is not viewing the screen. In addition, even when the user is viewing the screen, the display device (100) can control the brightness of the area where the user's gaze does not reach in the same way as the area where the user's gaze reaches. In this way, the display device (100) needs to apply local dimming technology that can control brightness by display area considering the user's gaze in order to reduce unnecessary power consumption in the display. For example, the display device (100) can reduce power consumed by the display by reducing the brightness of the area where the user's gaze does not reach.

[0075] FIG. 4 is a diagram illustrating a procedure for controlling brightness based on a user's gaze in a display device according to one example (e.g., the display device (100) of FIG. 1). For example, the display device (100) can perform a procedure to reduce brightness in an area not reached by the user's gaze.

[0076] In FIG. 4, two monitors (410, 430) are assumed for convenience of explanation, but the implementation described below can be applied equally to one monitor or three or more monitors.

[0077] Referring to FIG. 4, the display device (100) can output a screen to two or more monitors (410, 430) (hereinafter referred to as 'first monitor (410)' and 'second monitor (430)'). The first monitor (410) and / or the second monitor (430) may include one or more cameras (411, 413 or 431, 433) on the front facing the user (420). The cameras (411, 413 or 431, 433) can capture the face of the user (420) looking at the front of the monitors (410 or 430). The display device (100) can identify the presence of the user (420) based on the image captured by the cameras (411, 413 or 431, 433). The display device (100) can perform local dimming based on the coordinates where the user (420) looks on the monitor (410, 430) in response to identifying the presence of a user. According to one example, the display device (100) can perform local dimming to divide the entire display screen of at least one monitor (410, 430) into multiple regions and control the luminance (or brightness) (hereinafter referred to as 'luminance') for each divided region. Here, the at least one monitor (410, 430) may be either the first monitor (410) or the second monitor (430), or may refer to both the first and second monitors (410, 430). For local dimming, the display device (100) can obtain information regarding the gaze (440) of the user (420) based on a user image (e.g., a user's face image) captured by a camera (411, 413 or 431, 433). For example, the information regarding the gaze (440) of the user (420) may be direction information that the user (420) is looking at. The direction information may be, for example, information regarding a direction vector corresponding to the direction that the user (420) is looking at.A display device (100) can analyze information regarding the gaze (440) of a user (420) obtained to predict or obtain coordinates (hereinafter referred to as 'reference coordinates') to which the user's gaze (440) reaches (or is directed) on a monitor (410 or 430). For example, the display device (100) can determine a first area on the entire display screen that includes the obtained reference coordinates. The display device (100) can apply local dimming to adjust the brightness of the first area and the second area differently. The second area may correspond to an area on the entire display screen excluding the first area. According to one example, the second area may be divided into a plurality of divided areas. For example, the display device (100) can apply different brightness within the second area depending on the distance from the first area. For example, if the second area is divided into a first divided area at a relatively close distance and a second divided area at a relatively far distance based on the distance from the first area, the display device (100) can reduce the brightness of the second divided area relatively more than that of the first divided area. For example, on a screen output through a display, objects or areas with high brightness, such as the sun or lighting, and objects or areas with low brightness, such as shade, may coexist. The display device (100) can adjust the brightness of each area included in the entire display screen by considering the unique reference brightness to be output to these objects or areas and the user's line of sight.

[0078] A first image of a user (420) captured by a first camera (411, 413) provided on a first monitor (410) and a second image of a user (420) captured by a second camera (431, 433) provided on a second monitor (430) may be different. The display device (100) can identify the presence of a user (420) based on the first image captured by the first camera (411, 413) and / or the second image captured by the second camera (431, 433).

[0079] For example, a case may be assumed in which a first image captured by a first camera (411, 413) includes the user (420), and a second image captured by a second camera (431, 433) does not include the user (420). In this case, the display device (100) may analyze the first image captured by the first camera (411, 413) to recognize that the user (420) is present, and analyze the second image captured by the second camera (431, 433) to recognize that the user (420) is not present. According to one example, the display device (100) may adjust the brightness of the entire display screen of the second monitor (430) to below a threshold level in response to identifying that the user (420) is not present, that is, the absence of the user (420), based on the analysis result of the second image captured by the second camera (431, 433). For example, to adjust the brightness of the entire display screen of the monitor (430) to below a threshold level, the display device (100) can reduce the brightness of the entire display screen of the display in a uniform manner. For example, the display device (100) can reduce the brightness of the entire display screen in the same proportion.

[0080] According to one example, the display device (100) can identify the presence of a user (420) based on images (e.g., a first image and / or a second image) captured periodically or non-periodically by a first camera (411, 413) and / or a second camera (431, 433). According to one example, the display device (100) can count the number of images in which the presence of the user (420) is not identified among the images captured periodically and / or non-periodically. According to one example, the display device (100) can determine that the user (420) is absent if the number of counted images exceeds a threshold number.

[0081] For example, when a user (420) is looking at the first monitor (410) among two monitors (410, 430), the display device (100) may not be able to obtain reference coordinates on the first and / or second monitors (410, 430) where the user (420) is looking, even if it can identify the presence of the user (420) based on images captured by the first camera (411, 413) and / or the second camera (431, 433). For example, the display device (100) may adjust the brightness of the entire display screen of the second monitor (430) to below a threshold level in response to the failure to obtain reference coordinates on the display screen of the second monitor (430) corresponding to the user (420)'s gaze. At this time, just as the number of images in which the presence of the user (420) is not identified is counted, the display device (100) counts the number of images in which the reference coordinates toward which the user (420) looks are not obtained, and when the counted number exceeds a threshold number, the brightness of the entire display screen of the second monitor (430) can be adjusted to a threshold level or lower.

[0082] According to one example, the display device (100) can reduce the brightness of a display area that is not directed at the user's gaze. The display device (100) can reduce power consumption without affecting the image quality perceived by the user. The brightness control method of the display device (100) can be applied in a 3D monitor, wide monitor, or multi-monitor (e.g., dual monitor) environment.

[0083] FIG. 5 is a block diagram for implementing local dimming based on the gaze of a user (e.g., user (420) of FIG. 4) in a display device according to one example (e.g., display device (100) of FIG. 1).

[0084] Referring to FIG. 5, a display device (100) according to one example may include at least some of a content receiver (510), a sensor (530) (e.g., sensor (130) of FIG. 1), a processor (520) (e.g., processor (120) of FIG. 1), a dimming driver (540), a light source device (550) (e.g., light source device (210) of FIG. 2), or a display panel (not shown). According to one example, the sensor (530) may be included in the display device (100). According to one example, the sensor (530) may be connected to the display device (100) through a predetermined interface port as an external device. According to one example, light output from the light source device (550) may form an image on the display panel. According to one example, the display panel may be provided as a separate configuration externally. For example, a display device (100) that emits a light signal through a light source device (550), such as an image projection device (e.g., a projector), may not have a display panel. In this case, the light signal emitted by the light source device (550) of the display device (100) can be used to display an image on a projection surface such as a screen. In the following description, a display device (100) including a display panel will be assumed and described, but the present disclosure may also be applied to an image projection device such as a projector.

[0085] According to one example, a content receiving unit (510) may receive content including video signals and / or audio signals from one or more content sources (hereinafter referred to as 'content sources'). For example, the content receiving unit (510) may include a communication circuit (e.g., communication circuit (110) of FIG. 1) or a network (e.g., first and / or second networks (101, 102) of FIG. 1). For example, the content receiving unit (510) may include an interface or connection terminal for receiving content including video signals and / or audio signals from the content sources.

[0086] According to one example, the sensor (530) may include an image sensor corresponding to a camera (e.g., the first camera (411; 413) or the second camera (431; 433) of FIG. 4). In the following description, the term 'camera' will be used to refer collectively to components that convert light into a digital image, such as an image sensor.

[0087] According to one example, the sensor (530) can capture an image. For example, the sensor (530) may be placed on the front of the display device (100). For example, the sensor (530) provided on the display device (100) can capture a user within the field of view. For example, the sensor (530) can acquire a user image including the user.

[0088] According to one example, the sensor (530) can transmit the captured video to the processor (520). For example, the sensor (530) can capture the video periodically or non-periodically and transmit the captured video to the processor (520). For example, the sensor (530) can capture the video in accordance with the frame rate (i.e., the speed at which the display device displays one screen data). Accordingly, the video captured by the sensor (530) can correspond to the frame displayed on the screen of the display device (100). For example, the frame rate refers to the number of times the display (e.g., the display (150) of FIG. 1) displays a frame on the screen per second, and uses Hz (Hertz) as the unit, which refers to the number of repetitions per second. For example, a display with a frame rate of 60 Hz may mean that it displays 60 frames per second.

[0089] According to one example, the sensor (530) may include a plurality of sensors (530) (stereo cameras) corresponding to each of the user's left and right eyes. According to one example, the sensor (530) may include a depth camera using a time of flight (TOF) sensor and / or a depth sensor.

[0090] Although it has been described above that information regarding the user's gaze or viewpoint is collected using an image sensor, the user's gaze or viewpoint may be collected using various other types of sensors. For example, the user's gaze or viewpoint may be collected by various conventional embodiments, such as a contact lens method or a sensor attachment method.

[0091] According to one example, the processor (520) may receive a video signal and / or an audio signal from a content receiver (510). For example, the processor (520) may decode the video signal into video data. According to one example, the processor (520) may generate dimming data from the video data. The processor (520) may output the video data and the dimming data to a panel driver (not shown) and a dimming driver (540), respectively.

[0092] According to one example, the processor (520) may receive video from a camera. According to one example, the processor (520) may identify the presence of a user based on the video received from the sensor (530). The presence of a user may be detected, for example, by face recognition. For example, even if a user is present in the captured video, if the user's face is not recognized (e.g., if the user is not looking at the display screen), the display device (100) may determine that the user is absent. According to one example, the processor (520) may analyze the received video to obtain information regarding the user's gaze or viewpoint.

[0093] According to one example, the processor (520) can track the user's gaze based on information collected by the sensor (530). According to one example, the processor (520) can track the user's gaze based on user images received from the sensor (530). According to one example, the processor (520) can generate viewpoint data regarding the user's viewpoint, including, for example, the position of the user's eyes and coordinates on the display (150) toward which the user's gaze is directed. According to one example, the processor (520) can calculate coordinate values ​​corresponding to a planar orthogonal coordinate system on the X-axis and Y-axis (horizontal and longitudinal directions of the display) of the user's eyes based on the user images. According to one example, the processor (520) can calculate coordinate values ​​of the user's eyes on the Z-axis, which is the direction toward the user, based on the user images. For example, coordinate values ​​corresponding to a spatial orthogonal coordinate system on the X-axis, Y-axis, and Z-axis of the user's eyes can be obtained by utilizing the disclosed eye-tracking techniques. According to one example, the processor (520) can track the user's gaze by the sensor (530) and obtain a movement path of actual time point coordinates corresponding to the tracked gaze movement on the entire display screen of the display (150).

[0094] According to one example, the processor (520) can determine the predicted point coordinates where the user's gaze is predicted to move across the entire display screen of the display (150) based on the movement path of the actual point coordinates.

[0095] According to one example, the processor (520) can independently or individually control a first luminance value for a first display area including predicted time point coordinates and a second luminance value for a second display area excluding the first display area on the entire display screen of the display (150).

[0096] According to one example, the processor (520) can control the second brightness value by applying a rate that gradually decreases according to the distance from the predicted time point coordinates to the second display area.

[0097] According to one example, the processor (520) can control the second brightness value so that the brightness of the second display area can gradually darken over a predetermined time interval.

[0098] According to one example, the processor (520) can control the first brightness value so that the brightness of the first display area can be immediately brightened.

[0099] According to one example, the processor (520) can identify one or more specific dimming blocks containing predicted time point coordinates among a plurality of dimming blocks that divide the entire display screen of the display (150). The processor (520) can control the brightness values ​​of the identified one or more specific dimming blocks and the surrounding dimming blocks of the identified one or more specific dimming blocks independently or individually.

[0100] According to one example, the processor (520) can reduce the luminance value of a second peripheral dimming block, which is relatively far from the predicted time point coordinates among the peripheral dimming blocks, by a greater amount than the luminance value of a first peripheral dimming block, which is relatively close to the predicted time point coordinates.

[0101] According to one example, if the specific actual time point coordinates corresponding to the tracked gaze do not match the predicted time point coordinates, the processor (520) may independently or individually control the third luminance value for a third display area containing the specific actual time point coordinates on the entire display screen of the display (150) and the fourth luminance value for a fourth display area excluding the third display area on the entire display screen of the display (150).

[0102] According to one example, if the processor (520) does not detect a target user to track the gaze for a predetermined time interval by the sensor (530), the entire display screen of the display (150) may control the brightness value of the entire display screen of the display (150) so that the brightness is below a threshold level.

[0103] According to one example, when multiple users are detected by the sensor (530), the processor (520) can control the brightness value of the entire display screen of the display (150) so that the entire display screen of the display (150) has a reference brightness.

[0104] According to one example, the processor (520) obtains the distance from the display (150) to the user by means of a sensor (530) and can control a second brightness value in consideration of the distance.

[0105] According to one example, the processor (520) can control local dimming of the display (150). According to one example, the processor (520) can supply different driving currents to light sources (e.g., light sources (311) of FIG. 3) belonging to different dimming blocks (e.g., dimming block (301) of FIG. 3) according to dimming data. In this case, the light sources (311) belonging to different dimming blocks (301) can emit light of different brightness. The control operation of these multiple light sources (311) is called 'local dimming'.

[0106] According to one example, the processor (520) may generate dimming data based on data received from the content receiver (510) and / or images received from the sensor (530). The dimming data may include information regarding the intensity of light emitted by each of the plurality of light sources (or plurality of dimming blocks) included in the light source device (550). The dimming data may be provided to the light source device (550) via the dimming driver (540).

[0107] According to one example, the processor (520) can determine the brightness for each dimming block per frame based on data received from the content receiver (510). According to one example, the processor (520) can obtain a brightness adjustment ratio for each dimming block based on time data obtained by the sensor (530). According to one example, the processor (520) can determine the final output brightness by applying the brightness adjustment ratio for each dimming block obtained based on time data to the brightness for each dimming block determined based on data received from the content receiver (510). For example, the brightness adjustment ratio can be defined by the ratio of the brightness of the output image to the brightness of the input image. The brightness adjustment ratio may be a gain value that can be applied to the brightness of the input image to adjust the brightness of the output image. According to one example, the processor (520) can generate dimming data based on the determined brightness.

[0108] For local dimming, a plurality of light sources (311) included in the light source device (550) may be divided into a plurality of dimming blocks (301) as shown in FIG. 3. FIG. 3 shows a total of 60 dimming blocks in 5 rows and 12 columns, but the number and arrangement of dimming blocks are not limited to those shown in FIG. 3.

[0109] For example, each of the plurality of dimming blocks (301) may include at least one light source (311). The light source device (550) may supply the same driving current to the light sources (311) belonging to the same dimming block (301), and the light sources (311) belonging to the same dimming block (301) may emit light of the same brightness. For example, the light sources (311) belonging to the same dimming block (301) are connected in series with each other, thereby allowing the same driving current to be supplied to the light sources (311) belonging to the same dimming block (301).

[0110] According to one example, the dimming driver (540) can convert dimming data, which is a digital voltage signal, into an analog signal (e.g., analog driving current or voltage). The dimming driver can sequentially provide analog dimming signals to each driving element that controls the driving current applied to each dimming block (301), for example, in an active matrix manner. Each driving element of the dimming blocks (301) can provide an analog driving current corresponding to the analog dimming signal to the light source device (550). By the analog driving current, the light sources (311) included in the light source device (550) can emit light.

[0111] According to one example, the light source device (550) may include a plurality of driving elements (not shown) that control the driving current supplied to the light sources (311) included in each of the plurality of dimming blocks (301). The driving elements may each be provided corresponding to at least one dimming block (301). The driving elements may each drive the dimming blocks (301).

[0112] FIG. 6 is a flowchart illustrating a procedure for controlling local dimming in a display device (100) according to one example.

[0113] In the following examples, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0114] Referring to FIG. 6, the display device (100) can, in operation 601, track the user's gaze to obtain a movement path on the entire display screen of the display (e.g., the display (150) of FIG. 1). In the disclosure to be described later, the 'entire display screen of the display (150)' will be abbreviated as 'entire display screen'. According to one example, the display device (100) can track the user's gaze by at least one sensor (e.g., the sensor (530) of FIG. 5). The display device (100) can detect actual viewpoint coordinates corresponding to the movement of the tracked gaze on the entire display screen. The display device (100) can obtain a movement path of the user's gaze on the entire display screen based on the detected actual viewpoint coordinates. For example, the display device (100) can determine the movement path by connecting the actual viewpoint coordinates detected at a predetermined period by tracking the user's gaze. The actual time point coordinates may be, for example, coordinates on a planar orthogonal coordinate system where the user's gaze is directed on the entire display screen. According to one example, if the entire display screen includes a plurality of dimming blocks (301), the display device (100) can identify whether the actual time point coordinates corresponding to the movement of the user's gaze tracked by at least one sensor (130) have moved through a specific number of dimming blocks (301) among the plurality of dimming blocks (301). For example, if the actual time point coordinates have moved through a specific number of dimming blocks (301), the display device (100) can obtain a movement path from the first actual time point coordinates to the second actual time point coordinates. The first actual time point coordinates may be, for example, the actual time point coordinates first detected by tracking the user's gaze. The first actual time point coordinates may be, for example, the actual time point coordinates first detected after brightness control by local dimming based on the user's gaze is performed.The second actual measurement point coordinate may be, for example, the last actual measurement point coordinate detected by tracking the user's gaze. The second actual measurement point coordinate may be, for example, the actual measurement point coordinate detected at a point where brightness control by local dimming based on the user's gaze is required. In this case, the movement path from the first actual measurement point coordinate to the second actual measurement point coordinate may be a path that passes through a specific number of dimming blocks (301).

[0115] The display device (100) can determine, in operation 603, predicted point coordinates where the user's gaze is predicted to move across the entire display screen based on a movement path obtained based on actual point coordinates. A detailed explanation of this will be provided later with reference to FIG. 12.

[0116] In operation 605, the display device (100) may control the first luminance value and the second luminance value independently or individually. The first luminance value may be, for example, a luminance value to be applied to a first display area including the predicted viewpoint coordinates on the entire display screen. The second luminance value may be, for example, a luminance value to be applied to a second display area which is the remaining display area excluding the first display area on the entire display screen. According to one example, the display device (100) may control the first luminance value and the second luminance value differently from each other. According to one example, the display device (100) may control the first luminance value and the second luminance value identically. A detailed description thereof will be given later with reference to FIGS. 8 and 9.

[0117] FIGS. 7a and 7b are flowcharts for controlling local dimming in a display device according to one example (e.g., the display device (100) of FIG. 1).

[0118] In the following examples, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.

[0119] Referring to FIGS. 7a and 7b, the display device (100) can identify the presence of a user in operation 701. According to one example, the display device (100) can identify the presence of a user based on images captured periodically or non-periodically by a camera (e.g., sensor (530) of FIG. 5). The display device (100) can recognize the presence of a user, for example, by face recognition.

[0120] In response to identifying that a user is not present, for example, that a user is not recognized, the display device (100) can determine in operation 703 whether the number of times a user is not recognized exceeds a threshold number. According to one example, the display device (100) can count the number of images in which a user is not recognized among images captured by a camera (hereinafter referred to as 'number of times a user is not recognized'). For example, the threshold number can determine the frequency of operations that perform brightness adjustment based on the user's gaze. For example, if the threshold number is increased, the display device (100) can lower the frequency of operations that adjust brightness based on the user's gaze. For example, if the threshold number is decreased, the display device (100) can increase the frequency of operations that adjust brightness based on the user's gaze. According to one example, the display device (100) can set or update the threshold number based on user input.

[0121] In response to the number of times the user is not recognized exceeding a threshold number, the display device (100) may control the brightness value of the entire display screen of the display in operation 705. In the disclosure to be described later, the 'entire display screen of the display' will be abbreviated as 'entire display screen'. According to one example, the display device (100) may reduce the brightness of the entire display screen collectively. For example, the display device (100) may reduce the brightness of the entire display screen to a minimum value. According to one example, the display device (100) may reduce the brightness of the entire display screen by the same ratio. For example, the display device (100) may adjust the brightness adjustment ratio of each dimming block to a predetermined value (the brightness adjustment ratio is as described with reference to FIG. 5). For example, the predetermined value may be the same as the 'minimum set brightness adjustment ratio' per block implemented during local dimming. A detailed description of the minimum set brightness adjustment ratio will be described later with reference to FIG. 8.

[0122] The display device (100) can recognize multiple users in operation 707. For example, the display device (100) can recognize two, three, or more users. According to one example, the display device (100) can initialize the number of unrecognized users to 0 (zero) before performing operation 707.

[0123] In response to recognizing multiple users, the display device (100) can control the luminance value of the entire display screen in operation 709. For example, the display device (100) can control the luminance value of the entire display screen so that the entire display screen has a reference brightness. The reference brightness is, for example, the inherent brightness of the content (e.g., video input to the display device), which is a brightness that is not controlled based on the user's gaze. For example, the display device (100) can adjust the luminance adjustment ratio of each dimming block to 100%. Here, the reference for multiple users may be a number of people such that it is difficult to identify the users whose viewpoint movement is tracked to apply local dimming.

[0124] If multiple users are not recognized, the display device (100) can acquire viewpoint data regarding the user's viewpoint based on an image captured by a camera in operation 711. For convenience, the viewpoint data will be described by assigning numbers based on the order in which the viewpoint data is acquired. For example, the display device (100) can acquire the nth viewpoint data (where n is a natural number). For example, the display device (100) can acquire the first viewpoint data, the second viewpoint data, and the third viewpoint data sequentially. The first viewpoint data, the second viewpoint data, and the third viewpoint data can be acquired from continuous or discontinuous images among the images captured by a sensor (e.g., the sensor (530) of FIG. 5). For example, the first viewpoint data may include coordinates (X1, Y1) indicating the point on the display where the user's gaze is directed. For example, the first viewpoint data may include coordinates (X1, Y1) representing a point on the display where the user's gaze is directed, and a coordinate value Z1 corresponding to the position of the user's eye on the Z-axis, which is a direction perpendicular to the display. For example, the coordinate value Z1 corresponds to a distance value from the display to the user (or the user's eye). According to one example, the display device (100) may acquire viewpoint data periodically or non-periodically during a certain time interval.

[0125] The display device (100) can perform local dimming based on the first time point data obtained in operation 713. To do this, the display device (100) can obtain a first display area including coordinates (X1, Y1). According to one example, the display device (100) can control a first luminance value for the first display area so that the first display area has a reference brightness. For example, the display device (100) can set a luminance adjustment ratio for adjusting the luminance of the first display area to 100%. According to one example, the display device (100) can independently control the first luminance value for the first display area and the second luminance value for the second display area excluding the first display area from the entire display screen. According to one example, the display device (100) can control the second luminance value by applying a ratio that gradually decreases according to the distance from the predicted time point coordinates to the second display area. According to one example, the display device (100) can determine a brightness adjustment ratio for controlling a second brightness value. The brightness adjustment ratio for controlling the second brightness value will be explained in detail with reference to FIG. 9.

[0126] The display device (100) can acquire second time point data in operation 715. For example, the second time point data may include coordinates (X2, Y2) where the user's gaze is directed on the display. For example, the second time point data may include coordinates (X2, Y2) where the user's gaze is directed on the display and a coordinate value Z2 corresponding to the user's eye on the Z-axis, which is a direction perpendicular from the display. The second sensing data for providing the second time point data is acquired after the first sensing data for providing the first time point data. The timing at which the first sensing data and the second sensing data are acquired does not necessarily have to be consecutive.

[0127] The display device (100) can perform local dimming based on second time point data in operation 717. Since the local dimming in operation 717 is substantially the same as or duplicates the local dimming in operation 715, the description is omitted.

[0128] The display device (100) can obtain predicted time point data based on the first and second time point data obtained in operation 719 (time point data (X1, Y1) and Z1, and (X2, Y2) and Z2). For example, the predicted time point data may include coordinates (X3', Y3') indicating a point on the display where the user's gaze is predicted to be directed. For example, the predicted time point data may include coordinates (X3', Y3') where the user's gaze is predicted to be directed on the display and a coordinate value Z3' corresponding to the expected position of the user's eye on the Z-axis. The procedure for obtaining the predicted time point data will be described in detail with reference to FIG. 12.

[0129] The display device (100) can perform local dimming based on predicted time point data in operation 721. Since the local dimming in operation 721 is substantially the same as or duplicates the local dimming in operation 713, the description is omitted.

[0130] The display device (100) can identify, in operation 723, whether the predicted time point data and the actual time point data are substantially the same. For example, the actual time point data may include coordinates (X3, Y3) representing the point where the user's gaze is directed on the display. For example, the actual time point data may include coordinates (X3, Y3) and a coordinate value Z3 corresponding to the position of the user's eye on the Z-axis, which is a direction perpendicular to the display. For example, the display device (100) can identify whether the coordinates (X3', Y3') are substantially the same as the coordinates (X3, Y3). For example, the display device (100) can identify whether the coordinate value (Z3') is substantially the same as the coordinate value (Z3).

[0131] In response to a discrepancy between the actual time point data and the predicted time point data, the display device (100) may perform local dimming based on the actual time point data in operation 725. The display device (100) may return to operation 715 for acquiring the actual time point data. Subsequently, the display device (100) may perform the aforementioned local dimming operation 717 and operation 719 for acquiring the predicted time point data.

[0132] Meanwhile, in response to the actual time point data and the predicted time point data matching, the display device (100) can return to the operation 719 of acquiring the predicted time point data.

[0133] According to one example, even if the display device (100) is performing any operation in FIG. 7, in response to the user not being recognized, the display device (100) may return to operation 703. For example, even if the display device (100) is performing operation 717, in response to the number of times the user is not recognized being identified as exceeding a threshold level, the display device (100) may control the brightness value of the entire display screen so that the entire display screen of the display (150) has a brightness below the threshold level.

[0134] FIG. 8 illustrates an operation to control the brightness of a display (150) when no user is detected in a display device (100) according to one example.

[0135] Referring to FIG. 8, the display device (100) can control the brightness value of the entire display screen of the display (150) so that the entire display screen of the display (150) has a brightness level below a threshold level when no target user to track the gaze is detected by at least one sensor (e.g., sensor (530) of FIG. 5) for a predetermined time interval.

[0136] For example, the display device (100) can identify the presence of a user based on data collected by at least one sensor (530). The presence of a user can be detected, for example, by face recognition. For example, if the user is not facing the display screen, the user's face may be considered not to be recognized. Hereinafter, the failure to identify the presence of a user may be referred to as user non-recognition.

[0137] For example, the display device (100) can determine whether the user is not recognized for a predetermined time interval. For example, the display device (100) can determine whether the time during which the user is not recognized has exceeded the time interval of the predetermined time interval. For example, the display device (100) can acquire images by at least one sensor (530) at a frame rate. For example, the display device (100) can check for the presence of a user in each acquired image. For example, the display device (100) can count the number of images among the acquired images in which the user is not present, that is, images in which the user is not recognized ('number of times the user is not recognized'). For example, the display device (100) can identify whether the number of times the user is not recognized exceeds a threshold number.

[0138] If the user is recognized before the number of times the user is not recognized exceeds a threshold number, the display device (100) can reset the number of times the user is not recognized. At this time, the reset value may be '0 (zero)'.

[0139] According to one example, if the number of times a user is not recognized exceeds a threshold number, the display device (100) can control the luminance value of the entire display screen (810) so that the entire display screen (810) has a brightness below a threshold level. For example, the display device (100) can adjust the luminance adjustment ratio of the entire dimming block to a predetermined value. For example, the predetermined value may be the same as the minimum set luminance adjustment ratio (831) per block implemented during local dimming. A detailed description of the minimum set luminance adjustment ratio will be given later with reference to FIG. 9. In this way, if the display device (100) does not detect a target user to track the gaze during a predetermined time interval, the entire display screen (810) can control the luminance value of the entire display screen (810) so that the entire display screen (810) has a brightness below a threshold level.

[0140] According to one example, the display device (100) can control the brightness value of the entire display screen so that the entire display screen has a brightness level below a threshold level in the same manner as above, even when it is determined that a user is present for a predetermined time interval but the coordinates of the user's gaze on the display are not obtained (e.g., when the user is present in front of the display device (100) but is looking at an area other than the display screen).

[0141] FIG. 9 is a diagram illustrating the operation of obtaining a setting luminance adjust ratio when performing local dimming based on the user's gaze.

[0142] Referring to FIG. 9, the display device (100) can obtain coordinates (Xn, Yn) (910) (n is a natural number) representing the point on the display where the user (420)’s gaze is directed, in response to the recognition of the user (420). For example, the display device (100) can determine which of the plurality of dimming blocks the coordinates (Xn, Yn) (910) are located on. For example, the dimming block (920) containing the coordinates (Xn, Yn) (910) can be referred to as the ‘first block’.

[0143] According to one example, the display device (100) can obtain a set brightness adjustment ratio for each dimming block area. According to one example, the display device (100) can control the brightness of each dimming block area by applying the set brightness adjustment ratio for each dimming block area to the brightness of each dimming block area based on content. For example, the set brightness adjustment ratio for the first block area is 100%. In this case, the display device (100) can output the screen based on the original brightness without adjusting the brightness according to the content (e.g., video input to the display device). For example, the brightness of the first block area is output according to the brightness of the first block area based on content. For example, if the set brightness adjustment ratio for any block area is 70%, the display device (100) can reduce the brightness of the corresponding block area to 70% of the brightness of the corresponding block area based on content.

[0144] According to one example, the setting brightness adjustment ratio for each dimming block area follows the formula below.

[0145] Set brightness adjustment ratio for each dimming block area = 100 - (Dx*Δx) - (Dy*Δy)

[0146] In the above formula,

[0147] Dx is the difference in the luminance adjustment ratio per block unit in the x-axis direction;

[0148] Dy is the difference in the luminance adjustment ratio per block unit in the y-axis direction;

[0149] Δx is the number of blocks from the first block to each block in the x-axis direction;

[0150] Δy is the number of blocks from the first block to each block in the y-axis direction.

[0151] According to one example, Dx and Dy follow the formula below.

[0152] Dx = (100 - A) / (N / 2)

[0153] Dy = (100 - A) / (M / 2)

[0154] In the above formula, A is the minimum set brightness adjustment ratio.

[0155] For example, if the setting brightness adjustment ratio of a predetermined block is calculated to be A or less according to the above calculation formula, the display device (100) can set the setting brightness adjustment ratio of the block to A.

[0156] At this time, the display device (100) can set a minimum brightness adjustment ratio (931) by taking into account the distance (Z) from the display to the user. The area within the user's field of vision varies depending on the distance (Z) from the display to the user. For example, as the user moves further away from the display device (100), the area within the user's field of vision may be expanded to include the entire display screen area. Conversely, as the user moves closer to the display device (100), the area within the user's field of vision may be reduced to a part of the entire display screen area. For example, if the user is located close to the display device (100), the area within the user's field of vision may include at least a part of the entire display screen.

[0157] According to one example, the display device (100) can linearly increase the minimum setting brightness adjustment ratio as the user's viewing distance increases beyond a predetermined distance.

[0158] According to one example, the display device (100) can be identified as being located in an area where the user's viewing distance (Z) is divided into n sections (n ​​is a natural number greater than or equal to 1). The example below is described based on the user's viewing distance (Z) being located in an area divided into three sections, but the present disclosure is not limited thereto.

[0159] For example, if the Z value is smaller than a predetermined distance e, the display device (100) may set the minimum set brightness adjustment ratio to A. For example, the predetermined distance may be a viewing distance for the display device (100) to provide a stereoscopic image, but is not limited thereto.

[0160] For example, if the Z value is equal to or greater than a predetermined distance e and equal to or smaller than the distance f at which the entire display screen area comes into the user's field of vision, the display device (100) can set the minimum setting brightness adjustment ratio to Az. For example, the distance f can be determined according to the size of the display screen. For example, Az follows the formula below.

[0161] Az = A + (100-A)*(Ze) / (fe)

[0162] For example, if the Z value is greater than the distance f, the display device (100) can set the minimum setting brightness adjustment ratio to 100%.

[0163] In this way, the display device (100) can independently control a first luminance value for a first display area including the coordinates where the user's gaze is directed on the display, and a second luminance value for a second display area excluding the first display area from the entire display screen. For example, the display device (100) can control the second luminance value by applying a ratio that gradually decreases according to the distance from the predicted viewpoint coordinates to the second display area. At this time, the display device (100) can obtain the distance from the display to the user and determine a minimum set luminance adjustment ratio for controlling the second luminance value by considering the obtained distance. According to one example, the display device (100) can control the second luminance value by considering the distance from the display to the user.

[0164] FIG. 10 is a diagram illustrating the operation of changing the brightness adjustment ratio in a display device (100) according to one example. According to one example, the display device (100) may increase the brightness adjustment ratio. According to one example, the display device (100) may decrease the brightness adjustment ratio.

[0165] The left and right drawings of FIG. 10 illustrate the brightness adjustment ratio over time of any dimming block.

[0166] As described with reference to FIG. 9, the display device (100) can obtain a set luminance adjustment ratio of any dimming block for local dimming based on the user's gaze. According to one example, the display device (100) can obtain a luminance adjustment ratio applied to any dimming block at a specific point in time. According to one example, the display device (100) can obtain a luminance adjustment ratio applied before applying the set luminance adjustment ratio. Hereinafter, the luminance adjustment ratio applied before applying the set luminance adjustment ratio may be referred to as the start luminance adjustment ratio. When the display device (100) is first turned on or when the content image displayed on the display changes, the start luminance adjustment ratio may be 100%, but is not limited thereto.

[0167] Referring to the left side of FIG. 10, the display device (100) can maintain the starting brightness adjustment ratio (1010) at the starting brightness adjustment ratio (1020) or immediately increase it when the setting brightness adjustment ratio (1020) is equal to or higher than the starting brightness adjustment ratio (1010). Accordingly, the user can immediately see the screen displayed in the first display area brightly and clearly.

[0168] Referring to the right side of FIG. 10, the display device (100) can reduce the starting brightness adjustment ratio (1030) to the starting brightness adjustment ratio (1040) over a predetermined time interval when the setting brightness adjustment ratio (1040) of any dimming block is lower than the starting brightness adjustment ratio (1030). In this way, the display device (100) can gradually reduce the brightness of the second display area over a predetermined time interval. Accordingly, the user may not perceive that the brightness of the second display area is being reduced.

[0169] According to one example, the time unit change amount of the luminance adjustment ratio follows the following formula.

[0170] Time unit change in luminance adjustment ratio = |(Set luminance adjustment ratio - Start luminance adjustment ratio)| / Decrease time

[0171] In the above formula,

[0172] The set brightness adjustment ratio can be obtained in the manner described with reference to FIG. 9;

[0173] The starting brightness adjustment ratio is the brightness adjustment ratio applied before the display device (100) applies the set brightness adjustment ratio;

[0174] The falling time (FT) may be a time interval between 1 s and 20 s, but is not limited thereto.

[0175] According to one example, the display device (100) can obtain a starting brightness adjustment ratio in response to obtaining viewpoint data regarding the user's gaze (e.g., coordinates (Xn, Yn) where the user's gaze is directed on the display). According to one example, the display device (100) can obtain a starting brightness adjustment ratio in response to obtaining a set brightness adjustment ratio.

[0176] According to the above, the display device (100) can determine the brightness adjustment ratio of each dimming block at a specific time point. According to one example, the display device (100) can apply the determined brightness adjustment ratio to the dimming blocks to a frame to be displayed on the screen. For example, the display device (100) can immediately increase the brightness adjustment ratio for the dimming blocks of the first display area. For example, the display device (100) can gradually decrease the brightness adjustment ratio for the dimming blocks included in the second display area. According to one example, the display device (100) can control a first brightness value for the first display area so that the brightness of the first display area becomes bright immediately. According to one example, the display device (100) can control a second brightness value for the second display area so that the brightness of the second display area becomes gradually dimmed over a predetermined time interval. Accordingly, the display device (100) can improve power consumption without affecting the image quality perceived by the user.

[0177] FIG. 11 is a diagram illustrating the operation of updating the brightness adjustment ratio in response to the user's gaze in a display device (100) according to one example.

[0178] Referring to the top drawing of FIG. 11, the display device (100) can analyze information regarding the user's gaze to predict or measure and obtain reference coordinates where the user's gaze is directed on the entire display screen. For example, the display device (100) can obtain reference coordinates (X1, Y1) (1101). The display device (100) can obtain reference coordinates (X2, Y2) (1103). The display device (100) can obtain reference coordinates (X3, Y3) (1105). For example, reference coordinates (X1, Y1) (1101), reference coordinates (X2, Y2) (1103), and reference coordinates (X3, Y3) (1105) can be obtained in order according to the flow of time. For the sake of convenience of explanation, reference coordinates (X1, Y1) (1101), (X2, Y2) (1103), and (X3, Y3) (1105) are referred to as the first reference coordinate, the second reference coordinate, and the third reference coordinate, respectively, but the above reference coordinates are not limited to being obtained during a continuous time interval.

[0179] According to one example, in response to identifying a change in time point data (e.g., reference coordinates and / or distance from the display to the user), the display device (100) may perform local dimming based on the changed time point data. According to one example, whenever local dimming based on time point data is performed, the display device (100) may newly acquire a set brightness adjustment ratio and a currently applied brightness adjustment ratio for any dimming block. For example, the display device (100) may identify a change in time point data before the reduction time (FT) for local dimming based on specific time point data has elapsed. In this case, the display device (100) may perform local dimming based on the changed time point data even if the reduction time (FT) for local dimming based on specific time point data has not elapsed. For example, a change in time point data includes a change (or shift) in the reference coordinates. For example, in response to identifying a change (or shift) in the reference coordinates, the display device (100) may perform local dimming based on the changed reference coordinates.

[0180] The graph at the bottom of Fig. 11 shows the luminance adjustment ratio over time of any block included in the second display area when the reference coordinates move as shown at the top of Fig. 11.

[0181] For example, in response to acquiring a first reference coordinate (1101), the display device (100) may acquire a set brightness adjustment ratio (1109) to perform local dimming. The set brightness adjustment ratio (1109) may be referred to as the 'first set brightness adjustment ratio (1109)'. According to one example, the display device (100) may acquire a starting brightness adjustment ratio (1107) applied before applying the first set brightness adjustment ratio (1109). The starting brightness adjustment ratio (1107) may be referred to as the 'first starting brightness adjustment ratio (1107)'. According to one example, the display device (100) may reduce the brightness adjustment ratio from the first starting brightness adjustment ratio (1107) to the first set brightness adjustment ratio (1109) during a first reduction time (FT1).

[0182] For example, in response to acquiring a second reference coordinate (1103) before the first reduction time (FT1) has elapsed, the display device (100) may acquire a set brightness adjustment ratio (1113) to perform local dimming. The set brightness adjustment ratio (1113) may be referred to as the 'second set brightness adjustment ratio (1113)'. According to one example, the display device (100) may acquire an applied starting brightness adjustment ratio (1111) before applying the second set brightness adjustment ratio (1113). The starting brightness adjustment ratio (1111) may be referred to as the 'second starting brightness adjustment ratio (1111)'. According to one example, the display device (100) may reduce the brightness adjustment ratio from the second starting brightness adjustment ratio (1111) to the second set brightness adjustment ratio (1113) during the second reduction time (FT2).

[0183] For example, in response to acquiring a third reference coordinate (1105) before the second reduction time (FT2) has elapsed, the display device (100) may acquire a set brightness adjustment ratio (1117) to perform local dimming. The set brightness adjustment ratio (1117) may be referred to as the 'third set brightness adjustment ratio (1117)'. According to one example, the display device (100) may acquire a starting brightness adjustment ratio (1115) applied before applying the third set brightness adjustment ratio (1117). The starting brightness adjustment ratio (1115) may be referred to as the 'third starting brightness adjustment ratio (1115)'. According to one example, the display device (100) may reduce the brightness adjustment ratio from the third starting brightness adjustment ratio (1115) to the third set brightness adjustment ratio (1117) during the third reduction time (FT3). According to one example, the first reduction time (FT1), the second reduction time (FT2), and the third reduction time (FT3) may be the same or different from each other.

[0184] According to one example, in a display device (100), the reduction time (FT) may be longer than the time taken to perform the operation of determining the predicted point-time coordinates where the user's gaze is predicted to move across the entire display screen based on the movement path of the actual point-time coordinates. The movement path of the actual point-time coordinates corresponding to the movement of the gaze tracked across the entire display screen of the display (150) can be obtained by tracking the user's gaze. According to one example, the display device (100) may obtain the predicted point-time coordinates before a predetermined reduction time (FT) has elapsed and perform local dimming based on the predicted point-time coordinates.

[0185] FIG. 12 is a diagram illustrating the determination of prediction time point coordinates in a display device according to one example.

[0186] Referring to FIG. 12, the display device (100) can track the user's gaze by at least one sensor (130) to obtain a movement path of actual time point coordinates corresponding to the movement of the tracked gaze on the entire display screen, and determine a predicted time point coordinate where the user's gaze is predicted to move on the entire display screen based on the movement path of the actual time point coordinates.

[0187] For example, a display device (100) can track the user's gaze by at least one sensor (e.g., sensor (530) of FIG. 5) to obtain a movement path of actual viewpoint coordinates (Xn, Yn) (1201) and (Xn+1, Yn+1) (1203) corresponding to the movement of the tracked gaze on the entire display screen of the display (150). According to one example, the actual viewpoint coordinates (Xn, Yn) (1201) and (Xn+1, Yn+1) (1203) can be obtained from continuous or discontinuous images among images captured by, for example, a camera (e.g., sensor (530) of FIG. 5). According to one example, the display device (100) can obtain predicted viewpoint coordinates (X'n+2, Y'n+2) (1205) where the user's gaze is predicted to move, based on the movement path of the actual viewpoint coordinates (Xn, Yn) (1201) and (Xn+1, Yn+1) (1203).

[0188] For example, the predicted time point coordinates (X'n+2, Y'n+2)(1205) can be determined according to the following equations I and II.

[0189] X'n+2 = Xn+1 + (Xn+1 - Xn) Equation I

[0190] Y'n+2 = Yn+1 + (Yn+1 - Yn) Equation II

[0191] According to one example, the display device (100) can perform local dimming based on predicted time point coordinates (X'n+2, Y'n+2) (1205). According to one example, the display device (100) can independently control a first luminance value for a first display area including the predicted time point coordinates on the entire display screen and a second luminance value for a second display area excluding the first display area on the entire display screen.

[0192] According to one example, the display device (100) can obtain a change in distance (Zn) and (Zn+1) from the display to the user by tracking the user's gaze with at least one sensor (530). According to one example, the distance (Zn) and (Zn+1) can be obtained from continuous or discontinuous images among images captured by, for example, a camera (e.g., sensor (530) of FIG. 5). According to one example, the display device (100) can obtain a predicted distance (Z'n+2) that the user is expected to move based on the change in distance (Zn) and (Zn+1).

[0193] For example, the predicted separation distance (Z'n+2) can be determined according to the following Equation III.

[0194] Z'n+2 = Zn+1 + (Zn+1 - Zn) Equation III

[0195] According to one example, the display device (100) can perform local dimming based on predicted time point coordinates (X'n+2, Y'n+2) (1205) and predicted separation distance (Z'n+2).

[0196] According to one example, the display device (100) can obtain specific actual time point coordinates (Xn+2, Yn+2) by tracking the user's gaze with at least one sensor (530). According to one example, the display device (100) can compare whether the predicted time point coordinates (X'n+2, Y'n+2) and the actual time point coordinates (Xn+2, Yn+2) are substantially the same. According to one example, the time interval between the time at which sensing data is obtained to obtain the actual time point coordinates (Xn, Yn) (1201) and the time at which sensing data is obtained to obtain the actual time point coordinates (Xn+1, Yn+1) (1203) may be substantially the same as the time interval between the time at which sensing data is obtained to obtain the actual time point coordinates (Xn+1, Yn+1) (1203) and the time at which sensing data is obtained to obtain the actual time point coordinates (Xn+2, Yn+2).

[0197] According to one example, if the predicted time point coordinates (X'n+2, Y'n+2) and the actual time point coordinates (Xn+2, Yn+2) are substantially the same, the display device (100) can repeat the prediction operation. For example, after obtaining the actual time point coordinates (Xn+2, Yn+2), the display device (100) can obtain additional predicted time point coordinates by substituting Xn+1 for Xn and Xn+2 for Xn+1 in Equation I, and substituting Yn+1 for Yn and Yn+2 for Yn+1 in Equation II.

[0198] According to one example, if the predicted time point coordinates and the actual time point coordinates are substantially inconsistent, the display device (100) can perform local dimming based on the actual time point coordinates (Xn+2, Yn+2). The display device (100) can perform a prediction operation based on the acquired actual time point coordinates after additionally obtaining the actual time point coordinates on the display where the user's gaze is directed from the image captured by the camera. For example, if the predicted time point coordinates and the actual time point coordinates are substantially inconsistent, the display device (100) performs operation 725 as shown in FIG. 7 and then returns to operation 715.

[0199] According to one example, the display device (100) can predict the user's viewpoint data and perform local dimming based on the predicted viewpoint data. Accordingly, local dimming can be performed smoothly without delay according to the acquisition and processing of actual viewpoint data by the processor (520).

[0200] Figures 13a and 13b are drawings for explaining simulation results regarding brightness control of a display according to one example.

[0201] Referring to FIGS. 13a and 13b, the display device (100) may include 15 x 37 dimming blocks. The minimum setting brightness adjustment ratio for local dimming is set to 70%.

[0202] Referring to FIG. 13a, it was confirmed that when the coordinates (1301) where the user's gaze is directed on the display screen of the display (150) are located in the center area of ​​the display screen of the display (150), power consumption is reduced by 25.4%.

[0203] Referring to FIG. 13b, it was confirmed that power consumption is reduced by 27.5% when the coordinate (1303) where the user’s gaze is directed on the display screen of the display (150) is located in the outer area of ​​the display screen of the display (150). In this way, power consumption can be further reduced when the coordinate where the user’s gaze is directed on the display screen of the display (150) is located in the outer area of ​​the display screen of the display (150) compared to when it is located in the center area of ​​the display screen of the display (150).

[0204] According to one example, a display device (100) comprises at least one sensor (130); a display (150); a memory (160) including one or more storage media for storing instructions; and at least one processor (120) including a processing circuit, wherein when the instructions are executed individually or collectively by at least one processor (120), the display device (100) is caused to perform at least one operation, and the at least one operation may include: an operation of tracking a user's gaze by the at least one sensor (130) to obtain a movement path of actual time point coordinates corresponding to the movement of the tracked gaze on the entire display screen of the display (150); an operation of determining a predicted time point coordinate where the user's gaze is predicted to move on the entire display screen based on the movement path of the actual time point coordinates; and an operation of independently controlling a first luminance value for a first display area including the predicted time point coordinates on the entire display screen and a second luminance value for a second display area excluding the first display area on the entire display screen.

[0205] According to one example, when the above instructions are executed individually or collectively by at least one processor (120), they may cause the operation of controlling the second luminance value by applying a rate that gradually decreases according to the distance from the predicted time point coordinates to the second display area.

[0206] According to one example, when the above instructions are executed individually or collectively by at least one processor (120), the operation to control the second luminance value may be performed so that the brightness of the second display area can gradually darken over a predetermined time interval.

[0207] According to one example, when the above instructions are executed individually or collectively by at least one processor (120), they may cause an operation to control the first luminance value so that the brightness of the first display area can be immediately brightened.

[0208] According to one example, when the instructions are executed individually or collectively by at least one processor (120), the operation of identifying a specific dimming block containing the predicted time point coordinates among a plurality of dimming blocks dividing the entire display screen; and the operation of independently controlling the brightness values ​​of the identified specific dimming block and the surrounding dimming blocks of the identified specific dimming block may be performed.

[0209] According to one example, when the above instructions are executed individually or collectively by at least one processor (120), the operation to reduce the luminance value of a second peripheral dimming block, which is relatively far from the predicted time point coordinates among the peripheral dimming blocks, by a greater margin than the luminance value of a first peripheral dimming block, which is relatively close to the predicted time point coordinates.

[0210] According to one example, when the instructions are executed individually or collectively by at least one processor (120), if the specific actual time point coordinates corresponding to the tracked line of sight do not match the predicted time point coordinates, it may cause the operation to independently control a third luminance value for a third display area including the specific actual time point coordinates in the entire display screen and a fourth luminance value for a fourth display area excluding the third display area in the entire display screen.

[0211] According to one example, when the instructions are executed individually or collectively by at least one processor (120), if a target user to be tracked for a predetermined time interval is not detected by the at least one sensor (130), it may cause the operation to control the brightness value of the entire display screen so that the entire display screen has a brightness below a threshold level.

[0212] According to one example, when the instructions are executed individually or collectively by at least one processor (120), if multiple users are detected by the at least one sensor (130), it may cause an operation to be performed to control the brightness value of the entire display screen so that the entire display screen has a reference brightness.

[0213] According to one example, when the above instructions are executed individually or collectively by at least one processor (120), they may cause the operation of obtaining a distance from the display (150) to the user by the at least one sensor (130); and the operation of controlling the second brightness value in consideration of the distance from the display (150) to the user.

[0214] According to one example, a control method for a display device (100) may include: tracking a user's gaze by at least one sensor (130) to obtain a movement path of actual time point coordinates corresponding to the movement of the tracked gaze on the entire display screen of the display (150); determining a predicted time point coordinate where the user's gaze is predicted to move on the entire display screen based on the movement path of the actual time point coordinates; and independently controlling a first luminance value for a first display area including the predicted time point coordinates on the entire display screen and a second luminance value for a second display area excluding the first display area on the entire display screen.

[0215] According to one example, the method may include an operation to control the second luminance value by applying a ratio that gradually decreases according to the distance from the predicted time point coordinates to the second display area.

[0216] According to one example, the method may include an operation to control the second luminance value so that the brightness of the second display area can gradually darken over a predetermined time interval.

[0217] According to one example, the method may include an operation to control the first luminance value so that the brightness of the first display area can be immediately brightened.

[0218] According to one example, the method may include: identifying a specific dimming block containing the predicted time point coordinates among a plurality of dimming blocks that divide the entire display screen; and independently controlling the brightness values ​​of the identified specific dimming block and the surrounding dimming blocks of the identified specific dimming block.

[0219] According to one example, the method may include an operation to reduce the luminance value of a second surrounding dimming block, which is relatively far from the predicted time point coordinates among the surrounding dimming blocks, by a greater margin than the luminance value of a first surrounding dimming block, which is relatively close to the predicted time point coordinates.

[0220] According to one example, if the specific actual time point coordinates corresponding to the tracked line of sight do not match the predicted time point coordinates, the method may include an operation of independently controlling a third luminance value for a third display area including the specific actual time point coordinates on the entire display screen and a fourth luminance value for a fourth display area excluding the third display area on the entire display screen.

[0221] According to one example, the method may include an operation to control the brightness value of the entire display screen so that the entire display screen has a brightness level below a threshold level when a target user to be tracked for a predetermined time interval is not detected by the at least one sensor (130).

[0222] According to one example, the method may include an operation to control the brightness value of the entire display screen so that the entire display screen has a reference brightness when a plurality of users are detected by the at least one sensor (130).

[0223] According to one example, the method may include the operation of obtaining a distance from the display (150) to the user by the at least one sensor (130); and the operation of controlling the second brightness value in consideration of the distance from the display (150) to the user.

[0224] The various embodiments of the present invention disclosed in this specification and drawings are provided merely as specific examples to facilitate the explanation of the technical content of the invention and to aid in understanding the invention, and are not intended to limit the scope of the invention. Accordingly, the scope of the present invention should be interpreted to include all modifications or variations derived based on the technical concept of the invention, in addition to the embodiments disclosed herein.

Claims

In a display device (100), Sensor (130); Display screen (150); Memory (160) configured to store instructions; and It includes at least one processor (120) configured to execute the stored instructions individually and / or collectively, and The above-mentioned at least one processor is, Based on the information acquired by the sensor, the user's gaze is tracked to obtain the movement path of viewpoint coordinates corresponding to the movement path of the tracked gaze on the display screen, and Determining predicted viewpoint coordinates on the display screen where the user's gaze is predicted to move based on the movement path of the above viewpoint coordinates, and Controlling a first brightness value for a first display area of ​​the display screen including the above-mentioned predicted time point coordinates, and A display device (100) that controls a second brightness value for a second display area of ​​the display screen excluding the first display area, wherein the second brightness value is different from the first brightness value. In paragraph 1, A display device configured such that the above instructions control the second brightness value to decrease based on the distance from the predicted time point coordinates. In paragraph 1 or 2, The above instructions are configured to control the second luminance value so that the brightness of the second display area can be lowered over time intervals. A display device. In any one of paragraphs 1 through 3, A display device configured such that the above instructions control the first luminance value so that the brightness of the first display area can be increased immediately. In any one of paragraphs 1 through 4, The above instructions identify a dimming block of the display screen containing the predicted time point coordinates among a plurality of dimming blocks that divide the display screen, and A display device configured to independently control the luminance value of the identified dimming block and the luminance value of the dimming blocks surrounding the identified dimming block among the plurality of dimming blocks. In paragraph 5, Among the dimming blocks surrounding the identified dimming block, the first dimming block has a first separation distance from the predicted time point coordinates, Among the dimming blocks surrounding the identified dimming block, the second dimming block has a second separation distance from the predicted time point coordinates, A display device configured such that the above instructions reduce the brightness value of the second dimming block by a greater margin than the brightness value of the first dimming block. In any one of paragraphs 1 through 6, The above instructions are, Based on the fact that the viewpoint coordinates corresponding to the user's gaze do not match the predicted viewpoint coordinates, Controlling a third brightness value for a third display area of ​​the display screen including the viewpoint coordinates corresponding to the user's gaze, and A display device configured to control a fourth brightness value for a fourth display area of ​​the display screen, excluding the third display area. In any one of paragraphs 1 through 7, A display device configured such that the above instructions control the brightness value of the entire display screen to have a brightness level below a threshold level based on the determination that the user's gaze is not detected during the time interval. In any one of paragraphs 1 through 8, A display device configured such that the above instructions control the luminance value of the entire display screen to have a reference brightness based on the determination that multiple users are gazing at the display screen. In any one of paragraphs 1 through 9, The above instructions obtain the separation distance between the display screen and the user based on the information obtained by the sensor, and A display device configured to control the second brightness value based on the separation distance between the display screen and the user. In a method for controlling a display device (100), The display device comprises a sensor (130), a display screen (150), a memory (160) configured to store instructions, and at least one processor (120) configured to perform the method by executing the stored instructions individually and / or collectively. The above method is, An operation of tracking the user's gaze based on information acquired by the sensor above, and acquiring the movement path of viewpoint coordinates corresponding to the movement path of the tracked gaze on the display screen; An operation to determine predicted viewpoint coordinates on the display screen where the user's gaze is predicted to move based on the movement path of the above viewpoint coordinates; An operation to control a first luminance value for a first display area of ​​the display screen including the predicted time point coordinates; and Operation of controlling a second luminance value for a second display area of ​​the display screen excluding the first display area - wherein the second luminance value is different from the first luminance value - A control method including In Paragraph 11, Operation to control the second luminance value to decrease based on the separation distance from the above-mentioned prediction time point coordinates A control method that further includes In Article 11 or Article 12, Operation of controlling the second luminance value so that the brightness of the second display area can be lowered over time intervals A control method that further includes In any one of paragraphs 11 through 13, Operation of controlling the first luminance value so that the brightness of the first display area can be increased immediately A control method that further includes In any one of paragraphs 11 through 14, An operation of identifying a dimming block of the display screen including the predicted time point coordinates among a plurality of dimming blocks dividing the display screen; and Operation of independently controlling the luminance value of the identified dimming block and the luminance values ​​of the dimming blocks surrounding the identified dimming block among the plurality of dimming blocks. A control method that further includes

Images