Display device and image display method therefor

Abstract

A display device is disclosed. The display device comprises: a sensor; a display; and one or more processors for displaying an HDR image having a first luminance range on the display, and displaying an HDR image having a second luminance range on the display on the basis of a user being identified as being within a predetermined distance from the display by a sensor while the HDR image having the first luminance range is displayed. The maximum value of the second luminance range may be smaller than the maximum value of the first luminance range.

Description

Display device and image display method thereof

[0001] Embodiments of the present disclosure relate to a display device for displaying an image and a method for displaying the image thereof.

[0002] Display devices such as digital signage (or signage devices) can be installed in indoor or outdoor locations to provide various contents, advertisements, etc.

[0003] Recently, as the demand for high-brightness images has increased significantly, digital signage that provides high-brightness images has been increasing in number.

[0004] However, users may experience unexpected discomfort due to the strong light emitted from digital signage displaying high-brightness images.

[0005] One or more embodiments provide a display device for displaying an image and a method for displaying the image.

[0006] According to one or more aspects of the present invention, a display device is provided, comprising a sensor, a display, and one or more processors for displaying an HDR image having a first luminance range on the display, and displaying an HDR image having a second luminance range on the display based on a user being identified by the sensor as being within a predetermined distance from the display while the HDR image having the first luminance range is being displayed. A maximum value of the second luminance range may be less than a maximum value of the first luminance range.

[0007] The maximum value of the first luminance range may be the peak luminance of the display, and the maximum value of the second luminance range may be the maximum luminance of the display.

[0008] The one or more processors may identify the user as being within the preset distance from the display based on the sensor detecting that the user is within the preset distance from the display.

[0009] The one or more processors can identify that the user is within the predetermined distance from the display based on the sensor detecting that the user is within the predetermined distance from the display device in front of the display, and can identify that the user is not within the predetermined distance from the display based on the sensor detecting that the user is within the predetermined distance from the display device in the rear of the display device.

[0010] The one or more processors may display an HDR image having the first luminance range on the display based on the sensor identifying that the user is not within the preset distance from the display while the HDR image having the second luminance range is displayed.

[0011] The one or more processors can display an HDR image having the second luminance range on the display for a preset period of time from a time when the user is identified as being within the preset distance from the display, and can display the HDR image having the first luminance range on the display based on the elapsed period of time.

[0012] The one or more processors can maintain the HDR image having the second luminance range displayed on the display based on the sensor identifying that the user is within the preset distance from the display within the preset time.

[0013] The one or more processors may display an HDR image having the second luminance range on the display based on at least one user among a plurality of users around the display being identified by the sensor as being within the preset distance from the display while the HDR image having the first luminance range is displayed.

[0014] The one or more processors may identify a characteristic of a user within the preset distance from the display, and based on the characteristic of the user being the first characteristic, display an HDR image having the second luminance range on the display, and based on the characteristic of the user being the second characteristic, display an HDR image having a third luminance range on the display. The characteristic of the user may be determined based on an age of the user, and a maximum value of the third luminance range may be less than a maximum value of the second luminance range.

[0015] The one or more processors can identify the user's gaze direction by the sensor and display a portion of the HDR image displayed in an area corresponding to the gaze direction on the display in the second luminance range.

[0016] A method of displaying an image of a display device including a sensor according to another aspect of one or more embodiments is provided. The method comprises the steps of displaying an HDR image having a first luminance range on a display, and displaying an HDR image having a second luminance range on the display based on the sensor identifying that a user is within a preset distance from the display while the HDR image having the first luminance range is displayed, wherein a maximum value of the second luminance range is less than a maximum value of the first luminance range.

[0017] The maximum value of the first luminance range may be the peak luminance of the display, and the maximum value of the second luminance range may be the maximum luminance of the display.

[0018] The method may further include a step of identifying the user as being within a preset distance from the display based on the sensor detecting that the user is within a preset distance from the display.

[0019] The method may further include a step of identifying the user as being within the predetermined distance from the display based on the sensor detecting the user as being within the predetermined distance from the display device in front of the display, and a step of identifying the user as not being within the predetermined distance from the display based on the sensor detecting the user as being within the predetermined distance from the display device in the rear of the display device.

[0020] The method may further include the step of displaying an HDR image having the first luminance range on the display based on the sensor identifying that the user is not within the preset distance from the display while the HDR image having the second luminance range is displayed.

[0021] The method may further include the step of displaying an HDR image having the second luminance range on the display for a preset period of time from a time point when the user is identified as not being within the preset distance from the display, and the step of displaying the HDR image having the first luminance range on the display based on the elapsed time of the preset period of time.

[0022] The method may further include the step of maintaining the HDR image having the second luminance range displayed on the display based on the sensor identifying that the user is within the preset distance from the display within the preset time.

[0023] The method may further include a step of displaying an HDR image having the second luminance range on the display based on at least one user among a plurality of users around the display being identified by the sensor as being within the preset distance from the display while the HDR image having the first luminance range is displayed.

[0024] The method may further include the steps of identifying a characteristic of a user within the preset distance from the display, displaying an HDR image having the second luminance range on the display based on the characteristic of the user being the first characteristic, and displaying an HDR image having a third luminance range on the display based on the characteristic of the user being the second characteristic. The characteristic of the user may be determined based on an age of the user, and a maximum value of the third luminance range may be less than a maximum value of the second luminance range.

[0025] The method may further include a step of identifying a gaze direction of the user by the sensor and a step of displaying a portion of the HDR image displayed in an area corresponding to the gaze direction on the display in the second luminance range.

[0026] The embodiments will be more clearly understood from the detailed description written together with the attached drawings.

[0027] FIG. 1 is a diagram illustrating an example of a display device according to one or more embodiments.

[0028] FIG. 2A is a block diagram illustrating a configuration of a display device according to one or more embodiments.

[0029] FIG. 2b is a block diagram illustrating a configuration of a display device according to one or more embodiments.

[0030] FIGS. 3a, 3b, 4a, 4b, 5a, 5b, 5c, 6a, 6b, 7a, 7b, 7c, 8, 9a, and 9b are drawings illustrating various examples of a display device displaying HDR images depending on whether a user is relatively close to the display, according to one or more embodiments.

[0031] FIGS. 10A and 10B are diagrams illustrating examples of a luminance range of a display depending on whether a user is relatively close to the display according to one or more embodiments.

[0032] FIG. 11 is a flowchart illustrating a method of displaying an image on a display device according to one or more embodiments.

[0033] It should be understood that the various embodiments of the present disclosure and the terminology used therein are not intended to limit the technical features described in the present disclosure to specific embodiments, but rather to include various modifications, equivalents, or substitutes of the embodiments.

[0034] In connection with the description of the drawings, similar reference numerals may be used for similar or related components.

[0035] The singular form of a noun corresponding to an item may include one or more items, unless the context clearly indicates otherwise.

[0036] In this disclosure, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can each include any one of the items listed together in that phrase, or all possible combinations thereof. For example, "A or B," "at least one of A and B," or "at least one of A or B" can all refer to (1) including at least one A, (2) including at least one B, or (3) including both at least one A and at least one B.

[0037] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another and do not qualify the components in any other respect (e.g., importance or order).

[0038] When a component (e.g., a first component) is referred to as being “coupled” or “connected” to another component (e.g., a second component), with or without the terms “functionally” or “communicatively,” it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0039] The terms "include" or "have" are intended to specify the presence of a feature, number, step, operation, component, part or combination thereof described in this document, but do not preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0040] When a component is said to be “connected,” “coupled,” “supported,” or “in contact with” another component, this includes not only cases where the components are directly connected, coupled, supported, or in contact, but also cases where the components are indirectly connected, coupled, supported, or in contact through a third component.

[0041] When we say that a component is "on" another component, this includes not only cases where the component is in contact with the other component, but also cases where there is another component between the two components.

[0042] The term "and / or" includes any combination of a plurality of related described elements or any one of a plurality of related described elements.

[0043] In some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0044] In the embodiments, a "module" or "part" performs at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of "modules" or "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "module" or "part" that needs to be implemented as specific hardware.

[0045] Meanwhile, the various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0046] One or more embodiments are described in more detail with reference to the attached drawings.

[0047] FIG. 1 is a diagram illustrating an example of a display device according to one or more embodiments.

[0048] A display device (100) according to one or more embodiments may be, for example, a digital signage.

[0049] Digital signage is a digital video device installed in places with high traffic or where people spend a significant amount of time, providing various information and advertisements. Digital signage can be installed on streets, inside buildings, or on building exterior walls. Digital signage can also include video walls, which use multiple display devices to display images on a single screen.

[0050] The display device (100) can display an image to which HDR (High Dynamic Range) technology is applied (hereinafter referred to as HDR image).

[0051] For example, the brightness range that a display can express is narrow compared to the brightness range perceived by the human eye. HDR technology can overcome this by implementing an image that relatively maximizes the difference between the bright and dark parts of the image, thereby expanding the brightness range of the image as closely as possible to what the human eye sees directly. Since the luminance range of HDR is wider than that of SDR (Standard Dynamic Range), HDR images can express bright areas of the image brighter and dark areas darker than SDR images.

[0052] The display device (100) can display HDR images having different luminance ranges depending on whether the user (10) is relatively close to the display (120), for example, within a preset distance from the display (120).

[0053] For example, the display device (100) may display an HDR image having a first luminance range when there is no user (10) relatively close to the display (120), and may display an HDR image having a second luminance range when the user (10) is relatively close to the display (120). The luminance range of the HDR image displayed on the display (120) may change from the first luminance range to the second luminance range. At this time, the maximum value of the second luminance range is smaller than the maximum value of the first luminance range.

[0054] Since the display device (100) is installed in a public place (e.g., government office, subway, bus stop, etc.) or a commercial space (e.g., shopping mall, restaurant, etc.), if a high-brightness image is suddenly output to the display (120), unexpected problems may occur depending on the installation location and surrounding environment (vicinity). For example, if the display (120) suddenly outputs strong light, a user (10) who is relatively close to the display (120) may feel pain and glare in the eyes due to the stimulation by the strong light momentarily, and may have a negative effect on eyesight.

[0055] Accordingly, according to one or more embodiments, the same HDR image may be displayed in different luminance ranges depending on the relative proximity of the user to the display (120), thereby more effectively conveying advertisements or information in public places while reducing the risk of a user who is relatively close to the display (120) being suddenly exposed to bright light.

[0056] FIG. 2A is a block diagram illustrating a configuration of a display device according to one or more embodiments.

[0057] Referring to FIG. 2A, a display device (100) may include a sensor (110), a display (120), and one or more processors (130).

[0058] The sensor (110) can detect the area around the display (120). For example, the sensor (110) can detect the area around the display (120) at regular time intervals. The area around the display (120) can include the area in front of the display (120). For example, the display (120) is placed on the front of the display device (100), and the sensor (110) can detect the area in front of the display (120).

[0059] The sensor (110) can detect the surroundings of the display (120) and detect that the user is relatively close to the display (120). For example, the sensor (110) can detect the surroundings of the display (120) and generate an electrical signal or data value indicating the presence or absence of a user or the degree to which the user is relatively close to the display (120) (e.g., the distance between the user and the display (120), and provide the generated electrical signal or data value to one or more processors (130).

[0060] For example, the sensor (110) may include at least one of an ultrasonic sensor and a PIR sensor (passive infrared sensor).

[0061] The ultrasonic sensor outputs ultrasonic waves around the display (120), and when ultrasonic waves reflected from a user are received, the sensor measures the time difference it takes for the ultrasonic waves to be reflected from the user and return, and using the measured time difference, the sensor can detect the presence or absence of a user around the display (120), the distance between the display (120) and the user, the speed of the user, etc.

[0062] A PIR sensor can detect a user using infrared rays. For example, a PIR sensor can detect changes in infrared rays emitted from a user within an angular range corresponding to a specific area, and can use the detected changes in infrared rays to detect the presence of a user around a display (120), the distance between the display (120) and the user, etc.

[0063] Additionally, the sensor (110) may include a camera. For example, the camera may be implemented as an RGB camera, a depth camera, etc. The camera may capture images by taking pictures of the area around the display (120) and provide the captured images to one or more processors (130). The camera may include a lens, an image sensor, an image signal processor, etc. The images captured by the camera may be used to detect the presence or absence of a user around the display (120), the distance between the display (120) and the user, the direction of the user's gaze, etc.

[0064] The display (120) can display an image. For example, the display (120) can display a screen including a broadcast program, various information, advertisements, etc.

[0065] The display (120) may be implemented as an LED display. An LED display may refer to a display panel that uses LEDs as pixels. For example, the LED may include not only a regular LED but also a micro LED. A micro LED is an LED with a size of 100 micrometers (μm) or less, and is an ultra-small light-emitting element that emits light on its own. Compared to a liquid crystal display (LCD) panel that requires a backlight, an LED display can provide better contrast, response time, and energy efficiency. In addition, an LED display has the advantage of being relatively free from power constraints and pixel degradation, being able to output high-brightness images of several thousand nits, and also being able to maintain peak brightness for a long period of time. Furthermore, the display (120) may be implemented as a flat display, a curved display with a fixed curvature, or a curvature-variable display with a changeable curvature.

[0066] One or more processors (130) control the overall operation of the display device (100). For example, one or more processors (130) may be connected to components of the display device (100) to control the overall operation of the display device (100). For example, one or more processors (130) may be connected to a sensor (110) and a display (120) to control the display device (100). One or more processors (130) may be composed of one or more processors.

[0067] One or more processors (130) may perform operations of the display device (100) according to one or more embodiments by executing one or more instructions stored in the memory of the display device (100).

[0068] The one or more processors (130) may include one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors (130) may control one or any combination of other components of the display device (100) and perform operations or data processing related to communication. The one or more processors (130) may execute one or more programs or instructions stored in a memory. For example, the one or more processors (130) may perform a method according to one or more embodiments by executing one or more instructions stored in a memory.

[0069] When a method according to one or more embodiments includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to one or more embodiments, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-specific processor).

[0070] One or more processors (130) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicore or heterogeneous multicore). When one or more processors (130) are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to one or more embodiments, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to one or more embodiments.

[0071] When a method according to one or more embodiments includes a plurality of operations, the plurality of operations may be performed by one core among the plurality of cores included in the multi-core processor, or may be performed by the plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to one embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0072] In one or more embodiments, the processor may include a system on a chip (SoC) having one or more processors and other electronic components integrated therein, a single core processor, a multi-core processor, or a core included in a single core processor or a multi-core processor, for example, a core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but embodiments of the present disclosure are not limited thereto.

[0073] FIG. 2b is a block diagram illustrating a configuration of a display device according to one or more embodiments.

[0074] Referring to FIG. 2B, the display device (100) may include a sensor (110), a display (120), one or more processors (130), a memory (140), a communication interface (150), a user interface (160), a speaker (170), a light sensor (180), and a camera (190). However, such a configuration is exemplary, and it is obvious that new configurations may be added or some configurations may be omitted in addition to such configurations when implementing the present disclosure. Meanwhile, a detailed description of configurations that overlap with the configurations illustrated in FIG. 2A among the configurations illustrated in FIG. 2B will be omitted.

[0075] The memory (140) may store data necessary for the display device (100) to operate according to one or more embodiments.

[0076] The memory (140) may be implemented as a memory (e.g., volatile memory, non-volatile memory, hard drive, solid state drive, etc.) embedded in the display device (100) depending on the purpose of data storage, or may be implemented as a memory (e.g., memory card, external memory, etc.) that can be attached or detached to the display device (100).

[0077] One or more instructions may be stored in the memory (140). One or more processors (130) may execute one or more instructions stored in the memory (140) to perform operations of the display device (100) according to various embodiments of the present disclosure. Programs, applications, and data for driving the display device (100) may be stored in the memory (140).

[0078] The communication interface (150) includes circuitry. The communication interface (150) can communicate with an external device. The communication interface (150) may include a wireless communication module or a wired communication module. The communication module may be implemented in the form of at least one hardware chip.

[0079] A wireless communication module may be a module that communicates wirelessly with an external device. For example, the wireless communication module may include at least one of a Wi-Fi module, a Bluetooth module, or an infrared communication module. However, the present invention is not limited to this example, and the wireless communication module may include a communication module that communicates according to various wireless communication standards, such as LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation).

[0080] A wired communication module may be a module that communicates with an external device via wires. For example, the wired communication module may include at least one of a Local Area Network (LAN) module and an Ethernet module. Additionally, the wired communication module may include at least one wired interface among a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB), a USB Type-C port, and a Display Port (DP).

[0081] The user interface (160) includes a circuit. The user interface (160) can receive user input and transmit the user input to one or more processors (130).

[0082] The user interface (160) may include various types of input devices.

[0083] For example, the user interface (160) may include physical buttons. The physical buttons may include function keys, directional keys, or dial buttons.

[0084] For example, the user interface (160) may receive user input using a touch method. In one example, the user interface (160) may include a touch screen that performs a display function.

[0085] For example, the user interface (160) may receive user input from an external device. The external device may include a remote control device (e.g., a remote control) for controlling the display device (100) or a user's mobile device. The mobile device may have an application stored thereon for controlling the display device (100). The mobile device may receive user input through the application and transmit the user input to the display device (100).

[0086] For example, the user interface (160) may receive user input using, for example, voice recognition. The user interface (160) may receive the user's voice using a microphone. One or more processors (130) may perform a function corresponding to the user's voice. For example, the one or more processors (130) may convert the user's voice into text data using an STT (Speech To Text) function, obtain control command data based on the text data, and perform a function corresponding to the user's voice based on the control command data. In one or more embodiments, the STT function may be performed on a server.

[0087] The speaker (170) can output audio signals. For example, one or more processors (130) can output audio corresponding to images displayed on the display device (100), warning sounds related to the operation of the display device (100), notification messages, response messages corresponding to user input, etc. According to one example, the speaker (170) can include an audio output interface.

[0088] The illuminance sensor (180) can detect the illuminance surrounding the display device (100). The illuminance sensor (180) can measure the illuminance value surrounding the display device (100) and transmit an electrical signal corresponding to the measured illuminance value to the processor (130). For example, the illuminance sensor (180) can be implemented as any one of a photo sensor, a cadmium sulfide (CDS) sensor, an ultra violet (UV) sensor, and an ambient light sensor (ALS), but is not limited to these examples.

[0089] The camera (190) can acquire an image. For example, the camera (190) can be implemented as an RGB camera, a depth camera, etc. The camera (190) can acquire an image by photographing the area around the display (120). For example, the camera (190) can acquire an image by photographing the area in front of the display (120). In addition, the camera (190) can provide the acquired image to one or more processors (130). In FIG. 2B, the camera (190) is illustrated as a separate component, but the camera (190) may also be included in the sensor (110). For convenience of explanation, one or more processors (130) will be referred to as a processor (130) below.

[0090] The processor (130) can use the sensor (110) to identify whether the user is relatively close to the display (120).

[0091] For example, if the processor (130) detects that the user is located within a preset distance from the display (120) by the sensor (110), the processor (130) may identify that the user is relatively close to the display (120). Additionally, if the processor (130) does not detect that the user is located within a preset distance from the display (120) by the sensor (110), the processor (130) may identify that the user is not relatively close to the display (120).

[0092] In one example, the processor (130) can identify whether a user is relatively close to the display (120) using an electrical signal or data value received from the sensor (110). The electrical signal or data value can include information about the presence or absence of a user detected by the sensor (110) or the degree to which the user is close to the display (120) (e.g., the distance between the user and the display (120).

[0093] According to one example, the processor (130) can analyze an image acquired by the camera to identify the presence or absence of a user around the display (120), the distance between the display (120) and the user, etc.

[0094] The processor (130) can display an HDR image on the display (120). The processor (130) can display an HDR image having a first luminance range on the display (120). For example, the processor (130) can display an HDR image having a first luminance range on the display (120) when the user is not relatively close to the display (120).

[0095] The processor (130) can display an HDR image having a second luminance range on the display (120) when the sensor (110) identifies that a user is close to the display (120) while an HDR image having a first luminance range is being displayed.

[0096] The maximum value of the second luminance range is less than the maximum value of the first luminance range.

[0097] For example, the maximum value of the first luminance range may be the peak luminance (or peak brightness) of the display (120), and the maximum value of the second luminance range may be the maximum luminance (or maximum brightness) of the display (120).

[0098] The maximum luminance can be measured using a full white screen displayed on the display (120).

[0099] Peak luminance can be measured using a screen including a test pattern. For example, peak luminance can be measured using a white window (e.g., a 2% window, a 10% window, a 25% window, etc.) displayed on a portion of the display (120). Peak luminance can be determined based on specifications of the LEDs constituting the display (120), such as the intensity of light that the LEDs can output, the maximum power of the display device (100), etc. Peak luminance can be higher than maximum luminance. For example, the maximum luminance of the display (120) can be 600 nits, and the peak luminance of the display (120) can be 1200 nits. As another example, the maximum luminance of the display (120) can be 1000 nits, and the peak luminance of the display (120) can be 2000 nits. However, it is not limited to this example, and the peak brightness and maximum brightness of the display (120) may have various values ​​depending on the specifications of the display (120).

[0100] The maximum luminance that the display (120) can express may be lower than the maximum luminance of the HDR image, or the luminance range that the display (120) can express may be narrower than the luminance range of the HDR image. Accordingly, the processor (130) may perform tone mapping to display the HDR image on the display (120).

[0101] Tone mapping may refer to a process of converting the brightness values ​​of an input image into values ​​within a brightness range expressible by a display, in order to adjust the brightness of the input image to an appropriate brightness level for the display. The processor (130) may use tone mapping to convert the brightness range of an HDR image into a brightness range expressible by the display (120).

[0102] For example, the memory (140) may store tone mapping information. The tone mapping information may include a tone curve that maps the luminance range of an HDR image to a luminance range that can be output from the display (120).

[0103] According to one example, the tone mapping information may include first tone mapping information and second tone mapping information. The first tone mapping information may include information for mapping a luminance range of an HDR image to a first luminance range of the display (120), and the second tone mapping information may include information for mapping a luminance range of an HDR image to a second luminance range of the display (120). Such tone mapping information may be obtained from metadata of the HDR image, or may be generated by the processor (130) based on information obtained from metadata of the HDR image (e.g., brightness information of the image, color gamut information of a mastering monitor referenced during production of the image, minimum and maximum luminance of the mastering monitor, etc.) and brightness values ​​that the display (120) can express (e.g., maximum luminance and peak luminance).

[0104] The processor (130) can perform tone mapping on an HDR image using tone mapping information to display the HDR image on the display (120).

[0105] For example, if the processor (130) identifies that the user is not close to the display (120), the processor (130) may perform tone mapping on the HDR image using the first tone mapping information and display the HDR image having the first luminance range on the display (120). The maximum value of the first luminance range is the peak luminance of the display (120). In addition, if the processor (130) identifies that the user is relatively close to the display (120), the processor (130) may perform tone mapping on the HDR image using the second tone mapping information and display the HDR image having the second luminance range on the display (120). The maximum value of the second luminance range is the maximum luminance of the display (120).

[0106] For example, as shown in FIG. 3a, when a user (310) is positioned at a point more than a preset distance from the display (120), the processor (130) can display an HDR image (320) having a first luminance range on the display (120). And, as shown in FIG. 3b, when the user (310) moves and is positioned within a preset distance from the display (120), the processor (130) can display an HDR image (330) having a second luminance range on the display (120).

[0107] In this way, according to one or more embodiments, the display device (100) may display an HDR image having high contrast by using a peak luminance higher than the maximum luminance when there is no user relatively close to the display (120), and may limit the brightness of the HDR image by using the maximum luminance when there is a user relatively close to the display (120), thereby reducing the risk of the user being suddenly exposed to bright light.

[0108] The processor (130) can display an HDR image having a second luminance range on the display (120) when at least one user among a plurality of users around the display (120) is identified as being relatively close to the display (120) using the sensor (110) while an HDR image having a first luminance range is displayed.

[0109] For example, as shown in FIG. 4a, a plurality of users (411, 412, 413) may exist around the display (120). If the plurality of users (411, 412, 413) are all located at a distance greater than a preset distance from the display (120), the processor (130) may display an HDR image (420) having a first luminance range on the display (120). In addition, as shown in FIG. 4b, if the user (411) among the plurality of users (411, 412, 413) moves and is located within a preset distance from the display (120), the processor (130) may display an HDR image (430) having a second luminance range on the display (120).

[0110] Meanwhile, in FIG. 4b, it is described that one user is located within a preset distance from the display (120), but this example is not limited thereto. For example, if the processor (130) identifies that one or more users among a plurality of users are located within a preset distance from the display (120), the processor (130) may display an HDR image having a second luminance range on the display (120).

[0111] The processor (130) can identify the luminance range of the HDR image based on the characteristics of a user relatively close to the display (120).

[0112] The user's characteristics may include the user's age. The processor (130) may capture an image by using the camera (190) to capture an area in front of the display (120), and identify the user's age included in the image.

[0113] For example, the processor (130) may identify the user's age using an artificial intelligence model. The artificial intelligence model may be a neural network model trained to identify the age of the user included in an image based on the image. The artificial intelligence model may output a label value for the age of the user included in the image and a confidence value for the label value inferred from the image input to the artificial intelligence model. For example, the artificial intelligence model may include a neural network model configured with model parameters trained by applying a plurality of images as input data and applying a label value for the age of the user included in the image as an output correct value.

[0114] The neural network model according to the present disclosure refers to an artificial intelligence model including a neural network and can be trained by deep learning. The neural network may include, for example, at least one of a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a generative adversarial network (GAN), and a deep Q-network. However, the neural network model is not limited to the examples described above.

[0115] The artificial intelligence model can be stored in the memory (140). The processor (130) inputs an image acquired using the camera (190) into the artificial intelligence model, and can obtain information about the age of the user included in the image based on the label value and confidence value output from the artificial intelligence model.

[0116] As in the example described above, the artificial intelligence model may be implemented in the form of an on-device included in the display device (100). However, this is not limited to the artificial intelligence model, and the artificial intelligence model may also be stored in a server connected to the display device (100). If the artificial intelligence model is stored in the server, the display device (100) may transmit an image to the server via the communication interface (150) and receive information about the user's age from the server.

[0117] The processor (130) can identify the user's characteristic as the first characteristic if the user's age included in the image is greater than a preset value, and can identify the user's characteristic as the second characteristic if the user's age included in the image is less than or equal to the preset value.

[0118] And, if the user's characteristic is the first characteristic, the processor (130) can display an HDR image having a second luminance range on the display (120), and if the user's characteristic is the second characteristic, the processor (130) can display an HDR image having a third luminance range on the display (120).

[0119] At this time, the maximum value of the third luminance range may be less than the maximum value of the second luminance range. For example, the maximum value of the third luminance range may be half of the peak luminance or half of the maximum luminance. However, this example is not limited to this example, and the maximum value of the third luminance range may be one of the values ​​less than the maximum luminance.

[0120] According to one example, the memory (140) may further store third tone mapping information. The third tone mapping information may include information for mapping the luminance range of the HDR image to the third luminance range of the display (120). The processor (130) may perform tone mapping on the HDR image using the third tone mapping information and display the HDR image having the third luminance range on the display (120).

[0121] For example, as shown in FIG. 5A, a plurality of users (511, 512, 513) may exist around the display (120). If all of the plurality of users (511, 512, 513) are located at a point further than a preset distance from the display (120), the processor (130) may display an HDR image (520) having a first luminance range on the display (120). In addition, as shown in FIG. 5B, if the user (511) among the plurality of users (511, 512, 513) moves and is located within a preset distance from the display (120), the processor (130) may obtain an image of the user (511) using the camera (190) and identify the age of the user (511) based on the obtained image. If the age of the user (511) is greater than a preset value, the processor (130) can display an HDR image (530) having a second luminance range on the display (120). In addition, as shown in FIG. 5c, if a user (512) among a plurality of users (511, 512, 513) moves and is positioned within a preset distance from the display (120), the processor (130) can obtain an image of the user (512) using the camera (190) and identify the age of the user (512) based on the obtained image. If the age of the user (512) is less than or equal to the preset value, the processor (130) can display an HDR image (540) having a third luminance range on the display (120).

[0122] In this way, in the case of young children, the display device (100) can adjust the luminance range of the HDR image displayed on the display (120) by taking into account the age of the user who is relatively close to the display (120), as the child may be relatively more affected by the light output from the display (120).

[0123] The processor (130) can display an HDR image having a first luminance range on the display (120) when it is determined by the sensor (110) that the user is not relatively close to the display (120) while an HDR image having a second luminance range is being displayed.

[0124] A user being relatively close to the display (120) may include all users who were located within a preset distance from the display (120) moving to a point further than the preset distance from the display (120), such that no user is present within the preset distance from the display (120).

[0125] For example, as shown in FIG. 6a, when a user (610) is positioned within a preset distance from the display (120), the processor (130) can display an HDR image (620) having a second luminance range on the display (120). And, as shown in FIG. 6b, when a user (610) moves to a point that is more than the preset distance away from the display (120), the processor (130) can display an HDR image (530) having a first luminance range on the display (120).

[0126] According to one example, the processor (130) can display an HDR image having a first luminance range on the display (120) from a point in time when the user is identified as not being relatively close to the display (120).

[0127] According to one example, the processor (130) may display an HDR image having a second luminance range on the display (120) for a preset period of time from a time point when the user is identified as not being relatively close to the display (120), and when the preset period of time has elapsed, the processor (130) may display an HDR image having a first luminance range on the display (120). In addition, the processor (130) may maintain a state in which the HDR image having the second luminance range is displayed on the display (120) when the user is identified as being relatively close to the display (120) within the preset period of time using the sensor (110).

[0128] The operation of this display device (100) takes into account that a user who has moved to a point more than a preset distance from the display (120) may move back near the display (120).

[0129] For example, as shown in FIG. 7a, when an HDR image (710) having a second luminance range is displayed on the display (120), a user (720) who is within a preset distance from the display (120) may move to a point that is more than the preset distance from the display (120). The processor (130) may display the HDR image (710) having the second luminance range on the display (120) for a preset period of time from the time when it detects that the user (720) has moved to a point that is more than the preset distance from the display (120). In addition, as shown in FIG. 7b, when the preset period of time has elapsed, the processor (130) may display the HDR image (730) having the first luminance range on the display (120).

[0130] And, as in FIG. 7c, a user (720) who has moved to a point further than a preset distance from the display (120) can move again within the preset distance from the display (120). If the processor (130) determines that the user (720) is detected within the preset distance from the display (120) within a preset time, the HDR image (710) having the second luminance range can be maintained in a state in which it is displayed on the display (120). For example, the HDR image (710) having the second luminance range that is being displayed on the display (120) can continue to be displayed on the display (120).

[0131] The processor (130) can identify the user's gaze direction using the sensor (110).

[0132] For example, the processor (130) may analyze the image captured by the camera (190) to identify the direction of the user's gaze. In one example, the processor (130) may identify the user's eyes (e.g., pupils) in the image, recognize (or track) the gaze based on the position and movement of the eyes, and detect the direction in which the user's gaze is directed. In addition, the processor (130) may identify the user's face in the image, and detect the direction in which the user's gaze is directed based on the direction of the face.

[0133] In addition, the processor (130) can identify an area corresponding to the user's gaze direction on the display (120). The area corresponding to the gaze direction may include an area of ​​the display (120) toward which the user's gaze is directed.

[0134] For example, the processor (130) may identify coordinates of a point where the user's gaze passes on the display (120) based on the user's gaze direction, and identify an area of ​​the display (120) that includes the identified coordinates to identify an area corresponding to the user's gaze direction. According to one example, if the gaze direction is identified as facing forward, the processor (130) may identify that the user's gaze is directed toward the front area of ​​the display (120) with respect to the user. In addition, if the gaze direction is identified as the user's gaze facing left, the processor (130) may identify that the user's gaze is directed toward the left area of ​​the display (120) with respect to the user. In addition, if the gaze direction is identified as facing right, the processor (130) may identify that the user's gaze is directed toward the right area of ​​the display (120) with respect to the user. Meanwhile, the above-described method is an example, and the processor (130) can detect the direction of the user's gaze using various methods such as artificial intelligence, machine learning and computer vision technology, gaze recognition algorithm, etc., and identify an area of ​​the display (120) corresponding to the direction of the gaze.

[0135] In addition, the processor (130) may display a portion of an HDR image displayed in an area corresponding to the user's viewing direction on the display (120) in a second luminance range. That is, when the user is relatively close to the display (120), the processor (130) may display an HDR image having a second luminance range on the display (120). For example, the processor (130) may display an HDR image in the second luminance range only in an area that the user views from the display (120), and display an HDR image in the first luminance range in the remaining area of ​​the display (120), taking into account the user's viewing direction.

[0136] For example, the processor (130) may perform tone mapping on some images displayed in an area corresponding to the user's gaze direction on the display (120) among HDR images, using second tone mapping information, to adjust the luminance range of some images displayed in the area corresponding to the user's gaze direction, and may perform tone mapping on some images displayed in the remaining area of ​​the display (120) among HDR images, using first mapping information, to adjust the luminance range of some images displayed in the remaining area. In addition, the processor (130) may display the HDR images on the display (120).

[0137] For example, as shown in FIG. 8, it is assumed that a user (810) within a preset distance from the display (120) looks at the left area (121) of the display (120). The processor (130) can display a part of an HDR image (821) in a second luminance range in the left area (121) of the display (120), and display a part of an HDR image (822) in a first luminance range in the remaining area (122).

[0138] In Fig. 8, a case where one user is positioned within a preset distance from the display (120) is described as an example, but the embodiment is not limited to this example. The processor (130) may display an HDR image on the display (120) by considering the gaze directions of a plurality of users within a preset distance from the display (120). For example, the processor (130) may identify the gaze directions of a plurality of users who are relatively close to the display (120) using the sensor (110), and may display a portion of the HDR image displayed in an area corresponding to the gaze directions of the plurality of users on the display (120) in a second luminance range. For example, the processor (130) may display a portion of the HDR image in a second luminance range in a plurality of areas of the display (120) viewed by a plurality of users, and may display a portion of the HDR image in a first luminance range in the remaining areas.

[0139] In the above example, the sensor (110) is described as detecting the area in front of the display (120), but the present invention is not limited to this example. For example, the area detected by the sensor (110) may include the area in front of the display device (100) and the area behind the display device (100). For example, since the display (120) is arranged on the front of the display device (100), the area in front of the display device (100) may include the area in front of the display (120).

[0140] When the processor (130) detects that the user is located within a preset distance from the display device (100) in front of the display device (100) by the sensor (110), the processor (130) can identify that the user is relatively close to the display (120). Then, when the processor (130) identifies that the user is relatively close to the display (120), the processor (130) can display an HDR image having a second luminance range on the display (120). For example, when the processor (130) identifies that the user is relatively close to the display (120) using the sensor (110) while the HDR image having the first luminance range is displayed on the display (120), the processor (130) can display an HDR image having a second luminance range on the display (120).

[0141] In addition, when the processor (130) detects that the user is located within a preset distance from the display device (100) at the rear of the display device (100) by the sensor (110), the processor (130) can identify that the user is not relatively close to the display (120). Then, when the processor (130) identifies that the user is not relatively close to the display (120), the processor (130) can display an HDR image having a first luminance range on the display (120). For example, when an HDR image having a first luminance range is being displayed on the display (120), the processor (130) can continue to display an HDR image having the first luminance range on the display (120).

[0142] For example, as shown in FIG. 9A, when a user (910) is positioned in front of the display device (100) and within a preset distance from the display device (100), the processor (130) can display an image (920) having a second luminance range on the display (120). In addition, as shown in FIG. 9B, when a user (910) is positioned at the rear of the display device (100), the display (120) is not within the visible range of the user (910). Therefore, even if an HDR image having a relatively high luminance is displayed on the display (120), it does not affect the user. When a user (910) is positioned at the rear of the display device (100) and within a preset distance from the display device (100), the processor (130) can display an image (930) having a first luminance range on the display (120).

[0143] FIGS. 10A and 10B are diagrams illustrating examples of a luminance range of a display depending on whether a user is relatively close to the display according to one or more embodiments.

[0144] In FIGS. 10a and 10b, it is assumed that the peak brightness of the display (120) is 1200 nits and the maximum brightness of the display (120) is 600 nits.

[0145] Referring to FIGS. 10A and 10B, the processor (130) may limit the brightness of the display (120) based on the illuminance value around the display device (100). For example, the processor (130) may display the HDR image on the display (120) using peak brightness and maximum brightness based on the illuminance value detected by the illuminance sensor (180), or may display the HDR image on the display (120) using a brightness that is half of the peak brightness and maximum brightness.

[0146] According to one example, when the illuminance value detected by the illuminance sensor (180) is equal to or greater than a preset value, the processor (130) may display an HDR image on the display (120) using peak luminance and maximum luminance. As shown in FIG. 10A, when the processor (130) determines that the user is not relatively close to the display (120), the processor (130) may display an HDR image on the display (120) in a luminance range of 0 to 1200 nits using peak luminance. In addition, when the processor (120) determines that the user is relatively close to the display (120), the processor (120) may display an HDR image on the display (120) in a luminance range of 0 to 600 nits using maximum luminance.

[0147] When the illuminance value detected by the illuminance sensor (180) is less than a preset value, the processor (130) may display an HDR image on the display (120) using a luminance value that is half of the peak luminance and the maximum luminance. As shown in FIG. 10b, when the processor (130) determines that the user is not relatively close to the display (120), the processor (130) may display an HDR image on the display (120) in a luminance range of 0 to 600 nits using a luminance value that is half of the peak luminance. In addition, when the processor (120) determines that the user is relatively close to the display (120), the processor (120) may display an HDR image on the display (120) in a luminance range of 0 to 300 nits using a brightness value that is half of the maximum luminance.

[0148] FIG. 11 is a flowchart illustrating a method of displaying an image on a display device according to one or more embodiments.

[0149] An HDR image having a first luminance range is displayed on the display (S1110).

[0150] When a sensor is used to identify a user as being relatively close to the display while an HDR image having a first luminance range is displayed, an HDR image having a second luminance range is displayed on the display (S1120).

[0151] The maximum value of the second luminance range is less than the maximum value of the first luminance range.

[0152] For example, the maximum value of the first luminance range may be the peak luminance of the display, and the maximum value of the second luminance range may be the maximum luminance of the display.

[0153] In addition, the image display method according to the present disclosure can identify the user as being relatively close to the display when the sensor detects that the user is located within a preset distance from the display.

[0154] In addition, the image display method according to the present disclosure can display an HDR image having a first luminance range on the display when it is determined that the user is not relatively close to the display using a sensor that displays an HDR image having a second luminance range.

[0155] Additionally, when the user is identified as not being relatively close to the display, the step of displaying an HDR image having a first luminance range on the display may include displaying an HDR image having a second luminance range on the display for a preset period of time from the time when the user is identified as not being relatively close to the display, and when the preset period of time has elapsed, displaying an HDR image having a first luminance range on the display.

[0156] In addition, the step of displaying an HDR image having a second luminance range on the display may include displaying an HDR image having a second luminance range on the display when at least one user among a plurality of users around the display is identified as being relatively close to the display using a sensor while the HDR image having the first luminance range is displayed.

[0157] Additionally, the step of displaying an HDR image having a second luminance range on the display may identify a user's gaze direction using a sensor, and display a portion of the HDR image displayed in an area corresponding to the gaze direction on the display in the second luminance range.

[0158] The various embodiments described above may be implemented in a computer-readable recording medium using software, hardware, or a combination thereof, or in a computer- or similar device. In some cases, the embodiments described herein may be implemented by the processor itself. In a software implementation, embodiments, such as the procedures and functions described herein, may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

[0159] Meanwhile, computer instructions for performing processing operations of an electronic device according to various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. When the computer instructions stored in such a non-transitory computer-readable medium are executed by a processor of a specific device, the computer instructions cause the specific device to perform processing operations in a modular display device (100) according to various embodiments described above.

[0160] A non-transitory computer-readable medium is not a medium that stores data for a short period of time, such as a register, cache, or memory, but rather a medium that permanently stores data and can be read by a device. Specific examples of non-transitory computer-readable media include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, and ROMs.

[0161] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person skilled in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims and their equivalents, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In the display device, sensor; display; and Displaying an HDR image having a first luminance range on the display, One or more processors for displaying the HDR image having the second luminance range on the display based on the sensor identifying that the user is within a preset distance from the display while the HDR image having the first luminance range is displayed; A display device wherein the maximum value of the second luminance range is smaller than the maximum value of the first luminance range.

2. In paragraph 1, The maximum value of the above first luminance range is the peak luminance of the display, A display device wherein the maximum value of the second luminance range is the maximum luminance of the display.

3. In paragraph 1, One or more of the above processors, A display device that identifies the user as being within the preset distance from the display based on the user being detected by the sensor to be within the preset distance from the display.

4. In paragraph 3, One or more of the above processors, Based on the user being detected by the sensor to be within a preset distance from the display device in front of the display, identifying the user as being within the preset distance from the display, A display device that identifies that the user is not within the preset distance from the display based on the sensor detecting that the user is within the preset distance from the display device at the rear of the display device.

5. In paragraph 1, One or more of the above processors, A display device that displays an HDR image having the first luminance range on the display based on the sensor identifying that the user is not within the preset distance from the display while the HDR image having the second luminance range is displayed.

6. In paragraph 4, One or more of the above processors, Displaying an HDR image having the second luminance range on the display for a preset period of time from a time when the user is identified as not being within the preset distance from the display; A display device that displays the HDR image having the first luminance range on the display based on the elapsed time of the above-described preset time.

7. In paragraph 6, One or more of the above processors, A display device that maintains an HDR image having the second luminance range displayed on the display based on the user being identified as being within the preset distance from the display within the preset time by the sensor.

8. In paragraph 1, One or more of the above processors, A display device that displays an HDR image having the second luminance range on the display based on the identification by the sensor that at least one user among a plurality of users around the display is within the preset distance from the display while the HDR image having the first luminance range is displayed.

9. In paragraph 6, One or more of the above processors, Identifying the characteristics of a user within the preset distance from the display, Based on the user's characteristic being the first characteristic, an HDR image having the second luminance range is displayed on the display, Based on the user's characteristic being the second characteristic, an HDR image having a third luminance range is displayed on the display, The characteristics of the above user are determined based on the age of the above user, A display device wherein the maximum value of the third luminance range is smaller than the maximum value of the second luminance range.

10. In paragraph 1, One or more of the above processors, Identifying the user's gaze direction by the above sensor, A display device that displays a portion of the HDR image displayed in an area corresponding to the viewing direction on the display in the second luminance range.

11. A method for displaying an image on a display device including a sensor, A step of displaying an HDR image having a first luminance range on a display; and A step of displaying the HDR image having the second luminance range on the display based on the user being identified by the sensor as being within a preset distance from the display while the HDR image having the first luminance range is displayed; An image display method wherein the maximum value of the second luminance range is smaller than the maximum value of the first luminance range.

12. In paragraph 11, The maximum value of the above first luminance range is the peak luminance of the display, A method for displaying an image, wherein the maximum value of the second luminance range is the maximum luminance of the display.

13. In paragraph 11, A method for displaying an image further comprising: a step of identifying that the user is within a preset distance from the display based on the sensor detecting that the user is within a preset distance from the display; 14. In paragraph 13, A step of identifying that the user is within the preset distance from the display based on the sensor detecting that the user is within the preset distance from the display device in front of the display; and A method for displaying an image further comprising: a step of identifying that the user is not within the preset distance from the display based on the sensor detecting that the user is within the preset distance from the display device at the rear of the display device; 15. In paragraph 11, A method for displaying an image, further comprising: displaying an HDR image having the first luminance range on the display based on the sensor identifying that the user is not within the preset distance from the display while the HDR image having the second luminance range is displayed;

Images