Display device for indicating reception of notification while displaying image and control method therefor

Abstract

Disclosed is a display device. The display device comprises: a display including a plurality of pixel elements disposed on the front surface and a plurality of light emitting elements disposed on an edge region of the rear surface; a memory for storing one or more instructions; and at least one processor. By executing one or more instructions, the processor: controls the display to provide an image via the plurality of pixel elements; when a preset notification is received, identifies at least one light emitting element among the plurality of light emitting elements on the basis of location information on the screen related to the preset notification; and causes the at least one identified light emitting element to emit light on the basis of color information related to the preset notification.

Description

Display device for indicating receipt of notification while displaying image and method for controlling same

[0001] The present invention relates to a display device and a control method thereof, and more particularly, to a display device that indicates receipt of a notification while displaying an image and a control method thereof.

[0002] Recently, various home appliances are being developed and distributed, and in particular, the development and distribution of display devices is more active than in any other field.

[0003] For example, to enhance the user's viewing experience and sense of immersion, surround lighting is placed on the back of the TV, and technology is being utilized to dynamically adjust the lighting according to the color and content of the image being output by the TV.

[0004] However, if a notification is received while outputting a video and the notification is displayed in a part of the video or the video output is interrupted, there is a problem that it is difficult to maintain the user's immersion.

[0005] Even if a notification is received while outputting a video, if the notification is ignored, the user's immersion can be maintained, but there is a problem in that the user cannot recognize whether or not the notification has been received.

[0006] There has been a demand for a way to utilize surround lighting to maintain the immersion of the user watching a video, while still informing the user when a notification has been received.

[0007] In order to achieve the above object, according to one embodiment of the present disclosure, a display device includes a display including a plurality of pixel elements arranged on a front side and a plurality of light-emitting elements arranged in an edge region on a rear side, a memory storing one or more commands, and one or more processors, wherein the one or more processors control the display to provide an image through the plurality of pixel elements by executing the one or more commands, and when a preset notification is received, identify at least one light-emitting element among the plurality of light-emitting elements based on position information on a screen related to the preset notification, and cause the identified at least one light-emitting element to emit light based on color information related to the preset notification.

[0008] A method for controlling a display device including a plurality of pixel elements arranged on a front surface and a plurality of light-emitting elements arranged in an edge region of a rear surface according to one embodiment of the present disclosure includes the steps of providing an image through the plurality of pixel elements, identifying at least one light-emitting element among the plurality of light-emitting elements based on position information on a screen related to a preset notification when a preset notification is received, and causing the identified at least one light-emitting element to emit light based on color information related to the preset notification.

[0009] According to one embodiment for achieving the above-described object of the present disclosure, there is provided a computer-readable recording medium including a program for executing a control method for a display device including a plurality of pixel elements arranged on a front side and a plurality of light-emitting elements arranged in an edge region of a rear side, wherein the control method for the display device includes the steps of providing an image through the plurality of pixel elements, identifying at least one light-emitting element among the plurality of light-emitting elements based on position information on a screen related to a preset notification when a preset notification is received, and causing the identified at least one light-emitting element to emit light based on color information related to the preset notification.

[0010] FIG. 1 is a drawing for explaining the front and back of a display device according to an embodiment of the present disclosure.

[0011] FIG. 2 is a block diagram showing the configuration of a display device according to an embodiment of the present disclosure.

[0012] FIG. 3 is a drawing for explaining a method for a conventional display device to display an image and a preset notification.

[0013] FIG. 4 is a drawing for explaining a method in which a display device that has received a preset notification according to an embodiment of the present disclosure causes at least one light-emitting element among a plurality of light-emitting elements to emit light.

[0014] FIG. 5 is a drawing for explaining a method for a 3D display device according to an embodiment of the present disclosure to display a 3D image and a preset notification.

[0015] FIG. 6 is a drawing for explaining a method for a display device according to an embodiment of the present disclosure to emit light corresponding to each of a plurality of preset notifications.

[0016] FIG. 7 is a drawing for explaining a method of emitting light from a light-emitting element according to an application related to a function according to an embodiment of the present disclosure.

[0017] FIG. 8 is a diagram for explaining information related to colors corresponding to each of a plurality of users according to an embodiment of the present disclosure.

[0018] FIG. 9 is a drawing for explaining a display device that indicates a progress rate corresponding to a progress bar using a plurality of light-emitting elements according to an embodiment of the present disclosure.

[0019] FIG. 10 is a drawing for explaining a method of causing a plurality of light-emitting elements to emit light based on position information on the screen of each of a plurality of users according to an embodiment of the present disclosure.

[0020] FIG. 11 is a drawing for explaining colors corresponding to an image according to an embodiment of the present disclosure.

[0021] FIG. 12 is a drawing for explaining a display device communicating with an external device according to an embodiment of the present disclosure.

[0022] FIG. 13 is a flowchart for explaining a method for controlling a display device according to an embodiment of the present disclosure.

[0023] Hereinafter, the present disclosure will be described in detail with reference to the attached drawings.

[0024] The terms used in the embodiments of this disclosure have been selected from widely used, current terms, taking into account the functions of this disclosure. However, these terms may vary depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Furthermore, in certain cases, terms may be arbitrarily selected by the applicant, and in such cases, their meanings will be described in detail in the description of the relevant disclosure. Therefore, the terms used in this disclosure should not be defined simply as names of terms, but rather based on the meanings of the terms and the overall content of this disclosure.

[0025] In this specification, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a feature (e.g., a number, function, operation, or component such as a part), and do not exclude the presence of additional features.

[0026] The expression "at least one of A and / or B" should be understood to mean either "A" or "B" or "A and B".

[0027] As used herein, the expressions “first,” “second,” “first,” or “second,” etc., may describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0028] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that the component may be directly coupled to the other component, or may be connected through another component (e.g., a third component).

[0029] Singular expressions include plural expressions unless the context clearly dictates otherwise. In this application, terms such as "comprise" or "consist of" are intended to indicate the presence of a feature, number, step, operation, component, part, or combination thereof described in the specification, but should be understood not to preclude the presence or addition of one or more other features, numbers, steps, operations, components, parts, or combinations thereof.

[0030] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, multiple "modules" or multiple "parts" may be integrated into at least one module and implemented as at least one processor (not shown), excluding any "modules" or "parts" that need to be implemented as specific hardware.

[0031] In this specification, the term user may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0032] An embodiment of the present disclosure will be described in more detail with reference to the attached drawings below.

[0033] FIG. 1 is a drawing for explaining the front and back of a display device according to an embodiment of the present disclosure.

[0034] Referring to FIG. 1, a display device (100) according to an embodiment of the present disclosure includes a plurality of pixel elements (111) arranged on the front, and can display an image using the plurality of pixel elements (111).

[0035] According to an embodiment, the display device (100) may be implemented as a TV, but is not limited thereto, and may be applied to any device having a display function, such as a video wall, a large format display (LFD), a digital signage, a digital information display (DID), a projector display, etc. In addition, the display device (100) may be implemented as various types of displays, such as an LCD (liquid crystal display), an OLED (organic light-emitting diode), an LCoS (Liquid Crystal on Silicon), a DLP (Digital Light Processing), a QD (quantum dot) display panel, a QLED (quantum dot light-emitting diodes), a μLED (Micro light-emitting diodes), a Mini LED, etc.

[0036] According to an embodiment, the display device (100) may include a plurality of light-emitting elements (112) arranged on the rear surface. For example, the display device (100) may include a plurality of light-emitting elements (112) arranged on an edge area of ​​the rear surface (or an outer area of ​​the rear surface).

[0037] For example, the display device (100) can display an image through a plurality of pixel elements (111) and display a color corresponding to the image through a plurality of light-emitting elements (112).

[0038] For example, the display device (100) controls a plurality of light-emitting elements (112) to emit light of a color corresponding to an image toward a wall where the display device (100) is located, and can provide a gradation effect or gradient effect in which the intensity of the color corresponding to the image gradually decreases as the distance from the display device (100) increases behind the display device (100) (or in the space where the display device (100) is located).

[0039] According to an embodiment, a display device (100) may display an image using a plurality of pixel elements (111) arranged on the front of the display device (100), and may provide a sense of immersion to a user by emitting a color corresponding to the image (or at least one color among the colors included in the image) using a plurality of light-emitting elements (112) arranged on the rear of the display device (100).

[0040] For example, the display device (100) can control a plurality of light-emitting elements (112) arranged on the rear of the display device (100) to react in real time to an image being displayed using a plurality of pixel elements (111) arranged on the front of the display device (100) and emit a color corresponding to the image.

[0041] According to an embodiment, the display device (100) controls at least one of the plurality of light-emitting elements (112) arranged on the rear of the display device (100) to emit a color corresponding to an image while emitting a color corresponding to a context, thereby maintaining a sense of immersion for a user watching an image while making the user aware of the context.

[0042] FIG. 2 is a block diagram showing the configuration of a display device according to an embodiment of the present disclosure.

[0043] Referring to FIG. 2, the display device (100) includes a display (110), a memory (120), and one or more processors (130).

[0044] According to an embodiment of the present disclosure, a display (110) may include a plurality of pixel elements (111) arranged on the front side and a plurality of light-emitting elements (112) arranged on the rear side. Hereinafter, an embodiment implemented with a plurality of light-emitting elements (112) arranged on the edge area of ​​the rear side will be described, but is not limited thereto and may be implemented in various modified forms.

[0045] For example, each of the plurality of pixel elements (111) may include a self-luminous element. The self-luminous element may be at least one of a light emitting diode (LED) or a micro LED. Depending on the embodiment, the LED element may be implemented as a micro LED. Here, the micro LED is an ultra-small light emitting element that is an LED with a size of about 5 to 100 micrometers and emits light on its own without a color filter.

[0046] Not limited thereto, the display (110) includes a backlight, and each of the plurality of pixel elements (111) controls the transmittance of light emitted from the backlight to display an image, and may include sub-pixels of R (Red), G (Green), and B (Blue).

[0047] According to an embodiment of the present disclosure, a display (110) includes a plurality of light-emitting elements (112) arranged in an edge area of ​​the rear surface. The plurality of light-emitting elements (112) may be referred to as smart lighting, surround lighting, screen backlight, etc., but for convenience of explanation, they are collectively referred to as a plurality of light-emitting elements (112) hereinafter.

[0048] Referring to the top of FIG. 1, for convenience of explanation, the edge area of ​​the rear surface of the display (110) may be divided into a first edge area corresponding to the left area of ​​the rear surface of the display (110), a second edge area corresponding to the right area, a third edge area corresponding to the upper area, and a fourth edge area corresponding to the lower area.

[0049] According to an embodiment, the plurality of light-emitting elements (112) arranged in the first to fourth edge regions of the rear surface of the display (110) may include at least one of a first array including first light-emitting elements arranged in the first edge region, a second array including second light-emitting elements arranged in the second edge region, a third array including third light-emitting elements arranged in the third edge region, or a fourth array including fourth light-emitting elements arranged in the fourth edge region.

[0050] For example, as illustrated at the top of FIG. 1, the display (110) may include first to fourth arrays. However, the present invention is not limited thereto. For example, the display (110) may include only a fourth array including fourth light-emitting elements arranged in a fourth edge region corresponding to a lower region of the rear surface of the display (110).

[0051] As shown in the upper part of Fig. 1, a plurality of light-emitting elements (112) may be arranged in a rectangular shape. However, this is not limited thereto, and a plurality of light-emitting elements (112) may be arranged in the shape of various polygons.

[0052] According to an embodiment, one or more processors (130) may, while displaying an image, cause first light-emitting elements included in a first array to emit light based on colors corresponding to a right area of ​​the image, cause second light-emitting elements included in a second array to emit light based on colors corresponding to a left area of ​​the image, cause third light-emitting elements included in a third array to emit light based on colors corresponding to an upper area of ​​the image, and cause fourth light-emitting elements included in a fourth array to emit light based on colors corresponding to a lower area of ​​the image, as shown in the lower part of FIG. 1.

[0053] Accordingly, one or more processors (130) can emit colors synchronized to the image through a plurality of light-emitting elements (112) while displaying the image.

[0054] According to an embodiment, a plurality of light-emitting elements (112) arranged in an edge area of ​​the rear surface of a display device (100) can dynamically adjust a color (or color temperature) according to the color of an image or the content of the image to enhance a user's viewing experience and sense of immersion. For example, the plurality of light-emitting elements (112) can emit light based on a color included in an image, and can change the color and emit light in real time in response to changes in the image.

[0055] In the drawings according to the present disclosure, each of the patterns shown on the outside of the display device (100) may represent different colors emitted by the plurality of light-emitting elements (112) (or different colors reflected on the back wall of the display device (100), and the intensity of the colors emitted by the plurality of light-emitting elements (112) may decrease as the distance from the display device (100) increases.

[0056] According to an embodiment, the memory (120) may store data required for various embodiments of the present disclosure. Depending on the purpose of data storage, the memory (120) may be implemented as a memory embedded in the display device (100) or may be implemented as a memory detachable from the display device (100).

[0057] For example, data for driving the display device (100) may be stored in a memory embedded in the display device (100), and data for the extended functions of the display device (100) may be stored in a memory that can be attached or detached to the display device (100).

[0058] In the case of memory embedded in the display device (100), it may be implemented in the form of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD)).

[0059] In the case of a memory that can be attached or detached to a display device (100), it can be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), an external memory that can be connected to a USB port (e.g., USB memory), etc.

[0060] According to an embodiment, the memory (120) may store a computer program including at least one instruction or instructions for controlling the display device (100).

[0061] In an embodiment, one or more processors (130) control the overall operation of the display device (100). Specifically, one or more processors (130) may be connected to each component of the display device (100) to control the overall operation of the display device (100).

[0062] According to an embodiment, one or more processors (130) may control multiple robots (200) and charging stations (300).

[0063] One or more processors (130) may perform operations of the display device (100) according to various embodiments by executing at least one instruction stored in the memory (120).

[0064] The one or more processors (130) may include one or more of a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an Accelerated Processing Unit (APU), a Many Integrated Core (MIC), a Digital Signal Processor (DSP), a Neural Processing Unit (NPU), a hardware accelerator, or a machine learning accelerator. The one or more processors (130) may control one or any combination of other components of the electronic device, and may perform operations related to communication or data processing. The one or more processors (130) may execute one or more programs or instructions stored in the memory (120). For example, the one or more processors (130) may perform a method according to an embodiment of the present disclosure by executing one or more instructions stored in the memory (120).

[0065] When a method according to an embodiment of the present disclosure includes multiple operations, the multiple operations may be performed by one processor or by multiple processors. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence-dedicated processor).

[0066] One or more processors (130) may be implemented as a single core processor including one core, or may be implemented as one or more multicore processors including multiple cores (e.g., homogeneous multicores or heterogeneous multicores). When one or more processors (130) are implemented as a multicore processor, each of the multiple cores included in the multicore processor may include an internal processor memory, such as a cache memory or an on-chip memory, and a common cache shared by the multiple cores may be included in the multicore processor. In addition, each of the multiple cores (or some of the multiple cores) included in the multicore processor may independently read and execute a program instruction for implementing a method according to an embodiment of the present disclosure, or all (or some) of the multiple cores may be linked to read and execute a program instruction for implementing a method according to an embodiment of the present disclosure.

[0067] When a method according to an embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by one core among a plurality of cores included in a multi-core processor, or may be performed by a plurality of cores. For example, when a first operation, a second operation, and a third operation are performed by a method according to an embodiment, the first operation, the second operation, and the third operation may all be performed by a first core included in the multi-core processor, or the first operation and the second operation may be performed by a first core included in the multi-core processor, and the third operation may be performed by a second core included in the multi-core processor.

[0068] In embodiments of the present disclosure, a processor may mean a system on a chip (SoC) in which one or more processors and other electronic components are integrated, a single-core processor, a multi-core processor, or a core included in a single-core processor or a multi-core processor, wherein the core may be implemented as a CPU, a GPU, an APU, a MIC, a DSP, an NPU, a hardware accelerator, or a machine learning accelerator, but embodiments of the present disclosure are not limited thereto.

[0069] FIG. 3 is a drawing for explaining a method for a conventional display device to display an image and a preset notification.

[0070] Referring to Figure 3, conventional display devices had limitations in that they could not provide context to the user while providing images.

[0071] Conventional display devices may continuously display images to enhance user immersion and not display the preset notifications when a preset notification (e.g., a push notification) is received while providing images.

[0072] For example, a conventional display device, as shown in the upper part of FIG. 3, when a preset notification is received while providing an image, displays only the image until a user input for confirming the preset notification is received, so there is a problem in that the user cannot recognize in real time whether the preset notification has been received.

[0073] As illustrated in the lower part of Fig. 3, conventional display devices, when receiving user input to confirm a preset notification, overlay an application for providing the preset notification onto a portion of the image to provide the preset notification. While the user can recognize the preset notification, the application overlays a portion of the image to provide the preset notification, which hinders user immersion.

[0074] Conventional display devices, when a preset notification is received while providing a video, may provide the preset notification by overlaying an application on a portion of the video regardless of whether a user input for confirming the preset notification is received, and there is a problem in that the user's sense of immersion is not maintained.

[0075] FIG. 4 is a drawing for explaining a method in which a display device that has received a preset notification according to an embodiment of the present disclosure causes at least one light-emitting element among a plurality of light-emitting elements to emit light.

[0076] Referring to FIG. 4, one or more processors (130) can control a plurality of pixel elements (111) included in a display (110) to display an image received from a source device.

[0077] According to an embodiment, the source device may be a set-top box, a cloud server, an over-the-top media service (OTT) server, a streaming service (e.g., Samsung Gaming Hub), a home automation control panel, a security control panel, or a media box (e.g., Samsung HomeSync). TM , Apple TV TM , or Google TV TM ), game consoles (e.g. Xbox TM , PlayStation TM , Switch TM), electronic dictionary, electronic key, camcorder, or electronic picture frame. However, the present invention is not limited thereto, and the source device may include at least one of a TV, a user terminal device, a tablet PC, a mobile phone, a video phone, an e-book reader, a desktop PC, a laptop PC, a netbook computer, a workstation, a server, a PDA, a portable multimedia player (PMP), an MP3 player, a medical device, a camera, a virtual reality (VR) implementation device, a spatial computing device, or a wearable device. Here, the wearable device may be implemented as at least one of an accessory type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, a contact lens, or a head-mounted device (HMD)), a fabric or clothing-integrated type (e.g., electronic clothing), a body-attached type (e.g., a skin pad or tattoo), or a bio-implantable circuit.

[0078] Referring to the top of FIG. 4, one or more processors (130) can identify a color corresponding to an image and cause a plurality of light-emitting elements (112) arranged in an edge area of ​​the rear surface of the display (110) to emit light based on the color corresponding to the image.

[0079] Referring to the center of FIG. 4, when a preset notification is received while providing an image, one or more processors (130) may identify at least one of a plurality of light-emitting elements (112) based on on-screen position information related to the preset notification. According to an embodiment, one or more processors (130) may cause at least one light-emitting element identified based on color information related to the preset notification to emit light.

[0080] For example, preset notifications include push notifications, and push notifications may include notifications (or messages) that can be provided as pop-ups on the screen. Depending on the embodiment, push notifications include application (A)-based push notifications and web-based push notifications. For the convenience of explanation, below, preset notifications are assumed to be application (A)-based push notifications.

[0081] However, this is not limited thereto, and preset notifications may include various types of notifications, such as web-based push notifications. For example, preset notifications may include application (A)-based badge notifications, messages received from preset contacts (e.g., phone calls, SMS messages, instant messages, etc.), push notifications from preset application (A), etc.

[0082] As described in FIG. 3, when a preset notification is received, a conventional display device provides the preset notification by overlaying an application for providing the preset notification on a portion of the image (or popping up an application on a portion of the image).

[0083] The display device (100) according to the present disclosure, when a preset notification is received, can emit light from at least one of a plurality of light-emitting elements (110) based on color information related to the preset notification to inform the user of whether the preset notification has been received, without overlaying an application (A) (e.g., an instant messenger, etc.) for providing the preset notification on a part of the video so as not to disturb the immersion of the user watching the video.

[0084] According to an embodiment, when a preset notification is received, one or more processors (130) may identify at least one of the plurality of light-emitting elements (112) based on on-screen location information related to the preset notification.

[0085] For example, on-screen location information related to a preset notification may include a location for displaying an application (A) for providing the preset notification.

[0086] For example, one or more processors (130) may identify the previous display location or default display location of the application (A) as the location on the screen where the application (A) is to be displayed.

[0087] According to an embodiment, one or more processors (130) may identify at least one light emitting element (112) adjacent to a previous display position or a default display position of an application (A) for providing a preset notification among a plurality of light emitting elements (112).

[0088] For example, one or more processors (130) can identify at least one light-emitting element (e.g., at least one light-emitting element at the closest distance or at least one light-emitting element within a preset distance) adjacent to the center of the application (A), the center of the title bar of the application (A), etc., among the plurality of light-emitting elements (112).

[0089] According to an embodiment, when a preset notification is received while displaying an image, one or more processors (130) may not display an application (A) for providing the preset notification, but may light at least one light-emitting element based on a location for displaying the application (hereinafter, location information on the screen related to the preset notification) to notify the user of receipt of the preset notification.

[0090] For example, one or more processors (130) may cause at least one light-emitting element to emit light based on color information associated with a preset notification.

[0091] For example, one or more processors (130) can identify a color (10) corresponding to an application (A) for providing a preset notification, and control at least one light-emitting element to emit the identified color (10). For example, one or more processors (130) can identify a color of a title bar of an application (A), a primary color (e.g., a mode color) of an application (A), or a preset color corresponding to an application (A) as color information related to a preset notification.

[0092] Here, the title bar is located at the top of the application (A) and can display a title related to the application (A) (or a title related to a preset notification).

[0093] As shown in the middle of FIG. 4, according to an embodiment, a preset notification may be a push notification based on an instant message application (A), and one or more processors (130) may control, when a push notification is received, at least one light-emitting element adjacent to a position on the screen for displaying the instant message application (A) to emit a color (10) corresponding to the instant message application (A).

[0094] According to an embodiment, one or more processors (130) may control at least one light-emitting element to continuously emit light based on color information associated with a preset notification. However, the present invention is not limited thereto. For example, one or more processors (130) may control at least one light-emitting element to blink based on color information associated with a preset notification for a preset period of time (e.g., 5 seconds).

[0095] According to an embodiment, when a user input for confirming a push notification is received, one or more processors (130) may display an instant messaging application (A) based on location information to display the push notification.

[0096] Referring to the bottom of FIG. 4, when a user input for confirming a preset notification is received while at least one of a plurality of light-emitting elements (112) emits a color (10) corresponding to an application (A) for providing a preset notification, one or more processors (130) can display the preset notification by overlaying the preset notification on an image.

[0097] For example, when a user input for confirming a preset notification is received through an input device, one or more processors (130) may display the preset notification or an application (A) for providing the preset notification to be overlaid on a portion of the image based on on-screen location information related to the preset notification.

[0098] For example, input devices may include various types of devices that interact with the user and receive user input, such as a keyboard, mouse, microphone, or touch screen.

[0099] However, the input device is not limited thereto, and may include a camera that tracks the user's gaze. According to an embodiment, one or more processors (130) may display a preset notification when the user's gaze corresponds to (or is adjacent to) at least one light-emitting element that emits light based on color information related to the preset notification through the camera.

[0100] According to an embodiment, one or more processors (130) may, when a user input is received while at least one light-emitting element is emitting light based on color information associated with a preset notification, display the preset notification and turn off the at least one light-emitting element, or control the at least one light-emitting element to emit light based on a color (10) corresponding to the image.

[0101] FIG. 5 is a drawing for explaining a method for a 3D display device according to an embodiment of the present disclosure to display a 3D image and a preset notification.

[0102] Referring to FIG. 5, a display device (100) according to an embodiment of the present disclosure may include a 3D display device that provides 3D images.

[0103] For example, the image provided by the display device (100) may be a 3D image including a left-eye image and a right-eye image. The display device (100) may display the left-eye image and the right-eye image to provide a 3D image in a glasses-free manner.

[0104] For example, the display (110) includes pixels for the left eye and pixels for the right eye, and can display a left eye image through the pixels for the left eye and a right eye image through the pixels for the right eye.

[0105] The display (110) includes a viewing area separator (e.g., a parallax barrier) to provide different viewpoints, i.e., multi-views, for each viewing area on the front of the display (110), and images of different viewpoints can be output for each viewing area by blocking light through the viewing area separator.

[0106] According to an embodiment, the user views a left-eye image provided by left-eye pixels with the user's left eye, and views an image provided by right-eye pixels with the user's right eye, so the user can view images from different viewpoints, i.e., 3D images, depending on the viewing area.

[0107] However, it is not limited to this, and the display device (100) can of course also provide 3D images in a glasses manner.

[0108] The description of the upper part of Fig. 5 overlaps with the description of the upper part of Fig. 4, and the description of the middle part of Fig. 5 overlaps with the description of the middle part of Fig. 4, so it is omitted.

[0109] Referring to the bottom of FIG. 5, when a user input for confirming a preset notification is received while at least one of a plurality of light-emitting elements (112) emits a color (10) corresponding to an application (A) for providing a preset notification, one or more processors (130) can display the preset notification by overlaying the preset notification on the image.

[0110] The display device (100) can display a 3D image that indicates depth using binocular parallax.

[0111] According to an embodiment, when the display device (100) overlays a preset notification on a portion of a 3D image, the depth of the 3D image and the depth of the preset notification are different, so the user views multiple objects (e.g., objects included in the 3D image, preset notifications) with different depths, which causes fatigue to the user.

[0112] According to an embodiment, when a user input for confirming a preset notification is received, one or more processors (130) may overlay the preset notification on a 3D image and blur the 3D image.

[0113] According to an embodiment, when an application (A) for providing a preset notification by one or more processors (130) displays the notification clearly and displays the 3D image in a blurred manner, even if the user views the preset notification and the 3D image at different depths, the one or more processors (130) can provide the user with an effect in which the preset notification is positioned in front of the 3D image. This may not cause fatigue to the user.

[0114] According to an embodiment, when a user input for confirming a preset notification is received, one or more processors (130) may overlay an application (A) for providing a preset notification on a 3D image, and provide depth to the 3D image to provide an effect in which the preset notification is positioned in front of the 3D image. For example, one or more processors (130) may provide depth to the 3D image so that the 3D image is positioned relatively behind the preset notification, thereby providing an effect in which the preset notification is positioned in front of the 3D image. This may not cause user fatigue.

[0115] FIG. 6 is a drawing for explaining a method for a display device according to an embodiment of the present disclosure to emit light corresponding to each of a plurality of preset notifications.

[0116] For convenience of explanation, in FIGS. 4 and 5, it is assumed that one or more processors (130) receive one preset notification, but the present invention is not limited thereto.

[0117] As illustrated in FIG. 6, one or more processors (130) can light up a light-emitting element corresponding to each of a plurality of preset notifications.

[0118] For example, when a preset first notification is received, one or more processors (130) may cause a first light-emitting element (10-1) among a plurality of light-emitting elements (112) to emit light based on position information on the screen related to the preset first notification.

[0119] According to an embodiment, one or more processors (130) may cause the first light-emitting element to emit light based on color information related to a preset first notification or a color (10-1) corresponding to an application for providing the preset first notification.

[0120] According to an embodiment, when a preset second notification is received, one or more processors (130) may cause a second light-emitting element among a plurality of light-emitting elements (112) to emit light based on position information on the screen related to the preset second notification, and the second light-emitting element (10-2) may emit light in a color (10-2) corresponding to an application for providing the preset first notification.

[0121] According to an embodiment, one or more processors (130) may control the light emission intensity of at least one light emitting element that emits light upon receipt of a preset notification based on the accumulated number of preset notifications.

[0122] For example, when a preset third notification is received, one or more processors (130) may cause a third light-emitting element among a plurality of light-emitting elements (112) to emit light based on on-screen location information related to the preset third notification, and may cause the third light-emitting element to emit light based on a color (10-3) corresponding to an application for providing the preset third notification.

[0123] According to an embodiment, one or more processors (130) may increase the light emission intensity of the third light emitting element (10-3) proportionally when the number of times the preset third notification is received increases before a user input for confirming the preset third notification is received.

[0124] For example, one or more processors (130) may cause the third light-emitting element (10-3) to emit light according to the first intensity when a preset third notification is received, and may cause the third light-emitting element (10-3) to emit light according to the second intensity when the preset third notification is re-received before a user input for confirming the preset third notification is received.

[0125] FIG. 7 is a drawing for explaining a method of emitting light from a light-emitting element according to an application related to a function according to an embodiment of the present disclosure.

[0126] Referring to FIG. 7, one or more processors (130) may, while displaying an image, identify a function and cause at least one of the plurality of light-emitting elements (112) to emit light based on location information and color information of an application for providing the function. For example, one or more processors (130) may, while displaying an image, identify a recording function, a search function, etc. related to the image.

[0127] According to an embodiment, one or more processors (130) may identify a second light emitting element among the plurality of light emitting elements (112) based on a previous display position or a default display position of an application (A') for providing a recording function.

[0128] According to an embodiment, one or more processors (130) may cause a first light-emitting element corresponding to an application for providing a search function to emit light in a color (10-1) corresponding to the application for providing a search function, and cause a second light-emitting element corresponding to an application (A') for providing a recording function to emit light in a color (10-2) corresponding to the application (A') for providing a recording function.

[0129] When a user input is received to execute an application (A') for providing a recording function according to an embodiment, one or more processors (130) may execute the application (A').

[0130] According to an embodiment, in addition to receiving a preset notification, one or more processors (130) may, by emitting at least one light-emitting element based on the location information on the screen related to the application and the color corresponding to the application, notify the user whether an application for providing a function related to the image has been identified (or whether it is executable).

[0131] FIG. 8 is a diagram for explaining information related to colors corresponding to each of a plurality of users according to an embodiment of the present disclosure.

[0132] According to an embodiment of the present disclosure, the memory (120) can store information related to a color corresponding to each of a plurality of users (1, 2, 3).

[0133] According to an embodiment, when a preset notification is received from a first user (1) among a plurality of users (1, 2, 3), one or more processors (130) can identify a color corresponding to the first user (1) based on the information.

[0134] According to an embodiment, one or more processors (130) may identify a color (10) corresponding to a first user (1) as color information associated with a preset notification.

[0135] One or more processors (130) may identify at least one light-emitting element among a plurality of light-emitting elements (112) based on on-screen position information related to a preset notification, and may cause at least one light-emitting element to emit light based on color information related to the preset notification. For example, one or more processors (130) may cause at least one light-emitting element to emit light in a color corresponding to a first user (1).

[0136] However, the present invention is not limited thereto, and one or more processors (130) may cause a plurality of light-emitting elements (112) to emit light in a color (10) corresponding to the first user (1).

[0137] According to an embodiment, one or more processors (130) cause at least one of the plurality of light-emitting elements (112) to emit light in a color corresponding to a user who has transmitted a preset notification, thereby providing a user of the display device (100) with an immersive experience of the image while also recognizing the user who has transmitted the preset notification.

[0138] FIG. 9 is a drawing for explaining a display device that indicates a progress rate corresponding to a progress bar using a plurality of light-emitting elements according to an embodiment of the present disclosure.

[0139] According to an embodiment, the preset notification may include a progress bar (B). The progress bar (B) may visually indicate the progress (or progress rate) of a currently running task.

[0140] One or more processors (130) can display an image on the entire screen and simultaneously provide a progress bar (B) corresponding to the progress bar using at least one of the first to fourth arrays.

[0141] For example, as illustrated in FIG. 9, one or more processors (130) may provide progress using a fourth array including fourth light-emitting elements arranged in a fourth edge region corresponding to a lower region of the rear surface of the display (110).

[0142] For example, one or more processors (130) can sequentially light the fourth light-emitting elements according to the progress rate. For example, if the progress rate is 0%, none of the fourth light-emitting elements can light up, and if the progress rate is 100%, all of the fourth light-emitting elements can light up.

[0143] However, the present invention is not limited thereto, and one or more processors (130) may provide progress using a first array including first light-emitting elements arranged in a first edge area corresponding to a left area of ​​the rear surface of the display (110).

[0144] For example, if the progress is 0%, none of the first light-emitting elements will emit light, if the progress increases, the first light-emitting elements will emit light sequentially, and if the progress is 100%, all of the first light-emitting elements can emit light.

[0145] FIG. 10 is a drawing for explaining a method of causing a plurality of light-emitting elements to emit light based on position information on the screen of each of a plurality of users according to an embodiment of the present disclosure.

[0146] Referring to FIG. 10, one or more processors (130) may provide content that enables interaction with multiple users. For example, one or more processors (130) may control a display (110) to display video conferencing, game content, online classes, etc.

[0147] For example, game content is content in which multiple users can participate and in which interaction between multiple users is possible.

[0148] According to an embodiment, one or more processors (130) may identify a color corresponding to each of the plurality of users, and may cause the plurality of light-emitting elements (112) to emit light based on the location corresponding to each of the plurality of users and the color corresponding to each of the plurality of users within the game content.

[0149] For example, one or more processors (130) can identify the location and color of a first user among a plurality of users, and identify a first light-emitting element among a plurality of light-emitting elements (112) based on the location of the first user within the game content. One or more processors (130) can cause the first light-emitting element to emit light in a color (31) corresponding to the first user.

[0150] However, this is not limited thereto. For example, one or more processors (130) may identify a fourth user speaking among a plurality of users, and identify a fourth light-emitting element among a plurality of light-emitting elements (112) based on a location corresponding to the fourth user in a video conference. One or more processors (130) may cause the fourth light-emitting element to emit light in a color (34) corresponding to the fourth user.

[0151] FIG. 11 is a drawing for explaining colors corresponding to an image according to an embodiment of the present disclosure.

[0152] One or more processors (130) can identify a color corresponding to a preset area in the image as a color corresponding to the image (10).

[0153] For example, when fire is displayed in the center area of ​​the image as illustrated in FIG. 11, one or more processors (130) can identify red as a color (10) corresponding to the image, and can cause at least one of the plurality of light-emitting elements (112) to emit light based on the color (10) corresponding to the image. For example, one or more processors (130) can control at least one light-emitting element to emit a red color.

[0154] However, the present invention is not limited thereto, and when an animation effect is provided in an image, one or more processors (130) can identify a color corresponding to the animation effect as a color corresponding to the image (10).

[0155] For example, when an animation effect of lightning flowing in an image is provided, one or more processors (130) can control at least one of the plurality of light-emitting elements (112) to emit a white or blue color.

[0156] According to an embodiment, when a first UI is selected from among a plurality of UIs included in an image, one or more processors (130) may identify a color corresponding to the first UI as a color (10) corresponding to the image. For example, when a first UI having a blue color is selected from among a plurality of UIs, one or more processors (130) may identify a blue color as a color (10) corresponding to the image. One or more processors (130) may control at least one light-emitting element among a plurality of light-emitting elements (112) to emit a blue color.

[0157] FIG. 12 is a drawing for explaining a display device communicating with an external device according to an embodiment of the present disclosure.

[0158] Referring to FIG. 12, the display device (100) includes a communication interface and can communicate with an external device (200) located within the home through the communication interface. According to an embodiment, one or more processors (130) can identify the location of the external device (200).

[0159] It goes without saying that, depending on the embodiment, the communication interface may be implemented as various interfaces depending on the implementation example of the display device (100). For example, the communication interface may communicate with a plurality of robots (200), charging stations (300), etc. through a communication method such as Bluetooth, AP-based Wi-Fi (Wireless LAN network), Zigbee, wired / wireless LAN (Local Area Network), WAN (Wide Area Network), Ethernet, IEEE 1394, HDMI (High-Definition Multimedia Interface), USB (Universal Serial Bus), MHL (Mobile High-Definition Link), AES / EBU (Audio Engineering Society / European Broadcasting Union), optical, coaxial, etc. According to an example, the communication interface may communicate with other electronic devices, external servers, and / or remote control devices.

[0160] According to an embodiment, when a preset notification is received from an external device (200) via a communication interface, one or more processors (130) can identify at least one light-emitting element among a plurality of light-emitting elements (112) corresponding to the location of the external device (200).

[0161] According to an embodiment, one or more processors (130) may cause at least one light-emitting element to emit light using color information related to an external device (200) as color information related to a preset notification. For example, if the color information related to the external device (200) is a black color, the one or more processors (130) may control at least one light-emitting element corresponding to the location of the external device (200) to emit a black color.

[0162] According to an embodiment, color information related to an external device (200) may include a color preset by a user, a color according to identification information of the external device (200), etc.

[0163] For example, one or more processors (130) can communicate with an air purifier to identify the location of the air purifier within a home, and when a preset notification requesting filter replacement is received from the air purifier, at least one light emitting element among a plurality of light emitting elements (112) corresponding to the location of the air purifier can be controlled to emit a color (10) corresponding to the air purifier.

[0164] FIG. 13 is a flowchart for explaining a method for controlling a display device according to an embodiment of the present disclosure.

[0165] A method for controlling a display device including a plurality of pixel elements arranged on a front surface and a plurality of light-emitting elements arranged in an edge area of ​​a rear surface according to an embodiment of the present disclosure provides an image through the plurality of pixel elements (S1310).

[0166] When a preset notification is received, at least one light-emitting element among a plurality of light-emitting elements is identified based on the position information on the screen related to the preset notification (S1320).

[0167] At least one light-emitting element identified based on color information related to a preset notification is illuminated (S1330).

[0168] The location information according to an embodiment of the present disclosure includes a previous display location or a default display location of an application for providing a preset notification, and the step S1320 of identifying at least one light-emitting element may include a step of identifying at least one light-emitting element adjacent to the previous display location or the default display location among a plurality of feet and elements when a preset notification is received.

[0169] A control method according to an embodiment of the present disclosure may further include a step of displaying a preset notification by overlaying the preset notification on an image when a user input for confirming a preset notification is received.

[0170] A display device according to an embodiment of the present disclosure includes a 3D display, and the displaying step may further include a step of displaying a preset notification on the 3D image when a user input is received while displaying a 3D image through the 3D display, and a step of providing an effect in which the preset notification is positioned in front of the 3D image by giving depth to the 3D image or blurring the 3D image.

[0171] A display device according to an embodiment includes information related to a color corresponding to each of a plurality of users, and a control method according to an embodiment of the present disclosure further includes a step of, when a preset notification is received from a first user among the plurality of users, identifying a color corresponding to the first user as color information related to the preset notification based on the information, and the step S1330 of emitting light from at least one light-emitting element may include a step of emitting light from at least one light-emitting element identified based on color information related to the preset notification.

[0172] A control method according to an embodiment of the present disclosure may further include a step of identifying a color corresponding to an image and causing a plurality of light-emitting elements to emit light based on the color corresponding to the image.

[0173] According to an embodiment of the present disclosure, the edge includes at least one of a first edge region corresponding to a left region of the rear surface of the display, a second edge region corresponding to a right region, a third edge region corresponding to an upper region, or a fourth edge region corresponding to a lower region, and the plurality of light-emitting elements includes at least one of a first array including first light-emitting elements arranged in the first edge region, a second array including second light-emitting elements arranged in the second edge region, a third array including third light-emitting elements arranged in the third edge region, or a fourth array including fourth light-emitting elements arranged in the fourth edge region, and the step of emitting light of the plurality of light-emitting elements may include a step of emitting light of the first light-emitting elements included in the first array based on colors corresponding to a right region of the image, emitting light of the second light-emitting elements included in the second array based on colors corresponding to a left region of the image, emitting light of the third light-emitting elements included in the third array based on colors corresponding to an upper region of the image, and emitting light of the fourth light-emitting elements included in the fourth array based on colors corresponding to a lower region of the image, while displaying the image.

[0174] The control method according to the embodiment may further include, if the preset notification includes a progress bar, a step of controlling the light emission of light emitting elements included in any one of the first to fourth arrays to indicate a progress rate corresponding to the progress bar.

[0175] The step of emitting light from a plurality of light-emitting elements according to an embodiment of the present disclosure may further include a step of identifying a color corresponding to the first UI as a color corresponding to the image when a first UI is selected from among a plurality of UIs included in the image, or identifying a color corresponding to a preset area in the image as a color corresponding to the image.

[0176] According to an embodiment of the present disclosure, the step of emitting light from at least one light-emitting element may include the step of controlling at least one light-emitting element identified based on color information associated with a preset notification to blink for a preset period of time, and the step of turning off the at least one light-emitting element or emitting light from at least one light-emitting element based on a color corresponding to an image when the preset notification is displayed.

[0177] A control method according to an embodiment of the present disclosure further includes a step of identifying a location of the external device by communicating with the external device, a step of identifying at least one light-emitting element corresponding to the location among a plurality of light-emitting elements when a preset notification is received from the external device, and the step of emitting light may include a step of emitting light by identifying color information related to the external device as color information related to the preset notification.

[0178] However, it goes without saying that the various embodiments of the present disclosure can be applied not only to display devices but also to various types of electronic devices including display functions.

[0179] Meanwhile, the various embodiments described above may be implemented in a computer-readable recording medium or similar device using software, hardware, or a combination thereof. In some cases, the embodiments described herein may be implemented by the processor itself. In a software implementation, embodiments, such as the procedures and functions described herein, may be implemented as separate software modules. Each of the software modules may perform one or more functions and operations described herein.

[0180] Meanwhile, computer instructions for performing processing operations of the display device (100) according to the various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. When the computer instructions stored in the non-transitory computer-readable medium are executed by a processor of a specific device, they cause the specific device to perform processing operations in the display device (100) according to the various embodiments described above.

[0181] A non-transitory computer-readable medium refers to a medium that permanently stores data and can be read by a device, rather than a medium that stores data for a short period of time, such as a register, cache, or memory. Specific examples of non-transitory computer-readable media include CDs, DVDs, hard disks, Blu-ray discs, USBs, memory cards, and ROMs.

[0182] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In the display device, A display comprising a plurality of pixel elements arranged on a front side and a plurality of light-emitting elements arranged in an edge area on the rear side; A memory storing one or more instructions; and comprising one or more processors; The one or more processors, by executing the one or more instructions, Controlling the display to provide an image through the plurality of pixel elements; When a preset notification is received, at least one of the plurality of light-emitting elements is identified based on the on-screen location information related to the preset notification, A display device that causes at least one identified light-emitting element to emit light based on color information related to the above-described preset notification.

2. In paragraph 1, The above location information is, Contains the application's previous display location or default display location for providing the above preset notifications; One or more of the above processors, A display device, wherein when the above preset notification is received, the display device identifies at least one light-emitting element adjacent to the previous display position or the default display position among the plurality of feet and elements.

3. In paragraph 1, One or more of the above processors, A display device that, when a user input for confirming the above preset notification is received, displays the above preset notification by overlaying the above preset notification on the image.

4. In paragraph 3, The above display is, Includes 3D display; One or more of the above processors, When the user input is received while displaying a 3D image through the 3D display, the preset notification is displayed on the 3D image. A display device that provides an effect in which the preset notification is positioned in front of the 3D image by providing depth to the 3D image or blurring the 3D image.

5. In paragraph 1, Further comprising a memory storing information related to a color corresponding to each of a plurality of users; One or more of the above processors, When the preset notification is received from a first user among the plurality of users, a color corresponding to the first user is identified as color information related to the preset notification based on the information, A display device that causes at least one identified light-emitting element to emit light based on color information related to the above-described preset notification.

6. In paragraph 1, One or more of the above processors, A display device that identifies a color corresponding to the image and causes the plurality of light-emitting elements to emit light based on the color corresponding to the image.

7. In paragraph 6, The above edge, At least one of a first edge region corresponding to a left region of the rear surface of the display, a second edge region corresponding to a right region, a third edge region corresponding to an upper region, or a fourth edge region corresponding to a lower region, The above plurality of light-emitting elements are, At least one of a first array including first light-emitting elements arranged in the first edge region, a second array including second light-emitting elements arranged in the second edge region, a third array including third light-emitting elements arranged in the third edge region, or a fourth array including fourth light-emitting elements arranged in the fourth edge region, One or more of the above processors, A display device, which, while displaying the image, causes the first light-emitting elements included in the first array to emit light based on colors corresponding to a right area of ​​the image, causes the second light-emitting elements included in the second array to emit light based on colors corresponding to a left area of ​​the image, causes the third light-emitting elements included in the third array to emit light based on colors corresponding to an upper area of ​​the image, and causes the fourth light-emitting elements included in the fourth array to emit light based on colors corresponding to a lower area of ​​the image.

8. In paragraph 6, One or more of the above processors, A display device, wherein if the above preset notification includes a progress bar, the display device controls the light emission of light emitting elements included in any one of the first to fourth arrays to indicate a progress rate corresponding to the progress bar.

9. In paragraph 6, One or more of the above processors, A display device that, when a first UI among a plurality of UIs included in the image is selected, identifies a color corresponding to the first UI as a color corresponding to the image, or identifies a color corresponding to a preset area in the image as a color corresponding to the image.

10. In paragraph 6, One or more of the above processors, Controlling at least one identified light-emitting element to blink based on color information related to the preset notification for a preset period of time, A display device, which turns off at least one light-emitting element when the above preset notification is displayed, or causes at least one light-emitting element to emit light based on a color corresponding to the image.

11. In paragraph 1, further comprising a communication interface; One or more of the above processors Communicates with an external device through the above communication interface to identify the location of the external device, When the preset notification is received from the external device, at least one light-emitting element corresponding to the position among the plurality of light-emitting elements is identified, A display device that identifies color information related to the external device as color information related to the preset notification and causes at least one light-emitting element to emit light.

12. A method for controlling a display device including a plurality of pixel elements arranged on the front side and a plurality of light-emitting elements arranged on the edge area of ​​the rear side, A step of providing an image through the plurality of pixel elements; When a preset notification is received, a step of identifying at least one light-emitting element among the plurality of light-emitting elements based on on-screen location information related to the preset notification; and A control method comprising: a step of emitting light from at least one identified light-emitting element based on color information related to the above-described preset notification.

13. In paragraph 12, The above location information is, Contains the application's previous display location or default display location for providing the above preset notifications; The step of identifying at least one light-emitting element comprises: A control method, comprising: when the above preset notification is received, identifying at least one light-emitting element among the plurality of feet and elements adjacent to the previous display position or the default display position; 14. In paragraph 12, The above control method is, A control method further comprising the step of: when a user input for confirming the preset notification is received, displaying the preset notification by overlaying the preset notification on the image; 15. In paragraph 14, The above display device, Includes 3D display; The above displaying steps are: When the user input is received while displaying a 3D image through the 3D display, a step of displaying the preset notification on the 3D image; and A control method further comprising: a step of providing depth to the 3D image or blurring the 3D image to provide an effect in which the preset notification is positioned in front of the 3D image.

Images