Display device and control method thereof

Abstract

This display device comprises: a display; a lighting device including a plurality of light-emitting elements configured to emit light at a lower end of the display device; a memory storing at least one instruction; and one or more processors configured to execute the at least one instruction, wherein the one or more processors control the display to display an image input to the one or more processors, detect an object in the image, acquire position information and color information corresponding to the detected object, and control the lighting device such that the at least one light-emitting element emits light corresponding to the color information at a lower end position of the display device corresponding to the acquired position information.

Description

Display device and control method thereof

[0001] The present disclosure relates to a display device that provides a lighting effect related to displayed content and a method for controlling the same.

[0002] Recently, display devices equipped with LEDs positioned on the sides or rear of the device that emit light in various colors are becoming widespread. These display devices can enhance the user's immersion in the content by emitting light of the primary color perceived by the user through the content (ambient light).

[0003] Embodiments of the present disclosure may solve at least one of the previously described problems and / or disadvantages and provide the advantages described below. Accordingly, the embodiments of the present disclosure provide a display device and a method for controlling the same that provide a lighting effect related to displayed content.

[0004] Additional embodiments will be presented in the detailed description below, some of which are obvious from the detailed description, and other embodiments can also be presented through learning from the presented embodiments.

[0005] A display device according to an embodiment of the present disclosure comprises a display, a lighting device including a plurality of light-emitting elements configured to irradiate light from the bottom of the display device, a memory storing at least one instruction, and one or more processors configured to execute the at least one instruction. The one or more processors control the display to display an image input to the one or more processors, detect an object within the image, obtain location information and color information corresponding to the detected object, and control the lighting device so that at least one light-emitting element irradiates light corresponding to the color information at a bottom position of the display device corresponding to the obtained location information.

[0006] The memory may further store information about an object of interest corresponding to each of a plurality of game types, and the one or more processors may be configured to acquire a game type corresponding to the image and determine whether the detected object corresponds to the stored information about the object of interest corresponding to the acquired game type.

[0007] The information regarding the object of interest includes shape information of the object of interest and color information of the object of interest, and the one or more processors may be configured to acquire color information corresponding to the object of interest when it is confirmed that the detected object corresponds to the stored information regarding the object of interest.

[0008] The display device may further include a user interface for receiving a selection of a game type corresponding to the displayed image.

[0009] The above one or more processors may be configured to divide the displayed image into a plurality of regions, identify whether the detected object exists in one or more of the plurality of regions, and acquire location information corresponding to the one or more regions based on the identification that the detected object exists in one or more regions.

[0010] The above one or more processors may be configured to compare the previous frame and the current frame of the displayed image to determine a change area of ​​the image between the previous frame and the current frame, and to determine whether the detected object exists within the change area.

[0011] The above one or more processors input the partitioned image into a learning model configured to identify an object, and can determine whether an object exists based on the output of the learning model indicating that a detected object exists.

[0012] The memory may be configured to further store multiple learning models corresponding to each of multiple game types, and the one or more processors may be configured to acquire a game type corresponding to the displayed image and to perform object recognition using a learning model corresponding to the acquired game type among the multiple learning models.

[0013] The above one or more processors may be configured to determine the direction of movement of the detected object and to control the lighting device so that a light-emitting element among the plurality of light-emitting elements, which is located at the lower position of the display device corresponding to the determined direction of movement, emits light.

[0014] The above one or more processors may be configured to identify the location of the detected object on the displayed image and to control the lighting device so that the light-emitting element irradiates light at the lower position of the display device corresponding to the identified location among the plurality of light-emitting elements.

[0015] The display device further includes a speaker, and the one or more processors may be configured to acquire acoustic data to be input to the speaker and, based on a determination regarding the presence of sound within the acquired acoustic data, to control the lighting device to emit a colored light at a lower position of the display device corresponding to the sound.

[0016] The above one or more processors may be configured to acquire the direction of the sound and to control the lighting device so that at least one light-emitting element among the plurality of light-emitting elements corresponding to the acquired direction irradiates light.

[0017] The display device further includes at least one second light-emitting element capable of emitting light from the rear of the display device, and the one or more processors may be configured to control the lighting device so that the at least one second light-emitting element also emits light.

[0018] A method of a display device according to one embodiment of the present disclosure, comprising a display, a lighting device including a plurality of light-emitting elements configured to emit light from the bottom of the display device, a memory configured to store at least one instruction, and one or more processors configured to execute said at least one instruction, wherein the one or more processors include the steps of: controlling the display to display an image input to said one or more processors; detecting an object within said displayed image; obtaining location information and color information corresponding to said detected object; and controlling the lighting device so that at least one light-emitting element at a bottom position of said display device corresponding to said location information emits light corresponding to said color information.

[0019] The control method further includes the step of storing interest object information for each game type, and the detection step may acquire a game type corresponding to the image and detect whether an interest object corresponding to the acquired game type exists within the image.

[0020] The above-mentioned detection step divides the image into multiple regions and detects whether a preset object exists for each divided region, and the above-mentioned acquisition step can acquire location information corresponding to the region when an object in a specific region is identified.

[0021] The above detection step compares the previous frame and the current frame and can detect whether an object exists in an area with high image change.

[0022] The step of generating the above control information may involve obtaining the movement direction of the detected object and generating control information that causes a light-emitting element belonging to a lower area corresponding to the obtained movement direction to irradiate light.

[0023] The control method may further include the steps of detecting a preset sound within the acquired sound data when sound data is acquired, and generating control information to irradiate light corresponding to the detected sound.

[0024] A non-transient computer-readable recording medium storing a program for executing a control method for a display device, comprising a display according to one embodiment of the present disclosure, a lighting device including a plurality of light-emitting elements configured to emit light from the bottom of the display device, a memory configured to store at least one instruction, and one or more processors configured to execute said at least one instruction, wherein the method comprises the steps of detecting an object within an image displayed on the display of the display device, acquiring location information and color information corresponding to the detected object, and generating control information for controlling the lighting device so that at least one light-emitting element at the bottom position of the display device corresponding to the acquired location information irradiates light corresponding to the color information.

[0025] The above-described or other aspects, features, and benefits of embodiments of the present disclosure will become more apparent from the following description with reference to the accompanying drawings. In the accompanying drawings:

[0026] FIG. 1 is a drawing for explaining a lighting control operation according to one embodiment of the present disclosure,

[0027] FIG. 2 is a block diagram illustrating the configuration of a display device according to one embodiment of the present disclosure,

[0028] FIG. 3 is a block diagram illustrating the configuration of a display device according to one embodiment of the present disclosure,

[0029] FIG. 4 is a drawing for explaining various light-emitting positions according to the present disclosure,

[0030] FIG. 5 is a drawing for explaining an example of operation of a lighting device according to one embodiment of the present disclosure,

[0031] FIG. 6 is a drawing for explaining an example of operation of a lighting device according to one embodiment of the present disclosure,

[0032] FIG. 7 is a drawing for explaining an example of operation of a lighting device according to one embodiment of the present disclosure,

[0033] FIG. 8 is a drawing for explaining an example of operation of a lighting device according to one embodiment of the present disclosure,

[0034] FIG. 9 is a drawing for explaining an example of operation of a lighting device according to one embodiment of the present disclosure,

[0035] FIG. 10 is a drawing illustrating an example of a user interface window for receiving a game genre setting according to one embodiment of the present disclosure.

[0036] FIG. 11 is a drawing illustrating an example of a user interface window for receiving color information according to one embodiment of the present disclosure.

[0037] FIG. 12 is a flowchart for explaining a control method of a display device according to one embodiment of the present disclosure,

[0038] FIG. 13 is a flowchart illustrating a lighting control method according to one embodiment of the present disclosure.

[0039] The embodiments described herein are subject to various modifications and may have various forms; specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of specific embodiments and should be understood to include various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In relation to the description of the drawings, similar reference numerals may be used for similar components.

[0040] In describing the present disclosure, if it is determined that a detailed description of related known functions or configurations could unnecessarily obscure the essence of the present disclosure, such detailed description is omitted.

[0041] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concept of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to make the present disclosure more faithful and complete and to fully convey the technical concept of the present disclosure to those skilled in the art.

[0042] The terms used in this disclosure are used merely to describe specific embodiments and are not intended to limit the scope of the rights. The singular expression includes the plural expression unless the context clearly indicates otherwise.

[0043] In the present disclosure, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, actions, or components, etc.) and do not exclude the presence of additional features.

[0044] In the present disclosure, expressions such as “A or B,” “at least one of A or / and B,” or “one or more of A or / and B” may include all possible combinations of items listed together. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” may refer to cases including (1) at least one A, (2) at least one B, or (3) both at least one A and at least one B.

[0045] Expressions such as "first," "second," "first," or "second" used in this disclosure may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0046] Where it is stated that a component (e.g., a first component) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., a second component), it should be understood that the component may be directly connected to the other component or connected through the other component (e.g., a third component).

[0047] On the other hand, when it is stated that a certain component (e.g., a first component) is "directly connected" or "directly coupled" to another component (e.g., a second component), it may be understood that no other component (e.g., a third component) exists between said certain component and said other component.

[0048] As used in this disclosure, the expression “configured to” may be replaced, depending on the context, with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” may not necessarily mean only “specifically designed to” in hardware.

[0049] Instead, in some situations, the expression “device configured to do something” may mean that the device is “capable of doing something” together with other devices or components. For example, the phrase “processor configured (or set) to perform A, B, and C” may mean a dedicated processor for performing those operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or application processor) capable of performing those operations by executing one or more software programs stored in a memory device.

[0050] In the embodiments, a 'module' or 'part' performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of 'modules' or a plurality of 'parts' may be integrated into at least one module and implemented by one or more processors, except for the 'modules' or 'parts' that need to be implemented in specific hardware.

[0051] Operations performed by a module, program, or other component according to various embodiments may be executed sequentially, in parallel, iteratively, or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0052] Meanwhile, the various elements and areas in the drawings are depicted schematically. Accordingly, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0053] Meanwhile, an electronic device according to various embodiments of the present disclosure may include, for example, at least one of a smartphone, a tablet PC, a desktop PC, a laptop PC, a server, or a wearable device. The wearable device may include at least one of an accessory type (e.g., a watch, ring, bracelet, anklet, necklace, glasses, contact lens, or head-mounted device (HMD)), a fabric or clothing integrated type (e.g., electronic clothing), a body-attached type (e.g., a skin pad or tattoo), or a bio-implantable circuit.

[0054] In some embodiments, the electronic device is, for example, a television, a DVD (digital video disk) player, audio, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a media box (e.g., Samsung HomeSync). TM , Apple TV TM , or Google TV TM ), game console (e.g., Xbox) TM PlayStation TMIt may include at least one of an electronic dictionary, an electronic key, a camcorder, or an electronic photo frame. Meanwhile, among the electronic devices described above, a device equipped with a display may be referred to as a display device. Meanwhile, even if the electronic device of the present disclosure does not have a display, it may be a set-top box or a PC that provides images to a display device.

[0055] Hereinafter, embodiments according to the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement them.

[0056] FIG. 1 is a drawing for explaining a lighting control operation according to one embodiment of the present disclosure.

[0057] Referring to FIG. 1, a display device (100) can display an image corresponding to content to a user (10). Here, the content consists of images, audio, or a combination thereof and includes information that can be provided to the user visually, audibly, or audiovisually through an electronic device. For example, the content may include game content, voice content, music content, image content, video content, widget content, web pages, etc.

[0058] The display device (100) can be implemented as various types of devices such as digital TV, DVD player, Blu-ray disc player, game console, network TV, smart TV, internet TV, web TV, IPTV (Internet Protocol Television), signage, PC, HMD (Head mounted Display, wearable device), but is not limited thereto.

[0059] Recent display devices are equipped with lighting devices and can control these devices to provide consumers with a vibrant and stylish display experience. For example, by utilizing lighting (or light-emitting elements) located on the rear or sides of the display device to output lighting related to the video, users are made to feel more immersed in watching content.

[0060] However, conventional lighting control provided a limited sense of immersion by considering only the dominant colors within the image or utilizing predetermined colors. In particular, while game content may involve various objects and regions of interest, it failed to provide adaptive lighting for these diverse situations, specifically regarding the conditions of objects within the screen.

[0061] To solve these problems, the present disclosure identifies an object (or area) that a user might be interested in in an image, and provides lighting effects according to the location and type corresponding to the identified object.

[0062] Specifically, the display device (100) is equipped with a lighting device comprising a plurality of light-emitting elements capable of irradiating light toward the bottom of the display device, and when an image is input, it can detect a preset object within the input image. For ease of explanation, the above assumes that the lighting device is positioned at the bottom of the display device, but in implementation, the lighting device may irradiate light not only toward the bottom of the display device but also toward other directions. Such examples will be described later in FIG. 4.

[0063] And when a preset object is detected, the display device (100) can acquire position and color information corresponding to the object and control a lighting device to provide a lighting effect corresponding to the acquired information. Such an object may be referred to as a UI element, an object, an object of interest, etc.

[0064] For example, as illustrated in FIG. 1, the display device (100) can detect the presence of an object (111) expected to be an enemy within the screen and can provide illumination (20) to an area (21) corresponding to the location of the object.

[0065] In this way, by providing lighting corresponding to the location of a specific object, the user can focus more on the screen area corresponding to that lighting location, and prevent the user from failing to see the object even if they are focusing on another area.

[0066] Meanwhile, such objects of interest may vary depending on the type of game (or game genre). That is, in the illustrated example, it was assumed that the object of interest is the counterpart object, but the type of interest may differ in other types of games and game genres. Operations according to various types of games will be described later with reference to FIGS. 5 to 9. Meanwhile, in order to identify the object of interest corresponding to various types of games or game genres, the present disclosure may utilize an object recognition method (or recognition module, AI model) corresponding to the type of game.

[0067] The display device (100) can control a lighting device using sound information as well as video. For example, if the sound of footsteps or bullets of an object moving from left to right is detected, the display device (100) can display lighting corresponding to the position (or direction of movement) of the object. The specific configuration and operation of the display device (100) will be described later in FIG. 2.

[0068] As described above, the display device (100) according to the present disclosure does not merely display the main color of the screen, but provides lighting that makes it easier for the user to recognize key information during the progress of the content, thereby increasing the sense of immersion in the game content.

[0069] Meanwhile, although FIG. 1 illustrates and describes the present disclosure as being applicable to game content, it is possible to provide a lighting environment even in cases where it is not game content during implementation. For example, when a user watches a movie using a display device (100), the display device (100) can output lighting corresponding to the genre and situation of the movie. For example, if an explosion scene is detected in an action movie, the display device (100) can output lighting corresponding to the color information of the explosion scene.

[0070] Meanwhile, although the operation of the present invention is illustrated and described in FIG. 1 as being applied to a display device, it may also be applied to an electronic device that does not include a display during implementation. For example, an electronic device that provides images of a micro LED or lithography may provide images to the display and control a lighting device from the electronic device side. In this case, the lighting device may be attached to the display or may be spaced apart and located around the display.

[0071] Meanwhile, although FIG. 1 illustrates and describes the display device as independently outputting light, the display device can perform lighting operations in conjunction with other devices. For example, as shown in the illustrated example, the display device may be linked with a keyboard to illuminate multiple areas of the keyboard and multiple areas of the lighting device described above.

[0072]

[0073] FIG. 2 is a block diagram illustrating the configuration of a display device according to one embodiment of the present disclosure.

[0074] Referring to FIG. 2, the display device (100) includes a display (110), a memory (120), a lighting device (130), and a processor (140).

[0075] The display (110) can be implemented as various types of displays such as LCD (Liquid Crystal Display), OLED (Organic Light Emitting Diodes) display, PDP (Plasma Display Panel), Micro LED, etc. The display (110) may also include a driving circuit, a backlight unit, etc., which can be implemented in forms such as a-si TFT, LTPS (low temperature poly silicon) TFT, OTFT (organic TFT), etc. Meanwhile, the display (110) can be implemented as a touchscreen combined with a touch sensor, a flexible display, a 3D display, etc.

[0076] The display (110) can display a screen corresponding to an image. Here, the screen includes an image displayed on the display (110). The image may also be referred to by terms such as a frame. Various types of objects, such as icons, text, photos, videos, and widgets, may be displayed on the screen.

[0077] And the video may be a video with a fixed refresh rate or a video with a variable refresh rate. If the video has a variable refresh rate, the display (110) may operate at a refresh rate corresponding to the refresh rate of the input video.

[0078] Here, refresh rate refers to the speed at which a display shows data for a single screen, and may also be called frame rate, refresh frequency, screen refresh rate, frame rate, frame rate, or refresh rate. For example, frames per second refers to the number of screens displayed per second, and the unit fps (or frames / second) can be used.

[0079] Therefore, a fixed refresh rate means that the playback frequency is constant during the video display process, while a variable refresh rate means that the playback frequency changes during the video display process.

[0080] The memory (120) may store instructions, programs, or data for controlling the display device (100). Here, the instructions may include instructions for detecting objects within an image, instructions for controlling lighting based on location information and color information, instructions for controlling the display using an input image, etc.

[0081] For example, the memory (120) may be implemented as internal memory such as ROM (e.g., EEPROM (electrically erasable programmable read-only memory)) or RAM included in the processor (140), or as memory separate from the processor (140). In this case, the memory (120) may be implemented in the form of memory embedded in the display device (100) or in the form of memory that can be attached to and detached from the display device (100), depending on the purpose of data storage. For example, data for driving the display device (100) may be stored in memory embedded in the display device (100), and data for the extended function of the display device (100) may be stored in memory that can be attached to and detached from the display device (100).Meanwhile, the memory embedded in the display device (100) is implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), etc.), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), etc.), hard drive, or solid state drive (SSD), and the memory that can be attached to and detached from the display device (100) can be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), external memory connectable to a USB port (e.g., USB memory).

[0082] The memory (120) may temporarily store images obtained through the input / output interface (170) described later, or may store content corresponding to the images. Additionally, the memory (120) may store various content (e.g., broadcast content, applications, etc.) received through the communication unit (160) described later.

[0083] Meanwhile, although the display device (100) is depicted as being composed of a single memory in the illustrated example, when distinguishing between volatile memory and non-volatile memory, the display device (100) may be described as including multiple memories.

[0084] The memory (120) can store a learning model for identifying multiple objects. Here, the learning model may be referred to as an AI model, an object identification algorithm, etc. Such a learning model may be a model that determines whether a specific object is included in an input image when an image is input.

[0085] The specific objects detected here may vary depending on the learning method. Therefore, during implementation, objects used in various games can be trained integrally, or objects can be trained separately by game genre, and a learning model suitable for the game genre can be used when in use. Additionally, it is possible to use a learning model corresponding to a specific game rather than a genre. That is, when a user plays game A, the display device can use a learning model corresponding to game A.

[0086] Such a learning model can perform object recognition. Object recognition involves identifying objects in an image. For example, object recognition may include classifying what kind of object an object is by analyzing visual information within an image. Objects may include any object that is distinguishable from the background in an image. Depending on the embodiment, the process of determining whether an object exists in an image and the location of the object may also be included in object recognition.

[0087] Here, an object may be a character within the content or an item. An item includes graphic elements displayed on the display. An item may include graphic elements capable of providing information to the user or interacting with the user based on user input such as selecting or executing the item. For example, an item may be referred to as an object, UI element, UI object, etc., and may include icons, buttons, images, etc.

[0088] Such learning models may vary depending on the genre of the content and may also vary depending on the type of content. Additionally, when implementing, they can be applied not only to game content but also to other forms of content such as movies.

[0089] The lighting device (130) includes a plurality of light-emitting elements capable of irradiating light toward the bottom of the display device. For example, the lighting device (130) may divide the bottom area of ​​the display device into a plurality of regions and provide individual lighting for each divided region.

[0090] A lighting device (130) may have a plurality of light-emitting elements spaced apart from each other in the lower area of ​​the display. Here, each light-emitting element may be composed of a single element or may be composed of a plurality of elements. For example, corresponding to one area, it may include an R LED emitting red light, a G LED emitting green light, and a B LED emitting blue light. A more detailed arrangement of the lighting device will be described later in FIG. 4.

[0091] In this way, since the lighting device can provide individual lighting for multiple areas, the user can more intuitively know the area to be looked at on the display screen.

[0092] The processor (140) controls the overall operation of the display device (100). Specifically, the processor (140) is connected to the configuration of the electronic device including the display (110), memory (120), and lighting device (130), and can control the overall operation of the electronic device by executing at least one instruction stored in the memory (120) as described above. In particular, the processor (140) can be implemented as a single processor (140) as well as as a plurality of processors (140).

[0093] The processor (140) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing operations. The processor (140) may include at least one electrical circuit and may process instructions (or programs, data, etc.) stored in memory individually or collectively in a distributed manner.

[0094] The processor (140) may include a processor assembly comprising one or more processing circuits. The processor (140) may include any processing circuit that is operative to control the performance and operation of one or more components of an electronic device (e.g., memory and / or driving device (sensor)). For example, the processor (140) (e.g., AP) may be implemented as a system on chip (SoC) (e.g., a single chip or a chipset). For example, the processor (140) may be implemented as multiple cores (or at least one core circuit), multiple chips, or multiple chipsets.

[0095] For example, the processor (140) may include one or more processing circuits. The processor (140) may include one or more processing circuits configured to perform various functions of the present disclosure individually and / or collectively. As an example without limitation, at least a portion of the processor (140) may be included in a first chip of the display device (100), and at least another portion of the processor (140) may be included in a second chip of an electronic device different from the first chip of the display device (100).

[0096] For example, the processor (140) may include a central processing unit (CPU), a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a display controller, a memory controller, a storage controller, a communication processor (CP), and / or a sensor interface. These components of the processor (140) are merely exemplary. The processor (140) may include additional components other than those described above. Additionally, some components of the processor (140) may be omitted. Furthermore, some components of the processor (140) may be included as separate components of the display device (100) outside of the processor (140). For example, some components of the processor (140) (e.g., a memory controller) may be included within other components (e.g., at least a portion of memory, an interface (e.g., available for connection to at least one component of the display device (100)), a display).

[0097] The processor (140) can cause other components of the display device (100) to perform various operations by executing instructions stored in memory.

[0098] The processor (140) processes setting values, function commands, etc. according to a stored control program or control data, and can output control signals related to functions that the electronic device can perform or communication signals for communicating with an external electronic device.

[0099] When an image is acquired, the processor (140) can control the display (110) to display a screen corresponding to the image.

[0100] The processor (140) can control the lighting device using the acquired image. For example, when the processor (140) detects a preset object within the image, it can acquire location information and color information corresponding to the detected object.

[0101] For example, the processor (140) can divide an image into multiple regions and input a region among the divided multiple regions where a screen change exists into a learning model to check whether a pre-set object exists in that region. If a pre-set object exists, the learning model can output location information of the object and the type of the object.

[0102] Here, location information can be used to select the area to provide the lighting effects described below, and the type of object can be used to select the size and color of the area. For example, since objects within game content can have various sizes and effects, if an object is small, its presence may be indicated in only one of multiple areas. On the other hand, if an object is large, its presence may be indicated using several areas.

[0103] Additionally, the color to be displayed may be determined based on the type of identified object. For example, it may be decided to use a color with low saturation if the object has a low risk level, and a color with high saturation if the object has a high risk level. Additionally, in certain games, specific colors may be assigned to each team or user. Furthermore, if various users are playing a game together and the user of the currently detected object has yellow as their team color, the processor (140) may determine yellow as the color for that object.

[0104] As such, objects capable of influencing lighting effects can be diverse and may vary depending on the game's control method. Since such control methods share similarities across game genres, the present disclosure may utilize similar object recognition or lighting provision methods for the same genre. Here, a genre refers to a criterion for grouping items with similar themes or development methods within a specific field, and may be referred to as a category, classification, or style.

[0105] Meanwhile, this method is an example, and other algorithms or methods may be used even for the same genre. In this case, when the processor (140) identifies the type of game, it may obtain and use an algorithm (or object recognition learning model) corresponding to the identified type of game from an external server.

[0106] When color information to be used for the position and lighting of a preset object is obtained in the manner described above, the processor (140) can control the lighting device so that the light-emitting element corresponding to the obtained position among the plurality of light-emitting elements outputs a specific color.

[0107] The processor (140) can determine what color and what brightness (or luminance) each of the plurality of light-emitting elements should operate at, and can generate control information for each light-emitting element to operate at the determined color and brightness and provide it to the lighting device. For example, such control information is I 2 It can be provided to the lighting device as C.

[0108] Here, color can be divided into the attributes of hue, value, and saturation. Here, hue may include the name of the color. Value may include the degree of lightness or darkness of the color. Saturation may include the degree of vividness of the color.

[0109] Furthermore, hue can include a combination of lightness and saturation. For example, if the hue is high, it includes bright and vivid colors because both lightness and saturation are high; conversely, if the hue is low, it includes dark and dull colors because both lightness and saturation are low.

[0110] For example, a color gamut (or color space, color reproduction rate) may include the degree to which the colors of an image can be reproduced on a screen output by a display, and the range of colors that the display can express. For example, a color gamut can be expressed as a percentage based on color standards such as NTSC, sRGB, Adobe RGB, and DCI-P3 in the CIE color coordinate system.

[0111] Contrast (or contrast ratio) according to one example of the present disclosure may represent the difference between the brightest area and the darkest area in an image output by a display. For example, the contrast may include a value that numerically represents the difference between the maximum luminance (e.g., White) and the minimum luminance (e.g., Black) of the display.

[0112] Meanwhile, if the lighting device is capable of outputting lighting to other areas in addition to the lower area, the processor (140) can also perform control over this. For example, the processor (140) can acquire RGB gradation data of a preset area of ​​an image and control the lighting device to emit light corresponding to the RGB gradation data.

[0113] When an object is identified, the processor (140) can store information about the object in memory (120). The processor (140) can also continuously monitor the object to update the stored information about the object. For example, if an opposing unit is visible but then hides in a forest and becomes invisible due to the forest, that is, if it is not displayed because it overlaps with another object, the user may not be able to perceive the object. Therefore, even in such cases, the processor (140) can provide information about the hidden object in the form of location information and color.

[0114] Meanwhile, when the processor (140) acquires sound data, it can detect a preset sound within the acquired sound data and generate control information based on the detected sound. For example, when footsteps approaching from the left are acquired, the processor (140) can perform a lighting output that the user can recognize for the left area. Alternatively, it can output a color corresponding to the type of the identified sound.

[0115] Meanwhile, the processor (140) can control the bottom lighting of the display device by comprehensively considering the aforementioned video information and sound information. For example, if the area to be displayed by the video and the area to be displayed by the sound information are different, the processor (140) may display only one of them based on priority. To this end, individual priority may be assigned to each object, and priority may also be assigned to voice according to sound type.

[0116] Meanwhile, when implementing, it is also possible to display each area individually. For example, the processor (140) may control the lighting in the lower area based on image information, and control the lighting in the other areas using sound information.

[0117] As described above, the control method according to the present disclosure can enhance the user's immersion in gameplay through lighting linked to the content of a display device. In addition, since the state of change of an object within the image can be notified to the user through lighting, the user can obtain additional information through the lighting.

[0118] Meanwhile, although only a simple configuration constituting the display device (100) has been illustrated and described above, various additional configurations may be provided during implementation. This will be explained below with reference to FIG. 3.

[0119]

[0120] FIG. 3 is a block diagram illustrating the configuration of a display device according to one embodiment of the present disclosure.

[0121] Referring to FIG. 3, the display device (100') may include a display (110), memory (120), lighting device (130), processor (140), user interface (150), communication unit (160), input / output interface (170), and speaker (180).

[0122] The configuration of the display (110), memory (120), lighting device (130), and processor (140) was previously described in FIG. 2, and only the operation different from FIG. 2 will be described below.

[0123] The user interface (150) is a configuration involved in the display device (100) performing interaction with the user. For example, the user interface (150) may include at least one of a touch sensor, a motion sensor, a button, a jog dial, a switch, or a microphone, but is not limited thereto. Meanwhile, in implementation, control commands may be received through a remote control device (or remote control) rather than the user interface (150).

[0124] The user interface (150) may receive information related to a game genre (or game type). Here, the information related to the game genre may include information about the type of game content provided through the display device (100) or an area of ​​interest corresponding to the type of game content, but is not limited thereto.

[0125] The user interface (150) may also receive setting information for the operation of the lighting device. For example, the user interface (150) may receive color information corresponding to a specific object. The user interface (150) may also receive a setting for whether to provide a change in lighting corresponding to an image such as the present disclosure.

[0126] The communication unit (160) is a configuration that performs communication with various types of external devices according to various types of communication methods. The communication unit (160) may include a Wi-Fi module, a Bluetooth module, an infrared communication module, and a wireless communication module, etc. Here, each communication module may include at least one hardware chip or hardware circuit.

[0127] Wi-Fi modules and Bluetooth modules can perform communication via Wi-Fi and Bluetooth methods, respectively. When using a Wi-Fi module or a Bluetooth module, various connection information, such as SSID and session key, is transmitted and received first; after establishing a communication connection using this information, various information can be transmitted and received.

[0128] The infrared communication module performs communication according to infrared communication (IrDA, infrared Data Association) technology, which uses infrared rays located between visible light and millimeter waves to wirelessly transmit data over short distances. For example, the communication unit (160) may receive various settings (e.g., game genres, etc.) from a remote control device via infrared communication, etc., in a display device (100) as described above.

[0129] In addition to the communication method described above, the wireless communication module may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation).

[0130] In addition, the communication unit (160) may include at least one wired communication module that performs communication using a LAN (Local Area Network) module, an Ethernet module, a pair cable, a coaxial cable, a fiber optic cable, or a UWB (Ultra Wide-Band) module.

[0131] According to one example, the communication unit (160) may use the same communication module (e.g., Wi-Fi module) to communicate with external devices such as a remote control and an external server.

[0132] According to other examples, the communication unit (160) may use different communication modules (e.g., Wi-Fi modules) to communicate with external devices such as a remote control and external servers. For example, the communication unit (160) may use at least one of an Ethernet module or a Wi-Fi module to communicate with an external server, and may use a BT module to communicate with an external device such as a remote control. However, this is merely one example, and the communication unit (160) may use at least one of various communication modules when communicating with multiple external devices or external servers.

[0133] The communication unit (160) can receive content. This content can be diverse, such as movies, music videos, dramas, short videos, etc. And while the content is assumed to be video, it may also be an image or referred to as video.

[0134] In addition, the communication unit (160) can receive not only content but also information necessary for providing various applications and services of the display device (100) from an external device. For example, the communication unit (160) may receive a learning model corresponding to a game genre (or game type).

[0135] The input / output interface (170) may be any one of the following interfaces: HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), DVI (Digital Visual Interface).

[0136] The input / output interface (170) can input and output at least one of audio and video signals. Depending on the implementation example, the input / output interface (260) may include separate ports for inputting and outputting only audio signals and for inputting and outputting only video signals, or it may be implemented as a single port for inputting and outputting both audio and video signals.

[0137] And the input / output interface (170) can provide a video signal corresponding to a screen generated by the electronic device (100') or an audio signal together with the video signal to an external device (e.g., a display device, an STB, etc.). Meanwhile, in implementation, video and sound may be received through an HDMI terminal, the received video may be displayed on the display (110), and the sound may be output through a speaker of another external device.

[0138] The speaker (180) can output sound. Specifically, the speaker (180) may be a component that outputs various audio data processed at the input / output interface, as well as various notification sounds or voice messages. The speaker (180) may also output result information corresponding to the voice recognition operation described later.

[0139] The speaker (180) is a device that converts an electroacoustic signal corresponding to audio provided by the display device (100), generated from the processor (140), into sound waves. The speaker (180) may include a permanent magnet, a coil, and a diaphragm, and may output sound by vibrating the diaphragm through electromagnetic interaction occurring between the permanent magnet and the coil. For example, the processor (140) may control the speaker (180) to output audio corresponding to a game video provided through the display (110).

[0140] Meanwhile, although FIG. 3 illustrates and describes a display device (100) that includes a display (110), if the electronic device (100') is a device such as a set-top box that does not include a display, the display configuration may be omitted. Additionally, depending on the implementation form, the speaker and microphone described above may also be omitted. Furthermore, although not illustrated in FIG. 3, other components (e.g., a camera) may also be included.

[0141]

[0142] FIG. 4 is a drawing for illustrating various light-emitting positions according to the present disclosure.

[0143] Referring to FIG. 4, the lighting device (130) includes a plurality of light-emitting regions (131, 132, 133).

[0144] The first light-emitting area (131) is an area that irradiates light by dividing a plurality of areas into the lower area of ​​the display device (100). For example, when a preset object in the image is detected, the first light-emitting area (131) can output light to the area corresponding to the location of the detected object. For example, if the screen is divided into eight areas, and a specific object is identified in the fifth area, the first light-emitting area (131) can irradiate light from the light-emitting element corresponding to the fifth column. Such a first light-emitting area may be referred to as bottom lighting.

[0145] In the illustrated example, the first light-emitting region (131) is shown positioned on the rear of the display device and irradiating light toward the bottom of the display device, but in implementation, it may be positioned at the bottom of the display device (100) and operated.

[0146] Also, in the illustrated example, the bottom area is divided into eight areas, but in implementation, it may be divided into more or fewer areas than the number described above.

[0147] Meanwhile, during implementation, one area per object may emit light, or multiple areas may emit light. Additionally, racing games may be utilized by dividing them into three areas, such as a right area, a left area, and a center area. That is, although the illustrated example describes and explains an example utilizing eight areas, during implementation, they may be utilized by dividing them into smaller areas or by dividing them more finely. The number of these areas may be divided based on the screen size of the display device or the type of game.

[0148] The second light-emitting area (132) is an area that emits light from the center of the display toward the rear. This second light-emitting area may emit light in response to specific events, such as the start or end of a game. This second light-emitting area may be referred to as sub-lighting.

[0149] The third light-emitting area (133) is an area that emits light from the upper area of ​​the display toward the rear. Like the second area, the third light-emitting area (133) can perform a light-emitting operation at the start or end of the game and can also display the main color of the screen. This third light-emitting area may be referred to as rear lighting.

[0150] In addition, when implementing, the lighting of the first light-emitting area (131) may be controlled in response to the video of the content, and the lighting of the third light-emitting area (133) may be controlled in response to the sound of the content.

[0151] In this way, by outputting light related to the screen in various directions of the display device, the user is able to have light related to game content not only on the screen within the display device but also in the surrounding space; that is, by providing game content that is not limited to the screen but extends to the surrounding space, immersion can be enhanced.

[0152] Meanwhile, in illustrating and describing Fig. 4, the lighting device is shown placed only on the rear of the display device, but in implementation, the lighting device may be located on the side, top surface, etc. of the display device.

[0153] For example, a fourth light-emitting area divided into multiple regions may be positioned at the top of the display device to irradiate light in an upward direction. In this case, the position of an object on the screen may be divided into columns that are divided into two rows, rather than simply into columns. When a pre-set object is detected in the lower region of the screen, the first light-emitting area (131) may be used, and when a pre-set object is detected in the upper region of the screen, the fourth light-emitting area may be used. Such operation can be described as the light-emitting area closest to each object on the screen among the multiple light-emitting areas of the display irradiating light.

[0154]

[0155] FIG. 5 is a drawing for explaining an example of operation of a lighting device according to one embodiment of the present disclosure. Specifically, FIG. 5 is an example for explaining the operation of a display device (100) when displaying a screen corresponding to Multiplayer Online Battle Arena (MOBA) content.

[0156] Referring to Fig. 5, the MOBA genre is a game in which one's own objects or the opponent's objects move on a map to perform attacks or defenses. In such a MOBA genre, since the screen displays only a portion of the map, the opponent's objects may enter from the outer areas. It may be advantageous for the user to quickly identify and react to these new objects.

[0157] In this regard, the display device (100) can detect the opponent game unit (511). For example, if the game unit (511) is detected in the left area as in FIG. 5, lighting can be output to the left area within the lighting device. At this time, lighting can be output to only one area or to multiple areas based on the size of the game unit. Meanwhile, when implementing, the lighting area (or lighting range) may be determined based on the attack range (or speed) of the unit rather than based on the size of the unit.

[0158] Additionally, low-saturation or high-saturation colors may be used based on the risk level of the object. For example, if the detected object has high attack power, a high-saturation color may be displayed, and if the detected object has low attack power, a low-saturation color may be displayed.

[0159] Meanwhile, although the illustrated example depicts a case where the opposing unit is simply detected, in the event that the opposing unit and the user unit engage in combat, lighting can be output only to the area where the attack or defense is taking place. Accordingly, the user can maintain focus on the area where the attack or defense is taking place.

[0160]

[0161] FIG. 6 is a drawing for explaining an example of operation of a lighting device according to one embodiment of the present disclosure.

[0162] Referring to FIG. 6, a display device (100) outputs a game screen (610). The bottom right of the game screen has a message area (611). When a new alarm or message is generated in the message area, the display device (100) can turn on the bottom light of the message area (611) so that the user can check the message.

[0163] Meanwhile, as this message area is an additional part of the game, if an attack or defense is in progress at a specific location, a separate lighting display action may not be performed even if new text is entered into the message area.

[0164] Meanwhile, although the above description illustrates and explains turning on the light depending on whether a message is displayed, in implementation, the light for the corresponding area may also be provided when a message is displayed and a sound such as a message notification is detected.

[0165]

[0166] FIG. 7 is a drawing for explaining an example of operation of a lighting device according to one embodiment of the present disclosure. Specifically, FIG. 7 is an example for explaining the operation of a display device (100) when displaying a screen corresponding to First-Person Shooter (hereinafter FPS) content.

[0167] Referring to FIG. 7, an opponent (or opponent unit) can be detected within the screen. For example, if the shape of the opponent unit is star-shaped, the display device can detect the star shape within the image. For example, when an object recognition model detects an object, it can provide the position information of the image used to detect the object (i.e., (Xn) zones in the x-axis direction, (Yn) zones in the y-axis direction, a total of (Xn x Yn) zones) to the lighting device.

[0168] The lighting device (130) can perform lighting operations based on x-axis information among the provided location information. In this case, when attacked by an opponent, the lighting device (130) can distinguish the color of the lighting displayed in correspondence with the attack weapon used by the opponent. Such distinction of weapons can be performed through image analysis, or it can be performed based on sound (e.g., gunshot, arrow sound, etc.). The lighting device (130) can display a color corresponding to the identified type of weapon.

[0169] For example, a gunshot sound can be displayed in red, and an arrow in orange. Additionally, if identified as a gun or an arrow, only one square may be displayed, whereas if a weapon with a wide attack range, such as a tank cannon, is identified as being in use, multiple areas may be illuminated. Meanwhile, such display areas can correspond to the size of the area that can be damaged by an opponent's attack.

[0170]

[0171] FIG. 8 is a drawing for explaining an example of operation of a lighting device according to one embodiment of the present disclosure. Specifically, FIG. 8 is an example for explaining the operation of a display device (100) when displaying a screen corresponding to racing content.

[0172] Referring to FIG. 8, the user interface window (810) can display a screen including a race track. At this time, the display device (100) can obtain information corresponding to a milestone within the screen and output a light corresponding to the obtained milestone.

[0173] For example, as shown in the example, if you need to turn to the right, you can use the right area of ​​the lighting, and conversely, if you need to turn to the left area, you can use the left area of ​​the lighting.

[0174] Meanwhile, although the above description illustrates determining and displaying a lighting area based on road conditions (or signposts), in implementation, the lighting area may also be displayed in correspondence with the steering direction of the vehicle object. That is, it is possible to output lighting corresponding to the user's operation and provide lighting based on whether the user is currently turning to the right or turning to the left. In implementation, control information to position the vehicle in the center of the road may be provided as lighting information.

[0175] Additionally, the lighting device (130) can output light in response to speed regardless of steering of the handle or milestones, and can also output a color based on speed, etc. For example, if it is a sharp curve and the vehicle is traveling at 100 km / h or more, it may output red light, if it is traveling between 50 and 100 km / h, it may output orange light, and if it is traveling at 50 km / h or less, it may output yellow light.

[0176]

[0177] FIG. 9 is a drawing for explaining an example of operation of a lighting device according to one embodiment of the present disclosure.

[0178] Referring to FIG. 9, the user interface window (910) can display a screen including a race track. Here, the object of interest may be a vehicle behind the user's object (or vehicle). In this case, when the display device detects an opponent's vehicle to the left of the rear of the user's vehicle, it may output a light to the left of the screen. In this case, the user can easily recognize that there is a vehicle in the left area of ​​the rear of their own vehicle.

[0179] At this time, the display device may also analyze the sound to determine whether the sound of the vehicle behind is approaching or moving away, and display it in a different color accordingly.

[0180]

[0181] FIG. 10 is a drawing illustrating an example of a user interface window for setting a game genre according to one embodiment of the present disclosure.

[0182] Referring to FIG. 10, the display device (100) can display a user interface window (1010) for selecting a game genre.

[0183] For example, if there are three game genres distinguished by the display device, a user interface window (1010) for selecting one of the three can be displayed. Meanwhile, in the illustrated example, only three game genres were illustrated assuming that three can be distinguished, but more subdivided game genres may be used in implementation. Also, in implementation, instead of selecting a genre, the game itself may be selected.

[0184] Meanwhile, when the user interface window (1010) described above is displayed, the user can select one of the displayed items to use. Such selection may be made using a remote control device (400) as illustrated, or through a button provided on the display device (100).

[0185] The remote control device (400) can be implemented as a remote control capable of controlling the display device (100) as shown in FIG. 4, but this is merely one embodiment and can be implemented as various portable terminals such as smartphones, tablet PCs, etc.

[0186] When a remote control device (400) is used, the display device (100) may further include an RF signal module for receiving a remote control signal generated from the remote control device (400). Alternatively, when the remote control device (400) and the display device (100) are connected via a wireless communication method such as Bluetooth communication, the processor (140) may receive a control signal from the remote control device (400) through the communication unit (160).

[0187] Meanwhile, although FIG. 10 illustrates the aforementioned user interface window being displayed over the entire screen area, it may also be displayed together with a video corresponding to the game content during implementation.

[0188]

[0189] FIG. 11 is a drawing illustrating an example of a user interface window for receiving color information according to one embodiment of the present disclosure.

[0190] Referring to FIG. 11, the display device (100) can display a user interface window (1110) for receiving color information for a specific object. For example, such a user interface window (1110) is a user interface window that can be additionally displayed when the user selects an FPS game in FIG. 10.

[0191] Through such a user interface window (1110), the color for each object can be set. Meanwhile, although only the color for firearms is displayed in FIG. 11, the color for the opponent's race, etc., may also be entered during implementation. Meanwhile, although the illustrated example shows the user directly setting the color, during implementation, the color information for each object may be obtained through the manufacturer and stored in the display device (100).

[0192] For example, if the user sets the gun to red and the grenade to blue, when a gunshot occurs, red lighting can be provided to the area corresponding to the source of the gunshot.

[0193] Additionally, when the sound of a grenade exploding occurs, blue can be displayed in the area corresponding to the source. Meanwhile, if it is confirmed that the grenade exploded in a somewhat distant area rather than a nearby one, the light displayed at the bottom of the display device does not operate, and it is also possible to display blue only in the light facing the rear of the display.

[0194]

[0195] FIG. 12 is a flowchart illustrating a control method for a display device according to one embodiment of the present disclosure.

[0196] Referring to FIG. 12, a preset object is detected within the image (S1210). To do this, information on objects of interest by game type is stored in advance, a game type corresponding to the image is obtained, and whether an object of interest corresponding to the obtained game type exists within the image can be detected. For example, the existence of an object in an area with high image change can be detected by comparing the previous frame and the current frame.

[0197] The type of game can be determined based on the video layout, or the user can select it through the user interface window.

[0198] Then, location information and color information corresponding to the detected object are obtained (S1220). For example, by dividing an image into multiple regions and detecting the presence of a preset object for each divided region, the area to which the detected object belongs can be used as location information. Additionally, color information corresponding to the object can be obtained. This color information may be a color value predetermined by the user for each type of object, and in a specific type of game, the main color of the game screen or the color of a specific area of ​​the game screen may be used.

[0199] Then, control information is generated to cause at least one light-emitting element corresponding to position information among a plurality of light-emitting elements capable of emitting light in the downward direction of the display device to emit light corresponding to color information (S1230). For example, the movement direction of a detected object can be obtained, and control information can be generated to cause a light-emitting element belonging to a lower area corresponding to the obtained movement direction to emit light.

[0200] Additionally, when acoustic data is acquired, a preset sound is detected within the acquired acoustic data, and control information can also be generated based on the detected sound.

[0201] And the generated control information can be provided to the lighting device, or the lighting device can be directly controlled to emit light (S1240).

[0202] As described above, the control method according to the present disclosure can enhance the user's immersion in gameplay through lighting linked to the content of the display device.

[0203]

[0204] FIG. 13 is a flowchart illustrating a lighting control method according to one embodiment of the present disclosure.

[0205] Referring to FIG. 13, the user may set whether to perform an operation according to the present disclosure (S1310). Such an operation according to the present disclosure may be referred to as Core-sync, and may be referred to as a third-generation arena effect, lighting effect, etc.

[0206] When the user is set to have performed an operation according to the present disclosure, the screen can be divided into multiple regions (S1320), and individual operations can be performed for each divided region. In addition, for each region, object detection can be performed using an algorithm corresponding to the type of game selected by the user.

[0207] For example, the user can select a game type using the OSD. When a game type is selected in this way, an AI algorithm corresponding to that game type can be used (S1330). Meanwhile, during implementation, the game type can be automatically identified and used by detecting object recognition and layout.

[0208] Specifically, for each region, the amount of change in the image is checked (S1340), and for regions with a change amount exceeding a certain level, an algorithm suitable for each game type is used to check whether there is an object of interest within that region (S1350). For example, if an RTS game is being played, it is possible to check whether there is an opponent object (or a specific event) within a region that is brighter than the surroundings or where the brightness of the screen analysis histogram changes significantly.

[0209] When an object corresponding to the game type is identified in this way, coordinate information for the area and color information corresponding to the identified object can be provided to the lighting device (S1360).

[0210] When position information and color information are input into the lighting device in this manner, a light-emitting element corresponding to a plurality of position information can be made to emit a color corresponding to the color information (S1370). Meanwhile, although the above description explains that only the light-emitting element corresponding to the position information is operated, it is also possible to operate a plurality of light-emitting elements in the implementation, and to operate them so that the light-emitting element corresponding to the position information is highlighted. In other words, any method is possible as long as it is a type of lighting that allows the user to intuitively check a specific area within the screen according to the operation of the lighting.

[0211] As described above, the control method according to the present disclosure enhances the immersion of a game player through lighting linked to the content of a display device, and increases the probability of the game player winning by obtaining additional information through the lighting.

[0212] Meanwhile, methods according to at least some of the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.

[0213] In addition, methods according to at least some of the various embodiments of the present disclosure described above may be implemented by software upgrades or hardware upgrades alone for existing electronic devices.

[0214] In addition, methods according to at least some of the various embodiments of the present disclosure described above may also be performed through an embedded server equipped in an electronic device, or through at least one external server among the electronic devices.

[0215] Meanwhile, according to one embodiment of the present disclosure, the various embodiments described above may be implemented as software containing instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include an electronic device (e.g., electronic device (A)) according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions. When instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory storage medium" simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily on the storage medium. For example, a 'non-transient storage medium' may include a buffer in which data is temporarily stored. According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TMIt can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., terminal devices). For online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0216] Various embodiments of the present disclosure may be implemented as software including instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include an electronic device (e.g., a display device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored on the storage medium and operating according to the called instructions.

[0217] When the above-described instruction is executed by a processor, the processor may perform the function corresponding to the above-described instruction directly or by using other components under the control of the above-described processor. The instruction may include code generated or executed by a compiler or an interpreter.

[0218] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.

Claims

1. In a display device, display; A lighting device comprising a plurality of light-emitting elements configured to irradiate light from the bottom of the above-mentioned display device; Memory in which at least one instruction is stored; and It includes one or more processors configured to execute at least one of the above instructions; and The above one or more processors, Control the display to display an image input to one or more processors, and Detecting objects within the above image, and Acquire location information and color information corresponding to the above-mentioned detected object, and A display device that controls a lighting device so that at least one light-emitting element at a lower position of the display device corresponding to the above-mentioned acquired position information irradiates light corresponding to the above-mentioned color information.

2. In Paragraph 1, The above memory further stores information about objects of interest corresponding to each of a plurality of game types, and The above one or more processors, A display device configured to acquire a game type corresponding to the above image and to determine whether the detected object corresponds to stored information regarding an object of interest corresponding to the acquired game type.

3. In Paragraph 2, Information regarding the above object of interest is, Includes shape information of the object of interest and color information of the object of interest, The above one or more processors, A display device configured to acquire color information corresponding to the object of interest when it is confirmed that the detected object corresponds to the stored information regarding the object of interest.

4. In Paragraph 2, A display device further comprising a user interface for receiving a selection of a game type corresponding to the image displayed above.

5. In Paragraph 1, The above one or more processors, The image displayed above is divided into multiple regions, and Identify whether the detected object exists in one or more of the plurality of regions, and A display device configured to acquire location information corresponding to one or more areas based on the identification that the detected object exists in one or more areas.

6. In Paragraph 5, The above one or more processors, A display device configured to compare the previous frame and the current frame of the displayed image to determine a change area between the previous frame and the current frame, and to determine whether the detected object exists within the change area.

7. In Paragraph 5, The above one or more processors, A display device that inputs the partitioned image into a learning model configured to identify an object, and checks the existence of an object based on the output of the learning model indicating the existence of a detected object.

8. In Paragraph 7, The above memory is, It is configured to store multiple learning models corresponding to each of multiple game types, and The above one or more processors, Obtain the type of game corresponding to the image displayed above, and A display device configured to perform object recognition using a learning model corresponding to the acquired game type among the plurality of learning models.

9. In Paragraph 1, The above one or more processors, Check the direction of movement of the above-detected object, and A display device configured to control the lighting device so that a light-emitting element belonging to the lower position of the display device corresponding to the identified direction of movement among the plurality of light-emitting elements irradiates light.

10. In Paragraph 1, The above one or more processors, A display device configured to identify the location of the detected object on the above-mentioned image and to control the lighting device so that a light-emitting element irradiates light at a lower position of the display device corresponding to the identified location among the plurality of light-emitting elements.

11. Regarding Paragraph 1, Includes additional speakers, The above one or more processors, Acquire sound data to be input to the above speaker, and A display device configured to control a lighting device to irradiate a colored light at a lower position of the display device corresponding to the sound, based on a determination regarding the presence or absence of sound within the acquired sound data.

12. In Paragraph 11, The above one or more processors, A display device configured to obtain the direction of the sound and to control the lighting device so that at least one light-emitting element among the plurality of light-emitting elements corresponding to the obtained direction emits light.

13. In Paragraph 1, It further includes at least one second light-emitting element capable of irradiating light from the rear of the display device; and The above one or more processors, A display device configured to control the lighting device so that one second light-emitting element also emits light.

14. A method of a display device comprising a display, a lighting device including a plurality of light-emitting elements configured to emit light from the bottom of the display device, a memory configured to store at least one instruction, and one or more processors configured to execute said at least one instruction, One or more of the above processors, A step of controlling the display to display an image input to one or more processors; A step of detecting an object within the image displayed above; A step of obtaining location information and color information corresponding to the detected object; and A method comprising the step of controlling a lighting device such that at least one light-emitting element at a lower position of the display device corresponding to the acquired position information irradiates light corresponding to the color information.

15. A non-transient computer-readable recording medium storing a program for executing a control method for a display device, comprising: a display, a lighting device including a plurality of light-emitting elements configured to emit light from the bottom of the display device, a memory configured to store at least one instruction, and one or more processors configured to execute said at least one instruction. The above method is, A step of detecting an object within an image displayed on the display of the above-mentioned display device; A step of obtaining location information and color information corresponding to the detected object; and A non-transient computer-readable recording medium comprising the step of generating control information to control a lighting device such that at least one light-emitting element irradiates light corresponding to color information at a lower position of the display device corresponding to the acquired position information.

Images