Display apparatus providing image information and method of controlling the same

Abstract

A display device is disclosed. The display device includes: a communication interface; a display; a memory storing a plurality of application image frames; and one or more processors that, on the basis of a first output image frame output to the display and the plurality of application image frames, if the number of image frames among the plurality of application image frames having a degree of similarity to the first output image frame equal to or greater than a threshold value is equal to or greater than a threshold number, determine whether the number of image frames is equal to or greater than a threshold value. Frame information corresponding to background information and object information included in the first output image frame is obtained from information related to an application corresponding to the first output image frame, and a request based on profile information including application identification information and the frame information is transmitted to a server through a communication interface, and cause the display to provide video information corresponding to the request received from the server through the communication interface.

Description

Technical Field

[0001] Devices and methods consistent with the present disclosure relate to a display device and a control method thereof, and more particularly, to a display device for obtaining and providing video information using profile information and a control method thereof. Background Art

[0002] Various types of display devices are being developed and promoted.

[0003] Additionally, the number of homes equipped with various source devices (eg, video game consoles) for use with display apparatuses is increasing.

[0004] Users who enjoy games using consoles want to obtain various types of game-related content and streaming videos while operating games or while playing games, but there is no platform that provides user-customized content or videos.

[0005] For example, in order to find videos related to the current chapter and stage while operating a game, it is inconvenient for a user to directly access the service providing platform and search for videos by inputting keywords (or search words) related to the current chapter and stage.

[0006] There is a need for a service method that automatically searches for user-customized videos (eg, videos related to chapters and stages of a game currently provided by a display device) and provides search results without requiring the user to directly input keywords. Summary of the invention

[0007] A display device may include: a communication interface; a display; a memory configured to store a plurality of application image frames; and one or more processors. The one or more processors may be configured to: based on a first output image frame and a plurality of application image frames output to the display, based on the number of image frames in the plurality of application image frames having a similarity equal to or greater than a threshold value with the first output image frame being equal to or greater than a threshold value, obtain frame information corresponding to background information and object information included in the first output image frame from information related to an application corresponding to the first output image frame, send a request based on profile information including identification information of the application and frame information to a server through the communication interface, and control the display to provide video information corresponding to the request received from the server through the communication interface.

[0008] The profile information may also include quantity information corresponding to the number of multiple application image frames having similarities. The one or more processors may also be configured to: store the first output image frame in the memory, and when it is identified based on the second output image frame acquired after a predetermined time has passed since the first output image frame was acquired and the multiple application image frames stored in the memory that (i) the number of multiple application image frames having a similarity equal to or greater than a threshold value with the second output image frame is equal to or greater than a threshold value and (ii) the similarity between the first output image frame and the second output image frame is equal to or greater than a threshold value, increase the quantity information included in the profile information, and when it is identified that (i) the number of multiple application image frames having a similarity equal to or greater than a threshold value with the second output image frame is equal to or greater than a threshold value and (ii) the similarity between the first output image frame and the second output image frame is less than a threshold value, generate second profile information corresponding to the second output image frame.

[0009] One or more processors configured to increase quantity information may be configured to: compare the similarity between a first background included in a first output image frame and a second background included in a second output image frame and the similarity between a first object included in the first output image frame and a second object included in the second output image frame, and when each of the similarity between the first background and the second background and the similarity between the first object and the second object is equal to or greater than a threshold, identify that the similarity between the first output image frame and the second output image frame is equal to or greater than a threshold.

[0010] The one or more processors may be further configured to, when content is received from the external device through the communication interface, control the display to provide a screen corresponding to the content, and obtain identification information of the application based on at least one content image frame corresponding to the content.

[0011] The memory may be configured to store profile information corresponding to each of the plurality of users. The one or more processors may also be configured to obtain profile information corresponding to a user of the plurality of users selected through a user interface (UI), and when the application is run, control the display to output video information received from the server to a specific area of ​​the display.

[0012] The profile information corresponding to each of the multiple users may include identification information of the user, identification information of the application, frame information, quantity information, or acquisition time of the profile information. The one or more processors may also be configured to obtain a priority of the profile information based on at least one of quantity information or acquisition time of the profile information included in the profile information of each of the multiple users.

[0013] The one or more processors may be further configured to send a request based on profile information corresponding to a highest priority to the server based on a priority corresponding to each of the plurality of profiles corresponding to the selected user.

[0014] The one or more processors may also be configured to: input multiple profiles stored in the memory into the neural network model to obtain specific background information and specific object information whose correlation between frame information included in each of the multiple profiles and correlation with frame information included in the first output image frame is equal to or greater than a threshold, and send a request including the acquired specific background information and specific object information to the server.

[0015] The video information may include multiple video information. One or more processors may also be configured to control the display to output multiple video information sorted according to priority when multiple video information is received from the server according to the request. Each of the multiple video information may include a thumbnail image of the corresponding video.

[0016] The one or more processors may also be configured to control the display so that real-time video is output before recorded video according to a priority among the plurality of video information.

[0017] A method for controlling a display device may include: outputting a first output image frame through a display; based on the first output image frame and multiple application image frames, based on the number of image frames in the multiple application image frames whose similarity to the first output image frame is equal to or greater than a threshold value, obtaining frame information corresponding to background information and object information included in the first output image frame from information related to an application of the first output image frame; sending a request based on profile information including identification information of the application and frame information to a server; and providing video information corresponding to the request received from the server.

[0018] The profile information also includes quantity information corresponding to the number of multiple application image frames having similarity. The method may further include: storing a first output image frame; when it is identified based on a second output image frame and multiple application image frames acquired after a predetermined time has passed since the first output image frame was acquired that (i) the number of multiple application image frames having a similarity equal to or greater than a threshold value with the second output image frame is equal to or greater than a threshold value and (ii) the similarity between the first output image frame and the second output image frame is equal to or greater than a threshold value, adding the quantity information included in the profile information; and when it is identified that (i) the number of multiple application image frames having a similarity equal to or greater than a threshold value with the second output image frame is equal to or greater than a threshold value and (ii) the similarity between the first output image frame and the second output image frame is less than a threshold value, generating second profile information corresponding to the second output image frame.

[0019] Increasing the quantity information may include: comparing the similarity between a first background included in the first output image frame and a second background included in the second output image frame and the similarity between a first object included in the first output image frame and a second object included in the second output image frame; and when each of the similarity between the first background and the second background and the similarity between the first object and the second object is equal to or greater than a threshold, identifying that the similarity between the first output image frame and the second output image frame is equal to or greater than a threshold.

[0020] The method may further include: when content is received from the external device, controlling the display to provide a screen corresponding to the content; and obtaining identification information of the application based on at least one content image frame corresponding to the content.

[0021] The display device may store profile information corresponding to each of the plurality of users. The method further includes: obtaining profile information corresponding to a user of the plurality of users selected through a user interface (UI); and when the application is executed, controlling the display to output video information received from the server to a specific area of ​​the display.

[0022] The profile information corresponding to each of the multiple users may include identification information of the user, identification information of the application, frame information, quantity information, or acquisition time of the profile information. The method may also include obtaining a priority of the profile information based on at least one of quantity information or acquisition time of the profile information included in the profile information of each of the multiple users.

[0023] The method may further include transmitting a request based on profile information corresponding to a highest priority to the server based on a priority corresponding to each of a plurality of profiles corresponding to the selected user.

[0024] The method may also include: inputting multiple profiles stored in a memory into a neural network model to obtain specific background information and specific object information whose correlation with frame information included in each of the multiple profiles is equal to or greater than a threshold value, and sending a request including the acquired specific background information and specific object information to a server.

[0025] The video information may include a plurality of video information. The method may also include, when receiving a plurality of video information from a server according to a request, controlling a display to output the plurality of video information sorted according to a priority. Each of the plurality of video information may include a thumbnail image of a corresponding video.

[0026] The method may further include controlling the display so that the real-time video is output before the recorded video according to a priority among the plurality of video information.

[0027] A non-transitory computer-readable recording medium may include a program for executing a control method for a display device. The control method may include: outputting a first output image frame through a display; based on the first output image frame and a plurality of application image frames, based on the number of image frames in the plurality of application image frames having a similarity equal to or greater than a threshold value with the first output image frame being equal to or greater than a threshold value, obtaining frame information corresponding to background information and object information included in the first output image frame from information related to an application corresponding to the first output image frame; sending a request based on profile information including identification information of the application and frame information to a server; and providing video information corresponding to the request received from the server. BRIEF DESCRIPTION OF THE DRAWINGS

[0028] Figure 1 is a diagram for describing a display device providing a screen according to one or more embodiments of the present disclosure; Figure 2 is a block diagram showing a configuration of a display device according to an embodiment of the present disclosure; Figure 3 is a diagram for describing a method for obtaining quantity information based on similarity according to one or more embodiments of the present disclosure; Figure 4 is a diagram for describing a data set corresponding to an application according to one or more embodiments of the present disclosure; Figure 5 is a diagram for describing log data according to one or more embodiments of the present disclosure; Figure 6 is a diagram for describing profile information according to one or more embodiments of the present disclosure; Figure 7 is a diagram for describing a method for providing video information according to one or more embodiments of the present disclosure; Figure 8 is a diagram for describing a method for providing video information according to an embodiment of the present disclosure; Fig. 9 is a diagram for describing the priority of profile information according to one or more embodiments of the present disclosure; and Fig.10 is a flowchart for describing a method of controlling a display device according to one or more embodiments of the present disclosure. DETAILED DESCRIPTION

[0029] Hereinafter, the present disclosure will be described in detail with reference to the accompanying drawings.

[0030] Considering the functions in the present disclosure, currently widely used general terms are selected as the terms used in the embodiments of the present disclosure, but they may be changed according to the intention of those skilled in the art or the emergence of judicial precedents, new technologies, etc. In addition, in certain cases, there may be terms arbitrarily selected by the applicant. In this case, the meanings of these terms will be mentioned in detail in the corresponding description parts of the present disclosure. Therefore, the terms used in the present disclosure need to be defined based on the meaning of the terms and the overall content of the present disclosure, rather than defined based on the simple names of the terms.

[0031] In the present disclosure, expressions such as “having”, “may have”, “including”, “may include”, etc. indicate the existence of corresponding features (eg, numerical values, functions, operations, components (such as parts), etc.), and do not exclude the existence of additional features.

[0032] The expression “at least one of A and / or B” should be understood to mean “A” or “B” or “any one of A and B”.

[0033] The expressions “first”, “second”, etc. used in the present disclosure may indicate various components regardless of the order and / or importance of the components, and these expressions will only be used to distinguish one component from other components, and will not limit the corresponding components.

[0034] When it is mentioned that any component (e.g., a first component) is (operably or communicatively) coupled with / (operably or communicatively) coupled to another component or connected to another component (e.g., a second component), it will be understood that the any component is directly coupled to the other component or may be coupled to the other component through yet another component (e.g., a third component).

[0035] Unless the context clearly indicates otherwise, the singular form is intended to include the plural form. It will also be understood that the terms "comprising" or "formed by" used in this specification specify the presence of the features, numbers, steps, operations, components, parts or combinations thereof mentioned in this specification, but do not exclude the presence or addition of one or more other features, numbers, steps, operations, components, parts or combinations thereof.

[0036] In the present disclosure, a "module" or "device" may perform at least one function or operation and may be implemented by hardware or software, or by a combination of hardware and software. In addition, multiple "modules" or multiple "devices" may be integrated into at least one module and implemented by at least one processor (not shown), except for "modules" or "devices" that need to be implemented by specific hardware.

[0037] In the present disclosure, terms such as “user” may refer to a person using an electronic device or a device (eg, an artificial intelligence electronic device) using the electronic device.

[0038] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

[0039] Figure 1 is a diagram for describing a display device providing a screen according to one or more embodiments of the present disclosure.

[0040] The display device 100 may provide a video. The display device 100 may be implemented as a TV, but is not limited thereto, and any device equipped with a display function, such as a video wall, a large screen display (LFD), a digital signage, a digital information display (DID), and a projector display, may be applied without limitation. In addition, the display device 100 may be implemented with various types of displays, such as a liquid crystal display (LCD), an organic light emitting diode (OLED), a liquid crystal on silicon (LCoS), a digital light processing (DLP), a quantum dot (QD) display panel, and a quantum dot light emitting diode (QLED).

[0041] The display apparatus 100 may communicate with the external device 200 and provide a video received from the external device 200 .

[0042] The external device 200 may be implemented in various types of electronic devices. For example, the external device 200 is a video game console, and may provide a game video to the display apparatus 100. However, this is an example, and the external device 200 may be implemented in various types of electronic devices that provide video, such as a Blu-ray player, a digital versatile disc (DVD) player, a streaming content output device, a set-top box, a cloud server, an over-the-top media service (OTT) server, and a PC.

[0043] For example, the external device 200 may be implemented as a cloud server, and the cloud server may provide the video game as streaming media using cloud computing technology, so that the display apparatus 100 can remotely play the video game.

[0044] The display device 100 itself may not store and install the video game, and the display device 100 may access the cloud server to receive a plurality of image frames corresponding to the video game through streaming, and the user of the display device 100 may play the video game remotely.

[0045] Hereinafter, for convenience of description, a case where the external device 200 is a console and the display apparatus 100 provides a game video received from the external device 200 will be described.

[0046] Figure 2 is a block diagram illustrating a configuration of a display device according to an embodiment of the present disclosure.

[0047] The display device 100 may include a display 110 , a memory 120 , and a processor 130 .

[0048] It can be used in various types of displays (such as liquid crystal display (LCD), organic light emitting diode (OLED), liquid crystal on silicon (LCoS), digital light processing (DLP), quantum dot (QD) display panel, quantum dot light emitting diode (QLED), micro light emitting diode ( LED) and mini LED) to implement the display 110.

[0049] The display device 100 may be implemented as a touch screen combined with a touch sensor, a flexible display, a scrollable display, a 3D display, and a display in which a plurality of display modules are physically connected.

[0050] The memory 120 may store data required by various embodiments of the present disclosure. Depending on the purpose of data storage, the memory 120 may be implemented in the form of a memory embedded in the display device 100 or in the form of a memory detachable from the display device 100. For example, data for driving the display device 100 may be stored in a memory embedded in the display device 100, and data for extended functions of the display device 100 may be stored in a memory detachable from the display device 100. The memory embedded in the display device 100 may include, for example, at least one of a volatile memory (e.g., a dynamic random access memory (DRAM), a static RAM (SRAM), a synchronous dynamic RAM (SDRAM)), a nonvolatile memory (e.g., a one-time programmable read-only memory (OTPROM), a programmable ROM (PROM), an erasable programmable ROM (EPROM), an electrically erasable programmable ROM (EEPROM), a mask ROM, or a flash ROM), a flash memory (e.g., a NAND flash memory or a NOR flash memory), a hard disk drive, and a solid state drive (SSD). In addition, the memory 120 that is detachable from the display device 100 can be implemented in the form of a memory card (e.g., Compact Flash (CF), Secure Digital (SD), Micro Secure Digital (Micro-SD), Mini Secure Digital (Mini-SD), Extreme Digital (xD), Multi Media Card (MMC), etc.) and an external memory (e.g., USB memory) that can be connected to a USB port.

[0051] The memory 120 may store at least one instruction or a computer program including instructions for controlling the display apparatus 100 .

[0052] Various data may be stored in an external memory of the processor 120 , some of the various data may be stored in an internal memory of the processor 120 , and the remaining data may also be stored in the external memory.

[0053] In particular, the memory 120 may acquire and store a plurality of image frames by capturing a screen provided through the display 110 under the control of the processor 130 .

[0054] The one or more processors 130 according to one or more embodiments of the present disclosure may control the overall operation of the display device 100 .

[0055] The processor 130 may be implemented by a digital signal processor (DSP) that processes digital signals, a microprocessor, or a time controller (TCON). However, the processor 130 is not limited thereto, but may include one or more of a central processing unit (CPU), a microcontroller unit (MCU), a microprocessing unit (MPU), a controller, an application processor (AP), a communication processor (CP), and an ARM processor or an artificial intelligence (AI) processor, or may be defined by these terms. In addition, the processor 130 may be implemented by a system on chip (SoC) or a large-scale integrated circuit (LSI) embedded with a processing algorithm, or may be implemented in the form of a field programmable gate array (FPGA). The processor 130 may perform various functions by running computer executable instructions stored in a memory.

[0056] In particular, the processor 130 according to one or more embodiments of the present disclosure may acquire image frames by capturing a screen output on the display 110, and store the image frames in the memory 120. For example, the processor 130 may acquire multiple image frames by capturing a screen at predetermined time intervals (or preset time intervals).

[0057] When the processor 130 according to an embodiment enters a mode for executing a game (hereinafter referred to as an execution mode), a screen including a game video may be captured at fixed time intervals.

[0058] A game may be an example of an application, and the processor 130 may of course run various applications other than games. For example, of course, the processor 130 may acquire a plurality of image frames by running a motion image playback application and capturing the screen at fixed time intervals while running the motion image playback application.

[0059] The processor 130 may acquire a first image frame output to the display, and compare the first image frame with a plurality of image frames stored in the memory 120 .

[0060] Subsequently, when equal to or greater than a threshold number of image frames among multiple image frames whose similarity with the first image frame is equal to or greater than a threshold are identified based on the comparison result, the processor 130 may identify an application (eg, a game) corresponding to the first image frame.

[0061] Will refer to Figure 3 Describe its detailed description.

[0062] Figure 3 is a diagram for describing a method of obtaining quantity information based on similarity according to one or more embodiments of the present disclosure.

[0063] Reference Figure 3 , the memory 120 can store multiple image frames.

[0064] The memory 120 may store the image frame 10 - 1 obtained at a previous time (eg, time t-5) to the image frame 10 - 5 obtained at time t-1.

[0065] Subsequently, the processor 130 may acquire a first image frame 20 - 1 corresponding to a screen provided through the display at time t.

[0066] Subsequently, the processor 130 may identify the similarity between the image frame 10-1 obtained at time t-5 and the first image frame 20-1. In addition, the processor 130 may respectively identify the similarity between the image frame 10-2 obtained at time t-4 and the first image frame 20-1, the similarity between the image frame 10-3 obtained at time t-3 and the first image frame 20-1, the similarity between the image frame 10-4 obtained at time t-2 and the first image frame 20-1, and the similarity between the image frame 10-5 acquired at time t-1 and the first image frame 20-1.

[0067] like Figure 3 As shown, when the number of image frames whose similarity with the first image frame is equal to or greater than the threshold is equal to or greater than the threshold among the multiple image frames based on the comparison result is identified, the processor 130 can identify the application corresponding to the first image frame.

[0068] For example, since each of the image frame 10-1 acquired at time t-5, the image frame 10-4 acquired at time t-2, and the image frame 10-5 acquired at time t-1 has a similarity equal to or greater than a threshold value with the first image frame 20-1 (e.g., 80% similarity), when the number of image frames whose similarity with the first image frame is equal to or greater than the threshold value among the multiple image frames stored in the memory 120 is identified to be equal to or greater than a threshold number (e.g., 5 times), the processor 130 can identify the application corresponding to the first image frame (e.g., game "A").

[0069] Figure 3 The similarity identification method shown in is represented by the following pseudo code.

[0070] [Table 1]

[0071] Here, the processor 130 may sequentially store the image frames obtained at each time (e.g., time t-5 to time t) in the form of a memory queue. The processor 130 may compare the background included in each of the plurality of image frames 10-1, ..., 10-5 with the background of the first image frame 20-1 (comparison histogram), and compare the object included in each of the plurality of image frames 10-1, ..., 10-5 with the object included in the first image frame 20-1 (feature matching).

[0072] Subsequently, the processor 130 may identify (or count) information about the number of image frames having a similarity equal to or greater than 80% among multiple image frames 10-1, ..., 10-5 based on the background comparison result (histogram result in the code) and the object comparison result (feature result in the code).

[0073] Subsequently, when information about the number of image frames whose similarity to the first image frame among a plurality of image frames stored in the memory 120 is equal to or greater than a threshold value is equal to or greater than a threshold number (e.g., 5 times), the processor 130 may identify an application corresponding to the first image frame (e.g., game "A").

[0074] The processor 130 may obtain background information and object information included in the first image frame from a data set corresponding to the application. Figure 4 Describe its detailed description.

[0075] Figure 4 is a diagram for describing a data set corresponding to an application according to one or more embodiments of the present disclosure.

[0076] Reference Figure 4 , a data set corresponding to an application may represent a metadata library of the application and information related to the application. For example, when the application is a game "A", the metadata library of the application may include a plurality of image files included in the game "A", attribute information about each of the plurality of image files, index information, background information (e.g., chapter, stage, location, etc.), and object information (e.g., monster name, item name, weapon name, etc.).

[0077] Subsequently, the processor 130 may obtain background information and object information included in the first image frame 20 - 1 based on a data set corresponding to the recognized application.

[0078] For example, the processor 130 may compare each of the plurality of image files included in the data set with the first image frame 20-1 to identify an image file among the plurality of image files whose similarity to the first image frame 20-1 is equal to or greater than a threshold. Subsequently, the processor 130 may obtain background information and object information included in the first image frame 20-1 based on the identified image file. Hereinafter, for ease of description, the background information and object information will be collectively referred to as frame information.

[0079] Figure 4 The similarity identification method shown in is represented by the following pseudo code.

[0080] [Table 2]

[0081] As described above, when the information about the number of image frames whose similarity to the first image frame is equal to or greater than the threshold value among the plurality of image frames stored in the memory 120 is equal to or greater than the threshold value number (e.g., 5 times), the processor 130 may identify the application corresponding to the first image frame (e.g., game "A"). Subsequently, the processor 130 may obtain at least one image file whose similarity to the first image frame is equal to or greater than the threshold value among the plurality of image files included in the data set of the identified application.

[0082] The processor 130 may compare the background included in each of the plurality of image frames with the background of the first image frame 20-1 (comparison histogram), and compare the object included in each of the plurality of image frames 10-1, ..., 10-5 with the object included in the first image frame 20-1 (feature matching).

[0083] Subsequently, the processor 130 may identify image files having a similarity equal to or greater than 90% among multiple image files based on the background comparison results (histogram results in the code) and the object comparison results (feature results in the code), and obtain background information and object information based on the identified image files.

[0084] Subsequently, the processor 130 may obtain background information and object information as frame information, and may obtain profile information including identification information of an application (name (title) of the application, etc.) and frame information.

[0085] Figure 5 is a diagram for describing log data according to one or more embodiments of the present disclosure.

[0086] Figure 5 The log data shown may include identification information of the user (eg, the game ID of the user), identification information of the application, frame information, quantity information, and acquisition time of the frame information.

[0087] The number information may represent the number of image frames having a similarity with the first image frame 20 - 1 that is equal to or greater than a threshold value among the plurality of image frames.

[0088] like Figure 5 As shown, the quantitative information may represent the number of trials (number of trials, number of experiments, number of attempts, etc.).

[0089] For example, when the processor 130 obtains a plurality of image frames while playing a game, and can identify a plurality of image frames including a specific background and a specific object among the plurality of image frames, it may mean that the user has difficulty with the specific background and the specific object while playing the game.

[0090] Therefore, the processor 130 may acquire the current output image frame, ie, the first image frame 20 - 1 , and identify whether an image frame having a similarity with the first image frame 20 - 1 equal to or greater than a threshold value is pre-stored in the memory 120 .

[0091] When the number of image frames whose similarity to the first image frame 20-1 is equal to or greater than the threshold is equal to or greater than the threshold, the processor 130 may determine that the user has difficulty in playing the game with respect to the background information and object information corresponding to the first image frame 20-1. In addition, when the number of image frames whose similarity to the first image frame 20-1 is equal to or greater than the threshold is less than the threshold, the processor 130 may store the first image frame 20-1 in the memory 120. Therefore, the processor 130 may send the frame information corresponding to the first image frame 20-1 to the external server, and receive tips, strategies, capture methods, etc. corresponding to the frame information from the external server.

[0092] For example, the processor 130 may obtain the first image frame 20-1 at time t and store it in the memory 120, and obtain the second image frame after a predetermined time has passed from time t. Subsequently, the processor 130 may compare the second image frame with a plurality of image frames stored in the memory 120 (e.g., a plurality of image frames including the first image frame 20-1).

[0093] Subsequently, when a number of image frames among a plurality of image frames whose similarity to the second image frame is equal to or greater than a threshold is identified based on the comparison result, and when the similarity between the first image frame 20-1 and the second image frame is a threshold or greater than the threshold, the processor 130 may increase the quantity information included in the log data corresponding to the first image frame 20-1.

[0094] In addition, when it is identified based on the comparison result that the number of image frames whose similarity with the second image frame is equal to or greater than the threshold value among the plurality of image frames is equal to or greater than the threshold value, and the similarity between the first image frame 20-1 and the second image frame is less than the threshold value, the processor 130 may generate log data corresponding to the second image frame. Here, the log data corresponding to the second image frame may include information about the number of image frames whose similarity with the second image frame is equal to or greater than the threshold value among the plurality of image frames.

[0095] Figure 6 is a diagram for describing profile information according to one or more embodiments of the present disclosure.

[0096] The processor 130 according to one or more embodiments of the present disclosure may obtain profile information including identification information of a user, identification information of an application, and frame information based on log data.

[0097] In addition, the processor 130 may transmit a request 1 including the profile information to the server 300 .

[0098] For example, the processor 130 may obtain Request 1 based on the profile information. Request 1 may include at least one of identification information of the application in a string form, background information, object information, or additional characters (eg, weakness, hint, hint, strategy).

[0099] The additional characters do not necessarily have to be included, and the processor 130 may or may not include the additional characters when obtaining the request 1 based on the profile information.

[0100] Subsequently, the processor 130 may request a search to the external server 300 by using the request 1 as a search word (search string). In addition, in the above-mentioned embodiment, a case has been described where the processor 130 transmits the request 1 including the string form to the external server 300, but this is an example. It goes without saying that the processor 130 may transmit the request 1 including the image form to the external server 300 as well as the request 1 including the string form to the external server 300. For example, of course, the processor 130 may transmit the request 1 including the first image frame 20-1 to the external server 300.

[0101] When the video information 30 is received from the external server 300 according to the request 1, the processor 130 according to one or more embodiments of the present disclosure may control the display 110 to display the received video information 30 on one area of ​​the screen.

[0102] Here, the video information 30 received from the external server 300 may represent a search result corresponding to the request 1. The external server 300 may represent a video streaming server, an over-the-top (OTT) server, and a server providing a video hosting service.

[0103] Figure 7 is a diagram for describing a method of providing video information according to an embodiment of the present disclosure.

[0104] The display device 100 may provide an application execution mode under the control of the processor 130 .

[0105] For example, the display apparatus 100 may provide an application execution mode for providing content and applications provided from the external device 200 or the external server 300. However, this is an example, and it goes without saying that an application execution mode for executing an application stored in the memory 120 of the display apparatus 100 may be provided.

[0106] When the processor 130 according to an embodiment enters the application running mode according to a user command, the video information 30 received from the external server 300 may be provided to an area on the running mode. Here, it goes without saying that the user command may include a voice command received through a microphone (not shown) or a control command received from a remote control device (not shown).

[0107] When the processor 130 according to an embodiment enters an application execution mode according to a user command, an icon for executing an application provided from the external device 200 and video information 30 (e.g., thumbnail images) received from the external server 300 and a thumbnail image for selecting content provided by the external server 300 may be provided.

[0108] The memory 120 according to one or more embodiments of the present disclosure may store profile information corresponding to each of a plurality of users.

[0109] The processor 130 may provide a user interface (UI) for selecting any one of a plurality of users when driving the display device 100 or entering an execution mode of an application.

[0110] Subsequently, the processor 130 may identify profile information corresponding to a user selected from among a plurality of profiles through the UI, and transmit a request 1 including the identified profile information to the external server 300 .

[0111] For example, when “User 1 ” is selected, the processor 130 may transmit Request 1 including profile information corresponding to “User 1 ” to the external server 300 .

[0112] Therefore, the processor 130 may receive video information 30 related to an application corresponding to the selected user (eg, an application currently being played by the selected user or an application (eg, a game) recently played by the selected user) from the external server 300 .

[0113] exist Figure 7, a case where, when the display device 100 enters the running mode of the application, the video information 30 is provided to one area on the running mode is shown, but this is an example and is not limited thereto.

[0114] Figure 8 is a diagram for describing a method of providing video information according to an embodiment of the present disclosure.

[0115] Reference Figure 8 , the processor 130 may acquire the first image frame 20 - 1 being output through the display 110 while the application is running.

[0116] Subsequently, when the number of image frames whose similarity to the first image frame 20-1 among the multiple image frames stored in the memory 110 is equal to or greater than the threshold number, the processor 130 can obtain the background information and object information included in the first image frame 20-1 as frame information.

[0117] Subsequently, the processor 130 may obtain profile information including identification information and frame information of the application. In addition, when profile information including frame information corresponding to the first image frame 20-1 already exists (or has been acquired at a previous time), the processor 130 may increase quantity information included in the profile information.

[0118] Subsequently, the processor 130 may transmit a request 1 including the profile information to the external server 300 , and provide the video information 30 ′ received from the external server 300 according to the request 1 to an area on a screen being output through the display 110 (eg, an execution screen of an application).

[0119] When it is determined that the user has difficulty with a specific background and a specific object when running an application (e.g., a game), the processor 130 may provide information such as a video (e.g., a prompt video, a strategy video) related to the specific background and the specific object as video information 30' to an area on the running screen of the application.

[0120] Fig. 9 is a diagram for describing priority of profile information according to one or more embodiments of the present disclosure.

[0121] Reference Figure 5 , each of the plurality of log data stored in the memory 120 may include at least one of identification information of a user, identification information (title information) of an application, frame information, quantity information (e.g., the number of trials), or acquisition time of the log data. According to an embodiment, the processor 130 may identify the priority of the profile information corresponding to the data based on at least one of the quantity information or the acquisition time included in each of the plurality of log data.

[0122] For example, Fig. 9 As shown, when a plurality of log data corresponding to a user selected through the UI (or a user logged in to the display apparatus 100, or a user logged in to the external device 200) is identified, the processor 130 may obtain profile information corresponding to each of the plurality of log data. In addition, the processor 130 may identify the priority of each of the plurality of profile information based on at least one of quantity information or acquisition time included in each of the plurality of log data.

[0123] For example, when a plurality of log data corresponding to "user 1" is identified, the processor 130 may set the profile information corresponding to the log data having the largest amount of information to the highest priority (e.g., priority 1) based on the amount information included in each of the plurality of log data. For example, the processor 130 transmits the profile information having the largest amount of information to the external server 300 in preference to the remaining profile information based on the amount information included in each of the plurality of profile information corresponding to "user 1", and may receive the video information 30 corresponding thereto.

[0124] For example, when multiple log data corresponding to "User 1" are identified, the processor 130 may set the profile information corresponding to the log data in which the quantity information increases rapidly during a preset time period to the highest priority (e.g., priority 1) based on the quantity information included in each of the multiple log data.

[0125] For example, the processor 130 may identify log data in which the quantity information increases rapidly (e.g., the quantity information increases more than twice, or the quantity information increases more than 20 times, etc.) within a preset time period (e.g., within the past hour) based on the quantity information included in each of the plurality of log data corresponding to "user 1", and send the profile information corresponding to the identified log data to the external server 300 in priority to other profile information, and receive the video information 30 corresponding thereto. This is represented by the following pseudo code.

[0126] [Table 3]

[0127] For example, when it is identified that the number of image frames having a similarity equal to or greater than a threshold value with the specific frame information within a preset time interval is equal to or greater than a threshold value, the processor 130 may identify the profile information including the specific frame information as the highest priority profile information or the real-time profile information. Subsequently, the processor 130 may send a request 1 including the real-time profile information to the external server 300. For example, when a plurality of log data corresponding to "user 1" is identified, the processor 130 may set the profile information corresponding to the log data having the most recent acquisition time to the highest priority (e.g., priority 1) based on the acquisition time included in each of the plurality of log data. For example, the processor 130 sends the profile information having the most recent acquisition time to the external server 300 in priority to other profile information based on the acquisition time included in each of the plurality of profile information corresponding to "user 1", and may receive the video information 30 corresponding thereto.

[0128] In addition, when multiple log data corresponding to "User 1" are identified, the processor 130 may set the profile information corresponding to the log data corresponding to the application currently being displayed through the display 110 to the highest priority based on the identification information of the application included in each of the multiple log data.

[0129] return Figure 2 According to one or more embodiments of the present disclosure, the display device 100 includes a communication interface. The communication interface receives various types of data. For example, the communication interface can receive various types of data from at least one external device 200 set in the home, an external storage medium (e.g., a USB memory), an external server (e.g., a network hard disk or a streaming media server) 300, etc. through a communication method (such as AP-based Wi-Fi (wireless LAN network), Bluetooth, Zigbee, wired / wireless local area network (LAN), wide area network (WAN), Ethernet, IEEE 1394, High Definition Multimedia Interface (HDMI), Universal Serial Bus (UBS), Mobile High Definition Link (MHL), Audio Engineering Society / European Broadcasting Union (AES / EBU), optical and coaxial cables).

[0130] According to an example, the communication interface may communicate with external devices such as a remote control device and an external server using the same communication module (eg, a WiFi module).

[0131] According to an example, the communication interface may use different communication modules to communicate with external devices such as a remote control device and an external server. For example, the communication interface may use at least one of an Ethernet module or a WiFi module to communicate with an external server, and may use a Bluetooth module to communicate with an external device such as a remote control device. However, this is only an example, and the communication interface may use at least one communication module among various communication modules in the case where it communicates with a plurality of external devices or external servers.

[0132] Specifically, the communication interface according to one or more embodiments of the present disclosure may communicate with the external device 200 under the control of the processor 130, receive a screen corresponding to an application being run by the external device 200, and provide the received screen through the display 110. For example, when content is received from the external device 200 through the communication interface, the processor 130 may control the display 110 to provide a screen corresponding to the content.

[0133] The processor 130 may obtain identification information of the application by analyzing at least one image frame included in the content.

[0134] For example, when the external device 200 is a console, the external device 200 may play a game and transmit a plurality of image frames corresponding to the user's manipulation of the game to the display apparatus 100. The processor 130 may obtain identification information of the application by analyzing the plurality of image frames received from the external device 200. For example, the processor 130 may obtain identification information of the application running in the external device 200 by performing optical character recognition (OCR) on each of the plurality of image frames.

[0135] However, this is an example, and when the processor 130 itself executes an application, the processor 130 may obtain identification information of the running application. In addition, when an external server 300 (eg, a cloud server) runs an application, the processor 130 may receive and obtain identification information of the application from the external server 300.

[0136] The processor 130 according to one or more embodiments of the present disclosure may input a plurality of profile information into a neural network model to identify correlation between frame information included in each of the plurality of profiles.

[0137] For example, when the probability that the profile information including the first frame information includes the second frame information is equal to or greater than 0.7 based on multiple profile information, the neural network model can identify that there is a correlation between the first frame information and the second frame information.

[0138] In addition, when the probability that the profile information including the first frame information includes the second frame information is less than 0.7 based on the plurality of profile information, the neural network model can identify that there is no correlation between the first frame information and the second frame information. Here, the specific numbers are examples for ease of description and are not limited thereto.

[0139] Subsequently, the processor 130 may obtain specific background information and object information having a correlation equal to or greater than a threshold value (eg, 0.7) with frame information included in the first image frame 20 - 1 , and send a request 1 including the specific background information and object information to the external server 300 .

[0140] For example, when the processor 130 determines, based on multiple profile information, that the probability that the profile information of the frame information included in the first image frame 20-1 includes specific frame information (for example, specific background information and object information planned to be provided after the background information and object information included in the first image frame 20-1 according to the game progress order) is 0.7 or greater, the processor 130 may pre-generate the profile information including the specific frame information by using a neural network model.

[0141] Therefore, the processor 130 may obtain profile information including the specific frame information in advance before obtaining the specific frame information from the image frame output through the display 110 , and transmit the request 1 including the specific frame information to the external server 300 .

[0142] When it is determined that the user has difficulty with the background information and object information corresponding to the first image frame 20-1 when playing the game, the processor 130 may determine that there is a high probability that the user has difficulty with specific frame information whose correlation with the background information and object information corresponding to the first image frame 20-1 is equal to or greater than a threshold, and pre-obtain profile information including the specific frame information, and receive a video related to the specific frame information (a video related to a specific background and a specific object) from the external server 300.

[0143] The neural network model may be trained by using a plurality of profile information as training data to identify correlations between frame information included in each of the plurality of profile information. In addition, training a neural network model refers to creating a predefined operating rule or neural network model set to perform a desired characteristic (or purpose) by training a basic neural network model (e.g., a neural network model including any random parameters) using a plurality of training data according to a learning algorithm. Such training may be performed by a separate server and / or system, but is not limited thereto, and may be performed in the electronic device 100. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, transfer learning, or reinforcement learning, but are not limited to the above examples.

[0144] Each neural network model may be implemented as, for example, a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q network, but is not limited thereto.

[0145] The processor 130 for running a neural network model according to one or more embodiments of the present disclosure may be implemented by a combination of a general-purpose processor (such as a CPU, AP, and digital signal processor (DSP)), a graphics-specific processor (such as a GPU and a visual processing unit (VPU)), or a neural network-specific processor (such as an NPU) and software. The processor 130 may control the processing of input data according to a predefined operating rule or AI model stored in the memory 120. Optionally, when the processor 130 is a dedicated processor (or a neural network-specific processor), the processor 130 may be designed as a hardware structure dedicated to processing a specific neural network model. For example, hardware dedicated to processing a specific neural network model may be designed as a hardware chip (such as an ASIC or an FPGA). When the processor 130 is implemented as a dedicated processor, the processor 130 may be implemented to include a memory for implementing an embodiment of the present disclosure, or to include a memory processing function for using an external memory.

[0146] The memory 120 may store information about a neural network model including a plurality of layers. Here, storing information about the neural network model may refer to storing various types of information related to the operation of the neural network model, for example, information about a plurality of layers included in the neural network model and information about parameters (e.g., filter coefficients, biases, etc.) used in each of the plurality of layers.

[0147] When receiving a plurality of video information from the external server 300 according to the request 1, the processor 130 may arrange the plurality of video information according to priorities and then provide the arranged plurality of video information.

[0148] For example, the processor 130 may provide real-time video before recorded video according to the priority in the plurality of video information. In addition, the processor 130 may arrange the plurality of video information according to the priority based on the number of current viewers, the number of cumulative viewers and the amount of browsing, and then provide the arranged plurality of video information.

[0149] return Figure 2, an electronic device that does not include a display 110 may perform various functions of the disclosed embodiments. The electronic device may be connected to an external display device and send an image or content stored in the electronic device to the external display device. Specifically, the electronic device may send an image or content to the external display device together with a control signal for controlling the display of the image or content on the external display device. The external display device may be connected to the electronic device through the communication interface 110 or the input / output interface 160. For example, the electronic device 100 may not include a display such as a set-top box (STB). In addition, the electronic device 100 may include only a small display that can display only simple information (such as text information). The electronic device 100 may send an image or content to an external display device in a wired or wireless manner through a communication interface, or send an image or content to an external display device through an input / output interface.

[0150] The display device 100 may include an input / output interface. The input / output interface may be an interface of any one of a high-definition multimedia interface (HDMI), a mobile high-definition link (MHL), a universal serial bus (USB), a display port (DP), a thunderbolt interface, a video graphics array (VGA) port, an RGB port, a D-SUB, and a digital video interface (DVI). The input / output interface may input / output at least one of an audio signal and a video signal. According to an implementation example, the input / output interface may include a port for inputting / outputting only an audio signal and a port for inputting / outputting only a video signal as separate ports, or may be implemented as a single port for inputting / outputting both an audio signal and a video signal. In addition, the display device 100 may send at least one of an audio signal and a video signal to an external device 200 (e.g., a console or an external speaker) through the input / output interface. Specifically, an output port included in the input / output interface may be connected to an external device, and the display device 100 may send at least one of an audio signal and a video signal to an external device 200 through the output port.

[0151] The display device 100 may include a microphone. For example, there may be various embodiments in which the display device 100 performs an operation corresponding to a user voice signal received through the microphone.

[0152] For example, there may be various embodiments in which the display device 100 controls the display 110 based on a voice signal received through a microphone. For example, when a user voice signal for displaying content A is received, the display device 100 may control the display 110 to display content A.

[0153] For example, when a user voice signal for selecting any one of a plurality of video information is received, the display apparatus 100 may control the display 110 to output the selected video information.

[0154] For example, the display apparatus 100 may control the external device 200 connected to the display apparatus 100 based on the user voice signal received through the microphone. Specifically, the display apparatus 100 may generate a control signal for controlling the external device 200 so that an operation corresponding to the user voice signal is performed in the external device 200, and transmit the generated control signal to the external device 200.

[0155] The display device 100 may store a remote control application for controlling the external device 200. The display device 100 may send the generated control signal to the external display device using at least one communication method among Bluetooth, Wi-Fi, and infrared. For example, when receiving a user voice signal for displaying any one of a plurality of video information, the display device 100 may send a control signal to the external device 200 so that the external device 200 sends the video information corresponding to the user voice signal.

[0156] The display apparatus 100 may refer to various terminal devices capable of installing a remote control application, such as a smart phone and an AI speaker.

[0157] For example, the display apparatus 100 may control the external device 200 connected to the display apparatus 100 using the remote control device based on the user voice signal received through the microphone. Specifically, the display apparatus 100 may transmit a control signal for controlling the external device 200 so that an operation corresponding to the user voice signal is performed in the external device 200 to the remote control device. The remote control device may transmit the control signal received from the display apparatus 100 to the external device 200. For example, when a user voice signal for displaying any one of a plurality of video information is received, the display apparatus 100 may transmit a control signal for causing the external device 200 to transmit the video information corresponding to the user voice signal to the remote control device, and the remote control device may transmit the received control signal to the external device 200.

[0158] The display device 100 itself can perform the overall operation according to various embodiments of the present disclosure. Specifically, the display device 100 can obtain frame information, and obtain and output video information based on the frame information.

[0159] The display device 100 may obtain profile information and send a request corresponding to the obtained profile information to the server. Other operations may be performed by the external server, for example, an operation of obtaining video information corresponding to the request and sending the obtained video information to the display device. However, it is not limited thereto, and the operating subject of the operation described in various embodiments of the present disclosure may be changed according to the implementation examples.

[0160] Fig.10 is a flowchart for describing a method of controlling a display device according to one or more embodiments of the present disclosure.

[0161] In a method for controlling a display device according to one or more embodiments of the present disclosure, first, a first image frame is output through a display (see step S1010 ).

[0162] Subsequently, when it is determined based on the first image frame and the multiple image frames that the number of image frames whose similarity to the first image frame is equal to or greater than the threshold is equal to or greater than the threshold number (see step S1020: Y), frame information corresponding to the background information and object information included in the first image frame is obtained from information related to the application corresponding to the first image frame (see step S1030).

[0163] Subsequently, a request based on the profile information including the identification information of the application and the frame information is sent to the server (see step S1040 ).

[0164] Subsequently, the video information received from the server according to the request is provided (S1050).

[0165] When it is determined based on the first image frame and the plurality of image frames that the number of image frames having a similarity with the first image frame equal to or greater than a threshold is less than a threshold number (see step S1020 : N), the first image frame may be stored.

[0166] According to an example, the profile information also includes information about the number of image frames having similarity. The control method may further include: storing a first image frame, when the number of image frames whose similarity to the second image frame is equal to or greater than a threshold value among the multiple image frames is identified based on the multiple image frames and the second image frame acquired after a predetermined time after acquiring the first image frame is equal to or greater than a threshold value, and the similarity between the first image frame and the second image frame is equal to or greater than a threshold value, adding quantity information included in the profile information, and when the number of image frames whose similarity to the second image frame is equal to or greater than a threshold value among the multiple image frames is identified, and the similarity between the first image frame and the second image frame is less than a threshold value, generating profile information corresponding to the second image frame.

[0167] Increasing the quantity information may include: comparing the similarity between a first background included in the first image frame and a second background included in the second image frame and the similarity between a first object included in the first image frame and a second object included in the second image frame, and when each of the similarity between the first background and the second background and the similarity between the first object and the second object is equal to or greater than a threshold, identifying that the similarity between the first image frame and the second image frame is equal to or greater than a threshold.

[0168] The control method may further include, when content is received from the external device, controlling the display to provide a screen corresponding to the content, and obtaining identification information of the application based on at least one image frame corresponding to the content.

[0169] The display device may store profile information corresponding to each of the plurality of users. The control method may further include obtaining profile information corresponding to a user selected through a user interface (UI) for selecting any one of the plurality of users, and outputting video information received from the server to a specific area of ​​the display when the application is executed.

[0170] Each of the multiple profiles includes at least one of user identification information, application identification information, frame information, quantity information, or acquisition time of the profile information, and the control method may further include: obtaining the priority of the profile information based on at least one of the quantity information or acquisition time of the profile information included in each of the multiple profiles.

[0171] The sending step (see step S1040 ) may include sending a request based on profile information corresponding to a highest priority to the server based on a priority corresponding to each of a plurality of profiles corresponding to the selected user.

[0172] The control method according to the embodiment may further include: inputting multiple profiles into a neural network model to obtain correlation between frame information included in each of the multiple profiles and specific background information and object information whose correlation with frame information included in the first image frame is equal to or greater than a threshold, and sending a request including the acquired specific background information and object information to a server.

[0173] The control method according to an example further includes: when a plurality of video information is received from the server according to the request, outputting the plurality of video information sorted according to the priority, and each of the plurality of video information includes a thumbnail image of the corresponding video.

[0174] The outputting step may include controlling a display so that the real-time video is output before the recorded video according to a priority among the plurality of video information.

[0175] However, various embodiments are applicable to all electronic devices including a display as well as a display apparatus.

[0176] The various exemplary embodiments of the present disclosure described above may be implemented in a computer or a computer-readable recording medium using software, hardware, or a combination of software and hardware. In some cases, the embodiments described in the present disclosure may be implemented by the processor itself. According to software implementation, embodiments (such as the processes and functions described in the present disclosure) may be implemented by separate software modules. Each of the software modules may perform one or more functions and operations described in the present disclosure.

[0177] Computer instructions for executing the processing operations of the electronic device 100 according to the various embodiments of the present disclosure described above may be stored in a non-transitory computer-readable medium. The computer instructions stored in the non-transitory computer-readable medium, when executed by a processor of a specific device, allow the specific device to execute the processing operations of the electronic device and the display device according to the various exemplary embodiments described above.

[0178] A non-transitory computer-readable medium is not a medium that temporarily stores data, such as a register, cache, or memory, but refers to a medium that stores data semi-permanently and can be read by a device. Specific examples of non-transitory computer-readable media may include a compact disc (CD), a digital versatile disc (DVD), a hard disk, a Blu-ray disc, a universal serial bus (USB), a memory card, or a read-only memory (ROM).

[0179] Although exemplary embodiments have been shown and described above, the present disclosure is not limited to the above-mentioned specific exemplary embodiments, but various modifications may be made by those skilled in the art to which the present disclosure belongs without departing from the gist of the present disclosure disclosed in the appended claims. These modifications should also be understood to fall within the scope and spirit of the present disclosure.

Claims

1. A display device, comprising: Communication interface; monitor; a memory configured to store a plurality of application image frames; as well as One or more processors configured to: based on a first output image frame output to the display and the plurality of application image frames, based on the number of image frames in the plurality of application image frames having a similarity to the first output image frame that is equal to or greater than a threshold value being equal to or greater than a threshold value, obtaining frame information corresponding to background information and object information included in the first output image frame from information related to an application corresponding to the first output image frame, sending a request based on the profile information including the identification information of the application and the frame information to a server through the communication interface, The display is controlled to provide video information corresponding to the request received from the server through the communication interface.

2. The display device according to claim 1, in, The profile information further includes quantity information corresponding to the quantity of the plurality of application image frames having the similarity, Wherein, the one or more processors are further configured to: storing the first output image frame in the memory, When it is identified based on a second output image frame acquired after a predetermined time has elapsed since the first output image frame was acquired and the plurality of application image frames stored in the memory that (i) the number of the plurality of application image frames having a similarity to the second output image frame that is equal to or greater than the threshold is equal to or greater than the threshold number and (ii) the similarity between the first output image frame and the second output image frame is equal to or greater than the threshold, the quantity information included in the profile information is increased, and When it is identified that (i) the number of the plurality of application image frames having a similarity equal to or greater than the threshold with the second output image frame is equal to or greater than the threshold number and (ii) the similarity between the first output image frame and the second output image frame is less than the threshold, second profile information corresponding to the second output image frame is generated.

3. The display device according to claim 2, wherein: The one or more processors configured to increase the quantity information are configured to: comparing a similarity between a first background included in the first output image frame and a second background included in the second output image frame and a similarity between a first object included in the first output image frame and a second object included in the second output image frame, and When each of the similarity between the first background and the second background and the similarity between the first object and the second object is equal to or greater than the threshold, it is identified that the similarity between the first output image frame and the second output image frame is equal to or greater than the threshold.

4. The display device according to claim 1, wherein: The one or more processors are further configured to: When content is received from an external device through the communication interface, controlling the display to provide a screen corresponding to the content, and The identification information of the application is obtained based on at least one content image frame corresponding to the content.

5. The display device according to claim 1, in, The memory is configured to store the profile information corresponding to each of a plurality of users, Wherein, the one or more processors are further configured to: obtaining the profile information corresponding to a user among the plurality of users selected through the user interface UI, and When the application is executed, the display is controlled to output the video information received from the server to a specific area of ​​the display.

6. The display device according to claim 5, in, The profile information corresponding to each of the plurality of users includes identification information of the user, identification information of the application, the frame information, the quantity information, or acquisition time of the profile information, and The one or more processors are further configured to obtain the priority of the profile information based on at least one of the quantity information included in the profile information of each of the multiple users or the acquisition time of the profile information.

7. The display device according to claim 6, wherein: The one or more processors are further configured to send the request based on the profile information corresponding to a highest priority to the server based on a priority corresponding to each of a plurality of profiles corresponding to the selected user.

8. The display device according to claim 7, wherein: The one or more processors are further configured to: inputting the plurality of profiles stored in the memory to a neural network model to obtain correlation between frame information included in each of the plurality of profiles and specific background information and specific object information whose correlation with the frame information included in the first output image frame is equal to or greater than the threshold value, and A request including the acquired specific context information and the acquired specific object information is sent to the server.

9. The display device according to claim 1, in, The video information includes a plurality of video information. The one or more processors are further configured to, when receiving the plurality of video information from the server according to the request, control the display to output the plurality of video information sorted according to the priority, and Each of the plurality of video information includes a thumbnail image of the corresponding video.

10. The display device according to claim 9, wherein: The one or more processors are further configured to control the display so that real-time video is output before recorded video according to the priority among the plurality of video information.

11. A method for controlling a display device, comprising: outputting a first output image frame through a display; Based on the first output image frame and a plurality of application image frames, and based on the number of image frames among the plurality of application image frames having a similarity to the first output image frame that is equal to or greater than a threshold value being equal to or greater than a threshold value, obtaining frame information corresponding to background information and object information included in the first output image frame from information related to an application corresponding to the first output image frame; sending a request based on the profile information including the identification information of the application and the frame information to a server; as well as The video information corresponding to the request received from the server is provided.

12. The method according to claim 11, in, The profile information further includes quantity information corresponding to the quantity of the plurality of application image frames having the similarity, Wherein, the method further comprises: storing the first output image frame; adding the quantity information included in the profile information when it is identified based on a second output image frame acquired after a predetermined time has passed since the first output image frame was acquired and the plurality of application image frames that (i) the number of the plurality of application image frames having a similarity to the second output image frame that is equal to or greater than the threshold is equal to or greater than the threshold number and (ii) the similarity between the first output image frame and the second output image frame is equal to or greater than the threshold; and When it is identified that (i) the number of the plurality of application image frames having a similarity equal to or greater than the threshold with the second output image frame is equal to or greater than the threshold number and (ii) the similarity between the first output image frame and the second output image frame is less than the threshold, second profile information corresponding to the second output image frame is generated.

13. The method of claim 12, wherein: The quantity information to be increased includes: comparing a similarity between a first background included in the first output image frame and a second background included in the second output image frame and a similarity between a first object included in the first output image frame and a second object included in the second output image frame; and When each of the similarity between the first background and the second background and the similarity between the first object and the second object is equal to or greater than the threshold, it is identified that the similarity between the first output image frame and the second output image frame is equal to or greater than the threshold.

14. The method of claim 11, wherein: The method further comprises: When content is received from an external device, controlling the display to provide a screen corresponding to the content; and The identification information of the application is obtained based on at least one content image frame corresponding to the content.

15. The method according to claim 11, in, The display device stores profile information corresponding to each of a plurality of users, and Wherein, the method further comprises: obtaining profile information corresponding to a user among the plurality of users selected through the user interface UI; and When the application is executed, the display is controlled to output the video information received from the server to a specific area of ​​the display.

Images