Electronic apparatus and control method thereof

Abstract

This electronic device comprises: a communication unit; a memory storing at least one instruction; and one or more processors for executing the at least one instruction, wherein the one or more processors generate a first image corresponding to content acquired through the communication unit, acquire object information corresponding to the content, and when the object information is acquired, generate a second image including a message notifying that the object information may be provided.

Description

Electronic device and method of controlling the same

[0001] The present disclosure relates to an electronic device capable of providing information about an object within content and a method for controlling the same.

[0002] An electronic device can perform operations such as generating images corresponding to content or displaying images. Such an electronic device can provide the user not only with images corresponding to the content selected by the user, but also with various information related to the content.

[0003] Embodiments of the present disclosure may solve at least one of the previously described problems and / or disadvantages and provide the advantages described below. Accordingly, the embodiments of the present disclosure provide an electronic device capable of providing information about an object within content and a method for controlling the same.

[0004] Additional embodiments will be presented in the detailed description below, some of which are obvious from the detailed description, and other embodiments can also be presented through learning from the presented embodiments.

[0005] An electronic device according to an embodiment of the present disclosure is disclosed. The electronic device comprises a communication unit, a memory for storing at least one instruction, and one or more processors for executing said at least one instruction. The one or more processors generate a first image corresponding to content obtained through the communication unit, obtain object information corresponding to said content, and, upon obtaining said object information, generate a second image including a message indicating that said object information is available.

[0006] If the above one or more processors acquire second object information for a new object after acquiring first object information, they can generate a second image including the message.

[0007] When the above one or more processors acquire object information of a preset number or more, or acquire object information corresponding to a preset category, they can generate a second image including the message.

[0008] The above-mentioned preset category may include at least one corresponding category among music information corresponding to the content and location information corresponding to the content.

[0009] The above one or more processors can generate a second image by positioning the message so that it does not overlap with at least one main object in the first image.

[0010] When a preset event occurs, the above one or more processors may generate a third image containing the object information and generate a second image in which the message is located in an area corresponding to the position where the object information is to be displayed among a plurality of areas within the second image.

[0011] The third video above includes a first area where a first video corresponding to the content is located and a tab area where at least one of the object information is displayed. The tab area may display person information related to a person appearing in the content among the object information when a first tab among a plurality of tabs is selected, and actor information related to a character within the content among the body information may be displayed in the tab area when a second tab among a plurality of tabs is selected.

[0012] The above one or more processors can acquire at least one object image from the first image and acquire object information based on the acquired object image.

[0013] The above one or more processors can obtain object information corresponding to the first image and time information from an external device based on the time information of the first image.

[0014] The electronic device further includes a speaker, and the one or more processors can control the speaker to generate sound information corresponding to the message and output the generated sound information.

[0015] The above one or more processors can acquire an audio signal corresponding to the content, identify a blank section based on the acquired audio signal, and control the speaker to output the sound information to the identified blank section.

[0016] The electronic device further includes a communication unit capable of communicating with a user terminal device, and the one or more processors can control the communication unit to transmit notification information corresponding to the message to the user terminal device.

[0017] The above object information may include at least one of the following: person information corresponding to the person output in the content, product information, place information, and music information included in the content.

[0018] A control method for an electronic device according to one embodiment of the present disclosure includes the steps of: generating a first image corresponding to content; acquiring object information corresponding to the content; and, when the object information is acquired, generating a second image including a message indicating that the object information can be provided.

[0019] The step of generating the second image above can generate a second image including the message if, after acquiring the first object information, second object information for a new object is acquired.

[0020] The step of generating the second image above can generate a second image including the message when acquiring object information of a preset number or more, or acquiring object information corresponding to a preset category.

[0021] The step of generating the second image above can generate the second image by arranging the message so that it does not overlap with at least one main object in the first image.

[0022] The control method further includes the step of generating a third image containing the object information when a preset event occurs, and the step of generating the second image may generate a second image in which the message is located in an area corresponding to the position where the object information is to be displayed among a plurality of areas within the second image.

[0023] The third video above includes a first area where a first video corresponding to the content is located and a tab area where at least one of the object information is displayed. The tab area may display person information related to a person appearing in the content among the object information when a first tab among a plurality of tabs is selected, and actor information related to a character within the content among the object information may be displayed in the tab area when a second tab among a plurality of tabs is selected.

[0024] In a non-transient computer-readable recording medium storing a program for executing a control method for an electronic device according to one embodiment of the present disclosure, the control method comprises the steps of: generating a first image corresponding to content; acquiring object information corresponding to content; and, when the object information is acquired, generating a second image including a message indicating that the object information is available.

[0025] The above-described or other aspects, features, and benefits of embodiments of the present disclosure will become more apparent from the following description with reference to the accompanying drawings. In the accompanying drawings:

[0026] FIG. 1 is a drawing for explaining an object information providing operation according to one embodiment of the present disclosure,

[0027] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure,

[0028] FIG. 3 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure,

[0029] A drawing for explaining the display operation of a nudge message according to one embodiment of the present disclosure of FIG. 4,

[0030] FIG. 5 is a drawing illustrating an example of a user interface window displaying object information according to one embodiment of the present disclosure.

[0031] FIG. 6 is a drawing illustrating an example of a user interface window displaying object information according to one embodiment of the present disclosure.

[0032] FIG. 7 is a drawing illustrating an example of a user interface window displaying object information according to one embodiment of the present disclosure.

[0033] FIG. 8 is a drawing illustrating an example of a user interface window displaying object information according to one embodiment of the present disclosure.

[0034] FIG. 9 is a drawing illustrating an example of providing nudge information according to one embodiment of the present disclosure.

[0035] FIG. 10 is a drawing illustrating an example of providing nudge information according to one embodiment of the present disclosure.

[0036] FIG. 11 is a flowchart illustrating the control operation of an electronic device according to one embodiment of the present disclosure.

[0037] The embodiments described herein are subject to various modifications and may have various forms; specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of specific embodiments and should be understood to include various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In relation to the description of the drawings, similar reference numerals may be used for similar components.

[0038] In describing the present disclosure, if it is determined that a detailed description of related known functions or configurations could unnecessarily obscure the essence of the present disclosure, such detailed description is omitted.

[0039] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concept of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to make the present disclosure more faithful and complete and to fully convey the technical concept of the present disclosure to those skilled in the art.

[0040] The terms used in this disclosure are used merely to describe specific embodiments and are not intended to limit the scope of the rights. The singular expression includes the plural expression unless the context clearly indicates otherwise.

[0041] In the present disclosure, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, actions, or components, etc.) and do not exclude the presence of additional features.

[0042] In the present disclosure, expressions such as “A or B,” “at least one of A or / and B,” or “one or more of A or / and B” may include all possible combinations of items listed together. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” may refer to cases including (1) at least one A, (2) at least one B, or (3) both at least one A and at least one B.

[0043] Expressions such as "first," "second," "first," or "second" used in this disclosure may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0044] Where it is stated that a component (e.g., a first component) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., a second component), it should be understood that the component may be directly connected to the other component or connected through the other component (e.g., a third component).

[0045] On the other hand, when it is stated that a certain component (e.g., a first component) is "directly connected" or "directly coupled" to another component (e.g., a second component), it may be understood that no other component (e.g., a third component) exists between said certain component and said other component.

[0046] As used in this disclosure, the expression “configured to” may be replaced, depending on the context, with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” may not necessarily mean only “specifically designed to” in hardware.

[0047] Instead, in some situations, the expression “device configured to do something” may mean that the device is “capable of doing something” together with other devices or components. For example, the phrase “processor configured (or set) to perform A, B, and C” may mean a dedicated processor for performing those operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or application processor) capable of performing those operations by executing one or more software programs stored in a memory device.

[0048] In the embodiments, a 'module' or 'part' performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of 'modules' or a plurality of 'parts' may be integrated into at least one module and implemented by at least one processor, except for the 'module' or 'part' that needs to be implemented in specific hardware.

[0049] Operations performed by a module, program, or other component according to various embodiments may be executed sequentially, in parallel, iteratively, or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0050] Meanwhile, the various elements and areas in the drawings are depicted schematically. Accordingly, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0051] Meanwhile, an electronic device according to various embodiments of the present disclosure may include, for example, at least one of a smartphone, a tablet PC, a desktop PC, a laptop PC, a server, or a wearable device. The wearable device may include at least one of an accessory type (e.g., a watch, ring, bracelet, anklet, necklace, glasses, contact lens, or head-mounted device (HMD)), a fabric or clothing integrated type (e.g., electronic clothing), a body-attached type (e.g., a skin pad or tattoo), or a bio-implantable circuit.

[0052] In some embodiments, the electronic device is, for example, a television, a DVD (digital video disk) player, audio, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a media box (e.g., Samsung HomeSync). TM It may include at least one of a game console, an electronic dictionary, an electronic key, a camcorder, or an electronic photo frame. Meanwhile, among the electronic devices described above, a device equipped with a display may be referred to as a display device. Meanwhile, even if the electronic device of the present disclosure does not have a display, it may be a set-top box or a PC that provides images to a display device.

[0053] Hereinafter, embodiments according to the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement them.

[0054] FIG. 1 is a drawing for explaining an object information providing operation according to one embodiment of the present disclosure.

[0055] Referring to FIG. 1, the electronic device (100) can display a third image (106) containing object information while displaying a first image corresponding to the content. Meanwhile, in the illustrated example, for ease of explanation, it is assumed that the electronic device directly displays the image, but in implementation, the electronic device may be a device that outputs an image without having a display.

[0056] Here, the first image is an image corresponding to the content, and the third image (106) includes an area for displaying the first image and an information display area (105) for displaying information about an object within the image.

[0057] In the illustrated example, the third image is depicted as including an image (104) corresponding to the content and an information display area (105), but in implementation, the third image may only display object information. Also, the information display area may not display all acquired object information, but may display only the object information of some objects.

[0058] Here, the screen includes an image displayed on the display of the electronic device (100). The image may also be referred to by terms such as a frame. Various types of objects, such as icons, text, photos, videos, and widgets, may be displayed on the screen.

[0059] And an object is an identifiable entity that exists physically or can be conceived of abstractly. Such objects can be expressed as objects, targets, things, characters, people, figures, etc.

[0060] Furthermore, content refers to providing movies, music, plays, photographs, comics, animations, computer games, text, shapes, colors, sounds, movements, or images, or combinations of the aforementioned, through electronic devices. Among such content, regarding content such as movies, plays, and dramas, users may be interested in the characters within the content; in specific animations, they may be interested in the characters; and in documentaries, they may be interested in specific buildings, animals, etc.

[0061] For example, if the object is a person, the user might be curious about other works by the actor currently playing the role, other time periods in which the character appears, or the costumes the character is wearing.

[0062] Here, a character refers to a figure appearing in the relevant content, such as novels, plays, movies, etc. Here, the term "character" does not refer to a human being but can include anthropomorphic animals, mythical beings, and even inanimate objects within the content. In other words, in games, animations, etc., characters, animals, mascots, etc., that are not human can also be considered characters. Such characters may be referred to as protagonists, players, narrators, personas, or characters.

[0063] Previously, when a user had questions about a character, they had to search for the character's name on a search site or look up information related to the content on a content provider server. However, in the present disclosure, an electronic device can directly provide information about the object that the user is curious about.

[0064] Here, object information may include the name of the object, and if the object is a person, it may be referred to as character information. Furthermore, within the content, character information may include role names, actual cast member names, or arbitrary identifiers, character information, actor information, etc. Additionally, object information may include work information. Here, work information may include release dates, cast member information, work title, writer, director information, etc. Furthermore, work information may include information related to the character within the current content or information about other works in which the actor has appeared.

[0065] In addition, object information may include not only information about actors or characters within the video, but also information about locations appearing in the content, information about music played in the content, and information about products currently displayed or sold in the content.

[0066] For example, content such as music broadcasts or music videos may generate interest not only in the singers appearing in the video but also in the songs themselves. Therefore, music information can be utilized as object information. Additionally, basic information about the singer (or group) featured in the music broadcast and other songs by that singer can serve as object information.

[0067] Additionally, in the case of travel broadcasts, there may be interest regarding the countries or regions featured in the current content. In this case, regional information may be used as object information.

[0068] Furthermore, in broadcasts such as home shopping, users may be interested in the products currently being sold within the content, and if a famous actor appears, they may be interested in the clothing or accessories worn by that actor. In this case, the object information can be information about the product, such as product details or home appliance details.

[0069] Meanwhile, among the object recognition methods, human identification can be performed by detecting a human face. Alternatively, such object information may be collected and used from an external server without the electronic device (100) directly performing object recognition and verifying it. For example, information that can identify the content can be provided to an external server using metadata corresponding to the content, and object information corresponding to a database of the content or the current playback time can be received from the external server.

[0070] In this way, since the electronic device (100) does not know when the user will request object information, it performs the operation of acquiring (or collecting) object information related to the content (or current image) in the background, separate from the image display.

[0071] However, even if object information is obtained through such actions, if the user is unaware that they can perform these functions or does not execute them, the utilization of the aforementioned functions will inevitably be very low.

[0072] To solve these problems, the electronic device according to the present disclosure acquires object information corresponding to content, and if the acquired object information is of a certain number or more, or if conditions such as a specific situation are satisfied, it can provide a nudge message to the user that there is object information on the screen.

[0073] Here, a nudge is a liberal intervention or interference that gently guides a user to check object information, and the aforementioned nudge message may be a message that encourages checking acquired object information. Such a nudge message may be referred to as an implicit message, a guiding message, a soliciting message, a stimulating message, an intervention message, etc. Additionally, a nudge message may be referred to as nudge text, a nudge notification, a nudge UI, a nudge emoticon, etc.

[0074] Accordingly, as illustrated, the second screen (103) can confirm that a nudge message (102) is positioned on the video (101) corresponding to the content. For example, if a second actor newly appears on the screen while the first actor is being displayed, and object information regarding the second actor is newly acquired, the electronic device (100) can display a message indicating that object information regarding the appearing actor is prepared. Meanwhile, the nudge message displayed at this time may differ from the illustrated case and may display a message corresponding to the event environment being displayed.

[0075] In addition, while the illustrated example shows the nudge message displayed as a message on the screen, it can also be communicated to the user via voice during implementation. In this case, to avoid interfering with the voice output from the content, a blank section (i.e., a section where no dialogue is spoken) of the voice (a section where dialogue is spoken) can be identified, and the nudge message can be output as voice in that blank section.

[0076] In addition, if the user can operate the electronic device (100) with a user terminal device such as a smartphone, the above-described nudge message can be displayed on the user terminal device.

[0077] The specific configuration and operation of such electronic devices will be described later in Fig. 2.

[0078] Meanwhile, although the illustrated example shows the electronic device directly displaying the image, in implementation, the electronic device may be a device that performs only the image generation operation as described above and provides the generated image to a separate display.

[0079] As described above, when an environment is created in which object information can be acquired and provided to a user, the electronic device according to the present disclosure informs the user that object information can be provided, thereby allowing the user to naturally experience or use the new functions of the electronic device.

[0080] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0081] Referring to FIG. 2, the electronic device (100) may include a communication unit (110), a memory (120), and a processor (130).

[0082] The communication unit (110) is a configuration that performs communication with various types of external devices according to various types of communication methods. The communication unit (110) may include a Wi-Fi module, a Bluetooth module, an infrared communication module, and a wireless communication module, etc. Here, each communication module may include at least one hardware chip or hardware circuit.

[0083] Wi-Fi modules and Bluetooth modules can perform communication via Wi-Fi and Bluetooth methods, respectively. When using a Wi-Fi module or a Bluetooth module, various connection information, such as SSID and session key, is transmitted and received first; after establishing a communication connection using this information, various types of information can be transmitted and received.

[0084] The infrared communication module performs communication according to infrared communication (IrDA, Infrared Data Association) technology, which uses infrared rays located between visible light and millimeter waves to wirelessly transmit data over short distances.

[0085] In addition to the communication method described above, the wireless communication module may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation).

[0086] In addition, the communication unit (110) may include at least one wired communication module that performs communication using a LAN (Local Area Network) module, an Ethernet module, a pair cable, a coaxial cable, a fiber optic cable, or a UWB (Ultra Wide-Band) module.

[0087] According to one example, the communication unit (110) may use the same communication module (e.g., Wi-Fi module) to communicate with external devices such as a remote control and an external server.

[0088] According to other examples, the communication unit (110) may use different communication modules (e.g., Wi-Fi modules) to communicate with external devices such as a remote control and external servers. For example, the communication unit (110) may use at least one of an Ethernet module or a Wi-Fi module to communicate with an external server, and may use a BT module to communicate with an external device such as a remote control. However, this is merely one embodiment, and the communication unit (110) may use at least one of various communication modules when communicating with multiple external devices or external servers.

[0089] The communication unit (110) can receive content. Such content can be diverse, such as movies, music videos, dramas, short videos, etc. And while the content is assumed to be video, it may also be an image or referred to as video. In addition, the communication unit (110) can obtain metadata corresponding to the aforementioned content.

[0090] The communication unit (110) can receive information from a website or social media. For example, the communication unit (110) can provide a query (or search term, query, etc.) to a specific site under the control of the processor (130) and receive response information corresponding to the query. Here, the query may be a combination of keywords necessary to obtain search results for a person displayed in the content, such as "title and person" or "title and performer" corresponding to the specific content.

[0091] And the communication unit (110) can receive not only content but also information necessary for providing various applications and services of the electronic device (100) from an external device. For example, in cases where a database of people is not created directly, the communication unit (110) can obtain a database stored on an external server.

[0092] In addition, when the communication unit (110) uses an external DB or external module for person search, it can transmit an image for the search and receive corresponding result information. Meanwhile, when the electronic device does not directly perform object analysis, the communication unit (110) can transmit information and time information that can identify the content to an external server. In addition, the communication unit (110) can receive object information corresponding to the current time of the content.

[0093] And the communication unit (110) can transmit the database generated in the process described later to an external server. In this way, by registering the database generated by one device to the server, other devices can use the database registered to the server.

[0094] The memory (120) may be implemented as internal memory such as ROM (e.g., EEPROM (electrically erasable programmable read-only memory)) or RAM included in the processor (130), or as memory separate from the processor (130). In this case, the memory (120) may be implemented in the form of memory embedded in the electronic device (100) or in the form of memory that can be attached to and detached from the electronic device (100), depending on the purpose of data storage. For example, data for operating the electronic device (100) may be stored in memory embedded in the electronic device (100), and data for the expansion function of the electronic device (100) may be stored in memory that can be attached to and detached from the electronic device (100).

[0095] The memory (120) can store a database created during the process described below. Although the above description assumes that the electronic device (100) directly creates and uses a database, it is also possible to receive and use a database created by an external device. In this case, the aforementioned database may be referred to as object information.

[0096] Additionally, the memory (120) may store object images or object information generated during the object recognition process. Alternatively, the memory (120) may store object information obtained through the communication unit (110).

[0097] And the memory (120) can store various contents (e.g., broadcast content, applications, etc.) received through the communication unit (110) described above.

[0098] Meanwhile, the memory embedded in the electronic device (100) is implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD), and the memory that can be attached to and detached from the electronic device (100) can be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), external memory that can be connected to a USB port (e.g., USB memory).

[0099] Meanwhile, although the illustrated example shows the electronic device (100) being composed of a single memory, when distinguishing between volatile memory and non-volatile memory, the electronic device (100) may be described as including multiple memories.

[0100] The processor (130) controls the overall operation of the electronic device (100). Specifically, the processor (130) is connected to the configuration of the electronic device including a communication unit (110) and a memory (120), and can control the overall operation of the electronic device by executing at least one instruction stored in the memory (120) as described above. In particular, the processor (130) can be implemented as a single processor as well as as a plurality of processors.

[0101] The processor (130) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing operations. The processor (130) may include at least one electrical circuit and may process instructions (or programs, data, etc.) stored in memory individually or collectively in a distributed manner.

[0102] The processor (130) may include a processor assembly comprising one or more processing circuits. The processor (130) may include any processing circuit that is operative to control the performance and operation of one or more components of an electronic device (e.g., memory and / or driving device (sensor)). For example, the processor (130) (e.g., AP) may be implemented as a system on chip (SoC) (e.g., a single chip or a chipset). For example, the processor (130) may be implemented as multiple cores (or at least one core circuit), multiple chips, or multiple chipsets.

[0103] For example, the processor (130) may include one or more processing circuits. The processor (130) may include one or more processing circuits configured to perform various functions of the present disclosure individually and / or collectively. As an example without limitation, at least a portion of the processor (130) may be included in a first chip of the electronic device (100), and at least another portion of the processor (130) may be included in a second chip of an electronic device different from the first chip of the electronic device (100).

[0104] For example, the processor (130) may include a central processing unit (CPU), a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a display controller, a memory controller, a storage controller, a communication processor (CP), and / or a sensor interface. These components of the processor (130) are merely exemplary. The processor (130) may include additional components other than those described above. Additionally, some components of the processor (130) may be omitted. Furthermore, some components of the processor (130) may be included as separate components of the electronic device (100) outside of the processor (130). For example, some components of the processor (130) (e.g., a memory controller) may be included within other components (e.g., at least a portion of memory, an interface (e.g., available for connection to at least one component of the electronic device (100)), a display).

[0105] The processor (130) can cause other components of the electronic device (100) to perform various operations by executing instructions stored in memory (120). The processor (130) processes setting values, function commands, etc. according to a stored control program or control data, and can output control signals related to functions that the electronic device (100) can perform or communication signals for communicating with an external electronic device.

[0106] The processor (130) acquires content using the communication unit (110). For example, when the processor (130) receives a playback command for specific content from a user, it can control the communication unit (110) to receive the content. Such content may be a video such as VOD, but may also be a real-time streaming video provided by a specific server, or broadcast content transmitted by a broadcasting station.

[0107] The processor (130) generates a first image corresponding to the acquired content. For example, if the content is real-time streaming, it can construct a screen using video data from the received streaming data and generate a first image using the screen.

[0108] The processor (130) acquires at least one object image from the first image. For example, the processor (130) can use an object recognition model to recognize objects of a preset type within the image and acquire coordinate information of the objects. Here, the objects of a preset type may be human faces, but are not limited thereto. Once such coordinate information is acquired, the processor (130) can extract a region corresponding to the coordinates to acquire an object image.

[0109] Meanwhile, although the illustrated example describes generating an object image corresponding to each object, coordinate values ​​may be used during implementation, and it is also possible to use an image in which only the object image remains after blanking out the area outside the region corresponding to the object in the image. Here, blanking involves covering the area outside the aforementioned region with black (or white) or removing the area outside the aforementioned region so that pixel information, etc., is not present.

[0110] Meanwhile, the processor (130) may acquire an object image upon a user's request, or automatically acquire an object image during implementation. That is, it may acquire an object image and acquire object information in advance, and provide the object information acquired in advance in response to a user's request for object information.

[0111] The processor (130) obtains object information corresponding to each of at least one object image based on at least one object image. For example, the processor (130) controls the communication unit (110) to transmit the obtained object image to an external server and can obtain information corresponding to the object image from the external server. For example, if the object described above is a human face, the processor (130) can obtain information such as the name of the person and works in which the person appeared.

[0112] When implementing, the processor (130) may obtain object information using multiple servers. For example, the processor (130) may control the communication unit (110) to transmit an object image to a first server and obtain the name (or identifier) ​​of the object image from the first server.

[0113] And the processor (130) controls the communication unit (110) to transmit the acquired name (or identifier) ​​to the second server and may also acquire additional information about the object from the second server. In implementation, the operation of acquiring one of the two operations described above (i.e., the name or identifier) ​​may be performed independently by the electronic device (100).

[0114] Meanwhile, if the content is not real-time content, object information regarding the content may be acquired and stored from another device. In this case, the processor (130) controls the communication unit (110) to transmit information regarding the current content to an external server, and can receive and use object information regarding the content from the external server. In implementation, the processor (130) may acquire object information for all time intervals within the content all at once, acquire object information in specific time units, or acquire object information step by step at a time corresponding to the time currently being played.

[0115] And the processor (130) can obtain additional information corresponding to the content based on metadata corresponding to the content. Here, the additional information may include content information related to or similar to the content, and may also be object information generated for the content from another electronic device. In this case, it may include multiple object information within the total playback time of the content and time information for each object information to be displayed.

[0116] The processor (130) can generate a second image including a message indicating that object information is available when object information is acquired. Here, the message may be a nudge message.

[0117] Meanwhile, if a nudge message is displayed every time object information is acquired, it may interfere with video viewing. Accordingly, the timing of displaying such a nudge message may be limited. For example, a nudge message as described above may be displayed when a new character appears in a drama or movie, that is, when a second object information regarding a new object is acquired after the first object information has been acquired, or when object information exceeding a preset number is acquired, or when object information corresponding to a preset category, such as at least one corresponding category among music information corresponding to the content and location information corresponding to the content, is acquired.

[0118] Meanwhile, in order not to interfere with the user's viewing, such nudge messages may be displayed in a surrounding area rather than in a main location of the video. To this end, the processor (130) may identify a main object within the video and position it in an area that does not overlap with the main object. At this time, the processor (130) may position the nudge message in an area corresponding to the location where object information will be displayed later among many areas that do not overlap with the main object.

[0119] For example, as illustrated in FIG. 1, when object information is displayed on the right side of the image, the nudge message described above may be located in the right area of ​​the image. Conversely, when object information is displayed on the left side of the image, the nudge message may be located in the left area of ​​the image.

[0120] Meanwhile, although the illustration described displays such nudge messages within the video, in implementation, they may be output as voice or displayed on a user terminal device. Additionally, the aforementioned operations may be performed in combination. That is, they may be displayed in both the video and as voice, or the voice and display operations on the terminal device may be performed simultaneously.

[0121] Meanwhile, the processor (130) may display the aforementioned nudge message for a certain period of time. For example, if a new person appears on the screen and a nudge message is displayed indicating that information about the new person is available, but the new person has now disappeared, there is no need to display the nudge message. In addition, since continuously displaying the nudge message for tens of seconds or minutes can interfere with the user's viewing of the video, the processor (130) may maintain the display of the aforementioned nudge message only for a preset time or under specific conditions.

[0122] The processor (130) generates a third image containing object information when a preset event occurs. For example, the processor (130) can generate a third image containing object information within the current screen when a preset event occurs. Here, the preset event may be a user command requesting information about objects within the currently displayed image. Such a user command may be a specific button on an operating device such as a remote control, a voice command, or a user selection regarding the nudge message described above.

[0123] At this time, the processor (130) generates a third image containing at least one object information. For example, if the number of object information obtained in the current frame is equal to or greater than the number of object information stored, the processor (130) may generate a second image using only the object information obtained in the current frame.

[0124] At this time, the processor (130) can divide at least one object information into multiple items and display each item corresponding to a tab selected by the user. For example, the processor (130) can display multiple tab items, and when the user selects a specific tab, it can display object information corresponding to the selected tab.

[0125] For example, the aforementioned tabs may be divided into a content tab, an actor tab, a character tab, etc. When a user selects the content tab, information about other content related to the current video may be displayed, and when the actor tab is selected, object information about the names, information, and works of the actors appearing in the current content may be displayed.

[0126] And when the Character tab is selected, information such as footage of the actor appearing in the current video at different time points or key footage can be displayed. Additionally, when the Music tab is selected, information such as OST details regarding background music corresponding to the current video can be displayed. These tabs can be distinguished by the choice of the manufacturer or content provider, and can be applied in various ways, not just the examples described above. By using these tabs, it is possible to systematically provide various object information within a limited display space.

[0127] Meanwhile, the processor (130) can generate content corresponding to the object information selected by the user. For example, if the user selects performer A based on the displayed object information, the processor (130) can generate content about the person by using time information corresponding to the person, extracting and merging videos within the time information within the content, or providing information about key scenes output by the person.

[0128] For example, if a user requests past scenes of the current batter while watching a baseball game, the processor (130) can check all the segments where the batter appeared and generate a video by combining those segments.

[0129] As described above, when an environment is created in which object information can be acquired and provided to a user, the electronic device according to the present disclosure informs the user that object information can be provided, thereby allowing the user to naturally experience or use the new functions of the electronic device.

[0130] Meanwhile, although only a simple configuration constituting the electronic device (100) has been illustrated and described above, various additional configurations may be provided during implementation. This will be explained below with reference to FIG. 3.

[0131] FIG. 3 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0132] Referring to FIG. 3, the electronic device (100') may include a communication unit (110), memory (120), processor (130), input / output interface (140), microphone (150), display (160), and speaker (170).

[0133] The configuration of the communication unit (110), memory (120), and processor (130) was previously described in FIG. 2, and only the operation different from FIG. 2 will be described below.

[0134] The input / output interface (140) may be any one of the following interfaces: HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), and DVI (Digital Visual Interface).

[0135] The input / output interface (140) can input and output at least one of audio and video signals. Depending on the implementation example, the input / output interface (140) may include separate ports for inputting and outputting only audio signals and for inputting and outputting only video signals, or it may be implemented as a single port for inputting and outputting both audio and video signals.

[0136] And the input / output interface (140) can provide a video signal corresponding to an image (or screen) generated by the electronic device (100') or an audio signal together with the video signal to an external device (e.g., a display device, an STB, etc.).

[0137] The microphone (150) can receive the user's voice when active. For example, the microphone (150) may be formed integrally on the upper side, front side, or side side of the electronic device (100'). The microphone (150) may include various configurations such as a microphone for collecting analog user voice, an amplifier circuit for amplifying the collected user voice, an A / D conversion circuit for sampling the amplified user voice and converting it into a digital signal, and a filter circuit for removing noise components from the converted digital signal.

[0138] When a user's voice is input through such a microphone (150), the processor (130) can check the content of the user's voice and perform an action corresponding to the content of the voice. For example, the content of the voice may be a request for information about a person output in the content or a request for information about a person currently appearing on the screen.

[0139] That is, the voice request may be a request for object information, and when the processor (130) receives a user voice command requesting such object information, it may display a third image containing object information immediately without the process of displaying a nudge message.

[0140] Meanwhile, if the user's voice message is related to a specific category among the object information, the processor (130) can identify the category corresponding to the user's voice command among the multiple object information and display the object information corresponding to the identified category.

[0141] Meanwhile, although it has been described above that user voice is input through the microphone (150), the microphone may be provided in a remote control for controlling the electronic device (100'), and user voice input through the microphone provided in the remote control may be input to the electronic device (100') and processed through the communication unit (110) described above.

[0142] The electronic device (100') can operate not only based on the configuration or remote control provided in the electronic device (100'), but also according to control commands from a user terminal device. For example, if the electronic device is a TV or a set-top box, recently, manufacturers provide applications for controlling the TV or set-top box. Such applications can provide a function that allows the user terminal device to be used as a remote control for the electronic device.

[0143] Accordingly, when a user executes an application to control a TV or set-top box using a user terminal device and inputs a voice command through the user terminal device, the electronic device (100') can perform a voice recognition operation and a corresponding voice recognition result using the voice signal input through the user terminal device.

[0144] In addition, in the present disclosure, the nudge message described above may be displayed on the screen of a user terminal device rather than on the screen of an electronic device.

[0145] The display (160) can be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, and a PDP (Plasma Display Panel). The display (160) may also include a driving circuit, a backlight unit, etc., which can be implemented in forms such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, and an OTFT (organic TFT). Meanwhile, the display (160) can be implemented as a touchscreen combined with a touch sensor, a flexible display, a 3D display, etc.

[0146] The display (160) can display various images. For example, the display (160) can display a first image, a second image, or a third image generated by the processor (130).

[0147] The speaker (170) can output sound. Specifically, the speaker (170) may be a component that outputs various audio data processed at the input / output interface, as well as various notification sounds or voice messages. Additionally, the speaker (170) may output result information (e.g., person information) corresponding to the voice recognition operation described later.

[0148] Additionally, the speaker (170) can output a voice corresponding to the nudge message. At this time, the processor (130) checks the timing of dialogue related to the content and outputs the nudge message described above in a blank section where such dialogue does not appear.

[0149] Meanwhile, although the electronic device (100) in FIG. 3 is illustrated and described as including a display (160), if the electronic device (100') is a device such as a set-top box that does not include a display, the display configuration may be omitted. Also, depending on the implementation form, the speaker and microphone described above may also be omitted. Additionally, although not illustrated in FIG. 3, other components (e.g., camera, human body detection sensor) may be further included.

[0150] FIG. 4 is a drawing for explaining the display operation of a nudge message according to one embodiment of the present disclosure.

[0151] Referring to FIG. 4, an image corresponding to content selected by the user can be generated (410). In this case, the electronic device can continuously obtain object information corresponding to an object included in the image while generating an image corresponding to content selected by the user.

[0152] For example, the electronic device (420) can check the content, check if there is recommended content related to the content, and obtain information about object recognition and the recognized object within the screen. That is, the electronic device (420) can obtain object information corresponding to the current content and the current screen.

[0153] When implementing, various information can be obtained, such as object information related to the content, actor information related to the current screen, as well as audio information corresponding to audio information and location information related to the screen.

[0154] In this way, if various information is obtained or if it is determined that there is something the user is interested in, a second image (430) having a nudge message can be generated and displayed.

[0155] In this way, when a request for the display of additional information is made based on a nudge message, the electronic device (100) may generate a third image (440) containing additional information. Such display of additional information may be displayed based on the display of the nudge message, or the third image may be displayed based on the user's selection of a specific button or a voice command. That is, a third image displaying object information may be displayed when the nudge message is not displayed. Examples of the third image will be described later in FIGS. 5 and 6.

[0156] In addition, the aforementioned nudge message may not only be displayed on the screen of an electronic device, but may also be output as a voice message or displayed on the screen of a user terminal device. Examples of such cases will be described later in FIGS. 9 and 10.

[0157] Meanwhile, although the above description illustrates and explains that the nudge information is provided when there is sufficient object information regarding the current content or when object information corresponding to a specific category is obtained, in implementation, nudge messages may be displayed in various cases (or environments) in addition to the cases described above.

[0158] For example, if the currently playing video is a live broadcast but there is insufficient object information about it, a suggestion can be made to move to another live broadcast with sufficient object information. Alternatively, if a user is watching a video with low viewership or interest, other videos with high interest can be recommended.

[0159] In addition, when breaking news occurs or new content corresponding to a user's pre-set area of ​​interest becomes available, a nudge message recommending viewing such content may be displayed. Furthermore, if the user's viewing status can be obtained, the aforementioned nudge message may also be displayed even if it is determined through the user's viewing posture that the user's interest in the current content has decreased.

[0160] FIG. 5 is a drawing illustrating an example of a user interface window displaying object information according to an embodiment of the present disclosure. For example, FIG. 5 is a drawing illustrating an example of a screen that can be displayed on an electronic device when a command requesting additional information is entered during video viewing.

[0161] Referring to FIG. 5, the user interface window (500) may include a content area (510) and an additional information area (540).

[0162] For example, while watching a video of content, a user may become curious about other videos similar to that content. Accordingly, if the user inputs a command requesting additional information, the electronic device may display a third video containing information related to the current content as described above.

[0163] For example, as described above, the area of ​​additional information may be composed of multiple tabs. For example, the first tab (520) is a tab related to content, and the second tab (530) is a tab related to output actors.

[0164] If the first tab is selected by default, or if the user's request for additional information is related to the content itself, the object information corresponding to the first tab among the multiple object information may be listed and displayed in the object information area.

[0165] In the illustrated example, an example was shown in which the content area (510) and the additional information area (540) are displayed together, but in implementation, it is also possible to display only the additional information.

[0166] FIG. 6 is a drawing illustrating an example of a user interface window displaying object information according to an embodiment of the present disclosure. For example, FIG. 6 is a drawing illustrating an example of a screen that can be displayed on an electronic device when a command requesting actor information is entered during video viewing.

[0167] Referring to FIG. 6, the user interface window (600) may include a content area (610) and an additional information area (640).

[0168] For example, while watching a video of content, a user may become curious about the people appearing in the content. Accordingly, if the user inputs a command requesting information about the performers (e.g., voice or specific button input), the electronic device may display a third video including an additional information area (640) that displays object information about the main person of the current content as illustrated.

[0169] For example, as described above, the area of ​​additional information may be composed of multiple tabs. For example, the first tab (620) is a tab related to content, and the second tab (630) is a tab related to output actors.

[0170] Accordingly, if the second tab (630) is selected by default or if the user directly requests actor information, the object information corresponding to the second tab among the multiple object information can be listed and displayed in the object information area.

[0171] In the illustrated example, an example was shown in which the content area (610) and the additional information area (640) are displayed together, but in implementation, it is possible to display only the additional information. Also, in the illustrated example, the faces of the actors for the content are displayed together, but in implementation, only the names may be displayed, or various information about a specific person (e.g., the person currently appearing on the screen) that the user is expected to be most curious about may be displayed.

[0172] FIG. 7 is a drawing illustrating an example of a user interface window displaying object information according to one embodiment of the present disclosure.

[0173] Referring to FIG. 7, the user interface window (700) may include a content area (710), an additional information area (720), and time information (730).

[0174] The content area (710) is an area where a video corresponding to the content currently being played is displayed.

[0175] The additional information area (720) is an area that displays information about a person selected by the user from the preceding list or a person displayed on the current screen. For example, as illustrated, information about other works in which the actor who played the character appeared may be displayed. Alternatively, other interview videos, etc., may be displayed in addition to the aforementioned other works.

[0176] If the user selects another displayed work or content, the electronic device may acquire and display a website or content corresponding to the work or content selected by the user.

[0177] Time information (730) can display the time period in which the person appears. Users can select from the item to view other areas in the content where the actor appears. Meanwhile, in the illustrated example, the time information was displayed in a form that visually displays the area corresponding to the location where the person appears in the area (or timeline) corresponding to the content, but in implementation, it is possible to display it simply in a list form, or to display highlights (or key scenes) by section in a thumbnail form.

[0178] In addition, when implementing, it is also possible for the electronic device (100) to use the corresponding time information to create content corresponding to the actor by combining only the area that the actor outputs.

[0179] Meanwhile, although Fig. 7 illustrates and explains that only text information, such as appearance information, is provided for a specific person, it is also possible to use the preceding time information to extract only the video footage of the segment where the person selected by the user or the currently displayed person appears, and to create new content for that person and provide it to the user.

[0180] Although an example of providing actor information as supplementary information has been illustrated above, in implementation, information regarding various matters, in addition to the aforementioned information on people and actors, can be provided to the user. This will be explained below with reference to FIG. 8.

[0181] FIG. 8 is a drawing illustrating an example of a user interface window displaying object information according to an embodiment of the present disclosure. For example, FIG. 8 is a drawing illustrating an example of providing music information as object information.

[0182] Referring to FIG. 8, the user interface window (800) may include a content area (810) and an additional information area (820).

[0183] For example, when watching a musical movie, a music broadcast, etc., the user may be curious about the music included in the current content. Accordingly, if the user inputs a command requesting object information, the electronic device may display a third image containing information about the sound source (or song) being output for the current content, as illustrated.

[0184] When additional information related to music is obtained, that is, when additional information belonging to this category is obtained, a nudge message such as "Aren't you curious about the music playing now?" can be displayed on the screen.

[0185] Meanwhile, although additional information related to music has been described above, when implementing, information about the location currently displayed on the screen may be provided as object information, or information about the product displayed on the screen (e.g., a home shopping screen) may be provided as object information.

[0186] Meanwhile, although the above description assumed that the nudge message is displayed on the screen, it can be notified to the user in various ways during implementation. This will be explained below with reference to FIGS. 9 and 10.

[0187] FIG. 9 is a drawing illustrating an example of providing nudge information according to one embodiment of the present disclosure.

[0188] Referring to FIG. 9, the electronic device (100) can display an image corresponding to the content. For example, assume a case where object information for a first person is acquired, a new person appears on the screen, and additional object information for the new person is acquired.

[0189] When a new person is added in this way, users may be curious about information regarding the new person. In this environment, electronic devices can provide information about the new person through a nudge message.

[0190] Meanwhile, although the illustrated example describes and explains the use of object information such as person information regarding a new person, in implementation, a nudge message may be displayed when a new place appears, when new music appears, or when a specific product (e.g., a PPL product) appears.

[0191] However, as illustrated in FIG. 9, in cases where it is difficult to output a message because an actor or character occupies a large area of ​​the screen, the electronic device can output nudge information as sound rather than on the screen.

[0192] However, if a nudge message is displayed during a section where a specific actor's lines are spoken, it may interfere with the user's viewing of the video. Therefore, the electronic device can analyze the audio to identify sections where no lines are spoken and output a nudge voice during sections where no lines are spoken.

[0193] FIG. 10 is a drawing illustrating an example of providing nudge information according to one embodiment of the present disclosure.

[0194] Referring to FIG. 10, the electronic device (100) can display an image corresponding to the content. For example, assume a case where object information for a first person is acquired, a new person appears on the screen, and additional object information for the new person is acquired.

[0195] When a new person is added in this way, users may be curious about information regarding the new person. In this environment, electronic devices can provide information about the new person through a nudge message.

[0196] However, as illustrated in FIG. 9, when an actor or character occupies a large area of ​​the screen, making it difficult to output as a message, or when dialogue is continuously produced as in FIG. 9, making it difficult to provide guidance by voice, the electronic device can transmit information to display nudge information to the user terminal device.

[0197] For example, a recent electronic device can communicate with a user terminal device (10), and not only receive control commands related to the operation of the electronic device from the user terminal device, but also display status information of the electronic device, etc. on the user terminal device.

[0198] In this way, if the electronic device and the user terminal device are wirelessly connected, the electronic device (100) can display a nudge message on the user terminal device (10). That is, the electronic device (100) can transmit information corresponding to the nudge message to the user terminal device (10). In response, the user terminal device (10) can display the nudge message.

[0199] Meanwhile, although the above-described nudge message is shown as being displayed on a user terminal device separate from the electronic device, if the electronic device is equipped with multiple displays, the nudge message may also be displayed on a second display that does not display the first image. Here, the second display may be referred to as an auxiliary display, etc.

[0200] As such, it is provided that there is additional information available for users to check in various ways, allowing users to easily access diverse information.

[0201] FIG. 11 is a flowchart illustrating the control operation of an electronic device according to one embodiment of the present disclosure.

[0202] Referring to FIG. 11, a first image corresponding to content is generated (1110). For example, when a playback command for specific content is received from a user, the content can be acquired and a first image corresponding thereto can be generated. Meanwhile, when the control operation according to the present disclosure is operated on an electronic device having a display, the generated first image can be displayed.

[0203] Then, object information corresponding to the content is obtained (1120). For example, person information included in the content can be obtained by using at least one of the video information and audio information corresponding to the content. Such data may include person information for each person included in the content and time information within the content where foreign objects appear.

[0204] Specifically, video corresponding to the content is captured at a preset interval, and it is possible to check whether a person included in the captured image is a previously recognized person. If the person included in the image is a previously recognized person, time information corresponding to the currently captured video can be added to the previously recognized person. If the person is not a previously recognized person, a new person can be added to the corresponding database.

[0205] Verification of whether the individual is the same person can be performed by comparing the face image of a previously registered person with the face image of the currently captured foreign object, or through OCR of the subtitles within the video. Meanwhile, if the name of the person is obtained through this process, the name of the person in the corresponding database can be updated.

[0206] Meanwhile, if multiple individuals are identified in a single image, the recognition operation described above can be performed for individuals larger than a preset size based on the size of the individuals' faces. At this time, the electronic device (100) can check the display time of the individuals in the image and perform the recognition operation described above only when they are displayed for a certain period of time or longer.

[0207] Furthermore, audio information is used to perform functions corresponding to speech recognition, and name-related information (e.g., role name, actor name, role title, role nickname, etc.) can be obtained based on the results of the performed functions. Additionally, by combining these speech recognition results and video analysis results, the displayed person at the time of current capture and the name of that person can be obtained.

[0208] By carrying out this process chronologically, the database for the content can be continuously updated.

[0209] Meanwhile, although the above description illustrates that the electronic device directly analyzes the image to obtain object information, in implementation, information that can identify the current content and information on the playback time of the current content are provided to the server, and identification information can be obtained in response.

[0210] Meanwhile, during implementation, information that can identify content is provided, and object information within the content and time information of each object can also be obtained.

[0211] Then, when object information is acquired, a second image is generated that includes a message indicating that the object information is available. For example, if, after acquiring first object information, second object information for a new object is acquired, or object information exceeding a preset number is acquired, or object information corresponding to a preset category is acquired, a second image including a message can be generated.

[0212] At this time, the nudge message can be positioned so as not to overlap with at least one main object in the first image. Additionally, the nudge message can generate a second image in which the message is located in an area corresponding to the location where object information is to be displayed among a plurality of areas in the first image.

[0213] Subsequently, when a user selects a nudge message or requests the provision of object information, a third image containing object information may be generated. Here, the third image may include a first area where a first image corresponding to the content is located and a tab area where at least one of the object information is displayed.

[0214] In addition, regarding the tab area, person information related to the person appearing in the content among the object information is displayed in the tab area when the first tab among the multiple tabs is selected, and actor information related to the character within the content among the object information can be displayed in the tab area when the second tab among the multiple tabs is selected.

[0215] Meanwhile, although the illustrated example describes an example where an electronic device directly creates and uses a database, in implementation, when a user selects content, it is possible to search for whether a person database corresponding to that content exists, and if the person database is found, to acquire and use the found database.

[0216] As described above, the control method according to the present disclosure, at a point where various object information regarding content currently being played can be acquired and provided to the user, notifies the user that the object information is available for use, so that the user can receive not only the content but also various information.

[0217] Meanwhile, methods according to at least some of the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.

[0218] In addition, methods according to at least some of the various embodiments of the present disclosure described above may be implemented by software upgrades or hardware upgrades alone for existing electronic devices.

[0219] In addition, methods according to at least some of the various embodiments of the present disclosure described above may also be performed through an embedded server equipped in an electronic device, or through at least one external server among the electronic devices.

[0220] Meanwhile, according to one embodiment of the present disclosure, the various embodiments described above may be implemented as software containing instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include an electronic device (e.g., electronic device (A)) according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions. When instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory storage medium" simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily on the storage medium. For example, a 'non-transient storage medium' may include a buffer in which data is temporarily stored. According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TMIt can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., terminal devices). For online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0221] Various embodiments of the present disclosure may be implemented as software comprising instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include an electronic device (e.g., an electronic device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions.

[0222] When the above-described instruction is executed by a processor, the processor may perform the function corresponding to the above-described instruction directly or by using other components under the control of the above-described processor. The instruction may include code generated or executed by a compiler or an interpreter.

[0223] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.

Claims

1. In an electronic device, Communications Department; Memory for storing at least one instruction; and It includes one or more processors that execute at least one of the above instructions; The above one or more processors, A first image corresponding to the content obtained through the above communication unit is generated, and Obtain object information corresponding to the above content, and An electronic device that generates a second image including a message indicating that the object information can be provided when the object information is acquired.

2. In Paragraph 1, The above one or more processors, An electronic device that generates a second image including the message when acquiring second object information for a new object after acquiring first object information.

3. In Paragraph 1, The above one or more processors, An electronic device that generates a second image including the message when acquiring object information of a preset number or more, or acquiring object information corresponding to a preset category.

4. In Paragraph 3, The above-mentioned pre-set categories are, An electronic device comprising at least one corresponding category among music information corresponding to the above content and location information corresponding to the above content.

5. In Paragraph 1, The above one or more processors, An electronic device that generates a second image by arranging the above message so as not to overlap with at least one main object in the first image.

6. In Paragraph 5, The above one or more processors, When a preset event occurs, a third image including the object information is generated, and An electronic device that generates a second image in which the message is located in an area corresponding to the position where the object information is to be displayed among a plurality of areas within the first image.

7. In Paragraph 6, The third image above is, It includes a first area where a first image corresponding to the above content is located and a tab area where at least one of the object information is displayed, The above tab area is, Among the object information above, person information related to a person appearing in the content above is displayed in the tab area when the first tab among the plurality of tabs is selected, and An electronic device that displays actor information related to a character within the content among the above body information in the tab area when the second tab among the plurality of tabs is selected.

8. In Paragraph 1, The above one or more processors, An electronic device that acquires at least one object image in the first image and acquires object information based on the acquired object image.

9. In Paragraph 1, The above one or more processors, An electronic device that acquires object information corresponding to the first image and time information from an external device based on the time information of the first image.

10. In Paragraph 1, Includes more speakers, The above one or more processors, An electronic device that generates sound information corresponding to the above message and controls the speaker to output the generated sound information.

11. In Paragraph 10, The above one or more processors, An electronic device that acquires an audio signal corresponding to the above content, identifies a blank section based on the acquired audio signal, and controls the speaker to output the sound information to the identified blank section.

12. In Paragraph 1, A communication unit capable of communicating with a user terminal device; further comprising, The above one or more processors, An electronic device that controls the communication unit to transmit notification information corresponding to the above message to the user terminal device.

13. In Paragraph 1, The above object information is, An electronic device comprising at least one of the following: person information corresponding to a person output in the above content, product information, place information, and music information included in the above content.

14. In a method for controlling an electronic device, A step of generating a first video corresponding to the content; A step of obtaining object information corresponding to the above content; and A control method comprising the step of generating a second image including a message indicating that the object information can be provided when the object information is acquired.

15. A non-transient computer-readable recording medium storing a program for executing a method of controlling an electronic device, The above control method is, A step of generating a first video corresponding to the content; A step of obtaining object information corresponding to the above content; and A non-transient computer-readable recording medium comprising: a step of generating a second image including a message indicating that the object information is available when the object information is acquired.

Images