Electronic apparatus and control method thereof

Abstract

This electronic device comprises: a communication unit for receiving data corresponding to content; memory; and at least one processor. If a chat service related to content based on the received data exists, the at least one processor controls to output an image including text information related to the content and a highlight point identified on the basis of at least one of an image corresponding to the content or audio corresponding to the content.

Description

Electronic device and method of controlling the same

[0001] Embodiments of the present disclosure relate to an electronic device and a method for controlling the same, and more particularly, to an electronic device and a method for controlling the same for inducing chat participation based on image analysis and / or chat information.

[0002] Electronic devices perform operations such as generating and displaying images or providing images to a display device that displays the images. These electronic devices can display not only specific content selected by the user, as described above, but also various types of information.

[0003] Recent electronic devices offer chat services. These chat services allow users to converse, and more recently, they've been providing services that allow users watching the same content to share diverse opinions while watching.

[0004] However, many users are still unaware that their electronic devices provide these chat services, and in some cases, they are not even aware that chat services are available for the content they are currently watching.

[0005] An electronic device according to one embodiment of the present disclosure includes a communication unit that receives data corresponding to content, a memory, and, if a chat service related to the content corresponding to the data received through the communication unit exists, at least one processor that controls output of an image including a highlighted time point identified based on at least one of an image corresponding to the content and an audio corresponding to the content and text information related to the content.

[0006] The at least one processor may identify the highlight point based on whether the image includes an object of user interest, whether the audio includes a preset sound, and whether text information obtained through voice recognition of the audio includes a preset text.

[0007] The at least one processor can identify the highlight point by using at least one of conversation frequency and inclusion of a preset keyword based on conversation information corresponding to the chat service obtained through the communication unit.

[0008] The at least one processor may obtain the text information based on at least one of a keyword included in the obtained conversation information, the type of the content, the object of interest, and the text information.

[0009] The at least one processor may obtain additional information related to the content based on broadcast information related to the content obtained through the communication unit, and may determine whether an object of user interest is included in the image based on the obtained additional information.

[0010] The at least one processor may be controlled to output a UI corresponding to the chat service together with the image when a user input corresponding to selection of the text information or a user input corresponding to execution of the chat service is received.

[0011] The above UI may include conversation information of other users viewing the above content and additional information obtained from the server providing the chat service.

[0012] The above additional information may include at least one of a vote related to the content and information about an object included in the content.

[0013] The above text information may include text in the form of a question.

[0014] The electronic device further includes a display, and the at least one processor can control the display to output the text information together with the image acquired from the external device at the highlighted time point while the image acquired from the external device is being output to the display.

[0015] Meanwhile, in another embodiment of the present disclosure, a method for controlling an electronic device includes the steps of receiving data corresponding to content, and, if a chat service related to the content corresponding to the received data exists, outputting a video including a highlighted time point identified based on at least one of a video corresponding to the content and audio corresponding to the content and text information related to the content.

[0016] The control method may further include a step of identifying the highlight point based on whether the image includes an object of user interest, whether the audio includes a preset sound, and whether text information obtained through voice recognition of the audio includes a preset text.

[0017] The step of identifying the above-mentioned highlight point may identify the above-mentioned highlight point by using at least one of conversation frequency based on conversation information corresponding to the chat service and whether a preset keyword is included.

[0018] The present control method may further include a step of obtaining the text information based on at least one of a keyword included in the conversation information obtained from the chat service, the type of the content, the object of interest, and whether the text information is related to the conversation information.

[0019] The present control method may further include a step of obtaining additional information related to the content based on broadcast information related to the acquired content, and a step of confirming whether an object of user interest is included in the image based on the obtained additional information.

[0020] The present control method may further include a step of outputting a UI corresponding to the chat service together with the image when a user input corresponding to selection of the text information or a user input corresponding to execution of the chat service is received.

[0021] The above UI may include conversation information of other users viewing the above content and additional information obtained from the server providing the chat service.

[0022] The above additional information may include at least one of a vote related to the content and information about an object included in the content.

[0023] The above text information may include text in the form of a question.

[0024] In a non-transitory computer-readable recording medium storing a program for executing a control method of an electronic device according to an embodiment of the present disclosure, the control method includes the steps of receiving data corresponding to content, and, if a chat service related to the content corresponding to the received data exists, outputting an image including a highlighted time point identified based on at least one of a video corresponding to the content and an audio corresponding to the content and text information related to the content.

[0025] The above and other aspects, features, and advantages of the embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings. In the accompanying drawings:

[0026] FIG. 1 is a drawing for explaining an electronic system according to one embodiment of the present disclosure;

[0027] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure;

[0028] FIG. 3 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure;

[0029] FIG. 4 is a drawing for explaining the detailed operation of a processor according to one embodiment of the present disclosure;

[0030] FIG. 5 is a diagram illustrating an example of a user interface window that may be displayed on a display according to one embodiment of the present disclosure;

[0031] FIG. 6 is a drawing for explaining the display operation of nudge information according to an embodiment of the present disclosure;

[0032] FIG. 7 is a diagram illustrating an example of a user interface window that may be displayed on an electronic device according to one embodiment of the present disclosure;

[0033] FIG. 8 is a diagram illustrating an example of a user interface window that may be displayed on an electronic device according to one embodiment of the present disclosure;

[0034] FIG. 9 is a diagram illustrating an example of a user interface window that may be displayed on an electronic device according to one embodiment of the present disclosure;

[0035] FIG. 10 is a diagram illustrating an example of a user interface window that may be displayed on an electronic device according to one embodiment of the present disclosure;

[0036] FIG. 11 is a diagram illustrating an example of a user interface window that may be displayed on an electronic device according to one embodiment of the present disclosure;

[0037] FIG. 12 is a diagram illustrating an example of a user interface window that may be displayed on an electronic device according to one embodiment of the present disclosure;

[0038] FIG. 13 is a diagram illustrating an example of a user interface window that may be displayed on an electronic device according to one embodiment of the present disclosure;

[0039] FIG. 14 is a diagram illustrating an example of a conversation history according to an embodiment of the present disclosure;

[0040] FIG. 15 is a drawing for explaining an example of generating answer information according to one embodiment of the present disclosure;

[0041] FIG. 16 is a drawing for explaining an example of generating answer information according to one embodiment of the present disclosure;

[0042] FIG. 17 is a diagram for explaining an operation of determining the timing of nudge information based on conversation history according to one embodiment of the present disclosure;

[0043] FIG. 18 is a diagram illustrating examples of voting content generated based on screen information and keyword information according to one embodiment of the present disclosure;

[0044] FIG. 19 is a drawing for explaining the control operation of an electronic device according to an embodiment of the present disclosure, and

[0045] FIG. 20 is a drawing for explaining a control operation of a server according to one embodiment of the present disclosure.

[0046] The present embodiments may be modified and have various embodiments. Specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope to specific embodiments, but should be understood to encompass various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In connection with the description of the drawings, similar reference numerals may be used for similar components.

[0047] In describing the present disclosure, if it is determined that a specific description of a related known function or configuration may unnecessarily obscure the gist of the present disclosure, a detailed description thereof will be omitted.

[0048] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concepts of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to further faithfully and completely convey the technical concepts of the present disclosure to those skilled in the art.

[0049] The terminology used in this disclosure is for the purpose of describing specific embodiments only and is not intended to limit the scope of the rights. Singular expressions include plural expressions unless the context clearly dictates otherwise.

[0050] In this disclosure, expressions such as “has,” “can have,” “includes,” or “may include” indicate the presence of a corresponding feature (e.g., a component such as a number, function, operation, or part), and do not exclude the presence of additional features.

[0051] In this disclosure, expressions such as “A or B,” “at least one of A and / or B,” or “one or more of A or / and B” can include all possible combinations of the listed items. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” can all refer to instances where (1) at least one A is included, (2) at least one B is included, or (3) at least one A and at least one B are included.

[0052] The expressions “first,” “second,” “first,” or “second,” etc., used in this disclosure can describe various components, regardless of order and / or importance, and are only used to distinguish one component from another, but do not limit the components.

[0053] When it is said that a component (e.g., a first component) is “(operatively or communicatively) coupled with / to” or “connected to” another component (e.g., a second component), it should be understood that said component may be directly coupled to said other component, or may be coupled via another component (e.g., a third component).

[0054] On the other hand, when it is said that a component (e.g., a first component) is "directly connected" or "directly connected" to another component (e.g., a second component), it can be understood that no other component (e.g., a third component) exists between said component and said other component.

[0055] The expression "configured to" as used in the present disclosure may be used interchangeably with, for example, "suitable for," "having the capacity to," "designed to," "adapted to," "made to," or "capable of." The term "configured to" may not necessarily mean only "specifically designed to" in terms of hardware.

[0056] Instead, in some contexts, the phrase "a device configured to" may mean that the device, in conjunction with other devices or components, is "capable of" performing A, B, and C. For example, the phrase "a processor configured (or set) to perform A, B, and C" may refer to a dedicated processor (e.g., an embedded processor) for performing those operations, or a general-purpose processor (e.g., a CPU or application processor) that can perform those operations by executing one or more software programs stored in a memory device.

[0057] In the embodiments, a 'module' or 'part' performs at least one function or operation, and may be implemented as hardware or software, or as a combination of hardware and software. Furthermore, a plurality of 'modules' or 'parts' may be integrated into at least one module and implemented as at least one processor, except for a 'module' or 'part' that needs to be implemented as a specific hardware.

[0058] According to various embodiments, operations performed by a module, program or other component may be executed sequentially, in parallel, iteratively or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0059] Meanwhile, the various elements and areas in the drawings are schematically drawn. Therefore, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0060] Meanwhile, an electronic device according to various embodiments of the present disclosure may include, for example, at least one of a smartphone, a tablet PC, a desktop PC, a laptop PC, or a wearable device. The wearable device may include at least one of an accessory type (e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, contact lenses, or a head-mounted device (HMD)), a fabric or clothing-integrated type (e.g., an electronic garment), a body-attached type (e.g., a skin pad or tattoo), or a bio-implantable circuit.

[0061] In some embodiments, the electronic device may include at least one of, for example, a television, a digital video disk (DVD) player, an audio device, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave oven, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a media box (e.g., Samsung HomeSync™, Apple TV™, or Google TV™), a game console (e.g., Xbox™, PlayStation™), an electronic dictionary, an electronic key, a camcorder, or an electronic picture frame. Meanwhile, among the above-described electronic devices, a device having a display may be referred to as a display device. Meanwhile, the electronic device of the present disclosure may be a set-top box or a PC that provides images to a display device even if it does not have a display.

[0062] Hereinafter, with reference to the attached drawings, embodiments according to the present disclosure will be described in detail so that a person having ordinary knowledge in the technical field to which the present disclosure pertains can easily implement the present disclosure.

[0063] FIG. 1 is a drawing for explaining an electronic system according to one embodiment of the present disclosure.

[0064] The electronic system (1000) may include a server (100). The server (100) may be a device that provides a chat service. For example, the server (100) may provide a chat service corresponding to content. Here, the content may be related to various types of video, such as broadcast content or VOD content.

[0065] And the chat service is a service that allows conversations or information exchanges between various users. Users can input conversation content through various input methods (e.g., keyboard, keypad, voice recognition), and the conversation content can be displayed in other users' chat windows.

[0066] The specific configuration and operation of the server (100) are described later in FIG. 2.

[0067] The electronic device (200) may be a device that outputs content or provides an image corresponding to the content to an external device. For example, the electronic device (200) may be a TV, laptop, smartphone, tablet PC, etc. that includes a display, or a set-top box, PC, etc. that does not include a display. For ease of explanation, the following description assumes that the electronic device (200) includes a display to display an image. However, as described above, the electronic device (200) may also generate an image and transmit it to an external device without including a display.

[0068] In addition, the electronic device (200) may display a window corresponding to a chat service related to the content when providing the content. Furthermore, while displaying a video corresponding to the content, the electronic device (200) may display a notification message indicating that a chat service corresponding to the content exists and requesting participation in the chat service. Such a notification message may be referred to as a nudge message, etc. In this case, the electronic device (200) may not simply indicate the existence of a chat service, but may also display information (e.g., nudge information) that stimulates the user's curiosity. An example of this will be described later in FIG. 4.

[0069] And for the specific configuration and operation of the electronic device (200), refer to FIG. 3.

[0070] Meanwhile, in illustrating and explaining FIG. 1, the server (100) and the plurality of electronic devices are illustrated as being directly connected to each other, but when implemented, the server (100) and the electronic devices (201, 202, 203) may be connected via other devices such as a router and an access point.

[0071] Meanwhile, in illustrating and explaining FIG. 1, the electronic device (200) is illustrated as including a display to directly display an image or display a screen corresponding to a chat service, but the electronic device (200) may not directly display an image or chat window, but may also generate and provide an image to another electronic device.

[0072] FIG. 2 is a block diagram illustrating a server (100) according to one embodiment of the present disclosure.

[0073] Referring to FIG. 2, the server (100) may include at least one of a memory (110), a processor (120), and a communication unit (130).

[0074] The processor (120) can perform the overall control operation of the server (100). The processor (120) has the function of controlling the overall operation of the server (100).

[0075] The processor (120) can obtain broadcast schedule information and store it in memory (110), and provide a chat service for content based on the broadcast schedule information.

[0076] The processor (120) can obtain broadcast schedule information. The broadcast schedule information may include information related to the content schedule. The broadcast schedule information may include content schedules in various units. The units may include at least one of monthly, weekly, daily, and one-time provision units. The one-time provision unit may be a unit used to indicate a schedule that is provided only once, such as for disaster broadcasts.

[0077] Broadcast schedule information may be schedule information related to content provided in each time zone.

[0078] The broadcast schedule information may be generated from an external server (not shown). The external server (not shown) may analyze various broadcast schedules and generate broadcast schedule information to be provided to the server (100).

[0079] The processor (120) can store the acquired broadcast schedule information in the memory (110).

[0080] The processor (120) can obtain multiple broadcast schedule information. Each broadcast schedule information may include schedule information related to a single content providing device. Since multiple content providing devices may exist in a single region, there is a need to analyze schedules for various content providing devices. The processor (120) can obtain multiple broadcast schedule information to analyze content provided by various content providing devices.

[0081] The processor (120) can select content for providing a chat service based on multiple broadcast schedule information. While it is possible to provide a chat service corresponding to all broadcast schedules during implementation, it is also possible to generate content for providing a chat service based on user settings (e.g., conditions such as a specific time zone or a program with a viewership rating above a preset level).

[0082] Once the content for which a chat service will be provided is determined, the processor (120) can determine the execution time of the chat service corresponding to the content. For example, the processor can determine that the execution time is the same as the time information corresponding to the broadcast schedule, or that the execution time is a certain amount of time earlier or a certain amount of time later than the time information.

[0083] The server (100) may further include a communication unit (130). The processor (120) may generate access address information corresponding to a chat service based on a target time, and transmit the access address information corresponding to the chat service to an electronic device through the communication unit (130).

[0084] The connection address information may include information required to access the chat service. The connection address information may include at least one of an Internet address, a network address, and a security code.

[0085] The processor (120) can transmit a first screen related to a chat service to a terminal device through a communication unit (130), and when a user input is received from an electronic device, update the first screen to a second screen based on the user input, and transmit the updated second screen to the electronic device through the communication unit (130).

[0086] The chat service can be provided to various electronic devices. The server (100) can provide the chat service to each of the various electronic devices (201, 202, 203). The processor (120) can provide information related to the chat service to terminal devices with different communication connection methods.

[0087] For example, the first communication interface may be a communication interface that processes RF signals, and the second communication interface may be a communication interface that processes Internet network signals. The processor (120) may provide chat services to different electronic devices using different communication connection methods.

[0088] The action of providing a chat service may include the action of providing a screen related to a chat room.

[0089] The processor (120) can determine whether the server (100) needs to intervene and generate corresponding questions or additional content. For example, the processor (120) can determine whether user participation in the chat window is low, whether multiple users are participating but the level of conversation participation is low, whether a chat service has been abandoned, or whether a dispute has occurred between multiple users. Furthermore, the processor (120) can generate questions corresponding to the aforementioned situations or generate additional information and reflect it in the chat window.

[0090] Here, additional content can vary, including voting content related to the content and information content about objects included in the content. Examples of this are described in Figures 11 through 13.

[0091] The above-described operations are described as being performed by the server (100) representing the server. According to various embodiments, the above-described operations may be performed by the electronic device (200) itself. Conversely, the operations of the electronic device (200) of FIG. 1 may also be performed by the server (100). Specifically, the operations of identifying a highlight point and displaying text information at the highlighted point may be performed by the server.

[0092] FIG. 3 is a block diagram illustrating the configuration of an electronic device according to an embodiment of the present disclosure.

[0093] The electronic device (200) may include a memory (210), a processor (220), a communication unit (230), a display (240), an operation interface (250), an input / output interface (260), a speaker (270), and a microphone (280).

[0094] The memory (210) may be implemented as an internal memory such as a ROM (e.g., an electrically erasable programmable read-only memory (EEPROM)) or RAM included in the processor (220), or may be implemented as a separate memory from the processor (220). In this case, the memory (210) may be implemented as a memory embedded in the electronic device (200) or as a memory that can be detachably attached to the electronic device (200) depending on the purpose of data storage. For example, data for driving the electronic device (200) may be stored in a memory embedded in the electronic device (200), and data for expanding the functions of the electronic device (200) may be stored in a memory that can be detachably attached to the electronic device (200).

[0095] The memory (210) stores content. For example, the memory (210) can temporarily store content received through the communication unit (230) described below.

[0096] The memory (210) may store information related to a chat service associated with the content. Here, the information related to the chat service may include information on whether a chat service corresponding to the content exists, and if so, address information or time information providing the chat service.

[0097] The memory (210) can store history information (or conversation history) provided by the chat service while the chat service is being performed.

[0098] The memory (210) can store keywords of interest for the user. These keywords may include information about a specific object, a specific sport, or a specific person. For example, these keywords of interest can be used to determine whether the user is interested in a specific video.

[0099] The memory (210) can store layout information that constitutes the chat service. The layout information can store information regarding the size and location of each area where content is displayed, the area where chat content is displayed, and the area where chat input content is displayed. This layout can be initially set by the manufacturer, and the sizes and locations of the aforementioned windows may vary depending on the user's operation.

[0100] Accordingly, the layout form changed according to the user's preference is stored in the memory (210), and the chat service can be provided according to the layout form when providing the chat service.

[0101] Meanwhile, in the case of memory embedded in the electronic device (200), it may be implemented as at least one of volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), or synchronous dynamic RAM (SDRAM)), non-volatile memory (e.g., one time programmable ROM (OTPROM), programmable ROM (PROM), erasable and programmable ROM (EPROM), electrically erasable and programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD)), and in the case of memory that can be attached or detached to the electronic device (200), it may be implemented as a memory card (e.g., compact flash (CF), secure digital (SD), micro secure digital (Micro-SD), mini secure digital (Mini-SD), extreme digital (xD), multi-media card (MMC), etc.), external memory that can be connected to a USB port (e.g., USB memory), etc. there is.

[0102] Meanwhile, in the illustrated example, the electronic device (200) is depicted as being composed of one memory, but when referring to volatile memory and non-volatile memory separately, the electronic device (200) may be referred to as including multiple memories.

[0103] The communication unit (230) is a component that performs communication with various types of external devices according to various types of communication methods. The communication unit (230) may include a Wi-Fi module, a Bluetooth module, an infrared communication module, a wireless communication module, etc. Here, each communication module may be implemented in the form of at least one hardware chip.

[0104] Wi-Fi and Bluetooth modules can communicate via Wi-Fi and Bluetooth, respectively. When using a Wi-Fi or Bluetooth module, connection information, such as the SSID and session key, is first transmitted and received. This information is then used to establish a connection and then transmit and receive various information.

[0105] Infrared communication modules perform communication based on infrared communication (IrDA, infrared Data Association) technology, which transmits data wirelessly over short distances using infrared light, which lies between visible light and millimeter waves.

[0106] In addition to the above-described communication method, the wireless communication module may include at least one communication chip that performs communication according to various wireless communication standards such as zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), 5G (5th Generation), etc.

[0107] In addition, the communication unit (230) may include at least one of wired communication modules that perform communication using a LAN (Local Area Network) module, an Ethernet module, a pair cable, a coaxial cable, an optical fiber cable, or a UWB (Ultra Wide-Band) module.

[0108] For example, the communication unit (230) may use the same communication module (e.g., a Wi-Fi module) to communicate with an external device such as a remote control and an external server.

[0109] In another example, the communication unit (230) may utilize different communication modules (e.g., a Wi-Fi module) to communicate with external devices such as a remote control and an external server. For example, the communication unit (230) may utilize at least one of an Ethernet module or a Wi-Fi module to communicate with an external server, and may utilize a BT module to communicate with an external device such as a remote control. However, this is merely an example, and the communication unit (230) may utilize at least one of various communication modules when communicating with multiple external devices or external servers. Meanwhile, the user may input a voice command or select a specific icon (or object) on the displayed display through the above-described remote control. For example, the above-described remote control may also perform a function similar to a mouse.

[0110] The communication unit (230) can receive content. This content may be broadcast content provided by a broadcaster, real-time content such as streaming content, or VOD content provided by a VOD server. Furthermore, the content may be diverse, including content that includes video, content that displays images while providing music, and game content.

[0111] The communication unit (230) can receive information about a chat service. Here, the information about the chat service may include information about whether a chat service corresponding to the content exists, and if a chat service exists, its access address.

[0112] And the communication unit (230) can receive service information. For example, the communication unit (230) can include chat-related information (e.g., conversation information, additional information) provided by the chat server (100). Here, the conversation information includes various texts, emoticons, content, etc. entered by users in the chat window, and the additional information includes content generated by the server (100), and can include, for example, voting content related to the content, information about objects included in the content, or information related to the content.

[0113] The display (240) may be implemented as a variety of displays, such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, a PDP (Plasma Display Panel), etc. The display (240) may also include a driving circuit, a backlight unit, etc., which may be implemented as a-si TFT, LTPS (low temperature poly silicon) TFT, OTFT (organic TFT), etc. Meanwhile, the display (240) may be implemented as a touch screen combined with a touch sensor, a flexible display, a 3D display, etc.

[0114] The display (240) can display various images. For example, the display (240) can display an image generated by the processor (220). Such an image may be an image corresponding to the content, an image including text information indicating the presence of a chat service along with the image, or an image in which the image and the chat service are displayed together. Various examples of screens that can be displayed on the display (240) will be described below with reference to FIGS. 5, 7, and 13.

[0115] The input / output interface (260) may be any one of HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), and DVI (Digital Visual Interface).

[0116] The input / output interface (260) can input / output at least one of audio and video signals. Depending on the implementation example, the input / output interface (260) may include separate ports for inputting / outputting only audio signals and ports for inputting / outputting only video signals, or may be implemented as a single port for inputting / outputting both audio signals and video signals.

[0117] And the input / output interface (260) can provide a video signal corresponding to the screen generated by the electronic device (200) or an audio signal together with the video signal to an external device (e.g., a display device, STB, etc.).

[0118] The speaker (270) can output sound. Specifically, the speaker (270) may be a component that outputs various audio data processed by the input / output interface, as well as various notification sounds or voice messages. In addition, the speaker (270) may also output result information corresponding to the voice recognition operation described below.

[0119] The microphone (280) can receive the user's voice when activated. For example, the microphone (280) can be formed integrally on the upper side, front side, side side, etc. of the electronic device (200). The microphone (280) can include various components such as a microphone that collects the user's voice in analog form, an amplifier circuit that amplifies the collected user's voice, an A / D conversion circuit that samples the amplified user's voice and converts it into a digital signal, and a filter circuit that removes noise components from the converted digital signal.

[0120] When a user's voice is input through the microphone (280), the processor (220) can confirm the user's voice content and perform an operation corresponding to the voice content. Meanwhile, although the user's voice is input through the microphone (280) as described above, the microphone may be provided in a remote control for controlling the electronic device (200), and the user's voice input through the microphone provided in the remote control may be input and processed through the communication unit (230) described above.

[0121] In addition, the electronic device (200) may operate not only based on the configuration or remote control provided in the electronic device (200), but also according to control commands from a user terminal device. For example, if the electronic device is a TV or a set-top box, manufacturers have recently been providing applications for controlling the TV or set-top box. Such applications may provide a function that allows the user terminal device to be used as a remote control for the electronic device.

[0122] Meanwhile, when a user's voice is received through the above-described microphone (280) or user terminal device or remote control through the chat service, the processor (220) can perform voice recognition on the received voice data and display the voice recognition result in the chat service's conversation window.

[0123] The processor (220) can perform overall control operations of the electronic device (200). Specifically, the processor (220) has a function of controlling the overall operations of the electronic device (200).

[0124] The processor (220) may be implemented as a digital signal processor (DSP), a microprocessor, or a time controller (TCON) that processes digital signals. However, the present invention is not limited thereto, and may include one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics-processing unit (GPU), a communication processor (CP), or an ARM processor, or may be defined by the relevant terminology.

[0125] In addition, the processor (220) may be implemented as a SoC (System on Chip), an LSI (Large Scale Integration) with a built-in processing algorithm, or may be implemented in the form of an FPGA (Field Programmable Gate Array). In addition, the processor (220) may perform various functions by executing computer executable instructions stored in a memory. Meanwhile, although FIG. 2 illustrates that the electronic device (200) includes only one processor, it may include multiple processors (e.g., CPU + GPU, CPU + DSP) during implementation.

[0126] The processor (220) can control the display (240) to display an image. For example, when a user's control command is input, the processor (220) can generate an image for content corresponding to the input control command and control the display (240) to display the generated image.

[0127] When a user inputs a channel change command, the processor (220) can generate an image using a broadcast signal corresponding to the channel corresponding to the input channel command, and control the display (240) to display the generated image. At this time, the processor (220) can perform processing on not only the image but also an audio signal, and control the speaker (270) to output a corresponding sound.

[0128] At this time, the processor (220) can check whether a chat service corresponding to the image (or content) being displayed exists. For example, the processor (220) can access the server (100) and check whether a chat service corresponding to the content exists. Meanwhile, during implementation, the processor (220) can periodically receive chat service schedule information from the server (100) and use the received schedule information to check whether a chat service corresponding to the current content exists.

[0129] If there is a chat service corresponding to the currently displayed video, the processor (220) can indicate that there is a chat service related to the content.

[0130] While this display behavior may be performed when the presence of a chat service is confirmed, the processor (220) may also perform the display described above at a specific point in time. For example, if a user searches for content of interest while switching between channels, frequent display of the availability of a chat service may cause inconvenience to the user. In this regard, the processor (220) may display the presence of a chat service corresponding to a specific content if the user continues to view the content for a preset period of time.

[0131] Additionally, if the electronic device (200) only indicates the presence of a chat service, the user may have a low willingness to participate in the chat service. Furthermore, the user may find chat service requests for content of which he or she has no particular interest uncomfortable.

[0132] Accordingly, the electronic device (200) according to the present disclosure may, when a chat service is present, display a video of content likely to be of interest to the user, or display a message (or alarm) containing text that may pique the user's interest, rather than immediately indicating the presence of the chat service. This message may be text information containing text in the form of a question. In this respect, the text information may also be referred to as nudge information or nudge notification.

[0133] If a chat service related to content based on the received data exists, the processor (220) can control to output a video including a highlighted time point identified based on at least one of a video corresponding to the content and an audio corresponding to the content and text information related to the content.

[0134] If a chat service exists, the processor (220) can identify a highlight point using at least one of the video and audio data corresponding to the content. For example, the processor (220) can identify a highlight point based on whether the video includes an object of user interest, whether the audio data includes a preset sound, and whether the text information, which is a result of voice recognition for the audio data, includes a preset text. Details regarding such operations will be described later with reference to FIGS. 4 to 6.

[0135] Meanwhile, the processor (220) controls the communication device to obtain conversation information corresponding to the chat service, and may also check the highlight point using at least one of the conversation frequency using the obtained conversation information and whether a preset keyword is included.

[0136] The processor (220) then generates text information related to the content and highlight point. For example, the processor (220) may generate text information based on at least one of a keyword, content type, object of interest, and text information included in the acquired conversation information. For example, when utilizing an object of interest, the processor (220) may acquire additional information related to the content based on broadcast information related to the content acquired through the communication unit, and may determine whether the user's object of interest is included in the video based on the acquired additional information. Such operations will be described later with reference to FIG. 5.

[0137] And the processor (220) can control the display (240) to display text information generated at the identified highlight point on the image. At this time, the text information may be text in the form of a question.

[0138] When a user selects text information displayed by the above-described display or inputs an execution command (e.g., a voice command) of a chat service, the processor (220) can control the display (240) so that a UI (or chat window) related to the chat service is displayed.

[0139] Here, the UI may include conversation information from other users viewing the content, as well as additional information obtained from the server providing the chat service. Additional information may include votes related to the content, information about objects included in the content, and more.

[0140] The processor (220) can display content and chat windows together using layout information stored in the memory (210).

[0141] And the processor (220) can control the display (240) to output text information together with the image acquired from the external device at a highlighted point in time while the image acquired from the external device is being output to the display (240).

[0142] Meanwhile, although FIG. 3 illustrates and describes the electronic device (200) as including a display, if the electronic device (200) is a device such as a set-top box that does not include a display, the display configuration may be omitted. Furthermore, depending on the implementation form, the speakers and microphone described above may also be omitted. Furthermore, although not illustrated in FIG. 3, other components (e.g., a camera, a human body detection sensor), etc., may be further included.

[0143] FIG. 4 is a drawing for explaining detailed operations of a processor according to one embodiment of the present disclosure.

[0144] Referring to FIG. 4, the electronic device (300) can receive content and determine whether it is an event time based on the video / audio of the received content and conversation information of the chat service.

[0145] The electronic device (300) can identify specific objects (e.g., in the case of a sports event, the athlete's face, jersey number, or score) within the currently displayed image through screen analysis of the input image (305). For example, the electronic device (300) can obtain information related to the current content through the server (10) and perform the aforementioned image analysis using the obtained information. In the case of a sports event, the obtained information may be information (name, jersey number, etc.) of the athletes participating in the sport, and in the case of a drama or movie, the names of characters or actors appearing in the work.

[0146] Alternatively, the electronic device (300) may detect specific dynamic changes in addition to static object recognition. For example, in a baseball game, the electronic device (300) may detect actions such as a batter's swing or hit, or in a basketball game, a three-point shot, a scoring situation, a blocking situation, etc., or in a soccer game, a shooting motion, a goal motion, a foul motion, etc. The above description assumes a sports situation, but in the case of content such as a movie or drama, the electronic device (300) may also detect situations such as the occurrence of an accident or a shooting scene.

[0147] And the electronic device (300) can use the audio data of the content to check whether a sound event preset in the audio data exists (310). For example, it can detect sounds such as a percussion sound, applause, or cheering sound.

[0148] In addition, the electronic device (300) includes the user's voice in the audio data of the content, and can identify the sentence (320), intention (325), etc. of the voice through voice recognition (315) for the voice.

[0149] Additionally, the electronic device (300) can determine whether an event has occurred based on the update speed of text or the occurrence of a specific keyword within a chat window based on conversation information within the chat service (340).

[0150] Based on the conversation history of such a chat service, question and answer generation actions corresponding to the event can be performed simultaneously (350, 360). Details on utilizing the conversation history are described below with reference to Figures 14 through 18.

[0151] The electronic device (300) can determine whether an event has occurred by synthesizing information confirmed in various ways as described above (370).

[0152] Here, the event occurrence situations can be diverse. For example, if the current user is not using the chat service but the chat service can be induced, or if the conversation in the current chat window is interrupted while the chat service is running, or if an argument occurs between users participating in the chat window, or if participants leave the chat room, etc. can be determined as the above-described event occurrence situations. Meanwhile, the above-described situations are examples, and other situations may be additionally utilized, and the operations in each situation are described below with reference to FIG. 6.

[0153] Meanwhile, an example of a notification message displayed in a situation where the user has not entered the chat service but is highly likely to participate in the above-described situation is described with reference to FIG. 5.

[0154] FIG. 5 is a diagram illustrating an example of a user interface window that may be displayed on a display according to one embodiment of the present disclosure.

[0155] Referring to Figure 5, the user interface window (500) displays an image corresponding to the content, along with text information (510). This text information is generated through analysis of the content of the current image and, as illustrated, has a question-like format. In this respect, the aforementioned text information may be referred to as nudge information or nudge notifications.

[0156] Additionally, the user interface window (500) may display an icon (or image, e.g., a speech bubble, an arrow, etc.) indicating that chatting is possible along with the aforementioned text information. Furthermore, the aforementioned text information and icon may be displayed in a bold or color that distinguishes them from the current image, thereby highlighting them so that the user can select the text information, etc.

[0157] Meanwhile, the provision of the aforementioned nudge during implementation may take into account the user's preferences. For example, if a user has a history of registering (or setting) a specific player (or a specific team, or a specific sport) as a preference and the user's favorite player is currently displayed on the screen, the user may determine that it is a highlight moment and display the aforementioned text information. Furthermore, the aforementioned highlight moment may be a variety of moments other than when the user's preferred preference is displayed. Furthermore, the user's preferences may be stored on a per-electronic device basis, and may be stored on a per-user (or per-user account) basis. For example, if a specific user account A has registered player B and is currently using the electronic device under user account A, the aforementioned action may be performed when player B is displayed in the video.

[0158] Meanwhile, the highlight point for displaying the text information described above in FIG. 5 is described as being performed through analysis of an image input from the electronic device (200), etc. However, the highlight point described above may be identified not only by the electronic device (200), but also by an external device (i.e., the server (100)) or by using data used by the external device (i.e., chat window information).

[0159] For example, the server may perform image and / or audio analysis as described above, notify the electronic device (200) that it is a highlight point, and the electronic device (200) may display the text information described above at the notified highlight point. In addition, during implementation, the text information described above may also be generated on the server (100) side.

[0160] Meanwhile, a highlight point here can refer not only to a specific point in time, but also to a certain period of time (e.g., 1-2 seconds, or a situation that persists) before and after that point. For example, a highlight point can refer not only to the moment a player of interest enters the batter's box, but also to the entire time the player remains in the batter's box. Furthermore, a highlight period can refer not only to the moment a specific batter hits a base, but also to a certain period of time after the hit, such as the batter's baserunning. In this sense, what is referred to as a "highlight point" can also be referred to as a "highlight period."

[0161] In this way, the present disclosure not only provides information that a chat service is available, but also increases the likelihood of user participation by informing users that participation in the chat service is possible using text that can arouse their curiosity.

[0162] FIG. 6 is a diagram for explaining a display operation of nudge information according to an embodiment of the present disclosure.

[0163] Referring to Figure 6, the display situations of nudge information can be divided into the following four situations.

[0164] First, if there are no participants or conversations in the chat room.

[0165] Second, if there was a conversation between participants in the chat room but it was interrupted.

[0166] Third, if an argument arises between participants during the chat

[0167] Fourth, if participants leave the chat room during the match.

[0168] Meanwhile, although the present disclosure is divided into four situations, the situation may be divided into fewer cases than the above-described cases during implementation, or may be divided into five or more situations.

[0169] First, if there are no participants in the chat room, screen analysis can be performed to encourage participation (S615). For example, semantic segmentation can be used to extract human objects, extract and recognize letters and numbers from the human area, perform dynamic actions (e.g., "the batter steps up to bat"), and recognize team names and score status from the scoreboard.

[0170] Based on the results of the aforementioned screen analysis, it can be determined whether the current situation is a key scene situation (S620). For example, in sports content, this could be the predicted time for a specific player's performance, or in a movie, it could be a specific event situation, such as a shooting scene or a kissing scene.

[0171] In the case of a key scene situation, text information corresponding to the corresponding time point can be generated and displayed (S625). Meanwhile, while this operation is described and illustrated as being performed by the electronic device (200) in the above, when implemented, the server (100) may analyze the screen, key scene time points, etc., generate a question corresponding thereto, and provide the generated question to the electronic device (200), so that the electronic device (200) may only perform the display operation.

[0172] In a second scenario, the chat service can use analysis of the chat room's conversation history to generate questions that can encourage chat room participation (S930). For example, the chat room may be judged to have low participation by considering factors such as the trend in the number of remote control inputs, the type of sentence (interrogative, declarative, exclamation), and the frequency of interrogative sentences per unit time.

[0173] In the aforementioned scenario, you can preemptively suggest questions users might have within the recognized highlighted section of the content screen. For example, you can generate and display sentence-based questions that include evaluations of players, coaches, and teams. Alternatively, you can provide information related to voting content in the chat screen.

[0174] In the third scenario, chat conversation information can be analyzed to determine whether a dispute has occurred between users (S635). Questions corresponding to the dispute can then be generated and answers can be generated and displayed. For example, a prompt can be extracted to obtain accurate information by detecting a disputed part based on chat logs and generating a question (S640). When a certain number of user inputs (remote control inputs) are checked, the question can be asked to the AI ​​(chat gpt), and the answer can be shared with everyone in the chat room (S645).

[0175] In the fourth scenario, the electronic device (300) can provide entertainment elements (votes) on the chat screen to maintain the conversation in the chat window (S650). An example of this scenario is shown in FIG. 18.

[0176] FIGS. 7 to 13 are diagrams illustrating examples of user interface windows that may be displayed on an electronic device according to one embodiment of the present disclosure.

[0177] Referring to FIG. 7, the display screen (700) includes an area for displaying a video corresponding to the content the user was previously viewing, an area for displaying chat content (720), and an area for entering text in the chat window (730).

[0178] For example, the area (720) that displays chat content is an area that displays text or conversation content entered by not only the user of the current electronic device but also other users, and may display not only content entered by users but also question content generated by the server (100) or the electronic device (200).

[0179] In addition to the text described above, it is also possible to use the voice recognition result for voice data input by activating the voice input icon (710) located in the text input area as well as by the user directly inputting the text. Meanwhile, when the voice input icon (710) described above is activated and the user's voice is input, the input may be received not only by using the microphone included in the electronic device (100), but also through a device controlling the electronic device (100) (e.g., a remote control or a user terminal device).

[0180] In such an environment, the operation of recognizing a highlight section according to the present disclosure is described. For example, as illustrated, through screen analysis, the current score (711) and the batter's movements (714) can be recognized, and through voice data analysis, the hitting sound, the caster's guidance sound (712), etc., can be used to determine whether a highlight situation is present.

[0181] When such a highlighted situation is recognized, the electronic device (200, or server (100)) can generate text information corresponding to the highlighted situation. For example, in the situation described above, if users' chat participation is low, questions encouraging chat participation can be displayed in advance, as illustrated in FIG. 8, described below.

[0182] Referring to FIG. 8, FIG. 8 illustrates an example of displaying question information (722) to encourage chat participation when users' chat participation is low. The above-described question information may be generated and displayed directly on the electronic device (200), or may be generated on the server (100) and displayed in the chat window.

[0183] Specifically, in the past, users would first ask questions and then receive answers. However, this required users to understand the questioning method and the process. However, in this disclosure, users are asked questions in advance about topics they might be curious about, or about topics many people are curious about. This allows users to easily obtain the information they need from the question information displayed in the chat window by the chat system.

[0184] Referring to FIG. 9, an operation is described when a user inputs a question (740) by voice when question information is displayed as in FIG. 8.

[0185] As shown, a user can ask a question by voice by selecting a voice icon, and the electronic device (200) can confirm the question through voice recognition. In response to such a question, the electronic device (200) can display response information (725) to the user's question in the chat window, as shown in FIG. 10, described below.

[0186] Meanwhile, in the illustrated example, the answer to the above-described question is provided only in text, but when implemented, it may be provided as content such as video or audio.

[0187] Referring to FIG. 11, the user interface window may provide voting content (1130) along with conversation history (1120).

[0188] Items of such voting content can be generated through conversation history (1120), and as shown, if there are many complaints about a specific player, voting content reflecting that player can be generated.

[0189] Referring to FIGS. 12 and 13, the user interface window (1200) includes an area (1210) that displays an image corresponding to the content and an area (1220) that displays the conversation content.

[0190] When multiple users express different opinions on a specific situation, the server (100) can generate questions based on the conversations between the users and generate and display answers (1230) to the generated questions.

[0191] In this way, the chat system first asks questions and then provides answers to questions that many users are curious about in the chat window, allowing chat participants to obtain information with a minimal number of choices, thus improving user convenience.

[0192] Meanwhile, the occurrence of the aforementioned dispute can be determined by targeting the chat history for the entire chat section, utilizing chat history within a certain period of time, or performing the above-described action when a preset percentage of chats occurs within the entire chat section. More specific actions are described below with reference to FIGS. 14 through 18.

[0193] FIG. 14 is a diagram illustrating an example of another conversation information according to one embodiment of the present disclosure.

[0194] Referring to FIG. 14, an electronic device (200) or server (100) can store various texts (or speech contents) (1410) posted in a chat window as shown in FIG. 14, and store the characteristics (1420) of each text separately.

[0195] Here, the nature of the text can be distinguished as whether the user's utterance corresponding to the text is a question or not, and if the user's utterance is a question, it can be distinguished as to whether the question is about a specific object, a specific situation, or a specific point in time.

[0196] Such distinctions can be made using statistical or rule-based methods.

[0197] First, if you use statistical methods, you can segment your text as follows:

[0198] Text sentences can be converted into vector form through word embedding and used as input vectors for AI models. Accordingly, the output of the AI ​​model can be the aforementioned results for each text.

[0199] And when using rule-based systems, rules can be created using dictionaries containing entity names and keywords, as well as regular expressions. By determining whether an input sentence satisfies the conditions of the rule, the text type can be distinguished.

[0200] The operation of checking whether a dispute has occurred when a lookup table like that of Figure 14 is created through such classification is described below.

[0201] First, once the content and type of each text are confirmed, a debate point event can be generated if the number of times a question-type utterance occurs during a unit of time is greater than a random value.

[0202] Eventu occurs, if V > Threshold (V: number of times a question-type utterance occurs per unit time)

[0203] V = ΣWDA / T, during T,

[0204] WDA = 1 if DA [HOW, WHO, WHY, ASK, WHAT, WHEN]

[0205] WDA = 0 if DA [PLAIN]

[0206] When the above-described event occurs, the operation for generating a question corresponding to the above-described event and an answer thereto is described with reference to FIG. 15.

[0207] Referring to FIG. 15, questions with a preset number of abnormalities among the pre-saved conversation histories can be organized as in FIG. 15, and a lookup table such as text content (1510), question type (1520), and question object (1530) can be created.

[0208] For example, in order to generate the lookup table described above, the server (100) may use modules such as a classifier for judging a user request, an extractor for extracting an object name from the text, and a question generator for generating a final question by synthesizing the above-described information.

[0209] The operation of generating an answer using the above-described questions is as shown in Fig. 16.

[0210] FIG. 16 is a diagram illustrating an example of generating response information according to one embodiment of the present disclosure.

[0211] Referring to FIG. 16, based on the matters related to the question (1610, 1620, 1630), the corresponding response information (1640) can be generated using a natural language answer.

[0212] Matters related to the above-described question may correspond to the lookup table of Fig. 15. For example, UA (1610) is information about the question type, NE (1620) is an item about object information corresponding to the question, and query template (1630) is a question based on the above-described UA and NE.

[0213] An example of generating a response is as follows. After selecting a query template that meets the conditions of the detected UA and NE from the table below, additional information can be acquired from the NE or a separate search DB, and then a response for providing information can be generated.

[0214] The above description describes an operation that uses only the conversation within the chat window to identify the dispute situation and check the questions and answers accordingly. However, implementation can also utilize the screen context in addition to the conversation context to perform the above-described operation. This is described below with reference to Figure 17.

[0215] Referring to Figure 17, the chat room conversation history is analyzed (1710). For example, it is possible to determine whether a specific object (or person, object) is frequently mentioned in the chat room, and to determine whether a specific object appears in the video by analyzing the video (1720). This analysis can determine whether the video contains images corresponding to the specific object, whether the audio data contains keywords related to the specific object, and by synthesizing the aforementioned chat information and the analysis results from the video, it is possible to determine whether an event related to a specific user has occurred.

[0216] FIG. 18 is a diagram illustrating examples of voting content generated based on screen information and keyword information according to one embodiment of the present disclosure.

[0217] Referring to FIG. 18, examples according to the present disclosure illustrate examples of voting content that combine keywords in a chat window and screen recognition results. However, when implemented, voting content may be generated and displayed using only keywords in a chat window, or voting content may be generated using only screen recognition results.

[0218] As described above, the method according to the present disclosure can induce participation in a chat service by recognizing key sections of the viewing content, asking questions in advance about things the user may be curious about in that section, or providing various contents that encourage conversation depending on the situation of the chat window.

[0219] FIG. 19 is a drawing for explaining a control operation of an electronic device according to an embodiment of the present disclosure.

[0220] Referring to FIG. 19, an electronic device (200) receives content (S1910). Such content may be broadcast content, real-time streaming content, or VOD content.

[0221] The electronic device (200) generates and outputs an image corresponding to the content (S1920). For example, upon receiving content, the electronic device may generate and output an image and / or audio corresponding to the received content.

[0222] Meanwhile, if the electronic device performing the above-described operation includes a display, the generated image can be displayed through the display. If the electronic device performing the above-described operation is connected to another electronic device including a display, the generated image can be output to the other electronic device so that the image can be displayed on the other electronic device.

[0223] The electronic device (200) verifies the chat service associated with the generated video (S1930). For example, the electronic device may provide information about the generated content to the server or obtain chat service schedule information from the server to verify the existence of a chat service associated with the generated video.

[0224] If a chat service exists, a video can be output that includes highlighted time points identified based on at least one of a video corresponding to the content and an audio corresponding to the content and text information related to the content.

[0225] Specifically, if a chat service exists, a highlight point is identified using at least one of the video and audio data corresponding to the content (S1940). For example, a highlight point can be identified based on whether the video includes an object of user interest, whether the audio data includes a preset sound, and whether the text information resulting from voice recognition for the audio data includes a preset text.

[0226] Alternatively, conversation information corresponding to a chat service can be obtained, and a highlight point can be identified using at least one of the conversation frequency and the inclusion of a preset keyword using the obtained conversation information.

[0227] Alternatively, the broadcast information related to the content can be checked, additional information related to the content can be obtained based on the checked broadcast information, and the highlight point can be checked based on the obtained additional information to determine whether an object of user interest is included in the video.

[0228] Additionally, text information generated at the aforementioned highlight point can be displayed (S1950). For example, text information can be generated and displayed at the aforementioned highlight point based on at least one of the keywords, content type, object of interest, and text information contained in the acquired conversation information. This text information may include text in the form of a question.

[0229] Afterwards, when text information is selected or a chat service execution command is entered, a UI corresponding to the chat service can be displayed along with the video. The UI can include conversation information from other users viewing the content and additional information obtained from the server providing the chat service. Additional information can include votes related to the content, information about objects included in the content, etc.

[0230] FIG. 20 is a drawing for explaining a control operation of a server according to one embodiment of the present disclosure.

[0231] Referring to Figure 20, the server (100) can initiate a chat service corresponding to the content (S2010). For example, if the content is real-time, the chat service can be initiated in response to the broadcast time of the content.

[0232] The server (100) can determine whether service intervention is necessary by analyzing chat information within the chat service or chat content corresponding to the chat service (S020). For example, if the chat frequency within the chat window is low, users are leaving, or arguments arise between users, intervention may be determined to be necessary.

[0233] Meanwhile, if intervention is determined to be necessary, the server (100) can generate a question corresponding to the situation (2030), obtain answer information corresponding to the question, and display the answer information in a chat window (S2040). While this operation can be performed on a single device, it can also be implemented using multiple devices. Specifically, the above-described question can be generated by a first server, the above-described question can be provided to a second server to obtain answer information, and the obtained answer information can be displayed in a chat window.

[0234] Meanwhile, the methods according to at least some of the various embodiments of the present disclosure described above may be implemented in the form of an application that can be installed on an existing electronic device.

[0235] Additionally, the methods according to at least some of the various embodiments of the present disclosure described above can be implemented with only a software upgrade or a hardware upgrade for an existing electronic device.

[0236] Additionally, the methods according to at least some of the various embodiments of the present disclosure described above may also be performed through an embedded server provided in an electronic device, or an external server of at least one of the electronic devices.

[0237] Meanwhile, according to one embodiment of the present disclosure, the various embodiments described above can be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The machine is a device that can call instructions stored from the storage medium and operate according to the called instructions, and may include an electronic device (e.g., electronic device (A)) according to the disclosed embodiments. When an instruction is executed by a processor, the processor can perform a function corresponding to the instruction directly or by using other components under the control of the processor. The instruction may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the 'non-transitory storage medium' only means that it is a tangible device and does not include a signal (e.g., an electromagnetic wave), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is temporarily stored in the storage medium. No. For example, a 'non-transitory storage medium' may include a buffer in which data is temporarily stored. According to one embodiment, the method according to various embodiments disclosed in the present document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a commodity. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones).In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily created in a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0238] Various embodiments of the present disclosure may be implemented as software including instructions stored in a machine-readable storage medium that can be read by a machine (e.g., a computer). The device is a device that can call instructions stored in the storage medium and operate according to the called instructions, and may include an electronic device (e.g., a server (100)) according to the disclosed embodiments.

[0239] When the above-described instruction is executed by the processor, the processor may perform the function corresponding to the instruction directly or by utilizing other components under the control of the processor. The instruction may include code generated or executed by a compiler or interpreter.

[0240] Although the preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above, and various modifications may be made by a person having ordinary skill in the art to which the present disclosure pertains without departing from the gist of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical idea or prospect of the present disclosure.

Claims

1. In electronic devices, A communication unit that receives data corresponding to the content; memory; and An electronic device including at least one processor that controls output of a video including a highlighted time point identified based on at least one of a video corresponding to the content and an audio corresponding to the content and text information related to the content, if a chat service related to the content corresponding to the data received through the communication unit exists.

2. In paragraph 1, At least one processor of the above, An electronic device that identifies the highlight point based on whether the image includes an object of user interest, whether the audio includes a preset sound, and whether text information obtained by voice recognition for the audio includes a preset text.

3. In paragraph 2, At least one processor of the above, An electronic device that identifies the highlight point in time by using at least one of conversation frequency and inclusion of a preset keyword based on conversation information corresponding to the chat service obtained through the communication unit.

4. In paragraph 3, At least one processor of the above, An electronic device that obtains text information based on at least one of a keyword included in conversation information obtained from the chat service, a type of the content, an object of interest, and text information related to the conversation information.

5. In paragraph 4, At least one processor of the above, Obtaining additional information related to the content based on broadcast information related to the content based on the data received through the communication unit, An electronic device that determines whether an object of user interest is included in the image based on the acquired additional information.

6. In paragraph 1, At least one processor of the above, An electronic device that controls a UI corresponding to the chat service to be output together with the image when a user input corresponding to selection of the above text information or a user input corresponding to execution of the above chat service is received.

7. In paragraph 6, The above UI is, An electronic device that includes conversation information of other users viewing the above content and additional information obtained from a server providing the above chat service.

8. In paragraph 7, The above additional information is: An electronic device comprising at least one of a vote related to said content and information about an object included in said content.

9. Since there is a clause 1, The above text information is an electronic device including text in the form of a question.

10. In paragraph 1, display; including more; At least one processor of the above, An electronic device that controls the display so that, at the highlighted time point, the text information is output together with the image acquired from the external device while the image acquired from the external device is output to the display.

11. In a method for controlling an electronic device, A step of receiving data corresponding to the content; and A control method comprising: a step of outputting a video including a highlighted time point identified based on at least one of a video corresponding to the content and an audio corresponding to the content and text information related to the content, if a chat service related to the content corresponding to the received data exists; 12. In paragraph 11, The above control method is, Further comprising a step of identifying the highlight point based on whether the image includes an object of user interest, whether the audio includes a preset sound, and whether text information obtained by voice recognition for the audio includes a preset text; The step of identifying the above highlight point is: A control method for identifying the highlight point in time by using at least one of conversation frequency based on conversation information corresponding to the chat service and whether a preset keyword is included.

13. In paragraph 12, A control method further comprising: a step of obtaining text information based on at least one of a keyword included in conversation information obtained from the chat service, a type of the content, an object of interest, and text information related to the conversation information.

14. In paragraph 13, A step of obtaining additional information related to the content based on broadcast information related to the content obtained through the communication department; and A control method further comprising: a step of confirming whether an object of user interest is included in the image based on the acquired additional information; 15. In a non-transitory computer-readable recording medium storing a program for executing a method of controlling an electronic device, The above control method is, A step of receiving data corresponding to the content; and A computer-readable recording medium comprising: a step of outputting a video including a highlighted time point identified based on at least one of a video corresponding to the content and an audio corresponding to the content and text information related to the content, if a chat service related to the content corresponding to the received data exists;

Images