Electronic device and control method thereof

Abstract

An electronic device including a communication interface, a display, and a processor configured to obtain feature information of received content based on receiving the content from a source device through the communication interface, and transmit the obtained feature information to an external server, receive identification information of the content from the external server, the identification information being obtained based on the transmitted feature information, obtain information about a first time point when a predetermined mode of the display is turned on based on a signal received from the source device through the communication interface, and obtain information about a second time point when the predetermined mode is turned off after the first time point based on the predetermined mode of the display being turned off.

Description

[0001] Cross-references to related applications

[0002] This application is based on and claims priority to Korean Patent Application No. 10-2019-0144022, filed on November 12, 2019, with the Korean Intellectual Property Office, the entire disclosure of which is incorporated herein by reference. Technical Field

[0003] This disclosure relates to an electronic device and a method for controlling the same, which acquires information relating to content being displayed. Background Technology

[0004] In this field, various methods exist for obtaining information related to the content being displayed. However, these techniques are primarily applied to content where predetermined frames are displayed sequentially, such as movies or television series.

[0005] For example, by comparing several frames of the currently displayed content with frames stored in a database, a television can identify the title of the currently displayed TV series or movie.

[0006] However, unlike content that is displayed continuously in predetermined frames, it is difficult to specify game content by comparing it with frames stored in a database, because a wide variety of game images may be displayed depending on user actions. Summary of the Invention

[0007] An electronic device and its control method are provided, the electronic device identifying the title and playback time period of the content currently being displayed.

[0008] Additional aspects will be set forth in part in the description which follows, and will become apparent in part from the description itself, or may be learned by practice of the embodiments presented.

[0009] According to one aspect of this disclosure, an electronic device is provided, including a communication interface, a display, and a processor. The processor is configured to: obtain characteristic information of the received content based on content received from a source device via the communication interface, and send the obtained characteristic information to an external server; receive identification information of the content from the external server, the identification information being obtained based on the sent characteristic information; obtain information related to a first time point when the predetermined mode is activated based on a signal received from the source device via the communication interface to activate a predetermined mode; obtain information related to a second time point when the predetermined mode is deactivated after the first time point based on a predetermined mode when the display is deactivated; and obtain information related to the content displayed on the display based on the received identification information, the obtained information related to the first time point, and the obtained information related to the second time point.

[0010] The processor can also be configured to: identify the title of the displayed content based on identification information received from an external server; and identify the time period in which the title of the identified content is reproduced based on information obtained related to a first time point and information obtained related to a second time point.

[0011] The processor can also be configured to obtain content identification information based on feature information obtained between a first time point and a second time point from among multiple identification information received from an external server.

[0012] Signals received from the source device may include control information that allows the electronic device to turn a predetermined mode on or off based on the type of content received from the source device.

[0013] The scheduled mode can be Automatic Low Latency Mode (ALLM).

[0014] Control information can be provided from the source device to electronic devices that support a pre-defined or higher version of the HDMI standard.

[0015] Content-based types include game content, which can provide control information from the source device to the electronic device.

[0016] The feature information may include any one or any combination of video feature information and audio feature information, and the processor may also be configured to: capture an image of the currently viewed content from the content received from the source device at predetermined time intervals; obtain video feature information based on the pixel values ​​of the captured image; obtain frequency information of the acoustic information of the currently viewed content at predetermined time intervals; and obtain audio feature information based on the obtained frequency information.

[0017] If the number of identification information for the content obtained based on video feature information is greater than one, audio feature information can be used additionally to obtain the identification information corresponding to the currently viewed content from among the multiple identification information obtained.

[0018] The processor can also be configured to obtain video feature information from a predetermined number of the most recently captured images among the captured images.

[0019] According to one aspect of this disclosure, a method for controlling an electronic device is provided, the method comprising: obtaining feature information of received content based on content received from a source device, and sending the obtained feature information to an external server; receiving identification information of content from the external server, the identification information being obtained based on the sent feature information; obtaining information related to a first time point when the predetermined mode is turned on based on a predetermined mode of turning on a display according to a signal received from the source device; obtaining information related to a second time point when the predetermined mode is turned off after the first time point based on a predetermined mode of turning off the display; and obtaining information related to displayed content based on the received identification information, the obtained information related to the first time point, and the obtained information related to the second time point.

[0020] Obtaining content-related information may include: identifying the title of the displayed content based on identification information received from an external server; and identifying the reproduction time of the content whose title is identified based on information obtained related to a first time point and information obtained related to a second time point.

[0021] The method may further include: obtaining content identification information based on feature information obtained between a first time point and a second time point from multiple identification information received from an external server.

[0022] Signals received from the source device may include control information that allows the electronic device to turn a predetermined mode on or off based on the type of content received from the source device.

[0023] The scheduled mode can be Automatic Low Latency Mode (ALLM).

[0024] Control information can be provided from the source device to electronic devices that support a pre-defined or higher version of the HDMI standard.

[0025] Content-based types include game content, which can provide control information from the source device to the electronic device.

[0026] The feature information may include any one or any combination of video feature information and audio feature information, and obtaining the feature information may include: capturing an image of the currently viewed content from the content received from the source device at predetermined time intervals; obtaining video feature information based on the pixel values ​​of the captured image; obtaining frequency information of the acoustic information of the currently viewed content at predetermined time intervals; and obtaining audio feature information based on the obtained frequency information.

[0027] If the number of identification information for the content obtained based on video feature information is greater than one, audio feature information can be used additionally to obtain the identification information corresponding to the currently viewed content from among the multiple identification information obtained.

[0028] Obtaining video feature information may include obtaining video feature information from a predetermined number of the most recently captured images among the captured images.

[0029] According to one aspect of this disclosure, a non-transitory computer-readable storage medium is provided that stores instructions, which, when executed by at least one processor of an electronic device, cause the at least one processor to: identify whether a predetermined mode of a display of the electronic device is turned on based on a signal received from a source device; obtain a first time point when the predetermined mode of the display is turned on based on the identification that the predetermined mode of the display is turned on; obtain feature information from the received signal; send the obtained feature information to an external server; receive identification information of content corresponding to the sent feature information from the external server; obtain a second time point when the predetermined mode of the display is turned off based on the identification that the predetermined mode of the display is turned off after the first time point; and obtain information about the content displayed on the display from a portion of the received identification information, the portion corresponding to a time period from the obtained first time point to the obtained second time point.

[0030] The pre-order mode may include Automatic Low Latency Mode (ALLM), and the content information may include one or both of the title and type. Attached Figure Description

[0031] The above and other aspects, features, and advantages of some embodiments of this disclosure will become clearer from the following description taken in conjunction with the accompanying drawings, in which:

[0032] Figure 1 This is a view used to schematically illustrate the configuration of an electronic system according to an embodiment;

[0033] Figure 2 This is a block diagram illustrating the operation of an electronic device according to an embodiment;

[0034] Figure 3 This is a block diagram illustrating the configuration of an electronic device according to an embodiment;

[0035] Figure 4 This is a block diagram illustrating the operation between an electronic device and a server according to an embodiment;

[0036] Figure 5 This is a view used to illustrate the operation of differentiating content when reproducing the same video on multiple channels according to an embodiment;

[0037] Figure 6 This is a flowchart illustrating, according to an embodiment, the process of using audio feature information if not only video feature information is used to identify content;

[0038] Figure 7 This is a sequence diagram of the electronic device, source device, and server according to an embodiment;

[0039] Figure 8 This is a view used to illustrate identification information based on a time point when the feature information is obtained, according to an embodiment; and

[0040] Figure 9 This is a flowchart illustrating a method for controlling an electronic device according to an embodiment. Detailed Implementation

[0041] The present disclosure will be described in detail below with reference to the accompanying drawings.

[0042] After a brief explanation of the terminology used in the specification, this disclosure will be described in detail.

[0043] In consideration of the functions described herein, the terminology used in the embodiments of this disclosure has been selected as the most widely used and general terms possible. However, these terms may vary depending on the intent of those skilled in the art, precedents, the emergence of new technologies, etc. Additionally, in some cases, there may be terms arbitrarily chosen by the applicant; in such cases, their meanings will be described in detail in the description of this disclosure. Therefore, the terms used in this disclosure may be defined based on their meanings themselves and the overall content of this disclosure, rather than on their simple names.

[0044] The embodiments of this disclosure can be modified and include various embodiments, which will be illustrated in the accompanying drawings and described in detail in the specification. However, it is to be understood that this does not limit the scope of the embodiments and includes all modifications, equivalents, and / or alternatives within the spirit and technical scope of the disclosure. In describing this disclosure, detailed descriptions of prior art may be omitted where it is determined that such detailed descriptions might unnecessarily obscure the essential points of the disclosure.

[0045] Unless otherwise specifically defined, singular expressions may encompass plural expressions. It should be understood that terms such as “comprising” or “consisting of” are used herein to indicate the presence of a characteristic, quantity, step, operation, element, component, or combination thereof, without excluding the possibility of the presence or addition of one or more other characteristics, quantities, steps, operations, elements, components, or combinations thereof.

[0046] Expressions such as “A and / or B” can be understood as meaning any one of “A”, “B”, or “A and B”.

[0047] The expressions “first,” “second,” etc., used in this disclosure may denote various elements regardless of order and / or importance, and may be used to distinguish one element from another without limiting the elements.

[0048] If an element (e.g., a first element) is described as being "operationally or communicatively coupled" or "connected to" another element (e.g., a second element), it can be understood that the element can be connected to that other element directly or through yet another element (e.g., a third element).

[0049] Terms such as “module” or “unit” in this disclosure can perform at least one function or operation and can be implemented as hardware, software, or a combination of hardware and software. Furthermore, in addition to each of multiple “modules,” “units,” etc., being implemented in separate hardware, these components can be integrated into at least one module and implemented in at least one processor. In this disclosure, the term “user” can refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0050] In the following, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings, enabling those skilled in the art to readily implement and use the embodiments within the technical field of the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. Furthermore, in the accompanying drawings, components unrelated to the description may be omitted for clarity, and the same reference numerals are used for the same components throughout the specification.

[0051] In the following, embodiments of the present disclosure will be described in detail with reference to the accompanying drawings.

[0052] Figure 1 This is a view used to schematically illustrate the configuration of an electronic system according to an embodiment.

[0053] refer to Figure 1 An electronic system 1000 according to an embodiment of the present disclosure may include an electronic device 100, a source device 200, and a server 300.

[0054] Electronic device 100 may be a display device that receives image signals from source device 200 and displays content including the received image signals. For example, electronic device 100 may be implemented in various forms including displays, such as TVs, smart TVs, smartphones, tablet PCs, mobile phones, video phones, e-book readers, desktop PCs, laptop computers, netbook computers, PDAs, portable multimedia players (PMPs), MP3 players, medical devices, cameras, or wearable devices.

[0055] The source device 200 can be a device that transmits a source image and signals, including information about the source image, to the electronic device 100. For example, the source device 200 can be implemented in various forms, such as a game console (e.g., XBOX). TM PLAYSTATION TM Storage devices such as smartphones, tablet PCs, desktop PCs, laptop PCs, netbooks, wearable devices, set-top boxes, and USB drives.

[0056] Server 300 can be a device for storing and managing information about various types of content. For example, server 300 can generate and store feature information about the content. Feature information can refer to unique information used to distinguish corresponding content from other content, and can include, for example, video feature information generated based on video signals and audio feature information generated based on audio signals. This will be described in detail below.

[0057] If the electronic device 100 does not possess information related to the currently displayed content, it can obtain feature information related to the currently displayed content and send this feature information to the server 300. The server 300 can then identify the content currently displayed on the electronic device 100 by comparing the received feature information with information stored in the server 300, and send identification information to the electronic device 100. Additionally, the electronic device 100 can obtain reproduction time information of the currently displayed content based on information included in the signal received from the source device 200.

[0058] The following will describe in detail an embodiment of obtaining information relating to the content being reproduced by the electronic device 100 as described above.

[0059] Figure 2 This is a block diagram illustrating the operation of an electronic device according to an embodiment.

[0060] refer to Figure 2 The electronic device 100 may include a communication interface 110, a display 120, and a processor 130.

[0061] The communication interface 110 may include circuitry and is an element capable of communicating with the source device 200 and the server 300.

[0062] The communication interface 110 can communicate with the source device 200 and the server 300 using wired or wireless communication methods.

[0063] According to an embodiment, if the communication interface 110 communicates with an external device via a wired communication method, the communication interface 110 can be implemented as a port provided in the electronic device 100. The communication interface 110 can be implemented as an HDMI port for communication with the source device 200. In this case, the source device 200 may also include an HDMI port. Therefore, the electronic device 100 and the source device 200 can communicate with each other via each HDMI port and the High Definition Multimedia Interface (HDMI) cable connecting them. However, it is not limited to this; the communication interface 110 can also communicate with the source device 200 via a Low Voltage Differential Signaling (LVDS) cable, a Digital Vision Interface (DVI) cable, a D-SUB cable, a Video Graphics Array (VGA) cable, a V-by-One cable, or an optical fiber.

[0064] According to another embodiment, the communication interface 110 can communicate wirelessly with the source device 200 and the server 300. In this case, the communication interface 110 may include a Wi-Fi module, a Bluetooth module, an infrared (IR) module, a local area network (LAN) module, an Ethernet module, etc. Each communication module can be implemented as a hardware chip. In addition to the communication methods described above, the wireless communication module may include at least one communication chip that performs communication based on various wireless communication standards such as Zigbee, Universal Serial Bus (USB), Mobile Industry Processor Interface Camera Serial Interface (MIPI CSI), 3G, 3GPP, LTE, LTE-A, 4G, 5G, etc. However, this is one embodiment, and the communication interface 110 may use at least one of the various communication modules.

[0065] The communication interface for communicating with the source device 200 and the communication interface for communicating with the server 300 can be implemented as different interfaces. For example, communication interface 110 may include a first communication interface 110-1 for communicating with the source device 200 and a second communication interface 110-2 for communicating with the server 300. In this case, the first communication interface 110-1 can communicate with the source device 200 via wired communication, and the second communication interface 110-2 can communicate with the server 300 via wireless communication. The first communication interface 110-1 can be implemented as an HDMI port, but is not limited to this.

[0066] The first communication interface 110-1 can receive image signals from the source device 200. These image signals may include content and signals including information related to the content. The second communication interface 110-2 can send feature information of the content to the server 300 and receive identification information of the content obtained based on the feature information from the server 300. This will be described in detail below.

[0067] Display 120 is an element that displays content received from source device 200.

[0068] The display 120 can be implemented as various displays, such as liquid crystal display (LCD), organic light-emitting diode (OLED), liquid crystal on silicon (LCoS), digital light processing (DLP), quantum dot (QD) display panel, quantum dot light-emitting diode (QLED) and micro light-emitting diode (LED).

[0069] The display 120 can be implemented as a touchscreen type with a layered structure, including a touchpad. The touchscreen can be configured to detect touch input pressure in addition to the touch input location and area.

[0070] The processor 130 can be electrically connected to the memory and control the operation of the electronic device 100.

[0071] According to embodiments of this disclosure, processor 130 can receive content from source device 200 via communication interface 110. In some cases, electronic device 100 can receive content-related information (e.g., content title, type, playback time period) from source device 200, but this disclosure will be described by assuming that information related to the content currently being played or to be played is obtained, since clear information related to the content cannot be received from source device 200.

[0072] The processor 130 can obtain feature information of the content received from the source device 200 and send the feature information to the external server 300. The feature information can refer to unique information that allows corresponding content to be distinguished from other content, and the feature information can include any one or any combination of video feature information and audio feature information. Video feature information can be information extracted from a video signal excluding audio information, and can be video fingerprint information. Similarly, audio feature information can be information extracted from an audio signal, and can be audio fingerprint information.

[0073] Video fingerprint information can be a string of information generated based on the pixel values ​​of a frame included in a video signal. This string varies depending on the pixel value at the pixel location, so the same string can only be generated for the same frame. Therefore, a video fingerprint can be feature information capable of distinguishing one frame from another.

[0074] Audio fingerprint information can be a string of information generated based on audio frequency information included in a portion of an audio signal. Such a string varies depending on the frequency information; therefore, the same string can only be generated for the same acoustic signal. Thus, an audio fingerprint can be feature information that allows distinguishing one audio frequency portion from another.

[0075] The processor 130 can capture images of the currently viewed content from the content received from the source device 200 at predetermined time intervals. For example, the processor 130 can capture frames of the content displayed on the display 120 at 500ms intervals. The processor 130 can then obtain video feature information based on the pixel values ​​of the captured images.

[0076] For example, processor 130 can divide all pixels in a captured image (i.e., a captured frame) into blocks comprising n×m pixels. Then, processor 130 can calculate the pixel values ​​of some or all of the divided blocks. Processor 130 can generate a string corresponding to the calculated pixel values, and the generated string can be a video fingerprint. Processor 130 can obtain a video fingerprint, i.e., video feature information, using the method described above.

[0077] Processor 130 can obtain video feature information from a predetermined number of most recently captured images among a plurality of images captured at predetermined time intervals. For example, while obtaining video feature information from all the plurality of images captured at predetermined time intervals and sending it to server 300 can improve the recognition accuracy related to the content currently being reproduced on display 120, the processing load of processor 130 may unnecessarily increase. Therefore, by taking into account the real-time nature of the content currently being reproduced, video feature information can be obtained from a minimum number of images used for content recognition, and from the most recently captured images. For example, if the predetermined number is 3, processor 130 can obtain video feature information from only the three most recently captured images.

[0078] Additionally, the processor 130 can acquire the acoustic signal of the currently viewed content at predetermined time intervals. For example, the processor 130 can acquire frequency information of the acoustic signal of the content output through a speaker at 500ms intervals. Then, the processor 130 can acquire audio feature information based on the acquired frequency information. The processor 130 can analyze the waveform of the acquired frequency information and generate a string corresponding to the analyzed waveform. The string generated as described above can be an audio fingerprint. The processor 130 can acquire audio feature information as video feature information from the most recently acquired predetermined number of frequency information acquired at predetermined time intervals.

[0079] If the number of content identifiers obtained based on video feature information is greater than one, then the audio feature information is as follows, which can be additionally used to obtain the identifier information corresponding to the currently viewed content from among multiple identifier information. (See reference...) Figure 5 and Figure 6 This will be described in detail.

[0080] The processor 130 can send the feature information obtained in the above embodiment to the server 300.

[0081] In the example, the processor 130 may send the feature information to the server 300 at predetermined time intervals, and the interval of the predetermined time interval may be the same as the time interval when the feature information is obtained, but is not limited to this, and the feature information may be sent to the server 300 at a time interval different from the time interval when the feature information is obtained.

[0082] However, not limited to this, if a content recognition request is input from the user or a feature information sending request signal is received from the server 300, the processor 130 can send the obtained feature information to the server 300.

[0083] Then, server 300 can compare the feature information sent from electronic device 100 with feature information stored in server 300's database. For example, if electronic device 100 sends video fingerprint information corresponding to three frames included in a piece of content, server 300 can search the database for content including the three video fingerprints. In this example, server 300 can identify content including any one or any combination of the three video fingerprints as candidate content. In this case, if the identified candidate content is different from each other, server 300 can identify content with a larger number of video fingerprints matching these three video fingerprints as content corresponding to the video fingerprint information sent from electronic device 100. For example, if different movie content is divided into episode 1 and episode 2, the introductory images can be the same. Therefore, server 300 can identify content with a larger number of matching video fingerprints from among multiple identified candidate content as content corresponding to the feature information sent from electronic device 100. Thus, the accuracy of identifying content corresponding to the video fingerprint sent by electronic device 100 can be improved.

[0084] Furthermore, because server 300 may not store video fingerprints for all frames related to a given content, it may not be able to find content that matches all video fingerprints sent from electronic device 100. Therefore, server 300 can search for content that has only one fingerprint matching multiple video fingerprints sent from electronic device 100 and identify that content as candidate content. In subsequent processing, as described above, content with a large number of matching video fingerprints can be identified as content corresponding to the video fingerprint information sent from electronic device 100.

[0085] In other words, server 300 can identify highly similar content by comparing the feature information sent from electronic device 100 with information stored in a database. Server 300 can obtain information related to the identified content from the database and send the obtained content identification information to electronic device 100. The content identification information may include the content's title information, type information, year of production information, country of production information, personal information, etc.

[0086] The processor 130 can receive identification information of the content obtained based on feature information from the server 300.

[0087] The processor 130 can receive signals from the source device 200 via the communication interface 110. These signals can include both content and control information. The content can be a source image provided by the source device 200, and the control information can include instruction information for changing the settings of the display 120.

[0088] For example, the signal received from the source device 200 may include control information that allows the electronic device 100 to enable or disable a predetermined mode based on the type of content provided by the source device 200. If the content is game content, the predetermined mode may be an Automatic Low Latency Mode (ALLM). ALLM may be a mode that displays a relatively fast response to input on the display. Unlike content such as movies or TV shows, game content may require real-time user interaction. Therefore, it is necessary to quickly reflect the response to user interaction on the display 120, and thus, it is necessary to relatively reduce the response time to user input. Therefore, if the content sent to the electronic device 100 is identified as game content, the source device 200 may include control information for enabling ALLM in the signal sent to the electronic device 100.

[0089] Such control information can be provided to electronic device 100 that supports a predetermined or higher version of the HDMI standard. For example, control information can be provided to electronic device 100 that supports HDMI 2.0 or a higher version of the standard. In this case, electronic device 100 and source device 200 may include HDMI 2.0 ports. However, this is not the case, and if the version supported by electronic device 100 is lower than HDMI 2.0, ALLM may not be enabled in electronic device 100 even if control information is provided from source device 200.

[0090] In this context, HDMI 2.0 is the standard of choice for ultra-high resolution environments, also known as 4K or UHD (Ultra High Definition). HDMI 2.0 supports a maximum bandwidth of 18Gbps and can transmit images with smooth motion at 60Hz, with a maximum resolution of 4,096×2,160 (2160p).

[0091] The HDMI standard may include Vendor-Specific Data Blocks (VSDBs), and these VSDBs may include audio / video latency information, CEC physical address information, color bit information, and maximum transition minimized differential signaling (TMDS) frequency information. Here, color bit information can refer to color information, and the maximum transition minimized differential signaling (TMDS) frequency information can refer to resolution information.

[0092] If the type of content sent to electronic device 100 is identified as game content, source device 200 may include Automatic Low Latency Mode (ALLM) control information for adjusting the latency included in VSDB.

[0093] Each version of the HDMI port can be backward compatible. Therefore, a source device 200 with a higher standard can connect to an electronic device 100 with a lower standard, and vice versa. However, in this case, both devices can only use the features corresponding to the lower standard. In the example, even if the source device 200 supports HDMI 2.0, it can still use only the features of HDMI 1.4 if the electronic device 100 supports the HDMI 1.4 standard. Therefore, to enable ALLM on the electronic device 100, both the electronic device 100 and the source device 200 can be at least HDMI 2.0.

[0094] If a predetermined mode of the display 120 is activated based on a signal received from the source device 200, the processor 130 can obtain information related to a first point in time when the predetermined mode is activated. The processor 130 can store the information related to the first point in time when the predetermined mode is activated in its memory.

[0095] Additionally, the processor 130 can obtain information related to a second time point after the first time point when the predetermined mode is closed. The processor 130 can store the information about the second time point when the predetermined mode is closed in memory.

[0096] In the example, the information related to the first point in time when the pre-set mode is activated and the information related to the second point in time when the pre-set mode is deactivated can be the time information of the corresponding points in time. For example, the information related to the first point in time can be the time information of the first point in time, such as 16:30 on September 1, 2019. In another example, the information related to the first point in time can be the start time of a stopwatch used to measure a time period. In this case, the information related to the second point in time when the pre-set mode is deactivated can refer to the time period itself. For example, the first point in time can be the start time of the stopwatch, which is 0, and the second point in time can be the end time of the stopwatch, which is, for example, 2 hours and 30 minutes.

[0097] In the example, the predetermined mode can be turned off based on signals including control information for turning off the predetermined mode.

[0098] In another example, signals including control information for activating a predetermined mode can be periodically sent from the source device 200 to the electronic device 100 starting from a first time point, and the predetermined mode can be deactivated if the control information for activating the predetermined mode is no longer sent.

[0099] Therefore, the processor 130 can identify information related to a first point in time when the predetermined mode is activated and information related to a second point in time when the predetermined mode is deactivated. In other words, the processor 130 can identify the time period during which the predetermined mode is activated.

[0100] The processor 130 can obtain information related to the content displayed on the display 120 based on identification information, information related to a first time point, and information related to a second time point.

[0101] The content-related information here may include any one or any combination of the content’s title, type, or time period of reproduction.

[0102] The processor 130 can identify the title of the content displayed on the display 120 based on identification information. This identification information can be information obtained by the server 300 by comparing feature information received from the electronic device 100 with feature information stored in the server 300, or information sent by the server 300 to the electronic device 100. In addition to the title of the content, the processor 130 can also identify type information, year of manufacture information, country of manufacture information, personal information, etc., based on the identification information.

[0103] Furthermore, the processor 130 can identify the playback time period of the content identified based on information related to a first time point and information related to a second time point. The processor 130 can identify, based on identification information, that the identified content begins playback at the first time point and ends at the second time point. Therefore, the processor 130 can obtain total time information of the content played back during that period.

[0104] The processor 130 can obtain content identification information from multiple identification information received from the server 300 based on feature information obtained between the first and second time points. For example, if the feature information is obtained and sent to the server 300 before the first time point, and the identification information received from the server 300 is not used for content reproduced on the display 120 between the first and second time points, then the processor 130 can identify only the content reproduced between the first and second time points based on the feature information obtained between the first and second time points. (Refer to...) Figure 8 This will be described in detail.

[0105] The description describes how the processor 130 obtains feature information of the content currently being reproduced, but is not limited thereto. The processor 130 can obtain feature information of the content to be reproduced and receive related identification information from the server 300.

[0106] Figure 3 This is a block diagram illustrating the configuration of an electronic device according to an embodiment.

[0107] refer to Figure 3 The electronic device 100 may include a communication interface 110, a display 120, a processor 130, a memory 140, an audio output interface 150, and a user input interface 160. Further details regarding... Figure 2 The configurations shown overlap Figure 3 A detailed description of the components in the configuration shown.

[0108] Processor 130 can use various programs stored in memory 140 to control the operation of electronic device 100. Processor 130 may include a graphics processor 132 for image-corresponding graphics processing. Processor 130 may be implemented as a system-on-a-chip (SoC) including cores and a graphics processing unit (GPU) 132. Processor 130 may be a single-core processor, a dual-core processor, a triple-core processor, a quad-core processor, or other multi-core processor.

[0109] The processor 130 may include a main central processing unit (CPU) 131, a GPU 132, and a digital processing unit (NPU) 133.

[0110] The main CPU 131 can perform booting by accessing the memory 140 and using the O / S stored in the memory 140. The main CPU 131 can use various programs, contents, data, etc. stored in the memory 140 to perform various operations. According to an embodiment, the main CPU 131 can copy the program in the memory 140 to the RAM according to the instructions stored in the ROM and access the RAM to execute the corresponding program.

[0111] GPU 132 can correspond to a high-performance processor for graphics processing and can have dedicated electronic circuitry designed to rapidly process and modify memory to accelerate image generation in the frame buffer to be output to the screen. Alternatively, GPU 132 can refer to a Visual Processing Unit (VPU).

[0112] The NPU 133 can correspond to an AI chipset (or AI processor) and can be an AI accelerator. The NPU 133 can correspond to a processor chip optimized for deep neural networks. The NPU 133 can correspond to a processor that executes deep learning models instead of the GPU 132, and the NPU 133 can correspond to a processor that executes deep learning models together with the GPU 132.

[0113] The memory 140 may be electrically connected to the processor 130 and store data of the embodiment.

[0114] The memory 140 may be implemented as a memory embedded in the electronic device 100, or as a memory that can be removed from the electronic device 100 for data storage purposes. For example, data for operating the electronic device 100 may be stored in a memory embedded in the electronic device 100, and data for extended functions of the electronic device 100 may be stored in a memory that can be removed from the electronic device 100. The memory embedded in the electronic device 100 can be implemented as any one or any combination of the following: volatile memory (e.g., dynamic RAM (DRAM), static RAM (SRAM), synchronous dynamic RAM (SDRAM), etc.), and non-volatile memory (e.g., one-time programmable ROM (OTPROM), programmable ROM (PROM), erasable programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard disk drive or solid-state drive (SSD)). Memory removable from the electronic device 100 can be implemented as: memory cards (e.g., compact flash (CF), secure digital (SD), micro-secure digital (Micro-SD), mini-secure digital (Mini-SD), extreme digital (xD), multimedia card (MMC), etc.), external memory connectable to a USB port (e.g., USB memory), etc.

[0115] According to an embodiment, memory 140 may store feature information obtained by processor 130. Memory 140 may store any one or any combination of video fingerprints or audio fingerprints.

[0116] The memory 140 can store information related to a first time point and information related to a second time point. Additionally, the memory 140 can also store information related to the time point at which the feature information was obtained.

[0117] The audio output interface 150 can be a component for outputting an audio signal corresponding to the video signal. The audio output interface 150 can be implemented as a speaker, or it can be implemented as an external component of the electronic device 100, such as a soundbar.

[0118] User input interface 160 can be an element for receiving various user instructions and information. Processor 130 can execute functions corresponding to user instructions input through user input interface 160 and store information input through user input interface 160 in memory 140.

[0119] User input interface 160 may include a microphone for receiving user commands as voice, or may be implemented as a display 120 for receiving user commands via touch.

[0120] Additionally, the user input interface 160 can receive user commands or signals including operation-related information from a separate control device for controlling the electronic device 100.

[0121] Figure 4 This is a block diagram illustrating the operation between an electronic device and a server according to an embodiment.

[0122] The electronic device 100 may include a signal receiving module, a video fingerprint (VFP) acquisition module, an audio fingerprint (AFP) acquisition module, an HDMI information processing module, and a content information acquisition module. These modules may be stored in the memory 140 and loaded into the processor 130 for execution under the control of the processor 130.

[0123] The signal receiving module can receive image signals from the source device 200. The image signals may include content and control information related to that content. The signal receiving module can divide the image signals received from the source device 200 into video signals and audio signals. Then, the signal receiving module can send the video signals to the video fingerprinting module, the audio signals to the audio fingerprinting module, and the control information to the HDMI information processing module.

[0124] The video fingerprint acquisition module can obtain video fingerprints from the video signal at predetermined time intervals. The video fingerprint acquisition module can obtain a video fingerprint, including a string, based on the pixel values ​​included in the video signal. The obtained video fingerprint information can be sent to the content information acquisition module.

[0125] The audio fingerprint acquisition module can obtain audio fingerprints from an audio signal at predetermined time intervals. The audio fingerprint acquisition module can obtain an audio fingerprint, including a string, based on the frequency information of the acoustic signals included in the audio signal. The obtained audio fingerprint information can be sent to the content information acquisition module.

[0126] The HDMI information processing module can monitor whether ALLM is enabled in the electronic device 100 based on a predetermined or higher version of the HDMI standard and control information sent from the source device 200. The HDMI information processing module can send information related to the first point in time when ALLM is enabled to the content information acquisition module.

[0127] Additionally, the HDMI information processing module can monitor whether an active ALLM is turned off. The HDMI information processing module can then send information related to a second time point—when the ALLM is turned off after the first time point—to the content information acquisition module.

[0128] The content information acquisition module can store information related to a first time point and information related to a second time point sent from the HDMI information processing module in the memory 140, and identify that content of a predetermined type was reproduced between the first and second time points. In the example, the content information acquisition module can identify that game content was reproduced between the first and second time points.

[0129] The content information acquisition module can send the video fingerprint information and audio fingerprint information sent from the video fingerprint acquisition module and the audio fingerprint acquisition module to the server 300. In the example, the content information acquisition module can send any one or any combination of the most recently received video fingerprint information or audio fingerprint information to the server 300. However, it is not limited to this, and the content information acquisition module can send all video fingerprint information and audio fingerprint information sent from the video fingerprint acquisition module and the audio fingerprint acquisition module to the server 300.

[0130] The operation of the signal receiving module, the video fingerprint (VFP) acquisition module, the audio fingerprint (AFP) acquisition module, the HDMI information processing module, and the content information acquisition module can be executed by the processor 130, and the above modules can be collectively referred to as processor 130. Furthermore, the module names and types are examples, and these modules can be implemented as modules with various names and types.

[0131] Server 300 may include a matching module, an indexing module, a database, and an image input module.

[0132] Server 300 can identify the content reproduced by electronic device 100 based on any one or any combination of video fingerprints or audio fingerprints sent from electronic device 100.

[0133] The matching module can determine content that matches any one or any combination of video fingerprints or audio fingerprints sent from electronic device 100. For example, the matching module can identify content that matches any one or any combination of video fingerprints or audio fingerprints sent from electronic device 100 based on video fingerprint information and audio fingerprint information stored in a database. Matching can refer to a situation where a video fingerprint is the same as or similar to another video fingerprint, or a situation where an audio fingerprint is the same as or similar to another audio fingerprint.

[0134] The database can store any one or any combination of video fingerprints or audio fingerprints generated for at least one type of content. For example, the database can store video fingerprints or audio fingerprints of game content, or video fingerprints or audio fingerprints generated for a live broadcast service.

[0135] The indexing module can index each element in the video and audio. It can generate a video fingerprint based on the video signal from the image signal sent through the image input module, and an audio fingerprint based on the audio signal from the sent image signal. The generation of video and audio fingerprints can refer to the extraction of video and audio fingerprints, respectively.

[0136] The indexing module can index each of the generated video and audio fingerprints and store them in the database.

[0137] The image input module can receive content signals, including game content-related signals and broadcast service signals. The image input module can divide the received signals into video signals and audio signals. The image input module can then send the divided video and audio signals to the index module. The game content-related signals or broadcast service signals can be signals sent from the source device 200 or an external device.

[0138] In the case of live broadcasting, the live broadcast service signal can be sent to the image input module of the server 300 before the electronic device 100. Therefore, before the electronic device 100, video and audio fingerprints can be obtained from the image signal including the broadcast service signal and stored in a database. Thus, even if a content recognition request related to live broadcasting is received from the electronic device 100, the server 300 can identify the content corresponding to the live broadcast based on any one or any combination of the video or audio fingerprints stored in the database.

[0139] Figure 5 This is a view used to illustrate the operation of differentiating content when reproducing the same video on multiple channels according to an embodiment.

[0140] like Figure 5 As shown, it is assumed that the video content reproduced on multiple channels is the same. In this case, electronic device 100 can obtain video fingerprint information from channels 5, 7, and 11 and send them to server 300. Because the multiple video fingerprints sent from electronic device 100 are the same, server 300 can identify the content of the channels as a single content.

[0141] However, for example, suppose the content reproduced on channels 5, 7, and 11 is a football match. This content can be identified as distinct because the channel numbers, commentators, etc., of the reproduced content are different. Therefore, the following will refer to... Figure 6 An embodiment of using audio fingerprint information to more accurately identify content in this context is described in detail.

[0142] Figure 6This is a flowchart illustrating, according to an embodiment, the process of using audio feature information if not solely relying on video feature information to identify content.

[0143] Electronic device 100 can receive content-related identification information from server 300 (S610). It can be determined whether the number of identification messages received from server 300 is greater than one. That is, it can be identified whether multiple identical identification messages are received from server 300 (S620). If only one identification message is received from server 300 (S620 - No), electronic device 100 can identify that identification information related to content has been requested, and identify the content being reproduced as the corresponding identification message (S630).

[0144] If multiple identification messages are received from server 300 and these multiple identification messages are identical (S620 - Yes), then electronic device 100 can obtain audio fingerprint (AFP) information (S640). This is because audio fingerprint information can be used to distinguish multiple identification messages.

[0145] Electronic device 100 can send the acquired audio fingerprint information to server 300 (S650). For example, assuming the content reproduced on channels 5, 6, and 11 is a football match, the audio signals of channels 5, 6, and 11 may differ from each other because even if the video signals of channels 5, 6, and 11 are the same, the commentators may differ. Therefore, electronic device 100 can send the audio fingerprint information of each channel to server 300.

[0146] By comparing multiple audio fingerprints sent from electronic device 100 with information stored in each database, server 300 can obtain content identification information that is different from each other. For example, server 300 can obtain the broadcasting station, channel number, and personal information corresponding to each audio fingerprint and send them to electronic device 100.

[0147] Electronic device 100 can receive multiple different identification information from server 300 (S660) and identify the content (S670).

[0148] The description describes a scenario where electronic device 100 sends audio fingerprint information to server 300 after receiving identification information corresponding to video fingerprints. However, it is not limited to this. Electronic device 100 can send video fingerprints and audio fingerprints related to channel 5, channel 7, and channel 11. If multiple video fingerprints sent from electronic device 100 are identified as the same, server 300 can use the audio fingerprints to obtain identification information of different content corresponding to each audio fingerprint and send the identification information to electronic device 100.

[0149] Figure 7 This is a sequence diagram of an electronic device, a source device, and a server according to an embodiment.

[0150] The source device 200 can identify the type of content to be sent to the electronic device 100 (S705) and send an image signal to the electronic device 100 (S710). If the content sent to the electronic device 100 is identified as game content, the source device 200 can include control information for enabling ALLM in the image signal sent to the electronic device 100.

[0151] Electronic device 100 can receive image signals from source device 200 (S715). Electronic device 100 can identify whether a predetermined mode is enabled by control information included in the image signal (S720). When it is determined that the predetermined mode is enabled (S720-Yes), electronic device 100 can store information related to the first point in time when the predetermined mode is enabled (S725).

[0152] Furthermore, when receiving an image signal from the source device 200, the electronic device 100 can divide the content included in the image signal into a video signal and an audio signal, and periodically obtain feature information from the video signal and the audio signal (S730). The electronic device 100 can obtain video fingerprint information from the video signal and audio fingerprint information from the audio signal.

[0153] Then, the electronic device 100 can send the obtained feature information for identifying content-related information to the server 300 (S735).

[0154] Before electronic device 100, server 300 can receive image signals from source device 200 or external device (S740). Server 300 can divide the content included in the image signal into video signal and audio signal, and generate video feature information and audio feature information (S745). The generated feature information can be stored as video feature information and audio feature information (S750).

[0155] Then, when feature information is sent from electronic device 100 (S735), server 300 can match (compare) the video feature information sent from electronic device 100 with the information in the database (S755). Server 300 can identify whether the number of identification information obtained based on video feature information is greater than one (S760). If the number of identification information is identified as greater than one (S760 - Yes), in other words, if the identification information is not identified as information for a specific content, server 300 can match (compare) the audio feature information sent from electronic device 100 with the information in the database (S765). Even if multiple identification information using audio feature information can be identified as one identification information, server 300 can identify a matching content and obtain the identification information associated with it (S770). Then, server 300 can send the matching content identification information to electronic device 100 (S775).

[0156] The electronic device 100 can obtain information related to a second point in time when the reservation mode is closed, and store the information related to the second point in time (S780). Figure 7 Step S780 is shown after receiving the identification information from server 300, but this is an embodiment, and step S780 is a step performed at various points in time after step S730, which obtains feature information about electronic device 100.

[0157] Electronic device 100 can obtain content-related information based on identification information received from server 300 and stored information related to the first and second time points (S785).

[0158] The electronic device 100 can identify the type and title of the content based on identification information, and can identify the time period and type of the content's reproduction based on information related to the first and second time points.

[0159] Figure 8 This is a view used to illustrate the identification information based on the time point when the feature information is obtained, according to an embodiment.

[0160] The electronic device 100 can determine the type of content reproduced between a first time point when the predetermined mode is activated and a second time point when the predetermined mode is deactivated. In this case, if multiple different identification messages are received between the first and second time points, the electronic device 100 can identify which content corresponds to which identification message was reproduced between the first and second time points.

[0161] For example, electronic device 100 can obtain feature information from content A at time t1 before the first time point and send the obtained feature information to server 300. Server 300 can identify the matching content A based on the feature information and send the identification information of content A to electronic device 100. Suppose that electronic device 100 can receive the identification information of content A from server 300 at time t2 after the first time point.

[0162] Furthermore, electronic device 100 can obtain feature information from content B at time point t3 after the first time point and send the obtained feature information to server 300. Server 300 can identify the matching content B based on the feature information and send the identification information of content B to electronic device 100. Assume that electronic device 100 can receive the identification information of content B from server 300 at time point t4 before the second time point.

[0163] In other words, electronic device 100 can receive multiple identification information from server 300 between a first time point and a second time point. In this case, electronic device 100 can identify the identification information corresponding to the feature information obtained between the first time point and the second time point (the identification information received at time point t4) among the multiple identification information received from server 300. Electronic device 100 can identify that the content corresponding to the identification information received at time point t4 was reproduced between the first time point and the second time point, and can identify the reproduction time period of content B.

[0164] Furthermore, even if t4 (i.e., the time point at which the identification information of content B is received) is after the second time point, because the feature information of content B was obtained between the first time point and the second time point, the electronic device 100 can still identify that content B was reproduced between the first time point and the second time point.

[0165] Figure 9 This is a flowchart illustrating a method for controlling an electronic device according to an embodiment.

[0166] When receiving content from the source device 200, the electronic device 100 can obtain the characteristic information of the received content and send the characteristic information to the server 300 (S910).

[0167] Here, the feature information can include any one or any combination of video feature information and audio feature information. Video feature information can be implemented as a video fingerprint, and audio feature information can be implemented as an audio fingerprint.

[0168] The electronic device 100 can capture images of the currently viewed content from the received content at predetermined time intervals, and obtain video feature information based on the pixel values ​​of the captured images.

[0169] In addition, the electronic device 100 can obtain frequency information of the acoustic information of the content currently being viewed at predetermined time intervals, and obtain audio feature information based on the obtained frequency information.

[0170] Here, if the number of content identification information obtained based on video feature information is greater than one, then the audio feature information is as follows, which can be used to obtain the identification information corresponding to the currently viewed content from among multiple identification information.

[0171] The electronic device 100 can obtain video feature information from a predetermined number of the most recently captured images among a plurality of images captured at predetermined time intervals, and send the video feature information to the server 300.

[0172] Electronic device 100 can receive identification information of content obtained based on feature information from server 300 (S920).

[0173] The electronic device 100 can obtain content identification information based on feature information obtained between a first time point and a second time point from multiple identification information received from the server 300.

[0174] If the predetermined mode of the electronic device 100 is activated based on the signal received from the source device 200, the electronic device 100 can obtain information related to the first point in time when the predetermined mode is activated (S930).

[0175] Signals received from the source device 200 may include control information that allows the electronic device 100 to turn a predetermined mode on or off based on the type of content provided by the source device 200.

[0176] If the content type is game content, the control information can be information provided from the source device 200, and the preset mode can be automatic low latency mode (ALLM).

[0177] The electronic device 100 can obtain information related to a second time point after the first time point when the predetermined mode is turned off (S940).

[0178] The electronic device 100 can obtain information related to the displayed content based on the obtained identification information, information related to the first time point, and information related to the second time point (S950).

[0179] The electronic device 100 can identify the title of the displayed content based on identification information, and can identify the reproduction time period of the identified content based on information related to a first time point and a second time point.

[0180] The operation of each step has been described above, so its detailed description will not be repeated.

[0181] The methods according to the embodiments of the present disclosure described above can be implemented in the form of applications that can be installed in electronic devices of related technologies.

[0182] Alternatively, the method according to the embodiments of the present disclosure can be easily implemented by updating the software or hardware in existing electronic devices.

[0183] Furthermore, the disclosed embodiments described above can be executed via an embedded server equipped in the electronic device or an external server of the electronic device.

[0184] According to embodiments of this disclosure, the above embodiments can be implemented as software including instructions stored in a machine-readable storage medium. The machine is an apparatus that invokes and operates according to the instructions stored in the storage medium, and may include electronic devices according to the disclosed embodiments. When the instructions are executed by a processor, the processor can directly or using other elements perform the function corresponding to the instructions under the processor's control. The instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, a "non-transitory" storage medium is tangible and may not include signals, and it is impossible to distinguish whether data is semi-permanent or temporarily stored in the storage medium.

[0185] Additionally, according to embodiments of this disclosure, methods based on the above-disclosed embodiments can be provided for inclusion in a computer program product. The computer program product can be exchanged as a commodity between a seller and a buyer. The computer program product can be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)) or through an app store (e.g., the Play Store). TM Online distribution. In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated on a storage medium such as the memory of a manufacturer's server, an app store's server, or a relay server.

[0186] According to embodiments of this disclosure, the above embodiments can be implemented in a recording medium readable by a computer or similar apparatus using software, hardware, or a combination thereof. In some cases, the embodiments described in this specification can be implemented as a processor itself. According to implementations via software, embodiments such as the processes and functions described in this specification can be implemented as independent software modules. Each software module can perform one or more functions and operations described in this specification.

[0187] Computer instructions for performing processing operations according to embodiments of the present disclosure described above can be stored in a non-transitory computer-readable medium. When the computer instructions stored in such a non-transitory computer-readable medium are executed by a processor, the computer instructions enable the machine to perform the processing operations according to the embodiments described above.

[0188] Non-transitory computer-readable media are not media that store data for short periods of time (such as registers, caches, or memory), but rather media that store data semi-permanently and can be read by a machine. Examples of non-transitory computer-readable media can include CDs, DVDs, hard drives, Blu-ray discs, USB drives, memory cards, and ROMs.

[0189] Furthermore, each of the elements (e.g., modules or programs) according to the above embodiments may include a single entity or multiple entities, and in the above embodiments, some of the sub-elements may be omitted or other sub-elements may be included. Alternatively or additionally, some elements (e.g., modules or programs) may be integrated into one entity to perform the same or similar functions as those performed by each respective element prior to integration. According to embodiments, operations performed by modules, programs, or other elements may be performed sequentially in a parallel, repetitive, or heuristic manner, or at least some operations may be performed in a different order, omitted, or different operations may be added.

[0190] Although embodiments of the present disclosure have been illustrated and described, the present disclosure is not limited to the foregoing embodiments, and it will be apparent to those skilled in the art to which this disclosure pertains that various modifications can be made without departing from the spirit of the present disclosure as claimed in the appended claims. Furthermore, these modifications are not intended to be interpreted independently of the technical concept or prospects of the present disclosure.

[0191] As described above, according to embodiments of this disclosure, the electronic device can identify the title of the content currently being displayed.

[0192] In addition, if the content reproduced through the electronic device is game content, the electronic device can identify the actual game time played by the user.

Claims

1. An electronic device comprising: a communication interface; a display; and a processor configured to: receive content from a source device through the communication interface, obtain feature information of the received content, and transmit the obtained feature information to an external server; receive identification information of the content from the external server, the identification information being obtained based on the transmitted feature information; obtain information about a first point in time when a predetermined mode of the display is turned on based on a signal received from the source device through the communication interface; obtain information about a second point in time when the predetermined mode of the display is turned off after the first point in time based on the predetermined mode being turned off; and obtain, among a plurality of pieces of identification information received from the external server, identification information of content displayed through the display corresponding to the feature information obtained between the first point in time and the second point in time, wherein the identification information of the displayed content is used to identify a reproduction time period of content identified based on the information about the first point in time and the information about the second point in time. The processor is further configured to: 2.The electronic device of claim 1, wherein, identify a title of the displayed content based on the identification information received from the external server; and identify a reproduction time period of the content of which the title is identified based on the obtained information about the first point in time and the obtained information about the second point in time. The signal received from the source device includes control information for allowing the electronic device to turn on or turn off the predetermined mode based on a type of content received from the source device. The predetermined mode is an auto low latency mode (ALLM). 3.The electronic device of claim 1, wherein The control information is provided from the source device to the electronic device supporting a predetermined or higher version of a HDMI standard. 4.The electronic device of claim 3, wherein, The control information is provided from the source device to the electronic device based on the type of content being game content. 5.The electronic device of claim 3, wherein, The feature information includes any one or any combination of video feature information and audio feature information, and 6.The electronic device of claim 3, wherein wherein the processor is further configured to: 7.The electronic device of claim 1, wherein capture images of content currently being watched among the content received from the source device at a predetermined time interval; obtain the video feature information based on pixel values of the captured images; obtain frequency information of acoustic information of the content currently being watched at the predetermined time interval; and obtain the audio feature information based on the obtained frequency information. In response to a number of pieces of identification information of content obtained based on the video feature information being greater than one, the audio feature information is additionally used to obtain identification information corresponding to the content currently being watched among the obtained plurality of pieces of identification information. The processor is further configured to obtain the video feature information from a predetermined number of most recently captured images among the captured images. 8.The electronic device of claim 7, wherein, 10.A method of controlling an electronic device, the method comprising: 9.The electronic device of claim 7, wherein receiving content from a source device, obtaining feature information of the received content, and transmitting the obtained feature information to an external server; ​ ​ receiving identification information of the content from the external server, the identification information being obtained based on the transmitted feature information; obtaining information about a first time point when a predetermined mode of a display of the electronic device is turned on based on a signal received from the source device; obtaining information about a second time point when the predetermined mode is turned off after the first time point based on the predetermined mode of the display being turned off; and among a plurality of pieces of identification information received from the external server, obtaining identification information of displayed content corresponding to feature information obtained between the first time point and the second time point, wherein the identification information of the displayed content is used to identify a reproduction time period of content identified based on the information about the first time point and the information about the second time point.

11. The method of claim 10, wherein, Obtaining information about the content includes: identifying a title of the displayed content based on the identification information received from the external server; and identifying a reproduction time of the content whose title is identified based on the obtained information about the first time point and the obtained information about the second time point.

12. The method of claim 10, wherein, The signal received from the source device includes control information for allowing the electronic device to turn on or turn off the predetermined mode based on a type of content received from the source device.

13. The method of claim 12, wherein, The predetermined mode is an auto low latency mode (ALLM).

Images