Electronic device and control method thereof

Abstract

The electronic device comprises: a communication unit for communicating with a terminal device; a memory for storing at least one instruction; and one or more processors for executing the at least one instruction, wherein the one or more processors store image information about an image in the memory, and when data corresponding to the image acquired by means of a camera included in the terminal device is received from the terminal device by means of the communication unit, perform a function corresponding to authentication of the terminal device on the basis of the data received from the terminal device and the information corresponding to the image.

Description

Electronic device and control method thereof

[0001] The present disclosure relates to an electronic device capable of performing authentication of a terminal device using captured information obtained by the terminal device capturing the screen of a display, and a method for controlling the same.

[0002] The display device can display images, and control of such display device (or set-top box) can be controlled not only through a provided button or a separate remote control, but also through a user's terminal device.

[0003] However, in order to control the display device using the terminal device, a connection process between the terminal device and the display device was required.

[0004] Embodiments of the present disclosure may solve at least one of the previously described problems and / or disadvantages and provide the advantages described below. Accordingly, the embodiments of the present disclosure provide an electronic device and a method for controlling the same that can perform authentication of a terminal device using captured information obtained by the terminal device capturing the screen of a display.

[0005] Additional embodiments will be presented in the detailed description below, some of which are obvious from the detailed description, and others may be derived from the described embodiments.

[0006] The present invention is defined by the appended claims.

[0007] An electronic device according to an embodiment of the present disclosure is disclosed. The electronic device comprises a communication unit that communicates with a terminal device, a memory that stores at least one instruction, and one or more processors that execute said at least one instruction. The one or more processors store image information regarding an image in the memory, and when they receive data corresponding to an image acquired through a camera included in the terminal device from the terminal device via the communication unit, they perform a function corresponding to authentication of the terminal device based on the data received from the terminal device and the information corresponding to the image.

[0008] The above one or more processors control the screen brightness to change within a preset time and perform a function corresponding to the authentication of the terminal device based on whether there is a correspondence between the data received from the terminal device and the information corresponding to the image and a brightness change pattern corresponding to the change in screen brightness.

[0009] The above one or more processors acquire characteristic information including at least one of screen size and model information corresponding to the electronic device based on data received from the terminal device, and perform a function corresponding to authentication of the terminal device based on whether there is a correspondence between the data received from the terminal device and information corresponding to the image and the characteristic information.

[0010] The above one or more processors can control the communication unit to obtain a data type corresponding to authentication based on the image and transmit information corresponding to the obtained data type to the terminal device.

[0011] When the above one or more processors receive information related to acquiring data corresponding to the image through a camera included in the terminal device from the terminal device through the communication unit, they can store information corresponding to the image output through the electronic device in the memory.

[0012] The above one or more processors can acquire information corresponding to the communication latency between the terminal device and the electronic device, and based on the information corresponding to the communication latency, acquire an image that forms the basis of the function corresponding to the authentication among the information corresponding to the image.

[0013] The above one or more processors can control the memory to store audio information corresponding to the image and perform a function corresponding to the authentication of the terminal device based on the audio information included in the data received from the terminal device and the audio information corresponding to the image.

[0014] The above one or more processors can perform a function corresponding to the authentication of the terminal device by using audio information included in the data received from the terminal device and audio information corresponding to the image that has a frequency greater than or equal to a preset frequency.

[0015] The electronic device includes a speaker, and one or more processors control the speaker to output an audio signal having a preset pattern at a frequency other than an audible frequency, and if the preset pattern is included in the audio information included in the data received from the terminal device, the processor can perform a function corresponding to the authentication of the terminal device.

[0016] The above one or more processors can control the communication unit to transmit at least one of the state information of the electronic device and information related to a UI corresponding to the control of the electronic device to the terminal device when a function corresponding to the authentication of the terminal device is performed.

[0017] A control method for an electronic device according to one embodiment of the present disclosure includes the steps of: storing image information for an image; receiving data corresponding to an image acquired through a camera included in the terminal device from a terminal device; and performing a function corresponding to authentication of the terminal device based on the data received from the terminal device and the information corresponding to the image.

[0018] The control method includes a step of controlling the screen brightness to change within a preset time, and the step of performing the above function can perform a function corresponding to the authentication of the terminal device based on whether there is a correspondence between the data received from the terminal device and the information corresponding to the image and a brightness change pattern corresponding to the change in screen brightness.

[0019] The step of performing the above function may include obtaining characteristic information including at least one of screen size and model information corresponding to the electronic device based on data received from the terminal device, and performing a function corresponding to authentication of the terminal device based on whether there is a correspondence between the data received from the terminal device and information corresponding to the image and the characteristic information.

[0020] The control method may include the step of obtaining a data type corresponding to authentication based on the image, and the step of transmitting information corresponding to the obtained data type to the terminal device.

[0021] The above-mentioned storage step can store information corresponding to the image output through the electronic device when information related to acquiring data corresponding to the image is received from the terminal device through a camera included in the terminal device.

[0022] The control method includes a step of acquiring information corresponding to the communication latency between the terminal device and the electronic device, and the step of receiving the data may acquire an image that forms the basis of the function corresponding to the authentication among the information corresponding to the image based on the information corresponding to the communication latency.

[0023] The above-mentioned storage step stores audio information corresponding to the image, and the above-mentioned function-performing step can perform a function corresponding to the authentication of the terminal device based on the audio information included in the data received from the terminal device and the audio information corresponding to the image.

[0024] The step of performing the above function can perform a function corresponding to the authentication of the terminal device by using audio information included in the data received from the terminal device and audio information corresponding to the image that has a frequency greater than or equal to a preset frequency.

[0025] The control method includes the step of outputting an audio signal having a preset pattern at a frequency other than an audible frequency, and the step of performing the above function can perform a function corresponding to the authentication of the terminal device if the preset pattern is included in the audio information included in the data received from the terminal device.

[0026] In a non-transient computer-readable recording medium storing a program for executing a control method for an electronic device according to one embodiment of the present disclosure, the control method comprises: a step of storing image information for an image; a step of receiving data corresponding to an image acquired through a camera included in the terminal device from a terminal device; and a step of performing a function corresponding to authentication of the terminal device based on the data received from the terminal device and the information corresponding to the image.

[0027] The above-described or other aspects, features, and benefits of embodiments of the present disclosure will become more apparent from the following description with reference to the accompanying drawings. In the accompanying drawings:

[0028] FIG. 1 is a drawing for explaining an authentication operation in an electronic system according to one embodiment of the present disclosure,

[0029] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure,

[0030] FIG. 3 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure,

[0031] FIG. 4 is a block diagram illustrating the configuration of a terminal device according to one embodiment of the present disclosure,

[0032] FIG. 5 is a sequence diagram for explaining an authentication process according to one embodiment of the present disclosure,

[0033] FIG. 6 is a diagram for explaining an operation corresponding to an authentication request of another terminal device according to one embodiment of the present disclosure,

[0034] FIG. 7 is a drawing for explaining a screen display operation according to an embodiment of the present disclosure,

[0035] FIG. 8 is a drawing illustrating an example of a guide UI that can be displayed by a terminal device according to one embodiment of the present disclosure.

[0036] FIG. 9 is a drawing illustrating an example of a guide UI that can be displayed by a terminal device according to one embodiment of the present disclosure.

[0037] FIG. 10 is a flowchart for explaining a method of controlling an electronic device according to one embodiment of the present disclosure, and,

[0038] FIG. 11 is a flowchart illustrating a method for controlling a terminal device according to one embodiment of the present disclosure.

[0039] The embodiments described herein are subject to various modifications and may have various forms; specific embodiments are illustrated in the drawings and described in detail in the detailed description. However, this is not intended to limit the scope of specific embodiments and should be understood to include various modifications, equivalents, and / or alternatives of the embodiments of the present disclosure. In relation to the description of the drawings, similar reference numerals may be used for similar components.

[0040] In describing the present disclosure, if it is determined that a detailed description of related known functions or configurations could unnecessarily obscure the essence of the present disclosure, such detailed description is omitted.

[0041] Additionally, the following embodiments may be modified in various other forms, and the scope of the technical concept of the present disclosure is not limited to the following embodiments. Rather, these embodiments are provided to make the present disclosure more faithful and complete and to fully convey the technical concept of the present disclosure to those skilled in the art.

[0042] The terms used in this disclosure are used merely to describe specific embodiments and are not intended to limit the scope of the rights. The singular expression includes the plural expression unless the context clearly indicates otherwise.

[0043] In the present disclosure, expressions such as “have,” “may have,” “include,” or “may include” indicate the presence of such features (e.g., numerical values, functions, actions, or components, etc.) and do not exclude the presence of additional features.

[0044] In the present disclosure, expressions such as “A or B,” “at least one of A or / and B,” or “one or more of A or / and B” may include all possible combinations of items listed together. For example, “A or B,” “at least one of A and B,” or “at least one of A or B” may refer to cases including (1) at least one A, (2) at least one B, or (3) both at least one A and at least one B.

[0045] Expressions such as "first," "second," "first," or "second" used in this disclosure may modify various components regardless of order and / or importance, and are used only to distinguish one component from another and do not limit said components.

[0046] Where it is stated that a component (e.g., a first component) is "(operatively or communicatively) coupled with / to" or "connected to" another component (e.g., a second component), it should be understood that the component may be directly connected to the other component or connected through the other component (e.g., a third component).

[0047] On the other hand, when it is stated that a certain component (e.g., a first component) is "directly connected" or "directly coupled" to another component (e.g., a second component), it may be understood that no other component (e.g., a third component) exists between said certain component and said other component.

[0048] As used in this disclosure, the expression “configured to” may be replaced, depending on the context, with, for example, “suitable for,” “having the capacity to,” “designed to,” “adapted to,” “made to,” or “capable of.” The term “configured to” may not necessarily mean only “specifically designed to” in hardware.

[0049] Instead, in some situations, the expression “device configured to do something” may mean that the device is “capable of doing something” together with other devices or components. For example, the phrase “processor configured (or set) to perform A, B, and C” may mean a dedicated processor for performing those operations (e.g., an embedded processor), or a generic-purpose processor (e.g., a CPU or application processor) capable of performing those operations by executing one or more software programs stored in a memory device.

[0050] In the embodiments, a 'module' or 'part' performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of 'modules' or a plurality of 'parts' may be integrated into at least one module and implemented by at least one processor, except for the 'module' or 'part' that needs to be implemented in specific hardware.

[0051] Operations performed by a module, program, or other component according to various embodiments may be executed sequentially, in parallel, iteratively, or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.

[0052] Meanwhile, the various elements and areas in the drawings are depicted schematically. Accordingly, the technical concept of the present invention is not limited by the relative sizes or spacing depicted in the attached drawings.

[0053] Meanwhile, an electronic device according to various embodiments of the present disclosure may include, for example, at least one of a smartphone, a tablet PC, a desktop PC, a laptop PC, a server, or a wearable device. The wearable device may include at least one of an accessory type (e.g., a watch, ring, bracelet, anklet, necklace, glasses, contact lens, or head-mounted device (HMD)), a fabric or clothing integrated type (e.g., electronic clothing), a body-attached type (e.g., a skin pad or tattoo), or a bio-implantable circuit.

[0054] In some embodiments, the electronic device is, for example, a television, a DVD (digital video disk) player, audio, a refrigerator, an air conditioner, a vacuum cleaner, an oven, a microwave, a washing machine, an air purifier, a set-top box, a home automation control panel, a security control panel, a media box (e.g., Samsung HomeSync). TM , Apple TV TM , or Google TV TM ), game console (e.g., Xbox) TM PlayStation TMIt may include at least one of an electronic dictionary, an electronic key, a camcorder, or an electronic photo frame. Meanwhile, among the electronic devices described above, a device equipped with a display may be referred to as a display device. Meanwhile, even if the electronic device of the present disclosure does not have a display, it may be a set-top box or a PC that provides images to a display device.

[0055] In addition, among the aforementioned electronic devices, a device that a user can carry may be referred to as a terminal device. For example, a terminal device may be a smartphone, tablet, laptop, etc.

[0056] Hereinafter, embodiments according to the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement them.

[0057] FIG. 1 is a drawing for explaining an authentication operation in an electronic system according to one embodiment of the present disclosure.

[0058] Referring to FIG. 1, the electronic system (1000) may include an electronic device (100) and a terminal device (200). In the illustrated example, the electronic system (1000) is shown as having one electronic device (100) and one terminal device (200) each, but in implementation, there may be multiple devices.

[0059] The electronic device (100) can display an image (10) corresponding to the content. Here, the content consists of an image, audio, or a combination thereof and includes information that can be provided to the user visually, audibly, or audiovisually through the electronic device.

[0060] For example, the content may include movies, music, plays, photographs, comics, animations, computer games, text, shapes, colors, sounds, motions, or pictures, or a combination of the above, provided through an electronic device, and may include game content, voice content, music content, image content, video content, widget content, web pages, etc.

[0061] And an image (or video) may contain various forms of visual information. For example, an image may include still images and dynamic images (or videos). For example, a video may contain various forms of visual information that represent the movement of an object using a series of consecutive still images.

[0062] Images according to one example may include, depending on the aspect ratio, horizontal images where the width is longer than the height (e.g., landscape images, horizontal images), vertical images where the height is longer than the width (e.g., portrait images, vertical images), etc. For example, horizontal images may include images with a 16:9 aspect ratio, and vertical images may include images with a 9:16 aspect ratio. Specific numbers are examples for convenience of explanation and are not limited thereto.

[0063] An image according to one example may include various resolutions depending on the number of pixels constituting the image (the product of the number of pixels in the horizontal direction and the number of pixels in the vertical direction). For example, depending on the resolution, the image may include high-resolution images (FHD (1920×1080), 8K (7680×4320), etc.) and low-resolution images (640×480, etc.).

[0064] According to one example of the present disclosure, each of the plurality of still images included in the video may mean a frame (or, image frame).

[0065] According to one example, a video consists of multiple frames, and each of the multiple frames may correspond to one screen output by an electronic device. According to one example, the number of frames (or screens) output by an electronic device per second is referred to as the frame rate, and the frame rate may be expressed in units of frames per second (fps) or Hertz (Hz). According to one example, a video of 60fps may mean a video containing 60 frames in 1,000ms.

[0066] Meanwhile, in the illustrated example, for ease of explanation, it is assumed that the electronic device directly displays the image; however, in implementation, the electronic device may be a device that outputs an image without having a display.

[0067] For controlling the electronic device (100), a remote control device was previously used. Recently, it has become possible to use a user's terminal device (200) as a remote control device. For example, if the user's terminal device (200) is authenticated, the terminal device (200) can display a user interface window for controlling the electronic device (100). Through the displayed user interface window, the user can perform various operations such as changing channels, changing sources, and adjusting volume.

[0068] Here, authentication refers to the process of verifying the identity of someone or something. Such authentication can be achieved by verifying passwords, hardware tokens, or information proving identity.

[0069] In this way, an authentication procedure must be performed for the terminal device (200) to control the electronic device (100). Specifically, this is because only a person with control authority over the electronic device (100) should be able to operate the electronic device (100). For example, since wireless communication methods allow the signal to be received even in a neighboring house, an authentication procedure is required because a user in a neighboring house may attempt to access the electronic device.

[0070] For such authentication, a QR code or a PIN code was previously displayed on the screen. For example, when a QR code is displayed, the terminal device (200) can photograph the QR code, obtain information from the photographed QR code, and perform authentication with the electronic device using the obtained information.

[0071] If a PIN code is displayed on the screen, the user can enter the PIN code into the terminal device (200), and the terminal device (200) can proceed with the authentication procedure with the electronic device (100) using the entered PIN code.

[0072] This authentication process interferes with the viewer's viewing experience in that a QR code or PIN code must be displayed on the screen.

[0073] The present disclosure provides a method for performing authentication without interfering with a user's viewing in order to solve these problems. According to the present disclosure, an electronic device (100) stores image information corresponding to the content when the authentication process is performed. Additionally or alternatively, the electronic device (100) may store audio information corresponding to the content when the authentication process is performed. In this case as well, the electronic device (100) may maintain the same video display and audio output for the content. In other words, the electronic device (100) may include a display, and this display displays an image in which the authentication process is performed.

[0074] In this state, the terminal device (200) can capture an image (10) currently displayed on the display of the electronic device (100) (e.g., through the camera of the electronic device). Then, the terminal device (200) transmits the captured image to the electronic device (100) as authentication information. The specific configuration and operation of the terminal device (200) will be described later in FIG. 4.

[0075] The electronic device (100) can perform user authentication by comparing the received shooting data with previously stored image information to determine whether the user has captured the screen displayed on the electronic device (100). In other words, the electronic device (100) can compare the stored image information with the captured image information received from the terminal device (200), and if they match, the terminal can be authenticated. For example, as illustrated, if the image transmitted by the terminal device (200) was one of the screens displayed, the terminal device can be authenticated as a user's terminal device capable of controlling the electronic device.

[0076] The image described above may be an application screen, system UI, and / or broadcast screen currently displayed on an electronic device (100). This image may include unique visual elements that can be identified during the authentication process. QR codes or similar optically encoded data are not displayed or required. That is, unlike conventional authentication methods that display a QR code on a TV screen and scan it with a terminal device, the present disclosure utilizes a method of capturing a screen image without generating or displaying a QR code. The authentication interface displayed on the TV is intended to be visually identified and analyzed by the terminal device based on the screen content itself, rather than a machine-readable code.

[0077] However, if the video currently being watched by the user is a terrestrial broadcast and many viewers can watch the same video, the electronic device (100) can perform an authentication procedure using various additional information in addition to video comparison. These various authentication methods will be described later. The specific configuration and operation of the electronic device (100) will be described later in FIGS. 2 and FIGS. 3.

[0078] In the illustrated example, the electronic device is depicted as directly displaying an image, but in implementation, the electronic device may be a device that performs only the image generation operation as described above and provides the generated image to a separate display.

[0079] As described above, the electronic device according to the present disclosure continuously outputs the existing screen during the authentication process, thereby enabling the authentication operation to be performed without interfering with the user's viewing.

[0080] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0081] Referring to FIG. 2, the electronic device (100) may include a communication unit (110), a memory (120), and a processor (130).

[0082] The communication unit (110) is a configuration that performs communication with various types of external devices according to various types of communication methods. The communication unit (110) may include a Wi-Fi module, a Bluetooth module, an infrared communication module, and a wireless communication module, etc. Here, each communication module may include at least one hardware chip or hardware circuit.

[0083] Wi-Fi modules and Bluetooth modules can perform communication via Wi-Fi and Bluetooth methods, respectively. When using a Wi-Fi module or a Bluetooth module, various connection information, such as SSID and session key, is transmitted and received first; after establishing a communication connection using this information, various types of information can be transmitted and received.

[0084] The infrared communication module performs communication according to infrared communication (IrDA, Infrared Data Association) technology, which uses infrared rays located between visible light and millimeter waves to wirelessly transmit data over short distances.

[0085] In addition to the communication method described above, the wireless communication module may include at least one communication chip that performs communication according to various wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation).

[0086] In addition, the communication unit (110) may include at least one wired communication module that performs communication using a LAN (Local Area Network) module, an Ethernet module, a pair cable, a coaxial cable, a fiber optic cable, or a UWB (Ultra Wide-Band) module.

[0087] According to one example, the communication unit (110) may use the same communication module (e.g., Wi-Fi module) to communicate with external devices such as a remote control and an external server.

[0088] According to other examples, the communication unit (110) may use different communication modules (e.g., Wi-Fi modules) to communicate with external devices such as a remote control and external servers. For example, the communication unit (110) may use at least one of an Ethernet module or a Wi-Fi module to communicate with an external server, and may use a BT module to communicate with an external device such as a remote control. However, this is merely one embodiment, and the communication unit (110) may use at least one of various communication modules when communicating with multiple external devices or external servers.

[0089] The communication unit (110) can receive content. This content can be diverse, such as movies, music videos, dramas, short videos, etc. And while the content is assumed to be video, it may also be an image or referred to as video.

[0090] The communication unit (110) can communicate with the terminal device. At this time, the communication unit (110) can communicate with the terminal device in a P2P manner. Here, P2P communication is a method of direct connection without using other relay devices such as a router, and may be BLE, Wi-Fi Direct, etc.

[0091] When a wireless connection is established between the communication unit (110) and the terminal device (200), the communication unit (110) can measure the strength of the wireless signal, measure the latency, or transmit and receive information necessary for authentication for the authentication process described below. In this process, the communication unit (110) can generate information corresponding to the latency.

[0092] When the authentication procedure is completed, the communication unit (110) may provide a user interface window for controlling an electronic device (or data that enables the output of said user interface window) to the terminal device, or receive a control command from the terminal device. For example, the data described above may be address information that can obtain said user interface window, an index (for example, a UI number to use if the terminal device already has multiple user interface windows), etc.

[0093] And the communication unit (110) can receive not only content but also information necessary for providing various applications and services of the electronic device (100) from an external device.

[0094] The memory (120) may be implemented as internal memory such as ROM (e.g., EEPROM (electrically erasable programmable read-only memory)) or RAM included in the processor (130), or as memory separate from the processor (130). In this case, the memory (120) may be implemented in the form of memory embedded in the electronic device (100) or in the form of memory that can be attached to and detached from the electronic device (100), depending on the purpose of data storage. For example, data for operating the electronic device (100) may be stored in memory embedded in the electronic device (100), and data for the expansion function of the electronic device (100) may be stored in memory that can be attached to and detached from the electronic device (100).

[0095] The memory (120) can store image information and / or audio information for authentication described later. Here, the audio information may be the audio content (or sound source) itself corresponding to the image, or the characteristics of the audio content (e.g., frequency characteristics, etc.). The memory (120) can also temporarily store information (e.g., shooting information) received from the terminal device (200) through the communication unit (110).

[0096] The memory (120) can store an audio signal and / or a screen change pattern having a preset pattern used in the authentication process, etc.

[0097] And the memory (120) can store various contents (e.g., broadcast content, applications, etc.) received through the communication unit (110) described above.

[0098] And the memory (120) can store at least one instruction for the operation of the electronic device (100). Here, the instruction may include an instruction for displaying an image, an instruction for performing an authentication process with a terminal device, etc.

[0099] Meanwhile, the memory embedded in the electronic device (100) is implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD), and the memory that can be attached to and detached from the electronic device (100) can be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), external memory that can be connected to a USB port (e.g., USB memory).

[0100] Meanwhile, although the illustrated example shows the electronic device (100) being composed of a single memory, when distinguishing between volatile memory and non-volatile memory, the electronic device (100) may be described as including multiple memories.

[0101] The processor (130) controls the overall operation of the electronic device (100). Specifically, the processor (130) is connected to the configuration of the electronic device including a communication unit (110) and a memory (120), and can control the overall operation of the electronic device by executing at least one instruction stored in the memory (120) as described above. In particular, the processor (130) can be implemented as a single processor as well as as a plurality of processors.

[0102] The processor (130) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing operations. The processor (130) may include at least one electrical circuit and may process instructions (or programs, data, etc.) stored in memory individually or collectively in a distributed manner.

[0103] The processor (130) may include a processor assembly comprising one or more processing circuits. The processor (130) may include any processing circuit that is operative to control the performance and operation of one or more components of an electronic device (e.g., memory and / or driving device (sensor)). For example, the processor (130) (e.g., AP) may be implemented as a system on chip (SoC) (e.g., a single chip or a chipset). For example, the processor (130) may be implemented as multiple cores (or at least one core circuit), multiple chips, or multiple chipsets.

[0104] For example, the processor (130) may include one or more processing circuits. The processor (130) may include one or more processing circuits configured to perform various functions of the present disclosure individually and / or collectively. As an example without limitation, at least a portion of the processor (130) may be included in a first chip of the electronic device (100), and at least another portion of the processor (130) may be included in a second chip of an electronic device different from the first chip of the electronic device (100).

[0105] For example, the processor (130) may include a central processing unit (CPU), a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a display controller, a memory controller, a storage controller, a communication processor (CP), and / or a sensor interface. These components of the processor (130) are merely exemplary. The processor (130) may include additional components other than those described above. Additionally, some components of the processor (130) may be omitted. Furthermore, some components of the processor (130) may be included as separate components of the electronic device (100) outside of the processor (130). For example, some components of the processor (130) (e.g., a memory controller) may be included within other components (e.g., at least a portion of memory, an interface (e.g., available for connection to at least one component of the electronic device (100)), a display).

[0106] The processor (130) can cause other components of the electronic device (100) to perform various operations by executing instructions stored in memory (120). The processor (130) processes setting values, function commands, etc. according to a stored control program or control data, and can output control signals related to functions that the electronic device (100) can perform or communication signals for communicating with an external electronic device.

[0107] The processor (130) acquires content by using the communication unit (110). For example, when the processor (130) receives a playback command for specific content from a user, it can acquire the content by controlling the communication unit (110) to receive the content. Such content may be a video such as VOD, but may also be a real-time streaming video provided by a specific server, or broadcast content transmitted by a broadcasting station.

[0108] The processor (130) generates an image corresponding to the acquired content. For example, if the content is real-time streaming, it can construct a screen using video data from the received streaming data and generate a video using the screen.

[0109] The processor (130) can output the generated image. For example, if the electronic device includes a display, the processor (130) can control the display to display the generated image. If the electronic device is a set-top box, the processor (130) can output the generated image to the display device.

[0110] Additionally, the processor (130) can generate an audio signal corresponding to the acquired content. The processor (130) can output the generated audio signal. For example, if the electronic device includes a speaker, the processor (130) can control the speaker so that the speaker outputs the audio signal. If the speaker is located in an external device, the processor (130) can control the communication unit (110) so that the audio signal is transmitted to the external device.

[0111] The processor (130) can control the communication unit (110) to establish a wireless connection with the terminal device. For example, when the terminal device requests the establishment of a wireless connection, the processor (130) can control the communication unit (110) to establish a wireless connection with the terminal device.

[0112] The processor (130) can determine whether the wirelessly connected terminal device (200) is an authenticated device or not. If it is an authenticated device, the processor (130) can allow the operation of receiving control commands from the terminal device (200).

[0113] Conversely, if the device is not authenticated, the processor (130) may determine that an authentication process with the terminal device (200) is required. The processor (130) may also measure the wireless signal strength with the terminal device (200). Such wireless signal strength can be used to determine the data type described later.

[0114] And the processor (130) can measure the latency with the terminal device (200). Here, latency refers to the time between a stimulus and a response, and may be the time from when the electronic device transmits a request to the terminal device until it performs an action corresponding to that request, or conversely, the time when the electronic device performs a specific action in response to the request of the terminal device. In the present disclosure, it is used to determine the time relationship between the capture (or storage) of an image by the electronic device and the recording of an image by the terminal device.

[0115] The processor (130) can determine the data type to be used for authentication and perform a storage operation based on the determined type. For example, the data type may include video (i.e., image), audio, video + audio, video + device characteristics, and video + brightness change patterns.

[0116] For example, the determination of such data types may be determined by the type of video and the degree of change in the video. For example, if the user is watching a terrestrial broadcast that other users can also easily obtain, the processor (130) may decide to use audio along with the video, use information from the display device along with the video, or output a screen brightness pattern along with the video or an audio signal in an inaudible frequency band along with the video.

[0117] Here, inaudible frequency is the opposite of audible frequency, that is, a frequency outside the range of frequencies audible to the human ear (16 to 20,000 Hz). For example, inaudible frequency can refer to frequencies of 200,000 Hz or higher.

[0118] At this time, if the image currently being output is a static image with little change, the processor (130) can determine the data type among methods using information other than the image.

[0119] For example, in a state where there is very good reception strength, such that the terminal device and the electronic device are expected to be within 1m of each other, the processor (130) may decide to perform authentication using only the video image while displaying a normal broadcast video. Conversely, if the wireless signal is expected to be at a somewhat distant location, such as through a wall, the processor (130) may use other methods in addition to using only the video.

[0120] If the user is watching a video that is difficult for other users to easily obtain, the processor (130) may decide to use only the video.

[0121] Although the process of determining data types has been explained in a fragmentary manner above, it is possible to utilize the aforementioned points by comprehensively considering them during implementation. For example, a certain score can be assigned to each item, and the method corresponding to the summed-up reception can be determined.

[0122] And the processor (130) can control the communication unit (110) to transmit information about the determined data type to the terminal device. At this time, the processor (130) can also transmit information about the shooting method to the terminal device. For example, when information about the display device is also used, the processor (130) can control the communication unit (110) to provide guide information that the entire exterior of the display device needs to be photographed.

[0123] Alternatively, if an audio signal is used, the audio signal is also cited for authentication, so the processor (130) can control the communication unit (110) to provide a guide message to take a shot at a location as close as possible.

[0124] And when the data type is determined, the processor (130) can store information corresponding to the determined data type. For example, the processor (130) can store an image (or frame) corresponding to the video in a preset periodic unit, or store all frames within a certain time interval. At this time, the processor (130) can use the previously measured latency information. That is, it can notify the terminal device of information regarding the data type and perform a data storage operation after the latency following the notification.

[0125] If it is decided to use audio, the processor (130) can store audio information in memory (120).

[0126] And the processor (130) can store a brightness change pattern applied to the image when a preset brightness pattern is to be used. And the processor (130) can correct the brightness of the screen to correspond to the brightness change pattern described above and output the corrected image.

[0127] Meanwhile, when implementing, the electronic device stores multiple brightness change patterns in advance, and when it is decided to use a brightness pattern, one of the stored brightness change patterns may be selected and used.

[0128] Additionally, when the processor (130) uses sound in an inaudible frequency band, it can store the sound information used in memory (120). This sound information may be the sound source itself that uses the inaudible frequency band, or it may be information about the frequency characteristics of the sound source.

[0129] And if the processor (130) decides to use device information of the display device, it can obtain device information of the display device. Such device information for the display device can be obtained and stored in advance. If the information of the display device cannot be obtained, the processor (130) can exclude the use of device information of the display device in the preceding data type determination process.

[0130] Here, device information of the display device may include screen size, manufacturer information, and model name. If the electronic device is a display device that includes a display, all of the above-mentioned information can be obtained. If the electronic device is a set-top box and does not include a display, information previously entered by the user or information obtained from the display device can be utilized.

[0131] When the processor (130) receives a captured video, it can verify whether the received captured video is legal. For example, if the screen is not visible in the captured video, or if the device information of the display device is to be used but the video is captured in such a way that the display device is not identified within the video, or if the quality of the captured video is not legally suitable for use in the authentication process, the processor (130) can request the terminal device to retake the video and send it.

[0132] When a captured image is received, the processor (130) can proceed with an authentication process corresponding to a predetermined data type. For example, if the predetermined data type is to proceed only with images, the processor (130) can perform a function corresponding to authentication based on previously stored image information and received data. For example, one image can be acquired using the received data, and authentication (or a function corresponding to authentication) can be performed to determine whether the acquired image matches one of the previously stored images. In the process of selecting an image to be used for authentication, event information related to camera shooting and latency information notified by the terminal device can be considered.

[0133] Such image comparison may be performed by checking for the presence of the same object between the two images, or by performing color correction on one of the images to verify whether each color pattern is identical between the corrected image and the other image.

[0134] And for this comparison, a learning model may be used. For example, the processor (130) may input two images into a learning model and determine whether they are the same image based on the result of the learning model. Here, the learning model may be a model that receives two images and determines whether the two images are the same. At this time, the input images may be the input or acquired images as they are, or they may be images preprocessed to a certain size.

[0135] If a screen change pattern is to be used, the processor (130) can perform authentication by checking the brightness of the received captured image in frame units or preset time units and checking whether such brightness change has a preset brightness change pattern.

[0136] And if the determined data type is determined to also use audio information, the processor (130) can extract audio information within the received video and compare the extracted audio information with the previously stored audio to check for a match.

[0137] Such audio comparison may involve comparing frequency components in the corresponding area at regular time intervals to determine if they are of the same ratio, or it may involve performing speech recognition on each audio and verifying a match by checking if the same text is detected.

[0138] At this time, the matching of the audio is determined not only by using the identity of similar sound patterns, but the processor (130) can also consider whether the volume of the audio is above a certain level.

[0139] Additionally, to compare whether they are the same, the processor (130) may perform a comparison operation by using only the mid-to-high frequency bands of the various frequency bands constituting the audio, or by assigning weights to the high frequency bands.

[0140] Meanwhile, if a pattern of inaudible frequencies is added to the audio signal, the processor (130) can check whether there is a pattern of the corresponding inaudible frequency band within the audio signal.

[0141] The processor (130) may obtain characteristic information including at least one of the screen size and model information of a display within a captured image based on a captured image, and may perform authentication by comparing the characteristic information and device information as well as whether there is an image match between the captured image and the image information.

[0142] Meanwhile, although the above description explains that authentication is performed by comparing the information described above, additional operations related to authentication may be performed in addition to the authentication operations described above. That is, the expression "performing the authentication described above" may include not only operations such as authentication or authorization that the terminal device may control the display, but also operations such as providing a user interface window for display control or data for displaying said user interface window to the terminal device.

[0143] As described above, the electronic device according to the present disclosure can perform an authentication procedure without hindering viewing, in that it can perform the authentication procedure without any separate modification to the screen displayed by the display.

[0144] Meanwhile, although only a simple configuration constituting the electronic device (100) has been illustrated and described above, various additional configurations may be provided during implementation. This will be explained below with reference to FIG. 3.

[0145] FIG. 3 is a block diagram illustrating the configuration of an electronic device according to one embodiment of the present disclosure.

[0146] Referring to FIG. 3, the electronic device (100') may include a communication unit (110), memory (120), processor (130), input / output interface (140), microphone (150), display (160), and speaker (170).

[0147] The configuration of the communication unit (110), memory (120), and processor (130) was previously described in FIG. 2, and only the operation different from FIG. 2 will be described below.

[0148] The input / output interface (140) may be any one of the following interfaces: HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), and DVI (Digital Visual Interface).

[0149] The input / output interface (140) can input and output at least one of audio and video signals. Depending on the implementation example, the input / output interface (140) may include separate ports for inputting and outputting only audio signals and for inputting and outputting only video signals, or it may be implemented as a single port for inputting and outputting both audio and video signals.

[0150] And the input / output interface (140) can provide a video signal corresponding to a screen generated by the electronic device (100') or an audio signal together with the video signal to an external device (e.g., a display device, an STB, etc.).

[0151] The microphone (150) can receive the user's voice when active. For example, the microphone (150) may be formed integrally on the upper side, front side, or side side of the electronic device (100'). The microphone (150) may include various configurations such as a microphone for collecting analog user voice, an amplifier circuit for amplifying the collected user voice, an A / D conversion circuit for sampling the amplified user voice and converting it into a digital signal, and a filter circuit for removing noise components from the converted digital signal.

[0152] When a user's voice is input through such a microphone (150), the processor (130) can check the content of the user's voice and perform an action corresponding to the content of the voice. For example, the content of the voice may be a request for control of the electronic device (100) (e.g., changing the source, adjusting the volume, etc.).

[0153] Meanwhile, although it has been described above that user voice is input through the microphone (150), the microphone may be provided in a remote control for controlling the electronic device (100'), and user voice input through the microphone provided in the remote control may be acquired from the terminal device (200) through the communication unit (110) described above and transmitted to the electronic device (100') for processing.

[0154] The electronic device (100') can operate not only based on the configuration or remote control provided in the electronic device (100'), but also according to the control command of the terminal device (200). For example, if the electronic device is a TV or a set-top box, recently, manufacturers provide applications for controlling the TV or set-top box. Such applications can provide a function that allows the terminal device to be used as a remote control for the electronic device.

[0155] Accordingly, when a user executes an application to control a TV or set-top box using a terminal device and inputs a voice command through the terminal device, the electronic device (100') can perform a voice recognition operation and a corresponding voice recognition result using the voice signal input through the terminal device. Meanwhile, such an operation can be performed after authentication of the terminal device (200) has been performed as previously described.

[0156] The display (160) can be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, and a PDP (Plasma Display Panel). The display (160) may also include a driving circuit, a backlight unit, etc., which can be implemented in forms such as an a-si TFT, an LTPS (low temperature poly silicon) TFT, and an OTFT (organic TFT). Meanwhile, the display (160) can be implemented as a touchscreen combined with a touch sensor, a flexible display, a 3D display, etc.

[0157] The display (160) can display various images. For example, the display (160) can display an image generated by the processor (130).

[0158] The speaker (170) can output sound. Specifically, the speaker (170) may be a component that outputs various audio data processed at the input / output interface, as well as various notification sounds or voice messages.

[0159] And the speaker (170) can output an inaudible audio pattern during the authentication process. Here, the inaudible frequency band may be an ultrasonic band, but any band that cannot be detected by humans is sufficient.

[0160] Meanwhile, although the electronic device (100) in FIG. 3 is illustrated and described as including a display (160), if the electronic device (100') is a device such as a set-top box that does not include a display, the display configuration may be omitted. Also, depending on the implementation form, the speaker and microphone described above may also be omitted. Additionally, although not illustrated in FIG. 3, other components (e.g., camera, human body detection sensor) may be further included.

[0161] FIG. 4 is a block diagram illustrating the configuration of a terminal device according to one embodiment of the present disclosure.

[0162] Referring to FIG. 4, the terminal device (200) may include a communication device (210), a memory (220), a processor (260), a display (230), an operating device (240), a camera (250), and a processor (260).

[0163] The communication device (210) is configured to communicate with various types of external devices according to various types of communication methods. The communication device (210) may include a first communication device (211) and a second communication device (215).

[0164] The first communication device (211) can use a Wi-Fi module as a device that communicates with an access point. The communication device (211) can establish a wireless connection with the access point. Through this operation, the communication device (211) can check the channel information of the access point.

[0165] The second communication device (215) is a device that performs bidirectional communication with other electronic devices and may include at least one communication chip that performs communication according to various wireless communication standards such as Bluetooth module, Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), 5G (5th Generation), etc.

[0166] The second communication device (215) can establish a wireless connection with the electronic device (100). If the second communication device (215) establishes a wireless connection with the electronic device (100), it can measure wireless signal strength, measure latency, or transmit and receive various data for authentication.

[0167] And when authentication is completed, the second communication device (215) can receive a user interface window for controlling the electronic device (100) and can transmit a control command for controlling the electronic device (100). In addition, the second communication device (215) can obtain a user voice command for controlling the electronic device (100) and transmit it to the electronic device (100).

[0168] The communication device (210) may further include a wired communication module that performs communication using a LAN (Local Area Network) module, an Ethernet module, a pair cable, a coaxial cable, a fiber optic cable, or an UWB (Ultra Wide-Band) module, etc.

[0169] The memory (220) may store instructions, programs, or data for controlling the terminal device (200). Here, the instructions may include instructions for performing an authentication procedure, instructions for controlling an electronic device, etc.

[0170] For example, the memory (220) may be implemented as internal memory such as ROM (e.g., EEPROM (electrically erasable programmable read-only memory)) or RAM included in the processor (260), or as memory separate from the processor (260). In this case, the memory (220) may be implemented in the form of memory embedded in the terminal device (200) or in the form of memory that can be attached to and detached from the terminal device (200), depending on the purpose of data storage. For example, data for operating the terminal device (200) may be stored in memory embedded in the terminal device (200), and data for the expansion function of the terminal device (200) may be stored in memory that can be attached to and detached from the terminal device (200).Meanwhile, the memory embedded in the terminal device (200) is implemented as at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), etc.), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), etc.), hard drive, or solid state drive (SSD), and the memory that can be attached to and detached from the terminal device (200) can be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.), external memory connectable to a USB port (e.g., USB memory).

[0171] The memory (220) can temporarily store information obtained from communication with the electronic device (100) or temporarily store a captured image created for authentication described later.

[0172] And the memory (220) can store various contents (e.g., broadcast content, applications, etc.) received through the communication device (210) described later. For example, the application may be an application for remote control of the electronic device (100).

[0173] Meanwhile, although the terminal device (200) is depicted as being composed of a single memory in the illustrated example, when distinguishing between volatile memory and non-volatile memory, the terminal device (200) may be described as including multiple memories.

[0174] The display (230) displays a user interface window for selecting functions supported by the terminal device (200). Specifically, the display (230) can display a user interface window for selecting various functions provided by the terminal device (200). This display (230) may be a monitor such as an LCD (liquid crystal display) or an OLED (Organic Light Emitting Diodes), and may also be implemented as a touchscreen capable of simultaneously performing some functions of the operating device (240) described later.

[0175] The display (230) can display a user interface window for remote control of the electronic device (100). The display (230) can also display matters that the user must be careful of when taking a picture during the authentication process. Examples of such cases will be described later with reference to FIGS. 8 and FIGS. 9.

[0176] The control device (240) can receive input from the user regarding the selection of a function of the terminal device (200) and control commands for the said function. This control device (240) may be a keyboard, mouse, touchpad, etc., and may include a microphone for receiving the user's voice.

[0177] The camera (250) can generate an image (or video) through a capturing operation. For example, the camera (250) can generate a still image, generate a video by continuously capturing for a certain period of time, or generate multiple still images at regular intervals.

[0178] The camera (250) includes a microphone and can acquire an audio signal using the included microphone. Meanwhile, in implementation, a separate microphone may acquire such an audio signal.

[0179] The processor (260) controls the overall operation of the terminal device (200). Specifically, the processor (260) is connected to the configuration of the terminal device including a communication device (210) and a memory (220), and can control the overall operation of the terminal device by executing at least one instruction stored in the memory (220) as described above. In particular, the processor (260) can be implemented as a single processor as well as as a plurality of processors.

[0180] The processor (260) may be implemented as one or more IC (integrated circuit (or circuitry)) chips and may perform various data processing operations. The processor (260) may include at least one electrical circuit and may process instructions (or programs, data, etc.) stored in memory individually or collectively in a distributed manner.

[0181] The processor (260) may include a processor assembly comprising one or more processing circuits. The processor (260) may include any processing circuit that is operative to control the performance and operations of one or more components of the terminal device (e.g., memory and / or driving device (sensor)). For example, the processor (260) (e.g., AP) may be implemented as a system on chip (SoC) (e.g., a single chip or a chipset). For example, the processor (260) may be implemented as multiple cores (or at least one core circuit), multiple chips, or multiple chipsets.

[0182] For example, the processor (260) may include one or more processing circuits. The processor (260) may include one or more processing circuits configured to perform various functions of the present disclosure individually and / or collectively. As an example without limitation, at least a portion of the processor (260) may be included in a first chip of the terminal device (200), and at least another portion of the processor (260) may be included in a second chip of a terminal device different from the first chip of the terminal device (200).

[0183] For example, the processor (260) may include a central processing unit (CPU), a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a display controller, a memory controller, a storage controller, a communication processor (CP), and / or a sensor interface. These components of the processor (260) are merely exemplary. The processor (260) may include additional components other than those described above. Additionally, some components of the processor (260) may be omitted. Furthermore, some components of the processor (260) may be included as separate components of the terminal device (200) outside of the processor (260). For example, some components of the processor (260) (e.g., a memory controller) may be included within other components (e.g., at least a portion of memory, an interface (e.g., available for connection to at least one component of the terminal device (200)), a display).

[0184] The processor (260) can cause other components of the terminal device (200) to perform various operations by executing instructions stored in memory (220).

[0185] The processor (260) processes setting values, function commands, etc. according to a stored control program or control data, and can output control signals related to functions that the terminal device can perform or communication signals for communicating with an external electronic device.

[0186] The processor (260) can control the communication device (210) to establish a wireless connection with an electronic device. For example, the processor (260) can control the communication device (210) to request the establishment of a wireless connection with an electronic device. To this end, the processor (260) can identify connectable devices and control the display (230) to display the identified devices. Then, when the processor (260) receives input from the user regarding whether to proceed with the authentication procedure for the displayed device, it can proceed with establishing a wireless connection with the device.

[0187] The processor (260) can capture content displayed on a display. For example, the processor (260) can receive information from the electronic device (100) regarding a data type to be used for authentication (e.g., video, audio, video + audio). In response, the processor (260) can capture only the video displayed on the display or capture a video combining video and audio based on the received data type.

[0188] This could be capturing a single frame, i.e., an image, or it could be video recording. Alternatively, it could be capturing images at regular time intervals. When such data types are received, recording can be performed in a manner corresponding to the received data types.

[0189] At this time, the processor (260) can control the communication device (210) to transmit information about the time of shooting to the electronic device (100). This information about the time may be information that causes the image displayed by the display to be captured or saved. Through such operation, the electronic device can minimize the information required for authentication.

[0190] And the processor (260) can perform shooting using preset settings. For example, shooting using a camera can be performed with various settings, and shooting can be performed with a setting value that has a resolution that can be used for image analysis in the electronic device (100). In addition, for the convenience of image analysis, the processor (260) may perform image quality processing on the captured video.

[0191] When the processor (260) generates a captured image, it can control the communication device (210) to transmit the generated captured image. For example, when an image is captured, the processor (260) can control the communication device (210) to transmit the captured image to the electronic device (100). Meanwhile, although the capturing operation and the transmission operation have been described separately above, the operations described above can be applied in a streaming manner during implementation.

[0192] That is, instead of ending a certain number of shots to generate shooting content and then performing a transmission operation, the processor (260) may transmit the generated video and / or audio signals to the electronic device (100) in units of a certain number of frames or units of a certain number of times.

[0193] And when authentication is performed with the transmitted video footage, the processor (260) can perform an authentication procedure in response to the permission of the electronic device (100). Accordingly, the processor (260) can control the display (230) to display a user interface window for controlling the electronic device. And when a control command is selected through the displayed user interface window, the processor (260) can control the communication device (210) to transmit the selected control command.

[0194] As described above, the terminal device according to the present disclosure can perform authentication without interfering with the viewing of the user or other users by using the screen currently displayed by the display as is, without using a QR code and PIN number that obscure the screen of the electronic device.

[0195] FIG. 5 is a sequence diagram for explaining an authentication process according to one embodiment of the present disclosure.

[0196] Referring to FIG. 5, an electronic device (100) and a terminal device (200) are illustrated.

[0197] The electronic device (100) can establish a wireless connection with the terminal device (200) (505). In the illustrated example, a BLE connection is assumed, but other wireless connections other than BLE may be used in implementation.

[0198] For example, the terminal device (200) can search for nearby electronic devices and display a list of the searched nearby electronic devices. The user can select an electronic device to connect to among the searched electronic devices. In this case, the terminal device (200) can request the establishment of a wireless connection to the electronic device selected by the user.

[0199] Once such a wireless connection is established, the terminal device (200) can transmit latency information related to data collection to the electronic device (100) (510).

[0200] The terminal device (200) may request the electronic device (100) to proceed with authentication (515). Upon receiving such a request for authentication, the electronic device may check the latency between the two devices (520). This latency can be utilized in the image storage and comparison process described later.

[0201] In response to an authentication request, the electronic device can determine the data type (530). For example, by considering the characteristics of the screen currently displayed by the electronic device, latency characteristics, and wireless signal strength between terminal devices, it can determine whether to use only video, use both video and audio, additionally to add a brightness change pattern to the video, or add a high-frequency signal to the sound.

[0202] For example, the electronic device (100) can determine the data type (video, sound) by considering the characteristics of the content as shown in Table 1 below.

[0203] TV Status Request Data No Sound Video Static Screen Sound Static Screen and No Sound Shooting at Specific Locations (Randomly transmitting specific shooting guides such as the left corner of the TV, the right corner of the TV, etc.) Static Screen & Sound Severe Noise Utilizing Ultrasound When Network Latency is High Image Change Patterns

[0204] As shown in Table 1, for dynamic images with many screen changes, a higher weight can be given to the image data to determine suitability. Conversely, for static images with few screen changes, a higher weight can be given to the voice data to make a judgment. Meanwhile, if the voice data is silent, the electronic device (100) can make a judgment by giving weight to the image data. If it is difficult to make a judgment because both are dynamic, authentication can be performed by using ultrasound together or by using a method that converts the image into a certain pattern.

[0205] When a data type is determined based on such criteria, the electronic device (100) can transmit the determined data type (535). At this time, the electronic device (100) can transmit a guidance message, etc. corresponding to the type to the terminal device (200). For example, when using information from a display device, it may be a guidance message stating that the entire exterior of the display must be photographed.

[0206] The terminal device (200) can acquire an image or audio signal captured by an electronic device in response to the transmitted data type (540). For example, the terminal device (200) can acquire an image or video using a camera and acquire audio data using a microphone.

[0207] At this time, the terminal device (200) can proceed with data acquisition based on the transmitted type as shown in Table 2 below.

[0208] Data requested by TV Data collection method Video type: Displays a guide overlaid on the camera screen to help the user shoot easily Audio type: Displays text guides based on data conditions to ensure TV sound is collected well (e.g., "Get closer to the TV" or "Turn up the volume") Specific location shooting guide: Displays a guide overlaid on the camera screen indicating the location requested by the TV

[0209] In response to the operation of such a terminal device (200), the electronic device (100) can store data according to the data type. This data may be referred to as comparison data or verification data. At this time, the electronic device (100) can store video and sound displayed on the display, taking into account the measured latency. For example, if the calculated latency is 500ms, the electronic device (100) can store video and sound from 1 second prior. The terminal device (200) can transmit a captured video (e.g., video and / or audio information) to the electronic device (100) (545). At this time, the terminal device (200) can also transmit time information regarding the captured video. This time information may be absolute time information, or it may be a relative time elapsed from the point in time when the electronic device (100) transmits the information of the data type.

[0210] When the electronic device (100) receives a captured image, it can proceed with an authentication procedure based on the received captured image and previously stored information (550). For example, if only the image is used, a specific image can be obtained from the captured image, and it can be checked whether the obtained image is in the stored image. Such image comparison can be performed by extracting (or cropping) an image corresponding to the screen from the captured image and comparing the cropped image with the stored screen (or image).

[0211] If audio is used together, the electronic device (100) can perform an authentication procedure by comparing the received audio data with previously stored data.

[0212] And the electronic device can transmit the authentication result to the terminal device (200) (560). For example, if authentication is successful, the connection between the TV and the mobile device is allowed, otherwise access may be denied. Meanwhile, if the connection is denied, the process described above may be repeated, or the data type used during the process may be changed.

[0213] Notification of such authentication results may involve providing a user interface window for controlling the electronic device or transmitting data corresponding to said user interface window.

[0214] Meanwhile, although FIG. 5 illustrates and describes a connection between two devices using BLE, other wireless connection methods such as Wi-Fi Direct may be used in addition to the wireless connection method described above.

[0215] FIG. 6 is a diagram illustrating an operation in response to an authentication request from another terminal device according to an embodiment of the present disclosure. Specifically, FIG. 6 is a diagram illustrating a method of connecting various electronic devices when electronic devices are located in a home.

[0216] Referring to FIG. 6, an electronic device (100) may be located inside a home (10), and a user's terminal device (200) may also be located inside the home (10). Additionally, another user's terminal device (20) may be located outside the home.

[0217] In the environment described above, if a user performs an authentication procedure for an electronic device, the strength of the wireless signal between the electronic device (100) and the terminal device (200) can be very high. Additionally, even when the electronic device outputs audio, the terminal device (200) can acquire the sound very accurately.

[0218] However, since the terminal device (20) is located outside the wall of the house, wireless signals can be picked up by the terminal device (20), but the screen of the electronic device (100) cannot be obtained. In addition, it is difficult to detect the sound output from the electronic device (100). If the user is watching a video at a very high volume, the terminal device (20) can obtain the sound, but since the sound transmitted through the wall is a signal in a relatively low frequency band, that is, a signal in a high frequency band is difficult to obtain by the terminal device (20).

[0219] If the terminal device (200) of the user who owns the display is used, the terminal device and the electronic device are adjacent, so the communication strength between the two devices can be high. In addition, the sound of the display device can also be recognized by the electronic device (100) without significant distortion or interference.

[0220] However, if the terminal device (20) is located outside the user's home and is adjacent to the display device, wireless signals can be transmitted and received from each other. In such a case where a wireless connection is possible, the terminal device (20) can request authentication from the display device.

[0221] However, as explained earlier, since it is external, it is difficult to authenticate in the first place because it is impossible to know what kind of screen is being output to the electronic device.

[0222] However, if the user is operating it at a very loud volume and watching a broadcast, other users may turn on the same broadcast on their own displays to proceed with the authentication process.

[0223] Even when such authentication is performed, if the communication strength between the electronic device and the terminal device is low, the authentication can be performed by utilizing various additional information in addition to the image. For example, as shown in Fig. 7 described later, the brightness of the image can be changed, and whether the brightness change is confirmed can be utilized. Alternatively, the entire display showing the screen can be photographed to obtain the size or model of the screen, and the authentication procedure can be performed by comparing characteristic information, such as the obtained size or model name, with device information of the display device.

[0224] Alternatively, inaudible sound can be output, and whether such sound is included in the captured video can also be utilized. In this case, the inaudible sound may be in the ultrasonic range. For example, while low-frequency sound can be transmitted through the walls of a house as described, high-frequency signals are highly likely to be unable to pass through.

[0225] Therefore, since such voice signals are not perceived by the user's ears when using them, authentication operations can be performed without interfering with the user's video viewing.

[0226] FIG. 7 is a drawing for explaining a screen display operation according to one embodiment of the present disclosure.

[0227] Referring to FIG. 7, the electronic device (100) can output an image. At this time, the electronic device (100) can modify the brightness of the image (710 -> 720 -> 730) step by step as shown in the time series. For example, the electronic device (100) can perform an operation to reduce the brightness of the image in a specific period, such as in the first pattern (740), or, as in the second pattern (750), increase the brightness for a certain period of time and then reduce the brightness again after a certain period of time.

[0228] If the brightness of the screen changes in this manner and such a change in brightness is confirmed in a video captured by the user, the electronic device can be considered as having directly captured the display. In other words, even if a display device used by another user happens to display the same image as the screen of the electronic device, the aforementioned change in luminance cannot be replicated, so authentication can be performed using the change in screen brightness.

[0229] Meanwhile, although the illustrated example illustrates and explains an example of changing the brightness of the screen, when implementing it, other patterns other than the brightness change pattern shown in the illustration may be used.

[0230] Additionally, although the illustrated example shows the brightness of the screen being adjusted for the entire area of ​​the screen, in implementation, the brightness of the screen may be adjusted for only a part of the screen. For example, the electronic device (100) may output an image with a basic brightness for one second, and then adjust the brightness so that only the outer area of ​​the screen has a lower brightness than the central area for the next second. In implementation, the central and outer areas may not be used, but may be divided into left area / right area, or divided into upper or lower area.

[0231] Additionally, when implementing, an object displayed at a fixed position within the image for a certain period of time may be used. For example, while displaying the sea, the brightness may be changed only for the area corresponding to the sea. Alternatively, the image may be analyzed to distinguish between areas where a lot of movement occurs and areas where it does not. Since the area where a lot of movement occurs may be the part where the user's gaze is drawn the most, the electronic device (100) may also change the brightness for the area furthest from the area with a lot of movement or for the area with almost no movement.

[0232] FIG. 8 is a drawing illustrating an example of a guide UI that can be displayed by a terminal device according to one embodiment of the present disclosure.

[0233] Referring to FIG. 8, the user interface window (810) displays a guidance message. For example, the user interface window (810) is a message window that can be displayed when it is determined that information from the display device is to be used.

[0234] As previously explained, when a display shows a terrestrial broadcast, there may be cases where a display of a user other than the owner of the display also outputs the same broadcast. Accordingly, when the electronic device (100) displays a terrestrial broadcast, it may perform authentication by also considering the characteristics of the actual display device. For example, the size or model of the display within the video may be obtained using a captured video, and the authentication procedure may be carried out by comparing the obtained information with previously known information about the display.

[0235] Meanwhile, in order to obtain information about the display device, not only the screen but also the exterior of the display is required, so it is necessary to photograph the exterior. Therefore, when it is decided to use information about the display device together, the terminal device may display a guide message to photograph the exterior as shown in FIG. 8.

[0236] Meanwhile, although the above description illustrates the use of a model through the screen size and external shape, the aspect ratio may also be used. For example, when displaying a 4:3 aspect ratio video on a 16:9 aspect ratio display, the video can be displayed in various ways (or ratios). Since such display forms may vary depending on the user, such display methods and forms can also be used as information for the display device.

[0237]

[0238] FIG. 9 is a drawing illustrating an example of a guide UI that can be displayed by a terminal device according to one embodiment of the present disclosure.

[0239] Referring to FIG. 9, the user interface window (910) displays a guidance message. For example, the user interface window (910) is a message window that may be displayed when using video captured over a certain period of time. For example, it may be when using a screen brightness pattern as shown in FIG. 8.

[0240] As explained earlier, when a display shows a terrestrial broadcast, there may be cases where a display belonging to a user other than the owner of the display also outputs the same broadcast.

[0241] In such cases, the screen of another display may also output the same screen. In this case, if only the image displayed on the screen is used, the right to use the display or electronic device may be accidentally granted to another user. To prevent this, the electronic device may change the screen brightness for a certain period of time within a range where the user does not perceive it or the user does not perceive any discomfort, as illustrated in FIG. 7.

[0242] To verify such changes, recording for a certain period of time is required. For example, it is necessary to record the screen for a certain duration or to capture the screen at regular intervals. Therefore, a guide message can be displayed instructing the user to maintain screen recording for a certain period of time so that this recording operation can be performed.

[0243] Meanwhile, when implementing, a guide voice or guide message indicating that the shooting operation may be stopped once sufficient time has passed and the shooting is complete may also be output.

[0244] FIG. 10 is a flowchart illustrating a method for controlling an electronic device according to one embodiment of the present disclosure.

[0245] Referring to FIG. 10, content information related to an image to be displayed on a display is stored (1010). Here, the content information may include at least one of image information, audio information, device information, and a brightness change pattern. Such storage operation may be a method of continuously storing image information within a certain time range, and may be performed when an authentication procedure is required or when event information related to shooting is received from a terminal device during the authentication procedure. The storage operation may be terminated when the authentication procedure is completed or when the captured image is received and authentication is no longer required.

[0246] The electronic device may prioritize determining the data type to be used for authentication and perform a storage operation based on the determined type. For example, the data type may include image (i.e., image), audio, image + audio, image + device information, or image + brightness conversion pattern.

[0247] For example, the determination of such data types may be based on the type of image and the degree of change in the image. For instance, if a user is watching a terrestrial broadcast that other users can also easily access, the electronic device may decide to use audio along with the image, use information from the display device along with the image, use screen brightness patterns along with the image, or use inaudible sound frequency output along with the image. In this case, if the image currently being output is a static image with minimal change, the electronic device may determine the data type from among methods that utilize information other than the image.

[0248] In addition, the wireless signal strength with the terminal device may be measured in advance, and the data type may be determined based on whether the measured wireless signal strength is below a certain value. For example, in a state where there is very good reception strength, such that the terminal device and the electronic device are expected to be within 1m of each other, it may be decided to perform authentication using only the video image, even while displaying a standard broadcast video. Conversely, in cases where the wireless signal is expected to be at a somewhat distant location, such as through a wall, other methods may be used instead of using only the video.

[0249] If the user is watching a video that is difficult for other users to easily obtain, the electronic device may decide to use only the video.

[0250] In addition, information regarding these data types can be provided to a terminal device so that the terminal device can provide information corresponding to the data type. At this time, the electronic device may also transmit information regarding the shooting method to the terminal device. For example, if information regarding a display device is also used, a guide may be provided indicating that the entire exterior of the display device needs to be photographed. Furthermore, if an audio signal is used, the terminal device (200) may provide a guide message instructing the device to take a picture at a location close to the electronic device.

[0251] And once the data type is determined, the electronic device can store data corresponding to the determined data type. For example, the electronic device can store images corresponding to a video at preset intervals, or store all frames of a certain interval.

[0252] If it is decided to use audio, the electronic device can store audio data. And if it is decided to use a preset brightness pattern, the electronic device can store the brightness pattern applied to the image.

[0253] In addition, if the electronic device uses inaudible sound, it can store the sound information used. Also, if the electronic device decides to use information from a display device, it can acquire information from the display device. Such information regarding the display device can be acquired and stored in advance. If the information from the display device cannot be acquired, the electronic device may exclude the use of the display device information during the preceding data type determination process.

[0254] Then, the electronic device obtains content information from the terminal device (1020). For example, it may receive information corresponding to the data type notified to the terminal device in the preceding process. For example, the content information may be data corresponding to an image obtained through a camera included in the terminal device, but it may also be audio data or video. Accordingly, the captured image may include only an image or may also include audio.

[0255] If it is decided to use information from a display device, but the display device is not identified in the captured video, or if the quality of the captured video is not lawful for use in the authentication process, the electronic device may request the terminal device to re-capture and send the video.

[0256] When a captured image is received in this manner, the electronic device can perform a function corresponding to authentication corresponding to a predetermined data type (1030). For example, if the predetermined data type proceeds only with images, the electronic device (100) can compare a previously stored image with the received image to check whether the images match.

[0257] For example, one image can be acquired from the received video, and authentication can be performed to determine whether the acquired image matches one of the previously stored images. In the process of selecting the image to be used for authentication, event information related to camera shooting notified by the terminal device and latency information can be considered.

[0258] If a screen change pattern is to be used, the electronic device can perform authentication by checking the brightness of the received captured image on a frame-by-frame or preset time-by-time basis and verifying whether such brightness change has a stored brightness change pattern.

[0259] In this case, if the determined data type is determined to also use audio information, the electronic device can extract audio information within the received video and compare the extracted audio information with the previously stored audio to check for a match.

[0260] In this case, determining whether the audio matches may involve not only utilizing the identity of similar sound patterns but also considering whether the volume of the audio is above a certain level. Additionally, to compare identity, the comparison operation may be performed by using only the mid-to-high frequency bands of the various frequency ranges constituting the audio, or by assigning weights to the high frequency bands.

[0261] Meanwhile, if a pattern of inaudible frequencies is added to an audio signal, the electronic device can check whether there is a pattern of the corresponding inaudible frequency band within the audio signal.

[0262] Alternatively, the electronic device may acquire characteristic information including at least one of the screen size and model information of a display within a captured image based on a captured image, and perform authentication of the terminal device (or a function corresponding to authentication) based on whether there is an image match between the captured image and the image information and a comparison of the received characteristic information and the device information stored in advance.

[0263] Meanwhile, if communication latency information between the terminal device and the electronic device is obtained, in the aforementioned authentication process, an image to be used for authentication among the stored image information based on the communication latency information can be obtained, and an image comparison operation can be performed based on the obtained image.

[0264] As described above, the control method of an electronic device according to the present disclosure can perform an authentication procedure without hindering viewing, in that it can perform the authentication procedure without separate modification to the screen displayed by the display.

[0265] Meanwhile, although the above description illustrates and explains that operations such as image comparison are performed by an electronic device, such comparison operations may be delegated to a terminal device during implementation. For example, the terminal device captures an image, the electronic device mixes the actual displayed image with a false image that is not displayed and transmits it to the terminal device, the terminal device compares the multiple images with the captured image and transmits the result to the electronic device, and the electronic device may perform authentication using only the comparison result.

[0266] FIG. 11 is a flowchart illustrating a method for controlling a terminal device according to one embodiment of the present disclosure.

[0267] Referring to FIG. 11, the terminal device can capture content displayed on a display (1110). Prior to this, the terminal device receives information from an electronic device regarding a data type to be used for authentication (e.g., video, audio, video + audio), and based on the received data type, it can capture only the video displayed on the display or capture a video combining video and audio.

[0268] This could be capturing a single frame, i.e., an image, or it could be video recording. Alternatively, it could be capturing images at regular time intervals. When such data types are received, recording can be performed in a manner corresponding to the received data types.

[0269] At this time, the terminal device (200) can transmit information about the time of shooting to the electronic device (100). This information about the time may be information that causes the image displayed by the display to be captured or saved. Through such operation, the electronic device can minimize the information required for authentication.

[0270] The terminal device can transmit captured content to the electronic device (100). For example, if an image is captured, the captured image can be transmitted to the electronic device (100).

[0271] And when authentication is performed with the transmitted captured video, the terminal device can perform an authentication procedure in response to the permission of the electronic device (100). Accordingly, the terminal device (200) can perform control over the electronic device (1130).

[0272] As described above, the control method of a terminal device according to the present disclosure can perform authentication of the terminal device without interfering with the viewing of the user or other users by using the screen currently displayed by the display as is, without using a QR code and PIN number that obscure the screen of the electronic device.

[0273] Meanwhile, methods according to at least some of the various embodiments of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.

[0274] In addition, methods according to at least some of the various embodiments of the present disclosure described above may be implemented by software upgrades or hardware upgrades alone for existing electronic devices.

[0275] In addition, methods according to at least some of the various embodiments of the present disclosure described above may also be performed through an embedded server equipped in an electronic device, or through at least one external server among the electronic devices.

[0276] Meanwhile, according to one embodiment of the present disclosure, the various embodiments described above may be implemented as software containing instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include an electronic device (e.g., an electronic device, a display device, a terminal device) according to the disclosed embodiments, as a device capable of calling instructions stored from the storage medium and operating according to the called instructions. When instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory storage medium" simply means that it is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily in the storage medium. ...not. For example, a 'non-transient storage medium' may include a buffer in which data is temporarily stored. According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TMIt can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., terminal devices). For online distribution, at least a portion of the computer program product (e.g., a downloadable app) may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0277] Various embodiments of the present disclosure may be implemented as software comprising instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include an electronic device (e.g., an electronic device (100)) according to the disclosed embodiments, which is a device capable of calling instructions stored from the storage medium and operating according to the called instructions.

[0278] When the above-described instruction is executed by a processor, the processor may perform the function corresponding to the above-described instruction directly or by using other components under the control of the above-described processor. The instruction may include code generated or executed by a compiler or an interpreter.

[0279] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.

Claims

In electronic devices, A communication unit (110) that communicates with a terminal device (200); Memory (120) for storing at least one instruction; and It includes one or more processors (130) that execute at least one of the above instructions, and The above one or more processors (130) are, An electronic device that stores image information for an image in the memory (120), receives data corresponding to an image obtained through a camera (250) included in the terminal device (200) from the terminal device (200) via the communication unit, and performs a function corresponding to authentication of the terminal device (200) based on the data received from the terminal device (200) and the information corresponding to the image. In paragraph 1, The above one or more processors (130) are, Controls the screen brightness to change within a preset time, and An electronic device that performs a function corresponding to authentication of the terminal device (200) based on whether there is a correspondence between the data received from the terminal device (200) and the information corresponding to the image, and a brightness change pattern corresponding to the change in screen brightness. In paragraph 1 or 2, The above one or more processors (130) are, An electronic device that acquires characteristic information including at least one of screen size and model information corresponding to the electronic device (100, 100') based on data received from the terminal device (200), and performs a function corresponding to authentication of the terminal device (200) based on the characteristic information and whether there is a correspondence between the data received from the terminal device (200) and the information corresponding to the image. In at least one of claims 1 to 3, The above one or more processors (130) are, An electronic device that controls the communication unit (110) to obtain a data type corresponding to authentication based on the above image and to transmit information corresponding to the obtained data type to the terminal device (200). In at least one of claims 1 to 4, The above one or more processors (130) are, An electronic device that stores information corresponding to the image output through the electronic device (100, 100') in the memory (120) when information related to acquiring data corresponding to the image is received from the terminal device (200) through the communication unit (110) via the camera (250) included in the terminal device. In paragraph 5, The above one or more processors (130) are, An electronic device that acquires information corresponding to the communication latency between the terminal device (200) and the electronic device (100, 100'), and acquires an image that serves as the basis for a function corresponding to the authentication among the information corresponding to the image based on the information corresponding to the communication latency. In at least one of claims 1 to 6, The above one or more processors (130) are, Control the memory (120) to store audio information corresponding to the above image, and An electronic device that performs a function corresponding to the authentication of the terminal device (200) based on audio information included in the data received from the terminal device (200) and audio information corresponding to the image. In Paragraph 7, The above one or more processors (130) are, An electronic device that performs a function corresponding to authentication of the terminal device (200) using audio information included in the data received from the terminal device (200) and audio information corresponding to the image that has a frequency higher than a preset frequency. In Article 7 or Article 8, Includes a speaker (170); The above one or more processors (130) are, The speaker (170) is controlled to output an audio signal having a preset pattern at a frequency other than the audible frequency, and An electronic device that performs a function corresponding to the authentication of the terminal device (200) when the audio information included in the data received from the terminal device (200) contains the preset pattern. In at least one of claims 1 to 9, The above one or more processors (130) are, An electronic device that controls the communication unit (110) so that when a function corresponding to the authentication of the terminal device (200) is performed, at least one of the status information of the electronic device (100, 100') and information related to a UI corresponding to the control of the electronic device (100, 100') is transmitted to the terminal device (200). In a method for controlling an electronic device (100, 1000'), Step of storing image information for an image; A step of receiving data corresponding to an image acquired through a camera included in the terminal device from a terminal device (200); and A control method comprising: a step of performing a function corresponding to the authentication of the terminal device (200) based on data received from the terminal device (200) and information corresponding to the image. In Paragraph 11, A step of controlling screen brightness to change within a preset time; including The step of performing the above function is, A control method that performs a function corresponding to authentication of the terminal device (200) based on whether there is a correspondence between the data received from the terminal device (200) and the information corresponding to the image, and a brightness change pattern corresponding to the change in screen brightness. In Article 11 or Article 12, The step of performing the above function is, A control method for obtaining characteristic information including at least one of screen size and model information corresponding to the electronic device (100, 100') based on data received from the terminal device, and performing a function corresponding to authentication of the terminal device (200) based on the characteristic information and whether there is a correspondence between the data received from the terminal device (200) and the information corresponding to the image. In at least one of claims 11 to 13, A step of obtaining a data type corresponding to authentication based on the above image; and A control method comprising the step of transmitting information corresponding to the acquired data type to the terminal device (200). In a non-transient computer-readable recording medium storing a program for executing a control method of an electronic device (100, 100'), The above control method is, Step of storing image information for an image; A step of receiving data corresponding to an image acquired through a camera included in the terminal device from a terminal device (200); and A computer-readable recording medium comprising: a step of performing a function corresponding to the authentication of the terminal device (200) based on data received from the terminal device (200) and information corresponding to the image.

Images