Electronic device and control method thereof

Abstract

An electronic device according to an embodiment may comprise: a communication circuit; a display; a memory including one or more storage media storing instructions; and at least one processor including processing circuitry, wherein the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: establish communication with a first device on the basis of a first communication scheme through the communication circuit; control the display to output information corresponding to a plurality of second devices connectable to the first device; acquire one or more second devices among the plurality of second devices as one or more control devices on the basis of reception of a user input corresponding to the output plurality of second devices; and establish communication with the acquired one or more control devices through the first device.

Description

Electronic device and control method thereof

[0001] The present disclosure relates to an electronic device for communicating with an external device and a method for controlling the same.

[0002] Electronic devices can communicate with external devices based on mutually shared communication protocols. With the advancement of communication technology, new communication protocols are being proposed for electronic devices to communicate with external devices. Changes in communication protocols can be a factor that hinders connection compatibility between devices.

[0003] The information described above may be provided as related art for the purpose of aiding understanding of this document. None of the foregoing is to be claimed as prior art related to this document, nor is it to be used to determine prior art.

[0004] The present disclosure provides an electronic device for communicating with an external device and a method for controlling the same.

[0005] An electronic device according to one example comprises a communication circuit; a display; a memory including one or more storage media for storing instructions; and at least one processor including a processing circuit. When the instructions are executed individually or collectively by at least one processor, the electronic device may be configured to perform a communication connection with a first device based on a first communication method through the communication circuit, control the display to output information corresponding to a plurality of second devices that can be connected to the first device, acquire one or more of the plurality of second devices as one or more control devices based on the reception of user input corresponding to the outputted plurality of second devices, and perform a communication connection with the acquired one or more control devices through the first device.

[0006] A control method for an electronic device according to one example performs a communication connection with a first device based on a first communication method through a communication circuit, controls a display to output information corresponding to a plurality of second devices that can be connected to the first device, acquires one or more of the plurality of second devices as one or more control devices based on the reception of user input corresponding to the outputted plurality of second devices, and can perform a communication connection with the acquired one or more control devices through the first device.

[0007] According to one example, an electronic device may use a first device as an interface for connection with one or more second devices.

[0008] Figure 1 is a block diagram illustrating an electronic device according to one example.

[0009] FIG. 2 is a diagram illustrating a method in which an electronic device according to one example performs a direct communication connection with an external device.

[0010] Figure 3 is a diagram illustrating a method in which an electronic device according to one example performs a communication connection with an external device through a relay device.

[0011] Figure 4 is a block diagram of an external device according to one example.

[0012] Figure 5 is a flowchart illustrating the operation method of an electronic device according to one example.

[0013] FIG. 6 is a diagram illustrating how an electronic device according to one example performs a communication connection with a second device through a first device.

[0014] FIG. 7 is a diagram illustrating metadata generated as a result of registering a second device in a first device according to one example.

[0015] FIGS. 8a and 8b are drawings illustrating a procedure for an electronic device according to one example to receive a signal generated by a second device.

[0016] FIG. 9 is a diagram illustrating that an electronic device according to one example performs a communication connection with a plurality of first devices.

[0017] FIG. 10 illustrates that an example electronic device performs a direct communication connection with a second device.

[0018] FIGS. 11a and 11b are drawings for explaining the operation of an electronic device according to one example.

[0019] FIG. 12 is a diagram illustrating the operation of communicating with an external device using multiple devices.

[0020] The electronic devices according to the various examples disclosed in this document may be of various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or consumer electronics. Consumer electronics may include, for example, image projection devices such as televisions, monitors, STBs (Set Top Boxes), or beam projectors capable of providing images based on content stored internally or supplied externally. Electronic devices according to the examples in this document are not limited to the devices described above.

[0021] The various examples and terms used in this document are not intended to limit the technical features described in this document to specific examples, and should be understood to include various modifications, equivalents, or substitutions of such examples. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another corresponding component and do not limit the components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0022] The terms “module” or “part” as used in the various examples of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module or part may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one example, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0023] In the present disclosure, the term "user" may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).

[0024] An example is described in more detail below with reference to the attached drawings.

[0025] Figure 1 is a block diagram illustrating an electronic device according to one example.

[0026] Referring to FIG. 1, the electronic device (100) may include at least one memory (110) (hereinafter referred to as 'memory (110)'), at least one processor (120) (hereinafter referred to as 'processor (120)'), a communication circuit (130), a display (140), an operation interface (150), a speaker (170), a microphone (180), or a camera (190).

[0027] The memory (110) may include internal memory such as ROM (e.g., EEPROM (electrically erasable programmable read-only memory)) and RAM included in the processor (120). The memory (110) may include a recording medium that is hardware-separated from the processor (120). Depending on the purpose of data storage, the memory (110) may be embedded in the electronic device (100) or detachable / attachable to the electronic device (100). For example, data for operating the electronic device (100) may be stored in memory embedded in the electronic device (100), and data for the extended functions of the electronic device (100) may be stored in memory that is detachable / attachable to the electronic device (100).

[0028] The memory embedded in the electronic device (100) may include at least one of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), hard drive, or solid state drive (SSD). The memory that can be attached to / detachably in the electronic device (100) may include at least one of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card)), or external memory that can be connected to a USB port (e.g., USB memory).

[0029] The memory (110) can store at least one instruction. Based on the instruction stored in the memory (110), the processor (120) can perform various operations.

[0030] The processor (120) may include at least one of a digital signal processor (DSP) that processes digital signals, a microprocessor, and / or a time controller (TCON). However, it is not limited thereto, and may include or be defined by one or more of a central processing unit (CPU), a micro controller unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a graphics-processing unit (GPU), a communication processor (CP), or an ARM (advanced reduced instruction set computer (RISC) machine) processor. The processor (120) may be implemented as a System on Chip (SoC) and / or a large scale integration (LSI) with a built-in processing algorithm. The processor (120) may be implemented in the form of a Field Programmable Gate Array (FPGA). The processor (120) can perform various functions by executing computer executable instructions stored in memory (110).

[0031] The communication circuit (130) can communicate with an external device according to the definition of a communication protocol that supports one or more communication methods. The communication circuit (130) can support one or more communication protocols for connecting an external electronic device (not shown). The communication circuit (130) may include a wireless communication module and / or a wired communication module. Each communication module may be implemented in the form of at least one hardware chip.

[0032] A wireless communication module may be a module that communicates wirelessly with an external device. For example, a wireless communication module may include at least one module among a Wi-Fi module, a Bluetooth module, an infrared communication module, or other communication modules.

[0033] Wi-Fi modules and Bluetooth modules can perform communication using Wi-Fi and Bluetooth methods, respectively. When using a Wi-Fi module or a Bluetooth module, various connection information, such as the SSID (service set identifier) ​​and session key, is transmitted and received first; after establishing a communication connection using this information, various types of information can be transmitted and received.

[0034] The infrared communication module performs communication according to infrared communication (IrDA, infrared Data Association) technology, which uses infrared rays located between visible light and millimeter waves to wirelessly transmit data over short distances.

[0035] Other communication modules may include at least one communication chip that performs communication according to wireless communication standards such as Zigbee, 3G (3rd Generation), 3GPP (3rd Generation Partnership Project), LTE (Long Term Evolution), LTE-A (LTE Advanced), 4G (4th Generation), and 5G (5th Generation), in addition to the communication method described above.

[0036] A wired communication module may be a module that communicates with an external device via a wire. For example, a wired communication module may include at least one of a Local Area Network (LAN) module, an Ethernet module, a pair cable, a coaxial cable, a fiber optic cable, or an Ultra Wide-Band (UWB) module.

[0037] According to one example, the communication circuit (130) may use the same communication module (e.g., Wi-Fi module) to communicate with an external device, such as a remote control device, and an external server.

[0038] According to one example, the communication circuit (130) may use different communication modules to communicate with external devices, such as a remote control device and an external server. For example, the communication circuit (130) may use at least one of an Ethernet module or a Wi-Fi module to communicate with an external server. For example, the communication circuit (130) may use a Bluetooth module to communicate with an external device, such as a remote control device. However, this is merely an example, and the communication circuit (130) may use at least one of several types of communication modules when communicating with multiple external devices or external servers.

[0039] The display (140) can be implemented as a display such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, or a PDP (Plasma Display Panel). The display (140) may also include a driving circuit and a backlight unit that can be implemented as an a-si TFT (amorphous silicon thin film transistor), an LTPS (low temperature poly silicon) TFT, or an OTFT (organic TFT). The display (140) can be implemented as a touch screen combined with a touch sensor, a flexible display, or a 3D display (or three-dimensional display). According to one example, the display (140) may include a display panel that outputs an image, as well as a bezel that houses the display panel. In particular, according to one example, the bezel may include a touch sensor (not shown) for detecting user interaction.

[0040] The operation interface (150) may be implemented as a device such as a button, touchpad, mouse and / or keyboard, or as a touch screen capable of performing the aforementioned display function and operation input function. The button may be a type of button such as a mechanical button, touchpad, or wheel formed on any area of ​​the front, side, or rear surface of the main body of the electronic device (100).

[0041] The input / output interface (160) may support one or more communication protocols for connecting an external electronic device (not shown). For example, the input / output interface (160) may include any one of the following interfaces: HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), or DVI (Digital Visual Interface). The input / output interface (160) may input and output at least one of audio and video signals. Depending on the implementation example, the input / output interface (160) may include separate ports for inputting and outputting only audio signals and for inputting and outputting only video signals, or it may be implemented as a single port for inputting and outputting both audio and video signals. The electronic device (100) can transmit at least one of audio and video signals to an external device (e.g., an external display device or an external speaker) through an input / output interface (160). An output port included in the input / output interface (160) can be connected to an external device. The electronic device (100) can transmit at least one of audio and video signals to an external device through an output port.

[0042] The input / output interface (160) can be connected to the communication circuit (130). The input / output interface (160) can transmit information received from an external device to the communication circuit (130) or transmit information received through the communication circuit (130) to the external device.

[0043] The speaker (170) can convert various audio data as well as electrical signals such as various notification sounds or voice messages into audible signals and output them.

[0044] The microphone module (180) can receive an audible signal, such as a user's voice or other sounds, and convert it into audio data, which is an electrical signal. The microphone module (180) can receive the user's voice when active. For example, the microphone module (180) may be formed integrally on the upper side, front side, or side side of the electronic device (100). The microphone module (180) may include components such as a microphone that collects the user's voice in an analog form and converts it into an audio signal, which is an electrical signal; an amplifier circuit that amplifies the converted audio signal; an analog-to-digital (A / D) conversion circuit that samples the amplified audio signal and converts it into a digital signal; and a filter circuit that removes noise components from the converted digital signal.

[0045] The camera module (190) can capture a subject and generate an image. Here, the image may include video and / or still images. The camera module (190) can acquire an image of at least one external device. The camera module (190) may include an image sensor, a lens, or an infrared sensor.

[0046] The lens included in the camera module (190) may be at least one of a general-purpose lens, a wide-angle lens, or a zoom lens. The type of lens to be included in the camera module (190) may be determined according to the type, characteristics, or usage environment of the electronic device (100). For the image sensor, a semiconductor device such as a Complementary Metal Oxide Semiconductor (CMOS) and / or a Charge Coupled Device (CCD) may be used.

[0047] According to one example, the electronic device (100) can form a communication link (i.e., a communication connection) with an external device through a communication circuit (130) and / or an input / output interface (160).

[0048] According to one example, the electronic device (100) may include a display (140). The electronic device (100) may directly display an acquired image or content screen on the display (140).

[0049] According to one example, the electronic device (100) may not include a display (140). The electronic device (100) may be connected to an external display device and may transmit an image or content screen stored in the electronic device (100) to the external display device.

[0050] The electronic device (100) can transmit video data for displaying an image or content screen to an external display device, along with a control signal for controlling the display of an image or content screen on the external display device. The external display device may be connected to the electronic device (100) via a communication circuit (130) or an input / output interface (160). For example, the electronic device (100) may not include a display, such as a Set Top Box (STB).

[0051] The electronic device (100) may include a small display capable of displaying only simple information, such as text information. The electronic device (100) may, for example, transmit image or video data to an external display device via a wired or wireless connection through a communication circuit (130) or to an external display device via an input / output interface (160). The electronic device (100) may, for example, convert image or video data into an optical signal using a projection device (not shown) and project it onto a projection surface such as a screen.

[0052] There may be various examples in which the electronic device (100) performs an action corresponding to a user voice signal received through the microphone (180).

[0053] According to one example, the electronic device (100) can control the display (140) based on a user voice signal received through a microphone (180). For example, when a user voice signal requesting a service of content A is received, the electronic device (100) can control the display (140) to display a screen regarding content A.

[0054] According to one example, an electronic device (100) can control an external display device connected to the electronic device (100) based on a user voice signal received through a microphone (180). The electronic device (100) can generate a control signal to control the external display device so that an action corresponding to the user voice signal is performed on the external display device, and can transmit the generated control signal to the external display device. The electronic device (100) can store a remote control application for controlling the external display device. The electronic device (100) can transmit the generated control signal to the external display device using at least one communication method among Bluetooth, Wi-Fi, or infrared. For example, when a user voice signal requesting a service of content A is received, the electronic device (100) can control the external display device to display a screen regarding content A. To this end, the electronic device (100) can transmit a control signal to the external display device for controlling the external display device. The electronic device (100) may include a terminal device capable of installing a remote control application, such as a smartphone or an AI speaker.

[0055] According to one example, an electronic device (100) may use a remote control device to control an external display device connected to the electronic device (100) based on a user voice signal received through a microphone (180). The electronic device (100) may transmit a control signal to the remote control device to control the external display device so that an action corresponding to the user voice signal is performed on the external display device. In this case, the remote control device may transmit the control signal received from the electronic device (100) to the external display device. For example, when a user voice signal requesting a service of content A is received, the electronic device (100) may transmit a control signal to the remote control device to control the display of a screen regarding content A on the external display device. The remote control device may transmit the received control signal to the external display device.

[0056] The electronic device (100) can receive user voice signals in various ways.

[0057] According to one example, the electronic device (100) can receive a user voice signal through a microphone (180) included in the electronic device (100).

[0058] According to one example, the electronic device (100) may receive a user voice signal from an external device including a microphone. For example, the external device may be a remote controller or a smartphone. The received user voice signal may be a digital voice signal, but may be an analog voice signal depending on the implementation example. The electronic device (100) may receive the user voice signal based on a wireless communication method such as Bluetooth or Wi-Fi.

[0059] The electronic device (100) can convert a user voice signal in a predetermined manner.

[0060] According to one example, an electronic device (100) can obtain text information corresponding to a user voice signal from an external server. The electronic device (100) can transmit a user voice signal (audio signal or digital signal) to an external server. The external server may refer to a speech recognition server. The speech recognition server can convert the user voice signal into text information using STT (Speech To Text). The external server can transmit text information corresponding to the converted user voice signal to the electronic device (100).

[0061] According to one example, the electronic device (100) can independently acquire text information corresponding to a user voice signal. The electronic device (100) may also apply a Speech To Text (STT) function directly to the digital voice signal to convert it into text information and transmit the converted text information to an external server.

[0062] The external server can transmit information to the electronic device (100) in various ways.

[0063] According to one example, an external server can transmit text information corresponding to a user voice signal to an electronic device (100). The external server may be a server that performs a voice recognition function of converting the user voice signal into text information.

[0064] According to one example, an external server may transmit at least one of text information corresponding to a user voice signal or search result information corresponding to text information to an electronic device (100). The external server may be a server that performs a search result providing function that provides search result information corresponding to text information, in addition to a voice recognition function that converts the user voice signal into text information. For example, the external server may be a server that performs both the voice recognition function and the search result providing function. For another example, the external server may perform only the voice recognition function. In this case, the search result providing function may be performed on a separate server. The external server may transmit text information to a separate server to obtain search results and obtain search results corresponding to text information from the separate server.

[0065] The electronic device (100) can establish a communication connection with an external device and / or an external server in a predetermined manner.

[0066] According to one example, a communication module for communication with an external device and an external server can be implemented in the same way. For example, an electronic device (100) can communicate with an external device using a Bluetooth module, and an external server can also communicate using a Bluetooth module.

[0067] According to one example, communication modules for communication with external devices and external servers may be implemented separately. For example, an electronic device (100) may communicate with an external device using a Bluetooth module and with an external server using an Ethernet modem or a Wi-Fi module.

[0068] According to various examples, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various examples, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various examples, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0069] FIG. 2 is a diagram illustrating a method in which an electronic device (100) according to one example performs a direct communication connection with an external device (210).

[0070] Referring to FIG. 2, the electronic device (100) can be directly connected (or paired) with one or more external devices (210) wirelessly or wired. The external device (210) may be, for example, a game pad. However, the external device (210) is not limited to a game pad and may be various electronic devices such as a keyboard, mouse, or touch pad.

[0071] According to one example, the electronic device (100) may not support the communication method (203) of the external device (210-2; 210-3). For example, communication with the external device (210-2) may only be possible through a specific communication method. In this case, the electronic device (100) that does not support the specific communication method may be unable to establish a communication connection with the external device (210-2). For example, the external device (210-3) may be equipped with a specific cable (210-3-1) for wired communication. In this case, the electronic device (100) that does not have a terminal to connect the specific cable (210-3-1) may be unable to establish a communication connection with the external device (210-3).

[0072] According to one example, the electronic device (100) may not support multiple communication channels capable of transmitting or receiving signals or information with multiple external devices (210-1; 210-2; 210-3). For example, the electronic device (100) may support only one communication channel. In this case, the electronic device (100) may only perform a communication connection with one of the multiple external devices (210-1; 210-2; 210-3), namely (210-1), and may not perform a communication connection with multiple external devices (210-1; 210-2; 210-3) simultaneously.

[0073] FIG. 3 is a diagram illustrating a method in which an electronic device (100) according to one example performs a communication connection with an external device (210) through a relay device (300).

[0074] In the following description, the relay device (300) will be referred to as the first device (300), and the external device (210) will be referred to as the second device (210).

[0075] *63 Referring to FIG. 3, the electronic device (100) can establish a communication connection (304) with the first device (300) via wired or wireless means. The first device (300) may be, for example, a remote controller. However, the first device (300) is not limited to a remote controller and may be an electronic device such as a tablet or a smartphone.

[0076] According to one example, the electronic device (100) does not support the communication method of the second device (210-1; 210-2; 210-3), so it cannot establish a direct communication connection with the second device (210-1; 210-2; 210-3). Since the first device (300) supports the communication method of the second device (210-1; 210-2; 210-3), it can establish a communication connection (301; 302; 303) with the second device (210-1; 210-2; 210-3). According to one example, the electronic device (100) can transmit and receive signals or information to and from the second device (210-1; 210-2; 210-3) through the first device (300).

[0077] According to one example, the electronic device (100) may not support multiple communication channels. For example, the electronic device (100) may support one communication channel. For example, the electronic device (100) may establish a communication connection (304) with one first device (300) through one communication channel. By connecting with the first device (300), the electronic device (100) may transmit and receive signals or information with a plurality of second devices (210-1; 210-2; 210-3) connected to the first device (300).

[0078] The present disclosure relates to an electronic device (100) that uses a first device (300) as an interface for connecting with one or more second devices (210). For example, the electronic device (100) can perform a communication connection with one or more second devices (210) through the first device (300).

[0079] FIG. 4 is a block diagram of an external device according to one example. For example, the external device (400) may be the first device (300) and / or the second device (210) shown in FIG. 3.

[0080] According to one example, the external device (400) may be, but is not limited to, a remote control, a mobile phone, a smartphone, a tablet PC, a notebook PC, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation device, an MP3 player, an AI speaker, a wearable device, a game pad, a keyboard, a mouse, a joystick, a microphone, or a headset. For example, the first device (300) may be a remote control, a mobile phone, a smartphone, a tablet PC, a notebook PC, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation device, an MP3 player, an AI speaker, or a wearable device. For example, the second device (210) may be a game pad, a keyboard, a mouse, a joystick, a microphone, or a headset. In the following description, the external device (400) may be used to refer to either the first device (300) or the second device (210).

[0081] Referring to FIG. 4, the external device (400) may include or be configured with at least one of a communication circuit (410), an operation interface (420), a processor (430), a memory (440), an input / output interface (450), a display (460), or a battery (470). The external device (400) may control a display device (e.g., the electronic device (100) of FIG. 1). The external device (400) may install (or download from an external source) an application (not shown) for controlling the electronic device (100).

[0082] According to one example, the processor (430) controls the overall operation of the external device (400) and the signal flow between internal components (410 to 470), and performs the function of processing data. According to one example, the processor (430) includes a CPU (central processing unit), etc., and can control the operation of various hardware provided in the external device by executing a software program according to at least one instruction stored in memory (440).

[0083] According to one example, the processor (430) can control the communication circuit (410), the operation interface (420), the input / output interface (450), and / or the display (460). According to one example, the processor (430) can control the transmission of a signal or information regarding user input received through the operation interface (420) to the electronic device (100) through the communication circuit (410) and / or the input / output interface (450).

[0084] According to one example, the communication circuit (410) is configured to communicate with an external electronic device (e.g., the electronic device (100) of FIG. 3 and / or other external device) based on a predetermined communication method. The communication circuit (410) may support one or more communication methods for connecting the external electronic device. For example, the communication circuit (410) may include at least one of wired Ethernet or wireless communication circuits. The wireless communication circuit may be, for example, Bluetooth, Bluetooth Low Energy, CAN communication, Wi-Fi, Wi-Fi Direct, ultrawide band (UWB), Zigbee, infrared data association (IrDA), near field communication (NFC), 3GPP, Wi-Max, LTE, or 5G (5 th It can include Generation).

[0085] According to one example, the input / output interface (450) may support one or more communication methods for connecting external electronic devices. For example, the input / output interface (450) may include at least one port among a Universal Serial Bus (USB) port, a High Definition Multimedia Interface (HDMI) port, a Mobile High-Definition Link (MHL) port, a Display Port (DP), a Thunderbolt port, a Video Graphics Array (VGA) port, an RGB port, a D-subminiature (D-SUB) port, or a Digital Visual Interface (DVI) port. The input / output interface (450) may be connected to a communication interface (410). According to one example, the input / output interface (450) may transmit information received from an external electronic device to the communication interface (410) or transmit information received through the communication interface (410) to the external electronic device.

[0086] According to one example, the operation interface (420) may include at least one of a button (421) for receiving user input (e.g., touch or press) for controlling the electronic device (100), a touch pad (423), a microphone (425) for receiving user voice, a sensor (427) for detecting motion of an external device, or a vibration motor (not shown) for providing haptic feedback.

[0087] According to one example, the operation interface (420) can transmit an electrical signal (e.g., an analog signal or a digital signal) corresponding to a received user input (e.g., a touch, a press, a touch gesture, a voice, or a motion) to a processor (430).

[0088] According to one example, the button (421) can transmit an electrical signal to the processor (430) in response to input by pressing. The touch pad (423) can transmit an electrical signal to the processor (430) in response to a touch or touch gesture. According to one example, the touch pad (423) can be located on the front of an external device (400) where the button (421) is not located.

[0089] According to one example, the microphone (425) receives voice spoken by the user. According to one example, the microphone (425) can convert the received voice into an electrical signal and transmit it to the processor (430).

[0090] According to one example, the sensor (427) can detect the internal state and / or external state of the external device (400). For example, it may include a motion sensor (not shown) that detects the movement of the external device (400), a gyroscope sensor (not shown) that detects the direction using the rotational inertia of the external device (400), an acceleration sensor (not shown) that detects the acceleration of three axes (e.g., X-axis, Y-axis, Z-axis) applied to the external device (400), or a gravity sensor (not shown) that detects the direction of gravity action. The sensor (427) can measure the motion acceleration or gravity acceleration of the external device (400), respectively.

[0091] According to one example, the sensor (427) can detect movement (or acceleration) of the external device (400) by the user. The processor (430) can generate a control signal corresponding to the movement of the external device (400) and transmit it to the electronic device (100) through the communication circuit (410).

[0092] According to one example, a vibration motor (not shown) can convert an electrical signal into a mechanical vibration under the control of a processor (430). For example, the vibration motor may include a linear vibration motor, a bar-type vibration motor, a coin-type vibration motor, or a piezoelectric vibration motor. When data is received from an electronic device (100), the processor (430) may operate the vibration motor (not shown). One or more vibration motors (not shown) may be located inside an external device (400). Additionally, the vibration motor (not shown) may cause the entire external device (400) to vibrate or only a part of the external device (400) to vibrate.

[0093] According to one example, a vibration motor (not shown) can output haptic feedback corresponding to the transmission of data under the control of a processor (430). The vibration motor (not shown) can provide various haptic feedback (e.g., intensity of vibration and duration of vibration corresponding to various haptic patterns) stored in memory (440) based on data transmitted by the processor (430). The haptic pattern can, for example, represent the vibration time of the vibration motor (not shown) on the horizontal axis (e.g., unit is 50 ms) and the vibration intensity of the vibration motor (not shown) on the vertical axis (e.g., unit is 500 mV).

[0094] According to one example, the display (460) may include, for example, an LCD (liquid crystal display), an OLED (Organic Light Emitting Diodes) type, a PDP (Plasma Display Panel) type, or a VFD (Vacuum fluorescent display) type display.

[0095] According to one example, the display (460) may display a broadcast channel number, a broadcast channel name, and / or the status of the electronic device (100) displayed on the electronic device (100).

[0096] According to one example, when an external device (400) and an electronic device (100) are connected via wireless communication, the display (460) may output information indicating the situation under the control of the processor (430). The display (460) may display text such as "BT connected" or "NFC connected" indicating that wireless communication is connected, for example.

[0097] According to one example, the memory (440) may store various data, programs, or applications for driving and controlling an external device (400) under the control of the processor (430). The memory (440) may store input or output signals or data corresponding to the driving of the communication circuit (410) and / or the battery (470). The memory (440) may store data corresponding to user input (e.g., touch, press, touch gesture, voice, or motion) received under the control of the processor (430) and / or data corresponding to the movement of the external device (400).

[0098] According to one example, the memory (440) may store external device information corresponding to the external device (400). The external device information may include a model name, a unique device ID, remaining memory capacity, the presence or absence of object data, a Bluetooth version, or a Bluetooth profile.

[0099] The battery (470) supplies power to the components (410 to 460) of the external device (400) under the control of the processor (430). The battery (470) can be charged by a power supply unit (not shown) located in the external device (400).

[0100] According to one example, an external device (400) can receive a user voice signal through a microphone (425). The external device (400) can convert the received voice into an electrical signal and transmit it to an electronic device (100). At this time, the electronic device (100) can receive the converted signal based on a wireless communication method such as Bluetooth or Wi-Fi.

[0101] According to one example, an external device (400) can control an electronic device (100) connected to the external device (400) based on a user voice signal received through a microphone (425). The external device (400) can generate a control signal to control the electronic device (100) so that an action corresponding to the user voice signal is performed on the electronic device (100), and can transmit the generated control signal to the electronic device (100). The external device (400) can store a remote control application for controlling the electronic device (100). The external device (400) can transmit the generated control signal to the electronic device (100) using at least one communication method among Bluetooth, Wi-Fi, or infrared. For example, when a user voice signal requesting a service of content A is received, the external device (400) can transmit a control signal to the electronic device (100) to control the display of a screen corresponding to content A on the electronic device (100). The external device (400) may be a terminal device capable of installing a remote control application, such as a smartphone or an AI speaker.

[0102] According to one example, the external device (400) may include a display (e.g., a touch screen or a display panel only without a touch panel) (460). According to one example, a user may control the electronic device (100) using function keys (e.g., channel keys) in a graphical user interface (GUI) provided by an application running on the external device (400).

[0103] According to one example, an external device (400) can establish a communication connection with an external electronic device (e.g., the electronic device (100) of FIG. 3 and / or another external device (210)) using a communication circuit (410) and / or an input / output interface (450).

[0104] According to one example, the external device (400) may be a first device (e.g., the external device (300) of FIG. 3) used as an interface to communicate with an electronic device (100) shown in FIG. 3 and another external device (e.g., the external device (210) of FIG. 3). For example, the electronic device (100) may establish a communication connection with the first device (300) based on a first communication method. For example, the first device (300) may establish a communication connection with the second device (210) based on a second communication method. For example, the first communication method may be different from the second communication method. For example, the first device (300) may relay communication between the electronic device (100) and the second device (210).

[0105] According to one example, the first device (300) can register the second device (210) to the first device (300). According to one example, the electronic device (100) can register (acquire as a control device) the second device (210) through relay of the first device (300). According to one example, the first device (300) can acquire information corresponding to a plurality of second devices capable of communication connection and transmit the acquired information corresponding to the second devices to the electronic device (100). The electronic device (100) can receive information corresponding to a plurality of second devices from the first device. A detailed explanation thereof will be provided later with reference to FIG. 6.

[0106] According to one example, the first device (300) may transmit a signal mapped to the signal received from the second device (210) to the electronic device (100) in response to receiving a signal from the second device (210). A detailed explanation thereof will be given later with reference to FIG. 7.

[0107] FIG. 5 is a flowchart for explaining the operation method of an electronic device (e.g., the electronic device (100) of FIG. 1) according to one example.

[0108] *96 In the examples of operations described in the present disclosure below, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, or at least two operations may be performed in parallel.

[0109] Referring to FIG. 5, the electronic device (100) can establish a communication connection with a first device (e.g., the first device (300) of FIG. 3) in operation 501. For example, the electronic device (100) can establish a communication connection with the first device (300) based on a first communication method through a communication circuit (e.g., the communication circuit (130) of FIG. 1). The communication circuit (130) can support the first communication method. For example, the electronic device (100) can establish a communication connection with the first device (300) (e.g., a remote control) based on Bluetooth.

[0110] In operation 503, the electronic device (100) can control a display (e.g., the display (140) of FIG. 1) to output information corresponding to a plurality of second devices (210) that can be connected to the first device. For example, the electronic device (100) can receive information corresponding to a plurality of second devices (e.g., the second device (210) of FIG. 3) that can be connected to it from the first device (300). The electronic device (100) can control a display to output information corresponding to a plurality of second devices (210) (e.g., a list of the second devices (210)). For example, the first device (300) can perform a communication connection with a plurality of second devices (210) based on a second communication method different from a first communication method. For example, the first device (300) may receive information corresponding to the plurality of second devices (210) from the plurality of second devices (210) based on the second communication method, and may register the plurality of second devices (210) based on the information corresponding to the plurality of second devices (210). The first device (300) may transmit the information corresponding to the plurality of second devices (210) to the electronic device (100). The electronic device (100) may receive information corresponding to the plurality of second devices (210) from the first device (300). For example, the information corresponding to the second devices (210) may include information such as the type of the second device (210) and a device identifier (ID). A detailed description thereof will be given later with reference to FIG. 6.

[0111] In operation 505, the electronic device (100) may acquire one or more of the second devices (210) among the plurality of second devices as one or more control devices. For example, the electronic device (100) may receive user input corresponding to the plurality of second devices (210), such as user input selecting one or more of the second devices among the plurality of second devices (210). For example, the electronic device (100) may receive user input through the first device (300). For example, the electronic device (100) may identify one or more of the second devices (210) selected by user input among the plurality of second devices (210). For example, the electronic device (100) may acquire the identified one or more second devices (210) as control devices capable of controlling the electronic device (100).

[0112] In operation 507, the electronic device (100) can establish a communication connection with one or more control devices (210) through the first device (300). For example, the control device (210) can generate a first input signal in response to user operation. For example, the first device (300) can receive the first input signal based on a second communication method. For example, the first device (300) can transmit a signal corresponding to the first input signal to the electronic device (100) based on the first communication method.

[0113] FIG. 6 is a diagram illustrating how an electronic device (100) according to one example performs a communication connection with a second device (210) through a first device (300).

[0114] Referring to FIG. 6, the electronic device (100) can establish a communication connection (610) with the first device (300) based on a first communication method. The first device (300) can establish a communication connection (601; 602; 603) with the second device (210-1; 210-2; 210-3) based on a second communication method. The electronic device (100) can acquire the second device (210-1; 210-2; 210-3) as a control device through the first device (300). The electronic device (100) can establish a communication connection with the control device (210-1; 210-2; 210-3) acquired through the first device (300).

[0115] Before the electronic device (100) acquires a control device, the first device (300) may establish a communication connection with a plurality of second devices (210) that can be connected to it. The first device (300) may register a plurality of second devices (210) to the first device (300). When registering the second devices (210) in the first device (300), user input may be required. In this case, the first device (300) may control a display (e.g., the display of the first device (300) and / or the display of the electronic device (100)) to output a UI for interacting with the user. When the second devices (210) are registered to the first device (300), the first device (300) may transmit information (e.g., device ID) corresponding to the registered second devices (210) to the electronic device (100).

[0116] According to one example, the first device (300) can generate an identifier (ID) for each of the second devices (210-1; 210-2; 210-3). According to one example, the ID for each of the second devices (210-1; 210-2; 210-3) can be arbitrarily assigned by the first device (300). According to one example, the ID for each of the second devices (210-1; 210-2; 210-3) can be assigned based on user input.

[0117] According to one example, the first device (300) can set the authority of the second device (210). For example, the authority of the second device (210) may include a first authority and a second authority. For example, the first authority may be an authority corresponding to the control of the electronic device (100) in a first state. For example, the first device (300) with the first authority may control the electronic device (100) only when the electronic device (100) is in the first state. For example, the second authority may be an authority corresponding to the control of the electronic device (100) in the first state and the electronic device (100) in the second state. For example, the first device (300) with the second authority may control the electronic device (100) in the first state or the second state. For example, the state of the electronic device (100) may include a first state and a second state. For example, the first state may be a state that performs an action in response to a request from the second device (210) (e.g., a specific content service state). For example, the second state may be a state different from the first state (e.g., a broadcast viewing state). For example, the first device (300) may set the permissions of the second device (210) when the second device (210) is registered.

[0118] According to one example, the second device (210) may be a game pad. According to one example, the first state of the electronic device (100) may be a "game state" that performs an action corresponding to the request of the game pad, namely, a game. For example, the game in the electronic device (100) may be executed based on a game application (or program) stored in the electronic device (100). For example, the game in the electronic device (100) may be executed by connecting to an external game server via wired or wireless connection. According to one example, the second state of the electronic device (100) may be a state different from the game state (e.g., a broadcast viewing state). For example, the second state of the electronic device (100) may be a "broadcast viewing state" in which broadcast content is played. According to one example, the first authority of the second device (210) may be a "game authority" corresponding to the control of the electronic device (100) in the game state. According to one example, the second authority of the second device (210) may be "full authority" corresponding to the control of the electronic device (100) in a game state and the electronic device (100) in a broadcast viewing state.

[0119] According to one example, the first device (300) can set the authority of the second device (210) according to user input. According to one example, the electronic device (100) can control the display to output a UI corresponding to the authority setting of the second device (210) in response to a request from the first device (300). For example, when the electronic device (100) including the display receives a request to set the authority for the second device (210) from the first device (300), the display can control the display to output a UI including identifiers (210-1'; 210-2'; 210-3') corresponding to the second devices (210-1; 210-2; 210-3) that are subject to authorization (e.g., connectable to the first device (310)). For example, when an electronic device (100) that does not include a display receives a request for authorization setting for a second device from a first device (300), it can provide a UI containing identifiers (210-1'; 210-2'; 210-3') corresponding to the second devices (210-1; 210-2; 210-3) that are authorized targets through a controllable display device (620).

[0120] For example, a user can select at least one specific identifier among the identifiers (210-1', 210-2', 210-3') displayed on the UI screen through the operation interface of the first device (300) (e.g., the operation interface (420) of FIG. 4) and determine the authority for the selected specific identifier. In this case, the first device (300) can transmit a selection signal to indicate that a specific identifier has been selected and information corresponding to the determined authority to the electronic device (100). The electronic device (100) can identify the target second device to which authority is to be granted based on the selection signal received from the first device (300). The electronic device (100) can determine the authority for the identified second device based on the information corresponding to the authority received from the first device (300). The electronic device (100) can transmit information corresponding to the authority of the second device (210) determined according to user input to the first device (300). For example, the first device (300) can set and store the authority of the second device (210) based on information transmitted by the electronic device (100). For example, the first device (300) can set the authority of the second device (210) to "game authority" or "full authority" depending on user input. The first device (300) can provide the authority information set for the second device (200) to the electronic device (100). According to one example, the first device (300) can change the stored authority information for the second device (210) depending on user input. Since the change of authority information for the second device (210) can be performed by substantially the same procedure as the operation for setting the authority, a detailed description will be omitted.

[0121] According to one example, the first device (300) may arbitrarily grant and set the authority of the second device (210). According to one example, if one second device (210) is connected, the first device (300) may set the authority of the connected second device (210) as the second authority. The first device (300) may provide the authority information set for the second device (200) to the electronic device (100).

[0122] According to one example, the first device (300) may transmit a second output signal to the electronic device (100) in consideration of the authority of the second device (210). A detailed explanation thereof will be given later with reference to FIG. 7.

[0123] According to one example, the first device (300) may set mapping information for each button or key (hereinafter collectively referred to as a key) of the second device (210). For example, the first device (300) may provide a mapping table that defines key values ​​to be transmitted to the electronic device (100) in response to a key selection in the second device (210). For example, the mapping table may define a mapping relationship between input values ​​that the first device (300) can receive from the second device (210) by a key selection included in the second device (210), and output values ​​to be transmitted to the electronic device (100) in response to each of the input values. A detailed description thereof will be provided later with reference to FIG. 7.

[0124] According to one example, the first device (300) may store information corresponding to the second device (210), such as the device ID, authorization, and mapping information of the second device (210), in the memory (440) of the first device (300). The first device (300) may transmit information corresponding to the second device to the electronic device (100). For example, information corresponding to the second device (210) may be generated in the form of metadata. A detailed description thereof will be given later with reference to FIG. 7.

[0125] In the following description, it is explained that an electronic device (100) performs a communication connection with a second device (210) through a first device (300). The electronic device (100) can control a display (e.g., the display (140) of FIG. 1) to output information corresponding to a plurality of second devices (210) that can be connected to the first device (300). The electronic device (100) can acquire one or more of the plurality of second devices (210) as one or more control devices. The electronic device (100) can perform a communication connection with one or more control devices through the first device (300).

[0126] According to one example, the electronic device (100) may control the display to output information corresponding to a plurality of second devices (210-1; 210-2; 210-3) that can be connected to the first device (300). For example, the plurality of second devices (210-1; 210-2; 210-3) that can be connected to the first device (300) may be devices that are registered or have been registered with the first device (300) and / or the electronic device (100). For example, the electronic device (100) may control the display to output a user interface (UI) to support the acquisition of a control device. For example, an electronic device (100) including a display can output a UI including identifiers (210-1'; 210-2'; 210-3') corresponding to second devices (210-1; 210-2; 210-3) obtainable by a control device in response to a request from a first device (300). For example, an electronic device (100) not including a display can control a display device (620) to output a screen including a UI including identifiers (210-1'; 210-2'; 210-3') corresponding to second devices (210-1; 210-2; 210-3) obtainable by a control device in response to a request from a first device (300).

[0127] When the electronic device (100) receives user input corresponding to a plurality of output second devices (210-1; 210-2; 210-3), it may acquire one or more of the second devices (210-1) among the plurality of second devices (210-1; 210-2; 210-3) as one or more control devices (210-1). For example, the electronic device (100) may receive user input through the operation interface of the first device (300) (e.g., the operation interface (420) of FIG. 4). For example, the user may select at least one identifier (210-1') among the identifiers (210-1'; 210-2'; 210-3') displayed on the UI. In this case, the first device (300) may transmit a selection signal to the electronic device (100) to indicate that at least one identifier (210-1') has been selected. The electronic device (100) can identify one or more second devices (210-1) among the second devices (210-1, 210-2, 210-3) that are acquired as control devices by means of a selection signal transmitted from the first device (300). The electronic device (100) can establish a communication connection with one or more control devices (210-1) through the first device (300). Accordingly, the electronic device (100) can receive signals or information generated from the control device (210-1) through the first device (300).

[0128] According to one example, the electronic device (100) may receive a signal or information generated by the control device (210-1) through the first device (300). For example, a user may operate (e.g., press) a key of the control device (210-1). For example, in response to the key operation, the control device (210-1) may generate a signal and transmit the generated signal to the first device (300). Hereinafter, the signal transmitted by the control device (210-1) to the first device (300) will be referred to as the 'first output signal'. For example, the first device (300) may receive a signal from the control device (210-1) based on a second communication method. Hereinafter, the signal from the control device (210-1) received by the first device (300) will be referred to as the 'first input signal'. The first input signal may be substantially the same signal as the first output signal. According to one example, the first device (300) may transmit a signal to the electronic device (100) in response to receiving the first input signal. Hereinafter, the signal transmitted by the first device (300) to the electronic device (100) will be referred to as the 'second output signal'. The electronic device (100) may receive a signal from the first device (300) based on the first communication method. Hereinafter, the signal received by the electronic device (100) from the first device (300) in response to the generation of the first input signal will be referred to as the 'second input signal'. The second input signal may be substantially the same signal as the second output signal. The second input signal (or second output signal) may be obtained from a mapping table based on the first input signal (or first output signal).

[0129] According to one example, the second input signal may include identification information (e.g., device ID) of the control device (210-1) and information corresponding to the first input signal. Upon receiving the identification information of the control device (210-1), the electronic device (100) can determine which control device the signal received through the first device (300) corresponds to. According to one example, the information corresponding to the first input signal may include the first input signal as is. According to one example, the information corresponding to the first input signal may include a signal mapped to the first input signal. A detailed explanation thereof will be provided later with reference to FIGS. 7 and 8.

[0130] According to one example, the electronic device (100) can set the authority of the second device (210). The description of the authority of the second device (210) is omitted as it is redundant.

[0131] FIG. 7 is a diagram illustrating metadata generated by registering a second device (e.g., the second device (210) of FIG. 3) in a first device (e.g., the first device (300) of FIG. 3) according to one example.

[0132] Referring to the bottom of FIG. 7, when a second device (e.g., the second device (210-1; 210-2; 210-3) shown in FIG. 3) is connected and registered to a first device (e.g., the first device (300) shown in FIG. 3), the first device (300) can generate information about the second device (210-1; 210-2; 210-3) in the form of metadata (700).

[0133] For example, metadata (700) may include information about a second device (210) including at least one of a device ID (701), a physical ID (703), a delay time (705), an authorization (707), or information (708) about a key of the second device (210). For example, the information (708) about a key of the second device (210) may be at least one of a key ID (709), a key name (711) indicating the function of the key, a first input signal (713), or a signal (715) mapped to the first input signal, for each key. For example, the device ID (701) may be an ID for identifying the second device (210). For example, the physical ID (703) may be an ID for identifying the model and / or manufacturer of the second device (210). For example, a delay time (705) may be set so that when multiple input signals are received at the first device (300), all received multiple signals are not transmitted to the electronic device (100). For example, the first device (300) may not transmit input signals received within a delay time (705) from the time a predetermined input signal is received to the electronic device (100). For example, the authority (707) is as described with reference to FIG. 5. For example, the key ID (709) may be an ID for identifying a key. For example, a name (711) indicating the function of a key may indicate the function of the key operating in the electronic device (100). For example, if a key with the key name (711) "up" is operated at the second device (210), an operation called "up" may be performed in the electronic device (300). For example, the first input signal (713) may mean an input signal received by the first device (300) from the second device (210) when a user operation for a specific key is input at the second device (210). For example, the signal (715) mapped to the first input signal may mean a code set signal for controlling the electronic device (100).

[0134] According to one example, the first device (300) may have information about a code set for controlling the electronic device (100). For example, the information about the code set refers to information about the function that the electronic device (100) performs in response to a signal generated by a user operating each button of the first device (300). For example, the first device (300) may generate and transmit an IR signal using the code set information.

[0135] According to one example, the first device (300) can map a key code selected from the code set of the first device (300) to the first input signal (713). For example, when the electronic device (100) is in a second state (e.g., a broadcast viewing state), the first device (300) can convert the input signal received from the second device (210) into a mapped key code and transmit it to the electronic device (100) when a user operation for a specific key is input from the second device (210). The electronic device (100) that receives the transmitted key code can perform a function corresponding to the key code. For example, the second input signal transmitted by the first device (300) to the electronic device (100) may include a code set signal mapped to the first input signal. For example, the electronic device (100) can receive the second input signal from the first device (300).

[0136] For example, referring to the mapping table (720) illustrated in FIG. 7, for a second device with device ID: 1, the first device (300) can map a signal "0101" (725) to a first input signal "2020" (723). For example, the "0101" signal may be a key code to indicate "up" in the electronic device (100). For example, when a user operates the key (721) with key ID: 1 in the second device with device ID: 1, the first device (300) can receive the first input signal "2020" (723) and transmit the signal "0101" (725) to the electronic device (100). The electronic device (100) can perform an operation "up" corresponding to the received signal "0101" (725).

[0137] For example, information corresponding to the second device (210) can be edited by user input. For example, the user can edit mapping information generated for each second device (210). For example, the user can edit mapping information through a UI screen displayed via the display (150) of the electronic device (100) and / or the display of the first device (300). For example, the UI screen may include at least one of identification information of the second device (e.g., device ID), the type of key of the second device, or information about a function to be set corresponding to the key of the second device.

[0138] For example, in a second device with device ID: 1, if a user inputs an operation to a key with key ID: 1 to perform a "down" function rather than an "up" function, the user can edit the mapping information to map a signal "0102" (727) indicating a "down" function to a first input signal "2020" (723).

[0139] For example, when the electronic device (100) and the second device (210) are directly connected, it was difficult to control the electronic device (100) using the second device (210) when the electronic device (100) is in a second state (e.g., when broadcast content is being played on the electronic device (100). This is because, when the electronic device (100) is in a second state, it is not set for what function the electronic device (100) will utilize the signal received from the second device (210).

[0140] According to one example, when the electronic device (100) is in a second state, the first device (300) may transmit a key code mapped to the first input signal to the electronic device (100) in response to receiving a first input signal from the second device (210). For example, a user may control the electronic device (100) on which broadcast content is being played by inputting user operations to perform a desired function at the second device (210).

[0141] FIGS. 8a and 8b are drawings for explaining the procedure for an electronic device (100) according to one example to receive a signal generated from a second device (210).

[0142] Referring to FIGS. 8a and 8b, the first device (300) may receive a first input signal (e.g., 811) corresponding to a user's key operation from the second device (210). When the first device (300) receives the first input signal (e.g., 811) generated by the second device (210), it may transmit a second input signal (e.g., 821) to the electronic device (100), taking into account the state of the electronic device (100) and the authority of the second device (210). The state of the electronic device (100) and the authority of the second device (210) are as described with reference to FIG. 6.

[0143] According to one example, the electronic device (100) can transmit information corresponding to its current state to the first device (300). For example, the electronic device (100) can transmit information corresponding to the state of the electronic device (100) to the first device (300) in response to a change in the state of the electronic device (100). According to one example, the first device (300) can store information corresponding to the transmitted state of the electronic device (100) in the memory of the first device (300). According to one example, the first device (300) can change the communication method for forming a communication connection with the electronic device (100) depending on the state of the electronic device (100).

[0144] According to one example, when the electronic device (100) is in a first state (e.g., game state), the first device (300) may not convert the first input signal (e.g., 811) into a mapped key code and transmit it to the electronic device (100). For example, when the electronic device (100) is in a first state, the first device (300) may transmit the first input signal to the electronic device (100) as is. For example, the second input signal transmitted by the first device (300) to the electronic device (100) may include the first input signal as is. In this case, the first device (300) may use a communication method to transmit the first input signal as is to the electronic device (100). For example, the electronic device (100) may be controlled by the first input signal. For example, the electronic device (100) may have information about the function that the electronic device (100) performs in response to the first input signal. For example, the electronic device (100) can obtain information about the function performed by the electronic device (100) in response to a first input signal (e.g., 811) from an external server.

[0145] According to one example, when the electronic device (100) is in a second state (e.g., a broadcast viewing state), the first device (300) can convert a first input signal into a mapped key code and transmit it to the electronic device (100). At this time, the first device (300) may use a communication method to transmit the mapped signal to the electronic device (100). For example, when the electronic device (100) is in a second state, the first device (300) can transmit a signal mapped in a mapping table corresponding to the first input signal to the electronic device (100). For example, the second input signal transmitted by the first device (300) to the electronic device (100) may include a signal mapped in a mapping table corresponding to the first input signal. For example, the electronic device (100) may be controlled by a signal mapped in a mapping table corresponding to the first input signal.

[0146] Referring to FIG. 8a, the authority of the second device (210) may be the first authority (810), and the state of the electronic device (100) may be the first state (830) or the second state (850).

[0147] Referring to the top of FIG. 8a, if the authority of the second device (210) is the first authority (810) and the state of the electronic device (100) is the first state (830), the first device (300) can transmit a second input signal (821) to the electronic device (100) in response to receiving a first input signal (811) from the second device (210). For example, the second input signal (821) may include the first input signal (811).

[0148] Referring to the bottom of FIG. 8a, if the authority of the second device (201) is the first authority (810) and the state of the electronic device (100) is the second state (850), the first device (300) does not transmit a signal to the electronic device (100) even if it receives the first input signal (811) from the second device (210). For example, if the authority of the second device (201) is the game authority and the state of the electronic device (100) is the broadcast viewing state, the first device (300) does not transmit a signal to the electronic device (100) even if it receives the first input signal (811) from the second device (210).

[0149] Referring to FIG. 8b, the authority of the second device (210) may be the second authority (815), and the state of the electronic device (100) may be the first state (830) or the second state (850).

[0150] Referring to the top of FIG. 8b, if the authority of the second device (210) is the second authority (815) and the state of the electronic device (100) is the first state (830), the first device (300) can transmit a second input signal (827) to the electronic device (100) in response to receiving a first input signal (817) from the second device (210). For example, the second input signal (827) may include the first input signal (817).

[0151] Referring to the bottom of FIG. 8b, if the authority of the second device (210) is the second authority (815) and the state of the electronic device (100) is the second state (850), the first device (300) can transmit a second input signal (829) to the electronic device (100) in response to receiving a first input signal (819) from the second device (210). For example, the second input signal (829) may include a signal mapped to a mapping table corresponding to the first input signal (819).

[0152] According to one example, when the electronic device (100) is in a second state (850), if user operation is input to a plurality of second devices (210) and the first device (300) receives a plurality of first input signals (819), the first device (300) can transmit a second input signal (829) to the electronic device (100) by taking into account the input time of the plurality of first input signals (819).

[0153] For example, when a game is executed on an electronic device (100), a plurality of second devices (210) may be used. That is, when the electronic device (100) is in a first state (810) (e.g., game state), the electronic device (100) can perform control corresponding to user operations input by a plurality of second devices (210). On the other hand, when the electronic device (100) is in a second state (850) (e.g., broadcast viewing state), it may not be desirable for the electronic device (100) to respond to all user operations input by a plurality of second devices (210). In this case, the electronic device (100) needs to perform control for only one user operation.

[0154] According to one example, when the electronic device (100) is in a second state (850), if the first device (300) receives a plurality of first input signals (819) from a plurality of second devices (210) for a short time interval (e.g., 300 ms), it may transmit only the signal (829) corresponding to the first received signal among the received signals to the electronic device (100). For example, the first device (300) may set a delay time (e.g., the delay time (705) of FIG. 7) for the second device (210). For example, the first device (300) may determine whether another first input signal was input before the delay time from the input time at which the target first input signal was input to the first device (300). If no other first input signal was input, the first device (300) may transmit the signal (829) corresponding to the target first input signal to the electronic device (100).

[0155] FIG. 9 is a diagram illustrating that an electronic device (100) according to one example performs a communication connection with a plurality of first devices (310; 330). For example, the plurality of first devices (310; 330) may include a first device (330) capable of connecting to an external network.

[0156] Referring to FIG. 9, the electronic device (100) can communicate with the second device (210) through at least one of the plurality of first devices (310; 330). For example, the electronic device (100) can establish a communication connection with the second device (210-1; 210-2; 210-3) through the first device (310). For example, the electronic device (100) can establish a communication connection with the second device (210-4; 210-5) through the first device (330). For example, the electronic device (100) can establish a communication connection with the second device (210-1; 210-2; 210-3) through the first device (310) and establish a communication connection with the second device (210-4; 210-5) through the first device (330). According to one example, the first device (330) may be a smartphone. However, the first device (330) is not limited to a smartphone and may be various other electronic devices.

[0157] According to one example, a remote control app may be installed on the first device (330). For example, a user can control the electronic device (100) and / or the second device (210-4; 210-5) through the remote control app installed on the first device (330). For example, information about the second device (210-4; 210-5) stored in the first device (330) can be edited through the remote control app on the first device (330).

[0158] According to one example, the first device (330) can be controlled by a service technician (930) via a remote control app. For example, the first device (330) can be controlled remotely by a service technician (930) using wireless communication (920). According to one example, the electronic device (100) and / or the second device (210-4; 210-5) can be controlled remotely by a service technician (930) via the first device (330).

[0159] FIG. 10 illustrates that an example electronic device (100) performs a direct communication connection with a second device (210).

[0160] Referring to FIG. 10, when the remaining battery level of the first device (300) becomes below a threshold value, the electronic device (100) can establish a direct communication connection (1010) with the second device (210).

[0161] For example, the first device (300) may be in a state of being connected to a second device (210-1; 210-2; 210-3) via communication (1001; 1002; 1003). For example, as described with reference to FIG. 6, the second device (210-1; 210-2; 210-3) may be registered to the first device (300).

[0162] According to one example, if the remaining battery level of the first device (300) is below a threshold value, the first device (300) may transmit information corresponding to the second device (210-1; 210-2; 210-3) registered with the first device (300) to the electronic device (100). The information corresponding to the second device (210-1; 210-2; 210-3) may be, for example, information necessary for the electronic device (100) to establish a direct communication connection with the second device (210-1; 210-2; 210-3).

[0163] According to one example, when the transmission of information from the second device (210-1; 210-2; 210-3) is completed, the electronic device (100) can establish a direct communication connection (1010) with the second device (210-1). For example, the electronic device (100) can establish a direct communication connection (1010) with the second device (210-1) by activating a communication method between the electronic device (100) and the second device (210-1). If the electronic device (100) does not support a communication method that allows it to establish a communication connection with the second device (210-2; 210-3), the electronic device (100) cannot establish a direct communication connection with the second device (210-2; 210-3) even if the remaining battery level of the first device (300) falls below a threshold value. When the electronic device (100) establishes a direct communication connection with the second device (210-1), the electronic device (100) may notify the first device (300) that it is establishing a direct communication connection (1010) with the second device (210-1). In this case, the first device (300) may disconnect the communication connection with the second device (210-1).

[0164] For example, if the remaining capacity of the battery of the first device (300) exceeds a threshold value, the first device (300) may transmit information to the electronic device (100) that the remaining capacity of the battery of the first device (300) exceeds the threshold value. For example, the battery of the first device (300) may be charged. For example, the battery of the first device (300) may be replaced with another battery having a higher remaining capacity.

[0165] For example, when the remaining battery level of the first device (300) exceeds a threshold value, the first device (300) can establish a communication connection (1001) with the second device (210-1). In this case, the electronic device (100) can disconnect the direct communication connection (1010) with the second device (210-1). According to one example, the electronic device (100) can delete information set for the direct communication connection (1010) with the second device (210-1) from the electronic device (100).

[0166] According to one example, the first device (300) may periodically or non-periodically transmit information regarding the remaining battery level of the first device (300) to the second device (210). According to one example, in response to identifying the remaining battery level of the first device (300) below a threshold value, the first device (300) may control the second device (210) to vibrate. According to one example, the first device (300) may control a display (e.g., a display of the electronic device (100) and / or a display of the first device (300)) to output information that the remaining battery level of the first device (300) is low.

[0167] FIGS. 11a and 11b are drawings for explaining the operation of an electronic device (100) according to one example.

[0168] Referring to FIGS. 11a and 11b, the electronic device (100) can establish a communication connection with the first device (300) based on the first communication method (1104).

[0169] According to one example, the electronic device (100) may enter a first state (e.g., a game state) in which an action corresponding to the request of the second device (210) is executed. According to one example, in response to entering the first state, the electronic device (100) may transmit information corresponding to the state of the electronic device (100) to the first device (300).

[0170] Referring to FIG. 11a, the first device (300) may not be in a state of being in a communication connection with the second device (210-1). According to one example, the electronic device (100) may transmit data to the first device (300) that corresponds to the activation of a communication method (e.g., Bluetooth) for a communication connection between the first device (300) and the second device (210-1) through a communication circuit (e.g., communication circuit (130) of FIG. 1). According to one example, the first device (300) may activate a communication method for a communication connection between the first device (300) and the second device (210-1) in response to receiving data that corresponds to the activation of the communication method. The first device (300) may establish a communication connection (1103) with the second device (210-1) based on the activated communication method. According to one example, the electronic device (100) may display a message on a display (e.g., the display (140) of FIG. 1) saying "Connect the second device" (e.g., "Connect a game pad" 1110) in response to entering a first state. According to one example, if the communication method for connecting the second device (210) to the first device (300) is a wired communication method (e.g., USB), the user may establish a communication connection between the first device (300) and the second device (210) via the wired communication method. When the first device (300) establishes a communication connection with the second device (210), the electronic device (100) may acquire the second device (210) as a control device of the electronic device (100) through the relay of the first device and establish a communication connection with the second device (210).

[0171] Referring to FIG. 11b, the electronic device (100) may be in a state where it is connected to a first device (300) via communication (1105), and the first device (300) may be connected to a second device (210-2; 210-3) via communication (1107; 1108). According to one example, the first device (300) may identify the number of connected second devices (210-2; 210-3) in response to receiving information corresponding to the state (game state) of the electronic device (100). If two or more second devices (210-2; 210-3) are connected to the first device (300), the first device (300) may transmit a signal to the electronic device (100) to display a message (e.g., "Select main game pad" (1120)) to set one of the two or more second devices (210-2; 210-3) as the main control device. The main control device may mean, for example, a second device set to have second authority. According to one example, any one of the two or more second devices (210-2; 210-3) connected to the first device (300) may be set as the main control device. According to one example, all of the two or more second devices (210-2; 210-3) connected to the first device (300) may be set as the main control devices.

[0172] At least one of the operations of the electronic device (100) described above can be performed in another device.

[0173] FIG. 12 is a diagram illustrating the operation of communicating with an external device using multiple devices.

[0174] Referring to FIG. 12, an electronic device (100) and a server (1200) can perform an operation to register a second device (210) as a control device (210). The operation to register the second device (210) as a control device can be performed by the electronic device (100) and the server (1200). For example, the electronic device (100) can perform an operation to receive user input for registering the second device as a control device. For example, the electronic device (100) can transmit the received user input to the server (1200). For example, the server (1200) can perform a control device (210) registration operation. For example, the server (200) can store information corresponding to the control device (210) in the server (1200). For example, the electronic device (100) can communicate with the control device (210) based on information corresponding to the control device (210) stored in the server (1200).

[0175] According to one example, an electronic device (100) comprises a communication circuit (130); a display (140); a memory (110) including one or more storage media for storing instructions; and at least one processor (120) including a processing circuit, wherein when the instructions are executed individually or collectively by at least one processor (120), the electronic device may be caused to perform a communication connection with a first device based on a first communication method through the communication circuit (130), control the display (140) to output information corresponding to a plurality of second devices that can be connected to the first device, and, based on receiving user input corresponding to the plurality of second devices output, acquire one or more of the plurality of second devices as one or more control devices, and perform a communication connection with the one or more control devices acquired through the first device.

[0176] According to one example, when the instructions are executed individually or collectively by at least one processor (120), the communication connection between the first device and the plurality of second devices may cause the electronic device to perform the communication connection based on a second communication method different from the first communication method.

[0177] According to one example, when the instructions are executed individually or collectively by at least one processor (120), the electronic device may be caused to receive information corresponding to the plurality of second devices from the first device through the communication circuit (130).

[0178] According to one example, when the instructions are executed individually or collectively by at least one processor (120), the electronic device is caused to transmit information corresponding to a current state to the first device through the communication circuit (130), and the information corresponding to the current state may include a first state that performs an operation corresponding to the request of the second device and a second state different from the first state.

[0179] According to one example, when the instructions are executed individually or collectively by at least one processor (120), the electronic device is caused to control the display to output a user interface corresponding to the authority setting of the second device, and the authority of the second device may include a first authority corresponding to the control of the device in the first state and a second authority corresponding to the control of the device in the first state and the device in the second state.

[0180] According to one example, when the instructions are executed individually or collectively by at least one processor (120), the electronic device may be caused to transmit data to the first device corresponding to the activation of a communication method for a communication connection between the first device and the second device through the communication circuit (130).

[0181] According to one example, when the instructions are executed individually or collectively by at least one processor (120), the electronic device may be caused to receive data including a code set signal for controlling the electronic device mapped to a signal generated from the control device from the first device through the communication circuit (130).

[0182] According to one example, when the instructions are executed individually or collectively by at least one processor (120), if the remaining battery level of the first device is below a threshold value, the electronic device may be caused to perform a communication connection with the second device.

[0183] According to one example, the first device may include at least one of a remote control, a mobile phone, a smartphone, a tablet PC, a notebook PC, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation device, an MP3 player, an AI speaker, or a wearable device.

[0184] According to one example, the second device may include at least one of a game pad, keyboard, mouse, joystick, microphone, or headset.

[0185] According to one example, a control method for an electronic device (100) may include performing a communication connection with a first device based on a first communication method through a communication circuit (130), controlling a display (140) to output information corresponding to a plurality of second devices that can be connected to the first device, receiving user input corresponding to the outputted plurality of second devices, acquiring one or more of the plurality of second devices as one or more control devices, and performing a communication connection with the acquired one or more control devices through the first device.

[0186] According to one example, in a method for controlling an electronic device (100), the communication connection between the first device and the plurality of second devices can be performed based on a second communication method different from the first communication method.

[0187] According to one example, in a method for controlling an electronic device (100), information corresponding to the plurality of second devices can be received from the first device through the communication circuit (130).

[0188] According to one example, in a method for controlling an electronic device (100), information corresponding to a current state is transmitted to a first device through the communication circuit (130), and the information corresponding to the current state may include a first state that performs an operation corresponding to a request of the second device and a second state different from the first state.

[0189] According to one example, in a method for controlling an electronic device (100), the display is controlled to output a user interface corresponding to the authority setting of the second device, and the authority of the second device may include a first authority corresponding to the control of the device in the first state and a second authority corresponding to the control of the device in the first state and the device in the second state.

[0190] According to one example, in a control method for an electronic device (100), data corresponding to the activation of a communication method for a communication connection between the first device and the second device through the communication circuit (130) can be transmitted to the first device.

[0191] According to one example, in a method for controlling an electronic device (100), data including a code set signal for controlling the electronic device, which is mapped to a signal generated from the control device from the first device through the communication circuit (130), can be received.

[0192] According to one example, in a method for controlling an electronic device (100), if the remaining battery level of the first device is below a threshold value, a communication connection can be established with the second device.

[0193] According to one example, in a method for controlling an electronic device (100), the first device may include at least one of a remote control, a mobile phone, a smartphone, a tablet PC, a notebook PC, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation device, an MP3 player, an AI speaker, or a wearable device.

[0194] According to one example, in a method for controlling an electronic device (100), the second device may include at least one of a game pad, a keyboard, a mouse, a joystick, a microphone, or a headset.

[0195] According to one example, in a method for controlling an electronic device (100), the second device may include at least one of a game pad, a keyboard, a mouse, a joystick, a microphone, or a headset.

[0196] The methods according to the various examples of the present disclosure described above can be implemented in the form of an application that can be installed on an existing electronic device.

[0197] The methods according to the various examples of the present disclosure described above can be implemented by software upgrades or hardware upgrades alone for existing electronic devices.

[0198] Various examples of the present disclosure described above may also be performed through an embedded server equipped in an electronic device, or through an external server among at least one of the electronic device and the display device.

[0199] According to one example of the present disclosure, the various examples described above may be implemented as software comprising instructions stored on a machine-readable storage medium (e.g., a computer). The machine may include electronic devices according to the disclosed examples, which are devices capable of calling instructions stored from the storage medium and operating according to the called instructions. When instructions are executed by a processor, the processor may perform a function corresponding to the instructions directly or by using other components under the control of the processor. Instructions may include code generated or executed by a compiler or an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" means only that the storage medium does not contain a signal and is tangible, and does not distinguish whether data is stored semi-permanently or temporarily in the storage medium.

[0200] According to one example, the methods according to the various examples described above may be provided as part of a computer program product. The computer program product may be traded between a seller and a buyer as a commodity. The computer program product may be distributed online in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or through an application store (e.g., Play Store™). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0201] Each component (e.g., module or program) according to the various examples described above may consist of a singular or multiple entities, and some of the aforementioned sub-components may be omitted, or other sub-components may be additionally included in the various examples. Generally or additionally, some components (e.g., module or program) may be integrated into a single entity to perform the same or similar functions as those performed by each of the respective components prior to integration. The actions performed by the module, program, or other components according to the various examples may be executed sequentially, in parallel, iteratively, or heuristically, or at least some actions may be executed in a different order, omitted, or other actions added.

[0202] Although preferred examples of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific examples described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.

Claims

1. In an electronic device (100), Communication circuit (130); Display (140); Memory (110) comprising one or more storage media for storing instructions; and It includes at least one processor (120) including a processing circuit, and When the above instructions are executed individually or collectively by at least one processor (120), A communication connection with a first device is performed based on a first communication method through the above communication circuit (130), and The display (140) is controlled to output information corresponding to a plurality of second devices that can be connected to the first device, and Based on receiving user input corresponding to the plurality of second devices output above, one or more of the plurality of second devices are acquired as one or more control devices, and Causing the electronic device to perform a communication connection with one or more control devices obtained through the first device, Electronic device.

2. In Paragraph 1, When the above instructions are executed individually or collectively by at least one processor (120), The communication connection between the first device and the plurality of second devices causes the electronic device to perform the communication connection based on a second communication method different from the first communication method, Electronic device.

3. In Paragraph 1 or 2, When the above instructions are executed individually or collectively by at least one processor (120), The electronic device causes to receive information corresponding to the plurality of second devices from the first device through the communication circuit (130). Electronic device.

4. In any one of paragraphs 1 through 3, When the above instructions are executed individually or collectively by at least one processor (120), The electronic device is induced to transmit information corresponding to the current state to the first device through the communication circuit (130), and An electronic device comprising information corresponding to the above current state, a first state that performs an operation corresponding to the request of the second device, and a second state different from the first state.

5. In Paragraph 4, When the above instructions are executed individually or collectively by at least one processor (120), The electronic device is caused to control the display to output a user interface corresponding to the permission setting of the second device, and The authority of the second device comprises a first authority corresponding to the control of the device in the first state and a second authority corresponding to the control of the device in the first state and the device in the second state, in an electronic device (100).

6. In any one of paragraphs 1 through 5, When the above instructions are executed individually or collectively by at least one processor (120), The electronic device causes the first device to transmit data corresponding to the activation of a communication method for a communication connection between the first device and the second device through the communication circuit (130). Electronic device.

7. In any one of paragraphs 1 through 6, When the above instructions are executed individually or collectively by at least one processor (120), Causing the electronic device to receive data including a code set signal for controlling the electronic device mapped to a signal generated from the control device from the first device through the communication circuit (130), Electronic device.

8. In any one of paragraphs 1 through 7, When the above instructions are executed individually or collectively by at least one processor (120), If the remaining battery level of the first device is below a threshold value, the electronic device causes to perform a communication connection with the second device. Electronic device.

9. In any one of paragraphs 1 through 8, The first device is an electronic device comprising at least one of a remote control, a mobile phone, a smartphone, a tablet PC, a notebook PC, a PDA (Personal Digital Assistants), a PMP (Portable Multimedia Player), a navigation system, an MP3 player, an AI speaker, or a wearable device.

10. In any one of paragraphs 1 through 9, The second device is an electronic device comprising at least one of a game pad, keyboard, mouse, joystick, microphone, or headset.

11. A method for controlling an electronic device (100), A communication connection with a first device is established based on a first communication method through a communication circuit (130), and Control the display (140) to output information corresponding to a plurality of second devices that can be connected to the first device, and Based on receiving user input corresponding to the plurality of second devices output above, one or more of the plurality of second devices are acquired as one or more control devices, and Performing a communication connection with one or more control devices obtained through the first device, Control method.

12. In Paragraph 11, The communication connection between the first device and the plurality of second devices performs the communication connection based on a second communication method different from the first communication method. Control method.

13. In Paragraph 11 or 12, Receiving information corresponding to the plurality of second devices from the first device through the communication circuit (130), Control method.

14. In any one of paragraphs 11 through 13, Information corresponding to the current state is transmitted to the first device through the communication circuit (130), and A control method comprising information corresponding to the above current state, a first state that performs an operation corresponding to the request of the second device, and a second state different from the first state.

15. In Paragraph 14, Control the display to output a user interface corresponding to the permission settings of the second device, and A control method comprising the authority of the second device, the first authority corresponding to the control of the device in the first state and the second authority corresponding to the control of the device in the first state and the device in the second state.

Images