Electronic device and control method therefor
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2026-01-30
- Publication Date
- 2026-08-13
Smart Images
Figure KR2026001846_13082026_PF_FP_ABST
Abstract
Description
Electronic device and control method thereof
[0001] The present disclosure relates to an electronic device that switches an input device based on battery information of the input device and a method for controlling the same.
[0002] Thanks to advancements in electronic technology, various types of electronic devices are being used in daily life. Among these electronic devices, there may be those that perform input operations through connected input devices.
[0003] For example, there may be a display device that performs input actions through a game pad.
[0004] Here, an input device refers to a hardware device for transmitting user commands or data to a system, such as an electronic device.
[0005] An electronic device according to the present disclosure comprises a communication unit for performing communication with an external device, a memory for storing at least one instruction, and at least one processor for executing said at least one instruction. The at least one processor identifies said second input device by receiving a signal corresponding to said input event through the communication unit when data corresponding to the battery of a first input device obtained becomes less than or equal to a preset value and an input event occurs in a second input device. If said second input device is already connected, the processor activates a function corresponding to the connection with said second input device and controls the execution of an input operation using said second input device through said activated function. The first input device and the second input device are input devices connected to one of said electronic device and said external device.
[0006] The above input event may be an event including at least one of receiving a button input through the second input device, receiving a touch input, and receiving a user interaction input.
[0007] The electronic device further includes a display, and the at least one processor controls the display to display an image received from the external device through the communication unit when the first input device is connected to the external device, and can obtain data corresponding to the battery of the first input device connected to the external device based on the image displayed on the display.
[0008] The above at least one processor acquires visual data based on an image displayed on the display and acquires data corresponding to the battery based on the visual data, and the visual data may be data including at least one of a battery UI, text corresponding to the remaining battery amount, and a battery icon.
[0009] If the visual data includes text corresponding to the remaining battery amount, the above-mentioned at least one processor can acquire data corresponding to the battery through a function corresponding to Optical Character Recognition (OCR) based on the visual data.
[0010] The above at least one processor can control the communication unit so that, when the second input device is connected to the external device, the second input device disconnects from the external device and performs a connection with the electronic device, and can control the second input device to perform an input operation using the second input device through a function corresponding to the connection with the activated second input device.
[0011] The electronic device further includes a display, and the at least one processor identifies the second input device with the highest priority among a plurality of input devices based on user history data when data corresponding to the battery of the acquired first input device becomes less than or equal to a preset value and no input event occurs in the second input device within a preset time, and controls the display to display a UI corresponding to a request for user input for connection with the identified second input device, and the user history data may be data including at least one of connection history and usage frequency history.
[0012] The above at least one processor can identify the input device with the highest usage frequency among the plurality of input devices as the second input device with the highest priority.
[0013] When a plurality of input devices with the highest usage frequency are identified, the above-mentioned at least one processor can identify the most recently connected input device among the plurality of input devices with the highest usage frequency as the second input device with the highest priority based on the connection history.
[0014] When the above at least one processor activates a function corresponding to a connection with the second input device, it can disable a function corresponding to a connection with the first input device.
[0015] A control method for an electronic device according to the present disclosure comprises the steps of: acquiring data corresponding to a battery of a first input device; identifying the second input device by receiving a signal corresponding to the input event when an input event occurs at the second input device after the data corresponding to the battery becomes less than or equal to a preset value; activating a function corresponding to the connection with the second input device when the second input device is already connected; and controlling to perform an input operation using the second input device through the activated function. The first input device and the second input device may be input devices connected to one of the electronic device and the external device.
[0016] The above input event may be an event including at least one of receiving a button input through the second input device, receiving a touch input, and receiving a user interaction input.
[0017] The step of acquiring data corresponding to the battery of the first input device may include, if the first input device is connected to an external device, a step of displaying an image received from the external device and a step of acquiring data corresponding to the battery of the first input device connected to the external device based on the displayed image.
[0018] The step of acquiring data corresponding to the battery of the first input device includes the step of acquiring visual data based on the displayed image and the step of acquiring data corresponding to the battery based on the visual data, and the visual data may be data including at least one of a battery UI, text corresponding to the remaining battery amount, and a battery icon.
[0019] The step of acquiring data corresponding to the battery based on the above visual data may include, if the above visual data includes text corresponding to the remaining battery amount, the step of acquiring data corresponding to the battery through a function corresponding to Optical Character Recognition (OCR) based on the above visual data.
[0020] The above control method may further include the step of controlling the second input device to disconnect from the external device and perform a connection with the electronic device when the second input device is connected to the external device, and the step of controlling the second input device to perform an input operation using the second input device through a function corresponding to the connection with the activated second input device.
[0021] The above control method further includes the steps of identifying the second input device with the highest priority among a plurality of input devices based on user history data when data corresponding to the battery of the first input device obtained becomes less than or equal to a preset value and no input event occurs in the second input device within a preset time, and displaying a UI that responds to a request for user input for connection with the identified second input device, wherein the user history data may be data including at least one of connection history and usage frequency history.
[0022] The step of identifying the second input device may include identifying the input device with the highest usage frequency among the plurality of input devices as the second input device with the highest priority.
[0023] The step of identifying the input device with the highest usage frequency among the plurality of input devices as the second input device with the highest priority may include, when the plurality of input devices with the highest usage frequency are identified, identifying the input device most recently connected based on the connection history among the plurality of input devices with the highest usage frequency as the second input device with the highest priority.
[0024] In a non-transient readable recording medium comprising a program for executing a method for controlling an electronic device according to the present disclosure, the method for controlling the electronic device comprises the steps of: acquiring data corresponding to a battery of a first input device; identifying the second input device by receiving a signal corresponding to the input event when an input event occurs at the second input device after the data corresponding to the battery becomes less than or equal to a preset value; activating a function corresponding to a connection with the second input device when the second input device is already connected; and controlling to perform an input operation using the second input device through the activated function, wherein the first input device and the second input device are input devices connected to one of the electronic device and the external device.
[0025] FIG. 1 is a drawing for explaining the operation of an electronic device according to at least one embodiment of the present disclosure.
[0026] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to at least one embodiment of the present disclosure.
[0027] FIG. 3 is a detailed block diagram for illustrating an electronic device according to at least one embodiment of the present disclosure.
[0028] FIG. 4 is a diagram illustrating the operation of an electronic device according to at least one embodiment of the present disclosure switching an input device connected to the electronic device.
[0029] FIG. 5 is a diagram illustrating the operation of an electronic device according to at least one embodiment of the present disclosure switching an input device connected to an external device.
[0030] FIG. 6 is a diagram illustrating the operation of an electronic device according to at least one embodiment of the present disclosure switching an input device connected to the electronic device.
[0031] FIG. 7 is a diagram showing an example of a UI for switching an input device connected to an electronic device according to at least one embodiment of the present disclosure.
[0032] FIG. 8 is a diagram illustrating the operation of an electronic device according to at least one embodiment of the present disclosure acquiring data corresponding to the battery of an input device.
[0033] FIG. 9 is a sequence diagram showing the order in which an electronic device, an external device, and an input device operate according to at least one embodiment of the present disclosure.
[0034] FIG. 10 is a drawing for explaining the operation of an electronic device switching an input device according to at least one embodiment of the present disclosure.
[0035] FIG. 11 is a drawing for explaining the operation of an electronic device switching an input device according to at least one embodiment of the present disclosure.
[0036] The terms used in the various embodiments of this Disclosure have been selected to be as widely used and general as possible, taking into account their functions within this disclosure; however, these terms may vary depending on the intent of those skilled in the art, case law, the emergence of new technologies, etc. Additionally, in specific cases, terms have been selected at the applicant's discretion, and in such cases, their meanings will be described in detail in the relevant description section of this disclosure. Therefore, terms used in this disclosure should be defined not merely by their names, but based on their meanings and the overall content of this disclosure.
[0037] The various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features described in the present disclosure to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments.
[0038] In relation to the description of the drawings, similar reference numerals may be used for similar or related components.
[0039] The singular form of the noun corresponding to the item may include one or multiple items, unless the relevant context clearly indicates otherwise.
[0040] In the present disclosure, each of the phrases such as “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “at least one of A, B, or C” may include any one of the items listed together in the corresponding phrase, or all possible combinations thereof.
[0041] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another component and do not limit the components in other aspects (e.g., importance or order).
[0042] Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that the component may be connected to the other component directly (e.g., via a wire), wirelessly, or through a third component.
[0043] Terms such as "include" or "have" are intended to specify the existence of the features, numbers, steps, actions, components, parts, or combinations thereof described in this disclosure, and do not preclude the existence or addition of one or more other features, numbers, steps, actions, components, parts, or combinations thereof.
[0044] When it is said that a component is "connected," "combined," "supported," or "in contact" with another component, this includes not only cases where the components are directly connected, combined, supported, or in contact, but also cases where they are indirectly connected, combined, supported, or in contact through a third component.
[0045] When it is said that a component is located "on" another component, this includes not only cases where one component is in contact with the other, but also cases where another component exists between the two components.
[0046] The term "and / or" includes a combination of multiple related described components or any of the multiple related described components.
[0047] In the present disclosure, a "module" or "part" performs at least one function or operation and may be implemented in hardware or software, or a combination of hardware and software. Additionally, a plurality of "modules" or a plurality of "parts" may be integrated into at least one module and implemented by at least one processor, except for a "module" or "part" that needs to be implemented in specific hardware.
[0048] Meanwhile, various elements and areas in the drawings are depicted schematically. Accordingly, the technical concept of the present disclosure is not limited by the relative sizes or spacing depicted in the attached drawings.
[0049] In the present disclosure, the term "user" may refer to a person using an electronic device or a device using an electronic device (e.g., an artificial intelligence electronic device).
[0050] An embodiment of the present disclosure will be described in more detail below with reference to the attached drawings.
[0051] FIG. 1 is a drawing for explaining the operation of an electronic device according to at least one embodiment of the present disclosure.
[0052] Referring to FIG. 1, the electronic device (100) can communicate with an input device (200) or an external device (300) to collect and store various data.
[0053] An electronic device (100) according to one embodiment can communicate with other external devices, such as an input device (200) or an external device (300), using a network. As the electronic device (100) performs communication, it can acquire various information, such as signals and images, corresponding to input events.
[0054] For example, an electronic device (100) can communicate with an external device (300) to acquire image data, and based on the acquired image data, acquire data corresponding to the battery of an input device (200) connected to the external device.
[0055] Here, "input event" may mean an event including at least one of receiving a button input through an input device (200), receiving a touch input, and receiving a user interaction input.
[0056] Here, "data corresponding to the battery" may mean data indicating the battery status of the input device (200). For example, the data corresponding to the battery may include information indicating the amount of power remaining in the current battery of the input device (200). Here, the data corresponding to the battery may also be referred to as "data information" in this disclosure.
[0057] A network may include various wired networks and wireless networks. Wired networks include cable networks or telephone networks, etc., and wireless networks may include all networks that transmit and receive signals via radio waves. Wired networks and wireless networks may be connected to each other.
[0058] Networks may include wide area networks (WANs) such as the Internet, local area networks (LANs) formed around access points (APs), and short-range wireless networks that do not pass through access points (APs). Short-range wireless networks may include Bluetooth (IEEE 802.15.1), Zigbee (IEEE 802.15.4), Wi-Fi Direct, Near Field Communication (NFC), Z-Wave, etc., but are not limited thereto.
[0059] Meanwhile, in FIG. 1, the electronic device (100) is depicted in the form of a display device, but it is not limited thereto and may be at least one of various types of electronic devices. For example, the electronic device (100) may be implemented as various types of electronic devices such as a TV, laptop, monitor, kiosk, tablet PC, smartphone, user terminal, electronic picture frame, LFD (large format display), Digital Signage, DID (Digital Information Display), video wall, projector display, server device, etc.
[0060] Additionally, the aforementioned electronic devices are merely examples, and in addition to the aforementioned electronic devices, a device capable of performing the operation described below by being connected to an input device (200) or an external device (300) may be included in the electronic device (100) according to one embodiment.
[0061] The input device (200) may refer to a hardware device for transmitting user commands or data to a system such as an electronic device, and may include at least one of a game pad, a user terminal device, a keyboard, a mouse, a remote control, and a wireless input device.
[0062] For example, the input device (200) may be implemented as an electronic device such as a game pad (200-1), a keyboard (200-2), a user terminal device (200-3), a remote control (200-4), or a mouse (200-5). However, it is not limited thereto and may be implemented as various types of electronic devices.
[0063] The input device (200) can receive various feedback or commands from a user and transmit them to the electronic device (100). For example, when the electronic device (100) receives user input regarding a setting that controls each configuration of the electronic device (100) through the input device (200), it can operate each configuration in response to the user input.
[0064] For example, when an input device (200) receives user input for a game running on an electronic device (100) and transmits it to the electronic device (100), the electronic device (100) can control the game running on a display based on the user input.
[0065] When the input device (200) detects user interaction, such as a user's button input, it may transmit a signal regarding the user interaction to the electronic device (100) to activate the connection between the electronic device (100) and the input device where the user interaction occurred.
[0066] The input device (200) may include, but is not limited to, touch buttons, microphones, touchscreens, etc., and may include various input interfaces capable of receiving user input.
[0067] Here, the microphone is a component for receiving sound input and converting it into an audio signal. The microphone is electrically connected to the processor of the input device (200) and can receive sound under the control of the processor.
[0068] A microphone may include various components such as a microphone that collects analog sound, an amplifier circuit that amplifies the collected sound, an A / D converter circuit that samples the amplified sound and converts it into a digital signal, and a filter circuit that removes noise components from the converted digital signal.
[0069] Meanwhile, the microphone may be implemented in the form of a sound sensor, and any configuration capable of collecting sound is acceptable.
[0070] Meanwhile, the input device (200) may include a first input device in which the battery level is detected to be below a preset level, and a second input device in which a function corresponding to a connection with the electronic device (100) is activated when an input event occurs. This will be described later in FIGS. 2 to 11.
[0071] The external device (300) may include a communication module capable of communicating with the electronic device (100) or input device (200), a server, at least one processor capable of processing data received from the electronic device (100) or input device (200), and at least one memory capable of storing a program for processing data or processed data.
[0072] For example, if the external device (300) is implemented as a game console device, the external device (300) can run a video game in a form connected to a display device such as a TV and a game pad.
[0073] Meanwhile, in FIG. 1, the external device (300) is depicted in the form of a console device, but it is not limited thereto, and a device that can be connected to an electronic device (100) or an input device (200) and perform the operation described below may be included in the external device (300) according to one embodiment.
[0074] Hereinafter, the operation of an electronic device (100) according to various embodiments of the present disclosure will be described.
[0075] FIG. 2 is a block diagram illustrating the configuration of an electronic device according to at least one embodiment of the present disclosure.
[0076] Referring to FIG. 2, the electronic device (100) includes a communication unit (110), a memory (120), and at least one processor (130).
[0077] The communication unit (110) can communicate with the input device (200) or the external device (300). In particular, the communication unit (110) can receive image data from the input device (200) by communicating with the input device (200) to obtain data corresponding to the battery of the input device (200).
[0078] The communication unit (110) may include wired or wireless input / output interfaces (or input / output terminals) according to various standards. For example, one or more connection interfaces may include various interfaces such as HDMI (High Definition Multimedia Interface), MHL (Mobile High-Definition Link), USB (Universal Serial Bus), DP (Display Port), Thunderbolt, VGA (Video Graphics Array) port, RGB port, D-SUB (D-subminiature), DVI (Digital Visual Interface), AP-based Wi-Fi (Wi-Fi, Wireless LAN Network), Bluetooth, Zigbee, wired / wireless LAN (Local Area Network), WAN (Wide Area Network), Ethernet, IEEE 1394, AES / EBU (Audio Engineering Society / European Broadcasting Union), Optical, Coaxial, etc.
[0079] Meanwhile, the communication unit (110) may have a communication unit that communicates with the input device (200) and a communication unit that communicates with the external device (300), and the communication unit may be different or the same.
[0080] According to an embodiment, the memory (120) may store various programs, data, instructions, etc. used in the electronic device (100). In addition, the memory (120) may store various information according to various embodiments of the present disclosure.
[0081] The memory (120) may be implemented in the form of a memory embedded in the electronic device (100) or in the form of a memory that can be attached to and detached from the electronic device (100), depending on the purpose of data storage.
[0082] For example, data for driving the electronic device (100) may be stored in memory embedded in the electronic device (100), and data for the expansion function of the electronic device (100) may be stored in memory that is detachable from the electronic device (100).
[0083] In the case of memory embedded in an electronic device (100), it may be implemented in the form of volatile memory (e.g., DRAM (dynamic RAM), SRAM (static RAM), or SDRAM (synchronous dynamic RAM), etc.), non-volatile memory (e.g., OTPROM (one time programmable ROM), PROM (programmable ROM), EPROM (erasable and programmable ROM), EEPROM (electrically erasable and programmable ROM), mask ROM, flash ROM, flash memory (e.g., NAND flash or NOR flash), etc.), hard drive, or solid state drive (SSD).
[0084] In the case of a memory that can be attached to and detached from an electronic device (100), it can be implemented in the form of a memory card (e.g., CF (compact flash), SD (secure digital), Micro-SD (micro secure digital), Mini-SD (mini secure digital), xD (extreme digital), MMC (multi-media card), etc.) or an external memory that can be connected to a USB port (e.g., USB memory).
[0085] The memory (120) may include various instructions required for the operation of at least one processor (130). Here, the instructions may include an instruction to acquire data corresponding to the battery of a first input device, an instruction to identify a second input device, an instruction to activate a function corresponding to a connection with the second input device, an instruction to perform an input operation using the second input device through the activated function, an instruction to display an image received from an external device on a display, and an instruction to acquire data corresponding to the battery of a first input device connected to an external device based on the image displayed on the display.
[0086] The memory (120) can store information about the input device (200). Here, the information about the input device may include the ID of the input device (e.g., MAC address, etc.), the type of the input device, the connection status of the input device, user account information per input device, history of communication connections, etc.
[0087] The memory (120) may store information about the input device in a specific database. This is explained in detail in FIG. 8.
[0088] According to an embodiment, at least one processor (130) controls the overall operation of the electronic device (100). Specifically, at least one processor (130) is connected to each component of the electronic device (100) to control the overall operation of the electronic device (100).
[0089] According to an embodiment, at least one processor (130) can control an input device (200) and an external device (300).
[0090] At least one processor (130) can perform the operation of an electronic device (100) according to various embodiments by executing at least one instruction stored in memory.
[0091] According to an embodiment, at least one processor (130) may be implemented as a digital signal processor (DSP) that processes digital signals, a microprocessor, or a TCON (Timing controller). However, it is not limited thereto, and may include or be defined by one or more of a central processing unit (CPU), a Micro Controller Unit (MCU), a micro processing unit (MPU), a controller, an application processor (AP), a communication processor (CP), an ARM processor, or an AI (Artificial Intelligence) processor. Additionally, at least one processor (130) may be implemented as a System on Chip (SoC) or Large Scale Integration (LSI) with a built-in processing algorithm, or may be implemented in the form of a Field Programmable Gate Array (FPGA). At least one processor (130) can perform various functions by executing computer executable instructions stored in memory.
[0092] At least one processor (130) may include one or more of a CPU (Central Processing Unit), GPU (Graphics Processing Unit), APU (Accelerated Processing Unit), MIC (Many Integrated Core), DSP (Digital Signal Processor), NPU (Neural Processing Unit), hardware accelerator, or machine learning accelerator.
[0093] At least one processor (130) can identify the second input device by receiving a signal corresponding to the input event through the communication unit (110) after the data corresponding to the battery of the first input device obtained becomes less than or equal to a preset value and an input event occurs in the second input device.
[0094] For example, at least one processor (130) may receive a control signal from a second input device where an input event occurred to activate a function corresponding to a connection with the second input device or to switch the connection of the input device (e.g., switch the connection from the first input device to the second input device).
[0095] Here, "input event" may mean an event including at least one of receiving a button input through a second input device, receiving a touch input, and receiving a user interaction input.
[0096] Here, "first input device and second input device" may mean an input device connected to one of an electronic device and an external device.
[0097] Here, the “function corresponding to the connection” may correspond to a task (preparation task) for performing a specific task, such as data transmission or signal processing, through the connection while the electronic device (100) is connected to the first input device or the second input device.
[0098] At least one processor (130) can obtain data corresponding to the battery of the first input device by receiving data regarding the battery status from the first input device through the communication unit (110) when the first input device is connected to the electronic device (100).
[0099] On the other hand, if the first input device is connected to the external device (300), at least one processor (130) may receive an image containing data corresponding to the battery of the first input device from the external device (300) through the communication unit (110) and obtain data corresponding to the battery of the first input device. This is explained in detail in FIG. 5.
[0100] At least one processor (130) can activate a function corresponding to the connection with the second input device where an input event occurred, if the second input device is already connected, and control the second input device to perform an input operation using the activated function.
[0101] At least one processor (130) may disable the function corresponding to the connection with the first input device when it enables the function corresponding to the connection with the second input device. However, it is not limited to this, and it may enable the function corresponding to the connection with the second input device without disabling the function corresponding to the connection with the first input device.
[0102] For example, at least one processor (130) may perform multiple connections with multiple input devices based on a user's usage pattern stored in memory (120). However, it is not limited thereto, and at least one processor (130) may control a communication unit (110) to perform multiple connections with multiple input devices based on a user's usage pattern obtained from an external device such as a server.
[0103] At least one processor (130) can control one or any combination of other components of the electronic device and can perform operations or data processing related to communication. At least one processor (130) can execute one or more programs or instructions stored in memory. For example, at least one processor (130) can perform the method according to an embodiment of the present disclosure by executing one or more instructions stored in memory.
[0104] If the method according to the embodiment of the present disclosure includes a plurality of operations, the plurality of operations may be performed by a single processor or by a plurality of processors.
[0105] For example, when the first operation, the second operation, and the third operation are performed by the method according to the embodiment, the first operation, the second operation, and the third operation may all be performed by the first processor, or the first operation and the second operation may be performed by the first processor (e.g., a general-purpose processor) and the third operation may be performed by the second processor (e.g., an artificial intelligence dedicated processor).
[0106] One or more processors control the processing of input data according to predefined operation rules or artificial intelligence models stored in memory (120). Alternatively, if one or more processors are dedicated artificial intelligence processors, the dedicated artificial intelligence processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model. The predefined operation rules or artificial intelligence models are characterized by being created through learning.
[0107] Here, "created through learning" means that a basic artificial intelligence model is trained using multiple learning data by a learning algorithm, thereby creating a predefined rule of operation or an artificial intelligence model configured to perform a desired characteristic (or objective). Such learning may be performed on the device itself where the artificial intelligence according to the present disclosure is executed, or it may be performed through a separate server and / or system. Examples of learning algorithms include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.
[0108] An artificial intelligence model can be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values and performs neural network operations through calculations between the results of previous layers and the multiple weights. The multiple weights possessed by the multiple neural network layers can be optimized based on the learning results of the artificial intelligence model. For example, the multiple weights can be updated during the learning process so that the loss or cost values obtained by the artificial intelligence model are reduced or minimized.
[0109] Artificial neural networks may include deep neural networks (DNNs), such as, but are not limited to, Convolutional Neural Networks (CNNs), Deep Neural Networks (DNNs), Recurrent Neural Networks (RNNs), Restricted Boltzmann Machines (RBMs), Deep Belief Networks (DBNs), Bidirectional Recurrent Deep Neural Networks (BRDNNs), Generative Adversarial Networks (GANs), or Deep Q-Networks.
[0110] At least one processor (130) may be implemented as a single core processor including one core, or as one or more multicore processors including multiple cores (e.g., homogeneous multicore or heterogeneous multicore).
[0111] When at least one processor (130) is implemented as a multi-core processor, each of the multiple cores included in the multi-core processor may include internal processor memory such as cache memory or on-chip memory, and a common cache shared by multiple cores may be included in the multi-core processor.
[0112] Each of the multiple cores (or some of the multiple cores) included in the multi-core processor may independently read and execute program instructions for implementing the method according to the embodiment of the present disclosure, or all (or some of) of the multiple cores may be linked together to read and execute program instructions for implementing the method according to the embodiment of the present disclosure.
[0113] FIG. 3 is a detailed block diagram for illustrating an electronic device according to at least one embodiment of the present disclosure.
[0114] Referring to FIG. 3, an electronic device (100) according to one embodiment of the present disclosure may include a communication unit (110), a memory (120), at least one processor (130), and a display (140). Parts that overlap with the above description will be omitted or abbreviated below.
[0115] The display (140) can display various screens under the control of at least one processor (130). The display (140) may be implemented as a display including a self-emissive element or as a display including a non-emissive element and a backlight. Additionally, the display (140) may be implemented as an LFD display. For example, it may be implemented as various types of displays such as an LCD (Liquid Crystal Display), an OLED (Organic Light Emitting Diodes) display, an LED (Light Emitting Diodes), a micro LED, a Mini LED, a PDP (Plasma Display Panel), a QD (Quantum dot) display, a QLED (Quantum dot light-emitting diodes), etc. The display (140) may also include a driving circuit, a backlight unit, etc., which may be implemented in the form of an a-si TFT, an LTPS (low temperature poly silicon) TFT, an OTFT (organic TFT), etc.
[0116] According to one example, at least one processor (130) can display a game screen through a display (140) when a game is running on an external device (300) connected to an electronic device (100). This is explained in detail in FIGS. 5 and 6.
[0117] At least one processor (130) can control the display (140) to display an image received from the external device (300) through the communication unit (110) when the first input device is connected to the external device (300).
[0118] At least one processor (130) can obtain data corresponding to the battery of the first input device connected to the external device (300) based on the image displayed on the display.
[0119] For example, an electronic device (100) connected to an external device (300) can receive content images from the external device (300) and obtain pixel data of the screen. At least one processor (130) of the electronic device (100) can analyze the obtained pixel data and extract data corresponding to the battery of the first input device.
[0120] At least one processor (130) can acquire visual data based on an image displayed on a display (140) and acquire data corresponding to a battery based on the visual data.
[0121] At least one processor (130) can obtain data corresponding to the battery of the first input device through a function corresponding to Optical Character Recognition (OCR) based on visual data, if the visual data obtained based on the image displayed on the display (140) includes text corresponding to the remaining battery amount.
[0122] Here, "visual data" may mean data including at least one of a battery UI, text corresponding to the remaining battery level, and a battery icon. Here, the text corresponding to the battery UI, etc. may mean text indicating the remaining battery level.
[0123] Meanwhile, at least one processor (130) can activate a function corresponding to a connection with the second input device when the data corresponding to the battery of the first input device becomes less than or equal to a preset value and an input event occurs in the second input device.
[0124] On the other hand, at least one processor (130) may provide information corresponding to a request for user input for connection with the second input device based on priority before activating a function corresponding to a connection with the second input device if no input event occurs in the second input device.
[0125] For example, at least one processor (130) can identify the second input device with the highest priority among a plurality of input devices based on user history data if, after the data corresponding to the battery of the first input device is detected to be below a preset value, no input event occurs from the second input device within a preset time. In this case, at least one processor (130) can control the display (140) to display a UI that corresponds to a request for user input for connection with the identified second input device.
[0126] Here, "user history data" may mean data including at least one of connection history and usage frequency history.
[0127] At least one processor (130) can identify the input device with the highest usage frequency among a plurality of input devices as the second input device with the highest priority. Here, usage frequency may refer to the number of connections between the input device and the electronic device (100).
[0128] However, it is not limited to this, and at least one processor (130) may determine priority by considering the frequency of use of the input device, battery status and connection signal, and giving weight to the connection signal.
[0129] At least one processor (130) can identify the most recently connected input device among the most frequently used input devices as the second input device with the highest priority based on the connection history when multiple input devices with the highest usage frequency are identified.
[0130] For example, at least one processor (130) may identify the input device most recently connected among the A pad and B pad as the second input device with the highest priority when the usage frequency of the A pad and B pad is the same and the usage frequency is the highest among the multiple input devices.
[0131] The operation of the electronic device (100) will be described in more detail below through FIGS. 4 to 10. FIGS. 4 to 10 describes individual embodiments for the convenience of explanation. However, the individual embodiments of FIGS. 4 to 10 may be implemented in any combination.
[0132] FIG. 4 is a diagram illustrating the operation of an electronic device according to at least one embodiment of the present disclosure switching an input device connected to the electronic device.
[0133] Referring to FIG. 4, an electronic device (100) connected to a plurality of input devices can change the connection status of the input devices based on data corresponding to the battery of the input devices.
[0134] For example, the electronic device (100) can change the connection state of the second input device (220), which is already connected to the electronic device (100), to an active state when an input event occurs from the second input device (220) after the battery level of the first input device (210) connected to the electronic device (100) becomes below a preset value.
[0135] The electronic device (100) can receive a signal for data corresponding to the battery from the first input device (210) through the communication unit (110) and detect whether the battery level of the first input device (210) is below a preset value.
[0136] The electronic device (100) can identify the second input device (220) by receiving a signal corresponding to the input event from the second input device (220) where the input event occurred through the communication unit (110).
[0137] For example, the electronic device (100) can identify the second input device (220) by receiving a signal from the second input device (220) after the battery level of the first input device (210) becomes below a preset value and the user performs an input to turn on the power of the second input device (220) which is turned off.
[0138] However, it is not limited thereto, and the electronic device (100) may identify the second input device (220) by receiving a signal through various forms of input to the second input device (220).
[0139] For example, the electronic device (100) may identify the second input device (220) by receiving a signal from the second input device (220) after the user presses at least one of all buttons of the second input device (220) when the battery level of the first input device (210) is detected to be below a preset value.
[0140] The first input device and the second input device may refer to input devices connected to one of the electronic device (100) and the external device (300), and in FIG. 4, the first input device (210) and the second input device (220) are shown in the form of input devices connected to the electronic device (100).
[0141] Meanwhile, Figure 4 illustrates the case where an input event occurs through button input from the second input device (220), but it is not limited thereto and can be applied to cases where various input events such as user's voice input or user's touch input occur.
[0142] FIG. 5 is a diagram illustrating the operation of an electronic device according to at least one embodiment of the present disclosure switching an input device connected to an external device.
[0143] FIG. 5 shows a state in which an external device (300) is connected via an HDMI interface. At least one processor (130) can receive pixel data from the external device (300) via a communication unit (110).
[0144] Referring to FIG. 5, the electronic device (100) can receive an image from a connected external device (300) and obtain data corresponding to the battery of the first input device (210).
[0145] For example, the electronic device (100) can receive an image containing data corresponding to a battery from an external device (300) and display a battery icon (141) indicating the remaining battery amount on the display (140).
[0146] The electronic device (100) can obtain battery level information of the first input device (210) by extracting and analyzing pixel data for the displayed battery icon (141).
[0147] Alternatively, when the electronic device (100) receives pixel data from an external device (300), it may directly extract and display battery level information based on the pixel data as described above.
[0148] Pixel data refers to data regarding the pixels that constitute a single screen. Pixel data may include pixel coordinates and pixel values. When using the RGB (Red, Green, Blue) color model, the pixel value for each pixel coordinate includes R, G, and B data.
[0149] Although FIG. 5 illustrates a state connected via a wired cable, the electronic device (100) and the external device (300) may also be connected via wireless communication.
[0150] Specifically, each device may be connected via a wide area network (WAN), such as the Internet, a local area network (LAN) formed around an access point (AP), or a short-range wireless network that does not pass through an access point (AP). Short-range wireless networks may include, but are not limited to, Bluetooth (IEEE 802.15.1), Zigbee (IEEE 802.15.4), Wi-Fi Direct, Near Field Communication (NFC), Z-Wave, etc.
[0151] The electronic device (100) may store various programs. For example, various programs may be stored, such as a web browser that can access an external server device via the internet, and an application for performing functions of storing and analyzing pixel data. The electronic device (100) may perform various operations as the programs are executed.
[0152] Specifically, when a battery icon (141) indicating the remaining battery level of a first input device (210) is displayed on a content screen of an electronic device (100), the electronic device (100) may receive pixel data for the displayed battery icon (141) and input it into a stored data analysis program. The data analysis program may analyze what kind of object corresponds to each pixel based on the input pixel data, and then extract data corresponding to the battery of the input device according to the analysis result.
[0153] Meanwhile, although the above description assumes a case where data corresponding to the battery of the first input device (210) is obtained based on pixel data, it is not necessarily limited to pixel data, and data corresponding to the battery of the first input device (210) may also be obtained based on graphic data other than pixel data.
[0154] In addition, Figure 5 describes a case where data corresponding to the battery of the first input device (210) is obtained based on a battery icon (141), but it is not necessarily limited to a battery icon, and data corresponding to the battery of the first input device (210) can be obtained based on various battery UIs, such as text corresponding to the remaining battery amount, in addition to the battery icon.
[0155] FIG. 6 is a diagram illustrating the operation of an electronic device according to at least one embodiment of the present disclosure switching an input device connected to the electronic device.
[0156] FIG. 6 shows a state in which an external device (300) is connected via an HDMI interface. At least one processor (130) can transmit and receive a connection signal to a second input device (220) connected to the external device (300) via a communication unit (110).
[0157] Referring to FIG. 6, when the electronic device (100) detects that the remaining battery level of the first input device (210) connected to the electronic device (100) is below a preset value, it may receive a signal corresponding to an input event from the second input device (220) connected to the external device (300) or transmit a connection signal to the second input device (220).
[0158] For example, when the second input device (220) is connected to an external device (300) and the battery level of the first input device (210) connected to the electronic device (100) is detected to be below a preset value, the electronic device (100) may control the communication unit (110) so that the second input device (220) disconnects from the external device and performs a connection with the electronic device.
[0159] For example, the electronic device (100) may transmit a connection signal to the second input device (220) through the communication unit (110) to perform a connection with the second input device (220).
[0160] However, it is not limited to this, and a connection between the electronic device (100) and the second input device (220) may be performed by the second input device (220) transmitting a connection signal to the electronic device (100).
[0161] FIG. 7 is a diagram showing an example of a UI for switching an input device connected to an electronic device according to at least one embodiment of the present disclosure.
[0162] Referring to FIG. 7, the electronic device (100) can control the display (140) to display a UI that responds to a request for user input for connection with a second input device.
[0163] For example, if the electronic device (100) does not have an input event from the second input device within a preset time after the data corresponding to the battery of the acquired first input device (210) becomes less than or equal to a preset value, it may identify the second input device with the highest priority among a plurality of input devices based on user history data.
[0164] In this case, the electronic device (100) can request user input for connection to the second input device with the highest priority among multiple input devices by displaying a UI that says "Would you like to switch pads?" (142).
[0165] Here, "user history data" may refer to data including at least one of connection history and usage frequency history. However, it is not limited thereto, and the electronic device (100) may determine priority among a plurality of input devices based on the signal strength of the input device or the remaining battery status of the input device in addition to user history data.
[0166] FIG. 8 is a diagram illustrating the operation of an electronic device according to at least one embodiment of the present disclosure acquiring data corresponding to the battery of an input device.
[0167] Referring to FIG. 8, the electronic device (100) stores information about the input device in the form of a database in memory (120) and can manage the device connected to the electronic device (100) through a virtual device management module.
[0168] For example, at least one processor (130) can manage accessory devices connected to the electronic device (100) through a virtual device management module including a device switcher and notification module (131), a context recognition module (132), a context storage module (133), a CEC (Consumer Electronics Control) module (134), a screen recognition module (135), a sniffer module (136), etc.
[0169] For example, the Switcher and Noti module (131) can control the registration and switching of an input device (200) or an external device (300) connected to an electronic device (100), and provide a notification (UI Notification) to the user according to the user's request or system status.
[0170] For example, the context recognition module (132) can detect and analyze the usage environment (Context) of the electronic device (100) or external device (300) in real time. For example, the context recognition module (132) can identify a program currently running on the electronic device (100) in real time and obtain and analyze information such as usage history in the environment and the frequency of connection of connected input devices.
[0171] For example, the Context storage module (133) stores the state, usage history, connection records, etc. of the input device (200) in a database format and can provide information for switching or controlling the input device (200).
[0172] For example, the CEC module (134) can transmit and receive control signals to and from an external device (300) connected via a communication interface such as HDMI, and perform device control based on the HDMI-CEC standard.
[0173] For example, a screen recognition module (135) can recognize a screen of content of an external device (300) displayed on a display (140) of an electronic device (100) and analyze the status of the currently active input device (200) and the external device (300).
[0174] For example, the screen recognition module (135) can acquire pixel data through a screen displayed on the display (140) of the electronic device (100) and acquire data corresponding to the battery of the input device (200) based on the acquired pixel data.
[0175] For example, the Sniffer module (136) can monitor wireless communication signals (Bluetooth, Wi-Fi, etc.) and wired communication signals (HDMI-CEC) with an external device (300) to identify the connection status and signal type.
[0176] For example, the electronic device (100) can detect Bluetooth signals from multiple input devices (200) through a Sniffer module (136) and determine the connection priority of the input devices based on the presence or absence of a signal.
[0177] FIG. 9 is a sequence diagram showing the order in which an electronic device, an external device, and an input device operate according to at least one embodiment of the present disclosure.
[0178] FIG. 9 illustrates the sequence in which the electronic device (100), the external device (300), the first input device (210), and the second input device (220) operate when the external device (300) connected to the electronic device (100) is connected to the first input device (210) and the electronic device (100) is connected to the second input device (220).
[0179] An external device (300) connected to an electronic device (100) can transmit content video through the communication unit of the external device (300) (S910).
[0180] The electronic device (100) can display an image on the display (140) based on an image received from an external device (300) (S920).
[0181] The electronic device (100) can obtain data corresponding to the battery of the first input device based on an image displayed on the display (140) (S930).
[0182] The electronic device (100) can detect whether the data corresponding to the battery information is less than or equal to a preset value based on the data corresponding to the acquired battery (S940).
[0183] When the second input device (220) detects the occurrence of an input event through the user's input action (S950), it can generate a signal corresponding to the input event and transmit it to the electronic device (100) (S960).
[0184] The electronic device (100) can identify the second input device (220) based on a signal received from the second input device (220) (S970).
[0185] When the electronic device (100) identifies the second input device (220) where an input event occurred, it can activate a function corresponding to a connection with the second input device (220) (S980).
[0186] The electronic device (100) can perform an input operation using the second input device (220) (S990). For example, the electronic device (100) can control game content running on the display (140) through the second input device (220) with a function corresponding to the connection activated.
[0187] FIG. 10 is a drawing for explaining the operation of an electronic device switching an input device according to at least one embodiment of the present disclosure.
[0188] The electronic device can acquire data corresponding to the battery of the first input device (S1010). For example, the data corresponding to the battery may be acquired directly from the first input device or by processing an image received from an external device.
[0189] The electronic device can identify the second input device by receiving a signal corresponding to the input event (S1020).
[0190] The electronic device can activate a function corresponding to a connection with a second input device (S1030). For example, the electronic device can receive a signal corresponding to an input event to identify the second input device, and transmit and receive a connection signal to the second input device to activate a function corresponding to a connection with the second input device.
[0191] The electronic device can perform an input operation using the second input device through an activated function (S1040). For example, when user input is received, such as inputting a button to the second input device, the electronic device can perform a control operation corresponding to the operation input through the second input device through an activated function.
[0192] FIG. 11 is a drawing for explaining the operation of an electronic device switching an input device according to at least one embodiment of the present disclosure.
[0193] The electronic device can receive and display images from an external device (S1110).
[0194] The electronic device can obtain data corresponding to the battery of the first input device (S1120). For example, the data corresponding to the battery may be obtained directly from the first input device or by processing an image received from an external device.
[0195] The electronic device can identify the second input device by receiving a signal corresponding to the input event (S1130).
[0196] The electronic device can activate a function corresponding to a connection with a second input device (S1140). For example, the electronic device can receive a signal corresponding to an input event to identify the second input device, and transmit and receive a connection signal to the second input device to activate a function corresponding to a connection with the second input device.
[0197] The electronic device can perform an input operation using the second input device through an activated function (S1150). For example, when user input is received, such as inputting a button to the second input device, the electronic device can perform a control operation corresponding to the input operation using the second input device through an activated function.
[0198] The method of connecting with an input device described in FIGS. 10 and 11 may be performed by a device having various configurations such as FIGS. 2 and 3 described above, but is not necessarily limited thereto and may be performed by a device having various configurations.
[0199] The various embodiments described above may be implemented as individual embodiments, or at least one embodiment may be combined with one another, either wholly or partially, to be implemented together in a single device.
[0200] According to the various embodiments described above, convenience can be provided to a user utilizing the content by activating a function corresponding to the connection between an electronic device and a second input device based on data corresponding to the battery of the first input device. Ultimately, the user experience can be enhanced.
[0201] Various embodiments of the present disclosure may be implemented as software stored on a machine-readable storage media that can be mounted on or connected to a smartphone, a user terminal device, and various other electronic devices (e.g., a computer).
[0202] Specifically, a non-transient readable storage medium may be provided that stores software for sequentially performing the steps of: acquiring data corresponding to a battery of a first input device; receiving a signal corresponding to an input event and identifying a second input device when an input event occurs at a second input device after the data corresponding to the battery becomes less than or equal to a preset value; activating a function corresponding to a connection with the second input device if the second input device is already connected; and controlling to perform an input operation using the second input device through the activated function.
[0203] A device equipped with such a non-transient readable medium can perform various operations, such as acquiring data corresponding to the battery of the first input device described in the various embodiments above, activating a function corresponding to a connection with the second input device, and performing an input operation using the second input device through the activated function.
[0204] In non-transitory readable storage media, 'non-transitory' simply means that the storage medium does not contain a signal and is tangible; it does not distinguish whether data is stored semi-permanently or temporarily on the storage medium.
[0205] Alternatively, a program for performing the methods according to the various embodiments described above may be distributed online through an application store. In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created in a storage medium such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0206] Each component (e.g., module or program) according to various embodiments may consist of a single or multiple entities, and some of the aforementioned sub-components may be omitted, or other sub-components may be further included in various embodiments. Generally or additionally, some components (e.g., module or program) may be integrated into a single entity to perform the same or similar functions as those performed by each of the respective components prior to integration.
[0207] Operations performed by a module, program, or other component according to various embodiments may be executed sequentially, in parallel, iteratively, or heuristically, or at least some operations may be executed in a different order, omitted, or other operations may be added.
[0208] Although preferred embodiments of the present disclosure have been illustrated and described above, the present disclosure is not limited to the specific embodiments described above. It is understood that various modifications can be made by those skilled in the art without departing from the essence of the present disclosure as claimed in the claims, and such modifications should not be understood individually from the technical spirit or perspective of the present disclosure.
Claims
1. In an electronic device, A communication unit for performing communication with an external device; Memory for storing at least one instruction; and It includes at least one processor that executes the above at least one instruction; and The above-mentioned at least one processor is, When data corresponding to the battery of the acquired first input device becomes less than or equal to a preset value and an input event occurs in the second input device, a signal corresponding to the input event is received through the communication unit to identify the second input device, and If the second input device is already connected, activate a function corresponding to the connection with the second input device, and Controls to perform an input operation using the second input device through the above-mentioned activated function, and The first input device and the second input device are An electronic device that is an input device connected to one of the above electronic device and the above external device.
2. In Paragraph 1, The above input event is, An electronic device comprising an event including at least one of receiving a button input, receiving a touch input, and receiving a user interaction input through the second input device.
3. In Paragraph 1, Including a display; further The above-mentioned at least one processor is, If the first input device is connected to the external device, the display is controlled to display an image received from the external device through the communication unit, and An electronic device that acquires data corresponding to the battery of a first input device connected to an external device based on an image displayed on the above display.
4. In Paragraph 3, The above-mentioned at least one processor is, Visual data is obtained based on the image displayed on the above display. Based on the above visual data, data corresponding to the battery is obtained, and The above visual data is, An electronic device comprising data including at least one of a battery UI, text corresponding to the remaining battery amount, and a battery icon.
5. In Paragraph 4, The above-mentioned at least one processor is, An electronic device that, if the above visual data includes text corresponding to the remaining battery amount, acquires data corresponding to the battery through a function corresponding to Optical Character Recognition (OCR) based on the above visual data.
6. In Paragraph 1, The above-mentioned at least one processor is, If the second input device is connected to the external device, the communication unit is controlled so that the second input device disconnects from the external device and performs a connection with the electronic device. An electronic device that controls the performance of an input operation using the second input device through a function corresponding to a connection with the activated second input device.
7. In Paragraph 1, Including a display; further The above-mentioned at least one processor is, After the data corresponding to the battery of the first input device obtained above becomes less than or equal to a preset value, if no input event occurs in the second input device within a preset time, the second input device with the highest priority among a plurality of input devices is identified based on user history data, and Control the display to display a UI that corresponds to a request for user input for connection with the second input device identified above, and The above user history data is, An electronic device, which is data including at least one of connection history and usage frequency history.
8. In Paragraph 7, The above-mentioned at least one processor is, An electronic device that identifies the input device with the highest usage frequency among the plurality of input devices as the second input device with the highest priority.
9. In Paragraph 8, The above-mentioned at least one processor is, An electronic device that, when multiple input devices with the highest usage frequency are identified, identifies the most recently connected input device among the multiple input devices with the highest usage frequency as the second input device with the highest priority based on the connection history.
10. In Paragraph 1, The above-mentioned at least one processor is, An electronic device that disables a function corresponding to a connection with a first input device when a function corresponding to a connection with the second input device is activated.
11. In a method for controlling an electronic device, A step of acquiring data corresponding to the battery of the first input device; A step of identifying the second input device by receiving a signal corresponding to the input event when the data corresponding to the battery becomes less than or equal to a preset value; If the second input device is already connected, a step of activating a function corresponding to the connection with the second input device; and The method includes the step of controlling to perform an input operation using the second input device through the activated function; The first input device and the second input device are A control method, which is an input device connected to one of the above electronic device and external device.
12. In Paragraph 11, The above input event is, A control method comprising an event including at least one of receiving a button input, receiving a touch input, and receiving a user interaction input through the second input device.
13. In Paragraph 11, The step of acquiring data corresponding to the battery of the first input device is, If the first input device is connected to an external device, a step of displaying an image received from the external device; and A control method comprising the step of acquiring data corresponding to the battery of a first input device connected to the external device based on the image shown above.
14. In Paragraph 13, The step of acquiring data corresponding to the battery of the first input device is, A step of acquiring visual data based on the image indicated above; and The method includes the step of obtaining data corresponding to the battery based on the visual data above; The above visual data is, A control method comprising at least one of a battery UI, text corresponding to the remaining battery amount, and a battery icon.
15. A non-transient readable recording medium comprising a program for executing a method of controlling an electronic device, The control method of the above electronic device is, A step of acquiring data corresponding to the battery of the first input device; A step of identifying the second input device by receiving a signal corresponding to the input event when the data corresponding to the battery becomes less than or equal to a preset value; If the second input device is already connected, a step of activating a function corresponding to the connection with the second input device; and The method includes the step of controlling to perform an input operation using the second input device through the activated function; The first input device and the second input device are A non-transient readable recording medium, which is an input device connected to one of the above electronic device and external device.