Computing device and method for controlling a target device

Abstract

A method of controlling a target device by a computing device may include: identifying a distance difference between a distance from one or more electronic devices to a first reference device and a distance to a second reference device; identifying an angular difference between an angle of arrival of the one or more electronic devices relative to at least one of the first reference device or the second reference device and a reference angle of arrival; and controlling the target device based on at least one of the distance difference or the angle difference.

Description

Technical Field

[0001] The present disclosure relates to a method and a computing device for controlling a target device. Background Art

[0002] With the development of wireless communication technology and voice recognition technology, Internet of Things (IoT) systems that support controlling device operations through user voice commands have been applied in various fields. For example, users can control home appliances by issuing voice commands through a virtual assistant service in a home IoT system. In this case, the user needs to provide the identification information of the electronic device to the system to control the electronic device. In other words, the user needs to issue a voice command including the identification information of the electronic device to be controlled.

[0003] Meanwhile, there may be many electronic devices in the IoT system that can be controlled by the user's voice command. In this case, the user needs to remember all the identification information of the multiple electronic devices to control the multiple electronic devices. In addition, in order to control the electronic devices, the user needs to issue a long voice command including the identification information of the electronic devices. In addition, new users (e.g., guest users) who access the IoT system space do not know the identification information of the electronic devices included in the IoT system. Summary of the invention

[0004] Solution to the problem

[0005] The present disclosure may be implemented in numerous ways, including as a method, a system, a device, or a computer program stored in a computer-readable storage medium.

[0006] According to an embodiment of the present disclosure, a method for controlling a target device by a computing device may include identifying a distance difference between a distance from one or more electronic devices to a first reference device and a distance to a second reference device. In an embodiment of the present disclosure, the method may include identifying an angle difference between an angle of arrival of the one or more electronic devices relative to at least one of the first reference device or the second reference device and a reference angle of arrival. In an embodiment of the present disclosure, the method may include controlling the target device based on at least one of the distance difference or the angle difference.

[0007] According to an embodiment of the present disclosure, a computing device for controlling a target device may include: a memory storing one or more instructions; and at least one processor configured to execute the one or more instructions stored in the memory. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to identify the distance difference between the distance from one or more electronic devices to a first reference device and the distance to a second reference device. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to identify the angle difference between the angle of arrival of the one or more electronic devices relative to at least one of the first reference device or the second reference device and a reference angle of arrival. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to control the target device based on at least one of the distance difference or the angle difference.

[0008] According to an embodiment of the present disclosure, a program for executing a method of controlling a target device in a computer may be recorded on a computer-readable recording medium. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 is a diagram illustrating an example of an Internet of Things (IoT) system according to an embodiment of the present disclosure.

[0010] Figure 2 is a flowchart illustrating a method according to an embodiment of the present disclosure, by which a computing device controls a target device.

[0011] Figure 3 is a flowchart illustrating a method according to an embodiment of the present disclosure, by which a computing device controls a target device.

[0012] Figure 4a is a flowchart illustrating a method of selecting an electronic device that meets a distance condition according to an embodiment of the present disclosure. Figure 4b is a diagram illustrating an example of selecting an electronic device satisfying a distance condition according to an embodiment of the present disclosure.

[0013] Figure 5a is a flowchart illustrating a method of selecting an electronic device that satisfies an angle condition according to an embodiment of the present disclosure. Figure 5b is a diagram illustrating an example of selecting an electronic device satisfying an angle condition according to an embodiment of the present disclosure.

[0014] Figure 6 is a flow chart illustrating a method by which a computing device determines a target device according to an embodiment of the present disclosure.

[0015] Figure 7is a flow chart illustrating a method by which a computing device determines a target device according to an embodiment of the present disclosure.

[0016] Figure 8a is a flowchart illustrating a method of controlling a target device to output information associated with an electronic device according to an embodiment of the present disclosure. Figure 8b is a diagram illustrating that a target device outputs information associated with an electronic device according to an embodiment of the present disclosure.

[0017] Fig. 9 is a flowchart illustrating a method for controlling output of guide information for a location of an electronic device according to an embodiment of the present disclosure.

[0018] Fig.10a is a flowchart illustrating a method of controlling a target device by determining a location of the target device according to an embodiment of the present disclosure. Fig.10b is a diagram illustrating an example of controlling a target device by determining a position of the target device according to an embodiment.

[0019] Fig.11 is a flowchart illustrating a method of controlling an electronic device located in a user's gaze direction when a virtual assistance system is activated according to an embodiment of the present disclosure.

[0020] Fig.12 is a flowchart illustrating a method for allowing a new user terminal to access an IoT system according to an embodiment of the present disclosure.

[0021] Fig.13 is a flowchart illustrating a method of controlling a target device based on determining that a plurality of user input signals conflict with each other according to an embodiment of the present disclosure.

[0022] Fig.14 is a diagram showing a configuration example of an IoT system according to an embodiment of the present disclosure. DETAILED DESCRIPTION

[0023] Throughout the disclosure, the expression "at least one of a, b, or c" means only a, only b, only c, both a and b, both a and c, both b and c, all of a, b, and c, or variations thereof.

[0024] Throughout the specification, the term "angle of arrival (AoA)" may refer to the angle between a reference direction and a direction of a traveling vector in a wave. In an embodiment of the present disclosure, the reference direction may be the direction of a straight line between antennas included in a reference device. For example, the reference direction may be the direction of a straight line connecting two antennas included in the reference device in an XZ plane. Additionally or alternatively, the reference direction may be a horizontal direction.

[0025] Throughout the specification, the expression "distance difference of any electronic device" may refer to the difference between the distance of any electronic device to a first reference device and the distance to a second reference device. The expression "AoA of any electronic device" may refer to at least one of the AoA of any electronic device relative to the first reference device or the AoA of any electronic device relative to the second reference device. The expression "angle difference of any electronic device" may refer to the angle difference between the AoA of any electronic device and the reference AoA.

[0026] Throughout the specification, the expression "the gaze direction of the user or the user's gaze direction" may refer to the user's facing direction, that is, the direction in which the user is looking in three-dimensional (3D) space. In an embodiment of the present disclosure, the gaze direction of the user may not be limited to the actual eye direction of the user, but may also be the direction in which the user's face is facing. For example, even when the user is not actually looking at any object, any object located in a straight line with the user may be located in the user's gaze direction. For example, any object that is visually recognizable even without the user raising his / her head, twisting his / her torso, or moving him / herself may be located in the direction in which the user is facing.

[0027] Throughout the specification, the XY plane may be a plane parallel to the surface of the earth. For example, a direction on the XY plane may be a left-right direction relative to a reference device (or user). The XZ plane and the YX plane may be perpendicular to the surface of the earth. For example, a direction on the XY plane may be an up-down direction relative to a reference device (or user).

[0028] Figure 1 is a diagram illustrating an example of an Internet of Things (IoT) system according to an embodiment of the present disclosure.

[0029] The IoT system 100 may include a reference device 110 (eg, a wireless headset), a computing device 120, and one or more electronic devices 130 (eg, a television (TV)), but is not limited thereto. Figure 1 1 shows a home IoT system as an example of the IoT system 100, but the present disclosure is not limited thereto, and IoT systems for various environments and purposes may also be used, such as a factory IoT system, an autonomous driving IoT system, etc. The computing device 120 of the home IoT system is Figure 1 1. The computing device 120 is shown as being located in a different space from the reference device 110 and the one or more electronic devices 130, but the location of the computing device 120 is not limited thereto.

[0030] The one or more electronic devices 130 may include electronic devices controlled by the computing device 120 in the IoT system 100. For example, in a home IoT system, the one or more electronic devices 130 may include home appliances (such as TV, refrigerator, air conditioner, etc.), lights, door lock devices, etc. The one or more electronic devices 130 may send or receive digital signals. In an embodiment of the present disclosure, the one or more electronic devices 130 may send or receive ultra-wideband (UWB) signals.

[0031] The reference device 110 may send or receive digital signals. In an embodiment of the present disclosure, the reference device 110 may send or receive UWB signals. For example, the reference device 110 may send a UWB signal to the one or more electronic devices 130, or receive a UWB signal from the one or more electronic devices 130. In an embodiment of the present disclosure, the reference device 110 may be able to communicate or wired / wirelessly connect with a user terminal. For example, the reference device 110 may be a wireless headset, and the user terminal associated with the reference device 110 may be a smartphone wirelessly connected to the wireless headset. In an embodiment of the present disclosure, the reference device 110 may be part of a user terminal and included in the user terminal. For example, the reference device 110 may be a UWB signal sending and receiving device embedded in a user terminal.

[0032] The computing device 120 may include one or more servers (e.g., IoT servers). In an embodiment of the present disclosure, the computing device 120 may provide a signal to the one or more electronic devices 130, or receive a signal from the one or more electronic devices 130. To this end, the computing device 120 may be able to communicate with the one or more electronic devices 130 or connect wired or wirelessly. For example, the signal may include at least one of information, data, requests, or instructions for controlling the one or more electronic devices 130. Additionally or alternatively, the signal may include at least one of information, data, requests, or instructions used by the computing device 120 to perform any operation.

[0033] In an embodiment of the present disclosure, the computing device 120 may receive a signal from the reference device 110, or provide a signal to the reference device 110. For example, the computing device 120 may be able to communicate directly with the reference device 110 or be connected by wire or wirelessly. For example, the reference device 110 may be embedded in the computing device 120. Additionally or alternatively, the computing device 120 may be able to communicate with a user terminal associated with the reference device 110 or be connected by wire or wirelessly. In this case, the computing device 120 may provide a signal to the reference device 110, or receive a signal from the reference device 110, through the user terminal.

[0034] The computing device 120 may receive a user input signal to control at least one device included in the IoT system 100. For example, the computing device 120 may receive a user input signal from a device capable of communicating or wired or wirelessly connecting with the computing device 20. The user input signal may include at least one of data, information, an identifier, a request, or an instruction corresponding to the user input.

[0035] The computing device 120 may obtain information about at least one of the electronic device or operation to be controlled from the received user input signal. In an embodiment of the present disclosure, the computing device 120 may determine a target device from the one or more electronic devices 130. For example, the computing device 120 may determine the target device based on information about the electronic device to be controlled (e.g., a device identifier). Additionally or alternatively, based on information about the operation obtained from the user input signal, the computing device 120 may select a device capable of performing the operation as the target device. Additionally or alternatively, the computing device 120 may determine the target device based on information about the location of each of the one or more electronic devices 130. The location information of each of the one or more electronic devices 130 may be information identified based on a UWB signal sent or received between the reference device 110 and each electronic device.

[0036] The computing device 120 may control the target device. In an embodiment of the present disclosure, the computing device 120 may control the target device to perform an operation corresponding to a user input signal. To this end, the computing device 120 may send a control signal to the target device.

[0037] refer to Figure 1 , computing device 120 may receive a signal corresponding to a user voice command “power on” (i.e., a user input signal). The user input signal may include only information about the operation to be controlled without an additional device identifier. Computing device 120 may identify an electronic device (e.g., a turned-off light, washing machine, fan, TV, etc.) that may perform the operation corresponding to the received signal (i.e., power on).

[0038] The computing device 120 may select the TV 130 as a target device on which an operation may be performed based on the location information of the identified electronic device. For example, the computing device 120 may determine that the TV 130 is located in the user's gaze direction based on the UWB signal transmitted and received between the wireless headset 110 and the TV 130, and determine the TV 130 as a target device. The computing device 120 may control the TV 130 determined as the target device to turn on. The TV 130 may be turned on only by the user's voice command "turn on".

[0039] Although computing device 120 is Figure 110 is shown as receiving the user input signal from the reference device 110, but is not limited thereto. For example, the computing device 120 may receive the user input signal through a user terminal connected to the reference device 110. Additionally or alternatively, the computing device 120 may receive the user input signal through an input device included in the computing device 120.

[0040] Although the computing device 120 and the reference device 110 are Figure 1 1 and 120 are shown as separate devices, but are not limited thereto. For example, computing device 120 and reference device 110 may be the same device. In this case, reference device 110 may perform the functions and operations of the computing device. For example, reference device 110 and computing device 120 may be sub-devices that constitute one device.

[0041] Figure 2 is a flow chart illustrating a method according to an embodiment of the present disclosure, by which a computing device controls a target device.

[0042] refer to Figure 2 , by a computing device (e.g., Figure 1 The method 200 of controlling a target device may include operations 210 to 230. The method 200 of controlling a target device is not limited to Figure 2 The method shown may also include Figure 2 For example, the computing device may first determine whether the reference device is activated (eg, whether the reference device is installed). The computing device may perform operations 210 to 230 based on determining that the reference device is activated.

[0043] In operation 210, the computing device may identify a distance difference between a distance from one or more electronic devices to a first reference device and a distance to a second reference device. In an embodiment of the present disclosure, the computing device may identify the distance difference by receiving information about a difference between a distance from an electronic device to the first reference device and a distance to the second reference device. In an embodiment of the present disclosure, the computing device may calculate a distance difference between a distance from an electronic device to the first reference device and a distance to the second reference device.

[0044] In operation 220, the computing device may identify an angle difference between an angle of arrival (AoA) of the one or more electronic devices relative to at least one of a first reference device or a second reference device (hereinafter referred to as a reference device) and a reference AoA. In an embodiment of the present disclosure, the computing device may identify the angle difference by receiving information about a difference between the AoA of the electronic device relative to the reference device and the reference AoA. In an embodiment of the present disclosure, the computing device may calculate an angle difference between the AoA of the electronic device relative to the reference device and the reference AoA.

[0045] In operation 230, the computing device may control the target device based on at least one of the distance difference or the angle difference. In an embodiment of the present disclosure, the target device may be at least one of the one or more electronic devices. In an embodiment of the present disclosure, the target device may be a reference device. In an embodiment of the present disclosure, the target device may be a user terminal associated with the reference device. In an embodiment of the present disclosure, the target device may be a mobile object including the reference device.

[0046] Figure 3 is a flow chart illustrating a method according to an embodiment of the present disclosure, by which a computing device controls a target device.

[0047] Specifically, Figure 3 can represent a process performed by a computing device (e.g., Figure 1 A method for determining a target device and controlling the target device in an IoT system (a computing device of the present disclosure). In an embodiment of the present disclosure, the computing device may determine a device located in a specific area relative to a reference device (for example, in the gaze direction of a user wearing the reference device) from among the electronic devices included in the IoT system as a target device. For example, the computing device may determine a device determined to be gazed at by a user as a target device.

[0048] In operation 310, the computing device may receive a user input signal. In an embodiment of the present disclosure, the computing device may receive the user input signal from at least one of a user terminal, a reference device, an electronic device, or an input device that can communicate with the computing device or is wired / wirelessly connected (hereinafter referred to as a user terminal). For example, the user input signal may be a digital signal converted from a user's voice command.

[0049] In operation 320, the computing device may identify one or more electronic devices associated with the user input signal. In other words, the computing device may identify one or more electronic devices based on the received user input signal. In an embodiment of the present disclosure, the computing device may extract at least one of the devices or operations to be controlled from the user input signal by analyzing the user input signal.

[0050] In an embodiment of the present disclosure, a computing device may identify one or more electronic devices that can perform operations according to a user input signal from a plurality of electronic devices included in an IoT system. For example, in response to receiving a signal corresponding to a user command "increase temperature", a computing device may identify a refrigerator and an air conditioner that can perform the "increase temperature" operation. In an embodiment of the present disclosure, a computing device may identify one or more electronic devices by analyzing a device identifier included in a user input signal. For example, in response to receiving a signal corresponding to a user command "turn off the light", a computing device may identify one or more lights included in an IoT system.

[0051] In operation 330, the computing device may determine whether there are two or more electronic devices associated with the user input signal. In operation 340, based on determining that there are less than two electronic devices associated with the user input signal (i.e., one electronic device), the computing device may determine the electronic device as the target device. On the other hand, in operation 332, based on the number of electronic devices associated with the user input signal being two or more (i.e., multiple electronic devices), the computing device may select an electronic device that satisfies the distance condition and / or angle condition from the multiple electronic devices.

[0052] In an embodiment of the present disclosure, the distance condition of operation 332 may be a condition requiring that the difference between the distance from the electronic device to the first reference device and the distance to the second reference device is less than a first threshold. For example, the computing device may determine that the electronic device whose distance to the first reference device and the distance to the second reference device are less than the first threshold satisfies the distance condition. In an embodiment of the present disclosure, the angle condition of operation 330 may be a condition requiring that the angle difference between the AoA of the electronic device relative to at least one of the first reference device or the second reference device (hereinafter referred to as the reference device) and the reference AoA is less than a second threshold. For example, the computing device may determine that the electronic device whose angle difference between the AoA relative to the reference device and the reference AoA is less than the second threshold satisfies the angle condition.

[0053] In operation 350, the computing device may determine whether there is an electronic device that satisfies both the distance condition and the angle condition among the multiple electronic devices. For example, the computing device may determine whether there is an electronic device with a distance difference less than a first threshold and an angle difference less than a second threshold. In operation 352, based on determining that there is an electronic device that satisfies both conditions, the computing device may determine a target device from the electronic devices that satisfy both conditions.

[0054] On the other hand, in operation 360, based on determining that there is no electronic device that satisfies both conditions, the computing device may determine whether the user is looking at the device to be controlled. To this end, in an embodiment of the present disclosure, the computing device may provide a request to check the gaze to the user terminal. The computing device may receive a gaze check signal from the user terminal. The gaze check signal may include information indicating whether the user is looking at the device to be controlled. The computing device may determine whether the user is looking at the device to be controlled based on the received check signal.

[0055] In operation 362, based on determining that the user is not looking at the device to be controlled, the computing device may control the user terminal to output a notification. The notification output in operation 362 may include a notification indicating that there is no controllable electronic device within the user's gaze range. Additionally or alternatively, in operation 362, the output notification may include a notification requesting to look at the controllable electronic device and issue a command again.

[0056] In operation 364, based on determining that the user is looking at the device to be controlled, the computing device may determine the electronic device with the smallest angle difference among the multiple electronic devices as the target device. In an embodiment of the present disclosure, the computing device may determine the electronic device with the smallest angle difference among at least some of the electronic devices that meet the distance condition as the target device.

[0057] In operation 370, the computing device may control the target device determined in at least one of operations 340, 352, or 364. In an embodiment of the present disclosure, the computing device may control the target device to perform an operation corresponding to the user input signal. To this end, the computing device may send a control signal to the target device.

[0058] refer to Figure 3 , the method 300 for controlling the target device may include operations 310 to 370, but is not limited thereto, and some of the operations shown may be omitted, or other operations may be included. For example, the method 300 may also include an operation of checking whether the determined target device corresponds to a device that the user wants to control. For example, the computing device may omit operations 360 and 362, and may perform operation 364 based on determining that there is no electronic device that satisfies both conditions. In addition, Figure 3 At least some of the operations shown in can be performed in a different order.

[0059] Figure 4a is a flowchart illustrating a method of selecting an electronic device that meets a distance condition according to an embodiment of the present disclosure. Figure 4b is a diagram illustrating an example of selecting an electronic device satisfying a distance condition according to an embodiment of the present disclosure.

[0060] Figure 4a Can be expressed in Figure 3 An example of a method for selecting an electronic device that satisfies the distance condition in operation 332 of the present disclosure. In an embodiment of the present disclosure, based on the difference between the distance from each of the multiple electronic devices to the first reference device and the distance to the second reference device, the computing device can identify the electronic device that satisfies the distance condition among the multiple electronic devices.

[0061] In operation 410, the computing device may identify a distance d1 from an arbitrary electronic device to a first reference device. The distance d1 from the arbitrary electronic device to the first reference device may be calculated based on UWB signal transmission and reception information between the arbitrary electronic device and the first reference device. In an embodiment of the present disclosure, the computing device may receive information about the distance d1 from at least one of the arbitrary electronic device or the first reference device. In an embodiment of the present disclosure, the computing device may receive information for calculating the distance d1 (e.g., UWB signal transmission and reception information) from at least one of the arbitrary electronic device or the first reference device to calculate the distance d1. For example, the information for calculating the distance may include signal information, transmission time, reception time, etc., transmitted and received between the arbitrary electronic device and the first reference device.

[0062] Likewise, the computing device may identify a distance d2 from the arbitrary electronic device to the second reference device in operation 420. The distance identified in operations 410 and 420 may be a distance determined according to a UWB mechanism. Figure 4a Operations 410 and 420 are shown in sequence in FIG. 1 , but are not limited thereto. For example, the computing device may perform operations 410 and 420 in a different sequence. Alternatively, the computing device may perform operations 410 and 420 simultaneously.

[0063] In operation 430, the computing device may determine whether the distance difference between the distance d1 to the first reference device and the distance d2 to the second reference device is less than a first threshold. In other words, the computing device may compare the distance difference with the first threshold.

[0064] In operation 440, based on determining that the distance difference is less than the first threshold, the computing device may identify the arbitrary electronic device as an electronic device that satisfies the distance condition. The electronic device that satisfies the distance condition may be a device located in the gaze direction of the user on the XY plane.

[0065] The first threshold may be pre-set or may be set in real time. For example, the first threshold may be a value pre-set in the initial setting stage. In an embodiment of the present disclosure, the first threshold may be a value set based on the distance between the first reference device and the second reference device. For example, the first threshold may be set to a value less than the distance between the first reference device and the second reference device. In an embodiment of the present disclosure, the first threshold may be different or the same for each electronic device. Additionally or alternatively, the first threshold may be different or the same for each user. Additionally or alternatively, the first threshold may be different or the same depending on the location of the reference device. Additionally or alternatively, the first threshold may be a value set based on the distance between the reference device and each electronic device.

[0066] The computing device may select an electronic device that satisfies the distance condition by performing the aforementioned operations 410 to 440 on each of the plurality of electronic devices. Figure 4b , the computing device can identify the distance from each electronic device 403, 404 or 405 to the left earphone 401. Similarly, the computing device can identify the distance from each electronic device 403, 404 or 405 to the right earphone 402.

[0067] For example, based on determining that the difference between the distance d1 to the left earphone 401 and the distance d2 to the right earphone 402 is less than the first threshold, the computing device can identify that the electronic device 403 meets the distance condition. Similarly, based on determining that the difference between the distance d1 from the electronic device 404 to the left earphone 401 and the distance d2 to the right earphone 402 is less than the first threshold, the computing device can identify that the electronic device 404 meets the distance condition. On the other hand, based on determining that the difference between the distance d1 from the electronic device 405 to the left earphone 401 and the distance d2 to the right earphone 402 is equal to or greater than the first threshold, the computing device can identify that the electronic device 405 does not meet the distance condition. Therefore, the computing device can select electronic devices 403 and 404 from the multiple electronic devices 403, 404, and 405 as electronic devices that meet the distance condition.

[0068] In an embodiment of the present disclosure, the computing device may execute, for each of the plurality of electronic devices, simultaneously or sequentially. Figure 4a Operations 410 to 440 are shown. For example, referring to Figure 4b , the computing device may perform operations 410 to 440 for electronic device 404 while performing operations 410 to 440 for electronic device 403. Alternatively, the computing device may perform operations 410 to 440 for electronic device 403 and then perform operations 410 to 440 for electronic device 404.

[0069] In the embodiments of the present disclosure, the first reference device and the second reference device may correspond to separate devices that exist in pairs. Figure 4b As shown, the first reference device and the second reference device may be a pair of headphones, namely a left headphone 401 and a right headphone 402. In an embodiment of the present disclosure, the first reference device and the second reference device may be connected to the same user terminal by wire / wirelessly. In an embodiment of the present disclosure, the first reference device and the second reference device may be symmetrically arranged with respect to each other. For example, the first electronic device and the second electronic device may be symmetrical based on the left and right of the user.

[0070] Figure 5a is a flowchart illustrating a method of selecting an electronic device that satisfies an angle condition according to an embodiment of the present disclosure. Figure 5bis a diagram illustrating an example of selecting an electronic device satisfying an angle condition according to an embodiment of the present disclosure.

[0071] Figure 5a Can be expressed in Figure 3 An example of a method for selecting an electronic device that satisfies the angle condition in operation 332 of the present disclosure. In an embodiment of the present disclosure, based on the angle difference between the AoA of each of the multiple electronic devices relative to at least one of the first reference device or the second reference device (hereinafter referred to as the reference device) and the reference AoA (standard AoA), the computing device can identify the electronic device that satisfies the angle condition among the multiple electronic devices.

[0072] Additionally or alternatively, based on the angle difference between the AoA of at least one electronic device satisfying the distance condition relative to the reference device and the reference AoA, the computing device may identify the electronic device satisfying the angle condition among the at least one electronic device. In other words, the computing device may only determine whether the electronic device satisfying the distance condition satisfies the angle condition, but may not determine whether the electronic device not satisfying the distance condition among the multiple electronic devices satisfies the angle condition.

[0073] In operation 510, the computing device may identify the AoA of any electronic device relative to a reference device. Based on the UWB signal transmission and reception information between the arbitrary electronic device and the reference device, the AoA of the arbitrary electronic device relative to the reference device can be calculated. In an embodiment of the present disclosure, the computing device may receive information about the AoA from at least one of the arbitrary electronic device or the reference device. In an embodiment of the present disclosure, the computing device may receive information for computing the AoA from at least one of the arbitrary electronic device or the reference device. information (e.g., UWB signal transmission and reception information) to calculate AoA For example, to calculate AoA The information may include signal information, sending time, receiving time, etc. sent and received between the arbitrary electronic device and the reference device.

[0074] In operation 520, the computing device may determine the AoA relative to the reference device. Whether the angle difference between the reference AoA and the reference AoA is less than a second threshold. In other words, the computing device may compare the angle difference with the second threshold.

[0075] In operation 530, based on determining that the angle difference is less than the second threshold, the computing device may identify the arbitrary electronic device as an electronic device that satisfies the angle condition. The electronic device that satisfies the angle condition may be a device located in the user's gaze direction on the XZ (or YZ) plane.

[0076] The reference AoA may be pre-set or set in real time. In an embodiment of the present disclosure, the reference AoA may be a value pre-set in the initial setup phase. For example, the reference AoA may be a value set based on the AoA relative to the identified reference device in the initial setup phase. In an embodiment of the present disclosure, the reference AoA may be different or the same for each electronic device. Additionally or alternatively, the reference AoA may be different or the same for each user. Additionally or alternatively, the reference AoA may be different or the same for each reference device. Additionally or alternatively, the reference AoA may be different or the same depending on the location of the reference device. Additionally or alternatively, the reference AoA may be a value set based on the distance between the reference device and each electronic device.

[0077] The second threshold value may be pre-set or may be set in real time. In an embodiment of the present disclosure, the second threshold value may be a value pre-set in the initial setting stage. In an embodiment of the present disclosure, the second threshold value may be different or the same for each electronic device. Additionally or alternatively, the second threshold value may be different or the same for each user. Additionally or alternatively, the second threshold value may be different or the same for each reference device. Additionally or alternatively, the second threshold value may be different or the same depending on the position of the reference device. Additionally or alternatively, the second threshold value may be a value set based on the distance between the reference device and each electronic device.

[0078] The computing device may select an electronic device that satisfies the angle condition by performing the aforementioned operations 510 to 530 for each of the multiple electronic devices. In an embodiment of the present disclosure, the computing device may select an electronic device that satisfies the angle condition by performing operations 510 to 530 only for the at least one electronic device that satisfies the distance condition among the multiple electronic devices.

[0079] refer to Figure 5b , the computing device may determine the AoA of each electronic device 403 or 404 relative to the right earphone 402. For example, based on determining that the angle difference between the AoA of the electronic device 404 relative to the right earphone 402 and the reference AoA is less than the second threshold, the computing device may identify that the electronic device 404 satisfies the angle condition. On the other hand, based on determining that the difference between the AoA of the electronic device 403 relative to the right earphone 402 and the reference AoA is equal to or greater than the second threshold, the computing device may identify that the electronic device 403 does not satisfy the angle condition. Therefore, the computing device may select the electronic device 404 from the electronic devices 403 and 404 as the electronic device that satisfies the angle condition.

[0080] Additionally or alternatively, the computing device may also determine whether the electronic device 405 that does not meet the distance condition meets the angle condition. In this case, based on determining that the angle difference between the AoA of the electronic device 405 relative to the right earphone 402 and the reference AoA is less than the second threshold, the computing device may identify that the electronic device 405 meets the angle condition.

[0081] In an embodiment of the present disclosure, the computing device may perform operations 510 to 530 for each of the plurality of electronic devices simultaneously or sequentially. Figure 5b , while performing operations 510 to 530 for electronic device 403, the computing device may also perform operations 510 to 530 for electronic device 404. Alternatively, the computing device may perform operations 510 to 530 for electronic device 403 and then perform operations 510 to 530 for electronic device 404.

[0082] Figure 6 is a flow chart illustrating a method by which a computing device determines a target device according to an embodiment of the present disclosure.

[0083] Figure 6 Can be expressed in Figure 3 An example of a method in which the computing device determines the electronic device having the smallest angle difference as the target device in operation 364. Figure 3 In operation 364, based on determining that there is no electronic device that satisfies both the distance condition and the angle condition, the computing device may determine the electronic device having the smallest angle difference between the AoA relative to the reference device and the reference AoA as the target device.

[0084] In an embodiment of the present disclosure, based on determining that all electronic devices associated with the user input signal have a distance difference equal to or greater than a first threshold or an angle difference equal to or greater than a second threshold, the computing device may determine the electronic device with the smallest angle difference among the electronic devices associated with the user input signal as the target device. In an embodiment of the present disclosure, based on determining that at least one electronic device that meets the distance condition has an angle difference equal to or greater than the second threshold, the computing device may determine the electronic device with the smallest angle difference among the at least one electronic device as the target device.

[0085] In operation 610, the computing device may identify an electronic device having a minimum angle difference between an AoA relative to a reference device and the reference AoA. In an embodiment of the present disclosure, the computing device may identify an electronic device having a minimum angle difference among the multiple electronic devices associated with the user input terminal as a target device. In an embodiment of the present disclosure, the computing device may identify an electronic device having a minimum angle difference among the at least one device that satisfies the distance condition.

[0086] The computing device may request the user to confirm whether the identified electronic device corresponds to the device that the user wants to control. For example, in operation 620, the computing device may send a user confirmation request signal to, for example, a user terminal (e.g., at least one of a user terminal capable of communicating or wired / wirelessly connecting with the computing device, a reference device, or an output device). For example, the computing device may control the user terminal to output a notification requesting user confirmation by sending the user confirmation request signal.

[0087] In operation 630, the computing device may receive a user confirmation signal. In an embodiment of the present disclosure, the computing device may receive a user input signal from a user terminal (e.g., at least one of a user terminal capable of communicating or wired / wirelessly connecting with the computing device, a reference device, or an input device), the user input signal indicating that the identified electronic device is a device to be controlled. For example, the user input signal received in operation 630 may be a user response signal to the user confirmation request signal sent in operation 620.

[0088] In operation 640, in response to receiving the user confirmation signal, the computing device may determine that the identified electronic device is the target device. In addition, in operation 650, the computing device may update the reference AoA based on the AoA of the target device relative to the reference device (i.e., the AoA of the electronic device determined to be the target device relative to the reference device). When the user confirmation process of operations 620 and 630 is performed, the device that the user wants to control can be more accurately identified.

[0089] On the other hand, as a response to the user confirmation request of operation 620, the computing device may receive a signal indicating that the identified electronic device is not the electronic device that the user wants to control. In this case, the computing device may control the user terminal to output a notification requesting attention to the electronic device to be controlled.

[0090] Although Figure 6 The method for determining a target device shown includes operations 610 to 650, but is not limited thereto, and some operations may be omitted, or other operations may be further included. For example, the computing device may determine the identified electronic device as the target device without additional user confirmation (i.e., operations 620 and 630 are not required). For example, the computing device may receive a reference AoA update request (e.g., an automatic correction request) from a user terminal, and perform operation 650 based thereon.

[0091] In an embodiment of the present disclosure, the computing device may control the user terminal to output a notification indicating that the state of the reference device (e.g., the state of wearing the reference device) is different from the state of the initial setting. Additionally or alternatively, the computing device may control the user terminal to output a notification requesting that the state of the reference device be adjusted to be equal to the state in the initial setting. Additionally or alternatively, as the state of the reference device is adjusted, the computing device may determine whether the adjusted state of the reference device is equal to the state in the initial setting. To this end, the computing device may determine whether the distance between the adjusted reference device and the target device and the AoA of the target device relative to the adjusted reference device meet the conditions set in the initial setting (e.g., a first threshold, a reference AoA, a second threshold, etc.). Based on determining that the state of the reference device is equal to the state in the initial setting, the computing device may control the user terminal to output a notification indicating that the state of the reference device has been adjusted to be equal to the state in the initial setting.

[0092] Figure 7 is a flow chart illustrating a method by which a computing device determines a target device according to an embodiment of the present disclosure.

[0093] Figure 7 Can be expressed Figure 3 In an example of the method in operation 352 of the embodiment of the present invention, the computing device determines a target device from electronic devices that meet all conditions through the method. Figure 3 Based on determining that there is an electronic device that satisfies all the conditions, in operation 352, the computing device may determine the target device from the electronic devices that satisfy all the conditions. In an embodiment of the present disclosure, the electronic device that satisfies all the conditions may be an electronic device that satisfies the distance condition and the angle condition. For example, the electronic device that satisfies all the conditions may be an electronic device having a distance difference less than a first threshold and an angle difference less than a second threshold.

[0094] The computing device may identify the number of electronic devices that meet all conditions. In an embodiment of the present disclosure, in operation 710, the computing device may determine whether there are two or more electronic devices that meet all conditions.

[0095] In operation 720, based on determining that there are less than two electronic devices (i.e., one electronic device) that satisfy both the distance condition and the angle condition, the computing device may determine the electronic device as the target device. Therefore, the computing device may determine one electronic device that the user is looking at (i.e., one electronic device that exists in the user's gaze direction) as the target device.

[0096] Based on determining that there are two or more electronic devices (i.e., multiple electronic devices) that satisfy both the distance condition and the angle condition, the computing device may determine one of the electronic devices that satisfy both the distance condition and the angle condition as the target device. In an embodiment of the present disclosure, in operation 730, the computing device may determine the target device based on the distance to the reference device. For example, the computing device may determine the electronic device that is closest to the reference device among the electronic devices that satisfy both the distance condition and the angle condition as the target device.

[0097] In an embodiment of the present disclosure, based on a user input signal (for example, Figure 3 The computing device may determine the target device from the electronic devices that satisfy both the distance condition and the angle condition based on the value of the user input signal received in 310. For example, the higher the volume level of the user voice command, the computing device may determine the electronic device that is farther from the reference device as the target device, and the lower the volume level of the user voice command, the computing device may determine the electronic device that is closer to the reference device as the target device.

[0098] Although Figure 7 The method of determining a target device shown includes operations 710 to 730, but is not limited thereto, and some operations may be omitted or other operations may be further included.

[0099] Figure 8a is a flowchart illustrating a method of controlling a target device to output information associated with an electronic device according to an embodiment of the present disclosure. Figure 8b is a diagram illustrating that a target device outputs information associated with an electronic device according to an embodiment of the present disclosure.

[0100] Figure 8a It can be shown Figure 2 In an embodiment of the present disclosure, the target device may be a user terminal. For example, the target device may be a wearable device, a virtual reality (VR) device, an augmented reality (AR) device, etc. In an embodiment of the present disclosure, the first reference device and the second reference device may be included in the target device. For example, the first reference device and the second reference device may be part of the target device to perform any function (e.g., transmission and reception of UWB signals).

[0101] In operation 810, the computing device may determine whether any electronic device satisfies the condition. In an embodiment of the present disclosure, the computing device may determine whether any electronic device satisfies the distance condition. For example, the computing device may compare the distance difference of the any electronic device with a first threshold to determine whether the distance condition is satisfied. The computing device may determine that an electronic device having a distance difference less than the first threshold satisfies the distance condition.

[0102] In an embodiment of the present disclosure, the computing device may determine whether the arbitrary electronic device satisfies the angle condition. For example, the computing device may compare the angle difference of the arbitrary electronic device with a second threshold value to determine whether the angle condition is satisfied. The computing device may determine that an electronic device having a distance difference less than the second threshold value satisfies the angle condition.

[0103] In operation 820, based on determining that the arbitrary electronic device satisfies both the distance condition and the angle condition, the computing device may determine whether the information output mode of the target device is activated. In an embodiment of the present disclosure, the computing device may determine whether the information output mode is activated by identifying the current mode of the target device. For example, the information output mode may be a setting mode in which the target device outputs information associated with the arbitrary electronic device.

[0104] In operation 830, the computing device may control the target device to output information associated with the arbitrary electronic device. In an embodiment of the present disclosure, the computing device may control the target device to output information about electronic devices that satisfy both the distance condition and the angle condition. To this end, the computing device may send the associated information to the target device. Additionally or alternatively, the computing device may control the arbitrary electronic device to transmit the associated information to the target device. In an embodiment of the present disclosure, the target device may be a computer that is associated with the execution Figure 8a In this case, the target device may perform the functions and operations of the computing device. For example, in operation 830, the computing device may output information related to the arbitrary electronic device as the target device. In an embodiment of the present disclosure, the reference device, the target device, and the computing device may be sub-devices constituting one device. For example, a reference device as a UWB signal sending and receiving device, a target device as a display device (i.e., a display), and a computing device as a processing device (e.g., a processor) may be included in one device (e.g., a VR device).

[0105] refer to Figure 8b , when the user 840 wears the VR device 850 and looks at the air conditioner 860, the air conditioner 860 may satisfy both the distance condition and the angle condition. In an embodiment of the present disclosure, the distance difference between the distance to the first reference device and the distance to the second reference device of the air conditioner 860 may be less than the first threshold, and the angle difference between the AoA relative to the reference device and the reference AoA may be less than the second threshold. The computing device may control information 870 associated with the air conditioner 860, such as the current temperature, air quality, wind direction, wind strength, etc., to be visually output through the VR device 850.

[0106] exist Figure 8bIn the VR device 850, the first reference device and the second reference device may be included as partial components in the VR device 850. For example, the first reference device and the second reference device may be UWB signal transmitting and receiving devices (e.g., sensors, modules, antennas, etc.) symmetrically built into the VR device 850. For example, the first reference device and the second reference device may be located on the left and right sides to form bilateral symmetry based on the center of the VR device 850.

[0107] Although Figure 8a The method for controlling the target device to output information associated with the electronic device shown includes operations 810 to 830, but is not limited thereto, and some operations may be omitted or other operations may also be included. For example, the computing device may control the target device to output information associated with the electronic device without performing an operation to determine the mode of the target device, that is, without performing operation 820. In an embodiment of the present disclosure, regardless of the mode of the target device, the computing device may send information associated with the electronic device to the target device. In this case, the target device may output or not output the received information associated with the electronic device according to the current mode.

[0108] Fig. 9 is a flowchart illustrating a method for controlling output of guide information for a location of an electronic device according to an embodiment of the present disclosure.

[0109] In operation 910, the computing device may receive a user input signal. In an embodiment of the present disclosure, the user input signal may include a signal requesting location information of any electronic device. For example, the user input signal may be a signal corresponding to a user input requesting location information of any electronic device. The user input signal may include information about the electronic device that the user is looking for.

[0110] In operation 920, the computing device may identify an electronic device associated with the received user input signal. In other words, the computing device may identify the electronic device that the user is looking for based on the received user input signal. For example, the computing device may extract a device identifier from the user input signal.

[0111] In operation 930, the computing device may identify a distance difference between a distance from the identified electronic device to the first reference device and a distance to the second reference device. Fig. 9 In operation 930, you can apply Figure 4a and Figure 4b In operation 940, the computing device may identify an angle difference between an AoA of the identified electronic device relative to the reference device and the reference AoA. Fig. 9 In operation 940, you can apply Figure 5a and Figure 5b Embodiment of the invention.

[0112] In operation 950, the computing device may determine whether the identified electronic device satisfies the distance condition and the angle condition. In operation 952, the computing device may control the target device to output a notification based on determining that the identified electronic device satisfies the distance condition and the angle condition. In an embodiment of the present disclosure, the computing device may control, for example, a user terminal to output a notification based on determining that the distance difference of the identified electronic device is less than a first threshold and the angle difference is less than a second threshold. For example, the notification may be a notification indicating that the electronic device to be found by the user is located in the direction of the user's face (i.e., the user's gaze direction).

[0113] In operation 954, the computing device may control the target device to output guidance information based on determining that the identified electronic device does not satisfy at least one of the distance condition or the angle condition. In an embodiment of the present disclosure, the computing device may control, for example, a user terminal to output guidance information about the location of the identified electronic device based on determining that the distance difference of the identified electronic device is equal to or greater than a first threshold or the angle difference is equal to or greater than a second threshold.

[0114] The guidance information may include movement information of the identified electronic device to satisfy at least one of the distance condition or the angle condition. In an embodiment of the present disclosure, the guidance information may include first movement information for reducing the distance difference between the distance from the identified electronic device to the first reference device and the distance to the second reference device. The first movement information may include the user's gaze movement direction (e.g., left, right, etc.) of the identified electronic device, the degree of gaze movement, etc., to satisfy the distance condition. For example, the first movement information may include information indicating a movement to the left of up to 40 degrees.

[0115] In an embodiment of the present disclosure, the guidance information may include second movement information for reducing the angle difference between the AoA of the identified electronic device relative to the reference device and the reference AoA. The second movement information may include the user's gaze movement direction (e.g., up, down, etc.) of the identified electronic device, the gaze movement degree, etc., to meet the angle condition. For example, the second movement information may include information indicating a downward movement of up to 25 degrees.

[0116] refer to Fig. 9 , computing devices (e.g., Figure 1 The method for outputting guidance information about the location of an electronic device by a computing device of a reference device includes operations 910 to 954, but is not limited thereto, and may also include other operations or omit some operations. For example, when the reference device does not receive a UWB signal from the identified electronic device in operation 910, the computing device may control, for example, a user terminal to output a notification indicating that the identified electronic device does not exist in the IoT space.

[0117] Fig.10a is a flowchart illustrating a method of controlling a target device by determining a location of the target device according to an embodiment of the present disclosure. Fig.10b is a diagram illustrating an example of controlling a target device by determining a position of the target device according to an embodiment.

[0118] refer to Fig.10a , computing devices (e.g., Figure 1 The method for determining the position of a target device to control the target device by a computing device (computing device) includes operations 1010 to 1050, but is not limited thereto and may further include other operations or may omit some operations.

[0119] In operation 1010, a computing device may receive a user input signal regarding a target device. In an embodiment of the present disclosure, the computing device may receive a user input signal requesting the target device to move to a targeting location. For example, the target device may be a mobile object. To this end, the computing device may be able to communicate with or be wired / wirelessly connected to the mobile object, or be included in the mobile object.

[0120] In operation 1020, the computing device may identify a distance difference and an angle difference of one or more electronic devices relative to a reference device. For example, the reference device may be included in a mobile object. In an embodiment of the present disclosure, the one or more electronic devices may be associated with a targeting location of the mobile object. For example, when the targeting location is a parking area, the one or more electronic devices may be located in the parking area.

[0121] In operation 1030, the computing device may determine whether the target device is located at a reference position (e.g., a ready position) based on the identified distance difference and angle difference. In an embodiment of the present disclosure, the computing device may determine whether the mobile object is located at the reference position based on whether the distance condition and angle condition of the one or more electronic devices relative to the reference device included in the mobile object are satisfied. The first threshold, the reference AoA, and the second threshold used to determine whether the mobile object is located at the reference position may be values ​​set in the initial setting stage. For example, the first threshold may be set based on the distance difference of the one or more electronic devices when the mobile object is located at the reference position. For example, the reference AoA may be set based on the AoA of the one or more electronic devices relative to the mobile object when the mobile object is located at the reference position.

[0122] In operation 1040, based on determining that the target device is located at the reference position, the computing device may control the target device to output a notification. In an embodiment of the present disclosure, the computing device may output a notification through a user terminal (e.g., at least one of a mobile object, a reference device, a user terminal, or an output device). For example, the output notification may include a notification indicating that the mobile object is located at the reference position. For example, the output notification may include a notification indicating that preparations for moving to the aiming position are completed. For example, the output notification may include movement guidance information for moving to the aiming position.

[0123] In operation 1050, based on determining that the target device is located at a position other than the reference position, the computing device may control the target device to move to the reference position. In an embodiment of the present disclosure, based on determining that the mobile object is located at a position other than the reference position, the computing device may control the mobile object to perform an operation of moving to the reference position. For example, the computing device may send a control signal that causes the mobile object to perform an operation of moving to the reference position without additional user intervention. To this end, the computing device may provide movement guidance information for the mobile object to move to the reference position.

[0124] refer to Fig.10b , the mobile object 1062 may include a first reference device 1064 and a second reference device 1066 capable of transmitting and receiving UWB signals. The first reference device 1064 and the second reference device 1066 may be arranged to form left-right symmetry based on the center of the mobile object 1062. One or more electronic devices may be UWB signal transmitting and receiving devices located in the parking area. For example, a pair of UWB signal transmitting and receiving devices 1082 and 1084 may be placed to form symmetry in the parking area.

[0125] exist Fig.10b In the example, the computing device may determine that the current position 1060 of the mobile object 1062 does not correspond to the reference position 1070 based on the distance difference and the angle difference between the UWB signal transmitting and receiving devices 1082 and 1084 and the first reference device 1064 and the second reference device 1066. Based on this, the computing device may output a notification indicating that the mobile object 1062 is not located at the reference position 1070 through, for example, a user terminal. For example, the output notification may include guidance information for moving to the reference position 1070.

[0126] In an embodiment of the present disclosure, when the mobile object 1062 is located at the reference position 1070, the computing device may control the mobile device 1062 to move to the aiming position 1080. For example, the computing device may send a control signal that causes the mobile object 1062 to perform an operation of moving to the aiming position 1080 without additional user intervention. Additionally or alternatively, the computing device may send movement guidance information for the mobile object 1062 to perform an operation of moving to the aiming position 1080.

[0127] Fig.11 is a flowchart illustrating a method of controlling an electronic device located in a user's gaze direction when a virtual assistance system is activated according to an embodiment of the present disclosure.

[0128] The IoT system may include a virtual assistant system. In operation 1110, a computing device (e.g., Figure 1 A computing device) may receive a request to activate the virtual assistant system. For example, the request to activate the virtual assistant system may correspond to a user's instruction speech to wake up the virtual assistant system. For example, the computing device may receive a user input signal from at least one electronic device connected to the virtual assistant system, the user input signal indicating a request to activate the virtual assistant system.

[0129] In operation 1120, the computing device may identify an electronic device located in the user's gaze direction. In an embodiment of the present disclosure, the computing device may identify an electronic device that satisfies a distance condition and an angle condition relative to a reference device from among the one or more electronic devices associated with the virtual assistance system. Based on the recognition result, the computing device may determine in operation 1130 whether there is an electronic device in the user's gaze direction.

[0130] In operation 1140, the computing device may control output of a notification indicating that there is no electronic device in the user's gaze direction based on determining that there is no electronic device in the user's gaze direction. In an embodiment of the present disclosure, the computing device may control, for example, a user terminal to output a notification indicating that there is no electronic device associated with the virtual assistance system (e.g., an electronic device for performing an operation) in the user's gaze direction.

[0131] In operation 1150, the computing device may control the electronic device located in the user's gaze direction to output a notification based on determining that there is an electronic device in the user's gaze direction. For example, the computing device may control the electronic device identified as being located in the user's gaze direction to output a visual notification (e.g., a flashing light), an auditory notification (e.g., a notification sound), etc. This may allow the user to identify the electronic device located in the user's gaze direction. In other words, the user may identify the electronic device that executes the user's command in the virtual assistant system.

[0132] like Fig.11As shown, the method of controlling an electronic device located in a user's gaze direction may include operations 1110 to 1150, but is not limited thereto, and some of the operations shown may be omitted or other operations may be included.

[0133] Fig.12 is a flowchart illustrating a method for allowing a new user terminal to access an IoT system according to an embodiment of the present disclosure.

[0134] In order to control the electronic devices in the IoT system, there may be two or more user terminals connected to the IoT system. In addition, the computing device in the IoT system may receive user input signals from each user terminal to control the electronic devices. Each user input signal may be input by a different user.

[0135] In operation 1210, the computing device may receive a request from a user terminal to access the IoT system. In an embodiment of the present disclosure, the computing device may receive a system access request from a user terminal associated with a first reference device and a second reference device. For example, based on the installation or activation of the reference device, the user terminal associated with the reference device may send a system access request to the computing device. For example, in response to receiving a user input indicating a system access request, the user terminal may send a system access request to the computing device. The user terminal associated with the reference device may refer to a user terminal capable of communicating with the reference device or being connected wired / wirelessly or a user terminal including the reference device.

[0136] In operation 1220, the computing device may determine whether to allow access to the user terminal based on the received access request. In an embodiment of the present disclosure, the computing device may determine whether to allow access to the user terminal by determining whether the user terminal requesting access satisfies any condition. For example, the computing device may allow the user terminal to access the Internet of Things system based on determining that the user terminal satisfies the any condition.

[0137] In an embodiment of the present disclosure, the computing device may send a signal to the main user terminal in the IoT system to confirm whether the user terminal requesting access is allowed to access, and in return, receive a response signal. The computing device may determine whether to allow the user terminal to access based on the received response signal. The main user terminal may be a user terminal with the highest priority among one or more user terminals connected to the IoT system.

[0138] When access to the IoT system is allowed, the device allowed to access can control one or more electronic devices in the IoT system. In an embodiment of the present disclosure, the computing device can receive a user input signal from a user terminal allowed to access, and control the one or more electronic devices in the IoT system based on the received user input signal.

[0139] In operation 1230, the computing device may determine the priority of the user terminal allowed to access relative to other user terminals. The other user terminal may be a user terminal that has been connected to the IoT system. The other user terminal may also be associated with one or more reference devices, and the reference device associated with the other user terminal may be different from the reference device associated with the user terminal allowed to access.

[0140] The priority may include information about which signal the computing device uses to control the target device when a user input signal received by a user terminal that is allowed access conflicts with a user input signal received by another user terminal. Alternatively, the priority may include a ranking (i.e., a processing order) of which signal is processed first among multiple user input signals input simultaneously.

[0141] like Fig.12 As shown, the method for allowing access of a new user terminal may include operations 1210 to 1230, but is not limited thereto, and some of the operations shown may be omitted or other operations may also be included. In an embodiment of the present disclosure, based on allowing access of a new user terminal, a computing device may perform initial settings on the new user terminal. For example, the computing device may set a first threshold, a second threshold, and a reference AoA relative to a reference device associated with the new user terminal that is allowed access.

[0142] Although Fig.12 The figure shows the process of a user terminal controlling the access of an electronic device in an IoT system. Fig.12 One or more embodiments of the present invention may also be applicable to the access process of an electronic device to be controlled in an IoT system.

[0143] Fig.13 is a flowchart illustrating a method of controlling a target device based on determining that a plurality of user input signals conflict with each other according to an embodiment of the present disclosure.

[0144] In operation 1310, the computing device may receive a first user input signal from a first user terminal. In operation 1320, the computing device may receive a second user input signal from a second user terminal different from the first user terminal. Fig.13 , the computing device receives the first user input signal and then receives the second user input signal, but is not limited thereto. For example, the computing device may receive the first user input signal and the second user input signal at the same time.

[0145] In operation 1330, the computing device may determine whether the first user input signal conflicts with the second user input signal. For example, the conflict between the first user input signal and the second user input signal may refer to a command corresponding to the first user input signal conflicting with a command corresponding to the second user input signal. In an embodiment of the present disclosure, the computing device may determine whether control according to the first user input signal conflicts with control according to the second user input signal.

[0146] Specifically, the computing device may identify a target device relative to a first user input device and a target device relative to a second user input device. In an embodiment of the present disclosure, when the target device for the first user input device is different from the target device for the second user input device, the computing device may determine that the first user input signal does not conflict with the second user input signal. For example, when the target device to be controlled according to the first user input device is different from the target device to be controlled according to the second user input device, the computing device may determine that the first user input signal does not conflict with the second user input signal.

[0147] In an embodiment of the present disclosure, when the target device relative to the first user input signal is equal to the target device relative to the second user input signal, the computing device may determine whether the first user input signal and the second user input signal meet conflicting control purposes and / or control results. For example, when the control purposes and / or control results of the first user input signal and the second user input signal conflict with the same target device, the computing device may determine that the first user input signal conflicts with the second user input signal.

[0148] Additionally or alternatively, even when the target device relative to the first user input device is different from the target device relative to the second user input device, the computing device may determine that the first user input signal conflicts with the second user input signal when control results of the respective target devices in the IoT system are incompatible.

[0149] Based on determining that the first user input signal conflicts with the second user input signal, the computing device may control the target device based on the priority between the user terminals in operation 1340. In an embodiment of the present disclosure, when the priority of the first user terminal is higher than that of the second user terminal, the computing device may control the target device based on the first user input signal received from the first user terminal.

[0150] For example, the computing device may receive a first user input signal corresponding to 'lowering the air conditioning temperature' from a first user terminal, and receive a second user input signal corresponding to 'increasing the air conditioning temperature' from a second user terminal. Since the first user input signal and the second user input signal are related to the same target device (i.e., the air conditioner) and correspond to conflicting control purposes and results of increasing the temperature and decreasing the temperature, respectively, the computing device may determine that the first user input signal conflicts with the second user input signal. The computing device may control the decreasing of the air conditioning temperature based on the first user input signal received from the first user terminal having a higher priority than the second user terminal.

[0151] On the other hand, based on determining that the first user input signal does not conflict with the second user input signal, the computing device may control at least one target device according to the first user input signal and the second user input signal. In an embodiment of the present disclosure, the computing device may control the target device relative to the first user input signal, and control the target device relative to the second user input signal. For example, the computing device may control the temperature of the air conditioner to be lowered based on the first user input signal, and control the light to be turned on based on the second user input signal.

[0152] Fig.14 is a diagram showing a configuration example of an IoT system according to an embodiment of the present disclosure.

[0153] The IoT system 100 may include a reference device 110 , a computing device 120 , and the one or more electronic devices 130 . Fig.14 The reference device 110 may refer to at least one of a first reference device or a second reference device. Fig.14 The one or more electronic devices 130 may refer to devices that can be controlled by the computing device 120 in the IoT system 100 .

[0154] In an embodiment of the present disclosure, the reference device 110 may include one or more UWB signal antennas. For example, one reference device 110 may include two UWB signal antennas, and the distance between the two UWB signal antennas may be half of the signal wavelength (d= ). This feature can be used to measure the AoA of any electronic device relative to the reference device 110. The two antennas can be directional antennas that receive UWB signals in only one direction.

[0155] Although the reference device 110 is Fig.1410 is shown as communicating directly with the computing device 120, but is not limited thereto. For example, the reference device 110 may communicate with the computing device 120 via a user terminal associated with the reference device 110. In other words, the reference device 110 may provide data, information, requests, commands, and signals to the computing device 120 via a user terminal associated with the reference device 110, or receive data, information, requests, commands, and signals from the computing device 120. For example, the user terminal may include a smart phone, a mobile phone, a navigation terminal, a desktop computer, a laptop computer, a remote broadcast terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a tablet computer, a wearable device, a virtual reality (VR) device, an augmented reality (AR) device, etc., but is not limited thereto.

[0156] The one or more electronic devices 130 may send or receive UWB signals. To this end, the one or more electronic devices 130 may include one or more UWB signal antennas. For example, the reference device 110 and the one or more electronic devices 130 may send or receive UWB signals to each other. The one or more electronic devices 130 may also include a configuration for communicating with the computing device 120. In addition, the one or more electronic devices 130 may also include components for processing received signals and performing operations.

[0157] The computing device 120 may include one or more servers (eg, IoT servers). Fig.14 , the computing device 120 may include at least one processor 1410 and a memory 1420 .

[0158] The processor 1410 may be electrically connected to the components included in the computing device 120 to perform calculations or data processing for controlling and / or communicating the components included in the computing device 120. In an embodiment of the present disclosure, the processor 1410 may load a request, command, or data received from at least one other component onto the memory 1420, process it, and store the resultant data in the memory 1420. In various embodiments, the processor 1410 may include at least one of a central processing unit (CPU), an application processor (AP), a graphics processing unit (GPU), or a neural processing unit (NPU).

[0159] The memory 1420 may be electrically connected to the processor 1410 and may store one or more modules, programs, instructions, or data related to the operation of the components included in the computing device 120. The memory 1420 may include at least one type of storage medium, including a flash memory, a hard disk, a multimedia card micro memory, a card-type memory (e.g., an SD or XD memory), a random access memory (RAM), a static random access memory (SRAM), a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a programmable ROM (PROM), a magnetic memory, a magnetic disk, or an optical disk.

[0160] The components of computing device 120 are not limited to Fig.14 The components shown may also include Fig.14 For example, computing device 120 may also include input devices, output devices, input / output interfaces, communication interfaces, etc.

[0161] The communication interface may support establishing a wired or wireless communication channel between the user terminal, the one or more electronic devices 130, the reference device 110 and / or the external server (hereinafter referred to as the user terminal) and the computing device 120, and communicating on the established communication channel. In an embodiment of the present disclosure, the communication interface may receive data from the user terminal via wired communication or wireless communication. In addition, the communication interface may send data to the user terminal.

[0162] In various embodiments, the communication interface may include a wireless communication module (e.g., a cellular communication module, a short-range communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (e.g., a local area network (LAN) communication module or a power line communication module), and use one of the communication modules to communicate with an external electronic device or server through at least one network, such as a short-range communication network (e.g., Bluetooth, Wi-Fi direct, or Infrared Data Association (IrDA)) or a long-range communication network (e.g., a cellular network, the Internet, or a computer network (e.g., LAN or WAN)). The network may be configured as a wired network (e.g., Ethernet, a wired home network (power line communication), telephone line communication, RS serial communication, etc.), a wireless network (e.g., a mobile communication network, a wireless local area network (WLAN), Wi-Fi, etc.), or a combination thereof.

[0163] Despite Fig.14 The computing device, the target device, and the reference device are shown as separate devices, but are not limited thereto. For example, at least some of the computing device, the target device, or the reference device may be the same device or may constitute a single device. For example, at least one of the computing device, the target device, or the reference device may be included in or embedded in another device.

[0164] Can be combined Figures 1 to 14 One or more embodiments of the present invention are applied to other drawings, and repeated descriptions are omitted. Figures 1 to 14 One or more embodiments described in may be combined with each other.

[0165] The machine-readable storage medium may be provided in the form of a non-transitory storage medium. The term "non-transitory storage medium" may refer to a tangible device that does not include a signal (e.g., an electromagnetic wave), and does not distinguish between semi-permanent storage of data and temporary storage of data in the storage medium. For example, a non-transitory storage medium may include a buffer that temporarily stores data.

[0166] In an embodiment of the present disclosure, the above-mentioned methods according to various embodiments of the present disclosure may be provided in a computer program product. The computer program product may be a commercial product traded between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a CD-ROM) or distributed directly between two reference devices (e.g., a smartphone) or distributed online (e.g., downloaded or uploaded). In the case of online distribution, at least a portion of the computer program product (e.g., a downloadable application) may be at least temporarily stored or arbitrarily created in a storage medium that is readable by a device such as a manufacturer's server, an application store's server, or a relay server.

[0167] According to an embodiment of the present disclosure, a method for controlling a target device by a computing device may include identifying a distance difference between a distance from one or more electronic devices to a first reference device and a distance to a second reference device. In an embodiment of the present disclosure, the method may include identifying an angle difference between an angle of arrival of the one or more electronic devices relative to at least one of the first reference device or the second reference device and a reference angle of arrival. In an embodiment of the present disclosure, the method may include controlling the target device based on at least one of the distance difference or the angle difference.

[0168] In an embodiment of the present disclosure, the method may include comparing the distance difference of the one or more electronic devices with a first threshold. In an embodiment of the present disclosure, the method may include comparing the angle difference of the one or more electronic devices with a second threshold.

[0169] In an embodiment of the present disclosure, the method may include receiving a user input signal. In an embodiment of the present disclosure, the method may include identifying the one or more electronic devices associated with the received user input signal. In an embodiment of the present disclosure, the method may include determining a target device from the one or more electronic devices.

[0170] In an embodiment of the present disclosure, the method may include determining a target device from the one or more electronic devices based on determining that the distance difference of the one or more electronic devices is less than a first threshold and the angle difference is less than a second threshold. In an embodiment of the present disclosure, even when the user does not remember the identifier of each electronic device, the user can control the electronic device to be controlled only by looking at the electronic device and issuing instructions. In addition, the user can control the electronic device by issuing only a short instruction that does not include a device identifier.

[0171] In an embodiment of the present disclosure, the method may include determining an electronic device among the one or more electronic devices that is closest to at least one of the first reference device or the second reference device as the target device.

[0172] In an embodiment of the present disclosure, the method may include determining a target device from the one or more electronic devices based on a value of a user input signal.

[0173] In an embodiment of the present disclosure, the method may include determining the electronic device with the smallest angle difference among the one or more electronic devices as the target device based on determining that the one or more electronic devices all have a distance difference equal to or greater than a first threshold or an angle difference equal to or greater than a second threshold.

[0174] In an embodiment of the present disclosure, the one or more electronic devices may be electronic devices having a distance difference less than a first threshold value. In an embodiment of the present disclosure, the method may include determining the electronic device having the smallest angle difference among the one or more electronic devices as the target device based on determining that the angle differences of the one or more electronic devices are all equal to or greater than a second threshold value.

[0175] In an embodiment of the present disclosure, a method may include updating a reference angle of arrival (AoA) based on an AoA of the target device relative to at least one of a first reference device or a second reference device.

[0176] In an embodiment of the present disclosure, the method may include controlling the target device to output information associated with the one or more electronic devices based on determining that the distance difference is less than a first threshold and the angle difference is less than a second threshold.

[0177] In an embodiment of the present disclosure, the method may include controlling the target device to output guidance information for the location of the one or more electronic devices based on determining that the distance difference is equal to or greater than a first threshold or the angle difference is equal to or greater than a second threshold. In an embodiment of the present disclosure, the guidance information may include at least one of the first movement information for reducing the distance difference or the second movement information for reducing the angle difference.

[0178] In an embodiment of the present disclosure, the method may include determining whether the target device is located at a reference position based on at least one of a distance difference or an angle difference.

[0179] In an embodiment of the present disclosure, the method may include controlling the target device to perform an operation of moving to the aiming position based on determining that the target device is located at the reference position.

[0180] In an embodiment of the present disclosure, the method may include controlling the target device to perform an operation of moving to the reference location based on determining that the target device is located at a location other than the reference location.

[0181] In an embodiment of the present disclosure, the method may include receiving a user input signal requesting system activation. In an embodiment of the present disclosure, the method may include determining the one or more electronic devices as target devices based on determining that the distance difference of the one or more electronic devices is less than a first threshold and the angle difference is less than a second threshold. In an embodiment of the present disclosure, the method may include controlling the target device to output a notification.

[0182] In an embodiment of the present disclosure, the method may include receiving a system access request for a user terminal associated with a first reference device and a second reference device. In an embodiment of the present disclosure, the method may include determining a priority of a user terminal relative to another user terminal. In an embodiment of the present disclosure, even a new user who does not know the identifier of each electronic device in the IoT space can control the electronic device. For example, a user such as a hotel guest visiting the IoT space is also able to control the electronic device to be controlled by looking at the electronic device and issuing instructions.

[0183] In an embodiment of the present disclosure, the method may include receiving a user input signal associated with a user terminal. In an embodiment of the present disclosure, the method may include receiving a user input signal associated with another user terminal. In an embodiment of the present disclosure, the method may include controlling a target device according to a determined priority based on determining that a user input signal associated with a user terminal conflicts with a user input signal associated with another user terminal.

[0184] In an embodiment of the present disclosure, the first reference device and the second reference device may be devices capable of sending and receiving UWB signals. In an embodiment of the present disclosure, it is possible to determine whether the electronic device is located in the direction of the user's gaze based on information about the UWB signals sent and received between the electronic device and the reference device. In other words, the computing device does not have to use an additional camera to identify the position of the reference device (ie, the user) or the position of the electronic device in the IoT system space in real time. Therefore, the embodiments of the present disclosure can even be applied to secure or private spaces. In an embodiment of the present disclosure, it is even possible to determine whether a moving electronic device is located in the direction of the user's gaze, so the user can easily control the moving electronic device.

[0185] According to an embodiment of the present disclosure, a program for executing the method of controlling a target device in a computer may be recorded on a computer-readable recording medium.

[0186] According to an embodiment of the present disclosure, a computing device for controlling a target device may include a memory storing one or more instructions and at least one processor configured to execute the one or more instructions stored in the memory. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to identify the distance difference between the distance from one or more electronic devices to a first reference device and the distance to a second reference device. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to identify the angle difference between the angle of arrival of the one or more electronic devices relative to at least one of the first reference device or the second reference device and the reference angle of arrival. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to control the target device based on at least one of the distance difference or the angle difference.

[0187] In an embodiment of the present disclosure, the at least one processor may execute the one or more instructions to compare the distance difference of the one or more electronic devices with a first threshold value. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to compare the angle difference of the one or more electronic devices with a second threshold value.

[0188] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to receive a user input signal. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to identify the one or more electronic devices associated with the received user input signal. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to determine a target device from the one or more electronic devices.

[0189] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to determine a target device from the one or more electronic devices based on determining that a distance difference of the one or more electronic devices is less than a first threshold and an angle difference is less than a second threshold.

[0190] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to determine an electronic device among the one or more electronic devices that is closest to at least one of the first reference device or the second reference device as a target device.

[0191] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to determine a target device from the one or more electronic devices based on a value of a user input signal.

[0192] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to determine the electronic device with the smallest angle difference among the one or more electronic devices as the target device based on determining that the one or more electronic devices all have a distance difference equal to or greater than a first threshold or an angle difference equal to or greater than a second threshold.

[0193] In an embodiment of the present disclosure, the one or more electronic devices may be electronic devices having a distance difference less than a first threshold value. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to determine the electronic device having the smallest angle difference among the one or more electronic devices as the target device based on determining that the angle differences of the one or more electronic devices are all equal to or greater than a second threshold value.

[0194] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to update the reference angle of arrival based on an angle of arrival of the target device relative to at least one of the first reference device or the second reference device.

[0195] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to control the target device to output information associated with the one or more electronic devices based on determining that the distance difference is less than a first threshold and the angle difference is less than a second threshold.

[0196] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to control the target device to output guidance information for the location of the one or more electronic devices based on determining that the distance difference is equal to or greater than the first threshold or the angle difference is equal to or greater than the second threshold. In an embodiment of the present disclosure, the guidance information may include at least one of the first movement information for reducing the distance difference or the second movement information for reducing the angle difference.

[0197] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to determine whether the target device is located at a reference position based on at least one of a distance difference or an angle difference.

[0198] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to control the target device to perform an operation of moving to the aiming position based on determining that the target device is located at the reference position.

[0199] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to control the target device to perform an operation of moving to the reference location based on determining that the target device is located outside the reference location.

[0200] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to receive a user input signal requesting system activation. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to determine the one or more electronic devices as target devices based on determining that the distance difference of the one or more electronic devices is less than a first threshold and the angle difference is less than a second threshold. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to control the target device to output a notification.

[0201] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to receive a system access request for a user terminal associated with the first reference device and the second reference device. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to determine a priority of the user terminal relative to other user terminals.

[0202] In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to receive a user input signal associated with a user terminal. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to receive a user input signal associated with another user terminal. In an embodiment of the present disclosure, the at least one processor may be configured to execute the one or more instructions to control the target device according to a determined priority based on determining that a user input signal associated with a user terminal conflicts with a user input signal associated with another user terminal.

Claims

1. A method for controlling a target device by a computing device (120), the method comprising: Identify from one or more electronic devices (130; 403; 404； 405； 860； 1082； 1084) a distance difference between a distance to a first reference device (110; 401; 1064) and a distance to a second reference device (110; 402; 1066); identifying an angular difference between an angle of arrival AoA of the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) relative to at least one of the first reference device (110; 401; 1064) or the second reference device (110; 402; 1066) and a reference AoA; and The target device is controlled based on at least one of the distance difference or the angle difference.

2. The method according to claim 1, further comprising: The one or more electronic devices (130; 403; 404； 405； 860； 1082； 1084) compares the distance difference with a first threshold; and The angular difference of the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) is compared with a second threshold value.

3. The method according to claim 1 or 2, further comprising: receiving user input signals; as well as identifying the one or more electronic devices associated with the received user input signal (130; 403; 404； 405； 860； 1082； 1084）， Wherein, controlling the target device based on at least one of the distance difference or the angle difference comprises: determining the target device from the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084).

4. The method according to claim 3, wherein: From the one or more electronic devices (130; 403; 404；405；860；1082； 1084) includes: determining the target device from the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) based on determining that the distance difference of the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) is less than the first threshold and the angle difference is less than the second threshold.

5. The method according to claim 4, wherein: From the one or more electronic devices (130; 403; 404；405；860；1082； 1084) includes: determining the target device as the target device, the electronic device among the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) that is closest to at least one of the first reference device (110; 401; 1064) or the second reference device (110; 402; 1066).

6. The method according to claim 4 or 5, wherein: From the one or more electronic devices (130; 403; 404； 405； 860； 1082； 1084) comprises: determining the target device from the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) based on the value of the user input signal.

7. The method according to any one of claims 3 to 6, wherein: From the one or more electronic devices (130; 403; 404；405；860；1082； 1084) comprises: based on determining that the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) all have the distance difference equal to or greater than the first threshold or the angle difference equal to or greater than the second threshold, determining the electronic device with the smallest angle difference among the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) as the target device.

8. The method according to any one of claims 3 to 7, wherein: The one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) are electronic devices having the distance difference smaller than the first threshold, and From the one or more electronic devices (130; 403; 404； 405； 860； 1082； 1084) comprises: based on determining that the angle differences of the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) are all equal to or greater than the second threshold, determining the electronic device with the smallest angle difference among the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) as the target device.

9. The method according to any one of claims 1 to 8, further comprising: Based on the target device relative to the first reference device (110; 401; 1064) or the second reference device (110; 402; 1066) to update the reference AoA.

10. The method according to any one of claims 1 to 9, wherein: Controlling the target device based on at least one of the distance difference or the angle difference includes: based on determining that the distance difference is less than the first threshold and the angle difference is less than the second threshold, controlling the target device (850) to output information (870) associated with the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084).

11. The method according to any one of claims 1 to 10, wherein: Controlling the target device based on at least one of the distance difference or the angle difference comprises: based on determining that the distance difference is equal to or greater than the first threshold or the angle difference is equal to or greater than the second threshold, controlling the target device to output guidance information for the location of the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084), and The guidance information includes at least one of first motion information for reducing the distance difference or second motion information for reducing the angle difference.

12. The method according to any one of claims 1 to 11, wherein: Controlling the target device based on at least one of the distance difference or the angle difference includes determining whether the target device (1062) is located at a reference position (1070) based on at least one of the distance difference or the angle difference.

13. The method according to any one of claims 1 to 12, wherein: Controlling the target device based on at least one of the distance difference or the angle difference further includes: Based on determining that the target device (1062) is located at a reference position (1070), controlling the target device (1062) to execute an operation of moving to a targeting position (1080); or Based on determining that the target device (1062) is located outside the reference position (1070), the target device (1062) is controlled to perform an operation of moving to the reference position (1070).

14. The method according to any one of claims 1 to 13, further comprising receiving a user input signal requesting system activation, in, Controlling the target device based on at least one of the distance difference or the angle difference includes: Determining the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) as the target device based on determining that the distance difference of the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) is less than the first threshold and the angle difference is less than the second threshold; and The target device is controlled to output a notification.

15. A computing device (120) for controlling a target device, the computing device (120) comprising: A memory (1420) storing one or more instructions; as well as at least one processor (1410) configured to execute the one or more instructions stored in the memory (1420), Wherein, the at least one processor (1410) is configured to execute the one or more instructions to: identifying a distance difference between a distance from one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) to a first reference device (110; 401; 1064) and a distance to a second reference device (110; 402; 1066); identifying an angular difference between an angle of arrival AoA of the one or more electronic devices (130; 403; 404; 405; 860; 1082; 1084) relative to at least one of the first reference device (110; 401; 1064) or the second reference device (110; 402; 1066) and a reference AoA; and The target device is controlled based on at least one of the distance difference or the angle difference.

Images