Device control method, device, control system, device and storage medium

Abstract

The embodiments of the present application disclose a device control method, apparatus, control system, device and storage medium, which belong to the field of UWB technology. The method includes: receiving data frames sent by various UWB tags; based on the data frames, determining the target UWB tag from each UWB tag, the target UWB tag being the UWB tag pointed to by the remote control device; based on the target UWB tag, sending a connection instruction to the terminal device so that the terminal device establishes a data communication connection with the target IoT device represented by the target UWB tag; in response to the control operation of the remote control device, sending a control instruction to the terminal device so that the terminal device controls the target IoT device based on the control instruction. In the embodiment of the present application, the user points the remote control device to the IoT device to be controlled, and the control of the IoT device can be achieved through the control operation, without directly operating the terminal device, thereby improving the efficiency of device control.

Description

Technical Field

[0001] The embodiments of the present application relate to the field of UWB technology, and in particular to a device control method, apparatus, control system, device, and storage medium. Background Art

[0002] With the continuous development of Internet of Things (IoT) technology, more and more IoT devices are able to interact with terminal devices.

[0003] In related technologies, when a user needs to use a terminal device to control an IoT device at home, he or she can select the IoT device to be controlled in the device selection interface displayed on the terminal device, trigger the terminal device to establish a connection with the IoT device, and further operate on the control interface displayed on the terminal device to achieve control of the IoT device. Summary of the Invention

[0004] The embodiments of the present application provide a device control method, apparatus, control system, device, and storage medium. The technical solution is as follows:

[0005] In one aspect, an embodiment of the present application provides a device control method, which is applied to a remote control device, and the method includes:

[0006] Receive data frames sent by each Ultra Wide Band (UWB) tag, where the UWB tag is used to represent the IoT device;

[0007] Based on the data frame, determining a target UWB tag from each of the UWB tags, the target UWB tag being the UWB tag pointed to by the remote control device;

[0008] Based on the target UWB tag, a connection instruction is sent to the terminal device, so that the terminal device establishes a data communication connection with the target IoT device represented by the target UWB tag;

[0009] In response to a control operation on the remote control device, a control instruction is sent to the terminal device, so that the terminal device controls the target IoT device based on the control instruction.

[0010] On the other hand, an embodiment of the present application provides a device control method, applied to a terminal device, the method comprising:

[0011] receiving a connection instruction sent by a remote control device, wherein the connection instruction is sent by the remote control device when the remote control device determines a target UWB tag from among the UWB tags, wherein the target UWB tag is the UWB tag pointed to by the remote control device;

[0012] Establishing a data communication connection with a target IoT device represented by the target UWB tag based on the connection instruction;

[0013] receiving a control instruction sent by the remote control device;

[0014] The target IoT device is controlled based on the control instruction.

[0015] On the other hand, an embodiment of the present application provides a device control apparatus, the apparatus comprising:

[0016] A receiving module, configured to receive data frames sent by each UWB tag, wherein the UWB tag is used to represent an IoT device;

[0017] a determination module, configured to determine a target UWB tag from each of the UWB tags based on the data frame, wherein the target UWB tag is the UWB tag pointed to by the remote control device;

[0018] A sending module is used to send a connection instruction to a terminal device based on the target UWB tag, so that the terminal device establishes a data communication connection with the target IoT device represented by the target UWB tag;

[0019] The sending module is further configured to send a control instruction to the terminal device in response to a control operation on the remote control device, so that the terminal device controls the target IoT device based on the control instruction.

[0020] On the other hand, an embodiment of the present application provides a device control apparatus, the apparatus comprising:

[0021] A first receiving module is configured to receive a connection instruction sent by a remote control device, wherein the connection instruction is sent by the remote control device when the remote control device determines a target UWB tag from among the UWB tags, and the target UWB tag is the UWB tag pointed to by the remote control device;

[0022] A connection module, configured to establish a data communication connection with a target IoT device represented by the target UWB tag based on the connection instruction;

[0023] A second receiving module, configured to receive a control instruction sent by the remote control device;

[0024] A control module is used to control the target IoT device based on the control instruction.

[0025] On the other hand, an embodiment of the present application provides a control system for an IoT device, the system comprising a remote control device, a terminal device, a UWB tag, and an IoT device;

[0026] The UWB tag is used to characterize the IoT device;

[0027] The remote control device receives data frames sent by each of the UWB tags; based on the data frames, determines a target UWB tag from each of the UWB tags, the target UWB tag being the UWB tag pointed at by the remote control device; and sends a connection instruction to the terminal device based on the target UWB tag;

[0028] The terminal device receives a connection instruction sent by the remote control device; based on the connection instruction, establishes a data communication connection with the target IoT device represented by the target UWB tag;

[0029] The remote control device sends a control instruction to the terminal device in response to a control operation on the remote control device;

[0030] The terminal device receives the control instruction sent by the remote control device; and controls the target IoT device based on the control instruction.

[0031] On the other hand, an embodiment of the present application provides a remote control device, which includes: a processor, a memory and a UWB component; the memory stores at least one instruction, and the at least one instruction is used to be executed by the processor to implement the device control method described in the above aspect.

[0032] On the other hand, an embodiment of the present application provides a terminal device, which includes: a processor and a memory; the memory stores at least one instruction, and the at least one instruction is used to be executed by the processor to implement the device control method described in the above aspect.

[0033] On the other hand, an embodiment of the present application provides a computer-readable storage medium, which stores at least one program code, and the program code is loaded and executed by a processor to implement the device control method on the remote control device side described in the above aspects, or the device control method on the terminal device side.

[0034] In another aspect, embodiments of the present application provide a computer program product or computer program, which includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the device control method provided in various optional implementations of the above aspects.

[0035] The technical solutions provided in the embodiments of the present application can bring the following beneficial effects:

[0036] In an embodiment of the present application, the remote control device determines the target UWB tag it is pointing to based on the data frames sent by each UWB tag, and sends a connection instruction to the terminal device, instructing the terminal device to establish a connection with the target IoT device indicated by the target UWB tag. Then, based on the received control operation, the remote control device further sends a control instruction to the terminal device, and the terminal device controls the target IoT device based on the control instruction. By adopting the solution provided in the embodiment of the present application, the user points the remote control device to the IoT device to be controlled, and controls the IoT device through control operations without directly operating the terminal device, thereby improving the efficiency of device control. Moreover, for IoT devices that can establish a data communication connection with the terminal device, the remote control device can control them through the solution provided in the embodiment of the present application, thereby enriching the usage scenarios of the remote control device. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0038] Figure 1 A schematic diagram showing an implementation environment of an exemplary embodiment of the present application is shown;

[0039] Figure 2 A flow chart of a device control method provided by an exemplary embodiment of the present application is shown;

[0040] Figure 3 This is a schematic diagram of an implementation of a data frame receiving process shown in an exemplary embodiment of the present application;

[0041] Figure 4 is an interactive schematic diagram of a device control process shown in an exemplary embodiment of the present application;

[0042] Figure 5 A flow chart of a device control method provided by another exemplary embodiment of the present application is shown;

[0043] Figure 6 A flow chart of a device control method provided by another exemplary embodiment of the present application is shown;

[0044] Figure 7 A flow chart of a device control method provided by another exemplary embodiment of the present application is shown;

[0045] Figure 8 is a schematic diagram of a remote control device shown in an exemplary embodiment of the present application;

[0046] Figure 9 A flow chart of a device control method provided by another exemplary embodiment of the present application is shown;

[0047] Figure 10 This is a schematic diagram of an implementation of a smart curtain remote control process shown in an exemplary embodiment of the present application;

[0048] Figure 11 is a flow chart showing a control instruction sending process according to an exemplary embodiment of the present application;

[0049] Figure 12 A structural block diagram of a device control device provided by an embodiment of the present application is shown;

[0050] Figure 13 A structural block diagram of a device control device provided by an embodiment of the present application is shown;

[0051] Figure 14 A structural block diagram of a remote control device provided by an exemplary embodiment of the present application is shown;

[0052] Figure 15 A structural block diagram of a terminal device provided by an exemplary embodiment of the present application is shown;

[0053] Figure 16 A structural block diagram of a device control system provided by an exemplary embodiment of the present application is shown. DETAILED DESCRIPTION

[0054] In order to make the objectives, technical solutions and advantages of this application clearer, the implementation methods of this application will be further described in detail below with reference to the accompanying drawings.

[0055] Please refer to Figure 1 , which shows a schematic diagram of an implementation environment of an exemplary embodiment of the present application, wherein the implementation environment includes a terminal device 110, at least one IoT device 120, a UWB tag 130 and a remote control device 140.

[0056] The terminal device 110 is an electronic device with an IoT device control function. The terminal device 110 can be a portable electronic device such as a smartphone, tablet computer, smart remote control, smart watch, etc. Optionally, the IoT device control function is implemented by an application (or applet) installed in the terminal device 110.

[0057] IoT device 120 is an electronic device that can establish a data communication connection with terminal device 110. It can be a smart TV 122, a smart speaker 121, a smart door lock 123, a smart refrigerator, a smart air conditioner, a smart lamp, smart curtains, or other devices. IoT device 120 and terminal device 110 can exchange information via the data communication connection, enabling terminal device 110 to control IoT device 120 and / or present device data from IoT device 120 on the terminal device 110. This data communication connection can be a WiFi connection, a Bluetooth connection, an infrared connection, or the like, and is not limited in this embodiment of the present application.

[0058] The UWB tag 130 is an electronic tag used to represent the IoT device 120. In one possible design, the UWB tag 130 is independent of the IoT device 120. Independence means that the UWB tag 130 is a device independent of the IoT device 120 and can be sold as a product alone. It is not integrated into the IoT device 120 as a part of the IoT device 120, nor is it a necessary component module of the IoT device 120. And when the UWB tag 130 and the IoT device 120 are bound, the UWB tag 130 and the IoT device 120 do not have a data communication connection relationship, but only a binding relationship. The binding relationship means that the IoT device 120 represented by the UWB tag 130 can be determined. Figure 1 As shown, UWB tag 131 is used to characterize IoT device 121 , UWB tag 132 is used to characterize IoT device 122 , and UWB tag 132 is used to characterize IoT device 123 .

[0059] Of course, in other possible designs, the UWB tag 130 can also be integrated into the IoT device 120 as part of the IoT device 120, that is, the IoT device 120 has UWB functionality when it leaves the factory. Optionally, data communication can be performed between the UWB tag 130 and the IoT device 120.

[0060] Regarding the power supply method of the UWB tag 130, in one possible design, the UWB tag 130 is provided with an independent power supply, which can be a replaceable power supply, a non-replaceable power supply, or a rechargeable power supply. In another possible design, the UWB tag 130 is powered by the IoT device 120, and the power supply method of the IoT device 120 can include wired power supply (such as through a charging cable) or wireless power supply (such as through a wireless charging coil).

[0061] The remote control device 140 is an electronic device with spatial location awareness capabilities. In one possible design, the remote control device 140 is independent of the terminal device 110 but is capable of data communication with the terminal device 110. The data communication method between the remote control device 140 and the terminal device 110 may include a WiFi connection, a Bluetooth connection, an infrared connection, etc., which is not limited in this embodiment of the application.

[0062] Spatial position perception capability means that the remote control device 140 can perceive the spatial position relationship between itself and other devices. In the embodiment of the present application, the spatial position perception capability of the remote control device 140 is realized with the help of a UWB component and a UWB tag 130 representing the IoT device 120. The remote control device 140 can perform UWB communication with the UWB tag 130 through the UWB component. That is, the remote control device 140 can receive the data frame sent by the UWB tag 130 on the target channel through the UWB component, and determine the spatial position relationship between itself and the UWB tag 130 based on the data frame sent by the UWB tag 130.

[0063] In one possible design, the remote control device 140 is provided with a remote control control, which can be in the form of a physical button, a touch panel, or a combination of multiple forms. The user can trigger the remote control control to perform the corresponding control function. For example, the volume of the smart speaker 121 can be controlled by clicking a physical button, and the channel of the smart TV 122 can be controlled by sliding on the touch panel.

[0064] In other possible designs, a sensor is provided in the remote control device 140 so as to recognize the user's gesture operation based on the sensor data collected by the sensor, and then implement corresponding control functions based on the gesture operation.

[0065] In a possible application scenario, such as Figure 1 As shown, UWB tag 131 is bound to smart speaker 121, UWB tag 132 is bound to smart TV 122, and UWB tag 133 is bound to smart door lock 123. When the user uses remote control device 140 to point to smart TV 122, remote control device 140 can determine the currently pointed UWB tag 132 based on the data frames sent by the UWB tags 130 corresponding to each IoT device, and instruct terminal 110 to establish a data communication connection with the smart TV 122 represented by UWB tag 132. Furthermore, remote control device 140 sends control instructions to terminal 110 based on the received control operation, and terminal 110 controls smart TV 122 based on the control instructions, such as controlling smart TV 122 to switch channels, adjust volume, etc.

[0066] Please refer to Figure 2, which shows a flow chart of a device control method provided by an exemplary embodiment of the present application. The embodiment of the present application is applied to Figure 1 Taking the implementation environment shown in FIG. 1 as an example, the method includes:

[0067] In step 201, a remote control device receives data frames sent by each UWB tag, where the UWB tag is used to represent an IoT device.

[0068] In one possible implementation, after the UWB tag is bound to the represented IoT device, the UWB tag is in an operational state. The bound UWB tag may be attached to the represented IoT device, or the UWB tag may be placed near the represented IoT device, or the UWB tag may be placed away from the represented IoT device, or the UWB tag may be set inside the represented IoT device. The embodiments of the present application do not limit the location of the UWB tag.

[0069] In the working state, the UWB tag sends data frames on the target channel; correspondingly, the remote control device in the working state receives the data frames sent by each UWB tag on the target channel.

[0070] To prevent interference caused by simultaneous data frame transmissions from different UWB tags, in one possible implementation, before transmitting data frames on a target channel, the UWB tag first needs to monitor the target channel to determine its channel status. If the target channel is idle (i.e., unoccupied), the UWB tag transmits the data frame; if the target channel is occupied (i.e., occupied), the UWB tag monitors the target channel again after a random delay.

[0071] In step 202 , the remote control device determines a target UWB tag from various UWB tags based on the data frame. The target UWB tag is the UWB tag that the remote control device is pointing to.

[0072] After receiving the data frame, the remote control device determines the spatial position relationship between each UWB tag and the remote control device, and determines the UWB tag it is currently pointing to as the target UWB tag.

[0073] In one possible implementation, the remote control device determines its spatial positional relationship with the UWB tag based on the phase difference between the data frame and the antenna. Furthermore, to determine the horizontal and vertical positional relationship with the UWB tag, the remote control device is equipped with two antenna groups corresponding to different antenna directions: a first antenna group and a second antenna group. Each antenna group consists of two antennas (shared antennas may or may not exist). The first antenna group and the second antenna group have a preset angle (e.g., 60 degrees and 90 degrees) between them, which are used to measure horizontal and vertical angles, respectively.

[0074] The remote control device may use the signal angle of arrival (AOA) or signal phase difference of arrival (PDoA) technology to perform spatial positioning based on the data frame.

[0075] Optionally, the remote control device first receives data frames on the target channel through the first antenna group, and when the data frame reception time of the first antenna group reaches a preset time, switches to the second antenna group to receive data frames on the target channel.

[0076] Indicative, such as Figure 3 As shown, the remote control device first receives the data frames sent by UWB tags 1-4 on the target channel through the first antenna group, and then switches to receive the data frames sent by UWB tags 1-4 on the target channel through the second antenna group.

[0077] In some embodiments, after determining the horizontal and vertical angles relative to each UWB tag, the remote control device identifies a UWB tag whose horizontal angle falls within a horizontal angle range and whose vertical angle falls within a vertical angle range as a target UWB tag. For example, the horizontal angle range may be -10 degrees to 10 degrees, and the vertical angle range may be 0 degrees to 30 degrees, although this is not a limitation in the present embodiment.

[0078] Illustratively, the remote control device determines the spatial position relationship with each UWB tag as follows: UWB tag A (horizontal angle -30 degrees, vertical angle 10 degrees); UWB tag B (horizontal angle -2 degrees, vertical angle 10 degrees); UWB tag C (horizontal angle 35 degrees, vertical angle 5 degrees); UWB tag D (horizontal angle 60 degrees, vertical angle 20 degrees). If the horizontal angle range is -10 degrees to 10 degrees and the vertical angle range is 0 degrees to 30 degrees, since the spatial position relationship between UWB tag B and the remote control device is within this angle range, the remote control device determines UWB tag B as the target UWB tag.

[0079] Step 203: The remote control device sends a connection instruction to the terminal device based on the target UWB tag.

[0080] Since the remote control device is independent of the terminal device and does not have the ability to directly control the IoT device, after determining the target UWB tag, the remote control device needs to send a connection instruction to the terminal device through the communication connection between the terminal device and the terminal device, instructing the terminal device to establish a data communication connection with the target IoT device represented by the target UWB tag.

[0081] Optionally, a Bluetooth connection is established between the remote control device and the terminal device, and the remote control device sends a connection instruction to the terminal device via the Bluetooth connection.

[0082] In some embodiments, the connection instruction includes information indicating a target UWB tag, or includes information indicating a target IoT device represented by the target UWB tag.

[0083] Optionally, in order to reduce the probability of misoperation, the remote control device sends a connection instruction to the terminal device based on the target UWB tag when it determines that it is currently pointing to the target UWB tag and the pointing duration reaches a duration threshold (for example, 2s).

[0084] Step 204: The terminal device receives the connection instruction sent by the remote control device.

[0085] Optionally, the terminal device receives a connection instruction sent by the remote control device via a Bluetooth connection.

[0086] In step 205 , the terminal device establishes a data communication connection with the target IoT device represented by the target UWB tag based on the connection instruction.

[0087] Optionally, the terminal device determines the target IoT device to be controlled based on the information contained in the connection instruction, and then establishes a data communication connection with the target IoT device using the connection method corresponding to the target IoT device, so as to exchange data with the target IoT device via the data communication connection. The data communication connection between the terminal device and the target IoT device can be a Bluetooth connection, a WiFi connection, an infrared connection, etc., which is not limited in this embodiment.

[0088] Step 206: In response to the control operation on the remote control device, the remote control device sends a control instruction to the terminal device.

[0089] Unlike related technologies, which require controlling IoT devices through a control interface displayed on a terminal device, in this embodiment, users only need to perform control operations on the remote control device to indirectly control the target IoT device through the terminal device. The control operation on the remote control device can be a trigger operation on the remote control control on the remote control device, or a gesture operation on the remote control device.

[0090] After receiving the control operation, the remote control device sends a corresponding control instruction to the terminal device based on the operation type of the received control operation. Optionally, the remote control device sends the control instruction to the terminal device via a Bluetooth connection.

[0091] Step 207: The terminal device receives the control instruction sent by the remote control device.

[0092] Optionally, the terminal device receives the control instruction sent by the remote control device via a Bluetooth connection.

[0093] In step 208 , the terminal device controls the target IoT device based on the control instruction.

[0094] Since different IoT devices have different functions, the terminal device needs to parse the received control instructions to determine the device function controlled by the control instructions, and then control the target IoT device to perform the corresponding device function based on the parsing results through the data communication connection with the target IoT device.

[0095] In an illustrative example, Figure 4 As shown, after UWB tag 41 is bound to IoT device 42, it broadcasts data frames on the target channel. When remote control device 43 is aligned with UWB tag 41, remote control device 43 performs UWB angle measurement on the received data frames to confirm that UWB tag 41 is facing the target. It then sends a connection instruction via the Bluetooth connection with terminal device 44. Terminal device 44, based on the connection instruction, establishes a WiFi connection with IoT device 42. Furthermore, remote control device 43 sends control instructions to terminal device 44 via the Bluetooth connection based on the received control operation. Terminal device 44, in response to the control instructions, controls IoT device 42 via the WiFi connection.

[0096] To sum up, in the embodiment of the present application, the remote control device determines the target UWB tag it is pointing to based on the data frames sent by each UWB tag, and sends a connection instruction to the terminal device, instructing the terminal device to establish a connection with the target IoT device indicated by the target UWB tag. Then, based on the received control operation, the remote control device further sends a control instruction to the terminal device, and the terminal device controls the target IoT device based on the control instruction.

[0097] By adopting the solution provided in the embodiments of the present application, the user points the remote control device at the IoT device to be controlled and controls the IoT device through control operations without directly operating the terminal device, thereby improving the efficiency of device control; and, for IoT devices that can establish data communication connections with terminal devices, the remote control device can control them through the solution provided in the embodiments of the present application, enriching the usage scenarios of the remote control device.

[0098] In a possible implementation, the connection instruction sent by the remote control device to the terminal device includes a target tag identifier of the target UWB tag, and the terminal device determines the target IoT device represented by the target UWB tag based on the target tag identifier. Figure 2 On the basis of Figure 5 As shown, step 203 can be replaced by step 203A, and step 205 can be replaced by 205A.

[0099] Step 203A: Based on the data frame sent by the target UWB tag, the remote control device sends a connection instruction including the target tag identifier to the terminal device.

[0100] Optionally, the data frame sent by each UWB tag includes its own tag identifier. After the remote control device determines the target UWB tag, it obtains the target tag identifier from the data frame sent by the target UWB tag and sends a connection instruction including the target tag identifier to the terminal device.

[0101] In step 205A, the terminal device obtains the target tag identifier contained in the connection instruction; based on the target tag identifier, determines the target IoT device from the binding relationship between the UWB tag and the IoT device; and establishes a data communication connection with the target IoT device based on the target connection mode corresponding to the target IoT device.

[0102] Optionally, the terminal device stores the binding relationship between each UWB tag and the IoT device. After receiving the connection instruction, the terminal device can search for the target device identifier of the target IoT device represented by the target UWB tag from the binding relationship based on the target tag identifier contained in the connection instruction.

[0103] Schematically, the binding relationship between UWB tags and IoT devices is shown in Table 1.

[0104] Table 1

[0105] UWB Tags IoT devices UWB A Smart refrigerator UWB B Smart TV UWB C Smart curtains

[0106] Since the terminal device communicates data with different IoT devices in different ways, for example, the terminal device communicates with some IoT devices through Bluetooth connection and communicates with some IoT devices through WiFi connection. Therefore, after determining the target IoT device, the terminal device further establishes a data communication connection with the target IoT device based on the target connection method corresponding to the target IoT device.

[0107] In one possible implementation, when the target connection mode corresponding to the target IoT device is Bluetooth connection, the terminal device establishes a Bluetooth connection with the target IoT device based on the Bluetooth identifier of the target IoT device; when the target connection mode corresponding to the target IoT device is WiFi connection, the terminal device establishes a WiFi connection with the target IoT device through a routing device based on the MAC address of the target IoT device (the target IoT device and the terminal device are connected to the same routing device).

[0108] In this embodiment, the remote control device sends a connection instruction containing a target tag identifier to the terminal device, and the terminal device determines the target IoT device represented by the target UWB tag based on a pre-set binding relationship, thereby simplifying the instruction sending process on the remote control device side and helping to reduce the power consumption of the remote control device.

[0109] In another possible implementation, the connection instruction sent by the remote control device to the terminal device includes a target device identifier of the target IoT device, and the terminal can directly determine the target IoT device based on the target device identifier. Figure 2 On the basis of Figure 6 As shown, step 203 can be replaced by step 203B, and step 205 can be replaced by 205B.

[0110] Step 203B: The remote control device sends a connection instruction including the target device identifier to the terminal device based on the data frame sent by the target UWB tag.

[0111] In one possible implementation, when the data frame sent by the UWB tag contains the device identification of the represented IoT device (such as the data frame sent by the built-in UWB tag in the IoT device), after determining the target UWB tag, the remote control device can obtain the target device identification from the data frame sent by the target UWB tag, and send a connection instruction containing the target device identification to the terminal device.

[0112] In another possible implementation, the data frame sent by the UWB tag only includes the tag identifier. In this case, the remote control device needs to use the pre-stored binding relationship between the UWB tag and the IoT device to determine the target IoT device represented by the target UWB tag.

[0113] Optionally, the remote control device obtains the target tag identifier from the data frame sent by the target UWB tag; based on the target tag identifier, the target device identifier is obtained from the binding relationship between the UWB tag and the IoT device, thereby sending a connection instruction containing the target device identifier to the terminal device.

[0114] Regarding the setting method of the binding relationship between the UWB tag and the IoT device in the remote control device, in one possible implementation, the terminal device sends configuration data to the remote control device, and the remote control device receives and stores the configuration data sent by the terminal device, where the configuration data includes the binding relationship between the UWB tag and the IoT device.

[0115] Schematically, after the terminal device completes the binding between the UWB tag and the IoT device, the configuration data containing the binding relationship is sent to the remote control device via the Bluetooth connection.

[0116] It should be noted that, in addition to the above-mentioned binding relationship, the configuration data may also include other information, such as target channel information, data frame format, receiving cycle, etc., which is not limited in this embodiment.

[0117] In some embodiments, if the binding relationship does not include a target device identifier corresponding to the target tag identifier, the remote control device determines that the target UWB tag is not bound to the IoT device (controllable by the terminal device) and does not send a connection instruction to the terminal device.

[0118] In step 205B, the terminal device obtains the target device identifier included in the connection instruction; determines the target IoT device based on the target device identifier; and establishes a data communication connection with the target IoT device based on the target connection mode corresponding to the target IoT device.

[0119] Since the connection instruction includes the target device identifier, the terminal device can directly determine the target IoT device based on the target device identifier and establish a data communication connection with the target IoT device.

[0120] It should be noted that the above two methods of sending connection instructions and establishing data communication connections can be executed separately or in combination. For example, the remote control device first queries the target IoT device from the local binding relationship based on the target tag identifier in the data frame. If the target IoT device is found, a connection instruction containing the target device identifier is sent to the terminal device. If the target IoT device is not found, a connection instruction containing the target tag identifier is sent to the terminal device, and the terminal device further determines whether there is an IoT device bound to the target UWB tag based on the local binding relationship (the binding relationship on the remote control device side may not be updated in time).

[0121] Regarding the method of triggering the remote control device to send a control instruction to the terminal device, in one possible implementation, the remote control device can receive a control operation through a remote control control, and then send a corresponding control instruction to the terminal device based on the triggered remote control control. Figure 2 On the basis of Figure 7As shown, step 206 may be replaced by step 206A, and step 208 may be replaced by 208A.

[0122] Step 206A: In response to a triggering operation on a target remote control control on the remote control device, the remote control device sends a control instruction including an identifier of the target control to the terminal device.

[0123] Optionally, the remote control device is provided with a remote control control, which can be a physical button, a touch panel, etc. The present application embodiment does not limit the specific type of the remote control. For ease of description, the following embodiment is described by taking the target remote control control as a physical button as an example.

[0124] In a possible implementation, different remote controls are used to control different functions. Figure 8 As shown, the first remote control control 81 and the second remote control control 82 are used to adjust the functional parameters of the first function (such as the channel switching function); the third remote control control 83 and the fourth remote control control 84 are used to adjust the functional parameters of the second function (such as the volume adjustment function); and the fifth remote control control 85 is used to control the enable status (pause or start playback) of the third function (video playback).

[0125] In other possible implementations, different trigger operations on the same remote control control are used to control different functions. For example, a single click on the fifth remote control control 85 is used to control the enable state of the third function, while a long press on the fifth remote control 85 is used to control the power on and off of the device.

[0126] When a user needs to control a specific function of a target IoT device, they can trigger the corresponding remote control on the remote control device. Accordingly, when receiving a trigger operation for the target remote control, the remote control device obtains the target control identifier of the target remote control and sends a control instruction containing the target control identifier.

[0127] Optionally, in addition to the target control identifier, the control instruction may also include the operation type of the trigger operation received by the target remote control, such as a single-click operation, a double-click operation, a long-press operation, and the like.

[0128] In step 208A, the terminal device obtains the target control identifier contained in the control instruction, where the target control identifier is the identifier of the target remote control control triggered on the remote control device; based on the target control identifier, the target device function controlled by the target remote control is determined; and the target IoT device is controlled to execute the target device function.

[0129] In order to determine the device function to be controlled, the terminal device obtains the target control identifier from the control instruction, and then determines the target device function controlled by the target remote control based on the target control identifier, and then controls the target IoT device to execute the target device function.

[0130] Since different IoT devices have different control requirements, for example, smart speakers have volume control requirements, song switching requirements, and pause requirements, smart curtains have curtain stretching requirements and transmittance adjustment requirements, and smart door locks have opening and closing requirements, so in order to improve the accuracy of device control, the terminal device first needs to determine the device function of the target IoT device, and then determine the target device function controlled by the target remote control from the device function based on the target control identifier.

[0131] In a possible implementation, the terminal device obtains control setting information, which includes the correspondence between the device identifier, the device function, and the control identifier. When controlling the device, the terminal device determines the target device function from the above correspondence based on the target control identifier and the device identifier of the target IoT device. The control setting information can be the default setting of the terminal device based on the device function and the remote control control of the remote control device, or it can be customized by the user. Schematically, combined with Figure 8 The correspondence between the remote control control, device identification, device function and control identification is shown in Table 2.

[0132] Table 2

[0133]

[0134]

[0135] In an illustrative example, when the terminal device establishes a Bluetooth connection with the smart speaker and receives a control instruction sent by the remote control device containing the control identifier of the second control 82, the terminal device controls the smart speaker to play the next song through the Bluetooth connection; when the terminal device establishes a WiFi connection with the smart curtains and receives a control instruction sent by the remote control device containing the control identifier of the third control 83, the terminal device controls the smart curtains to increase the transmittance through the WiFi connection; when the terminal device establishes a WiFi connection with the smart air conditioner and receives a control instruction sent by the remote control device containing the control identifier of the fifth control 85, the terminal device controls the smart air conditioner to turn off through the WiFi connection.

[0136] In other possible implementations, when the control instruction also includes the operation type of the trigger operation received by the target remote control control, the terminal device controls the target IoT device to perform the corresponding device function based on the correspondence between the device identification, device function, control identification and operation type. This embodiment will not be repeated here.

[0137] In this embodiment, when the remote control device receives a trigger operation on the remote control control, it sends a control instruction containing a control identifier to the terminal device. The terminal device determines the required control device function based on the control identifier, and controls the target IoT device to execute the device function through the data communication connection. Device control is achieved without directly operating the terminal device, thereby improving device control efficiency and ensuring the accuracy of the control process.

[0138] In another possible implementation, the user can hold the remote control device and perform specific gesture operations to trigger the remote control device to send corresponding control instructions to the terminal device. Figure 2 On the basis of Figure 9 As shown, step 206 can be replaced by step 206B, and step 208 can be replaced by 208B.

[0139] Step 206B: In response to the target gesture operation on the remote control device, the remote control device sends a control instruction containing target gesture operation information to the terminal device.

[0140] In one possible implementation, the remote control device has a built-in sensor (such as an inertial sensor, an accelerometer, etc.). After determining the target UWB tag, the remote control device identifies the target gesture operation on the remote control device based on the sensor data collected by the sensor, and then sends a control instruction containing the gesture recognition result (i.e., the target gesture operation information) to the terminal device.

[0141] Optionally, the target gesture operation may include a left waving gesture, a right waving gesture, an upward waving gesture, a downward waving gesture, a shaking gesture, etc., which is not limited in this embodiment.

[0142] In one possible implementation, different gestures are used to control different functions. For example, for a smart speaker, waving left / right is used to switch songs, and waving up / down is used to adjust the volume.

[0143] In other possible implementations, the same gesture can be used to control different functions on different IoT devices. For example, when the target IoT device is a smart speaker, the shake gesture can be used to control audio play / pause, while when the target IoT device is a smart door lock, the shake gesture can be used to control the door lock to open / close.

[0144] In step 208B, the terminal device obtains the target gesture operation information contained in the control instruction, where the target gesture operation information is used to represent the target gesture operation received by the remote control device; based on the target gesture operation information, the target device function controlled by the target gesture operation is determined; and the target IoT device is controlled to execute the target device function.

[0145] In order to determine the device function to be controlled, the terminal device obtains the target gesture operation information from the control instruction, and then determines the target device function to be controlled based on the target gesture operation information, and then controls the target IoT device to execute the target device function.

[0146] Since different IoT devices have different control requirements, for example, smart speakers have volume control requirements, song switching requirements, and pause requirements, smart curtains have curtain stretching requirements and transmittance adjustment requirements, and smart door locks have opening and closing requirements, so in order to improve the accuracy of device control, the terminal device first needs to determine the device function of the target IoT device, and then determine the target device function controlled by the target gesture operation from the device function based on the target gesture operation information.

[0147] In one possible implementation, a terminal device obtains gesture setting information, which includes a correspondence between a device identifier, a device function, and gesture operation information. When controlling a device, the terminal device determines the target device function based on this correspondence, based on the target gesture operation information and the device identifier of the target IoT device. This gesture setting information can be a default setting for the terminal device based on the device function, or it can be user-defined. For example, the correspondence between device identifiers, device functions, and gesture operation information is shown in Table 3.

[0148] Table 3

[0149]

[0150] In an illustrative example, when the terminal device establishes a Bluetooth connection with a smart speaker and receives a control instruction sent by a remote control device that includes gesture operation information indicating "swipe right", the terminal device controls the smart speaker to play the next song through the Bluetooth connection; when the terminal device establishes a WiFi connection with smart curtains and receives a control instruction sent by a remote control device that includes gesture operation information indicating "swipe upward", the terminal device controls the smart curtains to increase light transmittance through the WiFi connection; when the terminal device establishes a WiFi connection with a smart air conditioner and receives a control instruction sent by a remote control device that includes gesture operation information indicating "shake", the terminal device controls the smart air conditioner to turn off through the WiFi connection.

[0151] Indicative, such as Figure 10As shown, when a user holds remote control device 1002 and points it at smart curtain 1001, remote control device 1002 instructs the terminal device to establish a data communication connection with smart curtain 1001. When the user further holds remote control device 1002 and waves it to the left, remote control device 1002 sends a control instruction containing the "wave left" gesture operation information to the terminal device. Based on this control instruction, the terminal device determines that the device function corresponding to "wave left" is to open the curtain, thereby controlling the opening of smart curtain 1001.

[0152] In this embodiment, the remote control device sends a control instruction containing gesture operation information to the terminal device based on the received gesture operation, and the terminal device controls the device function corresponding to the target IoT device based on the gesture operation information, allowing the user to control the IoT device through simple gesture operations, further simplifying the device control process.

[0153] In some cases, after receiving a connection instruction, the terminal device may be unable to establish a data communication connection with the target IoT device represented by the target UWB tag. For example, if the terminal device has never established a connection with the target IoT device, or if the communication component of the target IoT device is abnormal, the terminal device may be unable to establish a data communication connection with the target IoT device.

[0154] In this case, the remote control device continues to send control instructions to the terminal device but cannot achieve device control, which will cause the remote control device to waste power. Therefore, in one possible implementation, after the terminal device attempts to establish a connection with the target IoT device based on the connection instruction, it feeds back the connection result to the remote control device so that the remote control device can determine whether to send further control instructions based on the connection result. Figure 11 As shown, the process may include the following steps:

[0155] Step 1101: Receive connection feedback information sent by a terminal device, where the connection feedback information is used to indicate the establishment status of a data communication connection between the terminal device and a target IoT device.

[0156] Optionally, after the terminal device attempts to establish a connection with the target IoT device based on the connection instruction, it sends connection feedback information to the remote control device based on the connection establishment status. The remote control device then receives the connection feedback information and determines whether the data communication connection between the terminal device and the target IoT device is successfully established. If so, step 1102 is executed; if not, steps 1103 and 1104 are executed.

[0157] Step 1102: If the connection feedback information indicates that the data communication connection is successfully established, a control instruction is sent to the terminal device in response to the control operation on the remote control device.

[0158] When the data communication connection is successfully established, the remote control device responds to the control operation and sends a control instruction. The process of sending the control instruction based on the received control operation can refer to the above embodiment, which will not be repeated in this embodiment.

[0159] Step 1103: If the connection feedback information indicates that the data communication connection fails to be established, a connection failure prompt is provided, wherein the connection failure prompt includes at least one of a vibration prompt, a voice prompt, or an indicator light prompt.

[0160] When the data communication connection fails to be established, in order to inform the user in time and prevent the user from continuing to perform control operations, the remote control device will prompt the connection failure. Accordingly, the remote control device will not send control instructions to the terminal device.

[0161] In some embodiments, when a connection fails to be established, the remote control device vibrates, plays a prompt voice message through a speaker, or illuminates an indicator light. It should be noted that when a connection is successfully established, the remote control device may also provide a successful connection prompt, prompting the user to perform further control operations. The manner in which a successful connection prompt is provided differs from a failed connection prompt, and this embodiment does not limit this.

[0162] Step 1104: resend the connection instruction to the terminal device.

[0163] In one possible implementation, when the connection feedback information indicates that the connection establishment failed, the connection feedback information may also include a failure cause identifier. If the failure cause identifier indicates that the corresponding target IoT device was not found, the remote control device does not resend the connection instruction. If the failure cause identifier indicates that the corresponding target IoT device was found but the connection failed, the remote control device resends the connection instruction.

[0164] In this embodiment, the terminal device sends connection feedback information to the remote control device based on the connection establishment status, so that the remote control device determines whether to continue sending control instructions to the terminal device based on the connection feedback information, thereby avoiding power consumption waste caused by sending control instructions when the connection fails.

[0165] In the above embodiments, the remote control device indirectly controls the IoT device through the terminal device as an example. In other possible implementations, when the data communication connection is successfully established, the terminal device can display the device control interface corresponding to the target IoT device, and the device control interface includes the function controls corresponding to the target IoT device.

[0166] For example, when the target IoT device is a smart TV, the terminal device displays the TV remote control interface; when the target IoT device is a smart air conditioner, the terminal device displays the air conditioner remote control interface; when the target IoT device is a smart curtain, the terminal device displays the curtain control panel interface.

[0167] Furthermore, in response to a triggering operation on a function control in the device control interface, the terminal device controls the target IoT device to execute a corresponding device function.

[0168] In this way, even if the terminal device does not have UWB function, the target IoT device to be controlled can be selected with the help of the remote control device, thereby triggering the display of the corresponding control interface, avoiding the user from manually selecting in the applications corresponding to different IoT devices, and improving the efficiency of device control.

[0169] Since remote control devices are often not stationary when used to control IoT devices, to further reduce power consumption, the remote control device receives data frames when it detects it is in motion. If it detects it is in a disabled state, it remains in a dormant state. In this dormant state, the UWB component in the remote control device does not send or receive data frames.

[0170] In a possible implementation, in the sleep state, in response to sensor data collected by the sensor indicating that the remote control device is in motion, the remote control device turns on the UWB component and receives data frames sent by each UWB tag through the UWB component.

[0171] The sensor may be an inertial sensor, an acceleration sensor, etc., which is not limited in this embodiment.

[0172] In other possible implementations, when a start control is provided on the remote control device, in the sleep state, in response to a triggering operation on the start control on the remote control device, the remote control device turns on the UWB component, and the UWB component receives data frames sent by each UWB tag.

[0173] For example, a power button is provided on the remote control device. When a click operation on the power button is received, the remote control device turns on the UWB component; when a click operation on the power button is received again, the remote control device turns off the UWB component and enters a sleep state.

[0174] It should be noted that in the above embodiments, the steps with the terminal device as the execution subject can be independently implemented as a device control method on the terminal device side, and the steps with the remote control device as the execution subject can be independently implemented as a device control method on the remote control device side. The embodiments of this application will not be repeated here.

[0175] The following are device embodiments of the present application, which can be used to implement the method embodiments of the present application. For details not disclosed in the device embodiments of the present application, please refer to the method embodiments of the present application.

[0176] Please refer to Figure 12 , which shows a structural block diagram of a device control device provided by an embodiment of the present application. The device has the function of implementing the functions executed by the remote control device side in the above method embodiment, and the functions can be implemented by hardware or by hardware executing corresponding software. Figure 12 As shown, the device may include:

[0177] A first receiving module 1201 is configured to receive data frames sent by each UWB tag, where the UWB tag is used to represent an IoT device;

[0178] A determination module 1202 is configured to determine a target UWB tag from the UWB tags based on the data frame, where the target UWB tag is the UWB tag pointed to by the remote control device;

[0179] A first sending module 1203 is configured to send a connection instruction to a terminal device based on the target UWB tag, so that the terminal device establishes a data communication connection with a target IoT device represented by the target UWB tag;

[0180] The second sending module 1203 is configured to send a control instruction to the terminal device in response to a control operation on the remote control device, so that the terminal device controls the target IoT device based on the control instruction.

[0181] Optionally, the first sending module 1203 includes:

[0182] A first sending unit is configured to send the connection instruction including the target tag identifier to the terminal device based on the data frame sent by the target UWB tag, so that the terminal device determines the target IoT device from the binding relationship between the UWB tag and the IoT device based on the target tag identifier;

[0183] or,

[0184] The second sending unit is used to send the connection instruction including the target device identifier to the terminal device based on the data frame sent by the target UWB tag, so that the terminal device determines the target IoT device based on the target device identifier.

[0185] Optionally, the first sending unit is configured to obtain the target tag identifier from the data frame sent by the target UWB tag, and send the connection instruction including the target tag identifier to the terminal device.

[0186] Optionally, the second sending unit is configured to:

[0187] Obtaining the target tag identifier from the data frame sent by the target UWB tag; obtaining the target device identifier from the binding relationship between the UWB tag and the IoT device based on the target tag identifier; and sending the connection instruction containing the target device identifier to the terminal device;

[0188] or,

[0189] The target device identifier is obtained from the data frame sent by the target UWB tag, and the connection instruction including the target device identifier is sent to the terminal device.

[0190] Optionally, the target device identifier is obtained from a binding relationship between the UWB tag and the IoT device;

[0191] The device further comprises:

[0192] The storage module is used to receive and store the configuration data sent by the terminal device, wherein the configuration data includes the binding relationship between the UWB tag and the IoT device.

[0193] Optionally, the second sending module 1204 includes:

[0194] a third sending unit, configured to send, in response to a triggering operation on a target remote control control on the remote control device, the control instruction including the target control identifier to the terminal device, so that the terminal device determines a target device function controlled by the target remote control based on the target control identifier;

[0195] or,

[0196] The fourth sending unit is used to send the control instruction containing target gesture operation information to the terminal device in response to the target gesture operation on the remote control device, so that the terminal device determines the target device function controlled by the target gesture operation based on the target gesture operation information.

[0197] Optionally, the device includes:

[0198] A second receiving module is configured to receive connection feedback information sent by the terminal device, where the connection feedback information is used to indicate the establishment of a data communication connection between the terminal device and the target IoT device;

[0199] The second sending module 1204 is configured to: in response to the connection feedback information indicating that the data communication connection is successfully established, execute the step of sending a control instruction to the terminal device in response to the control operation on the remote control device.

[0200] Optionally, the device further includes:

[0201] a prompt module, configured to, in response to the connection feedback information indicating that the data communication connection failed to be established, provide a connection failure prompt, wherein the connection failure prompt includes at least one of a vibration prompt, a voice prompt, or an indicator light prompt;

[0202] The first sending module 1203 is further configured to resend the connection instruction to the terminal device.

[0203] Optionally, the first receiving module 1201 includes:

[0204] a first receiving unit configured to, in a dormant state, activate the UWB component in response to a trigger operation for activating a control on the remote control device, and receive the data frames sent by each of the UWB tags through the UWB component;

[0205] or,

[0206] The second receiving unit is configured to, in a dormant state, turn on the UWB component in response to sensor data collected by the sensor indicating that the remote control device is in motion, and receive the data frames sent by each of the UWB tags through the UWB component.

[0207] Optionally, a Bluetooth connection is established between the remote control device and the terminal device.

[0208] Please refer to Figure 13 , which shows a structural block diagram of a device control device provided by an embodiment of the present application. The device has the function of implementing the above method embodiment executed by the terminal device side, and the function can be implemented by hardware or by hardware executing the corresponding software. Figure 13 As shown, the device may include:

[0209] The third receiving module 1301 is configured to receive a connection instruction sent by the remote control device, wherein the connection instruction is sent by the remote control device when the remote control device determines a target UWB tag from among the UWB tags, and the target UWB tag is the UWB tag pointed to by the remote control device;

[0210] A connection module 1302 is configured to establish a data communication connection with a target IoT device represented by the target UWB tag based on the connection instruction;

[0211] The fourth receiving module 1303 is used to receive the control instruction sent by the remote control device;

[0212] The control module 1304 is configured to control the target IoT device based on the control instruction.

[0213] Optionally, the connection module 1302 includes:

[0214] A first connection unit is configured to obtain a target tag identifier included in the connection instruction; determine the target IoT device from a binding relationship between the UWB tag and the IoT device based on the target tag identifier; and establish a data communication connection with the target IoT device based on a target connection mode corresponding to the target IoT device;

[0215] or,

[0216] A second connection unit is configured to obtain a target device identifier included in the connection instruction; determine the target IoT device based on the target device identifier; and establish a data communication connection with the target IoT device based on a target connection mode corresponding to the target IoT device;

[0217] The target connection mode includes at least one of Bluetooth and WiFi.

[0218] Optionally, the target device identifier included in the connection instruction is obtained by the remote control device from a binding relationship between the UWB tag and the IoT device;

[0219] The device further comprises:

[0220] The third sending module is used to send configuration data to the remote control device so that the remote control device stores the configuration data, where the configuration data includes a binding relationship between the UWB tag and the IoT device.

[0221] Optionally, the control module 1304 includes:

[0222] A first control unit is configured to obtain a target control identifier included in the control instruction, where the target control identifier is an identifier of a target remote control control triggered on the remote control device; determine a target device function controlled by the target remote control based on the target control identifier; and control the target IoT device to execute the target device function;

[0223] or,

[0224] The second control unit is used to obtain target gesture operation information contained in the control instruction, where the target gesture operation information is used to represent the target gesture operation received by the remote control device; based on the target gesture operation information, determine the target device function controlled by the target gesture operation; and control the target IoT device to execute the target device function.

[0225] Optionally, the device further includes:

[0226] A first acquisition module is used to acquire control setting information, wherein the control setting information includes a correspondence between a device identifier, a device function, and a control identifier;

[0227] or,

[0228] The second acquisition module is configured to acquire gesture setting information, wherein the gesture setting information includes a correspondence between a device identifier, a device function, and gesture operation information.

[0229] Optionally, the device further includes:

[0230] The fourth sending module is used to send connection feedback information to the remote control device, where the connection feedback information is used to indicate the establishment status of the data communication connection between the terminal device and the target IoT device.

[0231] Optionally, the device further includes:

[0232] A display module is configured to display a device control interface corresponding to the target IoT device in response to a successful establishment of the data communication connection, wherein the device control interface includes function controls corresponding to the target IoT device;

[0233] The control module 1304 is further configured to control the target IoT device to execute a corresponding device function in response to a triggering operation on a function control in the device control interface.

[0234] Optionally, a Bluetooth connection is established between the remote control device and the terminal device.

[0235] It should be noted that the above embodiments provide devices that implement their functions using only the division of the above functional modules as examples. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the device and method embodiments provided in the above embodiments are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

[0236] Please refer to Figure 14 , which shows a block diagram of the structure of a remote control device 1400 provided by an exemplary embodiment of the present application. The remote control device 1400 in the present application may include one or more of the following components: a processor 1410, a memory 1420, and a UWB component 1430, wherein the processor 1510 is electrically connected to the memory 1420 and the UWB component 1430, respectively.

[0237] Processor 1410 may include one or more processing cores. Processor 1410 utilizes various interfaces and circuits to connect various components within remote control device 1400. Processor 1410 executes various functions and processes data for remote control device 1400 by running or executing instructions, programs, code sets, or instruction sets stored in memory 1420, as well as accessing data stored in memory 1420. Alternatively, processor 1510 may be implemented in hardware using at least one of a digital signal processing (DSP), a field-programmable gate array (FPGA), and a programmable logic array (PLA).

[0238] The memory 1420 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 1420 includes a non-transitory computer-readable storage medium. The memory 1420 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 1420 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. In an embodiment of the present application, at least one instruction is stored in the memory 1420, and the at least one instruction is used to be executed by the processor 1410 to execute the device control method shown in the above-mentioned embodiment.

[0239] The UWB component 1430 is used to receive data frames broadcast by external UWB components, so that the remote control device 1400 can process the data frames through the processor 1410 to achieve the purpose of determining the spatial location of the IoT device based on the data frames.

[0240] Optionally, the remote control device 1400 is further provided with a communication component, so as to perform data interaction with the terminal device through the communication component, and the communication component may be a Bluetooth component.

[0241] In addition, those skilled in the art will appreciate that the structure of the remote control device 1400 shown in the above figures does not limit the remote control device 1400. The remote control device may include more or fewer components than shown, or may combine certain components or arrange the components differently. For example, the remote control device 1400 may also include a vibration motor, sensors (such as accelerometers and inertial sensors), audio circuits, a power supply, physical buttons, and other components, which will not be described in detail here.

[0242] Please refer to Figure 15 , which shows a block diagram of the structure of a terminal device 1500 provided by an exemplary embodiment of the present application. The terminal device 1500 in the present application may include one or more of the following components: a processor 1510, a memory 1520, and a UWB component 1530, wherein the processor 1510 is connected to the memory 1520.

[0243] The processor 1510 may include one or more processing cores. The processor 1510 utilizes various interfaces and circuits to connect various components within the terminal device 1500. It executes instructions, programs, code sets, or instruction sets stored in the memory 1520, and accesses data stored in the memory 1520 to perform various functions and process data within the terminal device 1500. Optionally, the processor 1510 may be implemented using at least one of the following hardware forms: a digital signal processing (DSP), a field-programmable gate array (FPGA), or a programmable logic array (PLA). The processor 1510 may integrate one or a combination of a CPU, a graphics processing unit (GPU), and a modem. The CPU primarily processes the operating system, user interface, and application programs; the GPU is responsible for rendering and drawing content displayed on the touchscreen display; and the modem handles wireless communications. It is understood that the modem may not be integrated into the processor 1510 and may be implemented separately via a communications chip.

[0244] The memory 1520 may include a random access memory (RAM) or a read-only memory (ROM). Optionally, the memory 1520 includes a non-transitory computer-readable storage medium. The memory 1520 may be used to store instructions, programs, codes, code sets, or instruction sets. The memory 1520 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for implementing at least one function (such as a touch function, a sound playback function, an image playback function, etc.), instructions for implementing the above-mentioned various method embodiments, etc. The operating system may be an Android system (including a system developed based on an Android system in depth), an iOS system developed by Apple (including a system developed based on an iOS system in depth), or other systems. The data storage area may also store data (such as a phone book, audio and video data, chat history data), etc., created by the terminal device 1300 during use. In the embodiment of the present application, the memory 1520 stores at least one instruction, which is used to be executed by the processor 1510 to perform the device control method shown in the above embodiment.

[0245] Optionally, the terminal device 1500 is further provided with a communication component 1530, through which the terminal device 1500 can interact with external devices (such as remote control devices and IoT devices) for data. The communication component 1530 may include a Bluetooth component and a WiFi component.

[0246] Optionally, the terminal device 1500 may further include a touch screen display, which may be a capacitive touch screen display, which is used to receive touch operations on or near the display using any suitable object such as a finger or a stylus, and to display the user interface of each application. The touch screen display is typically provided on the front panel of the terminal device 1500. The touch screen display may be designed as a full screen, a curved screen, or a special-shaped screen. The touch screen display may also be designed as a combination of a full screen and a curved screen, or a combination of a special-shaped screen and a curved screen, which is not limited in the embodiments of the present application.

[0247] In addition, those skilled in the art will appreciate that the structure of the terminal device 1500 shown in the above figures does not limit the terminal device 1500. The terminal device may include more or fewer components than shown, or may combine certain components, or arrange the components differently. For example, the terminal device 1500 also includes components such as a radio frequency circuit, a camera component, a sensor, an audio circuit, and a power supply, which will not be described in detail here.

[0248] Please refer to Figure 16 , which shows a structural block diagram of a device control system 1600 provided by an exemplary embodiment of the present application. The device control system includes a remote control device 1601, a terminal device 1602, a UWB tag 1603 and an IoT device 1604.

[0249] In an embodiment of the present application, the remote control device 1601 is independent of the terminal device 1602 and establishes a communication connection with the terminal device 1602. The remote control device 1601 establishes UWB communication with the UWB tag 1603. The UWB tag 1603 is used to represent the IoT device 1604. The terminal device 1602 establishes a data communication connection with the IoT device 1604.

[0250] The remote control device 1601 receives data frames sent by each UWB tag 1603; based on the data frames, it determines a target UWB tag from each UWB tag 1603, where the target UWB tag is the UWB tag pointed at by the remote control device 1601; based on the target UWB tag, it sends a connection instruction to the terminal device 1602;

[0251] The terminal device 1602 receives the connection instruction sent by the remote control device 1601; based on the connection instruction, it establishes a data communication connection with the target IoT device 1604 represented by the target UWB tag;

[0252] The remote control device 1601 sends a control instruction to the terminal device 1602 in response to the control operation on the remote control device;

[0253] The terminal device 1602 receives the control instruction sent by the remote control device 1601 and controls the target IoT device 1604 based on the control instruction.

[0254] An embodiment of the present application further provides a computer-readable storage medium, which stores at least one program code, and the program code is loaded and executed by a processor to implement the device control method described in the above embodiments.

[0255] According to one aspect of the present application, a computer program product or computer program is provided, comprising computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the device control method provided in various optional implementations of the above aspects.

[0256] It should be understood that the "multiple" mentioned in this article refers to two or more. "And / or" describes the association relationship of associated objects, indicating that three relationships may exist. For example, A and / or B can represent three situations: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the previous and subsequent associated objects are in an "or" relationship. In addition, the step numbers described in this article only illustrate a possible execution sequence between the steps. In some other embodiments, the above steps may not be executed in the order of the numbers, such as two steps with different numbers are executed at the same time, or two steps with different numbers are executed in the opposite order to the diagram. The embodiments of the present application do not limit this.

[0257] The above description is merely an optional embodiment of the present application and is not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the scope of protection of the present application.

Claims

1. A device control method, characterized in that: Applied to a remote control device, the method includes: receiving data frames sent by each UWB tag, wherein the UWB tag is used to represent the IoT device; Based on the data frame, determining a target UWB tag from each of the UWB tags, the target UWB tag being the UWB tag pointed to by the remote control device; Based on the target UWB tag, a connection instruction is sent to the terminal device, so that the terminal device establishes a data communication connection with the target IoT device represented by the target UWB tag; Send a control instruction to the terminal device, so that the terminal device controls the target IoT device based on the control instruction.

2. The method according to claim 1, characterized in that The sending of a connection instruction to a terminal device based on the target UWB tag includes: Based on the data frame sent by the target UWB tag, the connection instruction containing the target tag identifier is sent to the terminal device, so that the terminal device determines the target IoT device from the mapping relationship between the UWB tag and the IoT device based on the target tag identifier.

3. The method according to claim 2, characterized in that The step of sending the connection instruction including the target tag identifier to the terminal device based on the data frame sent by the target UWB tag includes: The target tag identifier is obtained from the data frame sent by the target UWB tag, and the connection instruction including the target tag identifier is sent to the terminal device.

4. The method according to claim 1, wherein The sending of a connection instruction to a terminal device based on the target UWB tag includes: Based on the data frame sent by the target UWB tag, the connection instruction including the target device identifier is sent to the terminal device, so that the terminal device determines the target IoT device based on the target device identifier.

5. The method according to claim 4, characterized in that The step of sending the connection instruction including the target device identifier to the terminal device based on the data frame sent by the target UWB tag comprises: Acquire the target tag identifier from the data frame sent by the target UWB tag; Based on the target tag identifier, obtaining the target device identifier from a mapping relationship between the UWB tag and the IoT device; The connection instruction including the target device identifier is sent to the terminal device.

6. The method according to claim 5, characterized in that The target device identification is obtained from the mapping relationship between the UWB tag and the IoT device; The method further comprises: Receive and store configuration data sent by the terminal device, where the configuration data includes a mapping relationship between the UWB tag and the IoT device.

7. The method according to claim 4, characterized in that The step of sending the connection instruction including the target device identifier to the terminal device based on the data frame sent by the target UWB tag comprises: The target device identifier is obtained from the data frame sent by the target UWB tag, and the connection instruction including the target device identifier is sent to the terminal device.

8. The method according to any one of claims 1 to 7, characterized in that: The sending of a control instruction to the terminal device includes: In response to a triggering operation on a target remote control control on the remote control device, the control instruction including the target control identifier is sent to the terminal device, so that the terminal device determines the target device function controlled by the target remote control based on the target control identifier.

9. The method according to any one of claims 1 to 7, characterized in that: The sending of a control instruction to the terminal device includes: In response to a target gesture operation on the remote control device, the control instruction including target gesture operation information is sent to the terminal device, so that the terminal device determines the target device function controlled by the target gesture operation based on the target gesture operation information.

10. The method according to any one of claims 1 to 7, characterized in that: Before sending the control instruction to the terminal device, the method includes: Receive connection feedback information sent by the terminal device, where the connection feedback information is used to indicate the establishment status of the data communication connection between the terminal device and the target IoT device; The sending of a control instruction to the terminal device includes: In response to the connection feedback information indicating that the data communication connection is successfully established, a step of sending a control instruction to the terminal device is performed.

11. The method according to claim 10, characterized in that After receiving the connection feedback information sent by the terminal device, the method further includes: In response to the connection feedback information indicating that the data communication connection failed to be established, providing a connection failure prompt, wherein the connection failure prompt includes at least one of a vibration prompt, a voice prompt, or an indicator light prompt; Resend the connection instruction to the terminal device.

12. The method according to any one of claims 1 to 7, characterized in that: The receiving of data frames sent by each UWB tag includes: In the dormant state, in response to a triggering operation of turning on a control on the remote control device, the UWB component is turned on, and the data frames sent by each of the UWB tags are received through the UWB component.

13. The method according to any one of claims 1 to 7, characterized in that: The receiving of data frames sent by each UWB tag includes: In the dormant state, in response to the sensor data collected by the sensor indicating that the remote control device is in motion, the UWB component is turned on, and the data frames sent by each of the UWB tags are received through the UWB component.

14. The method according to any one of claims 1 to 7, characterized in that: A Bluetooth connection is established between the remote control device and the terminal device.

15. A device control method, characterized in that: Applied to a terminal device, the method includes: receiving a connection instruction sent by a remote control device, wherein the connection instruction is sent by the remote control device when the remote control device determines a target UWB tag from among the UWB tags, wherein the target UWB tag is the UWB tag pointed to by the remote control device; Establishing a data communication connection with a target IoT device represented by the target UWB tag based on the connection instruction; receiving a control instruction sent by the remote control device; The target IoT device is controlled based on the control instruction.

16. The method according to claim 15, characterized in that The establishing a data communication connection with a target IoT device represented by the target UWB tag based on the connection instruction includes: Obtaining the target tag identifier contained in the connection instruction; Based on the target tag identifier, determining the target IoT device from a mapping relationship between the UWB tag and the IoT device; Establish a data communication connection with the target IoT device based on the target connection mode corresponding to the target IoT device.

17. The method according to claim 15, characterized in that The establishing a data communication connection with a target IoT device represented by the target UWB tag based on the connection instruction includes: Obtaining the target device identifier contained in the connection instruction; Determine the target IoT device based on the target device identifier; Establishing a data communication connection with the target IoT device based on the target connection mode corresponding to the target IoT device; The target connection mode includes at least one of Bluetooth and WiFi.

18. The method according to claim 17, characterized in that The target device identifier included in the connection instruction is obtained by the remote control device from the mapping relationship between the UWB tag and the IoT device; The method further comprises: Configuration data is sent to the remote control device, so that the remote control device stores the configuration data, where the configuration data includes a mapping relationship between the UWB tag and the IoT device.

19. The method according to any one of claims 15 to 18, characterized in that: The controlling the target IoT device based on the control instruction includes: Acquire a target control identifier included in the control instruction, where the target control identifier is an identifier of a target remote control control triggered on the remote control device; Determining a target device function controlled by the target remote control based on the target control identifier; Controlling the target IoT device to execute the target device function; The method further comprises: The control setting information is obtained, wherein the control setting information includes a correspondence between a device identifier, a device function, and a control identifier.

20. The method according to any one of claims 15 to 18, characterized in that The controlling the target IoT device based on the control instruction includes: Acquire target gesture operation information included in the control instruction, where the target gesture operation information is used to represent the target gesture operation received by the remote control device; Determining a target device function controlled by the target gesture operation based on the target gesture operation information; Controlling the target IoT device to execute the target device function; The method further comprises: Acquire gesture setting information, wherein the gesture setting information includes a correspondence between a device identifier, a device function, and gesture operation information.

21. The method according to any one of claims 15 to 18, characterized in that After establishing a data communication connection with the target IoT device represented by the target UWB tag based on the connection instruction, the method further includes: Send connection feedback information to the remote control device, where the connection feedback information is used to indicate the establishment status of the data communication connection between the terminal device and the target IoT device.

22. The method according to any one of claims 15 to 18, characterized in that After establishing a data communication connection with the target IoT device represented by the target UWB tag based on the connection instruction, the method further includes: In response to the successful establishment of the data communication connection, displaying a device control interface corresponding to the IoT device, the device control interface including function controls corresponding to the IoT device; In response to a triggering operation on a function control in the device control interface, the IoT device is controlled to execute a corresponding device function.

23. The method according to any one of claims 15 to 18, characterized in that A Bluetooth connection is established between the remote control device and the terminal device.

24. A device control device, characterized in that: The device comprises: A receiving module, configured to receive data frames sent by each UWB tag, wherein the UWB tag is used to represent an IoT device; a determination module, configured to determine a target UWB tag from each of the UWB tags based on the data frame, wherein the target UWB tag is the UWB tag pointed to by the remote control device; A sending module is used to send a connection instruction to a terminal device based on the target UWB tag, so that the terminal device establishes a data communication connection with the target IoT device represented by the target UWB tag; The sending module is further used to send a control instruction to the terminal device, so that the terminal device controls the target IoT device based on the control instruction.

25. A device control device, characterized in that: The device comprises: A first receiving module is configured to receive a connection instruction sent by a remote control device, wherein the connection instruction is sent by the remote control device when the remote control device determines a target UWB tag from among the UWB tags, and the target UWB tag is the UWB tag pointed to by the remote control device; A connection module, configured to establish a data communication connection with a target IoT device represented by the target UWB tag based on the connection instruction; A second receiving module, configured to receive a control instruction sent by the remote control device; A control module is used to control the target IoT device based on the control instruction.

26. A control system for an IoT device, characterized in that: The system includes a remote control device, a terminal device, a UWB tag and an IoT device; The UWB tag is used to characterize the IoT device; The remote control device receives data frames sent by each of the UWB tags; based on the data frames, determines a target UWB tag from each of the UWB tags, the target UWB tag being the UWB tag pointed to by the remote control device; Based on the target UWB tag, sending a connection instruction to the terminal device; The terminal device receives a connection instruction sent by the remote control device; based on the connection instruction, establishes a data communication connection with the target IoT device represented by the target UWB tag; The remote control device sends a control instruction to the terminal device; The terminal device receives the control instruction sent by the remote control device; and controls the target IoT device based on the control instruction.

27. A remote control device, characterized in that: The remote control device includes: a processor, a memory, and a UWB component; the memory stores at least one instruction, and the at least one instruction is used to be executed by the processor to implement the device control method according to any one of claims 1 to 14.

28. A terminal device, characterized in that: The terminal device includes: a processor and a memory; the memory stores at least one instruction, and the at least one instruction is used to be executed by the processor to implement the device control method according to any one of claims 15 to 23.

29. A computer-readable storage medium, characterized in that The computer-readable storage medium stores at least one program code, and the program code is loaded and executed by the processor to implement the device control method according to any one of claims 1 to 14, or to implement the device control method according to any one of claims 15 to 23.

Images