Device control method, device control apparatus, and storage medium

By installing an external ultra-wideband positioning device in a smart home device, using a mobile terminal to position and display the device control interface, the problem of cumbersome control of smart home devices is solved, automatic and intelligent control of the device is realized, and operation efficiency is improved.

CN112327653BActive Publication Date: 2025-08-26BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
CN202011270944.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-11-13
Publication Date
2025-08-26
Estimated Expiration
2040-11-13

AI Technical Summary

Technical Problem

The control operation of existing smart home devices is cumbersome and not smart, which brings inconvenience to users.

Method used

By installing an external ultra-wideband positioning device in the device to be controlled, the mobile terminal is used to position the external ultra-wideband positioning device, and the control interface matching the device to be controlled is retrieved and displayed at the terminal based on the binding relationship, automatic and intelligent control of the device is realized.

Benefits of technology

It improves the operation efficiency of smart home devices, realizes automatic and intelligent control of the devices, and simplifies user operation processes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112327653B_ABST
    Figure CN112327653B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a device control method, a device control device and a storage medium. The device control method is applied to a mobile terminal, and the device control method includes: in response to the mobile terminal pointing to a device to be controlled with an external ultra-wideband positioning device installed, locating the external ultra-wideband positioning device, and there is a binding relationship between the external ultra-wideband positioning device and the device to be controlled; in response to locating the external ultra-wideband positioning device, determining the device to be controlled that is bound to the external ultra-wideband positioning device based on the binding relationship; calling and displaying the control interface of the device to be controlled that matches the device to be controlled. Through the embodiments of the present disclosure, when the terminal points to the device to be controlled, it can automatically select and control the device to be controlled with the external ultra-wideband positioning device installed, and realize automatic and intelligent control of the device to be controlled that originally had no ultra-wideband positioning control based on the ultra-wideband positioning technology, thereby improving operation efficiency and thus enhancing user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the field of terminal technology, and in particular to a device control method, a device control apparatus, and a storage medium. Background Art

[0002] Smart home devices, such as smart humidifiers, smart air conditioners, smart lighting equipment, smart security equipment, etc., are increasingly entering people's field of vision, bringing users an intelligent and convenient experience.

[0003] In current technology, in order to enable smart home devices to operate normally and in a personalized manner, users install applications for controlling smart home devices on terminals such as smartphones. When using home devices, they open the application for controlling the device at the terminal and operate on the operating interface of the smart home device to achieve control of the smart home device, such as turning the working state on and off, setting working parameters, etc.

[0004] While various smart home devices improve people's living environment, the control and adjustment operations of the devices are cumbersome and unintelligent, which brings inconvenience to users. Summary of the Invention

[0005] To overcome the problems existing in the related art, the present disclosure provides a device control method, a device control apparatus and a storage medium.

[0006] According to one aspect of an embodiment of the present disclosure, a device control method is provided, which is applied to a mobile terminal. The device control method includes: in response to the mobile terminal pointing to a device to be controlled on which an external ultra-wideband positioning device is installed, positioning the external ultra-wideband positioning device, and a binding relationship between the external ultra-wideband positioning device and the device to be controlled; in response to positioning the external ultra-wideband positioning device, determining the device to be controlled that is bound to the external ultra-wideband positioning device based on the binding relationship; and calling and displaying a control interface of the device to be controlled that matches the device to be controlled.

[0007] In one embodiment, there is a binding relationship between the external ultra-wideband positioning device and the device to be controlled, which is determined in the following manner: determining that there is a device to be controlled on which the external ultra-wideband positioning device is installed, and obtaining a first identifier for uniquely identifying the external ultra-wideband positioning device; creating and saving a binding relationship between the first identifier and the device to be controlled.

[0008] In one embodiment, creating and saving a binding relationship between the first identifier and the device to be controlled includes: in response to the first positioning of the external ultra-wideband positioning device, displaying a prompt message in a pop-up window on the display interface of a preset application, wherein the prompt message is used to guide the generation of a second identifier, and the second identifier is used to identify the device to be controlled; generating a second identifier according to the second identifier provided by the user based on the prompt message; and creating and saving a binding relationship between the first identifier and the second identifier.

[0009] In one embodiment, the positioning of the external ultra-wideband positioning device includes: if the distance between the external ultra-wideband positioning device and the mobile terminal is within a preset distance range, it is determined that the external ultra-wideband positioning device is positioned, and / or if the angle between the pointing direction between the external ultra-wideband positioning device and the mobile terminal is within a preset pointing angle range, it is determined that the external ultra-wideband positioning device is positioned.

[0010] In one embodiment, the device control method further includes: in response to the mobile terminal displaying the first device to be controlled control interface, the mobile terminal points to a second device to be controlled equipped with an external ultra-wideband positioning device, and switches to the second device to be controlled control interface that matches the second device to be controlled.

[0011] According to another aspect of an embodiment of the present disclosure, there is provided a device control device, which is applied to a mobile terminal, and the device control device includes: a positioning module, which is used to locate the external ultra-wideband positioning device in response to the mobile terminal pointing to the device to be controlled on which the external ultra-wideband positioning device is installed, and a binding relationship exists between the external ultra-wideband positioning device and the device to be controlled; a determination module, which is used to determine the device to be controlled that is bound to the external ultra-wideband positioning device based on the binding relationship in response to locating the external ultra-wideband positioning device; and a display module, which is used to call and display a control interface of the device to be controlled that matches the device to be controlled.

[0012] In one embodiment, there is a binding relationship between the external ultra-wideband positioning device and the device to be controlled, which is determined in the following manner: determining that there is a device to be controlled on which the external ultra-wideband positioning device is installed, and obtaining a first identifier for uniquely identifying the external ultra-wideband positioning device; creating and saving a binding relationship between the first identifier and the device to be controlled.

[0013] In one embodiment, creating and saving a binding relationship between the first identifier and the device to be controlled includes: in response to the first positioning of the external ultra-wideband positioning device, displaying a prompt message in a pop-up window on the display interface of a preset application, wherein the prompt message is used to guide the generation of a second identifier, and the second identifier is used to identify the device to be controlled; generating a second identifier according to the second identifier provided by the user based on the prompt message; and creating and saving a binding relationship between the first identifier and the second identifier.

[0014] In one embodiment, the positioning module locates the external ultra-wideband positioning device in the following manner: if the external ultra-wideband positioning device is located within a preset distance range from the mobile terminal, it is determined that the external ultra-wideband positioning device is located, and / or, if the external ultra-wideband positioning device is located within a preset pointing angle range between the pointing direction and the mobile terminal, it is determined that the external ultra-wideband positioning device is located.

[0015] In one embodiment, the device control device also includes: a switching module, which is used to respond to the mobile terminal displaying the first device to be controlled control interface, the mobile terminal pointing to the second device to be controlled equipped with an external ultra-wideband positioning device, and switching to the second device to be controlled control interface matching the second device to be controlled.

[0016] According to another aspect of an embodiment of the present disclosure, there is provided a device control apparatus, comprising: a processor; and a memory for storing processor-executable instructions; wherein the processor is configured to: execute any one of the aforementioned device control methods.

[0017] According to another aspect of an embodiment of the present disclosure, a non-transitory computer-readable storage medium is provided. When instructions in the storage medium are executed by a processor of a mobile terminal, the mobile terminal is enabled to execute any one of the aforementioned device control methods.

[0018] The technical solution provided by the embodiments of the present disclosure may include the following beneficial effects: by binding an external ultra-wideband positioning device to a device to be controlled, when a mobile terminal points to a device to be controlled on which an external ultra-wideband positioning device is installed, the external ultra-wideband positioning device can be located, thereby determining the device to be controlled that is bound to the external ultra-wideband positioning device. The control interface of the device to be controlled that matches the device to be controlled is retrieved and displayed at the terminal to control the device to be controlled, so that when the terminal points to the device to be controlled, the device to be controlled on which the external ultra-wideband positioning device is installed is automatically selected and controlled, thereby achieving automatic and intelligent control of the device to be controlled that originally did not have ultra-wideband positioning control based on ultra-wideband positioning technology, thereby improving operational efficiency.

[0019] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0021] Figure 1 The figure is a flow chart showing a device control method according to an exemplary embodiment of the present disclosure.

[0022] Figure 2 This is a flowchart of a method for determining whether an external ultra-wideband positioning device and a device to be controlled have a binding relationship according to another exemplary embodiment of the present disclosure.

[0023] Figure 3 This is a flowchart illustrating a method for creating and saving a binding relationship between a first identifier and a device to be controlled according to another exemplary embodiment of the present disclosure.

[0024] Figure 4 is a flowchart of a device control method according to another exemplary embodiment of the present disclosure.

[0025] Figure 5 is a flowchart of a device control method according to another exemplary embodiment of the present disclosure.

[0026] Figure 6a-6c FIG. 4 is a schematic diagram of a device control method according to an exemplary embodiment of the present disclosure.

[0027] Figure 7 The figure is a block diagram of a device control apparatus according to an exemplary embodiment of the present disclosure.

[0028] Figure 8 is a block diagram of a device control apparatus according to another exemplary embodiment of the present disclosure.

[0029] Figure 9 The figure is a block diagram showing a device control apparatus according to an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0030] Exemplary embodiments will be described in detail herein, with examples illustrated in the accompanying drawings. In the following description, when referring to the drawings, identical numerals in different figures represent identical or similar elements, unless otherwise indicated. The embodiments described in the following exemplary embodiments are not intended to represent all possible embodiments consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.

[0031] Smart home devices offer users an intelligent and convenient experience. Current technologies require users to install an application on a smartphone or other device to control the device in order to ensure proper and personalized operation. When using a home device, users open the application and navigate the device's user interface to control the device, such as turning it on and off and setting operating parameters.

[0032] While various smart home devices improve people's living environment, the control and adjustment operations of the devices are cumbersome and unintelligent, which brings inconvenience to users.

[0033] Ultra-Wideband (UWB) technology, unlike traditional communications technologies, achieves wireless transmission by sending and receiving extremely narrow pulses in the nanosecond or microsecond range. This ultra-large bandwidth and low transmit power enable fast data transmission with low power consumption. Compared to traditional narrowband systems, UWB systems offer advantages such as strong penetration, low power consumption, excellent multipath mitigation, high security, reduced system complexity, and precise positioning accuracy.

[0034] Ultra-wideband positioning utilizes pre-deployed anchor nodes and bridge nodes with known locations to communicate with newly added blind nodes. Positioning is achieved by measuring the transmission delay differences between different base stations and mobile terminals. This technology leverages the ultra-narrow pulses of sub-nanosecond or microsecond wireless transmission. By detecting the position of the signal pulses and combining them with certain positioning methods, the time the signal travels in the air is calculated. This time, multiplied by the signal's transmission rate, is used to determine the distance between the detecting and detected devices, achieving precise positioning with centimeter-level accuracy.

[0035] Although ultra-wideband positioning modules are installed in terminals as the configuration of mobile terminals continues to increase, the existing home appliances and office equipment widely used in people's work and living environments are not equipped with ultra-wideband positioning devices during production, so ultra-wideband technology cannot be used to locate them during use.

[0036] Therefore, the present disclosure provides a device control method, which can be achieved by installing an external ultra-wideband positioning device in the device to be controlled, and using a mobile terminal to locate the external ultra-wideband positioning device. When the external ultra-wideband positioning device is located, based on the binding relationship between the external ultra-wideband positioning device and the device to be controlled, the terminal calls up and displays the control interface of the device to be controlled that matches the device to be controlled, and controls the device to be controlled, thereby realizing automatic and intelligent control of the device to be controlled.

[0037] Figure 1is a flow chart of a device control method according to an exemplary embodiment. Figure 1 As shown, the device control method is used in a mobile terminal, which may be, for example, a smart phone, a tablet computer, a wearable device, etc. The embodiments of the present disclosure do not limit the types of devices to which the device control method is applied. Figure 1 As shown, the device control method includes the following steps.

[0038] In step S101, in response to the mobile terminal pointing to the device to be controlled equipped with an external ultra-wideband positioning device, the external ultra-wideband positioning device is positioned, and a binding relationship is established between the external ultra-wideband positioning device and the device to be controlled.

[0039] In step S102 , in response to locating the external ultra-wideband positioning device, a device to be controlled that is bound to the external ultra-wideband positioning device is determined based on a binding relationship.

[0040] In step S103, a control interface of the device to be controlled that matches the device to be controlled is retrieved and displayed.

[0041] In the embodiments of the present disclosure, the device to be controlled may be an air conditioner, television, speaker, refrigerator, lamp, or other device that does not have a built-in ultra-wideband positioning module. There is a binding relationship between the external ultra-wideband positioning device and the device to be controlled, and they correspond one to one. The external ultra-wideband positioning device may be fixedly installed on the surface, frame, bottom or back of the device to be controlled. The mobile terminal is provided with an ultra-wideband positioning module, which points to the device to be controlled on which the external ultra-wideband positioning device is installed, locates the external ultra-wideband positioning device, and the ultra-wideband positioning module of the mobile terminal communicates with the external ultra-wideband positioning device to determine the relative position relationship between the mobile terminal and the external ultra-wideband positioning device, that is, the relative distance and / or relative direction, angle relationship.

[0042] It can be understood that the arrival angle positioning method is used to determine the relative position relationship between the mobile terminal and the external ultra-wideband positioning device, that is, the direction angle and distance between the mobile terminal and the external ultra-wideband positioning device. Among them, the arrival angle positioning method measures the arrival angle between the mobile terminal and the external ultra-wideband positioning device. The ray formed with the external ultra-wideband positioning device as the starting point must pass through the external ultra-wideband positioning device. The intersection of the two rays is the position of the external ultra-wideband positioning device, and the direction angle and distance are calculated through the coordinates of this position. The relative position relationship between the mobile terminal and the device to be controlled can also be determined by an ultra-wideband positioning method, such as an AOA positioning method, a TOF positioning method, a TOA positioning method or a TDOA positioning method.

[0043] The mobile terminal locates the external ultra-wideband positioning device and, based on the binding relationship between the external ultra-wideband positioning device and the device to be controlled, determines the device to be controlled that is bound to the external ultra-wideband positioning device. The control interface for the device to be controlled that matches the device to be controlled is retrieved and displayed. The control interface for the device to be controlled includes touch buttons for controlling the device to be controlled. By touching the buttons on the control interface displayed on the mobile terminal, the user sends control signals to the device to control the device to control it. For example, this can be used to turn the device on or off or adjust parameters.

[0044] According to the embodiment of the present disclosure, by binding an external ultra-wideband positioning device to the device to be controlled, when the mobile terminal points to the device to be controlled, the external ultra-wideband positioning device is located, the device to be controlled bound to the external ultra-wideband positioning device is determined, and the control interface of the device to be controlled that matches the device to be controlled is called up and displayed at the terminal to control the device to be controlled. When the terminal points to the device to be controlled, the device to be controlled with the external ultra-wideband positioning device installed is automatically selected and controlled, and automatic and intelligent control of the device to be controlled that originally had no ultra-wideband positioning control is achieved based on ultra-wideband positioning technology, thereby improving operational efficiency.

[0045] Figure 2 FIG. 1 is a flow chart showing a method for determining a binding relationship between an external ultra-wideband positioning device and a device to be controlled according to another exemplary embodiment of the present disclosure. Figure 2 As shown, the method for determining whether there is a binding relationship between the external ultra-wideband positioning device and the device to be controlled includes the following steps.

[0046] In step S201, it is determined that there is a device to be controlled that is equipped with an external ultra-wideband positioning device, and a first identifier for uniquely identifying the external ultra-wideband positioning device is obtained.

[0047] In step S202, a binding relationship between the first identifier and the device to be controlled is created and saved.

[0048] In an embodiment of the present disclosure, in a scenario where the mobile terminal controls the device to be controlled for the first time, binding is performed between the external ultra-wideband positioning device and the device to be controlled. The mobile terminal is provided with an ultra-wideband positioning module. When it points to the device to be controlled on which the external ultra-wideband positioning device is installed, the direction and distance relationship determined by the ultra-wideband positioning module is used to determine the existence of the external ultra-wideband positioning device. A first identifier for uniquely identifying the external ultra-wideband positioning device is obtained, and the first identifier is bound to the device to be controlled on which the external ultra-wideband positioning device is installed. The first identifier can be the MAC address of the external ultra-wideband positioning device, or a unique identifier of other external ultra-wideband positioning devices.

[0049] A binding relationship is created on the mobile terminal between the first identifier and the device to be controlled, and the binding relationship is saved so that when the device to be controlled is subsequently controlled, control is performed based on the binding relationship between the first identifier and the device to be controlled. If there are multiple devices to be controlled, a binding relationship between the first identifier and the device to be controlled is created and saved for each of the multiple devices to be controlled.

[0050] According to an embodiment of the present disclosure, in a scenario where a mobile terminal controls a device to be controlled for the first time, binding is performed between an external ultra-wideband positioning device and the device to be controlled to determine the binding relationship between the external ultra-wideband positioning device and the device to be controlled. Then, in subsequent use, the binding relationship is utilized to control the device to be controlled by locating the external ultra-wideband positioning device, thereby facilitating the control experience of the device.

[0051] Figure 3 This is a flowchart of a method for creating and saving a binding relationship between a first identifier and a device to be controlled according to another exemplary embodiment of the present disclosure. Figure 3 As shown, the method for creating and saving the binding relationship between the first identifier and the device to be controlled includes the following steps.

[0052] In step S301, in response to the first positioning of the external ultra-wideband positioning device, a prompt message is displayed in a pop-up window on the display interface of the preset application program, the prompt message is used to guide the generation of a second identifier, and the second identifier is used to identify the device to be controlled.

[0053] In step S302, a second identifier is generated according to the second identifier provided by the user based on the prompt information.

[0054] In step S303, a binding relationship between the first identifier and the second identifier is created and saved.

[0055] In an embodiment of the present disclosure, in a scenario where the mobile terminal controls the device to be controlled for the first time, binding is performed between the external ultra-wideband positioning device and the device to be controlled. The mobile terminal is provided with an ultra-wideband positioning module. When it points to the device to be controlled on which the external ultra-wideband positioning device is installed, the direction and distance relationship determined by the ultra-wideband positioning module is used to determine the existence of the external ultra-wideband positioning device. That is, when the mobile terminal points to the device to be controlled on which the external ultra-wideband positioning device is installed for the first time, the mobile terminal locates the external ultra-wideband positioning device through the set ultra-wideband positioning module, and implements the binding of the external ultra-wideband positioning device and the device to be controlled in the preset application for controlling the device to be controlled. On the display interface of the preset application, a pop-up window displays a prompt message to guide the user to generate a second identifier, and the second identifier is used to identify the device to be controlled.

[0056] The user can provide a second identifier based on the prompt information in the preset application for controlling the device to be controlled, generate the second identifier in the preset application, create and save the binding relationship between the first identifier and the second identifier, and thus realize the binding of the external ultra-wideband positioning device and the device to be controlled.

[0057] In one embodiment of the present disclosure, taking the process of a user creating a binding relationship between a mobile phone and an air conditioner as an example, the mobile phone is equipped with an ultra-wideband positioning module, and the air conditioner is installed with an external ultra-wideband positioning device, so that the mobile phone is pointed to the location of the air conditioner to be controlled. The user's mobile phone can locate the external ultra-wideband positioning device and obtain a first identifier that identifies the external ultra-wideband positioning device, and the first identifier is unique. In the application for controlling the air conditioner with the mobile phone, a pop-up window displays a prompt message, prompting the user to locate the external ultra-wideband positioning device. Based on the prompt message, the user provides a second identifier for identifying the air conditioner, for example, "study air conditioner". According to the second identifier of "study air conditioner" provided by the user based on the prompt message, the second identifier of "study air conditioner" is generated in the application for controlling the air conditioner with the mobile phone, and a binding relationship between the first identifier and the second identifier is created to realize the binding between the mobile phone and the air conditioner. In subsequent use, when the user points the mobile phone at the living room air conditioner, the temperature adjustment, air volume adjustment, turning on or off, etc. of the living room air conditioner to which it is bound are realized according to the first identifier of the located external ultra-wideband positioning device.

[0058] According to an embodiment of the present disclosure, when the external ultra-wideband positioning device is located for the first time, a prompt message is displayed in a pop-up window on the display interface of the preset application. According to the second identifier provided by the user based on the prompt message, a binding relationship between the first identifier and the second identifier is created and saved. In subsequent use, the binding relationship can be directly used to control the device to be controlled, thereby further realizing intelligent and convenient control of the device to be controlled.

[0059] Figure 4 FIG. 1 is a flow chart of a device control method according to another exemplary embodiment of the present disclosure. Figure 4 As shown, the device control method includes the following steps.

[0060] In step S401, in response to the mobile terminal pointing to the device to be controlled equipped with an external ultra-wideband positioning device, the external ultra-wideband positioning device is positioned, and a binding relationship is established between the external ultra-wideband positioning device and the device to be controlled.

[0061] In step S402, if the external ultra-wideband positioning device is positioned within a preset distance range from the mobile terminal, and / or if the external ultra-wideband positioning device is positioned within a preset pointing angle range between the pointing direction and the mobile terminal, the device to be controlled that is bound to the external ultra-wideband positioning device is determined based on the binding relationship.

[0062] In step S403, a control interface of the device to be controlled that matches the device to be controlled is retrieved and displayed.

[0063] In the embodiment of the present disclosure, there is a binding relationship between the external ultra-wideband positioning device and the device to be controlled, and there is a one-to-one correspondence. The mobile terminal is provided with an ultra-wideband positioning module, which points to the device to be controlled on which the external ultra-wideband positioning device is installed to locate the external ultra-wideband positioning device.

[0064] The mobile terminal determines the device to be controlled that is bound to the external ultra-wideband positioning device within a preset spatial range. The preset spatial range includes a preset angle and / or a preset distance of the mobile terminal. The external ultra-wideband positioning device is located within the preset distance range from the mobile terminal. Based on the binding relationship between the external ultra-wideband positioning device and the device to be controlled, the device to be controlled that is bound to the external ultra-wideband positioning device is determined, thereby enabling the terminal to control the device to be controlled.

[0065] In the disclosed embodiments, an external ultra-wideband positioning device can be located within a preset pointing angle range relative to the mobile terminal. Based on the binding relationship between the external ultra-wideband positioning device and the device to be controlled, the device to be controlled that is bound to the external ultra-wideband positioning device is determined, thereby enabling control of the device to be controlled from the terminal. The preset distance and angle can be pre-set based on the accuracy of the ultra-wideband positioning module, user usage conditions, preferences, etc.

[0066] The mobile terminal locates the external ultra-wideband positioning device, calls up and displays the control interface of the device to be controlled that matches the device to be controlled. The control interface of the device to be controlled includes touch buttons for controlling the device to be controlled. The user touches the buttons on the control interface displayed on the mobile terminal to send a control signal of the device to be controlled to the device to be controlled, thereby controlling the device to be controlled.

[0067] According to an embodiment of the present disclosure, a mobile terminal points to a device to be controlled that is equipped with an external ultra-wideband positioning device. The mobile terminal determines the device to be controlled that is bound to the external ultra-wideband positioning device within a preset distance and / or range, and calls and displays the control interface of the device to be controlled to control the device to be controlled, thereby achieving precise and effective control of the device to be controlled.

[0068] Figure 5 FIG. 1 is a flow chart of a device control method according to another exemplary embodiment of the present disclosure. Figure 5 As shown, the device control method includes the following steps.

[0069] In step S501, in response to the mobile terminal pointing to the device to be controlled equipped with an external ultra-wideband positioning device, the external ultra-wideband positioning device is positioned, and a binding relationship is established between the external ultra-wideband positioning device and the device to be controlled.

[0070] In step S502, in response to locating the external ultra-wideband positioning device, a device to be controlled that is bound to the external ultra-wideband positioning device is determined based on a binding relationship.

[0071] In step S503, a control interface of the device to be controlled that matches the device to be controlled is retrieved and displayed.

[0072] In step S504, in response to the mobile terminal displaying the first device to be controlled control interface, the mobile terminal points to the second device to be controlled equipped with an external ultra-wideband positioning device and switches to the second device to be controlled control interface matching the second device to be controlled.

[0073] In the embodiment of the present disclosure, there is a binding relationship between the external ultra-wideband positioning device and the device to be controlled, and there is a one-to-one correspondence. The mobile terminal is provided with an ultra-wideband positioning module, which points to the device to be controlled on which the external ultra-wideband positioning device is installed to locate the external ultra-wideband positioning device.

[0074] The mobile terminal locates a first device to be controlled by the external ultra-wideband positioning device, determines the first device to be controlled that is bound to the external ultra-wideband positioning device based on the binding relationship between the external ultra-wideband positioning device and the first device to be controlled, and retrieves and displays a first device to be controlled control interface that matches the first device to be controlled. The first device to be controlled control interface includes touch buttons for controlling the first device to be controlled. A user touches the buttons on the first device to be controlled control interface displayed on the mobile terminal to send control signals to the first device to be controlled, thereby controlling the first device to be controlled.

[0075] When the mobile terminal displays the control interface of the first device to be controlled, due to user movement or changes in space or usage needs, the mobile terminal points to the second device to be controlled which is equipped with an external ultra-wideband positioning device to control the second device to be controlled.

[0076] The mobile terminal locates a second device to be controlled by the external ultra-wideband positioning device, determines the second device to be controlled that is bound to the external ultra-wideband positioning device based on the binding relationship between the external ultra-wideband positioning device and the second device to be controlled, and retrieves and displays a second device to be controlled control interface that matches the second device to be controlled. The second device to be controlled control interface includes touch buttons for controlling the second device to be controlled. The user touches the buttons on the second device to be controlled control interface displayed on the mobile terminal to send control signals to the second device to be controlled, thereby controlling the second device to be controlled.

[0077] On the display interface of the mobile terminal, the control interface of the first device to be controlled that matches the first device to be controlled is switched to the control interface of the second device to be controlled that matches the second device to be controlled.

[0078] According to an embodiment of the present disclosure, when the mobile terminal displays the control interface of the first device to be controlled, the mobile terminal points to the second device to be controlled which is equipped with an external ultra-wideband positioning device, and switches to the control interface of the second device to be controlled that matches the second device to be controlled. This enables switching between multiple devices to be controlled when there are multiple devices to be controlled within the range of the mobile terminal, thereby improving the convenient operation of controlling multiple devices to be controlled.

[0079] Figure 6a-6c is a schematic diagram of a device control method according to an exemplary embodiment of the present disclosure. Figure 6a This shows a user controlling a TV by pointing their phone at it. The phone is equipped with an ultra-wideband positioning module, and the TV is equipped with an external ultra-wideband positioning device. By pointing the phone at the location of the air conditioner to be controlled, the phone can locate the external ultra-wideband positioning device installed on the TV. The first time a phone is used to control the TV, a binding relationship is established between the phone and the TV.

[0080] Reference Figure 6b , Figure 6b This example shows a user pointing their phone at a TV. The phone then locates the TV's external ultra-wideband positioning device. Based on the binding relationship between the TV and the external ultra-wideband positioning device, the user determines that the device to be controlled is the TV. The phone then retrieves and displays the control interface for the device to be controlled that matches the TV. If this is not the first time a user is using their phone to control the TV, the phone retrieves the binding relationship between the phone and the TV stored in the phone.

[0081] Reference Figure 6c , Figure 6c This shows a user controlling a TV using their mobile phone. The phone locates the external ultra-wideband positioning device installed on the TV. Based on the binding relationship between the external ultra-wideband positioning device and the TV, the user determines that the device to be controlled is the TV. The phone then retrieves and displays the control interface for the device to be controlled that matches the TV. There is also an air conditioner nearby that is also equipped with an external ultra-wideband positioning device. When the user needs to control the air conditioner, they point their phone at the air conditioner. The phone then locates the external ultra-wideband positioning device installed on the air conditioner. The first time the user uses their mobile phone to control the air conditioner, a binding relationship is established between the phone and the air conditioner. If the user does not use their mobile phone to control the air conditioner for the first time, the phone retrieves the binding relationship between the phone and the air conditioner stored in the phone. The phone locates the external ultra-wideband positioning device installed on the air conditioner. Based on the binding relationship between the external ultra-wideband positioning device and the air conditioner, the user determines that the device to be controlled is the air conditioner. The phone then switches to displaying the air conditioner control interface.

[0082] Based on the same concept, an embodiment of the present disclosure also provides a device control apparatus.

[0083] It is understandable that the device control device provided by the embodiment of the present disclosure includes hardware structures and / or software modules corresponding to the execution of each function in order to realize the above functions. In combination with the units and method steps of each example disclosed in the embodiment of the present disclosure, the embodiment of the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the technical solution of the embodiment of the present disclosure.

[0084] Figure 7 FIG. 1 is a block diagram of a device control apparatus according to an exemplary embodiment of the present disclosure. Figure 7 The device control apparatus 100 includes a positioning module 101 , a determination module 102 and a display module 103 .

[0085] The positioning module 101 is configured to locate the external ultra-wideband positioning device in response to the mobile terminal pointing to the device to be controlled. The external ultra-wideband positioning device and the device to be controlled have a binding relationship.

[0086] Determining module 102, for locating an external ultra-wideband positioning device in response to, based on the binding relationship, determining the device to be controlled that is bound to the external ultra-wideband positioning device.

[0087] The display module 103 is used to retrieve and display the control interface of the device to be controlled that matches the device to be controlled.

[0088] In one embodiment, a binding relationship exists between the external ultra-wideband positioning device and the device to be controlled, which is determined in the following manner: determining that there is a device to be controlled on which the external ultra-wideband positioning device is installed, and obtaining a first identifier for uniquely identifying the external ultra-wideband positioning device; creating and saving a binding relationship between the first identifier and the device to be controlled.

[0089] In one embodiment, creating and saving a binding relationship between a first identifier and a device to be controlled includes: in response to first positioning of an external ultra-wideband positioning device, displaying a prompt message in a pop-up window on a display interface of a preset application, the prompt message being used to guide the generation of a second identifier, the second identifier being used to identify the device to be controlled; generating a second identifier according to the second identifier provided by the user based on the prompt message; and creating and saving a binding relationship between the first identifier and the second identifier.

[0090] In one embodiment, the positioning module 101 locates the external ultra-wideband positioning device in the following manner: if the external ultra-wideband positioning device is located within a preset distance range from the mobile terminal, it is determined that the external ultra-wideband positioning device is located, and / or, if the external ultra-wideband positioning device is located within a preset pointing angle range between the pointing direction and the mobile terminal, it is determined that the external ultra-wideband positioning device is located.

[0091] Figure 8 FIG. 1 is a block diagram of a device control apparatus according to another exemplary embodiment of the present disclosure. Figure 8 , the device control apparatus 100 further includes a switching module 104 .

[0092] The switching module 104 is configured to switch to a second device control interface matching the second device to be controlled in response to the mobile terminal pointing to the second device to be controlled equipped with an external ultra-wideband positioning device during the mobile terminal displaying the first device control interface.

[0093] Regarding the apparatus in the above embodiment, the specific manner in which each module performs operations has been described in detail in the embodiment of the method, and will not be elaborated here.

[0094] Figure 9 FIG1 is a block diagram illustrating a device control apparatus 800 according to an exemplary embodiment of the present disclosure. For example, the device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0095] Reference Figure 9 , the apparatus 800 may include one or more of the following components: a processing component 802 , a memory 804 , a power component 806 , a multimedia component 808 , an audio component 810 , an input / output (I / O) interface 812 , a sensor component 814 , and a communication component 816 .

[0096] The processing component 802 generally controls the overall operation of the device 800, such as operations associated with display, phone calls, data communications, camera operation, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to perform all or part of the steps of the above-described method. In addition, the processing component 802 may include one or more modules to facilitate interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate interaction between the multimedia component 808 and the processing component 802.

[0097] The memory 804 is configured to store various types of data to support the operations of the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 can be implemented by any type of volatile or non-volatile storage device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk, or optical disk.

[0098] The power component 806 provides power to the various components of the device 800. The power component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the device 800.

[0099] The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, slides, and gestures on the touch panel. The touch sensor can not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each front camera and rear camera can be a fixed optical lens system or have focal length and optical zoom capabilities.

[0100] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC), which is configured to receive external audio signals when the device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 also includes a speaker for outputting audio signals.

[0101] I / O interface 812 provides an interface between processing component 802 and peripheral interface modules, such as a keyboard, click wheel, buttons, etc. These buttons may include but are not limited to: a home button, volume buttons, a start button, and a lock button.

[0102] The sensor assembly 814 includes one or more sensors for providing various aspects of the status assessment of the device 800. For example, the sensor assembly 814 can detect the open / closed state of the device 800, the relative positioning of components, such as the display and keypad of the device 800. The sensor assembly 814 can also detect changes in the position of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration / deceleration of the device 800, and temperature changes of the device 800. The sensor assembly 814 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 814 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 814 may also include an accelerometer, a gyroscope, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0103] The communication component 816 is configured to facilitate wired or wireless communication between the device 800 and other devices. The device 800 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0104] In an exemplary embodiment, the apparatus 800 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above-described method.

[0105] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 804 including instructions, and the instructions can be executed by the processor 820 of the apparatus 800 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0106] It is understood that in this disclosure, "plurality" refers to two or more than two, and other quantifiers are similar. "And / or" describes the association relationship of related objects, indicating that three relationships may exist. For example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. The character " / " generally indicates that the related objects before and after are in an "or" relationship. The singular forms "a", "the" and "the" are also intended to include the plural forms, unless the context clearly indicates otherwise.

[0107] It will be further understood that the terms "first," "second," and the like are used to describe various types of information, but such information should not be limited to these terms. These terms are used solely to distinguish information of the same type from one another and do not indicate a particular order or level of importance. In fact, the terms "first," "second," and the like are fully interchangeable. For example, first information could be referred to as second information, and similarly, second information could be referred to as first information without departing from the scope of this disclosure.

[0108] It is further understood that, unless otherwise specified, “connection” includes a direct connection where there are no other components between the two elements, and also includes an indirect connection where there are other elements between the two elements.

[0109] It is further understood that although operations are described in a particular order in the drawings in the embodiments of the present disclosure, this should not be construed as requiring that the operations be performed in the particular order shown or in a serial order, or that all of the operations shown be performed to obtain the desired results. In certain circumstances, multitasking and parallel processing may be advantageous.

[0110] Other embodiments of the present disclosure will readily occur to those skilled in the art after considering the specification and practicing the disclosure herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or customary techniques in the art not disclosed herein. The description and examples are to be considered as exemplary only, with the true scope and spirit of the present disclosure being indicated by the following claims.

[0111] It should be understood that the present disclosure is not limited to the exact structures that have been described above and shown in the drawings, and that various modifications and changes can be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.

Claims

1. A device control method, characterized in that: Applied to a mobile terminal, the device control method includes: In response to the mobile terminal pointing to the location of the device to be controlled, locating an external ultra-wideband positioning device corresponding to the device to be controlled, where the device to be controlled is a device without a built-in ultra-wideband positioning device, and a binding relationship is established between the external ultra-wideband positioning device and the device to be controlled, where the binding relationship is predetermined and stored by the mobile terminal; In response to locating the external ultra-wideband positioning device, determining, based on the binding relationship, a device to be controlled that is bound to the external ultra-wideband positioning device; Retrieving and displaying a control interface of a device to be controlled that matches the device to be controlled; In response to the mobile terminal displaying the control interface of the first device to be controlled, the mobile terminal points to the location of the second device to be controlled, locates the external ultra-wideband positioning device corresponding to the second device to be controlled, and based on the binding relationship, determines the second device to be controlled bound to the second external ultra-wideband positioning device, and calls and switches to the second device to be controlled control interface that matches the second device to be controlled.

2. The device control method according to claim 1, wherein: The external ultra-wideband positioning device and the device to be controlled have a binding relationship, which is determined in the following manner: Determining that there is a device to be controlled that is bound to an external ultra-wideband positioning device, and obtaining a first identifier for uniquely identifying the external ultra-wideband positioning device; A binding relationship between the first identifier and the device to be controlled is created and saved.

3. The device control method according to claim 2, characterized in that: Creating and saving a binding relationship between the first identifier and the device to be controlled includes: In response to the external ultra-wideband positioning device being located for the first time, a prompt message is displayed in a pop-up window on a display interface of a preset application program, wherein the prompt message is used to guide the generation of a second identifier, and the second identifier is used to identify the device to be controlled; generating a second identifier according to a second identifier provided by the user based on the prompt information; A binding relationship between the first identifier and the second identifier is created and saved.

4. The device control method according to any one of claims 1 to 3, characterized in that: The positioning of the external ultra-wideband positioning device includes: If the external ultra-wideband positioning device is located within a preset distance range from the mobile terminal, it is determined that the external ultra-wideband positioning device is located, and / or, If the external ultra-wideband positioning device is located within a preset pointing angle range between the pointing direction of the mobile terminal and the external ultra-wideband positioning device, it is determined that the external ultra-wideband positioning device is located.

5. A device control device, characterized in that: Applied to a mobile terminal, the device control apparatus includes: a positioning module configured to, in response to the mobile terminal pointing to the location of a device to be controlled, locate an external ultra-wideband positioning device corresponding to the device to be controlled, wherein the device to be controlled is a device without a built-in ultra-wideband positioning device, and a binding relationship is established between the external ultra-wideband positioning device and the device to be controlled, wherein the binding relationship is predetermined and stored by the mobile terminal; a determining module, configured to, in response to locating the external ultra-wideband positioning device, determine, based on the binding relationship, a device to be controlled that is bound to the external ultra-wideband positioning device; A display module, configured to retrieve and display a control interface of a device to be controlled that matches the device to be controlled; A switching module is used to respond to the mobile terminal displaying the control interface of the first device to be controlled, the mobile terminal points to the location of the second device to be controlled, locate the external ultra-wideband positioning device corresponding to the second device to be controlled, determine the second device to be controlled bound to the second external ultra-wideband positioning device based on the binding relationship, and call and switch to the second device to be controlled control interface matching the second device to be controlled.

6. The device control device according to claim 5, characterized in that: The external ultra-wideband positioning device and the device to be controlled have a binding relationship, which is determined in the following manner: Determining that there is a device to be controlled that is bound to an external ultra-wideband positioning device, and obtaining a first identifier for uniquely identifying the external ultra-wideband positioning device; A binding relationship between the first identifier and the device to be controlled is created and saved.

7. The device control device according to claim 6, characterized in that: Creating and saving a binding relationship between the first identifier and the device to be controlled includes: In response to the external ultra-wideband positioning device being located for the first time, a prompt message is displayed in a pop-up window on a display interface of a preset application program, wherein the prompt message is used to guide the generation of a second identifier, and the second identifier is used to identify the device to be controlled; generating a second identifier according to a second identifier provided by the user based on the prompt information; A binding relationship between the first identifier and the second identifier is created and saved.

8. The device control apparatus according to any one of claims 5 to 7, characterized in that: The positioning module locates the external ultra-wideband positioning device in the following manner: If the external ultra-wideband positioning device is located within a preset distance range from the mobile terminal, it is determined that the external ultra-wideband positioning device is located, and / or, If the external ultra-wideband positioning device is located within a preset pointing angle range between the pointing direction of the mobile terminal and the external ultra-wideband positioning device, it is determined that the external ultra-wideband positioning device is located.

9. A device control device, characterized in that: include: processor; a memory for storing processor-executable instructions; The processor is configured to execute the device control method according to any one of claims 1 to 4.

10. A non-transitory computer-readable storage medium, when instructions in the storage medium are executed by a processor of a mobile terminal, enables the mobile terminal to execute the device control method according to any one of claims 1 to 4.

Citation Information

Patent Citations

  • Method and device for directly remotely controlling UWB equipment by using mobile phone embedded with UWB module

    CN111212182A