Method for controlling intelligent device, and terminal device

Abstract

The present application relates to a method for controlling an intelligent device, and a terminal device. The method may comprise: by means of a connection with a first terminal device, a second terminal device acquires, from the first terminal device, first information associated with controlling a first intelligent device; on the basis of the first information, the second terminal device uses a system capability of the second terminal device to generate a first control mode for controlling the first intelligent device; and in response to an operation performed by a user using the first control mode, the second terminal device controls the first intelligent device. In the technical solution provided in the present application, in a scenario in which an intelligent device management APP or a hub device is inconvenient to control an intelligent device, a lightweight terminal device can acquire information associated with controlling the intelligent device, generate, on the basis of the information associated with controlling the intelligent device, a control mode for controlling the intelligent device, and control the intelligent device on the basis of the control mode, thereby improving the convenience of controlling the intelligent device and user experience.

Description

Methods and terminal devices for controlling smart devices

[0001] This application claims priority to Chinese Patent Application No. 202510012919.0, filed on January 3, 2025, entitled "Method and Terminal Equipment for Controlling Intelligent Devices", the entire contents of which are incorporated herein by reference. Technical Field

[0002] This invention relates to the field of intelligent device control technology, and in particular to a method and terminal device for controlling intelligent devices. Background Technology

[0003] Currently, the control interface for smart devices is typically a smart device management application (APP) or a smart home hub device. Users can manage and control smart devices through the smart device management app or the smart home hub device. However, some lightweight terminal devices, due to limited hardware and software resources, do not have a smart device management app installed, thus failing to provide users with the function of controlling smart devices. This forces users to control smart devices only through the smart device management app or the smart home hub device. Clearly, this control method is not convenient enough. Summary of the Invention

[0004] This application provides a method and terminal device for controlling smart devices to meet users' needs for convenience in controlling smart devices in more scenarios.

[0005] In a first aspect, embodiments of this application provide a method for controlling a smart device, applicable to a smart device control system. The smart device control system may include a first terminal device and a second terminal device, wherein the first terminal device can be used to control the first smart device or is the first smart device, the second terminal device does not have an application installed for controlling the first smart device, and the first terminal device is connected to the second terminal device. The method includes:

[0006] The second terminal device obtains first information associated with controlling the first intelligent device from the first terminal device through its connection with the first terminal device.

[0007] Based on the first information, the second terminal device generates a first control method for controlling the first smart device using the system capabilities of the second terminal device.

[0008] The second terminal device responds to the user's operation using the first control method and controls the first smart device.

[0009] Based on the above technical solution, the second terminal device obtains first information associated with controlling the first smart device from the first terminal device, generates a first control method based on the first information, and controls the first smart device in response to the user adopting the first control method. This enables lightweight terminal devices to control smart devices even when resources are limited and no application for controlling smart devices is installed. Thus, in scenarios where it is inconvenient to control smart devices through smart device management apps or whole-house smart hub devices, smart devices can be controlled through lightweight terminal devices (such as wearable devices like watches, bracelets, rings, glasses, and speakers), improving the convenience of smart device control and user experience.

[0010] In one possible implementation, before the second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device, the method may further include: the first terminal device sending the first information to the second terminal device based on a near-field communication method with the second terminal device.

[0011] In one possible implementation, before the second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device, the method may further include: the first terminal device presenting a sharing interface for sharing the first information.

[0012] In one possible implementation, the first terminal device presenting the sharing interface may include:

[0013] The first terminal device presents a sharing interface based on near-field communication with the aforementioned second terminal device. The operation used to trigger the near-field communication method can be, for example, a user-initiated tap or proximity operation.

[0014] In one possible implementation, the second terminal device generates a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device, which may include:

[0015] Based on the first information, the second terminal device displays controls for controlling the first smart device using the system capabilities of the second terminal device.

[0016] Accordingly, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0017] The second terminal device responds to the user's operation controls and controls the first smart device.

[0018] In one possible implementation, the second terminal device generates a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device, which may include:

[0019] Based on the first information, the second terminal device generates a voice control method using the system capabilities of the second terminal device.

[0020] Accordingly, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0021] The second terminal device responds to the user's voice commands that match the voice control method, and controls the first smart device.

[0022] In one possible implementation, before the second terminal device controls the first smart device in response to the user issuing a voice that matches the voice control method, the method may further include:

[0023] The second terminal device or the first terminal device displays prompts related to the voice control method.

[0024] In one possible implementation, the second terminal device generates a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device, which may include:

[0025] The second terminal device generates an action control method based on the first information and by utilizing the system capabilities of the second terminal device.

[0026] The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0027] The second terminal device responds to the user's action that matches the action control method and controls the first smart device.

[0028] In one possible implementation, before the second terminal device controls the first smart device in response to the user making an action matching the action control method, the method may further include:

[0029] The second terminal device or the first terminal device displays prompts related to the action control method.

[0030] In one possible implementation, the first terminal device presenting the sharing interface may include:

[0031] The first terminal device presents a sharing interface based on the user's operation of the options in the interface of the second terminal device, and the options correspond to those of the first terminal device.

[0032] In one possible implementation, the above method may further include:

[0033] Based on the first information, the second terminal device generates a second control method for controlling the first smart device using the system capabilities of the second terminal device.

[0034] The second terminal device controls the first smart device in response to an operation performed by the user using the second control method.

[0035] In one possible implementation, the first terminal device can also be used to control a second smart device or be the second smart device, wherein the second terminal device does not have an application installed for controlling the second smart device; the method may further include:

[0036] The second terminal device, through its connection with the first terminal device, obtains second information associated with controlling the second intelligent device from the first terminal device.

[0037] The aforementioned second terminal device generates a third control method for controlling the second intelligent device based on the second information and utilizing the system capabilities of the second terminal device;

[0038] The aforementioned second terminal device responds to the user's operation using the third control method and controls the second smart device.

[0039] In one possible implementation, the above-mentioned intelligent device control system may further include a third terminal device, which does not have an application installed for controlling the first intelligent device, and is connected to the first terminal device.

[0040] After the first terminal device displays the sharing interface, the method may further include:

[0041] In response to the user's operation on the sharing interface, the first terminal device presents a first option corresponding to the second terminal device and a second option corresponding to the third terminal device.

[0042] In response to the user's operation on the first option, the first terminal device sends the first information to the second terminal device.

[0043] In response to the user's operation on the second option, the aforementioned first terminal device sends third information to the third terminal device, and the third information is associated with controlling the first smart device;

[0044] The third terminal device receives third information through its connection with the first terminal device mentioned above;

[0045] Based on the third information, the third terminal device uses its system capabilities to generate a fourth control method for controlling the aforementioned first intelligent device.

[0046] The third terminal device can control the first smart device in response to an operation performed by the user using the fourth control method.

[0047] In one possible implementation, before the first terminal device presents the sharing interface, the method may further include: the first smart device reporting capability information to the first terminal device, the capability information being used to provide first information.

[0048] In one possible implementation, before the second terminal device can obtain the first information associated with controlling the first smart device from the first terminal device via a connection with the first terminal device, it may further include:

[0049] The first terminal device obtains the type or identifier of the second terminal device;

[0050] The first terminal device determines, based on the type or identifier of the second terminal device, one of the control method, voice control method, or action control method as the aforementioned first control method.

[0051] In one possible implementation, the connection between the first terminal device and the second terminal device can be a near-field connection or a network connection. For example, a near-field connection can be a Near Field Communication (NFC) connection, a Bluetooth connection, or a satellite connection.

[0052] In one possible implementation, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0053] The second terminal device responds to the user's operation using the first control method by sending the identifier and control commands of the first smart device to control the first smart device.

[0054] Secondly, embodiments of this application provide a method for controlling a smart device, which can be applied to a second terminal device in the aforementioned smart device control system. The second terminal device can be connected to the aforementioned first terminal device. The first terminal device can be used to control the first smart device or is the first smart device itself. The second terminal device does not have the application for controlling the first smart device installed. The method may include:

[0055] The second terminal device obtains first information associated with controlling the first intelligent device from the first terminal device through its connection with the first terminal device.

[0056] Based on the first information, the second terminal device generates a first control method for controlling the first smart device using the system capabilities of the second terminal device.

[0057] The second terminal device responds to the user's operation using the first control method and controls the first smart device.

[0058] Based on the above technical solution, the second terminal device obtains first information associated with controlling the first smart device from the first terminal device, and generates a first control method based on the first information. By responding to the user's use of the first control method to control the first smart device, lightweight terminal devices (such as wearable devices like watches, bracelets, rings, glasses, and speakers) can control smart devices even without installing a smart device management APP. Thus, in scenarios where it is inconvenient to control smart devices through a smart device management APP or a whole-house smart hub, smart devices can be controlled through lightweight terminal devices, improving the convenience of smart device control and user experience.

[0059] In one possible implementation, the second terminal device generates a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device, which may include:

[0060] Based on the first information, the second terminal device displays controls for controlling the first smart device using the system capabilities of the second terminal device.

[0061] Accordingly, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0062] The second terminal device responds to the user's operation controls and controls the first smart device.

[0063] In one possible implementation, the second terminal device generates a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device, which may include:

[0064] Based on the first information, the second terminal device generates a voice control method using the system capabilities of the second terminal device.

[0065] Accordingly, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0066] The second terminal device responds to the user's voice commands that match the voice control method, and controls the first smart device.

[0067] In one possible implementation, before the second terminal device controls the first smart device in response to the user issuing a voice that matches the voice control method, the method may further include:

[0068] The second terminal device displays prompts related to the voice control method.

[0069] In one possible implementation, the second terminal device generates a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device, which may include:

[0070] The second terminal device generates an action control method based on the first information and by utilizing the system capabilities of the second terminal device.

[0071] Accordingly, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0072] The second terminal device responds to the user's action that matches the action control method and controls the first smart device.

[0073] In one possible implementation, before the second terminal device controls the first smart device in response to the user making an action matching the action control method, it may further include:

[0074] The second terminal device displays prompts related to the action control method.

[0075] In one possible implementation, the above method may further include: the second terminal device generating a second control method based on the first information and utilizing the system capabilities of the second terminal device;

[0076] The second terminal device responds to the user's operation using the second control method and controls the aforementioned first smart device.

[0077] In one possible implementation, the above method may further include:

[0078] The aforementioned second terminal device obtains second information associated with controlling the second intelligent device from the first terminal device through its connection with the first terminal device;

[0079] The aforementioned second terminal device generates a third control method for controlling the second intelligent device based on the second information and utilizing the system capabilities of the second terminal device;

[0080] The aforementioned second terminal device responds to the user's operation using the third control method and controls the second smart device.

[0081] In one possible implementation, the connection described above can be established via the second terminal device in response to a user's tap or proximity to the first terminal device;

[0082] Accordingly, the second terminal device, through its connection with the first terminal device, obtains first information associated with controlling the first intelligent device from the first terminal device, which may include:

[0083] In response to the tap or proximity operation of the first terminal device, the second terminal device obtains the first information from the first terminal device through a connection.

[0084] In one possible implementation, the second terminal device, through its connection with the first terminal device, obtains first information associated with controlling the first smart device from the first terminal device, which may include:

[0085] The second terminal device responds to the user's operation and displays the options corresponding to the first terminal device;

[0086] The second terminal device responds to the user's operation on the option and obtains the first information from the first terminal device through the connection with the first terminal device.

[0087] In one possible implementation, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0088] The second terminal device responds to the user's operation using the first control method by sending the identifier and control commands of the first smart device to control the first smart device.

[0089] In one possible implementation, the connection between the first terminal device and the second terminal device can be a near-field connection or a network connection. For example, a near-field connection could be an NFC connection, a Bluetooth connection, or a satellite connection.

[0090] Thirdly, embodiments of this application provide a terminal device. The terminal device may include one or more processors and a memory, the one or more processors being coupled to the memory. The memory can be used to store computer program code, the computer program code including computer instructions. When the one or more processors execute the computer instructions, the terminal device can perform the methods provided in any of the first to second aspects described above.

[0091] Fourthly, embodiments of this application provide a chip. The chip may include a processor and a communication interface. The processor can invoke computer programs or instructions through the communication interface to execute the methods provided in any one of the first to second aspects described above.

[0092] In conjunction with the fourth aspect, as one possible implementation, the chip may also include a memory containing computer programs or instructions, and be connected to a processor via a communication interface. The processor may use the communication interface to call and execute the computer programs or instructions stored in the memory, and perform the methods provided in any one of the first to second aspects above.

[0093] Fifthly, embodiments of this application provide a computer program product. When the computer program product is run on a computer, the computer can execute the methods provided in any one of the first to second aspects described above.

[0094] In a sixth aspect, embodiments of this application provide a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is run on a computer, the computer can perform the method described in any one of the first to second aspects described above. Attached Figure Description

[0095] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0096] Figure 1 is a schematic diagram of a system architecture provided in an embodiment of this application;

[0097] Figure 2a is a schematic diagram of a smart device management APP provided in an embodiment of this application;

[0098] Figure 2b is a schematic diagram of one interface of the APP shown in Figure 2a;

[0099] Figure 3 is a schematic diagram of another system architecture provided in an embodiment of this application;

[0100] Figure 4a is a schematic diagram of a whole-house smart device system provided in an embodiment of this application;

[0101] Figure 4b is an example of the user interface of the central control screen of the whole-house smart hub device provided in the embodiments of this application;

[0102] Figure 5 is an example of a second terminal device acquiring information according to an embodiment of this application;

[0103] Figure 6a is an example of a control method generated by the second terminal device according to an embodiment of this application;

[0104] Figure 6b is an example of a second terminal device controlling a smart device according to an embodiment of this application;

[0105] Figure 6c shows another example of a second terminal device controlling a smart device according to an embodiment of this application;

[0106] Figure 6d is a flowchart example of a second terminal device controlling a smart device provided in an embodiment of this application;

[0107] Figure 7a is a prompt example of a second terminal device provided in an embodiment of this application;

[0108] Figure 7b shows another example of a second terminal device controlling a smart device according to an embodiment of this application;

[0109] Figure 7c shows another example of a second terminal device controlling a smart device according to an embodiment of this application;

[0110] Figure 8a shows another example of a second terminal device controlling a smart device according to an embodiment of this application;

[0111] Figure 8b shows another example of a second terminal device controlling a smart device according to an embodiment of this application;

[0112] Figure 9a shows another example of a second terminal device acquiring information according to an embodiment of this application;

[0113] Figure 9b is a prompt example of a first terminal device provided in an embodiment of this application;

[0114] Figure 9c shows another example of a second terminal device controlling a smart device according to an embodiment of this application;

[0115] Figure 9d shows another example of a second terminal device controlling a smart device according to an embodiment of this application;

[0116] Figure 10a is another example of a prompt for the second terminal device provided in an embodiment of this application;

[0117] Figure 10b is another example of a prompt for the second terminal device provided in an embodiment of this application;

[0118] Figure 10c shows another example of a second terminal device controlling a smart device according to an embodiment of this application;

[0119] Figure 10d shows another example of a second terminal device controlling a smart device according to an embodiment of this application;

[0120] Figure 11a is another example of a prompt for the first terminal device provided in an embodiment of this application;

[0121] Figure 11b shows another example of a second terminal device controlling a smart device according to an embodiment of this application;

[0122] Figure 11c shows another example of a second terminal device controlling a smart device according to an embodiment of this application;

[0123] Figure 12a is a partial schematic diagram of another whole-house smart device system provided in an embodiment of this application;

[0124] Figure 12b shows an interface and operation example of the second terminal device provided in the embodiment of this application during the information acquisition process;

[0125] Figure 12c shows another interface and operation example of the second terminal device in the information acquisition process provided in the embodiment of this application;

[0126] Figure 12d is an example of a control method for the control generated by the second terminal device provided in an embodiment of this application;

[0127] Figure 13a is a schematic diagram of another whole-house smart device system provided in an embodiment of this application;

[0128] Figure 13b is an example of a second terminal device generation control method provided in an embodiment of this application;

[0129] Figure 13c shows another example of the second terminal device generation control method provided in the embodiments of this application.

[0130] Figures 14a and 14b are examples of a first terminal device presented in this application embodiment displaying a sharing interface through a smart device management APP;

[0131] Figures 14c and 14d show an interface and operation example of a first terminal device sharing and controlling information associated with a smart device through a smart device management APP provided in the embodiments of this application.

[0132] Figures 14e and 14f show another interface and operation example of the first terminal device in the embodiments of this application sharing and controlling information associated with the smart device through the smart device management APP;

[0133] Figure 15a is a schematic diagram of a process for a first terminal device to share and control information associated with a smart device according to an embodiment of this application;

[0134] Figure 15b is another schematic diagram of the process by which a first terminal device shares and controls information associated with a smart device, as provided in an embodiment of this application.

[0135] Figures 16a and 16b are examples of a first terminal device presenting a sharing interface through system capabilities according to an embodiment of this application.

[0136] Figure 16c is an example of a first terminal device sharing and controlling information associated with a smart device through system capabilities, as provided in an embodiment of this application.

[0137] Figure 17a is an example of the technical effect of the method for controlling a smart device provided in an embodiment of this application;

[0138] Figure 17b is a schematic diagram of a process that can be applied to the example shown in Figure 17a to control a smart device, according to an embodiment of this application.

[0139] Figure 18 is a schematic diagram of a method for controlling a smart device according to an embodiment of this application;

[0140] Figure 19a shows another example of a first terminal device presenting a sharing interface according to an embodiment of this application;

[0141] Figure 19b shows another example of the control method for the second terminal device provided in the embodiments of this application.

[0142] Figure 19c shows another example of a prompt displayed by the first terminal device according to an embodiment of this application;

[0143] Figure 19d is another example of a prompt displayed by the first terminal device provided in the embodiments of this application;

[0144] Figure 20 is a schematic diagram of a method for controlling a smart device provided in an embodiment of this application;

[0145] Figure 21 is a schematic diagram of another method for controlling a smart device provided in an embodiment of this application;

[0146] Figure 22 is a schematic diagram of a terminal device provided in an embodiment of this application. Detailed Implementation

[0147] To better understand the technical solution of this application, the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0148] Smart devices can not only have the basic functions of traditional devices (such as home devices, medical devices, industrial devices, agricultural devices, etc.), but also have communication functions.

[0149] The communication functions of smart devices can be wireless or wired communication functions. For example, wireless communication functions can be short-range wireless communication functions such as Wireless Fidelity (WiFi), NFC, Bluetooth (BT), Near Link, ZigBee, infrared, Z-Wave, and Ultra Wide Band (UWB), and / or long-range wireless communication functions such as Narrowband Internet of Things (NB-IoT), LoRa (long-range wireless communication), Second-Generation Mobile Communication Technology (2G), Third-Generation Mobile Communication Technology (3G), Fourth-Generation Mobile Communication Technology (4G), and Fifth-Generation Mobile Communication Technology (5G). For example, wired communication functions can include Ethernet communication (ETH), full-duplex communication (Recommended Standard 232, RS-232), half-duplex communication (Recommended Standard 485, RS-485), Meter Bus (M-Bus), Power Line Communication (PLC), and other communication functions.

[0150] As shown in Figure 1, smart device 1 can connect to a second server s1 via a smart device 1 management app and be controlled by the app. Specifically, the smart device 1 management app can respond to user operations by instructing the second server s1 to obtain data from smart device 1, such as its model and status, and bind it to smart device 1. For example, the smart device 1 management app can respond to user operations by sending control commands to the second server s1. After receiving the control commands, the second server s1 can issue control commands to smart device 1. Smart device 1 can respond to the control commands by performing corresponding operations (such as turning on, off, adjusting parameters, etc.) and reporting its status and other information after the operations to the second server s1. The second server s1 can transmit the information reported by smart device 1 to the smart device 1 management app, and the user can obtain the control results of the smart device through the information received by the smart device 1 management app. This method of controlling smart devices through a server can be called a remote control method.

[0151] Similarly, smart device 2 can connect to the second server s2 via the smart device 2 management app and be controlled by the smart device 2 management app. Smart device n can connect to the second server sn via the smart device n management app and be controlled by the smart device n management app.

[0152] In some embodiments, the functions of one or more of the following apps—Smart Device 1 Management App, Smart Device 2 Management App, ..., Smart Device n Management App—can be integrated into a single Smart Device Management App, which serves as the unified control entry point for Smart Device 1, Smart Device 2, ..., Smart Device n. In other words, the Smart Device Management App can respond to user operations and control one or more of the following smart devices: Smart Device 1, Smart Device 2, ..., Smart Device n. Unlike the control provided by the Smart Device 1 Management App, Smart Device 2 Management App, ..., Smart Device n Management App, the server-side of the Smart Device Management App, i.e., the first server, needs to interface with a second server to obtain data or information from the corresponding smart devices and to send control commands to the corresponding smart devices through the second server.

[0153] For example, the smart device management app can be downloaded from an app store server and installed on a first type of device (an example of a first terminal device). For example, the first type of device can be a smartphone, a personal digital assistant (PDA), an in-vehicle computer, a vehicle infotainment system, a portable computer (such as a tablet, foldable computer, laptop, etc.), or a desktop computer, among other terminal devices (multiple examples of the first terminal device). For example, the smart device management app can be... Apps, Huawei's Smart Life App, and so on.

[0154] As shown in Figure 2a, the smartphone has Huawei's Smart Life APP installed. When the user clicks the Smart Life APP icon, the smartphone responds to the operation, runs the Smart Life APP, and displays the interface shown in Figure 2b for the user to operate.

[0155] For example, any one of the second servers s1, s2, ..., sn can provide services to more than one smart device. For example, the first server can also provide services to more than one first-type device. For example, the first server can also provide services to second-type devices that do not have a smart device management app installed. For example, the second-type device can be a lightweight terminal device such as a speaker, a wearable device such as a watch, bracelet, ring, or glasses, etc. For example, in addition to providing services for the smart device management app, the first server can also provide services to first-type devices, such as providing download and installation services for the smart device management app, etc.

[0156] For example, the first server and the second server s1, s2, ..., sn can be physical servers or virtual servers. For example, a virtual server can be a virtual machine created on multiple physical servers. For ease of description, the first server and the second server s1, s2, ..., sn will no longer be distinguished in the following illustrations, and will be uniformly referred to as servers.

[0157] In some embodiments, when the first terminal device with the smart device management app installed is close to the smart device (e.g., within a range of tens of meters), the control commands sent by the smart device management app to the smart device can bypass the server. For example, they can be sent directly to the smart device via a Bluetooth or WiFi-based socket, User Datagram Protocol (UDP), or Transmission Control Protocol (TCP) connection. Data from the smart device can be directly reported to the smart device management app without going through a server. This control method, known as local control, is more efficient and saves network resources compared to remote control.

[0158] In some embodiments, smart devices within the same geographical area can be connected to a local area network (LAN). For example, the same geographical area can be a family residence (such as a household in a residential area, or a villa), an office, a company, a workshop, a factory, etc. For example, the LAN can be a wired LAN or a wireless LAN. The LAN topology can be bus, star, ring, tree, hybrid, etc. The LAN networking method can be point-to-point networking, network-wide mapping, networking using routers and hubs, etc.

[0159] In some embodiments, smart devices within the same geographical area can be bound to a control terminal via a smart device management app, allowing control of the smart devices via remote or local control. As shown in Figure 3, the smart device management app can perform local or remote control of smart devices 1, 2, 3, ... m within the same local area network.

[0160] In some embodiments, the control functions of all smart devices within the same local area network (LAN) can be centralized in a central device (another example of the first terminal device). The central device can be a terminal device (another example of the first terminal device) with an edge cloud central service process installed. As shown in Figure 3, smart device 1, smart device 2, smart device 3, ... smart device m can be connected to the same LAN and managed and controlled by the central device connected to that LAN. Exemplarily, the central device can have local server functionality, data storage, and analysis capabilities. The various functions of the central device can be integrated into one or more components.

[0161] In some embodiments, the central device may include a control host, a network access device, and a user interaction device. For example, the network access device may be a gateway, a router, etc. The user interaction device may include a display component with display functionality and a user operation component. The user operation component provides a control interface for the user.

[0162] In some embodiments, the display component may be a monitor. For example, the monitor may be a smart TV (such as Huawei's Smart Screen), a monitor for a portable computer, a desktop computer, etc., and so on. Correspondingly, the user operation component may be a remote control for a smart TV, a keyboard or mouse for a portable computer, a desktop computer, etc., or an audio receiving component such as a microphone, etc. The display component, the user operation component, and the control host may be connected via wired connection, wireless connection, or a combination of wired and wireless connection. For example, the display component and the control host may be connected via wired connection, and the user operation component and the control host may be connected via wireless connection, etc., depending on the specific needs.

[0163] In some embodiments, the display component and the user operation component may be integrated into a single component. For example, the user interaction device may be a touchscreen, such as a smartphone, tablet, personal digital assistant, Huawei's central control screen, etc. The control host in the central device acts as the brain of the whole-house smart devices, and is equipped with an edge cloud central service process. It can receive operation information from the user operation component, respond to user operations, manage and control the smart devices, and interact with the server of the smart device service platform (such as a second server), etc. The display component is used to display information such as management and control results.

[0164] Understandably, the functionality of a central device relies on the collaboration between hardware and software. The software can be the central device's operating system, the user interface of its display components and / or user operation components, or a presentation of some of the operating system's functions.

[0165] Taking smart home devices as an example, as shown in Figure 4a, the central device of a smart home local area network (LAN) may include a central control screen and a control host, which manage and control the smart devices in the LAN, such as security equipment, audio-visual equipment, home appliances, lighting equipment, sunshade equipment, and heating, cooling, and ventilation equipment. For example, the central control screen and control host can be connected wirelessly or wired. For example, security equipment may be smart door locks, smart windows, cameras, etc. Audio-visual equipment may be televisions, music players, speakers and / or gateways, projectors, microphones, etc. Home appliances may be washing machines, robot vacuums, water heaters, refrigerators, microwave ovens, rice cookers, ovens, range hoods, dishwashers, etc. Lighting equipment may be main lights, auxiliary lights (such as ambient lights, decorative lights, etc.). Sunshade equipment may be smart curtains, smart sunshade curtains, etc. Heating, cooling, and ventilation equipment may be air conditioners, electric heaters, fresh air systems, humidifiers, air purifiers, etc.

[0166] For example, the user interface of the central control screen is shown in Figure 4b. It can display operation buttons for user operation, such as "switch", "one-click movie", "all lights on", "all lights off", "curtains open", "curtains close", etc. It can also display processing results, such as "Y group lights on", etc.

[0167] In some embodiments, a smart device may install a Software Development Kit (SDK) integrating cross-device communication capabilities, such as the distributed soft bus in the HarmonyOS operating system, to form a distributed network with surrounding smart devices that also possess cross-device communication capabilities. All smart devices in this distributed network can be considered as a single device, possessing the functionality of all smart devices within the network. For ease of description, the SDK integrating cross-device communication capabilities will be referred to as the soft bus below. It is understood that the cross-device communication capabilities of the soft bus are based on the underlying communication functions of the smart device, such as Bluetooth, WiFi, Ethernet, infrared, PLC, NFC, Zigbee, and UWB.

[0168] For example, when the central device and the terminal device with the smart device management APP are equipped with a soft bus, the central device and the smart device management APP can discover, connect to and control the smart device through the soft bus.

[0169] When the aforementioned smart device management APP or central device controls a smart device, it first needs to bind the smart device. Secondly, when responding to the user's operation and controlling the bound smart device, it assembles control commands according to the device control protocol, which consumes a large amount of software and hardware resources. This means that the terminal device needs to have certain software and hardware resources to become the control end of the smart device and control the smart device. Wearable devices, speakers, and other lightweight second-type devices (examples of second-terminal devices) have limited software and hardware resources and do not have a smart device management APP (such as a smart life APP) installed, so they do not have the possibility of acting as the control end of the smart device to control the smart device.

[0170] However, in the field of whole-house smart home applications, the rapid development of smart devices has led to a continuous increase in the number of smart devices in users' homes. Many of these smart devices have limited resources, making it impossible to store large amounts of device data or create complex UIs. Their interactive screens are small, and their entry points are singular. Furthermore, these resource-limited second-type devices are designed for easy portability, such as wearable devices like smartwatches, bracelets, rings, and glasses.

[0171] Therefore, embodiments of this application provide a method for controlling a smart device. This method is applied to a second terminal device, which obtains information from a first terminal device, generates a shortcut for controlling the smart device based on that information, and controls the smart device based on the user's operation of the shortcut. Exemplarily, the first terminal device can be the first type of device described above, the central device described above, or the smart device described above. Exemplarily, the second terminal device can be the second type of device described above.

[0172] In this embodiment, the second terminal device can generate shortcuts based on the acquired information and control the smart device based on the user's operation of the shortcuts. This makes it easier to control the smart device in certain scenarios and improves the user experience. For example, when a user cannot find the remote control for a certain smart device (such as a smart TV, air conditioner, or light fixture) at home, they can quickly control the smart device through a shortcut temporarily or pre-generated by the second terminal device. Alternatively, for example, when it is inconvenient for a user to control the smart device through a smart device management app, mobile phone, or central device, such as when the user is driving, they can quickly control the smart device through shortcuts on the second terminal device, improving the user experience.

[0173] In this article, a shortcut is a control entry point provided to users for quickly controlling smart devices.

[0174] For example, this information may include the identifier of the smart device, the command used to control the smart device, and the command name. This information is small in size, facilitates rapid transmission, and the resulting convenient method of controlling the smart device saves time, responds quickly, and helps improve the user experience.

[0175] For example, this information may look like this:

[0176] Alternatively, the configuration information can be as follows:

[0177] Alternatively, the configuration information can be as follows:

[0178] In this context, "dev_id":"xxx" indicates that the smart device identifier is "xxx", "name":"Turn on TV" and "name":"Play XX" indicate that the command names are "Turn on TV" and "Play XX" respectively, and "cmd":"command" indicates that the command used to control the smart device is "command". Here, "command" can be a string with control functions or a pre-designed short command identifier.

[0179] For example, the second terminal device and the first terminal device can transmit the above information in the form of files (such as config.json, quick_operation.json, etc.), strings, binary, etc.

[0180] For example, a second terminal device can, under the user's operation, obtain information from the first terminal device by touching or approaching it, and generate a shortcut based on that information. Subsequently, the second terminal device can control the smart device based on the user's operation of the shortcut. In some embodiments, the process of the second terminal device obtaining information from the first terminal device and generating a shortcut based on that information may be invisible.

[0181] For example, when the second terminal device has a touchscreen, the shortcut generated by the second terminal device based on the obtained information can be a control button displayed on the touchscreen. The name of the control button can be a command name, such as "Open XX", "Close XX", etc.

[0182] For example, when a user cannot find the remote control for a smart device (such as a smart TV, air conditioner, or light fixture) at home, a second terminal device can, under the user's operation, obtain information from the smart device by touching or approaching it, and generate a shortcut for controlling the smart device based on that information. Then, the second terminal device can control the smart device based on the user's actions using that shortcut. The process of the second terminal device obtaining information from the smart device and generating the shortcut based on that information can be invisible.

[0183] As shown in Figure 5, when a user taps or brings their wristwatch close to the smart TV, the watch responds by displaying a shortcut on its interface. As shown in Figure 6a, the watch interface displays control buttons such as "Turn on TV" and "Turn off TV." When the user taps the "Turn on TV" button, as shown in Figure 6b, the watch responds to the user's action and turns the smart TV on. When the user taps the "Turn off TV" button, as shown in Figure 6c, the watch responds to the user's action and turns the smart TV off.

[0184] In the above embodiment, the process of the second terminal device (watch) controlling the smart device (television) is shown in Figure 6d. The second terminal device identifies the operation based on the user's shortcut and discovers and connects to the central device via the soft bus. Then, the second terminal device sends a device identifier and control command to the central device based on the user's operation. The central device parses the information sent by the second terminal device to obtain the device identifier and control command. Based on the device identifier, the central device determines that the control object of the control command is a specific smart device (such as a television) and sends the control command to that smart device. The smart device executes the control command, and the second terminal device controls the smart device.

[0185] For example, before the watch displays shortcuts (such as control buttons) on the interface, it may also include: receiving information sent by the smart TV, and generating shortcuts based on that information.

[0186] For example, the shortcut generated by the second terminal device can also be a voice shortcut.

[0187] Referring back to Figure 5, when a user touches or brings their wristwatch close to the smart TV, the watch responds to the user's action and displays a shortcut prompt on the interface. As shown in Figure 7a, the watch interface displays prompts such as "Please say 'Turn on TV' to turn on the TV" and / or "Please say 'Turn off TV' to turn off the TV." When the user says "Turn on TV," as shown in Figure 7b, the watch responds to the user's voice command and turns on the smart TV. When the user says "Turn off TV," as shown in Figure 7c, the watch responds to the user's voice command and turns off the smart TV.

[0188] For example, before the watch displays a shortcut prompt on the interface, it may also include: receiving information sent by the smart TV, and generating a shortcut based on that information.

[0189] The watch in the above embodiments can be replaced by a bracelet, and the way it controls the first smart device can be the same as the watch in the above embodiments.

[0190] In some embodiments, a user can tap the smart glasses against a smart TV, or bring the smart glasses close to the smart TV. The smart glasses can respond to the user's action, receive information sent by the smart TV, and generate interface controls or voice shortcuts based on that information. The user can then control the smart TV to turn on by operating the interface controls displayed on the smart glasses or by saying "Turn on the TV." For example, when the user says "Turn off the TV," the smart glasses can respond to the user's voice command and turn off the smart TV.

[0191] For example, when a user touches or brings the smart glasses close to the smart TV, the smart glasses or smart TV can respond to the user's action and display prompts on the screen. For example, the smart TV screen may display prompts such as "Please say 'Turn on the TV' to the smart glasses to turn on the TV" and / or "Please say 'Turn off the TV' to the smart glasses to turn off the TV." For example, the prompts provided by the smart TV may also be in the form of voice, visual + text prompts, etc.

[0192] As shown in Figure 9a, when a user touches or brings the ring on their finger near the smart TV, the ring responds to the user's action, retrieves information from the smart TV, and generates a voice shortcut based on that information. When the user says "Turn on the TV," as shown in Figure 9c, the ring responds to the user's voice command and turns the smart TV on. When the user says "Turn off the TV," as shown in Figure 9d, the ring responds to the user's voice command and turns the smart TV off.

[0193] For example, further, when a user touches or brings a ring on their finger near a smart TV, the smart TV can respond to the user's action and display a prompt message on its screen. As shown in Figure 9b, the smart TV screen displays prompt messages such as "Please say 'Turn on the TV' to the ring to turn on the TV" and / or "Please say 'Turn off the TV' to the ring to turn off the TV." For example, the prompt message provided by the smart TV can also be in the form of voice, visual + text prompts, etc.

[0194] For example, the shortcut generated by the second terminal device can also be an action shortcut.

[0195] As shown in Figure 5, when a user touches or brings their wristwatch close to the smart TV, the watch responds to the user's action and displays a prompt message for the action shortcut on the interface. As shown in Figure 10a, this displays an image of the wrist being raised and then swiped down, along with the text prompt "Turn the TV on / off." Alternatively, as shown in Figure 10b, the watch interface displays the text message "Please raise your wrist and then swipe down to turn the TV on / off." For example, "raise your wrist and then swipe down" can also be replaced with other actions such as "shaking your wrist." The prompt message can also take other forms, which are not limited here.

[0196] When the user raises their wrist and swipes down, as shown in Figure 10c, the watch responds to the user's action and turns the TV on. When the user wants to turn off the TV, they raise their wrist and swipe down, as shown in Figure 10d, and the watch responds to the user's action and turns the TV off.

[0197] For example, before displaying the prompt information for the action shortcut, the watch may further include: obtaining information from a smart TV, and generating the action shortcut based on that information.

[0198] As shown in Figure 9a, when a user touches or brings a ring on their finger near the smart TV, the smart TV responds to the user's action and displays a prompt message for the action shortcut on the screen. As shown in Figure 11a, the TV screen displays an image of the ring-wearing finger waving, along with text such as "Turn the TV on / off." Alternatively, the TV screen displays the text "Please shake your finger to turn the TV on / off." For example, "shaking your finger" can also be replaced by other actions such as "moving your finger down" or "your finger wants to move." The prompt message can also take other forms; there are no limitations on this.

[0199] When the user shakes the finger wearing the ring, as shown in Figure 11b, the ring responds to the user's action and controls the smart TV to turn on. When the user wants to turn off the TV, shaking the finger, as shown in Figure 11c, the ring responds to the user's action and controls the smart TV to turn off.

[0200] For example, when the second terminal device (which could also be a user) is close to the central device, the second terminal device can also obtain information based on the user's tapping or approaching of the central device (such as a router). For example, when the second terminal device (which could also be a user) is close to a terminal device capable of installing a smart device management app (such as a smartphone, tablet, etc.), or based on the user's tapping or approaching of a terminal device capable of installing a smart device management app, information is obtained, and a shortcut is generated based on that information. In both examples, the principle of the second terminal device obtaining information, generating a shortcut, and using the shortcut to control the smart device is the same as in the above embodiments.

[0201] In the above embodiments, the second terminal device obtains information based on the user's tapping or approaching operation of the first terminal device, generates a shortcut based on the information, and controls the smart device based on the user's operation of the shortcut. This allows the user to select the nearest tapping or approaching operation object from among the smart device, the central device, and terminal devices with the ability to install a smart device management APP, thereby improving the user's convenience experience.

[0202] For example, if a user cannot find the remote control for a smart device and is near a router, they can tap or bring a second terminal device close to the router. The second terminal device will then generate any of the shortcuts described above based on this action. Alternatively, if a user cannot find the remote control for a smart device and a family member is using a smartphone nearby, the user can tap or bring a second terminal device close to the smartphone. The second terminal device can then generate any of the shortcuts provided in the above embodiments based on the user's tapping or bringing the smartphone close. And so on.

[0203] For example, before the second terminal device generates the shortcut, it may further display the progress of information transmission, display information transmission prompts, such as "Information being received..." or "Information has been received x%", etc.

[0204] For example, before the second terminal device generates the shortcut, it can further display the progress of shortcut generation, such as displaying "Shortcut generating..." or "Generating shortcut," etc. on the second terminal device interface. Alternatively, it can display "Shortcut generated y%" or a prompt indicating that the shortcut is being generated, etc.

[0205] For example, in the above-mentioned method where the second terminal device obtains information for generating a shortcut by tapping or approaching the first terminal device, the second terminal device and the first terminal device can interact based on NFC or on short-range wireless communication methods such as Bluetooth.

[0206] For example, the second terminal device can also obtain information for generating shortcuts from the first terminal device via a soft bus based on the user's operation.

[0207] For example, the second terminal device and the first terminal device are located in the same home area network, and both the second terminal device and the first terminal device are equipped with a soft bus. For instance, when a user clicks the soft bus icon on the interface of the second terminal device, the second terminal device can respond to the user's operation, retrieve information from the first terminal device, and generate a shortcut based on that information. Alternatively, the second terminal device can display a HyperTerminal interface, which can display an icon corresponding to the first terminal device that can share the information. The user can click the icon to select the corresponding first terminal device to share the information. For details on how the second terminal device generates a shortcut based on the information and how the user operates on the shortcut, please refer to the description in the above embodiments.

[0208] As shown in Figure 12a, the wearable device (such as a watch) and the living room TV are located on the same home LAN, and both the watch and the TV are connected via a soft bus. When the user clicks the "Discover Shortcuts" icon on the watch's interface, as shown in Figure 12b, the watch can display the device installed to send information for generating shortcuts, based on the user's operation. When the user needs to turn on the TV, as shown in Figure 12c, they can click on the living room TV icon on the watch's interface. Based on the user's operation, the watch's interface first displays that the living room TV sent information to the watch, and then displays the control buttons generated based on that information. The step of displaying the living room TV sending information to the watch can be omitted; as shown in Figure 12d, the watch can simply display the control buttons on the interface based on the user's operation. For example, the shortcut generated by the watch based on the information can also be a voice shortcut, an action shortcut, etc., as detailed in the above embodiments. For example, the principle by which the watch controls the TV based on the user's operation is the same as in the above embodiments.

[0209] As shown in Figure 13a, the air conditioner has pre-installed information 'a' for generating shortcuts to control it, and the light fixture has pre-installed information 'b' for generating shortcuts to control it. When the air conditioner and light fixture are bound to the local area network (LAN) based on user actions, the air conditioner reports its capability A to the central device, which can carry information 'a'; the light fixture reports its capability B to the central device, which can carry information 'b'. Information 'a' can be used to generate shortcuts to control the air conditioner, and information 'b' can be used to generate shortcuts to control the light fixture. Afterward, the air conditioner, light fixture, watch, and central device are located on the same home LAN. No soft bus is installed in the air conditioner and light fixture. If the user wants to quickly control the air conditioner and / or light fixture via the watch, information 'a' and / or information 'b' needs to be obtained from the central device based on the user's actions.

[0210] As shown in Figure 13b, when the user clicks on the central device in the watch interface, the watch displays the generated control buttons on the interface according to the user's operation: "Turn on the air conditioner", "Turn off the air conditioner", "Turn on the lights", "Turn off the lights".

[0211] For example, before the watch displays the generated shortcut on the interface, it further includes: obtaining information a and information b from the central device (as shown in Figure 13a), and generating control buttons for controlling the air conditioner based on information a, and generating control buttons for controlling the lights based on information b.

[0212] For example, when a user clicks on the central device in the watch interface, as shown in Figure 13c, before the watch displays the generated control buttons on the interface according to the user's operation, it also includes: displaying a schematic screen showing the central device sending information to the device (watch).

[0213] For example, the shortcuts generated by the watch based on the information for controlling the air conditioner and / or lights can also be voice shortcuts, action shortcuts, etc., as detailed in the above embodiments.

[0214] For example, the watch can also obtain information a and / or information b from the mobile phone ("My Phone" as shown in Figure 13b) via a soft bus, based on the user's operation. The principle is the same as the watch obtaining information a and / or information b from the central device via a soft bus.

[0215] For example, the principle by which the watch controls the air conditioner and / or lights based on the user's operation can be the same as in the above embodiments.

[0216] For example, the second terminal device that controls the air conditioner and / or lighting according to the user's operation can also be a wristband, etc., with the same principle as the above embodiments.

[0217] The technical solution provided in the above embodiments can be used to allow a second terminal device to obtain information in real time based on the user's operation when the user needs to control the smart device, and generate a shortcut for controlling the smart device based on the information, so that the user can quickly control the smart device, which can meet the user's real-time needs and improve the user experience of controlling the smart device.

[0218] For example, the second terminal device can also obtain information in advance and generate shortcuts based on that information, so that the user can quickly control the smart device when needed. The second terminal device obtains information from the first terminal device by having the first terminal device send information to the second terminal device based on the user's actions. In this way, the user can operate the first terminal device when idle, and the second terminal device obtains the information and generates shortcuts, improving the flexibility of shortcut generation by the second terminal device. This helps users to better manage their time and further enhances the user experience of controlling the smart device.

[0219] For example, the first terminal device sends information to the second terminal device based on the user's operation. This can be achieved by the first terminal device sending information to the second terminal device based on the user's operation on the smart device management APP interface.

[0220] Taking the Smart Life app installed on a mobile phone as an example, as shown in Figure 2a, the user can click the Smart Life icon. The Smart Life app will then display the interface shown in Figure 2b. When the user clicks the "Living Room TV" control in the Smart Life app interface, as shown in Figure 14a, the Smart Life app will display the interface shown in Figure 14b. When the user clicks the "Yes" button in the share shortcut section, the Smart Life app can, as shown in Figure 15a or Figure 15b, query the server for soft bus devices, receive the query results from the server, and display the results. As shown in Figure 14c or Figure 14e, the Smart Life app interface displays query results such as watches, bracelets, rings, and speakers.

[0221] When the user taps the watch icon in the interface shown in Figure 14c, the Smart Life APP displays the interface shown in Figure 14d. When the user taps the "Confirm" button in the interface shown in Figure 14d, or taps the watch button shown in Figure 14e, the Smart Life APP sends information to the watch. Based on the user's selection of the sharing recipient, as shown in Figures 15a and 15b, the Smart Life APP selects the watch as the recipient of the information. Then, as shown in Figure 15a, the Smart Device Management APP (Smart Life APP) discovers and connects to the second terminal device (watch) and sends information to it. Alternatively, as shown in Figure 15b, the Smart Device Management APP (Smart Life APP) sends the information to the server, which then forwards it to the second terminal device (watch).

[0222] For example, the smart device management APP can further display the result of information sending or sharing on the interface, as shown in Figure 14f, where the smart life APP interface displays "Sharing complete".

[0223] For example, the first terminal device sending information to the second terminal device in response to the user's operation may be the first terminal device's operating system sending information to the second terminal device in response to the user's operation on the first terminal device's operating system interface.

[0224] Taking a mobile phone as an example, as shown in Figure 16a, the user can click the settings icon on the phone's interface. The phone responds to the user's action by displaying the interface shown in Figure 16b. When the user clicks the "Smart Device Shortcut Sharing" option in the interface shown in Figure 16b, the phone responds to this action, as shown in Figure 15a or Figure 15b, by querying the server for the soft bus device and receiving the query results from the server, and can display the query results. As shown in Figure 16c, the query results displayed on the phone's interface may include second terminal device c1, second terminal device c2, ..., second terminal device cn, etc. When the user clicks on second terminal device c1 in the interface shown in Figure 16c, the phone responds to this action by selecting second terminal device c1 as the recipient or sharing recipient of the information and sending the information to second terminal device c1. As shown in Figure 15a, the first terminal device (phone) discovers and connects to the second terminal device (c1) and sends information to the second terminal device (c1). Alternatively, as shown in Figure 15b, the first terminal device (phone) sends the information to the server, which then sends the information to the second terminal device (c1).

[0225] For example, the smart device management app / first terminal device can be pre-bound to all smart home devices, as shown in Figure 15 or Figure 16. This can be done by binding all smart home devices to the same Huawei account within the Smart Life app.

[0226] For example, the first terminal device may further display the result of information transmission or sharing on the interface. For instance, the interface of a mobile phone may display "Sharing complete" as shown in Figure 14f.

[0227] For example, after the first terminal device sends information to the second terminal device in response to the user's operation, the second terminal device generates a shortcut based on the information and controls the smart device based on the user's operation on the shortcut, which is the same as in the aforementioned embodiments.

[0228] For example, the mobile phone can send information for generating a shortcut to control the smart TV to the speaker via a pre-shared method as provided in any of the above embodiments. Upon receiving the information, the speaker can utilize its system capabilities to generate a voice shortcut based on that information. Subsequently, as shown in Figures 8a and 8b, the speaker can control the smart TV in response to a voice command issued by the user.

[0229] In the above embodiments, the pre-generated shortcuts on the second terminal device can bring convenience to users in some scenarios. As shown in Figure 17a, when a parent is driving outdoors, their child calls and says they want to turn on a certain device (e.g., "want to watch TV"). While driving, the parent can perform corresponding shortcut operations on the watch on their wrist according to the pre-generated shortcuts on the watch (see the aforementioned embodiments), such as raising and lowering their wrist after finishing the call with the child. The watch can then control the TV at home to turn on based on the user's operation. In Figure 17a, the dotted-line arrows indicate the path through which the watch sends control information. The flowchart of the watch controlling the TV at home is shown in Figure 17b. When the user operates the shortcut on the watch, the watch determines its network connection status based on the user's operation. When connected to the network, the watch sends a device identifier and control command to the server. After receiving the device identifier and control command, the server sends them to the corresponding central device. The central device parses the information sent by the server, obtains the device identifier and control command, and sends the control command to the controlled device (TV) based on the device identifier. The controlled device (television) receives and executes control commands, such as turning on the power and outputting an image, etc.

[0230] For example, users can also control their home television via devices such as wristbands or rings with pre-generated shortcuts. The control process is detailed in Figure 17b.

[0231] For example, users can also control other smart devices at home, such as air conditioners, water heaters, and lights, from outdoor second terminal devices such as watches, bracelets, rings, glasses, or portable speakers. The control process can be seen in Figure 17b.

[0232] Another method for controlling a smart device provided in this application embodiment is shown in Figure 18. This method can be applied to a smart device control system, which may include a first terminal device and a second terminal device.

[0233] The first terminal device can be used to control or is the first smart device. For example, the first terminal device can be a terminal device with a smart device management app installed, such as a smart living app or an easy-to-use app, to control smart devices. Examples include smartphones, tablets, and laptops. It can also be a central device for a smart home system, or a smart device (such as a smart TV or air conditioner), and so on. The second terminal device can be a lightweight terminal device such as a wearable device (e.g., a smartwatch, bracelet, ring, glasses), or a speaker. Due to limited hardware and software resources, it does not have an application installed to control the first smart device, and the first terminal device is connected to the second terminal device. The connection between the first and second terminal devices can be a near-field connection (e.g., NFC, Bluetooth, or StarFlash) or a network connection (e.g., Wi-Fi, cellular network, or soft bus connection).

[0234] As shown in Figure 18, the method may include:

[0235] Step 1801: The second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device.

[0236] In some embodiments, before step 1801, the method may further include: the first terminal device sending first information to the second terminal device based on a near-field communication method with the second terminal device.

[0237] In some embodiments, before step 1801, the method may further include: a first terminal device presenting a sharing interface for sharing first information. Exemplarily, the first terminal device may present the sharing interface based on near-field communication with the second terminal device described above. This sharing interface is not limited to the interfaces shown in Figures 14b, 16b, and 19a. Exemplarily, the operation used to trigger the near-field communication method may be, for example, a user-initiated tap or proximity operation, as detailed in the descriptions of the above embodiments.

[0238] In some embodiments, before step 1801, the process may further include: the first smart device reporting capability information to the first terminal device, the capability information being used to provide first information. For example, the first terminal device can obtain the first information based on the capability information. For example, the capability information may include the first information. As shown in FIG13a, the first terminal device may be a central device, and the first smart device may be an air conditioner or a lamp, etc. Before the central device presents the sharing interface, when the central device binds to a smart device such as an air conditioner or a lamp, the smart device such as the air conditioner or lamp reports capability information, which includes the first information.

[0239] For example, the first information may be information used to generate shortcuts in any of the above embodiments, such as the identifier of the smart device, the command to control the smart device, and the command name.

[0240] In some embodiments, the first terminal device presents a sharing interface, which may include: the first terminal device presents a sharing interface based on the second terminal device's tap or proximity.

[0241] For example, in response to a user's tap or proximity to the first terminal device, the second terminal device may send a request to the first terminal device through a connection with the first terminal device. The first terminal device receives the request sent by the second terminal device through the connection, and the request is used to obtain first information.

[0242] Accordingly, the first terminal device can respond to the request of the second terminal device and present a sharing interface through the system capabilities of the first terminal device.

[0243] In some embodiments, before step 1801, the method may further include: the second terminal device presenting a sharing interface, so that the second terminal device can generate a first control method in response to the user's operation on the sharing interface presented by the second terminal device, and control the first smart device in response to the user's operation using the first control method.

[0244] For example, the connection between the first terminal device and the second terminal device can be established by the second terminal device in response to a user's tap or proximity to the first terminal device. Before the first terminal device receives a request sent by the second terminal device through the connection, it may further include:

[0245] In response to the aforementioned tap-to-touch or proximity operation of the first terminal device, the second terminal device sends a request to the first terminal device through the connection between the two devices. Related embodiments are not limited to the examples shown in Figures 5, 8a, 8b, and 9a.

[0246] In some embodiments, when the second terminal device touches or approaches the first terminal device under the user's operation, the first terminal device displays a sharing interface. As shown in FIG19a, when the smartwatch touches or approaches the second terminal device, it displays various function cards, including a sharing shortcut. In some embodiments, when the smartwatch touches or approaches the second terminal device, it may only display the sharing shortcut card, or it may display the sharing shortcut card and any one or more other cards.

[0247] In some embodiments, presenting a sharing interface on the first terminal device may include: the first terminal device presenting a sharing interface based on the user's operation on the options in the interface of the second terminal device, wherein the options correspond to the first terminal device. For example, the connection between the first terminal device and the second terminal device may also be via a soft bus or similar means.

[0248] The second terminal device can respond to user operations and display options corresponding to the first terminal device, as shown in the embodiment of Figure 12b;

[0249] The second terminal device can respond to the user's operation on the option by sending a request to the first terminal device through the connection, as shown in the embodiments of Figures 12c and 13c. Accordingly, the first terminal device can respond to the request from the second terminal device and present a sharing interface through the system capabilities of the first terminal device.

[0250] In some embodiments, the first terminal device displays a sharing interface, which may include:

[0251] The first terminal device responds to the user's operation and presents a sharing interface through the first application or the system capabilities of the first terminal device, not limited to the embodiments shown in Figures 14a, 14b, 16a, and 6b.

[0252] For example, prior to step 1801, the following may also be included:

[0253] The first terminal device obtains the type or identifier of the second terminal device;

[0254] The first terminal device determines one of the control methods—control method, voice control method, or action control method—as the first control method based on the type or identifier of the second terminal device.

[0255] For example, when a user selects an option corresponding to a watch or bracelet from the options presented on the first terminal device, the first terminal device can determine that the second terminal device is resource-rich, has a user interface, and is portable, thus determining the first control method as control, voice, and motion control. As another example, when a user selects an option corresponding to a ring from the options presented on the first terminal device, the first terminal device can determine that the second terminal device has fewer resources, lacks a user interface, but is portable, thus determining the first control method as motion control. Yet another example, when a user selects an option corresponding to a speaker from the options presented on the first terminal device, and the user selects a speaker as the second terminal device, the first terminal device can determine that the second terminal device lacks a user interface, is not portable, but allows voice input, thus determining the first control method as voice control, and so on.

[0256] For example, step 1801 may include: the second terminal device receiving first information sent by the first terminal device through a connection with the first terminal device. For example, the second terminal device may receive first information sent by the first terminal device according to a request from the second terminal device. Or, for example, the second terminal device may receive first information sent by the first terminal device in response to a user's operation.

[0257] Step 1802: The second terminal device generates a first control method for controlling the first smart device based on the first information and by utilizing the system capabilities of the second terminal device.

[0258] For example, step 1802 may include: the second terminal device displays controls for controlling the first smart device based on the first information, using the system capabilities of the second terminal device, as shown in Figure 6a.

[0259] Alternatively, step 1802 may include: the second terminal device generating a voice control method based on the first information using the system capabilities of the second terminal device, as shown in Figures 7a, 8b, and 9b. In some embodiments, the voice control method may further include a control, as shown in Figure 19b, where a button representing voice input may be displayed on the watch interface. This button is marked with a microphone icon. When the user presses the button, the watch begins to receive voice signals. After the user speaks a voice command, they can release the button to complete the voice command input. Alternatively, the user can press and release the button, the watch begins to receive voice signals, and the user speaks a voice command to complete the voice command input.

[0260] Alternatively, for example, step 1802 may include: the second terminal device generating an action control mode based on the first information using the system capabilities of the second terminal device, as shown in Figures 10a and 11a.

[0261] Step 1803: The second terminal device responds to the user's operation using the first control method and controls the first smart device.

[0262] For example, step 1803 may include: the second terminal device responding to the user operation control to control the first smart device, as shown in Figures 6b and 6c.

[0263] Alternatively, step 1803 may include: the second terminal device controlling the first smart device in response to the user uttering a voice that matches the voice control method, as shown in Figures 7b, 7c, 8a, 8b, 9c, and 9d.

[0264] Alternatively, for example, step 1803 may include: the second terminal device controlling the first smart device in response to the user making an action that matches the action control method, as shown in Figures 10c, 10d, 11b and 11c.

[0265] In some embodiments, when the first control method is voice control, the process before step 1803 may further include:

[0266] The second terminal device or the first terminal device displays prompts related to the voice control method, as shown in Figures 7a and 19c.

[0267] In some embodiments, when the first control method is an action control method, before step 1803, the following may also be included:

[0268] The second terminal device or the first terminal device displays prompts related to the action control method, as shown in Figures 10a, 10b, and 19d.

[0269] In some embodiments, step 1803 may include:

[0270] The second terminal device responds to the user's operation using the first control method by sending the identifier and control command of the first smart device to control the first smart device, as shown in Figures 6d and 17b.

[0271] In some embodiments, the second terminal device may generate multiple control methods based on information used to control the first smart device. For example, the method for controlling the smart device may further include, based on this embodiment:

[0272] Based on the first information, the second terminal device uses its system capabilities to generate a second control method for controlling the first smart device. For example, the second control method may be similar to the first control method, such as a control panel control method, a voice control method, or an action control method.

[0273] The second terminal device responds to the user's operation using the second control method and controls the first smart device.

[0274] For example, the second terminal device may not only display the controls shown in Figure 6a, but also voice controls and / or action prompts, so that the user can adopt appropriate control methods to control the first smart device according to actual needs.

[0275] In some embodiments, the second terminal device may generate a control method for controlling multiple smart devices. For example, the first terminal device may also be used to control the second smart device or the second smart device itself. The second terminal device may not have an application installed for controlling the second smart device. Based on this embodiment, the method for controlling the smart device may further include:

[0276] The second terminal device obtains second information associated with controlling the second smart device from the first terminal device through the connection with the first terminal device. For example, the second information may be similar to the first information, such as being used to generate a control method for controlling the second smart device, or may include, for example, the identifier or index of the second smart device, control commands and command names, etc.

[0277] Based on the second information, the second terminal device uses its system capabilities to generate a third control method for controlling the second smart device. For example, the third control method may be similar to the first control method, such as the aforementioned control method, voice control method, action control method, etc.

[0278] The second terminal device responds to the user's operation using the third control method and controls the second smart device.

[0279] For example, when the first terminal device is a central device, the central device obtains information for controlling the smart devices such as air conditioners and lights from the capability information reported by the smart devices by binding smart devices such as air conditioners and lights. When the second terminal device requests information associated with controlling the smart devices from the central device, the second terminal device can receive information associated with controlling the smart devices such as air conditioners and lights, as shown in Figure 13b. The second terminal device can generate controls for controlling both the air conditioner and the lights.

[0280] In some embodiments, the intelligent device control system may further include a third terminal device, which has not installed an application for controlling the first intelligent device. The third terminal device is connected to the first terminal device. After the first terminal device displays a sharing interface, the method for controlling the intelligent device may further include, based on the embodiment shown in FIG18:

[0281] In response to the user's operation on the sharing interface, the first terminal device presents a first option corresponding to the second terminal device and a second option corresponding to the third terminal device, not limited to the embodiments shown in Figures 14b, 14c, 14d, 14e, 14f, 16b, and 6c.

[0282] In response to the user's operation on the first option, the first terminal device sends the first information to the second terminal device;

[0283] In response to the user's operation on the second option, the first terminal device sends third information to the third terminal device. The third information is associated with controlling the first smart device. For example, the third information may be similar to the first information, such as being used to generate at least one control method among controls, voice control, and action control, or it may include the identifier or index of the first smart device, control commands, and command names, etc.

[0284] The third terminal device receives third information through its connection with the first terminal device;

[0285] The third terminal device generates a fourth control method for controlling the first smart device based on the third information and using the system capabilities of the third terminal device; for example, the fourth control method can be any one of the following: control panel, voice control, and motion control.

[0286] The third terminal device responds to the user's operation using the fourth control method and controls the first smart device.

[0287] For example, the third terminal device can be the second type of device described above.

[0288] Corresponding to the method embodiment shown in Figure 18, an example of a method for controlling a smart device provided in this application is shown in Figure 20. Applied to a first terminal device in the aforementioned smart device control system, similar to the embodiment shown in Figure 18, the first terminal device can be a first type device with a first application installed. The first terminal device is connected to a second terminal device in the aforementioned smart device control system. The second terminal device is a second type device with limited hardware and software resources and does not have the first application installed. The method includes:

[0289] Step 2001: The first terminal device presents a sharing interface through the first application or the system capabilities of the first terminal device. This sharing interface is used to share and control the first information associated with the first smart device. For example, the sharing interface may be shown in Figures 14b, 16b, and 19a.

[0290] For example, when the first terminal device is a central device, before step 2001, the following may also be included:

[0291] The first terminal device receives capability information reported by the first smart device, the capability information including the first information.

[0292] In some embodiments, the presentation of the above interface by the first terminal device is triggered by the second terminal device. For example, before step 2001, it may further include:

[0293] The first terminal device receives a request sent by the second terminal device through the connection, the request being used to obtain first information;

[0294] Accordingly, step 2001 may include: the first terminal device may, in response to a request, present a sharing interface through the system capabilities of the first terminal device. For example, after the mobile phone is touched or brought near by the second terminal device, the interface shown in Figure 19a is presented.

[0295] In some embodiments, step 2001 may include: the first terminal device responding to a user operation by presenting a sharing interface through a first application or the system capabilities of the first terminal device, as shown in Figures 14a, 14b, 16a, and 16b.

[0296] Step 2002: In response to the user's operation on the interface, the first terminal device presents options corresponding to at least one second type of device, where the at least one second type of device includes the second terminal device. See Figures 14c and 16c. Step 2003: In response to the user's operation on the options, the first terminal device sends first information to the second terminal device. The first information is used by the second terminal device to generate a first control method, which is used to control the first smart device. See the description of the above embodiments for details.

[0297] In some embodiments, the first terminal device is also connected to a third terminal device in the aforementioned intelligent device control system. The third terminal device is a second type of device. In step 2002, the option corresponding to at least one second type of device may include a first option and a second option. The first option corresponds to the second terminal device, and the second option corresponds to the third terminal device. Correspondingly, step 2003 may include:

[0298] In response to the user's operation on the first option, the first terminal device sends the first information to the second terminal device;

[0299] In response to the user's operation on the second option, the first terminal device sends third information to the third terminal device. The third information is used by the third terminal device to generate a fourth control method, which is used to control the first smart device. See the description in the embodiment shown in Figure 18 for details.

[0300] In some embodiments, prior to step 2003, the following may also be included:

[0301] The first terminal device responds to the user's operation on the option and obtains the type or identifier of the second terminal device;

[0302] Based on the type or identifier of the second terminal device, one of the following is determined as the first control method: control via controls, voice control, or motion control. See the description in the embodiment shown in Figure 18 for details.

[0303] As shown in Figure 14d, when the user selects a watch, the mobile phone can determine that the watch is a device with a screen, and thus send information to the watch that can generate interface controls. In some embodiments, when the user selects a ring, the mobile phone determines that the ring is a device without a screen, and then sends information to the ring that can generate voice control methods and / or motion control methods. Since watches have more hardware and software resources than rings, in some embodiments, in addition to sending information that can generate interface controls, the mobile phone can also send information that can generate voice control methods and / or motion control methods to the watch, enabling the watch to generate more control methods to meet more user needs and further improve ease of use and user experience.

[0304] In some embodiments, the first control method may be a voice control method or a motion control method. After step 2003, it may further include: presenting prompts related to the voice control method or the motion control method, as shown in Figures 7a, 19c, 10a, 10b, and 19d.

[0305] In some embodiments, the first terminal device may also share information for controlling the first smart device with other second-type devices. For example, the first terminal device may be connected to a third terminal device, which may be one of the second-type devices described above. The connection method may be similar to that between the first terminal device and the third terminal device, and may be a near-field connection or a network connection. The method for controlling the smart device may further include: the first terminal device, in response to a user's operation on an option, sending information associated with controlling the first smart device to the third terminal device. For example, if the user also selects the wristband in Figure 14d, the mobile phone may also send information associated with controlling the smart screen to the wristband, thereby enabling the wristband to generate a corresponding control method, giving the user more ways to control the smart device and further improving the convenience and user experience of controlling the smart device.

[0306] Another embodiment of the method for controlling a smart device is shown in Figure 21, applied to a second terminal device in the aforementioned smart device control system. Similar to the above embodiment, in this embodiment, the second terminal device is connected to the first terminal device, which can be used to control or is the first smart device itself. The second terminal device is a second type of device (see the description of the above embodiment for details). The second type of device has limited hardware and software resources and does not have any applications installed for controlling the first smart device. The method shown in this embodiment includes:

[0307] Step 2101: The second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device.

[0308] For example, the connection between the first terminal device and the second terminal device can be established through the second terminal device responding to the user's tapping or proximity to the first terminal device; correspondingly, step 2101 may include: the second terminal device, in response to the user's tapping or proximity to the first terminal device, obtaining first information from the first terminal device through the connection. It can also be understood that the second terminal device, in response to the user's tapping or proximity to the first terminal device, not only establishes a connection with the first terminal device but also obtains first information from the first terminal device through this connection. The first information can be detailed in the embodiment shown in Figure 18.

[0309] For example, as shown in Figures 12b, 12c, and 12d, step 2101 may include:

[0310] The second terminal device responds to the user's operation and displays the options corresponding to the first terminal device;

[0311] The second terminal device responds to the user's operation on the option and obtains the first information from the first terminal device through the connection with the first terminal device.

[0312] Step 2102: Based on the first information, the second terminal device generates a first control method for controlling the first smart device using the system capabilities of the second terminal device. The first control method is detailed in the embodiment shown in Figure 18.

[0313] For example, step 2102 may include: the second terminal device displays a control for controlling the first smart device based on the first information using the system capabilities of the second terminal device. The control may be the "Turn on TV" or "Turn off TV" button in the interface shown in Figure 12c.

[0314] Alternatively, for example, step 2102 may include: the second terminal device generating a voice control method based on the first information using the system capabilities of the second terminal device, as detailed in the above embodiments.

[0315] Alternatively, for example, step 2102 may include: the second terminal device generating an action control method based on the first information using the system capabilities of the second terminal device, as detailed in the above embodiments.

[0316] Step 2103: The second terminal device responds to the user's operation using the first control method and controls the first smart device, as detailed in the above embodiments.

[0317] For example, step 2103 may include: the second terminal device controlling the first smart device in response to a user operation control, as shown in FIG6b.

[0318] Alternatively, step 2103 may include: the second terminal device controlling the first smart device in response to the user issuing a voice that matches the voice control method, as shown in Figures 7b, 7c, 8a, 8b, 9c and 9d.

[0319] Alternatively, for example, step 2103 may include: the second terminal device controlling the first smart device in response to the user making an action that matches the action control method, as shown in Figures 10c, 10d, 11b and 11c.

[0320] In some embodiments, when the first control method is voice control, before step 2103, the following may be further included:

[0321] The second terminal device displays prompts related to the voice control method, as shown in Figure 7a.

[0322] In some embodiments, when the first control method is voice control, before step 2103, the following may be further included:

[0323] The second terminal device displays prompts related to the action control method, as shown in Figures 10a and 10b.

[0324] In some embodiments, the second terminal device may generate multiple control methods based on information associated with controlling the first intelligent device. For example, the method shown in this embodiment may further include:

[0325] The second terminal device generates a second control method based on the first information and its system capabilities. The second control method can be described in detail in the embodiment shown in Figure 18.

[0326] The second terminal device responds to the user's operation using the second control method and controls the first smart device, as detailed in the embodiment shown in Figure 18.

[0327] For example, a watch can generate one or more of the following based on information associated with the first smart device: interface controls, voice control, and motion control; a bracelet and a ring can generate voice control and / or motion control based on information associated with the first smart device, and so on.

[0328] In some embodiments, the second terminal device may also obtain second information associated with controlling the second smart device from the first terminal device (see the description in the embodiment shown in FIG18 for details), and generate a corresponding control method to control the second smart device. For example, the method for controlling the smart device may further include, based on the method shown in this embodiment:

[0329] The second terminal device obtains second information associated with controlling the second smart device from the first terminal device through its connection with the first terminal device.

[0330] The second terminal device generates a third control method for controlling the second smart device based on the second information and using the system capabilities of the second terminal device (see the description in the embodiment shown in Figure 18 for details), as shown in Figure 13b.

[0331] The second terminal device responds to the user's operation using the third control method to control the second smart device. For example, the user can control the air conditioner not only through the control for controlling the air conditioner in Figure 13b, but also through the control for controlling the lights in Figure 13b.

[0332] For example, step 2103 may include: in response to an operation performed by the user using the first control method, the second terminal device controls the first smart device by sending a first smart device identifier and a control command, as shown in Figures 6d and 17b.

[0333] For example, the second terminal device may share the same account as the first terminal device on the login server. For instance, the second terminal device may share the same account as the first terminal device on the Huawei platform, ensuring the security of the recipients of information sharing or transmission, thereby guaranteeing the security of the method for controlling smart devices provided in this application embodiment.

[0334] The terminal device provided in this application embodiment can be referred to FIG22. As shown in FIG22, the terminal device 2200 may include a processor 2201, a memory 2202, and a communication interface 2203. The processor 2201, the memory 2202, and the communication interface 2203 are coupled to each other. Optionally, the memory 2202 may be used to store instructions executed by the processor 2201, or to store input data required by the processor 2201 to execute instructions, or to store data generated after the processor 2201 executes instructions. The communication interface 2203 may be a transceiver or an input / output interface. When the processor 2201 reads and executes the instructions stored in the memory 2202, the terminal device may implement any of the methods provided in this application embodiment.

[0335] Optionally, referring to Figure 22, the processor 2201, the memory 2202, and the communication interface 2203 are interconnected via a bus 2204. The bus 2204 can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of illustration, only one thick line is used in Figure 22, but this does not indicate that there is only one bus or one type of bus.

[0336] The terminal device provided in this application embodiment is used to implement any of the intelligent device control methods applied to a second terminal device provided in the above embodiments.

[0337] For example, a terminal device may include an acquisition unit, a generation unit, and a control unit. The acquisition unit is used to acquire first information associated with controlling the first smart device from the first terminal device via a connection between the second terminal device and the first terminal device; the generation unit is used to generate a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device; and the control unit is used to control the first smart device in response to an operation performed by a user using the first control method.

[0338] In some embodiments, the generation unit may be specifically configured to display controls for controlling the first smart device based on the system capabilities of the second terminal device using the first information; correspondingly, the control unit may be specifically configured to control the first smart device in response to user operation controls.

[0339] In some embodiments, the generating unit may be specifically configured to generate a voice control mode based on the first information and utilizing the system capabilities of the second terminal device; correspondingly, the control unit may be specifically configured to control the first smart device in response to the user uttering a voice that matches the voice control mode.

[0340] In some embodiments, the terminal device may further include a first prompting unit for presenting a prompt related to the voice control method before the control unit controls the first smart device in response to the user issuing a voice that matches the voice control method.

[0341] In some embodiments, the generating unit may be specifically configured to generate an action control mode based on the first information and utilizing the system capabilities of the second terminal device; correspondingly, the control unit may be specifically configured to control the first smart device in response to the user making an action that matches the action control mode.

[0342] In some embodiments, the terminal device may further include a second prompting unit for presenting a prompt related to the action control method before the control unit controls the first smart device in response to the user making an action that matches the action control method.

[0343] In some embodiments, the generating unit may further be configured to generate a second control mode based on the first information and utilizing the system capabilities of the second terminal device; correspondingly, the control unit may also be configured to control the first smart device in response to an operation performed by the user using the second control mode.

[0344] In some embodiments, the acquisition unit can also be used to acquire second information associated with controlling the second smart device from the first terminal device through a connection with the first terminal device; the generation unit can also be further used to generate a third control method for controlling the second smart device based on the second information and utilizing the system capabilities of the second terminal device; correspondingly, the control unit can also be used to control the second smart device in response to an operation performed by the user using the third control method.

[0345] In some embodiments, the terminal device may further include a connection unit, which may be used to establish a connection with the first terminal device in response to a user's tapping or proximity operation. The acquisition unit may also be used to acquire first information from the first terminal device through the connection established with the first terminal device in response to a user's tapping or proximity operation.

[0346] In some embodiments, the acquiring unit may include:

[0347] The display subunit is used to display the options corresponding to the first terminal device in response to user operations;

[0348] The acquisition subunit is used to acquire first information from the first terminal device in response to the user's operation on the option, through a connection with the first terminal device.

[0349] In some embodiments, the control unit may be specifically configured to control the first smart device by sending an identifier and control commands of the first smart device in response to an operation performed by the user using a first control method.

[0350] The intelligent device control system provided in this application embodiment may include the first terminal device and the second terminal device described above. The first terminal device is used to control the intelligent device and may be a terminal device with an intelligent device management APP installed, a central device for whole-house intelligence, or the intelligent device itself. The second terminal device may be the second type of device described above, a lightweight terminal device that does not have an application installed for controlling the intelligent device. For example, it may be a speaker, or a wearable device such as a smartwatch, smart bracelet, smart ring, or smart glasses, etc.

[0351] In some embodiments, the intelligent device control system may further include a third terminal device, which may be the second type of device described above.

[0352] The chip provided in this application embodiment can be a chip or chip system in the aforementioned terminal device that has the function of implementing the method provided in this application embodiment. Exemplarily, the chip can integrate a processor, a communication interface, and a memory. The memory stores computer programs or instructions, and the processor is connected to the memory through the communication interface to read and execute the computer programs or instructions stored in the memory to implement any of the methods provided in this application embodiment. In some embodiments, the memory may be omitted from the chip; in this case, the processor can call the computer programs or instructions from an external storage device through the communication interface. In some embodiments, the chip system can be composed of chips. Exemplarily, the chip system may include a processor chip, a communication interface chip, and a memory chip. The processor chip is connected to the memory chip through the communication interface chip to read and execute the computer programs or instructions stored in the memory chip to implement any of the methods provided in this application embodiment. In other embodiments, the chip system may include chips and other discrete devices.

[0353] It should be understood that the embodiments described in this application are only some embodiments, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0354] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the application. The singular forms “a,” “the,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. The term “and / or” as used herein is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Additionally, the character “ / ” in this document generally indicates that the preceding and following related objects are in an “or” relationship.

[0355] In a specific implementation, the present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and the program, when executed, may include some or all of the steps in the various method embodiments provided by the present invention. The storage medium may be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0356] In a specific implementation, the present invention also provides a computer program product, wherein the computer program product includes executable instructions, which, when executed on a computer, cause the computer to perform some or all of the steps in the various method embodiments provided by the present invention.

[0357] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or certain parts of the embodiments of the present invention.

[0358] The same or similar parts between the various embodiments in this specification can be referred to mutually. In particular, the device embodiments and terminal embodiments are basically similar to the method embodiments, so the description is relatively simple, and the relevant parts can be referred to the description in the method embodiments.

Claims

1. A method for controlling a smart device, characterized in that, An application is provided in a smart device control system, the smart device control system including a first terminal device and a second terminal device, wherein the first terminal device is used to control a first smart device or is the first smart device, the second terminal device does not have an application installed for controlling the first smart device, and the first terminal device is connected to the second terminal device, the method including: The second terminal device obtains first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device; Based on the first information, the second terminal device generates a first control method for controlling the first smart device using the system capabilities of the second terminal device; The second terminal device controls the first smart device in response to the user's operation using the first control method.

2. The method according to claim 1, characterized in that, Before the second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device, the method further includes: The first terminal device sends the first information to the second terminal device based on a near-field communication method with the second terminal device.

3. The method according to claim 1 or 2, characterized in that, Before the second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device, the method further includes: The first terminal device displays a sharing interface, which is used to share the first information.

4. The method according to claim 1, characterized in that, Based on the first information, the second terminal device generates a first control method for controlling the first smart device using its system capabilities, including: Based on the first information, the second terminal device displays controls for controlling the first smart device using the system capabilities of the second terminal device; The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: The second terminal device responds to the user's operation of the control to control the first smart device.

5. The method according to claim 1, characterized in that, Based on the first information, the second terminal device generates a first control method for controlling the first smart device using its system capabilities, including: The second terminal device generates a voice control method based on the first information and by utilizing the system capabilities of the second terminal device. The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: The second terminal device responds to the user's voice input that matches the voice control method, and controls the first smart device.

6. The method according to claim 5, characterized in that, Before the second terminal device controls the first smart device in response to a user issuing a voice matching the voice control method, the method further includes: The second terminal device or the first terminal device displays a prompt related to the voice control method.

7. The method according to claim 1, characterized in that, Based on the first information, the second terminal device generates a first control method for controlling the first smart device using its system capabilities, including: The second terminal device generates an action control method based on the first information and by utilizing the system capabilities of the second terminal device. The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: The second terminal device controls the first smart device in response to the user making an action that matches the action control method.

8. The method according to claim 7, characterized in that, Before the second terminal device controls the first smart device in response to the user making an action matching the action control method, the method further includes: The second terminal device or the first terminal device displays a prompt related to the action control method.

9. The method according to claim 2, characterized in that, The first terminal device displays a sharing interface, including: The first terminal device presents a sharing interface based on the user's operation on the options in the interface of the second terminal device, and the options correspond to those of the first terminal device.

10. The method according to any one of claims 1 to 9, characterized in that, Also includes: Based on the first information, the second terminal device uses its system capabilities to generate a second control method for controlling the first smart device; The second terminal device controls the first smart device in response to an operation performed by the user using the second control method.

11. The method according to any one of claims 1 to 9, characterized in that, The first terminal device is also used to control the second smart device or to be the second smart device, wherein the second terminal device does not have an application installed for controlling the second smart device; The method further includes: The second terminal device obtains second information associated with controlling the second smart device from the first terminal device through the connection with the first terminal device; Based on the second information, the second terminal device uses its system capabilities to generate a third control method for controlling the second smart device; The second terminal device controls the second smart device in response to the user's operation using the third control method.

12. The method according to any one of claims 2 to 9, characterized in that, The intelligent device control system further includes a third terminal device, which has no application installed for controlling the first intelligent device, and is connected to the first terminal device. After the first terminal device displays the sharing interface, the method further includes: In response to the user's operation on the sharing interface, the first terminal device presents a first option corresponding to the second terminal device and a second option corresponding to the third terminal device; In response to the user's operation on the first option, the first terminal device sends the first information to the second terminal device; In response to the user's operation on the second option, the first terminal device sends third information to the third terminal device, the third information being associated with controlling the first smart device; The third terminal device receives the third information through its connection with the first terminal device; The third terminal device generates a fourth control method for controlling the first smart device based on the third information and by utilizing the system capabilities of the third terminal device. The third terminal device controls the first smart device in response to the user's operation using the fourth control method.

13. The method according to any one of claims 2 to 9, characterized in that, Before the first terminal device displays the sharing interface, the method further includes: The first smart device reports capability information to the first terminal device, and the capability information is used to provide the first information.

14. The method according to any one of claims 1 to 9, characterized in that, Before the second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device, it further includes: The first terminal device obtains the type or identifier of the second terminal device; The first terminal device determines one of the control method, voice control method, or action control method as the first control method based on the type or identifier of the second terminal device.

15. The method according to any one of claims 1 to 9, characterized in that, The connection between the first terminal device and the second terminal device is either a near-field connection or a network connection.

16. The method according to any one of claims 1 to 9, characterized in that, The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: In response to the user's operation using the first control method, the second terminal device controls the first smart device by sending the identifier and control commands of the first smart device.

17. A method for controlling a smart device, characterized in that, The method is applied to a second terminal device connected to a first terminal device, where the first terminal device is used to control or is the first smart device, and the second terminal device does not have an application installed for controlling the first smart device. The second terminal device obtains first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device; Based on the first information, the second terminal device generates a first control method for controlling the first smart device using the system capabilities of the second terminal device; The second terminal device controls the first smart device in response to the user's operation using the first control method.

18. The method according to claim 17, characterized in that, Based on the first information, the second terminal device generates a first control method for controlling the first smart device using its system capabilities, including: Based on the first information, the second terminal device displays controls for controlling the first smart device using the system capabilities of the second terminal device; The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: The second terminal device responds to the user's operation of the control to control the first smart device.

19. The method according to claim 17, characterized in that, Based on the first information, the second terminal device generates a first control method for controlling the first smart device using its system capabilities, including: The second terminal device generates a voice control method based on the first information and by utilizing the system capabilities of the second terminal device. The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: The second terminal device responds to the user's voice input that matches the voice control method, and controls the first smart device.

20. The method according to claim 19, characterized in that, Before the second terminal device controls the first smart device in response to a user issuing a voice matching the voice control method, the method further includes: The second terminal device displays prompts related to the voice control method.

21. The method according to claim 17, characterized in that, Based on the first information, the second terminal device generates a first control method for controlling the first smart device using its system capabilities, including: The second terminal device generates an action control method based on the first information and by utilizing the system capabilities of the second terminal device. The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: The second terminal device controls the first smart device in response to the user making an action that matches the action control method.

22. The method according to claim 21, characterized in that, Before the second terminal device controls the first smart device in response to the user making an action matching the action control method, the method further includes: The second terminal device displays prompts related to the action control method.

23. The method according to claim 17, characterized in that, Also includes: The second terminal device generates a second control method based on the first information and by utilizing the system capabilities of the second terminal device. The second terminal device controls the first smart device in response to an operation performed by the user using the second control method.

24. The method according to claim 17, characterized in that, Also includes: The second terminal device obtains second information associated with controlling the second smart device from the first terminal device through the connection with the first terminal device; Based on the second information, the second terminal device uses its system capabilities to generate a third control method for controlling the second smart device; The second terminal device controls the second smart device in response to the user's operation using the third control method.

25. The method according to any one of claims 17 to 24, characterized in that, The connection is established via the second terminal device in response to a user's tap or proximity to the first terminal device. The second terminal device, through the connection with the first terminal device, obtains first information associated with controlling the first smart device from the first terminal device, including: In response to the tap or proximity operation of the first terminal device, the second terminal device obtains the first information from the first terminal device through the connection.

26. The method according to any one of claims 17 to 24, characterized in that, The second terminal device, through the connection with the first terminal device, obtains first information associated with controlling the first smart device from the first terminal device, including: The second terminal device responds to the user's operation and displays the options corresponding to the first terminal device; In response to the user's operation on the option, the second terminal device obtains the first information from the first terminal device through the connection with the first terminal device.

27. The method according to any one of claims 17 to 24, characterized in that, The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: In response to the user's operation using the first control method, the second terminal device controls the first smart device by sending the identifier and control commands of the first smart device.

28. A terminal device, characterized in that, include: One or more processors and a memory, the one or more processors being coupled to the memory, the memory being used to store computer program code, the computer program code including computer instructions, wherein when the one or more processors execute the computer instructions, the terminal device performs the method as described in any one of claims 1 to 27.

29. A chip, characterized in that, include: A processor and a communication interface, wherein the processor invokes a computer program or instruction through the communication interface to execute the method as described in any one of claims 1 to 27.

30. The chip according to claim 29, characterized in that, It also includes a memory that stores the computer program or instructions and is connected to the processor via the communication interface. The processor retrieves the computer program or instructions from the memory via the communication interface.

31. A computer program product, characterized in that, When the computer program product is run on a computer, the computer performs the method described in any one of claims 1 to 27.

32. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when run on a computer, enables the computer to perform the method described in any one of claims 1 to 27.

Images