Method and terminal device for controlling smart devices

Abstract

This application relates to a method and terminal device for controlling a smart device. The method may include: a second terminal device, through a connection with a first terminal device, obtaining first information associated with controlling the first smart device from the first terminal device; the second terminal device generating a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device; and the second terminal device controlling the first smart device in response to an operation performed by a user using the first control method. The technical solution provided by this application enables lightweight terminal devices to obtain and generate a control method for controlling the smart device based on information associated with controlling the smart device, and to control the smart device based on this control method, in scenarios where it is inconvenient for a smart device management app or central device to control the smart device. This improves the convenience of controlling the smart device and enhances the user experience.

Description

Technical Field

[0001] This invention relates to the field of intelligent device control technology, and in particular to a method and terminal device for controlling intelligent devices. Background Technology

[0002] Currently, the control interface for smart devices is typically a smart device management application (APP) or a smart home hub device. Users can manage and control smart devices through the smart device management app or the smart home hub device. However, some lightweight terminal devices, due to limited hardware and software resources, do not have a smart device management app installed, thus failing to provide users with the function of controlling smart devices. This forces users to control smart devices only through the smart device management app or the smart home hub device. Clearly, this control method is not convenient enough. Summary of the Invention

[0003] This application provides a method and terminal device for controlling smart devices to meet users' needs for convenience in controlling smart devices in more scenarios.

[0004] In a first aspect, embodiments of this application provide a method for controlling a smart device, applicable to a smart device control system. The smart device control system may include a first terminal device and a second terminal device, wherein the first terminal device can be used to control the first smart device or is the first smart device, the second terminal device does not have an application installed for controlling the first smart device, and the first terminal device is connected to the second terminal device. The method includes:

[0005] The second terminal device obtains first information associated with controlling the first intelligent device from the first terminal device through its connection with the first terminal device.

[0006] Based on the first information, the second terminal device generates a first control method for controlling the first smart device using the system capabilities of the second terminal device.

[0007] The second terminal device responds to the user's operation using the first control method and controls the first smart device.

[0008] Based on the above technical solution, the second terminal device obtains first information associated with controlling the first smart device from the first terminal device, generates a first control method based on the first information, and controls the first smart device in response to the user adopting the first control method. This enables lightweight terminal devices to control smart devices even when resources are limited and no application for controlling smart devices is installed. Thus, in scenarios where it is inconvenient to control smart devices through smart device management apps or whole-house smart hub devices, smart devices can be controlled through lightweight terminal devices (such as wearable devices like watches, bracelets, rings, glasses, and speakers), improving the convenience of smart device control and user experience.

[0009] In one possible implementation, before the second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device, the method may further include: the first terminal device sending the first information to the second terminal device based on a near-field communication method with the second terminal device.

[0010] In one possible implementation, before the second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device, the method may further include: the first terminal device presenting a sharing interface for sharing the first information.

[0011] In one possible implementation, the first terminal device presenting the sharing interface may include:

[0012] The first terminal device presents a sharing interface based on near-field communication with the aforementioned second terminal device. The operation used to trigger the near-field communication method can be, for example, a user-initiated tap or proximity operation.

[0013] In one possible implementation, the second terminal device generates a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device, which may include:

[0014] Based on the first information, the second terminal device displays controls for controlling the first smart device using the system capabilities of the second terminal device.

[0015] Accordingly, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0016] The second terminal device responds to the user's operation controls and controls the first smart device.

[0017] In one possible implementation, the second terminal device generates a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device, which may include:

[0018] Based on the first information, the second terminal device generates a voice control method using the system capabilities of the second terminal device.

[0019] Accordingly, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0020] The second terminal device responds to the user's voice commands that match the voice control method, and controls the first smart device.

[0021] In one possible implementation, before the second terminal device controls the first smart device in response to the user issuing a voice that matches the voice control method, the method may further include:

[0022] The second terminal device or the first terminal device displays prompts related to the voice control method.

[0023] In one possible implementation, the second terminal device generates a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device, which may include:

[0024] The second terminal device generates an action control method based on the first information and by utilizing the system capabilities of the second terminal device.

[0025] The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0026] The second terminal device responds to the user's action that matches the action control method and controls the first smart device.

[0027] In one possible implementation, before the second terminal device controls the first smart device in response to the user making an action matching the action control method, the method may further include:

[0028] The second terminal device or the first terminal device displays prompts related to the action control method.

[0029] In one possible implementation, the first terminal device presenting the sharing interface may include:

[0030] The first terminal device presents a sharing interface based on the user's operation of the options in the interface of the second terminal device, and the options correspond to those of the first terminal device.

[0031] In one possible implementation, the above method may further include:

[0032] Based on the first information, the second terminal device generates a second control method for controlling the first smart device using the system capabilities of the second terminal device.

[0033] The second terminal device controls the first smart device in response to an operation performed by the user using the second control method.

[0034] In one possible implementation, the first terminal device can also be used to control a second smart device or be the second smart device, wherein the second terminal device does not have an application installed for controlling the second smart device; the method may further include:

[0035] The second terminal device, through its connection with the first terminal device, obtains second information associated with controlling the second intelligent device from the first terminal device.

[0036] The aforementioned second terminal device generates a third control method for controlling the second intelligent device based on the second information and utilizing the system capabilities of the second terminal device;

[0037] The aforementioned second terminal device responds to the user's operation using the third control method and controls the second smart device.

[0038] In one possible implementation, the above-mentioned intelligent device control system may further include a third terminal device, which does not have an application installed for controlling the first intelligent device, and is connected to the first terminal device.

[0039] After the first terminal device displays the sharing interface, the method may further include:

[0040] In response to the user's operation on the sharing interface, the first terminal device presents a first option corresponding to the second terminal device and a second option corresponding to the third terminal device.

[0041] In response to the user's operation on the first option, the first terminal device sends the first information to the second terminal device.

[0042] In response to the user's operation on the second option, the aforementioned first terminal device sends third information to the third terminal device, and the third information is associated with controlling the first smart device;

[0043] The third terminal device receives third information through its connection with the first terminal device mentioned above;

[0044] Based on the third information, the third terminal device uses its system capabilities to generate a fourth control method for controlling the aforementioned first intelligent device.

[0045] The third terminal device can control the first smart device in response to an operation performed by the user using the fourth control method.

[0046] In one possible implementation, before the first terminal device presents the sharing interface, the method may further include: the first smart device reporting capability information to the first terminal device, the capability information being used to provide first information.

[0047] In one possible implementation, before the second terminal device can obtain the first information associated with controlling the first smart device from the first terminal device via a connection with the first terminal device, it may further include:

[0048] The first terminal device obtains the type or identifier of the second terminal device;

[0049] The first terminal device determines, based on the type or identifier of the second terminal device, one of the control method, voice control method, or action control method as the aforementioned first control method.

[0050] In one possible implementation, the connection between the first terminal device and the second terminal device can be a near-field connection or a network connection. For example, a near-field connection can be a Near Field Communication (NFC) connection, a Bluetooth connection, or a satellite connection.

[0051] In one possible implementation, the second terminal device controls the first terminal device in response to an operation performed by the user using the first control method.

[0052] The second terminal device responds to the user's operation using the first control method by sending the identifier and control commands of the first smart device to control the first smart device.

[0053] Secondly, embodiments of this application provide a method for controlling a smart device, which can be applied to a second terminal device in the aforementioned smart device control system. The second terminal device can be connected to the aforementioned first terminal device. The first terminal device can be used to control the first smart device or is the first smart device itself. The second terminal device does not have the application for controlling the first smart device installed. The method may include:

[0054] The second terminal device obtains first information associated with controlling the first intelligent device from the first terminal device through its connection with the first terminal device.

[0055] Based on the first information, the second terminal device generates a first control method for controlling the first smart device using the system capabilities of the second terminal device.

[0056] The second terminal device responds to the user's operation using the first control method and controls the first smart device.

[0057] Based on the above technical solution, the second terminal device obtains first information associated with controlling the first smart device from the first terminal device, and generates a first control method based on the first information. By responding to the user's use of the first control method to control the first smart device, lightweight terminal devices (such as wearable devices like watches, bracelets, rings, glasses, and speakers) can control smart devices even without installing a smart device management APP. Thus, in scenarios where it is inconvenient to control smart devices through a smart device management APP or a whole-house smart hub, smart devices can be controlled through lightweight terminal devices, improving the convenience of smart device control and user experience.

[0058] In one possible implementation, the second terminal device generates a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device, which may include:

[0059] Based on the first information, the second terminal device displays controls for controlling the first smart device using the system capabilities of the second terminal device.

[0060] Accordingly, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0061] The second terminal device responds to the user's operation controls and controls the first smart device.

[0062] In one possible implementation, the second terminal device generates a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device, which may include:

[0063] Based on the first information, the second terminal device generates a voice control method using the system capabilities of the second terminal device.

[0064] Accordingly, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0065] The second terminal device responds to the user's voice commands that match the voice control method, and controls the first smart device.

[0066] In one possible implementation, before the second terminal device controls the first smart device in response to the user issuing a voice that matches the voice control method, the method may further include:

[0067] The second terminal device displays prompts related to the voice control method.

[0068] In one possible implementation, the second terminal device generates a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device, which may include:

[0069] The second terminal device generates an action control method based on the first information and by utilizing the system capabilities of the second terminal device.

[0070] Accordingly, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0071] The second terminal device responds to the user's action that matches the action control method and controls the first smart device.

[0072] In one possible implementation, before the second terminal device controls the first smart device in response to the user making an action matching the action control method, it may further include:

[0073] The second terminal device displays prompts related to the action control method.

[0074] In one possible implementation, the above method may further include: the second terminal device generating a second control method based on the first information and utilizing the system capabilities of the second terminal device;

[0075] The second terminal device responds to the user's operation using the second control method and controls the aforementioned first smart device.

[0076] In one possible implementation, the above method may further include:

[0077] The aforementioned second terminal device obtains second information associated with controlling the second intelligent device from the first terminal device through its connection with the first terminal device;

[0078] The aforementioned second terminal device generates a third control method for controlling the second intelligent device based on the second information and utilizing the system capabilities of the second terminal device;

[0079] The aforementioned second terminal device responds to the user's operation using the third control method and controls the second smart device.

[0080] In one possible implementation, the connection described above can be established via the second terminal device in response to a user's tap or proximity to the first terminal device;

[0081] Accordingly, the second terminal device, through its connection with the first terminal device, obtains first information associated with controlling the first intelligent device from the first terminal device, which may include:

[0082] In response to the tap or proximity operation of the first terminal device, the second terminal device obtains the first information from the first terminal device through a connection.

[0083] In one possible implementation, the second terminal device, through its connection with the first terminal device, obtains first information associated with controlling the first smart device from the first terminal device, which may include:

[0084] The second terminal device responds to the user's operation and displays the options corresponding to the first terminal device;

[0085] The second terminal device responds to the user's operation on the option and obtains the first information from the first terminal device through the connection with the first terminal device.

[0086] In one possible implementation, the second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, which may include:

[0087] The second terminal device responds to the user's operation using the first control method by sending the identifier and control commands of the first smart device to control the first smart device.

[0088] In one possible implementation, the connection between the first terminal device and the second terminal device can be a near-field connection or a network connection. For example, a near-field connection could be an NFC connection, a Bluetooth connection, or a satellite connection.

[0089] Thirdly, embodiments of this application provide a terminal device. The terminal device may include one or more processors and a memory, the one or more processors being coupled to the memory. The memory can be used to store computer program code, the computer program code including computer instructions. When the one or more processors execute the computer instructions, the terminal device can perform the methods provided in any of the first to second aspects described above.

[0090] Fourthly, embodiments of this application provide a chip. The chip may include a processor and a communication interface. The processor can invoke computer programs or instructions through the communication interface to execute the methods provided in any one of the first to second aspects described above.

[0091] In conjunction with the fourth aspect, as one possible implementation, the chip may also include a memory containing computer programs or instructions, and be connected to a processor via a communication interface. The processor may use the communication interface to call and execute the computer programs or instructions stored in the memory, and perform the methods provided in any one of the first to second aspects above.

[0092] Fifthly, embodiments of this application provide a computer program product. When the computer program product is run on a computer, the computer can execute the methods provided in any one of the first to second aspects described above.

[0093] In a sixth aspect, embodiments of this application provide a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, and when the computer program is run on a computer, the computer can perform the method described in any one of the first to second aspects described above. Attached Figure Description

[0094] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0095] Figure 1 A schematic diagram of a system architecture provided for an embodiment of this application;

[0096] Figure 2a This is a schematic diagram of a smart device management APP provided in an embodiment of this application;

[0097] Figure 2b for Figure 2a The image shows a schematic diagram of one type of APP interface.

[0098] Figure 3 Another system architecture diagram provided for an embodiment of this application;

[0099] Figure 4a A schematic diagram of a whole-house smart device system provided in this application embodiment;

[0100] Figure 4b An example of the user interface of the central control screen of the whole-house smart hub device provided in the embodiments of this application;

[0101] Figure 5 An example of a second terminal device acquiring information provided in an embodiment of this application;

[0102] Figure 6a An example of a control method generated by the second terminal device provided in this application embodiment;

[0103] Figure 6b An example of a second terminal device controlling a smart device provided in this application embodiment;

[0104] Figure 6c Another example of a second terminal device controlling a smart device provided in the embodiments of this application;

[0105] Figure 6d An example of a process for a second terminal device to control a smart device, provided in an embodiment of this application;

[0106] Figure 7a A prompt example of a second terminal device provided in the embodiments of this application;

[0107] Figure 7b Another example of a second terminal device controlling a smart device provided in the embodiments of this application;

[0108] Figure 7c Another example of a second terminal device controlling a smart device provided in the embodiments of this application;

[0109] Figure 8a Another example of a second terminal device controlling a smart device provided in the embodiments of this application;

[0110] Figure 8b Another example of a second terminal device controlling a smart device provided in the embodiments of this application;

[0111] Figure 9a Another example of a second terminal device acquiring information provided in the embodiments of this application;

[0112] Figure 9b A prompt example of the first terminal device provided in the embodiments of this application;

[0113] Figure 9c Another example of a second terminal device controlling a smart device provided in the embodiments of this application;

[0114] Figure 9d Another example of a second terminal device controlling a smart device provided in the embodiments of this application;

[0115] Figure 10a Another example of a prompt for the second terminal device provided in the embodiments of this application;

[0116] Figure 10b Another example of a prompt for the second terminal device provided in the embodiments of this application;

[0117] Figure 10c Another example of a second terminal device controlling a smart device provided in the embodiments of this application;

[0118] Figure 10d Another example of a second terminal device controlling a smart device provided in the embodiments of this application;

[0119] Figure 11a Another example of a prompt for the first terminal device provided in the embodiments of this application;

[0120] Figure 11b Another example of a second terminal device controlling a smart device provided in the embodiments of this application;

[0121] Figure 11c Another example of a second terminal device controlling a smart device provided in the embodiments of this application;

[0122] Figure 12a This is a partial schematic diagram of another whole-house smart device system provided in an embodiment of this application;

[0123] Figure 12b This application provides an example of an interface and operation for a second terminal device during the information acquisition process.

[0124] Figure 12c This is another interface and operation example of the second terminal device provided in the embodiments of this application during the information acquisition process;

[0125] Figure 12d This application provides an example of a control method for displaying generated controls on a second terminal device.

[0126] Figure 13a The embodiment provided in this application provides a schematic diagram of another whole-house smart device system;

[0127] Figure 13b This application provides an example of a second terminal device generation control method.

[0128] Figure 13c Another example of the control method for generating the second terminal device provided in the embodiments of this application.

[0129] Figure 14a and Figure 14b An example of a first terminal device providing an embodiment of this application presenting a sharing interface through a smart device management APP;

[0130] Figure 14c and 14d An interface and operation example provided in this application embodiment for sharing and controlling information associated with a smart device through a smart device management APP;

[0131] Figure 14e and Figure 14f Another interface and operation example of the first terminal device provided in this application sharing and controlling information associated with the smart device through a smart device management APP;

[0132] Figure 15a A schematic diagram illustrating a process for a first terminal device to share and control information associated with a smart device, as provided in an embodiment of this application;

[0133] Figure 15b Another schematic diagram illustrating the process of a first terminal device sharing and controlling information associated with a smart device, provided in an embodiment of this application;

[0134] Figure 16a and Figure 16b An example of a first terminal device providing an embodiment of this application presenting a sharing interface through system capabilities;

[0135] and Figure 16c An example of how a first terminal device, as provided in this application embodiment, shares and controls information associated with a smart device through system capabilities;

[0136] Figure 17a An example of the technical effect of the method for controlling a smart device provided in the embodiments of this application;

[0137] Figure 17b The embodiments provided in this application are applicable to Figure 17a The example shown is a schematic diagram of a process for a second terminal device to control a smart device.

[0138] Figure 18 This is a schematic diagram of a method for controlling a smart device provided in an embodiment of this application;

[0139] Figure 19a Another example of a first terminal device presenting a sharing interface as provided in the embodiments of this application;

[0140] Figure 19b Another example of the control method for the second terminal device provided in the embodiments of this application.

[0141] Figure 19c Another example of a prompt being presented by the first terminal device provided in the embodiments of this application;

[0142] Figure 19d Another example of a prompt being displayed on a first terminal device provided in an embodiment of this application;

[0143] Figure 20 This is a schematic diagram of a method for controlling a smart device provided in an embodiment of this application;

[0144] Figure 21 This is a schematic diagram of another method for controlling a smart device provided in an embodiment of this application;

[0145] Figure 22 This is a schematic diagram of the structure of a terminal device provided in an embodiment of this application. Detailed Implementation

[0146] To better understand the technical solution of this application, the embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0147] Smart devices can not only have the basic functions of traditional devices (such as home devices, medical devices, industrial devices, agricultural devices, etc.), but also have communication functions.

[0148] The communication function of a smart device can be a wireless communication function or a wired communication function. For example, the wireless communication function can be a short-range wireless communication function such as Wireless Fidelity (WiFi), NFC, Bluetooth (BT), NearLink, ZigBee, infrared, Z-Wave, Ultra Wide Band (UWB), and / or a long-range wireless communication function such as Narrowband Internet of Things (NB-IoT), LoRa (long-range wireless communication), Second-Generation Mobile Communication Technology (2G), Third-Generation Mobile Communication Technology (3G), Fourth-Generation Mobile Communication Technology (4G), and Fifth-Generation Mobile Communication Technology (5G). For example, wired communication functions can include Ethernet communication (ETH), full-duplex communication (Recommended Standard 232, RS-232), half-duplex communication (Recommended Standard 485, RS-485), Meter Bus (M-Bus), Power Line Communication (PLC), and other communication functions.

[0149] like Figure 1As shown, smart device 1 can connect to the second server s1 via a smart device 1 management app and be controlled by the app. Specifically, the smart device 1 management app can respond to user operations by instructing the second server s1 to obtain data from smart device 1, such as model and status, and bind the smart device 1. For example, the smart device 1 management app can respond to user operations by sending control commands to the second server s1. After receiving the control commands, the second server s1 can issue control commands to smart device 1. Smart device 1 can respond to the control commands by performing corresponding operations (such as turning on, off, adjusting parameters, etc.) and reporting its status and other information after the operations to the second server s1. The second server s1 can transmit the information reported by smart device 1 to the smart device 1 management app, and the user can obtain the control results of the smart device through the information received by the smart device 1 management app. This method of controlling smart devices through a server can be called a remote control method.

[0150] Similarly, smart device 2 can connect to the second server s2 via the smart device 2 management app and be controlled by the smart device 2 management app. Smart device n can connect to the second server sn via the smart device n management app and be controlled by the smart device n management app.

[0151] In some embodiments, the functions of one or more of the following apps—Smart Device 1 Management App, Smart Device 2 Management App, ..., Smart Device n Management App—can be integrated into a single Smart Device Management App, which serves as the unified control entry point for Smart Device 1, Smart Device 2, ..., Smart Device n. In other words, the Smart Device Management App can respond to user operations and control one or more of the following smart devices: Smart Device 1, Smart Device 2, ..., Smart Device n. Unlike the control provided by the Smart Device 1 Management App, Smart Device 2 Management App, ..., Smart Device n Management App, the server-side of the Smart Device Management App, i.e., the first server, needs to interface with a second server to obtain data or information from the corresponding smart devices and to send control commands to the corresponding smart devices through the second server.

[0152] For example, the smart device management app can be downloaded from an app store server and installed on a first type of device (an example of a first terminal device). For example, the first type of device can be a smartphone, a personal digital assistant (PDA), an in-vehicle computer, a vehicle infotainment system, a portable computer (such as a tablet, foldable computer, laptop, etc.), or a desktop computer, among other terminal devices (multiple examples of the first terminal device). For example, the smart device management app can be... Apps, Huawei's Smart Life App, and so on.

[0153] like Figure 2a As shown, the smartphone has Huawei's Smart Life app installed. When the user taps the Smart Life app icon, the smartphone responds, runs the Smart Life app, and displays the following: Figure 2b The interface shown is for user operation.

[0154] For example, any one of the second servers s1, s2, ..., sn can provide services to more than one smart device. For example, the first server can also provide services to more than one first-type device. For example, the first server can also provide services to second-type devices that do not have a smart device management app installed. For example, the second-type device can be a lightweight terminal device such as a speaker, a wearable device such as a watch, bracelet, ring, or glasses, etc. For example, in addition to providing services for the smart device management app, the first server can also provide services to first-type devices, such as providing download and installation services for the smart device management app, etc.

[0155] For example, the first server and the second server s1, s2, ..., sn can be physical servers or virtual servers. For example, a virtual server can be a virtual machine created on multiple physical servers. For ease of description, the first server and the second server s1, s2, ..., sn will no longer be distinguished in the following illustrations, and will be uniformly referred to as servers.

[0156] In some embodiments, when the first terminal device with the smart device management app installed is close to the smart device (e.g., within a range of tens of meters), the control commands sent by the smart device management app to the smart device can bypass the server. For example, they can be sent directly to the smart device via a connection based on Bluetooth or WiFi, such as a socket, User Datagram Protocol (UDP), or Transmission Control Protocol (TCP). The smart device's data can be directly reported to the smart device management app without going through a server. This control method, known as local control, is more efficient and saves more network resources compared to remote control.

[0157] In some embodiments, smart devices within the same geographical area can be connected to a local area network (LAN). For example, the same geographical area can be a family residence (such as a household in a residential area, or a villa), an office, a company, a workshop, a factory, etc. For example, the LAN can be a wired LAN or a wireless LAN. The LAN topology can be bus, star, ring, tree, hybrid, etc. The LAN networking method can be point-to-point networking, network-wide mapping, networking using routers and hubs, etc.

[0158] In some embodiments, smart devices within the same geographical area can be bound to a control terminal via a smart device management app, allowing control of the smart devices through remote or local control methods. For example... Figure 3 As shown, the smart device management APP can perform local or remote control of smart devices 1, 2, 3, ... m within the same local area network.

[0159] In some embodiments, the control functions of all smart devices within the same local area network can be centralized in a central device (another example of the first terminal device). The central device can be a terminal device (another example of the first terminal device) with an edge cloud central service process installed. Figure 3 As shown, smart device 1, smart device 2, smart device 3, ... smart device m can be connected to the same local area network (LAN) and managed and controlled by a central device connected to that LAN. For example, the central device can have local server functionality, data storage, and analysis capabilities. The various functions of the central device can be integrated into one or more components.

[0160] In some embodiments, the central device may include a control host, a network access device, and a user interaction device. For example, the network access device may be a gateway, a router, etc. The user interaction device may include a display component with display functionality and a user operation component. The user operation component provides a control interface for the user.

[0161] In some embodiments, the display component may be a monitor. For example, the monitor may be a smart TV (such as Huawei's Smart Screen), a monitor for a portable computer, a desktop computer, etc., and so on. Correspondingly, the user operation component may be a remote control for a smart TV, a keyboard or mouse for a portable computer, a desktop computer, etc., or an audio receiving component such as a microphone, etc. The display component, the user operation component, and the control host may be connected via wired connection, wireless connection, or a combination of wired and wireless connection. For example, the display component and the control host may be connected via wired connection, and the user operation component and the control host may be connected via wireless connection, etc., depending on the specific needs.

[0162] In some embodiments, the display component and the user operation component may be integrated into a single component. For example, the user interaction device may be a touchscreen, such as a smartphone, tablet, personal digital assistant, Huawei's central control screen, etc. The control host in the central device acts as the brain of the whole-house smart devices, and is equipped with an edge cloud central service process. It can receive operation information from the user operation component, respond to user operations, manage and control the smart devices, and interact with the server of the smart device service platform (such as a second server), etc. The display component is used to display information such as management and control results.

[0163] Understandably, the functionality of a central device relies on the collaboration between hardware and software. The software can be the central device's operating system, the user interface of its display components and / or user operation components, or a presentation of some of the operating system's functions.

[0164] Taking smart home devices as an example, such as Figure 4a As shown, the central device of a smart home local area network (LAN) may include a central control screen and a control host, which manage and control smart devices within the LAN, such as security equipment, audio-visual equipment, home appliances, lighting equipment, sunshade devices, and heating / cooling / ventilation equipment. For example, the central control screen and control host can be connected wirelessly or via a wired connection. For example, security equipment may include smart door locks, smart windows, cameras, etc. Audio-visual equipment may include televisions, music players, speakers and / or gateways, projectors, microphones, etc. Home appliances may include washing machines, robot vacuums, water heaters, refrigerators, microwave ovens, rice cookers, ovens, range hoods, dishwashers, etc. Lighting equipment may include main lights and auxiliary lights (such as ambient lights, decorative lights, etc.). Sunshade devices may include smart curtains, smart sunshade curtains, etc. Heating / cooling / ventilation equipment may include air conditioners, electric heaters, fresh air systems, humidifiers, air purifiers, etc.

[0165] For example, the user interface of the central control screen is as follows: Figure 4b As shown, it can display operation buttons for user operation, such as "Switch", "One-click movie viewing", "All lights on", "All lights off", "Curtains open", "Curtains closed", etc. It can also display the processing results, such as "Y group lights on", etc.

[0166] In some embodiments, a smart device may install a Software Development Kit (SDK) integrating cross-device communication capabilities, such as the distributed soft bus in the HarmonyOS operating system, to form a distributed network with surrounding smart devices that also possess cross-device communication capabilities. All smart devices in this distributed network can be considered as a single device, possessing the functionality of all smart devices within the network. For ease of description, the SDK integrating cross-device communication capabilities will be referred to as the soft bus below. It is understood that the cross-device communication capabilities of the soft bus are based on the underlying communication functions of the smart device, such as Bluetooth, WiFi, Ethernet, infrared, PLC, NFC, Zigbee, and UWB.

[0167] For example, when the central device and the terminal device with the smart device management APP are equipped with a soft bus, the central device and the smart device management APP can discover, connect to and control the smart device through the soft bus.

[0168] When the aforementioned smart device management APP or central device controls a smart device, it first needs to bind the smart device. Secondly, when responding to the user's operation and controlling the bound smart device, it assembles control commands according to the device control protocol, which consumes a large amount of software and hardware resources. This means that the terminal device needs to have certain software and hardware resources to become the control end of the smart device and control the smart device. Wearable devices, speakers, and other lightweight second-type devices (examples of second-terminal devices) have limited software and hardware resources and do not have a smart device management APP (such as a smart life APP) installed, so they do not have the possibility of acting as the control end of the smart device to control the smart device.

[0169] However, in the field of whole-house smart home applications, the rapid development of smart devices has led to a continuous increase in the number of smart devices in users' homes. Many of these smart devices have limited resources, making it impossible to store large amounts of device data or create complex UIs. Their interactive screens are small, and their entry points are singular. Furthermore, these resource-limited second-type devices are designed for easy portability, such as wearable devices like smartwatches, bracelets, rings, and glasses.

[0170] Therefore, embodiments of this application provide a method for controlling a smart device. This method is applied to a second terminal device, which obtains information from a first terminal device, generates a shortcut for controlling the smart device based on that information, and controls the smart device based on the user's operation of the shortcut. Exemplarily, the first terminal device can be the first type of device described above, the central device described above, or the smart device described above. Exemplarily, the second terminal device can be the second type of device described above.

[0171] In this embodiment, the second terminal device can generate shortcuts based on the acquired information and control the smart device based on the user's operation of the shortcuts. This makes it easier to control the smart device in certain scenarios and improves the user experience. For example, when a user cannot find the remote control for a certain smart device (such as a smart TV, air conditioner, or light fixture) at home, they can quickly control the smart device through a shortcut temporarily or pre-generated by the second terminal device. Alternatively, for example, when it is inconvenient for a user to control the smart device through a smart device management app, mobile phone, or central device, such as when the user is driving, they can quickly control the smart device through shortcuts on the second terminal device, improving the user experience.

[0172] In this article, a shortcut is a control entry point provided to users for quickly controlling smart devices.

[0173] For example, this information may include the identifier of the smart device, the command used to control the smart device, and the command name. This information is small in size, facilitates rapid transmission, and the resulting convenient method of controlling the smart device saves time, responds quickly, and helps improve the user experience.

[0174] For example, this information may look like this:

[0175]

[0176] Alternatively, the configuration information can be as follows:

[0177]

[0178] Alternatively, the configuration information can be as follows:

[0179]

[0180] etc.

[0181] In this context, "dev_id":"xxx" indicates that the smart device identifier is "xxx", "name":"Turn on TV" and "name":"Play XX" indicate that the command names are "Turn on TV" and "Play XX" respectively, and "cmd":"command" indicates that the command used to control the smart device is "command". Here, "command" can be a string with control functions or a pre-designed short command identifier.

[0182] For example, the second terminal device and the first terminal device can transmit the above information in the form of files (such as config.json, quick_operation.json, etc.), strings, binary, etc.

[0183] For example, a second terminal device can, under the user's operation, obtain information from the first terminal device by touching or approaching it, and generate a shortcut based on that information. Subsequently, the second terminal device can control the smart device based on the user's operation of the shortcut. In some embodiments, the process of the second terminal device obtaining information from the first terminal device and generating a shortcut based on that information may be invisible.

[0184] For example, when the second terminal device has a touchscreen, the shortcut generated by the second terminal device based on the obtained information can be a control button displayed on the touchscreen. The name of the control button can be a command name, such as "Open XX", "Close XX", etc.

[0185] For example, when a user cannot find the remote control for a smart device (such as a smart TV, air conditioner, or light fixture) at home, a second terminal device can, under the user's operation, obtain information from the smart device by touching or approaching it, and generate a shortcut for controlling the smart device based on that information. Then, the second terminal device can control the smart device based on the user's actions using that shortcut. The process of the second terminal device obtaining information from the smart device and generating the shortcut based on that information can be invisible.

[0186] like Figure 5 As shown, when a user taps or brings their wristwatch close to the smart TV, the watch responds by displaying a shortcut on the screen. For example... Figure 6a As shown, the watch screen displays control buttons such as "Turn on TV" and "Turn off TV". When the user clicks the "Turn on TV" control button on the watch screen, as shown... Figure 6b As shown, the watch responds to the user's input and controls the smart TV to turn on. When the user clicks the "Turn off TV" control button, as shown... Figure 6c As shown, the watch responds to the user's actions and turns off the smart TV.

[0187] In the above embodiments, the process of the second terminal device (watch) controlling the smart device (television) can be as follows: Figure 6d As shown, the second terminal device identifies the user's operation shortcut and discovers and connects to the central device via the soft bus. Then, the second terminal device sends a device identifier and control command to the central device based on the user's operation. The central device parses the information sent by the second terminal device to obtain the device identifier and control command. Based on the device identifier, the central device determines that the control object of the control command is a specific smart device (such as a television) and sends the control command to that smart device. The smart device executes the control command, and the second terminal device then controls that smart device.

[0188] For example, before the watch displays shortcuts (such as control buttons) on the interface, it may also include: receiving information sent by the smart TV, and generating shortcuts based on that information.

[0189] For example, the shortcut generated by the second terminal device can also be a voice shortcut.

[0190] Still with Figure 5 For example, when a user taps their wristwatch against or brings it close to a smart TV, the watch responds to the user's action and displays a shortcut prompt on the interface. Figure 7a As shown, the watch interface displays messages such as "Please say 'Turn on TV' to turn on the TV" and / or "Please say 'Turn off TV' to turn off the TV." When the user says "Turn on TV" to the watch, as shown... Figure 7b As shown, the watch responds to the user's voice commands to turn on the smart TV. When the user says "Turn off the TV" to the watch, as shown... Figure 7c As shown, the watch responds to the user's voice command to turn off the smart TV.

[0191] For example, before the watch displays a shortcut prompt on the interface, it may also include: receiving information sent by the smart TV, and generating a shortcut based on that information.

[0192] The watch in the above embodiments can be replaced by a bracelet, and the way it controls the first smart device can be the same as the watch in the above embodiments.

[0193] In some embodiments, a user can tap the smart glasses against a smart TV, or bring the smart glasses close to the smart TV. The smart glasses can respond to the user's action, receive information sent by the smart TV, and generate interface controls or voice shortcuts based on that information. The user can then control the smart TV to turn on by operating the interface controls displayed on the smart glasses or by saying "Turn on the TV." For example, when the user says "Turn off the TV," the smart glasses can respond to the user's voice command and turn off the smart TV.

[0194] For example, when a user touches or brings the smart glasses close to the smart TV, the smart glasses or smart TV can respond to the user's action and display prompts on the screen. For example, the smart TV screen may display prompts such as "Please say 'Turn on the TV' to the smart glasses to turn on the TV" and / or "Please say 'Turn off the TV' to the smart glasses to turn off the TV." For example, the prompts provided by the smart TV may also be in the form of voice, visual + text prompts, etc.

[0195] like Figure 9aAs shown, when a user touches or brings the ring on their finger near the smart TV, the ring responds to the user's action, retrieves information from the smart TV, and generates a voice shortcut based on that information. When the user says "Turn on the TV" to the ring on their finger, such as... Figure 9c As shown, the ring responds to the user's voice commands to turn on the smart TV. When the user says "turn off the TV" to the ring on their finger, as shown... Figure 9d As shown, the ring responds to the user's voice command to turn off the smart TV.

[0196] For example, further, when a user touches or brings a ring on their finger near the smart TV, the smart TV can respond to the user's action and display a prompt message on the screen. For instance... Figure 9b As shown, the smart TV screen displays prompts such as "Please say 'Turn on the TV' to the ring to turn on the TV" and / or "Please say 'Turn off the TV' to the ring to turn off the TV." For example, the prompts provided by the smart TV can also be in the form of voice, visual + text prompts, etc.

[0197] For example, the shortcut generated by the second terminal device can also be an action shortcut.

[0198] like Figure 5 As shown, when a user taps their wristwatch against the smart TV or brings it close, the watch responds by displaying a shortcut prompt on the screen. For example... Figure 10a As shown, the screen displays an image of a wrist wearing a watch raised and then swiped down, along with the text prompt "Turn the TV on / off." Alternatively, as... Figure 10b As shown, the watch's interface displays the text "Please raise your wrist and then swipe down to turn the TV on / off." For example, "raise your wrist and then swipe down" could also be replaced by other actions such as "shaking your wrist." The prompt message can also take other forms; there are no limitations on this.

[0199] When the user raises their wrist while wearing the watch and then swipes down, as... Figure 10c As shown, the watch responds to the user's actions and controls the TV to turn on. When the user wants to turn off the TV, they raise their wrist wearing the watch and then swipe down, as shown. Figure 10d As shown, the watch responds to the user's actions and turns off the TV.

[0200] For example, before displaying the prompt information for the action shortcut, the watch may further include: obtaining information from a smart TV, and generating the action shortcut based on that information.

[0201] like Figure 9a As shown, when a user touches or brings a ring on their finger near the smart TV, the smart TV responds to the user's action and displays a shortcut prompt on the screen. For example... Figure 11aAs shown, the television screen displays an image of a finger wearing a ring waving, along with text messages such as "Turn the TV on / off." Alternatively, the television screen displays the text message "Please waving your finger to turn the TV on / off." For example, "waving your finger" can also be replaced by other actions such as "moving your finger down" or "your finger is saying 'move.'" The prompt message can also take other forms, which are not limited here.

[0202] When the user's finger wearing the ring moves, such as Figure 11b As shown, the ring responds to user input, controlling the smart TV to turn on. When the user wants to turn off the TV, they shake their finger, as shown... Figure 11c As shown, the ring responds to the user's actions and turns off the smart TV.

[0203] For example, when the second terminal device (which could also be a user) is close to the central device, the second terminal device can also obtain information based on the user's tapping or approaching of the central device (such as a router). For example, when the second terminal device (which could also be a user) is close to a terminal device capable of installing a smart device management app (such as a smartphone, tablet, etc.), or based on the user's tapping or approaching of a terminal device capable of installing a smart device management app, information is obtained, and a shortcut is generated based on that information. In both examples, the principle of the second terminal device obtaining information, generating a shortcut, and using the shortcut to control the smart device is the same as in the above embodiments.

[0204] In the above embodiments, the second terminal device obtains information based on the user's tapping or approaching operation of the first terminal device, generates a shortcut based on the information, and controls the smart device based on the user's operation of the shortcut. This allows the user to select the nearest tapping or approaching operation object from among the smart device, the central device, and terminal devices with the ability to install a smart device management APP, thereby improving the user's convenience experience.

[0205] For example, if a user cannot find the remote control for a smart device and is near a router, they can tap or bring a second terminal device close to the router. The second terminal device will then generate any of the shortcuts described above based on this action. Alternatively, if a user cannot find the remote control for a smart device and a family member is using a smartphone nearby, the user can tap or bring a second terminal device close to the smartphone. The second terminal device can then generate any of the shortcuts provided in the above embodiments based on the user's tapping or bringing the smartphone close. And so on.

[0206] For example, before the second terminal device generates the shortcut, it may further display the progress of information transmission, display information transmission prompts, such as "Information being received..." or "Information has been received x%", etc.

[0207] For example, before the second terminal device generates the shortcut, it can further display the progress of shortcut generation, such as displaying "Shortcut generating..." or "Generating shortcut," etc. on the second terminal device interface. Alternatively, it can display "Shortcut generated y%" or a prompt indicating that the shortcut is being generated, etc.

[0208] For example, in the above-mentioned method where the second terminal device obtains information for generating a shortcut by tapping or approaching the first terminal device, the second terminal device and the first terminal device can interact based on NFC or on short-range wireless communication methods such as Bluetooth.

[0209] For example, the second terminal device can also obtain information for generating shortcuts from the first terminal device via a soft bus based on the user's operation.

[0210] For example, the second terminal device and the first terminal device are located in the same home area network, and both the second terminal device and the first terminal device are equipped with a soft bus. For instance, when a user clicks the soft bus icon on the interface of the second terminal device, the second terminal device can respond to the user's operation, retrieve information from the first terminal device, and generate a shortcut based on that information. Alternatively, the second terminal device can display a HyperTerminal interface, which can display an icon corresponding to the first terminal device that can share the information. The user can click the icon to select the corresponding first terminal device to share the information. For details on how the second terminal device generates a shortcut based on the information and how the user operates on the shortcut, please refer to the description in the above embodiments.

[0211] like Figure 12a As shown, the wearable device (such as a watch) and the living room TV are on the same home LAN, and both the watch and the TV are connected via a software bus. When the user clicks the "Discover Shortcuts" icon on the watch's interface, as shown... Figure 12b As shown, the watch can display the device installed that sends information for creating shortcuts, based on the user's actions. For example, when the user needs to turn on the TV, they can... Figure 12c As shown, tap the living room TV icon on the watch interface. Based on the user's input, the watch interface first displays a message sent from the living room TV to the watch, then displays control buttons generated based on that message. The step of displaying the living room TV sending a message to the watch can be omitted; it can be done as follows: Figure 12d As shown, the watch displays control buttons on the interface based on the user's actions. For example, the shortcuts generated by the watch based on information can also be voice shortcuts, action shortcuts, etc., as detailed in the above embodiments. For example, the principle by which the watch controls the television based on the user's actions is the same as in the above embodiments.

[0212] like Figure 13aAs shown, the air conditioner has pre-installed information 'a' for generating shortcuts to control it, and the light fixture has pre-installed information 'b' for generating shortcuts to control it. When the air conditioner and light fixture are bound to the local area network (LAN) based on user actions, the air conditioner reports its capability A to the central device, which can carry information 'a'; the light fixture reports its capability B to the central device, which can carry information 'b'. Information 'a' can be used to generate shortcuts to control the air conditioner, and information 'b' can be used to generate shortcuts to control the light fixture. Afterward, the air conditioner, light fixture, watch, and central device are located on the same home LAN. No soft bus is installed in the air conditioner and light fixture. If the user wants to quickly control the air conditioner and / or light fixture via the watch, information 'a' and / or information 'b' needs to be obtained from the central device based on the user's actions.

[0213] like Figure 13b As shown, when the user taps the central device on the watch interface, the watch displays the generated control buttons on the interface based on the user's operation: "Turn on the air conditioner", "Turn off the air conditioner", "Turn on the lights", and "Turn off the lights".

[0214] For example, before the watch displays the generated shortcut on the interface, it further includes: obtaining information a and information b (such as...) from the central device. Figure 13a As shown), and generate control buttons for controlling the air conditioner based on information a, and control buttons for controlling the lights based on information b.

[0215] For example, when a user taps the central device in the watch interface, such as Figure 13c As shown, before the watch displays the generated control buttons on the interface based on the user's operation, it also includes: a schematic screen showing the central device sending information to the watch.

[0216] For example, the shortcuts generated by the watch based on the information for controlling the air conditioner and / or lights can also be voice shortcuts, action shortcuts, etc., as detailed in the above embodiments.

[0217] For example, the watch can also control the user's actions from a mobile phone (such as...). Figure 13b The “My Phone” shown obtains information a and / or information b via a soft bus, similar to how a watch obtains information a and / or information b from a central device via a soft bus.

[0218] For example, the principle by which the watch controls the air conditioner and / or lights based on the user's operation can be the same as in the above embodiments.

[0219] For example, the second terminal device that controls the air conditioner and / or lighting according to the user's operation can also be a wristband, etc., with the same principle as the above embodiments.

[0220] The technical solution provided in the above embodiments can be used to allow a second terminal device to obtain information in real time based on the user's operation when the user needs to control the smart device, and generate a shortcut for controlling the smart device based on the information, so that the user can quickly control the smart device, which can meet the user's real-time needs and improve the user experience of controlling the smart device.

[0221] For example, the second terminal device can also obtain information in advance and generate shortcuts based on that information, so that the user can quickly control the smart device when needed. The second terminal device obtains information from the first terminal device by having the first terminal device send information to the second terminal device based on the user's actions. In this way, the user can operate the first terminal device when idle, and the second terminal device obtains the information and generates shortcuts, improving the flexibility of shortcut generation by the second terminal device. This helps users to better manage their time and further enhances the user experience of controlling the smart device.

[0222] For example, the first terminal device sends information to the second terminal device based on the user's operation. This can be achieved by the first terminal device sending information to the second terminal device based on the user's operation on the smart device management APP interface.

[0223] Taking the smart living app installed on a mobile phone as an example, users can... Figure 2a As shown, click the Smart Life icon. The Smart Life app will then display the following based on this action: Figure 2b The interface shown. When the user... Figure 14a As shown, clicking the "Living Room TV" control in the Smart Life APP interface will cause the Smart Life APP to display the following based on this action. Figure 14b The interface shown. When the user clicks the "Yes" button in the share shortcut section of the interface, the Smart Life APP can, based on this action, such as... Figure 15a Or such as Figure 15b As shown, the system queries the server for the soft bus device, receives the query results from the server, and displays the results. Figure 14c or Figure 14e As shown, the Smart Life APP interface displays search results for watches, bracelets, rings, and speakers, among others.

[0224] When the user clicks as Figure 14c When the watch is displayed on the screen shown, the Smart Life APP can display the following based on this operation: Figure 14d The interface shown. When the user clicks as shown... Figure 14d When the user clicks the "Confirm" button on the interface shown, or when the user clicks as shown... Figure 14e When the watch button is pressed as shown, the Smart Life App can send information to the watch based on this operation. The Smart Life App will then send information based on the user's selected sharing recipient, such as... Figure 15a and Figure 15bAs shown, select the watch as the recipient of the message. Then, as... Figure 15a As shown, the smart device management app (Smart Life App) discovers and connects to the second terminal device (watch), and sends information to the second terminal device (watch). Or, as... Figure 15b As shown, the smart device management APP (Smart Life APP) sends information to the server, and the server then sends the information to the second terminal device (watch).

[0225] For example, the smart device management app can further display the results of information sending or sharing on the interface, such as... Figure 14f As shown, the Smart Life APP interface displays "Sharing complete".

[0226] For example, the first terminal device sending information to the second terminal device in response to the user's operation may be the first terminal device's operating system sending information to the second terminal device in response to the user's operation on the first terminal device's operating system interface.

[0227] Taking mobile phones as an example, such as Figure 16a As shown, users can tap the settings icon on their phone's screen. The phone will then respond to the user's action by displaying the following... Figure 16b The interface shown. When the user clicks... Figure 16b When the "Share Smart Device Shortcut" option is selected in the interface shown, the phone can respond to this operation, such as... Figure 15a Or such as Figure 15b As shown, it queries the server for the soft bus device, receives the query results from the server, and can display the query results. Figure 16c As shown, the mobile phone interface displays query results that may include second terminal device c1, second terminal device c2, ..., second terminal device cn, etc. When the user taps... Figure 16c When the second terminal device c1 is displayed in the interface shown, the mobile phone can respond to this operation by selecting the second terminal device c1 as the recipient of the information or the recipient of the information, and then send the information to the second terminal device c1. For example... Figure 15a As shown, the first terminal device (mobile phone) discovers and connects to the second terminal device (c1), and sends information to the second terminal device (c1). Alternatively, as... Figure 15b As shown, the first terminal device (mobile phone) sends information to the server, and the server then sends the information to the second terminal device (c1).

[0228] For example, the smart device management app / first terminal device can be pre-bound to all smart home devices, as shown in Figure 15 or Figure 16. This can be done by binding all smart home devices to the same Huawei account within the Smart Life app.

[0229] For example, the first terminal device may further display the result of information transmission or sharing on the interface. For instance, a mobile phone's interface may be as follows: Figure 14f As shown, it displays "Sharing complete".

[0230] For example, after the first terminal device sends information to the second terminal device in response to the user's operation, the second terminal device generates a shortcut based on the information and controls the smart device based on the user's operation on the shortcut, which is the same as in the aforementioned embodiments.

[0231] For example, the mobile phone can send information for generating a shortcut to control the smart TV to the speaker via a pre-shared method as provided in any of the above embodiments. Upon receiving the information, the speaker can utilize its own system capabilities to generate a voice shortcut based on that information. Subsequently, the speaker can... Figure 8a and Figure 8b As shown, it responds to voice commands issued by the user to control the smart TV.

[0232] In the above embodiments, the pre-generated shortcuts on the second terminal device can bring convenience to users in certain scenarios. For example... Figure 17a As shown, when a parent is driving outdoors, their child calls and asks to turn on a device (e.g., "I want to watch TV"). While driving, the parent can use pre-generated shortcuts on the watch (see the aforementioned embodiment) to perform corresponding quick operations on their wrist (see the aforementioned embodiment). For example, after finishing the call with the child and lowering their arm, the parent can raise and lower their wrist. The watch can then control the TV to turn on based on the user's actions. Figure 17a In the diagram, the dotted-line arrows represent the paths through which the watch sends control messages. A flowchart illustrating how a watch controls a home television could be shown below. Figure 17b As shown, when a user operates a shortcut on the watch, the watch determines its network connection status based on the user's action. When connected to the network, the watch sends a device identifier and control commands to the server. Upon receiving the device identifier and control commands, the server forwards them to the corresponding central device. The central device parses the information sent by the server, obtains the device identifier and control commands, and sends the control commands to the controlled device (TV) based on the device identifier. The controlled device (TV) receives and executes the control commands, such as turning on the power and outputting an image, etc.

[0233] For example, users can also control their home television via devices such as wristbands or rings with pre-generated shortcuts; the control process can be found in [link to documentation]. Figure 17b .

[0234] For example, users can also control other smart devices in their homes, such as air conditioners, water heaters, and lights, from outdoors using second-terminal devices such as watches, bracelets, rings, glasses, or portable speakers. The control process can be found in [link to relevant documentation]. Figure 17b .

[0235] Another method for controlling a smart device provided in this application embodiment is as follows: Figure 18 As shown, this method can be applied to an intelligent device control system, which may include a first terminal device and a second terminal device.

[0236] The first terminal device can be used to control or is the first smart device. For example, the first terminal device can be a terminal device with a smart device management app installed, such as a smart living app or an easy-to-use app, to control smart devices. Examples include smartphones, tablets, and laptops. It can also be a central device for a smart home system, or a smart device (such as a smart TV or air conditioner), and so on. The second terminal device can be a lightweight terminal device such as a wearable device (e.g., a smartwatch, bracelet, ring, glasses), or a speaker. Due to limited hardware and software resources, it does not have an application installed to control the first smart device, and the first terminal device is connected to the second terminal device. The connection between the first and second terminal devices can be a near-field connection (e.g., NFC, Bluetooth, or StarFlash) or a network connection (e.g., Wi-Fi, cellular network, or soft bus connection).

[0237] like Figure 18 As shown, the method may include:

[0238] Step 1801: The second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device.

[0239] In some embodiments, before step 1801, the method may further include: the first terminal device sending first information to the second terminal device based on a near-field communication method with the second terminal device.

[0240] In some embodiments, before step 1801, the method may further include: a first terminal device presenting a sharing interface for sharing first information. For example, the first terminal device may present the sharing interface based on near-field communication with the second terminal device described above. This sharing interface is not limited to... Figure 14b , Figure 16b and Figure 19a The interface shown is illustrated. For example, the operation used to trigger near-field communication could be a user-initiated touch or proximity action, as detailed in the above embodiments.

[0241] In some embodiments, prior to step 1801, the method may further include: a first smart device reporting capability information to a first terminal device, the capability information being used to provide first information. For example, the first terminal device may obtain the first information based on the capability information. For example, the capability information may include the first information. Figure 13aAs shown, the first terminal device can be a central device, and the first smart device can be an air conditioner or a lamp, etc. Before the central device displays the sharing interface, when the central device binds to a smart device such as an air conditioner or a lamp, the smart device such as the air conditioner or a lamp reports its capability information, which includes the first information.

[0242] For example, the first information may be information used to generate shortcuts in any of the above embodiments, such as the identifier of the smart device, the command to control the smart device, and the command name.

[0243] In some embodiments, the first terminal device presents a sharing interface, which may include: the first terminal device presents a sharing interface based on the second terminal device's tap or proximity.

[0244] For example, in response to a user's tap or proximity to the first terminal device, the second terminal device may send a request to the first terminal device through a connection with the first terminal device. The first terminal device receives the request sent by the second terminal device through the connection, and the request is used to obtain first information.

[0245] Accordingly, the first terminal device can respond to the request of the second terminal device and present a sharing interface through the system capabilities of the first terminal device.

[0246] In some embodiments, before step 1801, the method may further include: the second terminal device presenting a sharing interface, so that the second terminal device can generate a first control method in response to the user's operation on the sharing interface presented by the second terminal device, and control the first smart device in response to the user's operation using the first control method.

[0247] For example, the connection between the first terminal device and the second terminal device can be established by the second terminal device in response to a user's tap or proximity to the first terminal device. Before the first terminal device receives a request sent by the second terminal device through the connection, it may further include:

[0248] In response to the aforementioned tap-to-touch or proximity operation of the first terminal device, the second terminal device sends a request to the first terminal device through the connection between the two devices. Related embodiments are not limited to those described above. Figure 5 , Figure 8a , Figure 8b and Figure 9a The example shown.

[0249] In some embodiments, when the second terminal device touches or approaches the first terminal device under the user's operation, the first terminal device displays a sharing interface, such as... Figure 19aAs shown, when the smartwatch is touched or brought close to the second terminal device, it displays various function cards, including a sharing shortcut. In some embodiments, when the smartwatch is touched or brought close to the second terminal device, it may display only the sharing shortcut card, or it may display the sharing shortcut card and any one or more other cards.

[0250] In some embodiments, presenting a sharing interface on the first terminal device may include: the first terminal device presenting a sharing interface based on the user's operation on the options in the interface of the second terminal device, wherein the options correspond to the first terminal device. For example, the connection between the first terminal device and the second terminal device may also be via a soft bus or similar means.

[0251] The second terminal device can respond to user operations and display options corresponding to those on the first terminal device, such as... Figure 12b The illustrated embodiment;

[0252] The second terminal device can respond to the user's operation on the option by sending a request to the first terminal device through the connection, such as... Figure 12c , Figure 13c The illustrated embodiment. Accordingly, the first terminal device can respond to a request from the second terminal device and, through the system capabilities of the first terminal device, present a sharing interface.

[0253] In some embodiments, the first terminal device displays a sharing interface, which may include:

[0254] The first terminal device responds to the user's operation and presents a sharing interface through the first application or the system capabilities of the first terminal device, including but not limited to: Figure 14a , Figure 14b , Figure 16a , Figure 6b The example shown.

[0255] For example, prior to step 1801, the following may also be included:

[0256] The first terminal device obtains the type or identifier of the second terminal device;

[0257] The first terminal device determines one of the control methods—control method, voice control method, or action control method—as the first control method based on the type or identifier of the second terminal device.

[0258] For example, when a user selects an option corresponding to a watch or bracelet from the options presented on the first terminal device, the first terminal device can determine that the second terminal device is resource-rich, has a user interface, and is portable, thus determining the first control method as control, voice, and motion control. As another example, when a user selects an option corresponding to a ring from the options presented on the first terminal device, the first terminal device can determine that the second terminal device has fewer resources, lacks a user interface, but is portable, thus determining the first control method as motion control. Yet another example, when a user selects an option corresponding to a speaker from the options presented on the first terminal device, and the user selects a speaker as the second terminal device, the first terminal device can determine that the second terminal device lacks a user interface, is not portable, but allows voice input, thus determining the first control method as voice control, and so on.

[0259] For example, step 1801 may include: the second terminal device receiving first information sent by the first terminal device through a connection with the first terminal device. For example, the second terminal device may receive first information sent by the first terminal device according to a request from the second terminal device. Or, for example, the second terminal device may receive first information sent by the first terminal device in response to a user's operation.

[0260] Step 1802: The second terminal device generates a first control method for controlling the first smart device based on the first information and by utilizing the system capabilities of the second terminal device.

[0261] For example, step 1802 may include: the second terminal device, based on the first information, using the system capabilities of the second terminal device, displaying controls for controlling the first smart device, such as... Figure 6a As shown.

[0262] Or, for example, step 1802 may include: the second terminal device generating a voice control method based on the first information, utilizing the system capabilities of the second terminal device, such as... Figure 7a , Figure 8b , Figure 9b As shown. In some embodiments, the voice control method may further include controls, such as... Figure 19b As shown, the watch face can display a button for voice input, which is marked with a microphone icon. When the user presses the button, the watch starts receiving voice signals. After the user speaks the voice command, they can release the button to complete the voice command input. Alternatively, the user can press and release the button, and the watch will start receiving voice signals. The user can then speak the voice command to complete the voice command input.

[0263] Or, for example, step 1802 may include: the second terminal device generating an action control method based on the first information using the system capabilities of the second terminal device, such as... Figure 10a , Figure 11aAs shown.

[0264] Step 1803: The second terminal device responds to the user's operation using the first control method and controls the first smart device.

[0265] For example, step 1803 may include: the second terminal device responding to a user operation control to control the first smart device, such as... Figure 6b and Figure 6c As shown.

[0266] Or, for example, step 1803 may include: the second terminal device controlling the first smart device in response to the user uttering a voice that matches the voice control method, such as... Figure 7b , Figure 7c , Figure 8a , Figure 8b , Figure 9c and Figure 9d As shown.

[0267] Or, for example, step 1803 may include: the second terminal device controlling the first smart device in response to the user making an action matching the motion control method, such as... Figure 10c , Figure 10d , Figure 11b and Figure 11c As shown.

[0268] In some embodiments, when the first control method is voice control, the process before step 1803 may further include:

[0269] The second terminal device or the first terminal device displays prompts related to the voice control method, such as... Figure 7a , Figure 19c As shown.

[0270] In some embodiments, when the first control method is an action control method, before step 1803, the following may also be included:

[0271] The second terminal device or the first terminal device displays prompts related to the action control method, such as... Figure 10a , Figure 10b , Figure 19d As shown.

[0272] In some embodiments, step 1803 may include:

[0273] The second terminal device responds to the user's operation using the first control method by sending the identifier and control commands of the first smart device to control the first smart device, such as... Figure 6d , Figure 17b As shown.

[0274] In some embodiments, the second terminal device may generate multiple control methods based on information used to control the first smart device. For example, the method for controlling the smart device may further include, based on this embodiment:

[0275] Based on the first information, the second terminal device uses its system capabilities to generate a second control method for controlling the first smart device. For example, the second control method may be similar to the first control method, such as a control panel control method, a voice control method, or an action control method.

[0276] The second terminal device responds to the user's operation using the second control method and controls the first smart device.

[0277] For example, the second terminal device can display not only such as Figure 6a The controls shown can also display voice controls and / or action prompts, allowing users to control the first smart device using appropriate control methods according to their actual needs.

[0278] In some embodiments, the second terminal device may generate a control method for controlling multiple smart devices. For example, the first terminal device may also be used to control the second smart device or the second smart device itself. The second terminal device may not have an application installed for controlling the second smart device. Based on this embodiment, the method for controlling the smart device may further include:

[0279] The second terminal device obtains second information associated with controlling the second smart device from the first terminal device through the connection with the first terminal device. For example, the second information may be similar to the first information, such as being used to generate a control method for controlling the second smart device, or may include, for example, the identifier or index of the second smart device, control commands and command names, etc.

[0280] Based on the second information, the second terminal device uses its system capabilities to generate a third control method for controlling the second smart device. For example, the third control method may be similar to the first control method, such as the aforementioned control method, voice control method, action control method, etc.

[0281] The second terminal device responds to the user's operation using the third control method and controls the second smart device.

[0282] For example, when the first terminal device is a central device, the central device obtains information for controlling smart devices such as air conditioners and lights from the capability information reported by these smart devices by binding them to the central device. When the second terminal device requests information associated with controlling the smart devices from the central device, the second terminal device can receive the information associated with controlling the smart devices such as air conditioners and lights. Figure 13bAs shown, the second terminal device can generate controls for both air conditioning and lighting.

[0283] In some embodiments, the smart device control system may further include a third terminal device, which does not have an application installed for controlling the first smart device. The third terminal device is connected to the first terminal device, and after the first terminal device displays a sharing interface, the method for controlling the smart device is... Figure 18 Based on the illustrated embodiment, it may also include:

[0284] The first terminal device responds to the user's operation on the sharing interface by presenting a first option corresponding to the second terminal device and a second option corresponding to the third terminal device, which is not limited to, for example... Figure 14b , Figure 14c , Figure 14d , Figure 14e , Figure 14f , Figure 16b , Figure 6c The example shown;

[0285] In response to the user's operation on the first option, the first terminal device sends the first information to the second terminal device;

[0286] In response to the user's operation on the second option, the first terminal device sends third information to the third terminal device. The third information is associated with controlling the first smart device. For example, the third information may be similar to the first information, such as being used to generate at least one control method among controls, voice control, and action control, or it may include the identifier or index of the first smart device, control commands, and command names, etc.

[0287] The third terminal device receives third information through its connection with the first terminal device;

[0288] The third terminal device generates a fourth control method for controlling the first smart device based on the third information and using the system capabilities of the third terminal device; for example, the fourth control method can be any one of the following: control panel, voice control, and motion control.

[0289] The third terminal device responds to the user's operation using the fourth control method and controls the first smart device.

[0290] For example, the third terminal device can be the second type of device described above.

[0291] and Figure 18 Corresponding to the method embodiments shown, an example of a method for controlling a smart device provided in this application is as follows: Figure 20 As shown, the first terminal device applied in the above-mentioned intelligent device control system, and Figure 18Similarly, in the illustrated embodiment, the first terminal device can be a first type of device with the first application installed. The first terminal device is connected to the second terminal device in the aforementioned intelligent device control system. The second terminal device is a second type of device with limited hardware and software resources and does not have the first application installed. The method includes:

[0292] Step 2001: The first terminal device, through the first application or the system capabilities of the first terminal device, presents a sharing interface. This sharing interface is used to share and control first information associated with the first smart device. For example, the sharing interface may be as follows: Figure 14b , Figure 16b and Figure 19a As shown.

[0293] For example, when the first terminal device is a central device, before step 2001, the following may also be included:

[0294] The first terminal device receives capability information reported by the first smart device, the capability information including the first information.

[0295] In some embodiments, the presentation of the above interface by the first terminal device is triggered by the second terminal device. For example, before step 2001, it may further include:

[0296] The first terminal device receives a request sent by the second terminal device through the connection, the request being used to obtain first information;

[0297] Accordingly, step 2001 may include: the first terminal device may, in response to a request, present a sharing interface through the system capabilities of the first terminal device. For example, after the mobile phone is touched or brought near by the second terminal device, a sharing interface is presented as follows. Figure 19a The interface shown.

[0298] In some embodiments, step 2001 may include: the first terminal device responding to a user operation by presenting a sharing interface through a first application or the system capabilities of the first terminal device. For example... Figure 14a , Figure 14b , Figure 16a and Figure 16b As shown.

[0299] Step 2002: In response to the user's operation on the interface, the first terminal device presents options corresponding to at least one second type of device, where the at least one second type of device includes the second terminal device. For example... Figure 14c and Figure 16c As shown. Step 2003: In response to the user's operation on the option, the first terminal device sends first information to the second terminal device. The first information is used by the second terminal device to generate a first control method. The first control method is used to control the first smart device. See the description of the above embodiment for details.

[0300] In some embodiments, the first terminal device is also connected to a third terminal device in the aforementioned intelligent device control system. The third terminal device is a second type of device. In step 2002, the option corresponding to at least one second type of device may include a first option and a second option. The first option corresponds to the second terminal device, and the second option corresponds to the third terminal device. Correspondingly, step 2003 may include:

[0301] In response to the user's operation on the first option, the first terminal device sends the first information to the second terminal device;

[0302] In response to the user's action on the second option, the first terminal device sends third information to the third terminal device. This third information is used by the third terminal device to generate a fourth control method, which is then used to control the first smart device. See details. Figure 18 Description of the illustrated embodiments.

[0303] In some embodiments, prior to step 2003, the following may also be included:

[0304] The first terminal device responds to the user's operation on the option and obtains the type or identifier of the second terminal device;

[0305] Based on the type or identifier of the second terminal device, determine one of the following as the first control method: control via buttons, voice control, or motion control. See details... Figure 18 Description of the illustrated embodiments.

[0306] like Figure 14d As shown, when the user selects a watch, the mobile phone can determine that the watch is a device with a screen, and thus send information to the watch that can generate interface controls. In some embodiments, when the user selects a ring, the mobile phone determines that the ring is a device without a screen, and then sends information to the ring that can generate voice control methods and / or motion control methods. Since watches have more hardware and software resources than rings, in some embodiments, in addition to sending information that can generate interface controls, the mobile phone can also send information that can generate voice control methods and / or motion control methods to the watch, enabling the watch to generate more control methods to meet more user needs and further improve ease of use and user experience.

[0307] In some embodiments, the first control method may be a voice control method or a motion control method. After step 2003, the method may further include: presenting prompts related to the voice control method or the motion control method, such as... Figure 7a , Figure 19c , Figure 10a , Figure 10b , Figure 19d As shown.

[0308] In some embodiments, the first terminal device may also share information for controlling the first smart device with other second-type devices. For example, the first terminal device may be connected to a third terminal device, which may be one of the second-type devices described above. The connection method may be similar to that between the first terminal device and the third terminal device, and the connection method may be a near-field connection or a network connection. The method for controlling the smart device may further include: the first terminal device, in response to a user's operation on an option, sending information associated with controlling the first smart device to the third terminal device. For example, the user may have also selected... Figure 14d In addition to the smart bracelet, the mobile phone can also send information associated with the control of the smart screen to the bracelet, so that the bracelet can also generate corresponding control methods, giving users more ways to control the smart device and further improving the convenience of controlling smart devices and the user experience.

[0309] Another implementation of the method for controlling smart devices is, for example Figure 21 As shown, a second terminal device is applied in the above-mentioned intelligent device control system. Similar to the above embodiments, in this embodiment, the second terminal device is connected to the first terminal device, which can be used to control the first intelligent device or is itself the first intelligent device. The second terminal device is a second type of device (see the description of the above embodiments for details). The second type of device has limited hardware and software resources and does not have any applications installed for controlling the first intelligent device. The method shown in this embodiment includes:

[0310] Step 2101: The second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device.

[0311] For example, the connection between the first terminal device and the second terminal device can be established through the second terminal device responding to a user's tap or proximity operation to the first terminal device; correspondingly, step 2101 may include: the second terminal device, in response to the user's tap or proximity operation to the first terminal device, obtaining first information from the first terminal device through the connection. It can also be understood that the second terminal device, in response to the user's tap or proximity operation to the first terminal device, not only establishes a connection with the first terminal device but also obtains first information from the first terminal device through this connection. Details of the first information can be found in [link to relevant documentation]. Figure 18 Description of the illustrated embodiments.

[0312] For example, such as Figure 12b , Figure 12c and Figure 12d As shown, step 2101 may include:

[0313] The second terminal device responds to the user's operation and displays the options corresponding to the first terminal device;

[0314] The second terminal device responds to the user's operation on the option and obtains the first information from the first terminal device through the connection with the first terminal device.

[0315] Step 2102: Based on the first information, the second terminal device generates a first control method for controlling the first intelligent device using its system capabilities. Details of the first control method can be found in [link to relevant documentation]. Figure 18 Description of the illustrated embodiments.

[0316] For example, step 2102 may include: the second terminal device, based on the first information, using the system capabilities of the second terminal device, displaying controls for controlling the first smart device, the controls being such as... Figure 12c The "Turn on TV" and "Turn off TV" buttons are shown on the interface.

[0317] Alternatively, for example, step 2102 may include: the second terminal device generating a voice control method based on the first information using the system capabilities of the second terminal device, as detailed in the above embodiments.

[0318] Alternatively, for example, step 2102 may include: the second terminal device generating an action control method based on the first information using the system capabilities of the second terminal device, as detailed in the above embodiments.

[0319] Step 2103: The second terminal device responds to the user's operation using the first control method and controls the first smart device, as detailed in the above embodiments.

[0320] For example, step 2103 may include: the second terminal device controlling the first smart device in response to a user operation control, such as... Figure 6b As shown.

[0321] Or, for example, step 2103 may include: the second terminal device controlling the first smart device in response to the user uttering a voice that matches the voice control method, such as... Figure 7b , Figure 7c , Figure 8a , Figure 8b , Figure 9c and Figure 9d As shown.

[0322] Or, for example, step 2103 may include: the second terminal device controlling the first smart device in response to the user making an action matching the motion control method, such as... Figure 10c , Figure 10d , Figure 11b and Figure 11c As shown.

[0323] In some embodiments, when the first control method is voice control, before step 2103, the following may be further included:

[0324] The second terminal device displays prompts related to the voice control method, such as... Figure 7a As shown.

[0325] In some embodiments, when the first control method is voice control, before step 2103, the following may be further included:

[0326] The second terminal device displays prompts related to the action control method, such as... Figure 10a and Figure 10b As shown.

[0327] In some embodiments, the second terminal device may generate multiple control methods based on information associated with controlling the first intelligent device. For example, the method shown in this embodiment may further include:

[0328] Based on the first information, the second terminal device generates a second control method using its system capabilities. Details of the second control method can be found in [link to relevant documentation]. Figure 18 Description of the illustrated embodiments;

[0329] The second terminal device responds to the user's operation using the second control method and controls the first smart device, as detailed below. Figure 18 Description of the illustrated embodiments.

[0330] For example, a watch can generate one or more of the following based on information associated with the first smart device: interface controls, voice control, and motion control; a bracelet and a ring can generate voice control and / or motion control based on information associated with the first smart device, and so on.

[0331] In some embodiments, the second terminal device may also obtain second information associated with controlling the second smart device from the first terminal device (see details). Figure 18 (As illustrated in the embodiments), and generate corresponding control methods to control the second smart device. For example, the method for controlling the smart device, based on the embodiments shown, may further include:

[0332] The second terminal device obtains second information associated with controlling the second smart device from the first terminal device through its connection with the first terminal device.

[0333] Based on the second information, the second terminal device utilizes its system capabilities to generate a third control method for controlling the second intelligent device (see details). Figure 18 (as illustrated in the embodiments), such as Figure 13b As shown;

[0334] The second terminal device responds to an operation performed by the user using a third control method to control the second smart device. For example, the user can control the second smart device not only through methods such as... Figure 13bThe air conditioner can be controlled via the controls in the middle, and can also be controlled via... Figure 13b The controls in the system control the lighting fixtures.

[0335] For example, step 2103 may include: in response to an operation performed by the user using the first control method, the second terminal device controls the first smart device by sending a first smart device identifier and a control command, such as... Figure 6d , Figure 17b As shown.

[0336] For example, the second terminal device may share the same account as the first terminal device on the login server. For instance, the second terminal device may share the same account as the first terminal device on the Huawei platform, ensuring the security of the recipients of information sharing or transmission, thereby guaranteeing the security of the method for controlling smart devices provided in this application embodiment.

[0337] The terminal device provided in this application embodiment can be referred to. Figure 22 .like Figure 22 As shown, the terminal device 2200 may include a processor 2201, a memory 2202, and a communication interface 2203. The processor 2201, memory 2202, and communication interface 2203 are coupled to each other. Optionally, the memory 2202 may be used to store instructions executed by the processor 2201, or to store input data required by the processor 2201 to execute instructions, or to store data generated after the processor 2201 executes instructions. The communication interface 2203 may be a transceiver or an input / output interface. When the processor 2201 reads and executes the instructions stored in the memory 2202, the terminal device may implement any of the methods provided in the embodiments of this application.

[0338] Optionally, see Figure 22 The processor 2201, the memory 2202, and the communication interface 2203 are interconnected via a bus 2204. The bus 2204 can be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus, etc. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 22 The bus is represented by a single thick line, but this does not mean that there is only one bus or one type of bus.

[0339] The terminal device provided in this application embodiment is used to implement any of the intelligent device control methods applied to a second terminal device provided in the above embodiments.

[0340] For example, a terminal device may include an acquisition unit, a generation unit, and a control unit. The acquisition unit is used to acquire first information associated with controlling the first smart device from the first terminal device via a connection between the second terminal device and the first terminal device; the generation unit is used to generate a first control method for controlling the first smart device based on the first information and utilizing the system capabilities of the second terminal device; and the control unit is used to control the first smart device in response to an operation performed by a user using the first control method.

[0341] In some embodiments, the generation unit may be specifically configured to display controls for controlling the first smart device based on the system capabilities of the second terminal device using the first information; correspondingly, the control unit may be specifically configured to control the first smart device in response to user operation controls.

[0342] In some embodiments, the generating unit may be specifically configured to generate a voice control mode based on the first information and utilizing the system capabilities of the second terminal device; correspondingly, the control unit may be specifically configured to control the first smart device in response to the user uttering a voice that matches the voice control mode.

[0343] In some embodiments, the terminal device may further include a first prompting unit for presenting a prompt related to the voice control method before the control unit controls the first smart device in response to the user issuing a voice that matches the voice control method.

[0344] In some embodiments, the generating unit may be specifically configured to generate an action control mode based on the first information and utilizing the system capabilities of the second terminal device; correspondingly, the control unit may be specifically configured to control the first smart device in response to the user making an action that matches the action control mode.

[0345] In some embodiments, the terminal device may further include a second prompting unit for presenting a prompt related to the action control method before the control unit controls the first smart device in response to the user making an action that matches the action control method.

[0346] In some embodiments, the generating unit may further be configured to generate a second control mode based on the first information and utilizing the system capabilities of the second terminal device; correspondingly, the control unit may also be configured to control the first smart device in response to an operation performed by the user using the second control mode.

[0347] In some embodiments, the acquisition unit can also be used to acquire second information associated with controlling the second smart device from the first terminal device through a connection with the first terminal device; the generation unit can also be further used to generate a third control method for controlling the second smart device based on the second information and utilizing the system capabilities of the second terminal device; correspondingly, the control unit can also be used to control the second smart device in response to an operation performed by the user using the third control method.

[0348] In some embodiments, the terminal device may further include a connection unit, which may be used to establish a connection with the first terminal device in response to a user's tapping or proximity operation. The acquisition unit may also be used to acquire first information from the first terminal device through the connection established with the first terminal device in response to a user's tapping or proximity operation.

[0349] In some embodiments, the acquiring unit may include:

[0350] The display subunit is used to display the options corresponding to the first terminal device in response to user operations;

[0351] The acquisition subunit is used to acquire first information from the first terminal device in response to the user's operation on the option, through a connection with the first terminal device.

[0352] In some embodiments, the control unit may be specifically configured to control the first smart device by sending an identifier and control commands of the first smart device in response to an operation performed by the user using a first control method.

[0353] The intelligent device control system provided in this application embodiment may include the first terminal device and the second terminal device described above. The first terminal device is used to control the intelligent device and may be a terminal device with an intelligent device management APP installed, a central device for whole-house intelligence, or the intelligent device itself. The second terminal device may be the second type of device described above, a lightweight terminal device that does not have an application installed for controlling the intelligent device. For example, it may be a speaker, or a wearable device such as a smartwatch, smart bracelet, smart ring, or smart glasses, etc.

[0354] In some embodiments, the intelligent device control system may further include a third terminal device, which may be the second type of device described above.

[0355] The chip provided in this application embodiment can be a chip or chip system in the aforementioned terminal device that has the function of implementing the method provided in this application embodiment. Exemplarily, the chip can integrate a processor, a communication interface, and a memory. The memory stores computer programs or instructions, and the processor is connected to the memory through the communication interface to read and execute the computer programs or instructions stored in the memory to implement any of the methods provided in this application embodiment. In some embodiments, the memory may be omitted from the chip; in this case, the processor can call the computer programs or instructions from an external storage device through the communication interface. In some embodiments, the chip system can be composed of chips. Exemplarily, the chip system may include a processor chip, a communication interface chip, and a memory chip. The processor chip is connected to the memory chip through the communication interface chip to read and execute the computer programs or instructions stored in the memory chip to implement any of the methods provided in this application embodiment. In other embodiments, the chip system may include chips and other discrete devices.

[0356] It should be understood that the embodiments described in this application are only some embodiments, and not all embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0357] The terminology used in the embodiments of this application is for the purpose of describing particular embodiments only and is not intended to limit the application. The singular forms “a,” “the,” and “the” used in the embodiments of this application and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise. The term “and / or” as used herein is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. Additionally, the character “ / ” in this document generally indicates that the preceding and following related objects are in an “or” relationship.

[0358] In a specific implementation, the present invention also provides a computer storage medium, wherein the computer storage medium may store a program, and the program, when executed, may include some or all of the steps in the various method embodiments provided by the present invention. The storage medium may be a magnetic disk, optical disk, read-only memory (ROM), or random access memory (RAM), etc.

[0359] In a specific implementation, the present invention also provides a computer program product, wherein the computer program product includes executable instructions, which, when executed on a computer, cause the computer to perform some or all of the steps in the various method embodiments provided by the present invention.

[0360] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in various embodiments or certain parts of the embodiments of the present invention.

[0361] The same or similar parts between the various embodiments in this specification can be referred to mutually. In particular, the device embodiments and terminal embodiments are basically similar to the method embodiments, so the description is relatively simple, and the relevant parts can be referred to the description in the method embodiments.

Claims

1. A method for controlling a smart device, characterized in that, An application is provided in a smart device control system, the smart device control system including a first terminal device and a second terminal device, wherein the first terminal device is used to control a first smart device or is the first smart device, the second terminal device does not have an application installed for controlling the first smart device, and the first terminal device is connected to the second terminal device, the method including: The second terminal device obtains first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device; Based on the first information, the second terminal device generates a first control method for controlling the first smart device using the system capabilities of the second terminal device; The second terminal device controls the first smart device in response to the user's operation using the first control method.

2. The method according to claim 1, characterized in that, Before the second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device, the method further includes: The first terminal device sends the first information to the second terminal device based on a near-field communication method with the second terminal device.

3. The method according to claim 1 or 2, characterized in that, Before the second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device, the method further includes: The first terminal device displays a sharing interface, which is used to share the first information.

4. The method according to claim 1, characterized in that, Based on the first information, the second terminal device generates a first control method for controlling the first smart device using its system capabilities, including: Based on the first information, the second terminal device displays controls for controlling the first smart device using the system capabilities of the second terminal device; The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: The second terminal device responds to the user's operation of the control to control the first smart device.

5. The method according to claim 1, characterized in that, Based on the first information, the second terminal device generates a first control method for controlling the first smart device using its system capabilities, including: The second terminal device generates a voice control method based on the first information and by utilizing the system capabilities of the second terminal device. The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: The second terminal device responds to the user's voice input that matches the voice control method, and controls the first smart device.

6. The method according to claim 5, characterized in that, Before the second terminal device controls the first smart device in response to a user issuing a voice matching the voice control method, the method further includes: The second terminal device or the first terminal device displays a prompt related to the voice control method.

7. The method according to claim 1, characterized in that, Based on the first information, the second terminal device generates a first control method for controlling the first smart device using its system capabilities, including: The second terminal device generates an action control method based on the first information and by utilizing the system capabilities of the second terminal device. The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: The second terminal device controls the first smart device in response to the user making an action that matches the action control method.

8. The method according to claim 7, characterized in that, Before the second terminal device controls the first smart device in response to the user making an action matching the action control method, the method further includes: The second terminal device or the first terminal device displays a prompt related to the action control method.

9. The method according to claim 2, characterized in that, The first terminal device displays a sharing interface, including: The first terminal device presents a sharing interface based on the user's operation on the options in the interface of the second terminal device, and the options correspond to those of the first terminal device.

10. The method according to any one of claims 1 to 9, characterized in that, Also includes: Based on the first information, the second terminal device uses its system capabilities to generate a second control method for controlling the first smart device; The second terminal device controls the first smart device in response to an operation performed by the user using the second control method.

11. The method according to any one of claims 1 to 9, characterized in that, The first terminal device is also used to control the second smart device or to be the second smart device, wherein the second terminal device does not have an application installed for controlling the second smart device; The second terminal device obtains second information associated with controlling the second smart device from the first terminal device through the connection with the first terminal device; Based on the second information, the second terminal device uses its system capabilities to generate a third control method for controlling the second smart device; The second terminal device controls the second smart device in response to the user's operation using the third control method.

12. The method according to any one of claims 2 to 9, characterized in that, The intelligent device control system further includes a third terminal device, which has no application installed for controlling the first intelligent device, and is connected to the first terminal device. After the first terminal device displays the sharing interface, the method further includes: In response to the user's operation on the sharing interface, the first terminal device presents a first option corresponding to the second terminal device and a second option corresponding to the third terminal device; In response to the user's operation on the first option, the first terminal device sends the first information to the second terminal device; In response to the user's operation on the second option, the first terminal device sends third information to the third terminal device, the third information being associated with controlling the first smart device; The third terminal device receives the third information through its connection with the first terminal device; The third terminal device generates a fourth control method for controlling the first smart device based on the third information and its system capabilities. The third terminal device controls the first smart device in response to the user's operation using the fourth control method.

13. The method according to any one of claims 2 to 9, characterized in that, Before the first terminal device displays the sharing interface, the method further includes: The first smart device reports capability information to the first terminal device, and the capability information is used to provide the first information.

14. The method according to any one of claims 1 to 9, characterized in that, Before the second terminal device obtains the first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device, it further includes: The first terminal device obtains the type or identifier of the second terminal device; The first terminal device determines one of the control method, voice control method, or action control method as the first control method based on the type or identifier of the second terminal device.

15. The method according to any one of claims 1 to 9, characterized in that, The connection between the first terminal device and the second terminal device is either a near-field connection or a network connection.

16. The method according to any one of claims 1 to 9, characterized in that, The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: In response to the user's operation using the first control method, the second terminal device controls the first smart device by sending the identifier and control commands of the first smart device.

17. A method for controlling a smart device, characterized in that, The method is applied to a second terminal device connected to a first terminal device, where the first terminal device is used to control or is the first smart device, and the second terminal device does not have an application installed for controlling the first smart device. The second terminal device obtains first information associated with controlling the first smart device from the first terminal device through the connection with the first terminal device; Based on the first information, the second terminal device generates a first control method for controlling the first smart device using the system capabilities of the second terminal device; The second terminal device controls the first smart device in response to the user's operation using the first control method.

18. The method according to claim 17, characterized in that, Based on the first information, the second terminal device generates a first control method for controlling the first smart device using its system capabilities, including: Based on the first information, the second terminal device displays controls for controlling the first smart device using the system capabilities of the second terminal device; The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: The second terminal device responds to the user's operation of the control to control the first smart device.

19. The method according to claim 17, characterized in that, Based on the first information, the second terminal device generates a first control method for controlling the first smart device using its system capabilities, including: The second terminal device generates a voice control method based on the first information and by utilizing the system capabilities of the second terminal device. The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: The second terminal device responds to the user's voice input that matches the voice control method, and controls the first smart device.

20. The method according to claim 19, characterized in that, Before the second terminal device controls the first smart device in response to a user issuing a voice matching the voice control method, the process further includes: The second terminal device displays prompts related to the voice control method.

21. The method according to claim 17, characterized in that, Based on the first information, the second terminal device generates a first control method for controlling the first smart device using its system capabilities, including: The second terminal device generates an action control method based on the first information and by utilizing the system capabilities of the second terminal device. The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: The second terminal device controls the first smart device in response to the user making an action that matches the action control method.

22. The method according to claim 21, characterized in that, Before the second terminal device controls the first smart device in response to the user making an action matching the action control method, the process further includes: The second terminal device displays prompts related to the action control method.

23. The method according to claim 17, characterized in that, Also includes: The second terminal device generates a second control method based on the first information and by utilizing the system capabilities of the second terminal device. The second terminal device controls the first smart device in response to an operation performed by the user using the second control method.

24. The method according to claim 17, characterized in that, Also includes: The second terminal device obtains second information associated with controlling the second smart device from the first terminal device through the connection with the first terminal device; Based on the second information, the second terminal device uses its system capabilities to generate a third control method for controlling the second smart device; The second terminal device controls the second smart device in response to the user's operation using the third control method.

25. The method according to any one of claims 17 to 24, characterized in that, The connection is established via the second terminal device in response to a user's tap or proximity to the first terminal device. The second terminal device, through the connection with the first terminal device, obtains first information associated with controlling the first smart device from the first terminal device, including: In response to the tap or proximity operation of the first terminal device, the second terminal device obtains the first information from the first terminal device through the connection.

26. The method according to any one of claims 17 to 24, characterized in that, The second terminal device, through the connection with the first terminal device, obtains first information associated with controlling the first smart device from the first terminal device, including: The second terminal device responds to the user's operation and displays the options corresponding to the first terminal device; In response to the user's operation on the option, the second terminal device obtains the first information from the first terminal device through the connection with the first terminal device.

27. The method according to any one of claims 17 to 24, characterized in that, The second terminal device, in response to an operation performed by the user using the first control method, controls the first smart device, including: In response to the user's operation using the first control method, the second terminal device controls the first smart device by sending the identifier and control commands of the first smart device.

28. A terminal device, characterized in that, include: One or more processors and a memory, the one or more processors being coupled to the memory, the memory being used to store computer program code, the computer program code including computer instructions, wherein when the one or more processors execute the computer instructions, the terminal device performs the method as described in any one of claims 1 to 27.

29. A chip, characterized in that, include: A processor and a communication interface, wherein the processor invokes a computer program or instruction through the communication interface to execute the method as described in any one of claims 1 to 27.

30. The chip according to claim 29, characterized in that, It also includes a memory that stores the computer program or instructions and is connected to the processor via the communication interface. The processor retrieves the computer program or instructions from the memory via the communication interface.

31. A computer program product, characterized in that, When the computer program product is run on a computer, the computer performs the method described in any one of claims 1 to 27.

32. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program that, when run on a computer, enables the computer to perform the method described in any one of claims 1 to 27.

Images