Smart home equipment control method and system, electronic equipment and storage medium

Abstract

The invention provides a control method and system of smart home equipment, electronic equipment and a storage medium, and relates to the field of smart home. The method comprises the following steps: integrating control interfaces of a plurality of smart home equipment brands into an integrated interface; based on a bidirectional trust protocol, acquiring authorization of a plurality of smart home equipment brands; based on the integrated interface, receiving a control instruction sent by the user side for a target smart home device under the smart home device brand; the control instruction comprises an identity label of the target smart home equipment and an operation instruction for the target smart home; and executing the operation instruction on the target smart home device based on the integrated interface through authorization. According to the application, unified management and control of the plurality of smart home device brands are conveniently realized through the authorization and integration interface, a user does not need to download and use the application programs of different smart home device brands, the use difficulty of the user is reduced, and the operation is simple and convenient.

Description

Technical Field

[0001] Embodiments of the present invention relate to the field of smart home devices, and in particular to a control method and system, an electronic device, and a storage medium for smart home devices. Background Art

[0002] Smart home uses residence as platform and utilizes integrated wiring technology, network communication technology, security technology, automatic control technology, audio and video technology to build an efficient management system for residential facilities and family schedule affairs by integrating the equipment related to home life. Smart home can enhance the safety, convenience, comfort and artistry of the home and realize an environmentally friendly and energy-saving living environment.

[0003] At present, each smart home device brand uses a dedicated application to control each smart home device thereunder to achieve the purpose of smart home.

[0004] However, the above method requires users to download and use applications of different smart home device brands separately, which not only increases the difficulty of use for users, but also causes inconvenience and confusion in operation. Moreover, it is difficult for users to achieve unified management and control of all smart home devices, which to some extent restricts the development of smart homes. Summary of the invention

[0005] In view of the above problems, embodiments of the present invention are proposed to provide a control method and system for smart home devices, an electronic device, and a storage medium that overcome the above problems or at least partially solve the above problems.

[0006] In a first aspect, an embodiment of the present application discloses a control method for a smart home device, including:

[0007] Integrate the control interfaces of several smart home device brands into one integrated interface;

[0008] Based on a two-way trust agreement, obtain authorization from the several smart home device brands;

[0009] Based on the integrated interface, receiving a control instruction for a target smart home device under the smart home device brand issued by a user end; the control instruction includes: an identity identifier of the target smart home device and an operation instruction for the target smart home device;

[0010] Through the authorization, the operation instruction is executed on the target smart home device based on the integrated interface.

[0011] Optionally, before receiving, based on the integrated interface, a control instruction for a target smart home device under the smart home device brand issued by a user terminal, the method further includes:

[0012] Displaying a control interface for the smart home device to the user terminal; the control interface includes: a room identifier and a list of identity identifiers of each smart home device deployed in the room;

[0013] The step of receiving a control instruction for a target smart home device under the smart home device brand from a user terminal based on the integrated interface includes:

[0014] Based on the integrated interface, accepting a control instruction for a target smart home device in a target room issued by the user terminal through the control interface; the control instruction further includes: a room identifier of the target room;

[0015] The step of executing the operation instruction on the target smart home device based on the integrated interface through the authorization includes:

[0016] Through the authorization, the operation instruction is executed on the target smart home device in the target room based on the integrated interface.

[0017] Optionally, before receiving, based on the integrated interface, a control instruction for a target smart home device under the smart home device brand issued by a user terminal, the method further includes:

[0018] Displaying a control interface for the smart home device to the user terminal; the control interface includes: an application scenario, the application scenario includes: multiple target smart home devices, and linkage operation instructions for the multiple target smart home devices;

[0019] The step of receiving a control instruction for a target smart home device under the smart home device brand from a user terminal based on the integrated interface includes:

[0020] Based on the integrated interface, receiving a control instruction for the application scenario issued by the user terminal through the control interface;

[0021] The step of executing the operation instruction on the target smart home device based on the integrated interface through the authorization includes:

[0022] Through the authorization, based on the integrated interface, the linkage operation instructions corresponding to the application scenario are executed on each target smart home device in the application scenario.

[0023] Optionally, before presenting the control interface of the smart home device to the user terminal, the method further includes:

[0024] Displaying a smart home selection interface in the application scenario to the user terminal; the selection interface includes: a list of identity identifiers of each smart home device;

[0025] Receiving at least one smart home device selected by the user through the selection interface;

[0026] Displaying, to the user terminal, control instruction setting interfaces corresponding to each of the at least one smart home device;

[0027] Receive the control instructions set by the user end for each smart home device through the control instruction setting interface, and save them to form an application scenario.

[0028] Optionally, the method further comprises:

[0029] If no control command is received within a preset time, a heartbeat request and / or a status request is sent to each smart home device according to a preset period;

[0030] Receive heartbeat parameters and / or status returned by each smart home device.

[0031] Optionally, obtaining authorization of the plurality of smart home device brands based on a two-way trust protocol includes:

[0032] Displaying an authorization guidance interface to the user terminal; the authorization guidance interface includes: a list of identity identifiers of various smart home device brands;

[0033] Receiving at least one smart home device brand selected by the user through the authorization guidance interface;

[0034] Displaying a login interface corresponding to each smart home device brand of the at least one smart home device brand to the user terminal;

[0035] Receiving login instructions of various smart home device brands respectively input by the user terminal through the login interface, and triggering an authorization process;

[0036] In the authorization process, authorization of the several smart home device brands is obtained based on a two-way trust agreement.

[0037] In a second aspect, a control system for a smart home device is provided, comprising:

[0038] Integration module, used to integrate the control interfaces of several smart home device brands into one integrated interface;

[0039] An authorization module, used to obtain authorization of the several smart home device brands based on a two-way trust protocol;

[0040] A control instruction receiving module, configured to receive, based on the integrated interface, a control instruction issued by a user terminal to a target smart home device under the smart home device brand; the control instruction includes: an identity identifier of the target smart home device and an operation instruction for the target smart home device;

[0041] A control module is used to execute the operation instruction on the target smart home device based on the integrated interface through the authorization.

[0042] According to a third aspect, an electronic device is provided, including:

[0043] A processor, a memory, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, any one of the aforementioned methods for controlling smart home devices is implemented.

[0044] In a fourth aspect, a readable storage medium is provided. When the instructions or transactions in the storage medium are executed by a processor of an electronic device, the electronic device can execute any of the aforementioned control methods for smart home devices.

[0045] In a fifth aspect, a computer program product is provided, comprising instructions or transactions, which, when executed by a processor in an electronic device, enable the electronic device to execute any one of the aforementioned methods for controlling smart home devices.

[0046] In the embodiment of the present application, the control interfaces of several smart home device brands are integrated into an integrated interface, and then the integrated interface can be used to uniformly manage and operate the several smart home device brands. Based on a two-way trust protocol, authorization of several smart home device brands is obtained to achieve secure verification and authorization of the user's identity. Then, based on the above-mentioned integrated interface, operation instructions issued by the user end are received. Through the above-mentioned authorization and integrated interface, unified management and control of several smart home device brands are conveniently achieved. Users do not need to download and use application programs of different smart home device brands separately, which reduces the difficulty of use for users and makes the operation simple and convenient. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] Figure 1 is a flowchart of a method for controlling a smart home device provided by an embodiment of the present invention;

[0048] Figure 2 is a schematic diagram of authorization of a smart home device provided by an embodiment of the present invention;

[0049] Figure 3 is a flowchart of another method for controlling a smart home device provided by an embodiment of the present invention;

[0050] Figure 4 is a schematic diagram of a control interface provided by an embodiment of the present invention;

[0051] Figure 5 is a flowchart of a method for controlling a smart home device provided by an embodiment of the present invention;

[0052] Figure 6 is a schematic diagram of another control interface provided by an embodiment of the present invention;

[0053] Figure 7 It is a structural schematic diagram of a control system of a smart home device provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0054] The exemplary embodiments of the present invention will be described in more detail below with reference to the accompanying drawings. Although the exemplary embodiments of the present invention are shown in the accompanying drawings, it should be understood that the present invention can be implemented in various forms and should not be limited by the embodiments set forth herein. On the contrary, these embodiments are provided in order to enable a more thorough understanding of the present invention and to enable the scope of the present invention to be fully communicated to those skilled in the art.

[0055] The present application provides a method for preparing a control method of a smart home device, referring to Figure 1 , the method comprises the following steps.

[0056] Step 101: Integrate the control interfaces of several smart home device brands into one integrated interface.

[0057] The smart home devices mentioned in this application can be various smart home devices in the user's home, such as smart lighting equipment, smart home appliances, smart security equipment, smart entertainment equipment, smart health equipment, smart health equipment, smart curtains, etc. Smart lighting equipment may include smart light bulbs, smart light strips, smart switches, etc. Smart security equipment may include smart cameras, door locks, door and window sensors, smoke alarms, etc. Smart home appliances may include smart refrigerators, washing machines, dryers, dishwashers, etc. Smart entertainment equipment may include: smart TVs, audio systems, etc. Smart health equipment may include smart weight scales, health monitoring equipment, etc. Smart curtains may include electric curtain controllers, etc. The smart home devices here may also include smart sockets, etc., which are not specifically limited.

[0058] Normally, the control interface of a smart home device brand corresponds to one or more smart home device brands. For example, the control interface corresponding to Gree's Gree+ can correspond to multiple smart home devices of Gree. Moreover, each brand's control interface can not only add and bind products under its own brand, but also third-party smart home devices. The third-party smart home devices here refer to smart home devices that are not owned by the company of the brand. This step requires all brands' mini programs to follow a unified development and access guide to ensure that mini programs of different brands can be seamlessly integrated into the integration interface.

[0059] Specifically, the integration interface defines the basic operations required to interact with smart home devices, such as device discovery, status reading, control command sending, etc. Specific adapters can be developed for each brand of smart home devices. These adapters are responsible for converting the abstract application interface of the service platform corresponding to the brand into brand-specific application calls, hiding the technical differences between different brands.

[0060] For example, a plug-in architecture can be adopted to allow third-party developers or smart home device brand providers to contribute new plug-ins to the service platform corresponding to the brand. Each plug-in encapsulates the application interface implementation of a brand, and multiple plug-ins implement the functions of the integrated interface. The benefits of the plug-in architecture are: first, flexibility and scalability: plug-ins can be added or removed independently without affecting the core functions of the integrated interface; second, modularity: it can be decomposed into independent modules, each with specific functions, easy to manage and update; third, easy to maintain and upgrade: the independence of plug-ins makes maintenance and upgrade easier, without the need for redeployment; fourth, customizability: users or developers can add or develop specific plug-ins according to their needs; fifth, technical diversity: different technology stacks are allowed to be used to develop plug-ins to adapt to the technical preferences of different developers; sixth, low risk: independent deployment of plug-ins reduces the risk of failure, and a plug-in problem will not affect the entire integrated interface; seventh, easy to update: the open plug-in architecture encourages developers to contribute new plug-ins, promote functional innovation and expansion; eighth, dynamic loading and unloading: plug-ins can be dynamically loaded and unloaded at runtime, providing better user experience and resource management.

[0061] The integration of control interfaces can also be achieved by using a microservice architecture, specifically, the control method is decomposed into a series of small services, each of which runs in its own independent process and interacts through a lightweight communication mechanism (for example, HTTP RESTful API (Hypertext Transfer Protocol Representational State Transfer Application Programming Interface)). Alternatively, the integration of control interfaces can also be achieved by using a layered architecture, decomposing the control method of smart home devices into several layers, such as presentation layer, business logic layer and data access layer, each layer is responsible for different functions. Alternatively, the integration of control interfaces can also be achieved by using an event-driven architecture, which is event-centric and different parts communicate through events, usually using message queues or event stream processing middleware. Alternatively, the integration of control interfaces can also be achieved by using a service-oriented architecture, where services are self-contained business functional units that provide services through the network and can be used by other applications or services. Alternatively, the integration of control interfaces can also be achieved by using a cloud-native architecture, which is an architecture specially designed for cloud environments and takes advantage of the characteristics of cloud services, such as scalability, elasticity and distributed computing. Alternatively, the integration of control interfaces can also be achieved by using a containerized architecture, which uses container technology (such as Docker) to package applications and their dependencies to achieve consistency and easy deployment in different environments. Alternatively, you can also use Function as a Service to integrate the control interface. Function as a Service can be an event-triggered, serverless architecture model where the application consists of one or more functions that respond to events and perform tasks.

[0062] Step 102: Obtain authorization of the smart home device brands based on a two-way trust protocol.

[0063] The two-way trust protocol can ensure that all access control interfaces are verified, protecting user data and privacy, or in other words, ensuring that the smart home devices of each smart home device brand must follow the prescribed protocol to support the secure handshake and data exchange of the application corresponding to the integrated interface. Standard protocols such as OAuth (Open Authorization) 2.0 and OpenID Connect (Open Identity Connection) can be used as the two-way trust protocol here to ensure the secure transmission of user data and data mutual trust between brands.

[0064] OAuth 2.0 focuses on the authorization process, allowing third-party applications to access user resources, while OpenIDConnect adds the function of identity authentication on this basis, providing users and developers with a more secure and convenient identity authentication and authorization solution. More specifically, it can be divided into the following stages. The first is user authentication request: When the user uses the application corresponding to the integrated interface, if a new smart home device needs to be added, the application corresponding to the integrated interface will guide the user to authenticate. After the user clicks to add a device, the application corresponding to the integrated interface will send an authentication request to the authentication server of the user's smart home device brand. The second is user login: The user is redirected to the login interface of the smart home device brand authentication server, where the user enters their username and password to log in. The third is authorization consent: Once the user successfully logs in, they will be prompted whether to agree to the application corresponding to the integrated interface to access their smart home device information.

[0065] The following can be the authorization consent steps in the OAuth 2.0 process. First, obtain the authorization code: If the user agrees to the authorization, the authentication server of the smart home device brand will generate an authorization code and send it back to the application corresponding to the integrated interface. This authorization code is temporary and can only be used once; second, exchange access tokens: The application corresponding to the integrated interface uses this authorization code to request an access token from the authentication server of the smart home device brand. This request includes the client ID and key of the application corresponding to the integrated interface. Third, access tokens and ID tokens: After the authentication server of the smart home device brand verifies the authorization code, if the authorization code is valid, it will issue an access token and ID token to the application corresponding to the integrated interface. The ID token contains the user's identity information, such as the user's unique identifier and some basic attributes. Fourth, securely store tokens: The application corresponding to the integrated interface securely stores these tokens, usually encrypted on the server side to protect the security of user data and authorization information. Fifth, use access tokens: When the user issues a control instruction through the application corresponding to the integrated interface, the platform will use the stored access token to send the control instruction to the interface of the smart home device through a secure HTTPS request. Sixth, refresh token: In order to maintain the user's session, when the access token is close to expiration, the application corresponding to the integrated interface will use the refresh token to obtain a new access token without the user having to log in again. Seventh, continuous security monitoring: The application corresponding to the integrated interface continuously monitors all authentication and authorization activities to ensure that there is no unauthorized access or abnormal behavior. Through the above methods, the application corresponding to the integrated interface not only realizes the security verification of the user's identity, but also ensures that the user's authorization process for controlling smart home devices is secure and reliable. At the same time, using the OpenIDConnect protocol, the platform can also obtain confirmation of the user's identity, increasing the security and reliability of the entire system.

[0066] The user end mentioned in this application refers to a device used by the user, such as a smartphone or tablet, for interacting with the application corresponding to the integrated interface. The application corresponding to the integrated interface is the subject of the present invention, which provides a user interface for user operation, processes user requests, and communicates with the authentication server of the smart home device brand and the smart home device through the integrated interface. The authentication server of the smart home device brand refers to a server responsible for user identity authentication and authorization, using protocols such as OAuth 2.0 or OpenID Connect, which issues access tokens and refresh tokens to the application corresponding to the integrated interface to allow it to access smart home devices on behalf of the user.

[0067] This application can also use MQTT (Message Queuing Telemetry Transport) to achieve the above authorization. MQTT is a lightweight message transmission protocol, which mainly includes: secure handshake and data exchange. The secure handshake here refers to the security authentication between the client and the server through the TLS (Transport Layer Encryption Protocol) / SSL (Secure Sockets Layer Encryption Protocol) encrypted connection. Data exchange refers to the secure transmission of device status updates and control instructions through encrypted channels.

[0068] This application can also implement the aforementioned authorization with the help of CoAP (Constrained Application Protocol). The steps for implementing secure handshake and data exchange based on these protocols can generally include: First, device registration, the smart home device registers with the application corresponding to the integrated interface and provides the necessary identity and capability information. Second, identity authentication, using protocols such as OAuth 2.0 and OpenID Connect to verify the identity of the user or device. Third, session establishment, establishing a secure session, using TLS / SSL or DTLS encrypted communication. Fourth, data encryption, using JWT (an authentication protocol) or other mechanisms to encrypt and sign the transmitted data. Fifth, interface call, using access tokens to call the interface of the smart home device for data exchange. Sixth, message subscription, the smart home device and the application corresponding to the integrated interface subscribe to each other's message topics to receive real-time updates. Seventh, data parsing and execution, after receiving the data, parse and execute the corresponding operations according to the protocol. It should be noted that the data in the data exchange may include: status information of smart home devices: such as switch status, temperature, humidity, etc. User control instructions: such as turning on the light, adjusting the temperature, etc. System messages: such as smart home device online, offline notifications, etc. User identity information: User identity data exchanged through OpenID Connect, etc.

[0069] It should be noted that the control interface integration and authorization authentication here are all for smart home device brands, not just for individual smart home devices. In addition, all smart home devices under a smart home device brand are integrated and authorized in batches to improve efficiency. For example: the smart home devices in the user's home are bound to the "Gree" brand. If the user wants to move all the devices of this brand to the "application corresponding to the integrated interface", the "application corresponding to the integrated interface" needs to access the "Gree" platform first, and this platform needs to be authorized to the "application corresponding to the integrated interface". In this way, all smart home devices of this platform will be displayed in the application corresponding to the integrated interface. The next time this platform is equipped with new smart home devices, it will also be synchronized to the "application corresponding to the integrated interface". When the user uses the application corresponding to the integrated interface for the first time, he needs to log in and authenticate his identity. Then proceed to the authorization process: After the user selects the smart home device to be bound, the application corresponding to the integrated interface will guide the user to the authorization process, which usually involves authorization protocols such as OAuth 2.0. Then obtain the access token: After the user completes the authorization, the application corresponding to the integrated interface obtains the access token from the authentication server of each brand. Smart home device discovery interface call: Using the obtained access token, the application corresponding to the integration interface calls the device discovery interface provided by the backend server of each brand. These interfaces can list all bound smart home devices under the user account. Device list retrieval: The smart home device discovery interface returns the list of devices that the user has bound, including device ID, type, status and other information. Smart home device binding: The application corresponding to the integration interface provides an interface for the user to display all bindable smart home devices based on the retrieved device list, and allows the user to choose to bind a specific smart home device. Establish smart home device mapping: For the smart home devices that the user chooses to bind, the application corresponding to the integration interface establishes a smart home device mapping relationship in the local database, and records the detailed information and control parameters of the smart home devices. Smart home device status synchronization: After the binding is completed, the application corresponding to the integration interface starts to synchronize the status of the smart home device to ensure that the information of the smart home device displayed on the user interface is the latest. Continuous communication: The application corresponding to the integration interface maintains continuous communication with the backend server of each brand to receive status updates and push control instructions of smart home devices. User interface update: Any change in the status of any smart home device will be reflected in the user interface in real time, providing a seamless user experience. Security measures: All communications with the brand's backend servers are conducted over secure connections, such as using HTTPS and TLS encryption. Error handling: The application corresponding to the integration interface implements an error handling mechanism to deal with device communication failures or authorization issues.

[0070] Reference Figure 2This is an example of obtaining authorization for smart home devices under various smart home brands in the home. The smart home devices in the home are mainly smart home devices under three smart home brands, namely brand 1, brand 2 and brand 3. Through the authorization protocol corresponding to the two-way trust protocol, authorization is achieved with the three brands, and then authorization of all smart home devices in the home is obtained.

[0071] The status of the smart home device mentioned in this application may include: the switch status refers to whether the smart home device is turned on or off; the working mode refers to the current working mode of the smart home device, such as cooling, heating, automatic, etc.; the setting parameters refer to the parameters set by the user, such as temperature, brightness, color, etc. Real-time data refers to the current real-time data of the smart home device, such as indoor temperature, humidity, power, etc. The connection status refers to whether the smart home device is successfully connected to the network. The status of the smart home device, etc. can be stored in a database, which can be a local database or other databases. The local database can refer to the database in the user end, which is usually used to store application data, user settings, device configuration, etc., for fast access and processing. Other database options: The cloud database may include at least one of the following databases. The cloud database refers to data stored on a remote server, which can be accessed through the Internet and is suitable for data synchronization and backup. Distributed databases, where data is distributed in multiple geographical locations or servers, provide better scalability and fault tolerance. NoSQL databases are suitable for storing unstructured or semi-structured data, providing flexible data models and high scalability. Relational databases use tables, rows, and columns to store data, support complex queries and transaction processing, and are suitable for structured data.

[0072] Step 103: Based on the integrated interface, a control instruction for a target smart home device under the smart home device brand issued by a user terminal is received; the control instruction includes: an identity identifier of the target smart home device and an operation instruction for the target smart home.

[0073] After the control interface is integrated with the intelligent integration interface, the corresponding smart home device can be accessed through the integration interface. The target smart home device refers to the smart home device corresponding to the control instruction. The identity of the target smart home device refers to the unique identifier of the target smart home device, which can be regarded as the "identity card" of the target smart home device. It is used to uniquely identify a target smart home device in the network. It may be assigned by the manufacturer, such as a MAC (media access control) address, serial number or other forms of unique coding.

[0074] The operation instruction refers to the specific operation for the target home appliance, such as switch operation, temperature adjustment operation, etc., which is not specifically limited.

[0075] Step 104: Execute the operation instruction on the target smart home device based on the integrated interface through the authorization.

[0076] With authorization, the aforementioned operation instructions can be executed on the target smart home device through the above integrated interface, thereby realizing unified management and operation of smart home devices of various brands. Users do not need to download and use applications of different smart home device brands separately, which reduces the difficulty of use for users and makes the operation simple and convenient.

[0077] It should be noted that the order of the aforementioned step 101 and step 102 is not specifically limited. For example, step 102 may be performed first and then step 101.

[0078] This application provides another method for preparing a control method for a smart home device, referring to Figure 3 , the method comprises the following steps.

[0079] Step 201 : Integrate the control interfaces of several smart home device brands into one integrated interface.

[0080] Step 202: Obtain authorization of the smart home device brands based on a two-way trust protocol.

[0081] Step 201 and step 202 may refer to the aforementioned step 101 and step 102, and will not be described again here to avoid repetition.

[0082] Step 203, displaying a control interface for the smart home device to the user terminal; the control interface includes: a room identifier and a list of identity identifiers of each smart home device deployed in the room.

[0083] Usually, a certain type of smart home device may not be unique in a home, and can usually play a similar role in different rooms. For example, there may be at least one air conditioner in each room. Here, the room identification and the identity list of each smart home device deployed in each room are displayed in the control interface, so that each smart home device can be accurately controlled to avoid misoperation. The identity of the smart home device here is to distinguish different smart home devices in the room.

[0084] The room ID here can be an ID that uniquely identifies a room in the home. Figure 4 A schematic diagram of the control interface is shown. Figure 4The display shows a total of 6 rooms, including the living room, kitchen, balcony, bathroom, master bedroom, and second bedroom. In the living room, there are brand 1 sweeper, brand 1 fan, brand 1 refrigerator, brand 3 smart door lock, brand 2 living room lamp, brand 2 curtain, and brand 3 camera. The brand here refers to the smart home device brand, such as Gree.

[0085] It should be noted that for some movable smart home devices, a position identification component can be set to accurately identify the current location, and its identity can be adjusted in real time to the identity list of the smart home devices in the corresponding room. The current location of the above movable smart home device can also be highlighted in the interface, so that users can find the smart home device as soon as possible from the interface. For example, the position of a sweeping machine may change, and a position identification component of the sweeping machine can be set to accurately identify the current location of the sweeping machine, and its identity can be adjusted in real time to the identity list of the smart home devices in the corresponding room. The current location of the above sweeping machine can also be highlighted in the interface, so that users can find the sweeping machine as soon as possible from the interface.

[0086] Step 204: Based on the integrated interface, accept the control instruction for the target smart home device in the target room issued by the user terminal through the control interface; the control instruction also includes: the room identifier of the target room.

[0087] This step is to receive the user's control instructions for a target home appliance in a room through the aforementioned integrated interface.

[0088] Step 205: Through the authorization, the operation instruction is executed on the target smart home device in the target room based on the integrated interface.

[0089] This step is to achieve unified and precise control of different smart home devices in different rooms of the home. Figure 3 The method shown in Figure 1 On the basis of the method shown, unified and precise control of smart home devices of different brands in different rooms of the home can be further achieved, so that each smart home device can be precisely controlled to avoid misoperation.

[0090] The present application provides a method for preparing a control method of a smart home device, referring to Figure 5 , the method comprises the following steps.

[0091] Step 301: Integrate the control interfaces of several smart home device brands into one integrated interface.

[0092] Step 302: Obtain authorization of the smart home device brands based on a two-way trust protocol.

[0093] Step 301 and step 302 may refer to the aforementioned step 101 and step 102, and will not be described again here to avoid repetition.

[0094] Step 303, displaying a control interface for the smart home device to the user terminal; the control interface includes: an application scenario, the application scenario includes: multiple target smart home devices, and linkage operation instructions for the multiple target smart home devices.

[0095] Usually, some smart home devices in a home have certain associations in certain scenarios. Here, the smart home devices that have certain associations in a certain scenario and the operations of each smart home device are associated to improve control efficiency and further improve user convenience. For example, users can set a "sleep" application scenario, which will automatically lower the light brightness, adjust the air conditioning temperature, and activate the security system.

[0096] For example, refer to Figure 6 Another control interface diagram is shown. Figure 6 A total of 6 application scenarios are shown in the figure.

[0097] Step 304: Based on the integrated interface, receive a control instruction for the application scenario issued by the user terminal through the control interface.

[0098] This step is to receive control instructions from users for certain application scenarios through the aforementioned integrated interface, and then issue control instructions to at least one smart home device in the application scenario at one time, thereby improving operational convenience.

[0099] Step 305: Through the authorization, based on the integrated interface, the linkage operation instructions corresponding to the application scenario are executed on each target smart home device in the application scenario.

[0100] For example, with respect to the above example, if a control instruction for the "sleep" application scenario is received from the user end in the control interface, the light brightness can be lowered, the air conditioning temperature can be adjusted, and the security system can be activated.

[0101] Figure 5 The method shown in Figure 1 On the basis of the method shown, unified and precise control of smart home devices in different application scenarios in the home can be further achieved, so that control instructions can be issued to at least one smart home device in the application scenario at one time, thereby improving the convenience of operation.

[0102] Optionally, before the aforementioned step 303, the method may further include: displaying a smart home selection interface in the application scenario to the aforementioned user terminal, the selection interface including: a list of identity identifiers of each smart home device, receiving at least one smart home device selected by the aforementioned user terminal through the selection interface, displaying a control instruction setting interface corresponding to each smart home device in the aforementioned at least one smart home device to the user terminal, receiving control instructions set by the user terminal for each smart home device through the aforementioned control instruction setting interface, and saving to form an application scenario. Here, a method for realizing flexible configuration and automatic execution of intelligent scenarios according to the user's personal preferences is provided, further enhancing the user's personalized experience.

[0103] For example, refer to Figure 6 , the automatic scene can be some popular application scenes provided by the application corresponding to the integrated interface. The manual scene can be an intelligent scene set by the user's personal preferences. The plus sign in the screenshot can be the location to open the application scene setting.

[0104] The application scenarios configured here according to the user's personal preferences can be saved in the aforementioned database, and no specific limitation is made to this.

[0105] Optional, Figure 1 , Figure 3 as well as Figure 5 The control methods of the smart home devices shown may also include the following steps: if no control instruction is received within a preset time, a heartbeat request and / or a status request is sent to each smart home device according to a preset period, and the heartbeat parameters and / or status returned by each smart home device are received. Even if the user does not operate within the preset time, each smart home device may periodically send a "heartbeat" and / or status to the integrated interface to keep the session active and update the session status. The preset time and preset period here can be set according to actual conditions, and there is no specific limitation on this.

[0106] It should be noted that the method may also include the following steps. First, access token renewal: If the application corresponding to the integrated interface detects that the access token is about to expire, it can use the refresh token in advance to obtain a new access token, thereby avoiding service interruption when the user returns. Second, background tasks can be run even when the user is not active, and are used to handle data synchronization and status updates. Third, local cache, the information and control status of the user's smart home devices can be cached locally, so that even in an offline state, the user can view the latest status of the smart home devices. Fourth, pre-authorization, the application corresponding to the integrated interface can pre-acquire a long-term valid access token or use a refresh token with a longer validity when the user is active, reducing the need for re-authorization due to token expiration. Fifth, fast re-authentication: In the case of re-authentication, the application corresponding to the integrated interface can implement a fast re-authentication process, such as by using the stored fingerprints or user preferences of the smart home device to simplify the login steps. Sixth, status synchronization, when the user returns to the application corresponding to the integrated interface, the application corresponding to the integrated interface can quickly synchronize the latest device status and user settings to ensure that the user interface reflects the current home environment. Seventh, intelligent preloading: Based on the user's usage habits and device status, the application corresponding to the integrated interface can predict the user's possible operations and preload relevant data and resources. Eighth, seamless switching ensures that when users return to the application corresponding to the integrated interface from the background, they can seamlessly switch to the context they left without having to re-login or re-enter instructions.

[0107] Optional, Figure 1 , Figure 3 as well as Figure 5 The authorization steps of the control method of the smart home device shown can also include the following sub-steps: displaying an authorization guidance interface to the aforementioned user terminal, the authorization guidance interface including: a list of identity identifiers of each smart home device brand, where the list of identity identifiers of the smart home device brand is used to uniquely represent a smart home device brand, such as "Gree". Receive at least one smart home device brand selected by the aforementioned user terminal through the authorization guidance interface, display the login interface corresponding to each smart home device brand in the aforementioned at least one smart home device brand to the user terminal, receive the login instructions of each smart home device brand respectively input by the user terminal through the login interface, and trigger the authorization process. In the authorization process, based on the two-way trust protocol, the authorization of each smart home device brand is obtained. Under the premise of user authorization, the authorization of each smart home device brand is conveniently realized, so that the application corresponding to the integrated interface can perform specific operations on behalf of the user, such as reading the device status, sending control instructions, etc.

[0108] It should be noted that these authorizations can be achieved through the following process. First, the access token is used to grant the application corresponding to the integrated interface access rights to the user's smart home devices, so that the application corresponding to the integrated interface can perform specific operations on behalf of the user, such as reading device status, sending control instructions, etc. The access token usually has a short validity period and needs to be refreshed regularly. The refresh token is used to obtain a new access token after the access token expires. Without the need for user re-authorization, the access token of the application corresponding to the integrated interface can maintain long-term access rights and improve user experience. The refresh token is usually valid for a long time, but it may also need to be replaced according to security policies. The specific access and refresh processes include: one is the use of the access token. After receiving the access token, the application corresponding to the integrated interface uses it in subsequent interface calls to the brand server, such as requesting device data or sending control commands. The other is the refresh of the access token. When the access token expires, the application corresponding to the integrated interface uses the refresh token to request a new access token from the brand server. The brand server verifies the validity of the refresh token. If it is valid, it will issue a new access token and may also issue a new refresh token. Another one is secure storage. The application platform corresponding to the integrated interface stores the received access token and refresh token securely on the server, and usually uses encryption measures to protect these sensitive information. Then there is the management of storage tokens. The application corresponding to the integrated interface needs to manage the life cycle of the token, including storage, update and invalidation processing. And the display of the client interface. The user's front-end interface uses the application corresponding to the integrated interface to obtain the list and status of bound devices and display them to the user. There is also a device control request. The control instructions issued by the user through the front-end interface are proxied to the brand server by the back-end of the application corresponding to the integrated interface using a valid access token to achieve control of smart home devices. Automation of the refresh process. When the application corresponding to the integrated interface detects that the access token is about to expire or has expired, it automatically uses the refresh token to obtain a new access token and continues to execute the user request. Persistence of user sessions. By using refresh tokens, users can maintain control sessions of devices even after a long period of inactivity without re-login.

[0109] The present application is further explained below in conjunction with specific embodiments. The present application requires the implementation of the following steps.

[0110] The standardized access process requires all brands of mini programs to follow unified development and access guidelines to ensure that mini programs of different brands can be seamlessly integrated into the integration interface.

[0111] Abstract integration interface,Design a set of abstract integration interfaces that define the basic operations required to interact with smart home devices, such as device discovery, status reading, control command sending, etc.

[0112] Specific adapters are developed for each smart home brand. These adapters are responsible for converting the abstract integration interface into brand-specific interface calls, hiding the technical differences between different brands.

[0113] A plug-in architecture can be adopted to allow third-party developers or smart home brand providers to contribute new plug-ins to the platform, each plug-in encapsulating a brand's interface implementation.

[0114] Implement an automated registration mechanism so that when new brand applets or plug-ins are added, they can automatically register and provide services without manual intervention.

[0115] Unified authentication and authorization, establish a unified authentication and authorization mechanism to ensure that all mini-programs connected to each smart home device are verified and protect user data and privacy.

[0116] Cross-platform data synchronization implements a cross-platform data synchronization mechanism to ensure that users' operations between smart home devices of different brands can be synchronized and updated in real time.

[0117] User interface integration provides a unified user interface framework, allowing the interface elements and control logic of mini-programs of different brands to be seamlessly integrated, providing a consistent user experience.

[0118] Continuous updates and maintenance. As smart home devices develop, integrated interfaces and adapters are continuously updated to ensure compatibility with new devices and new features.

[0119] Development support and documentation: Provide comprehensive development support and documentation to help developers quickly understand how to develop and integrate new brand mini programs into the platform.

[0120] This embodiment may include the following processes: 1. The user opens the application corresponding to the integrated interface on the user end and selects the smart home device to be bound. 2. The application corresponding to the integrated interface guides the user to perform authentication and redirects the user end to the login interface of the brand's authentication server. 3. The user logs in to the brand's authentication server and authorizes the application corresponding to the integrated interface to access its smart home devices. 4. The authentication server issues an access token and a refresh token to the application corresponding to the integrated interface. 5. The application corresponding to the integrated interface uses the access token to request operations on the smart home device through the integrated interface, such as obtaining status or sending control instructions. 6. When necessary, the application corresponding to the integrated interface uses the refresh token to request a new access token from the authentication server to maintain continuous access rights.

[0121] This application also provides a control system for smart home devices, referring to Figure 7, including: an integration module 401, used to integrate the control interfaces of several smart home device brands into an integrated interface; an authorization module 402, used to obtain the authorization of the several smart home device brands based on a two-way trust protocol; a control instruction receiving module 403, used to receive, based on the integrated interface, a control instruction for a target smart home device under the smart home device brand issued by a user end; the control instruction includes: an identity of the target smart home device and an operation instruction for the target smart home; a control module 404, used to execute the operation instruction on the target smart home device based on the integrated interface through the authorization.

[0122] Optionally, the control system further includes:

[0123] A first display module is used to display a control interface of the smart home device to the user terminal; the control interface includes: a room identifier and a list of identity identifiers of each smart home device deployed in the room;

[0124] The control instruction receiving module 403 includes:

[0125] A first control instruction receiving submodule is used to receive, based on the integrated interface, a control instruction issued by the user terminal through the control interface to a target smart home device in a target room; the control instruction also includes: a room identifier of the target room;

[0126] The control module 404 includes:

[0127] The first control submodule is used to execute the operation instruction on the target smart home device in the target room based on the integrated interface through the authorization.

[0128] Optionally, the control system further includes:

[0129] A second display module is used to display a control interface of a smart home device to the user terminal; the control interface includes: an application scenario, the application scenario includes: a plurality of target smart home devices, and linkage operation instructions for the plurality of target smart home devices;

[0130] The control instruction receiving module 403 includes:

[0131] A second control instruction receiving submodule, configured to receive, based on the integrated interface, a control instruction for the application scenario issued by the user terminal through the control interface;

[0132] The control module 404 includes:

[0133] The second control submodule is used to execute the linkage operation instructions corresponding to the application scenario on each target smart home device in the application scenario based on the integrated interface through the authorization.

[0134] Optionally, the control system further includes:

[0135] The third display module is used to display the smart home selection interface in the application scenario to the user terminal; the selection interface includes: a list of identity identifiers of each smart home device;

[0136] A first receiving module, configured to receive at least one smart home device selected by the user terminal through the selection interface;

[0137] A fourth display module, used to display to the user terminal a control instruction setting interface corresponding to each smart home device in the at least one smart home device;

[0138] The second receiving module is used to receive the control instructions set by the user terminal for each smart home device through the control instruction setting interface, and save them to form an application scenario.

[0139] Optionally, the control system further includes:

[0140] A sending module, configured to send a heartbeat request and / or a status request to each smart home device according to a preset period if no control instruction is received within a preset time period;

[0141] The third receiving module is used to receive the heartbeat parameters and / or status returned by each smart home device.

[0142] Optionally, the authorization module includes:

[0143] The first interface display submodule is used to display an authorization guidance interface to the user terminal; the authorization guidance interface includes: a list of identity identifiers of various smart home device brands;

[0144] A first receiving submodule is configured to receive at least one smart home device brand selected by the user terminal through the authorization guidance interface;

[0145] A second interface display submodule, used to display a login interface corresponding to each smart home device brand of the at least one smart home device brand to the user terminal;

[0146] A second receiving submodule is used to receive login instructions of various smart home device brands respectively input by the user terminal through the login interface, and trigger an authorization process;

[0147] The authorization submodule obtains the authorization of the several smart home device brands based on a two-way trust protocol during the authorization process.

[0148] The present application also provides an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements any one of the aforementioned control methods for smart home devices when executing the program.

[0149] The present application also provides a readable storage medium. When the instructions or transactions in the storage medium are executed by a processor of an electronic device, the electronic device can execute any of the aforementioned control methods for smart home devices.

[0150] The present application also provides a computer program product, including instructions or transactions, which, when executed by a processor in an electronic device, enable the electronic device to execute any of the aforementioned methods for controlling smart home devices.

[0151] It should be noted that the control system, electronic device, readable storage medium and computer program product can all refer to the description of the aforementioned control method and have the same or similar beneficial effects. In order to avoid repetition, they will not be described here.

[0152] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0153] The present application also provides an electrical appliance, which includes any of the aforementioned control methods for smart home devices. The type of the electrical appliance is not specifically limited. For example, the electrical appliance may be an air conditioner, a robotic arm, etc. The preparation method of the electrical appliance and the aforementioned control method for smart home devices has the same or similar beneficial effects as any of the aforementioned control methods for smart home devices, and will not be described in detail here to avoid repetition.

[0154] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the application disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0155] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A control method for a smart home device, characterized in that: include: Integrate the control interfaces of several smart home device brands into one integrated interface; Based on a two-way trust agreement, obtain authorization from the several smart home device brands; Based on the integrated interface, receiving a control instruction for a target smart home device under the smart home device brand issued by a user end; the control instruction includes: an identity identifier of the target smart home device and an operation instruction for the target smart home device; Through the authorization, the operation instruction is executed on the target smart home device based on the integrated interface.

2. The control method of the smart home device according to claim 1, characterized in that: Before receiving a control instruction for a target smart home device under the smart home device brand from a user terminal based on the integrated interface, the method further includes: Displaying a control interface for the smart home device to the user terminal; the control interface includes: a room identifier and a list of identity identifiers of each smart home device deployed in the room; The step of receiving a control instruction for a target smart home device under the smart home device brand from a user terminal based on the integrated interface includes: Based on the integrated interface, accepting a control instruction for a target smart home device in a target room issued by the user terminal through the control interface; the control instruction further includes: a room identifier of the target room; The step of executing the operation instruction on the target smart home device based on the integrated interface through the authorization includes: Through the authorization, the operation instruction is executed on the target smart home device in the target room based on the integrated interface.

3. The control method of the smart home device according to claim 1, characterized in that: Before receiving a control instruction for a target smart home device under the smart home device brand from a user terminal based on the integrated interface, the method further includes: Displaying a control interface for the smart home device to the user terminal; the control interface includes: an application scenario, the application scenario includes: multiple target smart home devices, and linkage operation instructions for the multiple target smart home devices; The step of receiving a control instruction for a target smart home device under the smart home device brand from a user terminal based on the integrated interface includes: Based on the integrated interface, receiving a control instruction for the application scenario issued by the user terminal through the control interface; The step of executing the operation instruction on the target smart home device based on the integrated interface through the authorization includes: Through the authorization, based on the integrated interface, the linkage operation instructions corresponding to the application scenario are executed on each target smart home device in the application scenario.

4. The control method of the smart home device according to claim 3, characterized in that: Before presenting the control interface of the smart home device to the user terminal, the method further includes: Displaying a smart home selection interface in the application scenario to the user terminal; the selection interface includes: a list of identity identifiers of each smart home device; Receiving at least one smart home device selected by the user through the selection interface; Displaying, to the user terminal, control instruction setting interfaces corresponding to each of the at least one smart home device; Receive the control instructions set by the user end for each smart home device through the control instruction setting interface, and save them to form an application scenario.

5. The control method of the smart home device according to any one of claims 1 to 4, characterized in that: The method further comprises: If no control command is received within a preset time, a heartbeat request and / or a status request is sent to each smart home device according to a preset period; Receive heartbeat parameters and / or status returned by each smart home device.

6. The control method of the smart home device according to any one of claims 1 to 4, characterized in that: The obtaining of authorization of the plurality of smart home device brands based on the two-way trust agreement includes: Displaying an authorization guidance interface to the user terminal; the authorization guidance interface includes: a list of identity identifiers of various smart home device brands; Receiving at least one smart home device brand selected by the user through the authorization guidance interface; Displaying a login interface corresponding to each smart home device brand of the at least one smart home device brand to the user terminal; Receiving login instructions of various smart home device brands respectively input by the user terminal through the login interface, and triggering an authorization process; In the authorization process, authorization of the several smart home device brands is obtained based on a two-way trust agreement.

7. A control system for smart home devices, characterized in that: include: Integration module, used to integrate the control interfaces of several smart home device brands into one integrated interface; An authorization module, used to obtain authorization of the several smart home device brands based on a two-way trust protocol; A control instruction receiving module, configured to receive, based on the integrated interface, a control instruction issued by a user terminal to a target smart home device under the smart home device brand; the control instruction includes: an identity identifier of the target smart home device and an operation instruction for the target smart home device; A control module is used to execute the operation instruction on the target smart home device based on the integrated interface through the authorization.

8. An electronic device, characterized in that: include: A processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the control method of the smart home device as claimed in any one of claims 1 to 6 when executing the program.

9. A readable storage medium, characterized in that: When the instructions or transactions in the storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the control method of a smart home device according to any one of claims 1 to 6.

10. A computer program product, characterized in that The method comprises instructions or transactions, which, when executed by a processor in an electronic device, enable the electronic device to execute the control method of a smart home device according to any one of claims 1 to 6.

Images