A voice control system and method for intelligent equipment
By introducing intelligent gateways into the voice control system of smart devices, the dependence on external networks is reduced, the problems of long communication links and overloading of servers are solved, and the speed and user experience of voice control are improved.
Patent Information
- Application Number
- CN202010904051.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2020-09-01
- Publication Date
- 2024-11-01
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The control process of the existing smart device voice control system is complicated, and the communication link is too long, which can easily affect the control effect due to blockage or failure. The server is overloaded and unable to work properly due to too many smart devices to control the server.
Introduce an intelligent gateway, the voice controller sends voice commands to the voice server, the voice server parses the control command and returns the unique identifier of the smart device, the voice controller generates protocol commands and sends it to the smart gateway, the smart gateway forwards the instructions to the smart device, and controls the server to establish The association between smart devices and voice controllers reduces dependence on external networks.
Reduce dependence on external networks, improve the speed and user experience of voice control, solve the problem of device control servers and smart devices being unable to connect and servers being overloaded, and improve the stability and response speed of the system.
Smart Images

Figure CN112071320B_ABST
Abstract
Description
Technical Field
[0001] The present invention belongs to the technical field of intelligent device control, and in particular relates to an intelligent device voice control system and method. Background Art
[0002] With the rapid development of Internet of Things technology and the application of voice recognition technology, more and more smart devices can be controlled by voice. Fig.10 As shown in the figure, the control process of the current smart device voice control system is relatively complicated. First, the voice command needs to be sent to a dedicated voice server through the network for voice command recognition, and then the recognition result is sent to the control server to control the smart device through the control server. The specific control process is: the voice controller uploads the voice command to the voice server, the voice server recognizes the voice command and sends the parsed control command to the control server, the control server generates a protocol command based on the received control command and the control protocol corresponding to the smart device and sends it to the smart device; the role of the voice server is only to recognize and understand the voice command, and does not store any information related to the smart device. The role of the control server is to remotely control the device.
[0003] The above control methods have the following problems: First, the transmission path of the control instructions in the wide area network is too long. Once one of the communication links is blocked or fails, the control effect will be affected. For example, a communication connection cannot be established between the voice server and the control server or between the control server and the smart device. Secondly, too many smart devices connected to the control server will cause the server to be overloaded and unable to work normally. Summary of the invention
[0004] The purpose of the present invention is to solve the problems in the prior art that the voice control method of smart devices is complicated, the communication link is too long, link blockage or failure will affect the control effect of the system, and too many smart devices connected to the control server will cause the server to be overloaded and unable to work normally.
[0005] The present invention solves the above technical problems through the following technical solutions:
[0006] A smart device voice control system comprises: a voice controller, a voice server, an intelligent gateway, a control server, and a plurality of smart devices; the voice controller is used to receive voice instructions, send the voice instructions to the voice server, generate protocol instructions according to the returned unique identifier of the smart device and the control instruction, and then send the protocol instruction to the intelligent gateway; the voice server is used to identify the voice instruction, parse out the control information, judge the unique identifier of the smart device to be controlled, and return the unique identifier of the smart device and the control instruction to the voice controller; the intelligent gateway is used to receive and parse the unique identifier of the smart device contained in the protocol instruction, and then send the received protocol instruction to the corresponding smart device; the control server is used to establish an association relationship between the smart device and the voice controller, including establishing a binding relationship between the intelligent gateway and the smart device and between the intelligent gateway and the voice controller, and synchronizing the binding relationship to the voice server; the smart device is used to execute the control action contained in the protocol instruction.
[0007] A smart device voice control system also includes the following control process: the voice controller uploads the voice command to the voice server, the voice server stores the information of the smart gateway and the smart device bound / associated with the voice controller, the voice server recognizes the voice command and parses the control command, and then sends the control command and the corresponding smart device unique identifier to the voice controller, the voice controller generates a protocol command based on the received information and sends it to the smart gateway, and the smart gateway then forwards the protocol command to the smart device.
[0008] The above control system and process solve many problems existing in the voice control method of smart devices in the prior art. First, only voice recognition needs to rely on the external network, while device control does not rely on the external network. Therefore, the degree of dependence on the external network environment is reduced; secondly, the smart devices are controlled by the intelligent gateway existing in the same local area network / intranet, which reduces the time from the user's voice command request to the device response, the voice control device is fast, and the user experience is improved.
[0009] As a further improvement of the technical solution of the present invention, the method for establishing an association relationship between the smart device and the voice controller is:
[0010] Step 101: The control server sends the binding relationship between the intelligent gateway and the voice controller to the voice server corresponding to the voice controller;
[0011] Step 102: The control server sends the binding relationship between the intelligent gateway and the intelligent device to the voice server corresponding to the voice controller bound to the intelligent gateway;
[0012] Step 103: The voice server establishes an association relationship between the smart device and the voice controller according to the received binding relationship between the smart gateway and the voice controller and between the smart gateway and the smart device.
[0013] As a further improvement of the technical solution of the present invention, there are multiple smart gateways, and the multiple smart gateways respectively receive and parse the unique identifier of the smart device contained in the protocol instructions, and then send the received protocol instructions to the corresponding smart devices; there are multiple control servers, and the multiple control servers respectively establish binding relationships between the multiple smart gateways and smart devices and between the multiple smart gateways and voice controllers, and synchronize the binding relationships to the voice servers.
[0014] A method applied to the intelligent device voice control system, comprising the following steps:
[0015] Step 110: the voice controller sends a recognition request of a voice command to the voice server; the voice command is a voice signal received by the voice controller to control the smart device;
[0016] Step 120: The voice server determines the unique identifier of the smart device to be controlled based on the control information contained in the received voice command, and returns the control command, the unique identifier of the smart device and the smart gateway information to the voice controller;
[0017] Step 130: The voice controller generates a protocol instruction based on the returned unique identifier of the smart device and the control instruction, and then sends the protocol instruction to the smart gateway bound to the device;
[0018] Step 140: The intelligent gateway parses the unique identifier of the intelligent device contained in the received protocol instruction, and sends the received protocol instruction to the corresponding intelligent device.
[0019] As a further improvement of the technical solution of the present invention, before the voice controller sends a recognition request for a voice command to the voice server, it also includes: the voice controller sends a connection request to the voice server, and the voice controller sends a MAC address and an identity identifier to the voice server so that the voice server can verify whether the information is consistent with the pre-stored information. If they are consistent, the connection is successful.
[0020] As a further improvement of the technical solution of the present invention, the voice server determines the unique identifier of the smart device to be controlled based on the control information contained in the received voice command, specifically including:
[0021] Step 121: The voice server recognizes the voice signal and extracts the semantic information of the received voice command, and extracts the control information contained in the voice command;
[0022] Step 122: The voice server obtains the smart device information associated with the voice controller according to the voice controller identity identifier;
[0023] Step 123: Based on the smart device name and attributes contained in the control information and the smart device information associated with the voice controller, determine the unique identifier of the smart device to be controlled and the smart gateway information bound to the device.
[0024] As a further improvement of the technical solution of the present invention, before the voice controller generates a protocol instruction based on the returned unique identifier of the smart device and the control instruction, and then sends the protocol instruction to the smart gateway bound to the device, it also includes: the voice controller sends a connection request to the smart gateway, the voice controller sends its own MAC address and identity identifier to the smart gateway, and the smart gateway reports the received information to the control server for the control server to verify whether the information is consistent with the pre-stored information. If they are consistent, a binding relationship between the smart gateway and the voice controller is established, and the smart gateway stores the identity identifier of the voice controller to complete the binding.
[0025] As a further improvement of the technical solution of the present invention, before the intelligent gateway parses the unique identifier of the intelligent device contained in the received protocol instruction and sends the received protocol instruction to the corresponding intelligent device, it also includes: the intelligent device sends a connection request to the intelligent gateway, the intelligent device sends its own MAC address and unique identifier to the intelligent gateway, and the intelligent gateway reports the received information to the control server for the control server to verify whether the information is consistent with the pre-stored information. If they are consistent, a binding relationship between the intelligent gateway and the intelligent device is established, and the intelligent gateway stores the unique identifier of the intelligent device to complete the binding.
[0026] As a further improvement of the technical solution of the present invention, the voice controller uses the HTTPS protocol to establish a data transmission channel with the voice server and encrypts the transmitted data.
[0027] As a further improvement of the technical solution of the present invention, the data transmitted between the intelligent gateway and the control server, between the intelligent gateway and the voice controller, and between the intelligent gateway and the intelligent device are encrypted using the MQTT protocol and the AES encryption algorithm.
[0028] The present invention also includes: a non-transitory computer-readable storage medium storing a computer program for implementing the method of the smart device voice control system, characterized in that the computer program implements the steps of the method of the smart device voice control system when executed by a processor.
[0029] The advantages of the present invention are:
[0030] (1) Voice control of smart devices does not need to rely on control servers, which reduces the degree of dependence on control servers; only the recognition of voice commands needs to rely on external networks, while device control does not rely on external networks. Therefore, the degree of dependence on the external network environment is reduced, and the time from voice command request to device response is greatly reduced. Voice control of devices is fast, and user experience is improved.
[0031] (2) The voice controller and the smart gateway, as well as the smart gateway and the smart device, also communicate through a home router or a local area network, with the smart gateway acting as a home router.
[0032] (3) The data messages between the smart gateway and other devices use the MQTT message queue telemetry transmission protocol. The protocol is simple, the header is small, and the requirements for bandwidth and computing power are not high. It is suitable for the Internet of Things and small devices. At the same time, it has a message confirmation mechanism to ensure the delivery of messages.
[0033] (4) The intelligent gateway is used to communicate with the voice controller, thereby solving the problem of remote control failure caused by the inability to establish a connection between the device control server and the intelligent device.
[0034] (5) The intelligent gateway is used to communicate with the intelligent devices, thus solving the problem of the server failing to respond due to too many connections to the device control server.
[0035] (6) By adopting the message queue telemetry protocol, the problem of slow response of small IoT devices to control instructions is solved. BRIEF DESCRIPTION OF THE DRAWINGS
[0036] Figure 1 It is a schematic diagram of a voice control system for an intelligent device provided by the present invention;
[0037] Figure 2 It is a structural block diagram of a voice control system for an intelligent device provided by the present invention;
[0038] Figure 3 It is a control principle diagram of a smart device voice control system provided by the present invention;
[0039] Figure 4 It is a schematic diagram of an extended implementation of a smart device voice control system provided by the present invention;
[0040] Figure 5 It is a flow chart of a method for voice control of an intelligent device provided by the present invention;
[0041] Figure 6 It is a flow chart of a method for a voice server of a smart device voice control method provided by the present invention to determine a unique identifier of a smart device;
[0042] Figure 7 It is a flow chart of a method for establishing association between a voice controller and a smart device in a method for voice control of a smart device provided by the present invention;
[0043] Figure 8 It is a schematic diagram of a method for binding a voice controller and an intelligent gateway in a method for voice control of an intelligent device provided by the present invention;
[0044] Fig. 9 It is a schematic diagram of a method for binding a smart device and a smart gateway in a method for voice control of a smart device provided by the present invention;
[0045] Fig.10 It is a schematic diagram of a smart device control method in the prior art. DETAILED DESCRIPTION
[0046] To make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in combination with the embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0047] The technical solution of the present invention is further described below in conjunction with the accompanying drawings and specific embodiments:
[0048] like Figure 1 As shown, a smart device voice control system includes: a voice controller, a voice server, an intelligent gateway, and multiple smart devices; the voice controller is used to receive voice instructions, send the voice instructions to the voice server, and generate protocol instructions according to the returned smart device unique identification and control instructions, and then send the protocol instructions to the intelligent gateway; the voice server is used to identify the voice instructions, parse out the control information, determine the unique identification of the smart device to be controlled, and return the unique identification of the smart device and the control instructions to the voice controller; the intelligent gateway is used to receive and parse the unique identification of the smart device contained in the protocol instruction, and then send the received protocol instruction to the corresponding smart device; the smart device is used to execute the control action contained in the protocol instruction.
[0049] like Figure 2 and Figure 3 As shown, the smart device voice control system also includes a control server, which is used to establish an association relationship between the smart device and the voice controller, including establishing a binding relationship between the smart gateway and the smart device and between the smart gateway and the voice controller, and synchronizing the binding relationship to the voice server.
[0050] like Figure 4 As shown, there are multiple smart gateways, and the multiple smart gateways respectively receive and parse the unique identifier of the smart device contained in the protocol instruction, and then send the received protocol instruction to the corresponding smart device; there are multiple control servers, and the multiple control servers respectively establish binding relationships between the multiple smart gateways and smart devices and between the multiple smart gateways and voice controllers, and synchronize the binding relationships to the voice server.
[0051] like Figure 5 As shown, the process of the smart device voice control method includes the following steps:
[0052] Step 110: the voice controller sends a recognition request of a voice command to the voice server; the voice command is a voice signal received by the voice controller to control the smart device;
[0053] In the embodiment of the present invention, the voice controller has a far-field voice collection function, which is used for long-distance voice control of smart devices (within a few meters). Generally, a microphone array and related noise reduction, echo cancellation and sound source localization technologies are used to process the collected voice signals before recognition to improve the accuracy of voice recognition; the voice controller compresses the collected and processed voice signals and uploads them to a dedicated voice server through the network, recognizes the voice signals through a voice recognition algorithm, and then parses the control intent through a semantic understanding algorithm, and converts the voice instructions into specific control instructions. Among them, the algorithm for voice recognition can be an algorithm based on a neural network, and the present invention does not limit the specific algorithm for voice recognition; among them, the algorithm for semantic understanding can be a method based on information extraction, and the present invention does not limit the specific algorithm for semantic understanding.
[0054] Before the voice controller sends a recognition request for the voice command to the voice server, the method further includes:
[0055] The voice controller sends a connection request to the voice server, and the voice controller sends the MAC address and identity to the voice server so that the voice server can verify whether the information is consistent with the pre-stored information. If they are consistent, the connection is successful.
[0056] As an embodiment of the present invention, the voice controller can be a smart speaker. The voice controller needs to be activated before use. Specifically, the voice controller communicates with a mobile phone APP through a short-range wireless communication technology, such as Bluetooth, and sends the username and password of the home wireless network to the voice controller through the mobile phone APP for the controller to connect to the Internet; after the voice controller is successfully connected to the Internet, it sends a connection request to the voice server, and encrypts the identity of the controller into a ciphertext through an encryption algorithm and sends it to the voice server; the voice server determines the key for decrypting the ciphertext sent by the controller through the received information related to the controller, such as the brand, model, MAC address of the controller, etc., and decrypts the ciphertext with the pre-stored key to obtain the identity of the controller; the voice server checks the received controller MAC address and the controller identity obtained after decryption with the pre-stored information, and establishes a connection if they are consistent.
[0057] Step 120: The voice server determines the unique identifier of the smart device to be controlled based on the control information contained in the received voice command, and returns the control command, the unique identifier of the smart device and the smart gateway information to the voice controller;
[0058] The voice server determines the unique identifier of the smart device to be controlled based on the control information contained in the received voice command, specifically including:
[0059] Step 121: The voice server recognizes the voice signal and extracts the semantic information of the received voice command, and extracts the control information contained in the voice command;
[0060] Step 122: The voice server obtains the smart device information associated with the voice controller according to the voice controller identity identifier;
[0061] Step 123: Based on the smart device name and attributes contained in the control information and the smart device information associated with the voice controller, determine the unique identifier of the smart device to be controlled and the smart gateway information bound to the device.
[0062] In an embodiment of the present invention, the control information includes: the name and attributes of the smart device, the control category and the control action. For example, if the voice command received by the voice server is "turn on the bedroom air conditioner", then "air conditioner" corresponds to the device name, and "bedroom" corresponds to the device attribute. The device attribute is used to distinguish devices of the same category. The device name can also be a custom name, such as "Xiao Fei". The device attribute can also be the serial number or brand of the device, such as "No. 1 Lamp", "Haier Air Conditioner", etc. The present invention does not limit the definition scope of the name and attribute of the smart device.
[0063] In an embodiment of the present invention, the voice server stores the smart device information associated with the voice controller, and the smart device information includes: information of the smart gateway bound to the smart device, a unique identifier of the smart device, and the name and attributes of the smart device. Among them, the unique identifier of the smart device is a device identifier burned when the device is produced, which is used to distinguish different devices and is unique. The voice server obtains the smart device information associated with the controller according to the identity identifier of the voice controller, and determines the unique identifier of the smart device to be controlled according to the control information in step 121, such as the unique identifier of the device corresponding to the "bedroom air conditioner". Among them, the correspondence between the name and attributes of the smart device and the unique identifier of the smart device can be completed through the APP of the smart device, and can also be set through the APP of the voice controller, which will not be repeated here.
[0064] In the above embodiment, when there are multiple smart gateways bound to the voice controller, the information returned from the voice server includes not only the unique identifier of the smart device, but also the information of the smart gateway bound to the smart device, and the information of the smart gateway includes the MAC address of the smart gateway.
[0065] In an embodiment of the present invention, after the voice server completes the action of associating the voice controller with the smart device described in steps 101 to 103 above, the voice server sends the associated data to the voice controller; therefore, the voice controller stores information about the smart gateway / smart device bound / associated with it.
[0066] Step 130, the voice controller generates a protocol instruction based on the returned unique identifier of the smart device and the control instruction, and then sends the protocol instruction to the smart gateway bound to the device;
[0067] In the embodiment of the present invention, the HTTPS protocol is used to transmit data between the voice controller and the voice server, and the MQTT protocol is used to transmit data between the voice controller and the intelligent gateway. Therefore, after the voice controller receives the unique identifier of the intelligent device and the control instruction returned from the voice server, it is necessary to convert the received data into the form of the MQTT protocol and then send it to the intelligent gateway. At the same time, when there are multiple intelligent gateways bound to the voice controller, the voice controller needs to determine which intelligent gateway to forward the control instruction to. Specifically, it can be determined by the intelligent gateway information bound to the intelligent device returned from the voice server.
[0068] Step 140: The intelligent gateway parses the unique identifier of the intelligent device contained in the received protocol instruction, and sends the received protocol instruction to the corresponding intelligent device.
[0069] In the embodiment of the present invention, the data sent by the voice controller to the intelligent gateway and the data sent by the intelligent gateway to the intelligent device are both data encrypted by an encryption algorithm; the intelligent gateway stores the controller information bound to it, including: the controller MAC address, identity identification and decryption key; the intelligent gateway decrypts the received protocol instruction through the pre-stored key to obtain the unique identification of the device to be controlled; the intelligent gateway also stores the intelligent device information bound to it, including: the MAC address, unique identification and encryption key of the intelligent device; the intelligent gateway re-encrypts the protocol instruction according to the pre-stored key of the intelligent device and sends it to the intelligent device; the intelligent device decrypts the data sent by the intelligent gateway, obtains the protocol instruction therein and executes the corresponding control operation; at the same time, the intelligent device returns the execution result of the protocol instruction to the intelligent gateway, so that the intelligent gateway can synchronize the running status of the device to the device control server.
[0070] like Figure 7 As shown, the method for establishing an association relationship between the smart device and the voice controller provided by the present invention includes:
[0071] Step 101, the control server sends the binding relationship between the intelligent gateway and the voice controller to the voice server corresponding to the voice controller;
[0072] Step 102, the control server sends the binding relationship between the intelligent gateway and the intelligent device to the voice server corresponding to the voice controller bound to the intelligent gateway;
[0073] Step 103: The voice server establishes an association relationship between the smart device and the voice controller according to the received binding relationship between the smart gateway and the voice controller and the smart device.
[0074] like Figure 8 As shown, a schematic diagram of a method for binding an intelligent gateway and a voice controller provided by an embodiment of the present invention specifically includes: the voice controller sends a connection request to the intelligent gateway, the voice controller sends its own MAC address and identity to the intelligent gateway, and the intelligent gateway reports the received information to the control server for the control server to verify whether the information is consistent with the pre-stored information. If they are consistent, a binding relationship between the intelligent gateway and the voice controller is established, and the intelligent gateway stores the voice controller identity to complete the binding.
[0075] Furthermore, the control server pre-stores the voice controller information, including: the voice controller MAC address, identity, and a key for decrypting data sent by the controller.
[0076] In an embodiment of the present invention, the connection request data sent by the voice controller includes the type and model of the voice controller, such as: Feier Speaker X1, and may also include the device MAC address. The above information is transmitted in plain text and is used by the recipient to determine the key for decrypting the encrypted data. The identity identifier sent by the voice controller to the intelligent gateway is encrypted. If the intelligent gateway does not pre-store the decryption key corresponding to the voice controller, the received encrypted information is sent to the control server. It should be explained here that the data sent by the intelligent gateway to the control server also needs to be encrypted. In particular, the intelligent gateway encrypts the information received from the voice controller into ciphertext using the encryption algorithm of the intelligent gateway and then reports it to the control server; after the control server decrypts the received encrypted data, it verifies whether the corresponding relationship between the MAC address of the voice controller and the identity identifier is consistent with the pre-stored information. If they are consistent, a binding relationship between the intelligent gateway and the voice controller is established. At the same time, the control server returns the binding information to the intelligent gateway, and the intelligent gateway stores the voice controller information to complete the binding.
[0077] like Fig. 9 As shown, a schematic diagram of a method for binding a smart gateway and a smart device provided by an embodiment of the present invention specifically includes: the smart device sends a connection request to the smart gateway, the smart device sends its own MAC address and unique identifier to the smart gateway, the smart gateway reports the received information to the control server, so that the control server can verify whether the information is consistent with the pre-stored information. If they are consistent, a binding relationship between the smart gateway and the smart device is established, and the smart gateway stores the smart device information to complete the binding.
[0078] Furthermore, the control server pre-stores information of the smart device, including: a MAC address of the smart device, a unique identifier, and a key for decrypting data sent by the smart device.
[0079] In the embodiment of the present invention, the connection request data sent by the smart device includes the type and model of the smart device, such as Haier Air Conditioner S1. The above information is transmitted in plain text and is used by the receiving party to determine the secret key required to decrypt the encrypted data. After the control server decrypts the encrypted data sent by the received smart device with the pre-stored secret key, it verifies whether the received smart device MAC address and unique identifier are consistent with the pre-stored information. If they are consistent, a binding relationship between the smart device and the smart gateway is established, and the information of the smart device is returned to the smart gateway.
[0080] Here, it should be explained that the keys corresponding to smart devices can be set differently according to different MAC addresses; considering that the number of keys is too large and it is inconvenient to manage the keys, different keys can also be set according to different device types and models; or the keys can be set according to the serial number of the product. Specifically, the same key is used for product serial numbers within a specific range.
[0081] Furthermore, the method provided by the present invention is characterized in that the voice controller uses the HTTPS protocol to establish a data transmission channel with the voice server and encrypts the transmitted data.
[0082] In the embodiment of the present invention, the HTTPS protocol is a network protocol constructed by adding the HTTP protocol to the SSL protocol, which can perform encrypted transmission and identity authentication. It mainly completes Internet data transmission encryption through digital certificates, encryption algorithms, asymmetric keys and other technologies to achieve Internet transmission security protection.
[0083] In an embodiment of the present invention, the voice command sent by the voice controller to the voice server includes a voice signal; considering that the voice signal data packet is large and the asymmetric encryption algorithm is too slow, the voice signal is encrypted using a symmetric encryption algorithm, and the present invention does not limit the encryption algorithm of the voice signal; the voice server can pre-store a secret key for decrypting the voice signal, or send the secret key through the voice controller, and the present invention does not limit this; when the secret key for decrypting the voice signal is sent through the voice controller, an asymmetric encryption algorithm, such as the RSA algorithm, is used to encrypt the secret key before transmitting it to ensure the security of the secret key, and the specific steps are not repeated here.
[0084] Furthermore, the method provided by the present invention is characterized in that the data transmitted between the intelligent gateway and the control server, between the intelligent gateway and the voice controller, and between the intelligent gateway and the intelligent device are encrypted using the MQTT protocol and the AES encryption algorithm.
[0085] In an embodiment of the present invention, the MQTT protocol is used to transmit data between the intelligent gateway and the control server, between the intelligent gateway and the voice controller, and between the intelligent gateway and the intelligent device; MQTT (message queuing telemetry transport) is an instant messaging and message transmission protocol. The protocol is simple and lightweight, and does not require high bandwidth and computing power, making it suitable for the Internet of Things and small devices; MQTT uses the TCP / IP protocol by default to provide network connection. Since the MQTT protocol has a connection maintenance mechanism, that is, a heartbeat request and a heartbeat response, it can maintain a long connection between the intelligent gateway and the intelligent device; therefore, the intelligent gateway can not only send protocol instructions to the intelligent device, but also the intelligent device can report the operating status of the device to the intelligent gateway and the control server in real time, so that the control server can remotely manage and control the intelligent device.
[0086] In the embodiment of the present invention, the AES encryption algorithm is used to encrypt the transmitted data between the intelligent gateway and the control server, between the intelligent gateway and the voice controller, and between the intelligent gateway and the intelligent device; AES stands for "Advanced Encryption System" and is the most widely used and faster symmetric encryption algorithm. The symmetric encryption algorithm uses the same key for encryption and decryption; the intelligent gateway stores the key of the voice controller and also stores the key of the intelligent device; when the intelligent gateway sends a protocol instruction to the intelligent device, the protocol instruction data is encrypted using the key of the intelligent device and then transmitted. After the intelligent device receives the ciphertext, it uses its own key to decrypt the ciphertext to obtain the protocol instruction.
[0087] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit the same. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that the technical solutions described in the aforementioned embodiments may still be modified, or some of the technical features may be replaced by equivalents. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.
Claims
1. A control method for a voice control system of an intelligent device, characterized in that: The intelligent device voice control system comprises: a voice controller, a voice server, an intelligent gateway, a plurality of intelligent devices, and a control server; the voice controller is used to receive voice instructions, send the voice instructions to the voice server, generate protocol instructions according to the returned unique identifier of the intelligent device and the control instruction, and then send the protocol instructions to the intelligent gateway; the voice server is used to identify the voice instructions, parse out the control information, determine the unique identifier of the intelligent device to be controlled, and return the unique identifier of the intelligent device and the control instruction to the voice controller; the intelligent gateway is used to receive and parse the unique identifier of the intelligent device contained in the protocol instruction, and then send the received protocol instruction to the corresponding intelligent device; the intelligent device is used to execute the control action contained in the protocol instruction; the control server is used to establish an association relationship between the intelligent device and the voice controller, including establishing a binding relationship between the intelligent gateway and the intelligent device and between the intelligent gateway and the voice controller, and synchronizing the binding relationship to the voice server; There are multiple intelligent gateways, and the multiple intelligent gateways respectively receive and parse the unique identifier of the intelligent device contained in the protocol instruction, and then send the received protocol instruction to the corresponding intelligent device; there are multiple control servers, and the multiple control servers respectively establish binding relationships between the multiple intelligent gateways and the intelligent devices and between the multiple intelligent gateways and the voice controllers, and synchronize the binding relationships to the voice server; The method for establishing an association relationship between the smart device and the voice controller is: Step 101: The control server sends the binding relationship between the intelligent gateway and the voice controller to the voice server corresponding to the voice controller; Step 102: The control server sends the binding relationship between the intelligent gateway and the intelligent device to the voice server corresponding to the voice controller bound to the intelligent gateway; Step 103: The voice server establishes an association relationship between the smart device and the voice controller according to the received binding relationship between the smart gateway and the voice controller and the smart device; The control method comprises the following steps: Step 110: the voice controller sends a connection request to the voice server, and the voice controller sends the MAC address and identity to the voice server, so that the voice server can verify whether the information is consistent with the pre-stored information. If they are consistent, the connection is successful; the voice controller sends a recognition request for a voice command to the voice server; the voice command is a voice signal received by the voice controller to control the smart device; Step 120: The voice server determines the unique identifier of the smart device to be controlled based on the control information contained in the received voice command, and returns the control command, the unique identifier of the smart device and the smart gateway information to the voice controller; The voice server determines the unique identifier of the smart device to be controlled based on the control information contained in the received voice command, specifically including: Step 121: The voice server recognizes the voice signal and extracts the semantic information of the received voice command, and extracts the control information contained in the voice command; Step 122: The voice server obtains the smart device information associated with the voice controller according to the voice controller identity identifier; Step 123: Based on the smart device name and attributes contained in the control information and the smart device information associated with the voice controller, determine the unique identifier of the smart device to be controlled and the smart gateway information bound to the device; Step 130: the voice controller sends a connection request to the intelligent gateway, the voice controller sends its own MAC address and identity to the intelligent gateway, the intelligent gateway reports the received information to the control server, so that the control server can verify whether the information is consistent with the pre-stored information. If they are consistent, a binding relationship between the intelligent gateway and the voice controller is established, and the intelligent gateway stores the identity of the voice controller to complete the binding; the voice controller generates a protocol instruction based on the returned unique identifier of the intelligent device and the control instruction, and then sends the protocol instruction to the intelligent gateway bound to the device; Step 140: The smart device sends a connection request to the smart gateway, and the smart device sends its own MAC address and unique identifier to the smart gateway. The smart gateway reports the received information to the control server for the control server to verify whether the information is consistent with the pre-stored information. If they are consistent, a binding relationship between the smart gateway and the smart device is established, and the smart gateway stores the unique identifier of the smart device to complete the binding; the smart gateway parses the unique identifier of the smart device contained in the received protocol instruction, and sends the received protocol instruction to the corresponding smart device.
2. The control method according to claim 1, characterized in that: The voice controller uses the HTTPS protocol to establish a data transmission channel with the voice server and encrypts the transmitted data.
3. The control method according to claim 1, characterized in that: The MQTT protocol and AES encryption algorithm are used to encrypt data transmitted between the smart gateway and the control server, between the smart gateway and the voice controller, and between the smart gateway and the smart device.
4. A non-transitory computer-readable storage medium storing a computer program for implementing the control method according to any one of claims 1 to 3, characterized in that: The computer program implements the steps of the method for controlling the voice control system of an intelligent device when the computer program is executed by a processor.
Citation Information
Patent Citations
Smart home control method and system based on B / S framework
CN104079653A
Wireless transmission system and method based on Internet of Things
CN106850362A
Cloud server-based smart home control system
CN109933029A
Method and system for opening application through voice at intelligent loudspeaker box end
CN110517686A
Method for controlling intelligent device, intelligent housing system and device and medium
CN110716441A
