Iot device control method and apparatus
By enabling voice control of cross-platform IoT devices through voiceprint recognition and the OAuth 2.0 protocol, the problem of cumbersome operations for users in controlling cross-platform devices is solved, improving the user experience and meeting the needs of special groups.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- MIDEA GROUP CO LTD
- Filing Date
- 2021-12-22
- Publication Date
- 2026-05-01
AI Technical Summary
When users control IoT devices using voice interaction devices across platforms, they need to perform cumbersome touch operations and download multiple apps. This is especially difficult for visually or physically impaired users, and the existing technology has high requirements for the platform, resulting in a poor user experience.
By using voiceprint recognition and the OAuth 2.0 protocol, voice control of IoT devices across platforms can be achieved. Users can complete cross-platform control simply by verifying their voice, including voiceprint information verification, access token acquisition, and device list synchronization.
It significantly reduces the difficulty and time required for user operation, improves the user experience, meets the needs of more special groups, and ensures the security and efficiency of cross-platform control.
Smart Images

Figure CN116343801B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of mobile communication technology, and more particularly to a method and apparatus for controlling Internet of Things (IoT) devices. Background Technology
[0002] Currently, when a user binds an IoT device to Platform A, if they want to use Platform B's voice interaction device to control the IoT device via voice, they need to first download Platform B's app or perform touch operations on the screen of the voice interaction device (assuming it has a screen) to complete the login authorization for their Platform A account and synchronize the IoT device. Only then can they continue to use Platform B's voice interaction device to control the IoT device. This approach has the following main drawbacks:
[0003] The user experience is poor. When using the voice interaction terminal, in addition to voice interaction with the device, users also need to perform additional touch operations related to authorization.
[0004] If the user is using a screenless smart speaker or a screenless smart wearable device with a voice assistant, they will need to download the app of platform B and operate it. If the user uses voice interaction terminals of multiple platforms, they will need to download multiple apps and operate them multiple times.
[0005] If the user is physically disabled or visually impaired, the entire operation process is quite difficult;
[0006] The requirements for platform B are relatively high. Platform B needs to have its own app or implement the relevant interface interaction functions for cross-platform authorization of user operation on its own voice device terminal with screen. Summary of the Invention
[0007] This invention aims to at least solve one of the technical problems existing in the prior art. To this end, this invention proposes an IoT device control method. According to an embodiment of this invention, by verifying the user's voiceprint, if the verification is successful, the user can control the IoT device across platforms simply by voice. This solves the cumbersome operation process when users control IoT devices using cross-platform voice interaction devices, significantly reducing the difficulty and time of operation, and improving the user experience.
[0008] The present invention also proposes a method for controlling Internet of Things (IoT) devices.
[0009] An Internet of Things (IoT) device control method according to a first aspect of the present invention includes:
[0010] The first IoT platform sends the target user's verification voiceprint information to the second IoT platform; the verification voiceprint information is used by the second IoT platform to compare and verify the verification voiceprint information with the target user's pre-stored voiceprint information.
[0011] If the verification is successful, the first IoT platform receives the access token and the list of IoT devices associated with the second IoT platform from the second IoT platform.
[0012] The first IoT platform sends a control command to the second IoT platform based on the access token; the control command is used by the second IoT platform to control the IoT devices in the IoT device list.
[0013] According to the IoT device control method of the present invention, by verifying the user's voiceprint, the user can control the IoT device across platforms simply by using voice when the verification is successful. This solves the cumbersome operation process when the user controls the IoT device using a cross-platform voice interaction device, greatly reduces the difficulty and time of operation for the user, and improves the user experience.
[0014] According to an embodiment of the present invention, before the first IoT platform sends the verification voiceprint information of the target user to the second IoT platform, the method further includes:
[0015] The first IoT platform receives the verification voiceprint information sent by the target user through a voice interaction device.
[0016] According to the IoT device control method of the present invention, the voiceprint verification process of the target user can be completed through a single voice interaction, which can reduce the user's cumbersome operation steps and operation time, and can also meet the needs of more special groups.
[0017] According to one embodiment of the present invention, the control command is determined in the following manner:
[0018] The first IoT platform receives voice commands sent by the target user through a voice interaction device;
[0019] The first IoT platform recognizes the voice command to determine the control command.
[0020] According to the IoT device control method of the present invention, cross-platform control of IoT devices can be completed through a single voice interaction, which can reduce the user's cumbersome operation steps and operation time, and can also meet the needs of more special groups.
[0021] According to one embodiment of the present invention, before the first IoT platform receives the access token sent by the second IoT platform and the list of IoT devices associated with the second IoT platform, the method further includes:
[0022] If the verification is successful, the first IoT platform receives the authorization code sent by the second IoT platform;
[0023] The first IoT platform obtains the access token from the second IoT platform according to the authorization code and the OAuth 2.0 protocol.
[0024] According to the IoT device control method of the present invention, by combining voiceprint recognition and OAuth2.0 protocol, the user's voiceprint is verified. If the verification is successful, the second IoT platform generates an authorization code, and the first IoT platform replaces the access token with the authorization code, thus ensuring the security of cross-platform authorization.
[0025] According to one embodiment of the present invention, the first IoT platform receives an access token sent by the second IoT platform and a list of IoT devices associated with the second IoT platform, including any one of the following:
[0026] The first IoT platform sends the acquisition request and the access token to the second IoT platform, and receives the list of IoT devices sent by the second IoT platform after recognizing the access token according to the acquisition request;
[0027] The first IoT platform receives an access token and a list of IoT devices associated with the second IoT platform simultaneously sent by the second IoT platform.
[0028] According to the IoT device control method of the present invention, by receiving an access token from a first IoT platform and a list of IoT devices associated with a second IoT platform, the security and efficiency of cross-platform control of IoT devices are ensured.
[0029] An Internet of Things (IoT) device control method according to a second aspect of the present invention includes:
[0030] The second IoT platform receives the verification voiceprint information of the target user sent by the first IoT platform;
[0031] The second IoT platform compares and verifies the verified voiceprint information with the target user's pre-stored voiceprint information;
[0032] If the verification is successful, the second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform.
[0033] The second IoT platform receives control instructions sent by the first IoT platform based on the access token, and controls the IoT devices in the IoT device list according to the control instructions.
[0034] According to the IoT device control method of the present invention, by verifying the user's voiceprint, the user can control the IoT device across platforms simply by using voice when the verification is successful. This solves the cumbersome operation process when the user controls the IoT device using a cross-platform voice interaction device, greatly reduces the difficulty and time of operation for the user, and improves the user experience.
[0035] According to one embodiment of the present invention, before the second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform, the method further includes:
[0036] If the verification is successful, the second IoT platform generates an authorization code and sends it to the first IoT platform;
[0037] The authorization code is used by the first IoT platform to obtain the access token from the second IoT platform according to the OAuth 2.0 protocol.
[0038] According to the IoT device control method of the present invention, by combining voiceprint recognition and OAuth2.0 protocol, the user's voiceprint is verified. If the verification is successful, the second IoT platform generates an authorization code, and the first IoT platform replaces the access token with the authorization code, thus ensuring the security of cross-platform authorization.
[0039] According to one embodiment of the present invention, the second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform, including any one of the following:
[0040] The second IoT platform receives an acquisition request and an access token sent by the first IoT platform. After recognizing the access token, the second IoT platform sends the IoT device list to the first IoT platform according to the acquisition request.
[0041] The second IoT platform simultaneously sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform.
[0042] According to the IoT device control method of the present invention, an access token is sent through a second IoT platform and a list of IoT devices associated with the second IoT platform is provided, thereby ensuring the security and efficiency of cross-platform control of IoT devices.
[0043] An Internet of Things (IoT) device control apparatus according to a third aspect of the present invention includes:
[0044] The first sending module is used by the first IoT platform to send the verification voiceprint information of the target user to the second IoT platform; the verification voiceprint information is used by the second IoT platform to compare and verify the verification voiceprint information with the pre-stored voiceprint information of the target user.
[0045] The receiving module is used to receive, upon successful verification, an access token sent by the second IoT platform and a list of IoT devices associated with the second IoT platform from the first IoT platform.
[0046] The second sending module is used by the first IoT platform to send a control command to the second IoT platform based on the access token; the control command is used by the second IoT platform to control the IoT devices in the IoT device list.
[0047] According to the IoT device control device of the present invention, by verifying the user's voiceprint, the user can control the IoT device across platforms simply by using voice when the verification is successful. This solves the cumbersome operation process when the user controls the IoT device using a cross-platform voice interaction device, greatly reduces the difficulty and time of operation for the user, and improves the user experience.
[0048] An Internet of Things (IoT) device control apparatus according to a fourth aspect of the present invention includes:
[0049] The receiving module is used for the second IoT platform to receive the verification voiceprint information of the target user sent by the first IoT platform.
[0050] The verification module is used by the second IoT platform to compare and verify the verified voiceprint information with the pre-stored voiceprint information of the target user.
[0051] The sending module is used to send an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform when the verification is successful.
[0052] The control module is used for the second IoT platform to receive control instructions sent by the first IoT platform according to the access token, and to control the IoT devices in the IoT device list according to the control instructions.
[0053] According to the IoT device control device of the present invention, by verifying the user's voiceprint, the user can control the IoT device across platforms simply by using voice when the verification is successful. This solves the cumbersome operation process when the user controls the IoT device using a cross-platform voice interaction device, greatly reduces the difficulty and time of operation for the user, and improves the user experience.
[0054] An electronic device according to a fifth aspect of the present invention includes a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the steps of any of the above-described Internet of Things device control methods.
[0055] According to a sixth aspect of the present invention, a non-transitory computer-readable storage medium is provided thereon storing a computer program that, when executed by a processor, implements the steps of any of the above-described Internet of Things device control methods.
[0056] The above-described one or more technical solutions in the embodiments of the present invention have at least one of the following technical effects:
[0057] By verifying the user's voiceprint, once the verification is successful, the user can control IoT devices across platforms simply by voice. This solves the cumbersome operation process when users control IoT devices using cross-platform voice interaction devices, greatly reducing the difficulty and time of operation and improving the user experience.
[0058] Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description
[0059] To more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.
[0060] Figure 1 This is one of the flowcharts illustrating the IoT device control method provided in this embodiment of the invention;
[0061] Figure 2 This is a second schematic flowchart of the IoT device control method provided in this embodiment of the invention;
[0062] Figure 3 This is one of the structural schematic diagrams of the IoT device control device provided in the embodiments of the present invention;
[0063] Figure 4 This is a second schematic diagram of the structure of the IoT device control device provided in the embodiment of the present invention;
[0064] Figure 5 This is a flowchart illustrating the IoT device control method provided in the embodiments of the present invention;
[0065] Figure 6 This is a schematic diagram of the structure of the electronic device provided in an embodiment of the present invention. Detailed Implementation
[0066] The embodiments of the present invention will be described in further detail below with reference to the accompanying drawings and examples. The following examples are for illustrative purposes only and should not be construed as limiting the scope of the invention.
[0067] In the description of this specification, the references to terms such as "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of the present invention. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.
[0068] To make the objectives, technical solutions, and advantages of this invention clearer, the technical solutions of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this invention. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.
[0069] Figure 1 This is one of the flowcharts illustrating the IoT device control method provided in this embodiment of the invention, referred to... Figure 1 The IoT device control method provided in this embodiment of the invention includes the following steps:
[0070] Step 110: The first IoT platform sends the target user's verification voiceprint information to the second IoT platform; the verification voiceprint information is used by the second IoT platform to compare and verify the verification voiceprint information with the target user's pre-stored voiceprint information.
[0071] Step 120: If the verification is successful, the first IoT platform receives the access token and the list of IoT devices associated with the second IoT platform from the second IoT platform.
[0072] Step 130: The first IoT platform sends a control command to the second IoT platform based on the access token; the control command is used by the second IoT platform to control the IoT devices in the IoT device list.
[0073] An IoT platform encompasses services such as device registration, access management, operation monitoring, data processing and storage, and data presentation or push. It should also be capable of ensuring security, reliability, and ease of use. Generally, the comprehensiveness and reliability of device management and information exchange protocols are paramount. Smart devices typically connect to gateways through an IoT platform, but IoT platforms connected to smart devices from different manufacturers are not interoperable. The first and second IoT platforms connect to different smart devices; these "different smart devices" refer to different models or manufacturers, not necessarily different types of smart devices.
[0074] The execution entity of the IoT device control method provided in this embodiment of the invention can be a first IoT platform. The technical solution of the present invention will be described in detail below using the execution of the IoT device control method provided in this embodiment of the invention by a first IoT platform as an example. The smart device connected to the first IoT platform can be a voice interaction device, such as a smart speaker, like a screenless smart speaker, or a screenless smart wearable device with a voice assistant. The smart device connected to the second IoT platform can be a smart home appliance, such as an air conditioner, refrigerator, rice cooker, washing machine, or water heater, etc., which will not be listed here.
[0075] Optionally, in step 110, the first IoT platform sends the verification voiceprint information of the target user to the second IoT platform; the verification voiceprint information is used by the second IoT platform to compare and verify the verification voiceprint information with the pre-stored voiceprint information of the target user.
[0076] The user initiates voiceprint authentication on the smart speaker connected to the first IoT platform. The first IoT platform recognizes the user's verification voiceprint information and sends it to the second IoT platform. After receiving the verification voiceprint information, the second IoT platform can perform voiceprint verification to confirm the user's identity.
[0077] Users can pre-bind IoT devices on the second IoT platform and pre-record a voice message as pre-stored voiceprint information. The voice message can be a sentence, a few words, or a few numbers, which is equivalent to users logging into the second IoT platform via voice.
[0078] After receiving the user's verification voiceprint information, the second IoT platform compares the verification voiceprint information with the pre-stored voiceprint information. If it is confirmed that the voiceprint belongs to the same user, the verification is successful; otherwise, it fails.
[0079] In step 120, if the verification is successful, the first IoT platform receives an access token and a list of IoT devices associated with the second IoT platform.
[0080] Once the voiceprint verification is successful, meaning the user's identity has been verified, the first IoT platform receives an access token and a refresh token from the second IoT platform. After receiving the access token, the user can log in to the second IoT platform through the first IoT platform.
[0081] Access tokens are a security concept in the Windows operating system. When a user logs in, the system creates an access token containing the SID returned by the login process and a list of privileges assigned to the user and their security groups by local security policies. All processes running as that user have a copy of this token. The system uses the token to control which secure objects a user can access and their ability to perform related system operations.
[0082] Refresh tokens can be used to update the contents of an access token by making a request before the access token expires; they can also be used to revoke access to an authenticated user; refresh tokens do not require storage or prompting for usernames and passwords.
[0083] Optionally, the second IoT platform may connect to multiple IoT devices simultaneously. After receiving the list of IoT devices, the first IoT platform can determine which devices can be controlled through the second IoT platform.
[0084] In step 130, the first IoT platform sends a control command to the second IoT platform based on the access token; the control command is used by the second IoT platform to control the IoT devices in the IoT device list.
[0085] The first IoT platform sends control commands to the second IoT platform based on the access token. The control commands may include: turning on the smart device, turning off the smart device, adjusting the temperature of the smart device to a certain degree, etc. After receiving the command, the second IoT platform controls the corresponding IoT device according to the control command.
[0086] The following is an illustration in combination with a specific scenario. For example, when a user simultaneously owns an air conditioner, a washing machine, a water heater produced by Manufacturer A, and a smart speaker produced by Manufacturer B, the air conditioner, the washing machine, and the water heater are connected to the Internet of Things (IoT) platform A, and the smart speaker is connected to the IoT platform B. Generally, linkage control cannot be achieved between the air conditioner, the washing machine, the water heater, and the smart speaker.
[0087] The user can pre-enter a voice on the IoT platform A as pre-stored voiceprint information, and the voice content can be a sentence, several words, or several numbers. The user can initiate voiceprint authentication on the smart speaker, that is, the user repeats the voice content pre-entered on the IoT platform A. The IoT platform B takes the user's voiceprint information to the IoT platform A to complete the voiceprint feature comparison and verification. If the user identity verification is passed, the IoT platform A sends an access token and a refresh token to the IoT platform B, that is, the user can log in to the IoT platform A through the IoT platform B. The IoT platform A also sends a list of IoT devices associated with the IoT platform A to the IoT platform B, and this list can include: an air conditioner, a washing machine, a water heater, etc. That is, the user can directly initiate a voice command through the smart speaker. For example, turn on the air conditioner and set the temperature to 25°C, or start the washing machine and set it to the dehydration mode, so as to directly control the IoT devices, realizing cross-platform control of IoT devices through voice.
[0088] The IoT device control method provided by the embodiment of the present invention verifies the user's voiceprint. In the case of successful verification, the user only needs to use voice to achieve cross-platform control of IoT devices, solving the cumbersome operation process when the user uses cross-platform voice interaction devices to control IoT devices, greatly reducing the user operation difficulty and operation time, and improving the user experience.
[0089] In one embodiment, before the first IoT platform sends the verified voiceprint information of the target user to the second IoT platform, it further includes:
[0090] The first IoT platform receives the verified voiceprint information sent by the target user through the voice interaction device.
[0091] Optionally, the user initiates voiceprint authentication on the voice interaction device associated with the first IoT platform. After the first IoT platform receives the verified voiceprint information sent by the user, it sends the verified voiceprint information to the second IoT platform to perform the user's voiceprint verification.
[0092] For example, voice interaction devices could be smart speakers, such as screenless smart speakers or screenless smart wearable devices with voice assistants. Users pre-record a voice message on IoT platform A, such as the string of numbers "874276482," as their preset voiceprint information. When a user wants to control a device from manufacturer A through a smart speaker from manufacturer B, they first send the voice message "874276482" to the smart speaker. After receiving the voice message from the user through the smart speaker, IoT platform B sends the user's voice message to IoT platform A, where the received voice message is compared and verified against the pre-stored voiceprint features.
[0093] The IoT device control method provided in this invention can complete the voiceprint verification process of the target user through a single voice interaction, which can reduce the user's cumbersome operation steps and operation time, and can also meet the needs of more special groups.
[0094] In one embodiment, the control command is determined in the following manner:
[0095] The first IoT platform receives voice commands sent by the target user through a voice interaction device;
[0096] The first IoT platform recognizes voice commands to determine control instructions.
[0097] Optionally, the user initiates a voice command on a voice interaction device associated with the first IoT platform. The voice command is directed to a smart device in the IoT device list. The voice command is sent to the first IoT platform via the voice interaction device. The first IoT platform determines the control command based on the user's voice command and then sends the control command to the second IoT platform, thereby enabling cross-platform control of IoT devices via voice.
[0098] For example, a user can directly issue voice commands to Manufacturer B's smart speaker, such as "turn on the TV", "turn on the air conditioner", "turn off the water heater", etc. After receiving the voice commands sent by the user through the voice interaction device, IoT platform B can identify the keywords in the voice commands to determine the control commands, and then send the control commands to IoT platform A to control the corresponding devices.
[0099] The IoT device control method provided in this invention can complete cross-platform control of IoT devices through a single voice interaction, which can reduce the user's cumbersome operation steps and operation time, and can also meet the needs of more special groups.
[0100] In one embodiment, before the first IoT platform receives the access token and the list of IoT devices associated with the second IoT platform, the method further includes:
[0101] If the verification is successful, the first IoT platform receives the authorization code sent by the second IoT platform;
[0102] The first IoT platform obtains an access token from the second IoT platform according to the authorization code and the OAuth 2.0 protocol.
[0103] Optionally, after successful user authentication, the first IoT platform receives an authorization code generated by the second IoT platform, signifying successful authorization from the second IoT platform to the first IoT platform. Upon receiving the authorization code, the first IoT platform can then exchange it for an access token according to the OAuth 2.0 protocol.
[0104] OAuth 2.0 is an authorization mechanism used to authorize third-party applications to access user data. The authorization code method involves the third-party application first requesting an authorization code, and then using that code to obtain a token. This method offers relatively high security. The authorization code is transmitted through the front-end, while the token is stored on the back-end, and all communication with the resource server is completed on the back-end. This separation of front-end and back-end prevents token leakage.
[0105] For example, website A provides a link that redirects a user to website B, authorizing website A to use the user's data. After being redirected, website B asks the user to log in and confirms their agreement to grant authorization to website A. If the user agrees, website B redirects the user to a specified URL, sending back an authorization code. Website A, having obtained the authorization code, can then request a token from website B on its backend. Upon receiving the request, website B issues the token.
[0106] The IoT device control method provided in this embodiment of the invention verifies the user's voiceprint by combining voiceprint recognition and the OAuth 2.0 protocol. If the verification is successful, the second IoT platform generates an authorization code, and the first IoT platform replaces the access token with the authorization code, thus ensuring the security of cross-platform authorization.
[0107] In one embodiment, the first IoT platform receives an access token and a list of IoT devices associated with the second IoT platform, including any one of the following:
[0108] The first IoT platform sends the acquisition request and access token to the second IoT platform, and receives the list of IoT devices sent by the second IoT platform after recognizing the access token and according to the acquisition request;
[0109] The first IoT platform receives an access token and a list of IoT devices associated with the second IoT platform simultaneously.
[0110] Optionally, the first IoT platform initiates an access request to the second IoT platform using an access token, requesting access to the user's list of IoT devices. Upon recognizing the access token from the first IoT platform, the second IoT platform responds to the request by sending the list of IoT devices to the first IoT platform, ensuring the security of cross-platform control of IoT devices.
[0111] Alternatively, the first IoT platform can receive an access token and a list of IoT devices associated with the second IoT platform simultaneously, ensuring the efficiency of cross-platform control of IoT devices.
[0112] The IoT device control method provided in this embodiment of the invention receives an access token from a first IoT platform and a list of IoT devices associated with a second IoT platform, thereby ensuring the security and efficiency of cross-platform control of IoT devices.
[0113] Figure 2 This is a second flowchart illustrating the IoT device control method provided in an embodiment of the present invention, referring to... Figure 2 The IoT device control method provided in this embodiment of the invention includes the following steps:
[0114] Step 210: The second IoT platform receives the verification voiceprint information of the target user sent by the first IoT platform;
[0115] Step 220: The second IoT platform will compare and verify the voiceprint information with the target user's pre-stored voiceprint information;
[0116] Step 230: If the verification is successful, the second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform.
[0117] Step 240: The second IoT platform receives the control command sent by the first IoT platform based on the access token, and controls the IoT devices in the IoT device list according to the control command.
[0118] The execution entity of the IoT device control method provided in this embodiment of the invention can be a second IoT platform. The following describes the technical solution of the invention in detail using the execution of the IoT device control method provided in this embodiment by a second IoT platform as an example. The smart devices connected to the second IoT platform can be smart home appliances, such as air conditioners, refrigerators, rice cookers, washing machines, or water heaters, etc., which will not be listed here. The smart devices connected to the first IoT platform can be voice interaction devices, such as smart speakers, including screenless smart speakers, screenless smart wearable devices with voice assistants, etc. The first IoT platform and the second IoT platform connect to different smart devices respectively. Different smart devices refer to smart devices of different models or manufactured by different manufacturers, not specifically different types of smart devices.
[0119] Optionally, in step 210, the second IoT platform receives the verification voiceprint information of the target user sent by the first IoT platform. The user initiates voiceprint authentication on a smart speaker connected to the first IoT platform. The first IoT platform identifies the user's verification voiceprint information and sends it to the second IoT platform. Upon receiving the verification voiceprint information, the second IoT platform performs voiceprint verification to confirm the user's identity.
[0120] In step 220, the second IoT platform compares the verified voiceprint information with the target user's pre-stored voiceprint information. The user pre-binds their IoT device to the second IoT platform and can pre-record a voice message as pre-stored voiceprint information. The voice message can be a sentence, a few words, or a few numbers, essentially allowing the user to log in to the second IoT platform via voice. After receiving the user's verified voiceprint information, the second IoT platform compares it with the pre-stored voiceprint information. If the voiceprint matches the same user, the verification is successful; otherwise, it fails.
[0121] In step 230, if the verification is successful, the second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform. If the voiceprint verification is successful, i.e., the user's identity is verified, the second IoT platform sends an access token and a refresh token to the first IoT platform.
[0122] After receiving the access token, the user can log in to the second IoT platform through the first IoT platform.
[0123] Optionally, the second IoT platform may connect to multiple IoT devices simultaneously. The second IoT platform sends a list of connected IoT devices to the first IoT platform, which can then determine which devices can be controlled by the second IoT platform.
[0124] In step 240, the second IoT platform receives control commands sent by the first IoT platform based on an access token, and controls the IoT devices in the IoT device list according to the control commands. The control commands received by the second IoT platform may include: turning on a smart device, turning off a smart device, adjusting the smart device's temperature to a certain degree, etc. After receiving the commands, the second IoT platform controls the corresponding IoT devices according to the control commands.
[0125] The IoT device control method provided in this invention verifies the user's voiceprint. If the verification is successful, the user can control the IoT device across platforms simply by using voice. This solves the cumbersome operation process when the user controls the IoT device using a cross-platform voice interaction device, greatly reducing the difficulty and time of operation and improving the user experience.
[0126] In one embodiment, before the second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform, the method further includes:
[0127] If the verification is successful, the second IoT platform generates an authorization code and sends it to the first IoT platform;
[0128] The authorization code is used by the first IoT platform to obtain an access token on the second IoT platform according to the OAuth 2.0 protocol.
[0129] Optionally, after user authentication is successful—that is, after the second IoT platform verifies the user's true identity—an authorization code is generated and sent to the first IoT platform, signifying successful authorization from the second IoT platform to the first IoT platform. Upon receiving the authorization code, the first IoT platform can then exchange it for an access token according to the OAuth 2.0 protocol.
[0130] OAuth 2.0 is an authorization mechanism used to authorize third-party applications to access user data. The authorization code method involves the third-party application first requesting an authorization code, and then using that code to obtain a token. This method offers relatively high security. The authorization code is transmitted through the front-end, while the token is stored on the back-end, and all communication with the resource server is completed on the back-end. This separation of front-end and back-end prevents token leakage.
[0131] The IoT device control method provided in this embodiment of the invention verifies the user's voiceprint by combining voiceprint recognition and the OAuth 2.0 protocol. If the verification is successful, the second IoT platform generates an authorization code, and the first IoT platform replaces the access token with the authorization code, thus ensuring the security of cross-platform authorization.
[0132] In one embodiment, the second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform, including any of the following:
[0133] The second IoT platform receives the acquisition request and access token sent by the first IoT platform. After recognizing the access token, the second IoT platform sends a list of IoT devices to the first IoT platform according to the acquisition request.
[0134] The second IoT platform simultaneously sends an access token and a list of IoT devices associated with the first IoT platform.
[0135] Optionally, the first IoT platform initiates an access request to the second IoT platform using an access token, requesting access to the user's list of IoT devices. Upon recognizing the access token from the first IoT platform, the second IoT platform responds to the request by sending the list of IoT devices to the first IoT platform, ensuring the security of cross-platform control of IoT devices.
[0136] Alternatively, the second IoT platform can simultaneously send an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform, ensuring the efficiency of cross-platform control of IoT devices.
[0137] The IoT device control method provided in this embodiment of the invention sends an access token and a list of IoT devices associated with the second IoT platform through a second IoT platform, thereby ensuring the security and efficiency of cross-platform control of IoT devices.
[0138] Figure 3 This is one of the structural schematic diagrams of an IoT device control device provided in an embodiment of the present invention. (Refer to...) Figure 3 The IoT device control device provided by the present invention includes:
[0139] The first sending module 310 is used to send the verification voiceprint information of the target user from the first IoT platform to the second IoT platform; the verification voiceprint information is used by the second IoT platform to compare and verify the verification voiceprint information with the pre-stored voiceprint information of the target user.
[0140] The receiving module 320 is used to receive, upon successful verification, an access token sent by the second IoT platform and a list of IoT devices associated with the second IoT platform from the first IoT platform.
[0141] The second sending module 330 is used by the first IoT platform to send control commands to the second IoT platform based on the access token; the control commands are used by the second IoT platform to control IoT devices in the IoT device list.
[0142] The IoT device control device provided in this embodiment of the invention verifies the user's voiceprint. If the verification is successful, the user can control the IoT device across platforms simply by using voice. This solves the cumbersome operation process when the user controls the IoT device using a cross-platform voice interaction device, greatly reducing the difficulty and time of operation for the user and improving the user experience.
[0143] In one embodiment, before the first IoT platform sends the target user's verification voiceprint information to the second IoT platform, the method further includes:
[0144] The first IoT platform receives verification voiceprint information sent by the target user through a voice interaction device.
[0145] In one embodiment, the control command is determined in the following manner:
[0146] The first IoT platform receives voice commands sent by the target user through a voice interaction device;
[0147] The first IoT platform recognizes voice commands to determine control instructions.
[0148] In one embodiment, before the first IoT platform receives the access token and the list of IoT devices associated with the second IoT platform, the method further includes:
[0149] If the verification is successful, the first IoT platform receives the authorization code sent by the second IoT platform;
[0150] The first IoT platform obtains an access token from the second IoT platform according to the authorization code and the OAuth 2.0 protocol.
[0151] In one embodiment, the receiving module 320 is used for any of the following:
[0152] The first IoT platform sends the acquisition request and access token to the second IoT platform, and receives the list of IoT devices sent by the second IoT platform after recognizing the access token and according to the acquisition request;
[0153] The first IoT platform receives an access token and a list of IoT devices associated with the second IoT platform simultaneously.
[0154] Figure 4 This is a second structural schematic diagram of the IoT device control device provided in an embodiment of the present invention. (Refer to...) Figure 4 The IoT device control device provided by the present invention includes:
[0155] The receiving module 410 is used for the second IoT platform to receive the verification voiceprint information of the target user sent by the first IoT platform;
[0156] The verification module 420 is used by the second IoT platform to compare and verify the verification voiceprint information with the pre-stored voiceprint information of the target user.
[0157] The sending module 430 is used to send an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform when the verification is successful.
[0158] The control module 440 is used for the second IoT platform to receive control commands sent by the first IoT platform according to the access token, and to control the IoT devices in the IoT device list according to the control commands.
[0159] The IoT device control device provided in this embodiment of the invention verifies the user's voiceprint. If the verification is successful, the user can control the IoT device across platforms simply by using voice. This solves the cumbersome operation process when the user controls the IoT device using a cross-platform voice interaction device, greatly reducing the difficulty and time of operation for the user and improving the user experience.
[0160] In one embodiment, before the second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform, the method further includes:
[0161] If the verification is successful, the second IoT platform generates an authorization code and sends it to the first IoT platform;
[0162] The authorization code is used by the first IoT platform to obtain an access token on the second IoT platform according to the OAuth 2.0 protocol.
[0163] In one embodiment, the sending module 430 is configured to be any of the following:
[0164] The second IoT platform receives the acquisition request and access token sent by the first IoT platform. After recognizing the access token, the second IoT platform sends a list of IoT devices to the first IoT platform according to the acquisition request.
[0165] The second IoT platform simultaneously sends an access token and a list of IoT devices associated with the first IoT platform.
[0166] Figure 5 This is a flowchart illustrating the IoT device control method provided in an embodiment of the present invention. (Refer to...) Figure 5 The IoT device control method provided in this embodiment of the invention has the following specific interaction steps:
[0167] Step 1: Users first complete the binding of IoT devices and the recording and storage of voiceprint features on platform A;
[0168] Step 2: The user initiates voiceprint authentication on the voice interaction device of Platform B. Platform B carries the user's voiceprint information to Platform A to complete the voiceprint feature comparison and verification. If the verification is successful, an authorization code is generated and sent to Platform B.
[0169] Step 3: After obtaining the authorization code from Platform A, Platform B completes the authorization process with Platform A according to the OAuth 2.0 protocol specifications and obtains the access token and refresh token;
[0170] Step 4: Platform B sends the access token to Platform A to request the user's list of IoT devices and informs the user that authorization was successful;
[0171] Step 5: The user initiates control operations on the IoT device via voice commands on the voice interaction device of Platform B. After the voice commands are recognized by the voice interaction device, Platform B sends the access token to Platform A to request control of the IoT device. Platform A issues control commands through the communication channel established with the IoT device, thereby completing the entire authorization and control process.
[0172] The IoT device control method provided by this invention, by combining voiceprint recognition and OAuth 2.0, solves the cumbersome authorization process that users need to perform when using cross-platform voice interaction devices to control IoT devices. It allows users to complete the entire cross-platform IoT device authorization and control process simply by using a voice interaction device, thereby significantly reducing the difficulty and time of operation for users, improving the user experience, and meeting the needs of more special groups.
[0173] Figure 6 An example is a schematic diagram of the physical structure of an electronic device, such as... Figure 6 As shown, the electronic device may include a processor 610, a communications interface 620, a memory 630, and a communication bus 640, wherein the processor 610, the communications interface 620, and the memory 630 communicate with each other via the communication bus 640. The processor 610 can call logical instructions in the memory 630 to execute the following methods:
[0174] The first IoT platform sends the target user's verification voiceprint information to the second IoT platform; the verification voiceprint information is used by the second IoT platform to compare and verify the verification voiceprint information with the target user's pre-stored voiceprint information.
[0175] If the verification is successful, the first IoT platform receives the access token and the list of IoT devices associated with the second IoT platform from the second IoT platform.
[0176] The first IoT platform sends control commands to the second IoT platform based on the access token; the control commands are used by the second IoT platform to control the IoT devices in the IoT device list.
[0177] or
[0178] The second IoT platform receives the verification voiceprint information of the target user sent by the first IoT platform;
[0179] The second IoT platform will verify the voiceprint information by comparing it with the target user's pre-stored voiceprint information.
[0180] If the verification is successful, the second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform.
[0181] The second IoT platform receives control commands sent by the first IoT platform based on the access token, and controls the IoT devices in the IoT device list according to the control commands.
[0182] Furthermore, the logical instructions in the aforementioned memory 630 can be implemented as software functional units and, when sold or used as independent products, can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, essentially, or the part that contributes to the prior art, or a part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0183] Furthermore, this invention discloses a computer program product, which includes a computer program stored on a non-transitory computer-readable storage medium. The computer program includes program instructions, and when these instructions are executed by a computer, the computer can execute the IoT device control methods provided in the above-described method embodiments, such as including:
[0184] The first IoT platform sends the target user's verification voiceprint information to the second IoT platform; the verification voiceprint information is used by the second IoT platform to compare and verify the verification voiceprint information with the target user's pre-stored voiceprint information.
[0185] If the verification is successful, the first IoT platform receives the access token and the list of IoT devices associated with the second IoT platform from the second IoT platform.
[0186] The first IoT platform sends control commands to the second IoT platform based on the access token; the control commands are used by the second IoT platform to control the IoT devices in the IoT device list.
[0187] or
[0188] The second IoT platform receives the verification voiceprint information of the target user sent by the first IoT platform;
[0189] The second IoT platform will verify the voiceprint information by comparing it with the target user's pre-stored voiceprint information.
[0190] If the verification is successful, the second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform.
[0191] The second IoT platform receives control commands sent by the first IoT platform based on the access token, and controls the IoT devices in the IoT device list according to the control commands.
[0192] On the other hand, embodiments of the present invention also provide a non-transitory computer-readable storage medium storing a computer program thereon, which, when executed by a processor, is implemented to perform the IoT device control methods provided in the above embodiments, including, for example:
[0193] The first IoT platform sends the target user's verification voiceprint information to the second IoT platform; the verification voiceprint information is used by the second IoT platform to compare and verify the verification voiceprint information with the target user's pre-stored voiceprint information.
[0194] If the verification is successful, the first IoT platform receives the access token and the list of IoT devices associated with the second IoT platform from the second IoT platform.
[0195] The first IoT platform sends control commands to the second IoT platform based on the access token; the control commands are used by the second IoT platform to control the IoT devices in the IoT device list.
[0196] or
[0197] The second IoT platform receives the verification voiceprint information of the target user sent by the first IoT platform;
[0198] The second IoT platform will verify the voiceprint information by comparing it with the target user's pre-stored voiceprint information.
[0199] If the verification is successful, the second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform.
[0200] The second IoT platform receives control commands sent by the first IoT platform based on the access token, and controls the IoT devices in the IoT device list according to the control commands.
[0201] The device embodiments described above are merely illustrative. The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the modules can be selected to achieve the purpose of this embodiment according to actual needs. Those skilled in the art can understand and implement this without any creative effort.
[0202] Through the above description of the embodiments, those skilled in the art can clearly understand that each embodiment can be implemented by means of software plus necessary general-purpose hardware platforms, and of course, it can also be implemented by hardware. Based on this understanding, the above technical solutions, in essence or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods described in the various embodiments or some parts of the embodiments.
[0203] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.
[0204] The above embodiments are for illustrative purposes only and are not intended to limit the scope of the invention. Although the invention has been described in detail with reference to the embodiments, those skilled in the art should understand that various combinations, modifications, or equivalent substitutions of the technical solutions of the invention do not depart from the spirit and scope of the invention and should be covered within the scope of the claims of the invention.
Claims
1. A method for controlling an Internet of Things (IoT) device, characterized in that, include: The first IoT platform sends the target user's verification voiceprint information to the second IoT platform; The verification voiceprint information is used by the second IoT platform to compare and verify the verification voiceprint information with the target user's pre-stored voiceprint information. If the verification is successful, the first IoT platform receives the access token and the list of IoT devices associated with the second IoT platform from the second IoT platform. The first IoT platform sends a control command to the second IoT platform based on the access token; the control command is used by the second IoT platform to control the IoT devices in the IoT device list. The control command is determined in the following manner: The first IoT platform receives voice commands sent by the target user through a voice interaction device; The first IoT platform recognizes the voice command to determine the control command.
2. The IoT device control method according to claim 1, characterized in that, Before the first IoT platform sends the target user's verification voiceprint information to the second IoT platform, the process also includes: The first IoT platform receives the verification voiceprint information sent by the target user through a voice interaction device.
3. The IoT device control method according to claim 1, characterized in that, Before the first IoT platform receives the access token and the list of IoT devices associated with the second IoT platform, the process also includes: If the verification is successful, the first IoT platform receives the authorization code sent by the second IoT platform; The first IoT platform obtains the access token from the second IoT platform according to the authorization code and the OAuth 2.0 protocol.
4. The IoT device control method according to claim 3, characterized in that, The first IoT platform receives an access token and a list of IoT devices associated with the second IoT platform, including any one of the following: The first IoT platform sends the acquisition request and the access token to the second IoT platform, and receives the list of IoT devices sent by the second IoT platform after recognizing the access token according to the acquisition request; The first IoT platform receives an access token and a list of IoT devices associated with the second IoT platform simultaneously sent by the second IoT platform.
5. A method for controlling an Internet of Things (IoT) device, characterized in that, include: The second IoT platform receives the verification voiceprint information of the target user sent by the first IoT platform; The second IoT platform compares and verifies the verified voiceprint information with the target user's pre-stored voiceprint information; If the verification is successful, the second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform. The second IoT platform receives control instructions sent by the first IoT platform based on the access token, and controls the IoT devices in the IoT device list based on the control instructions; The control command is determined in the following manner: The first IoT platform receives voice commands sent by the target user through a voice interaction device; The first IoT platform recognizes the voice command to determine the control command.
6. The IoT device control method according to claim 5, characterized in that, Before the second IoT platform sends the access token and the list of IoT devices associated with the second IoT platform to the first IoT platform, the process also includes: If the verification is successful, the second IoT platform generates an authorization code and sends it to the first IoT platform; The authorization code is used by the first IoT platform to obtain the access token from the second IoT platform according to the OAuth 2.0 protocol.
7. The IoT device control method according to claim 6, characterized in that, The second IoT platform sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform, including any one of the following: The second IoT platform receives an acquisition request and an access token sent by the first IoT platform. After recognizing the access token, the second IoT platform sends the IoT device list to the first IoT platform according to the acquisition request. The second IoT platform simultaneously sends an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform.
8. A control device for an Internet of Things (IoT) device, characterized in that, include: The first sending module is used to send the verification voiceprint information of the target user from the first IoT platform to the second IoT platform; The verification voiceprint information is used by the second IoT platform to compare and verify the verification voiceprint information with the target user's pre-stored voiceprint information. The receiving module is used to receive, upon successful verification, an access token sent by the second IoT platform and a list of IoT devices associated with the second IoT platform from the first IoT platform. The second sending module is used by the first IoT platform to send a control command to the second IoT platform according to the access token; the control command is used by the second IoT platform to control the IoT devices in the IoT device list. The control command is determined in the following manner: The first IoT platform receives voice commands sent by the target user through a voice interaction device; The first IoT platform recognizes the voice command to determine the control command.
9. An Internet of Things (IoT) device control device, characterized in that, include: The receiving module is used for the second IoT platform to receive the verification voiceprint information of the target user sent by the first IoT platform. The verification module is used by the second IoT platform to compare and verify the verified voiceprint information with the pre-stored voiceprint information of the target user. The sending module is used to send an access token and a list of IoT devices associated with the second IoT platform to the first IoT platform when the verification is successful. The control module is used for the second IoT platform to receive control instructions sent by the first IoT platform according to the access token, and to control the IoT devices in the IoT device list according to the control instructions; The control command is determined in the following manner: The first IoT platform receives voice commands sent by the target user through a voice interaction device; The first IoT platform recognizes the voice command to determine the control command.
10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, characterized in that, When the processor executes the program, it implements the steps of the Internet of Things device control method as described in any one of claims 1 to 7.
11. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps of the Internet of Things device control method as described in any one of claims 1 to 7.
12. A computer program product, comprising a computer program, characterized in that, When the computer program is executed by the processor, it implements the steps of the Internet of Things device control method as described in any one of claims 1 to 7.
Citation Information
Patent Citations
Internet of Things equipment binding method, device and system, cloud server and storage medium
CN113746633A
Short-range cross-device authorization
US10117097B1