Internet of Things device control method, device, storage medium, electronic device and system

Abstract

This application discloses a method, apparatus, storage medium, electronic device, and system for controlling an Internet of Things (IoT) device. The IoT device control method is applied to an electronic device and includes: obtaining operation information; encoding the operation information to obtain voice command information; and transmitting the voice command information to a local target device via a call connection channel, so that the local target device controls the IoT device to perform a corresponding operation based on a command in a first preset format generated after decoding the voice command information. The call connection channel is established via a cellular network. This application can prevent privacy leaks and enhance information security.

Description

Technical Field

[0001] The present application relates to the technical field of electronic equipment, and specifically to a method, device, storage medium, electronic equipment, and system for controlling an Internet of Things device. Background Art

[0002] With the development of technology, the use of electronic devices is becoming more and more widespread. Simultaneously, the scope of use of IoT devices is also gradually expanding. In related technologies, when users need to remotely control IoT devices using electronic devices such as smartphones, or control IoT devices through the network to which they are connected, they typically need to use third-party applications to achieve remote control of IoT devices. However, using third-party applications to achieve remote control can lead to certain privacy leaks and information security issues. Summary of the Invention

[0003] In view of this, the present application provides an IoT device control method, apparatus, storage medium, electronic device and system to improve the privacy leakage and information security problems caused by existing solutions that use third-party applications to achieve remote control.

[0004] In a first aspect, an embodiment of the present application provides an Internet of Things device control method, which is applied to an electronic device, including:

[0005] Get operation information;

[0006] Encode the operation information to obtain voice command information;

[0007] The voice command information is sent to the local target device through the call connection channel, so that the local target device controls the Internet of Things device to perform corresponding operations according to the command in the first preset format generated after decoding the voice command information, wherein the call connection channel is established through a cellular network (Cellular Network, CN).

[0008] Optionally, the electronic device includes a remote device interface (RDI) for obtaining operation information, including:

[0009] Get touch operation information on the remote device interface.

[0010] Optionally, encoding the operation information to obtain voice command information includes:

[0011] converting the touch operation information into a command in a second preset format according to the touch operation sequence;

[0012] The command in the second preset format is encoded to obtain voice command information.

[0013] Optionally, the operation information includes a voice message, and encoding the operation information to obtain voice command information includes:

[0014] Converting the voice message into commands of a second preset format in sequence;

[0015] The command in the second preset format is encoded to obtain voice command information.

[0016] Optionally, sending the voice command information to the local target device through the call connection channel, so that the local target device controls the Internet of Things device according to a command in a first preset format generated after decoding the voice command information, includes:

[0017] The voice command information is sent to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface (LDI) of the Internet of Things device controls the Internet of Things device to perform corresponding operations according to the command sequence in the first preset format.

[0018] Optionally, sending the voice command information to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the Internet of Things device controls the Internet of Things device to perform a corresponding operation according to the command sequence in the first preset format, includes:

[0019] sending the voice command information to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format;

[0020] If a request message for resending the lost command is received from the local device interface, the other commands after the lost command in the command sequence of the first preset format are cached, and the lost information corresponding to the lost command is resent, so that the local device interface controls the Internet of Things device to perform corresponding operations according to the lost command and other subsequent commands.

[0021] Optionally, sending the voice command information to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the Internet of Things device controls the Internet of Things device to perform a corresponding operation according to the command sequence in the first preset format, includes:

[0022] sending the voice command information to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format;

[0023] If a request message for resending the damaged command is received from the local device interface, the other commands after the damaged command in the command sequence of the first preset format are cached, and the damage information corresponding to the damaged command is resent, so that the local device interface controls the Internet of Things device to perform corresponding operations according to the damaged command and other subsequent commands.

[0024] Optionally, the remote device interface is paired with the local target device, and a call connection channel is set between the remote device interface and the local target device through a security key.

[0025] Optionally, the touch operation information includes at least one of the following:

[0026] Selecting an IoT device, changing the state of an IoT device, and performing operations on the IoT device. Optionally, the remote device interface has the same application user interface as the local device interface.

[0027] In a second aspect, an embodiment of the present application provides an IoT device control device, which is applied to an electronic device. The IoT device control device includes:

[0028] Acquisition module, used to obtain operation information;

[0029] An encoding module, used to encode the operation information to obtain voice command information;

[0030] A control module is used to send voice command information to a local target device through a call connection channel, so that the local target device controls the Internet of Things device to perform corresponding operations according to a command in a first preset format generated after decoding the voice command information, wherein the call connection channel is established through a cellular network.

[0031] On the third aspect, an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed on a computer, the computer executes the process in the Internet of Things device control method provided by the embodiment of the present application.

[0032] In a fourth aspect, an embodiment of the present application further provides an electronic device comprising a memory and a processor, wherein the processor is used to execute the process in the method for controlling an Internet of Things device provided in an embodiment of the present application by calling a computer program stored in the memory.

[0033] In the fifth aspect, an embodiment of the present application also provides an Internet of Things device control system, including an electronic device, a local target device and an Internet of Things device. The electronic device receives operation information, encodes the operation information to obtain voice command information, and sends the voice command information to the local target device through a call connection channel. The local target device decodes the voice command information to generate a command in a first preset format, and controls the Internet of Things device to perform corresponding operations according to the command in the first preset format, wherein the call connection channel is established through a cellular network.

[0034] In the IoT device control method, apparatus, storage medium, electronic device, and system of the embodiments of the present application, the electronic device can obtain operation information; then encode the operation information to obtain voice command information, and send the voice command information to the local target device via a call connection channel, so that the local target device controls the IoT device to perform the corresponding operation according to the command in a first preset format generated after decoding the voice command information. The call connection channel is established through a cellular network and is secure because its call function does not require the use of any third-party application. Therefore, the embodiments of the present application can prevent privacy leakage and enhance information security. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] The following detailed description of the specific embodiments of the present application in conjunction with the accompanying drawings will make the technical solutions and beneficial effects of the present application apparent.

[0036] Figure 1 This is a flow chart of the method for controlling an IoT device provided in an embodiment of the present application;

[0037] Figure 2 This is a schematic diagram of the architecture of an Internet of Things device control system provided by an embodiment of the present application;

[0038] Figure 3 This is another flowchart of the method for controlling an IoT device provided by an embodiment of the present application;

[0039] Figure 4 This is a schematic diagram of the interface of the remote device provided in the embodiment of the present application;

[0040] Figure 5 Schematic diagram of the interaction between the remote device interface, the local target device, and the local device interface provided in an embodiment of the present application;

[0041] Figure 6 This is a schematic diagram of a scenario in which a local target device receives a voice message according to an embodiment of the present application;

[0042] Figure 7 This is a schematic diagram of the structure of the IoT device control device provided in an embodiment of the present application;

[0043] Figure 8 is a structural diagram of an electronic device provided in an embodiment of the present application;

[0044] Figure 9 is another structural diagram of an electronic device provided in an embodiment of the present application;

[0045] Figure 10 It is a structural diagram of the Internet of Things device control system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0046] Please refer to the accompanying drawings, in which the same reference numerals represent the same components. The principles of this application are illustrated by implementing them in an appropriate computing environment. The following description is based on the illustrated embodiments of this application and should not be construed as limiting other embodiments of this application that are not described in detail herein.

[0047] It is understood that the execution subject of the embodiments of the present application may be an electronic device. In actual scenarios, the specific form of the electronic device is not limited by the embodiments of the present application, and includes, but is not limited to: mobile phones, tablet computers, laptop computers, PDAs, portable media players (PMPs), and other handheld terminals; in-vehicle navigation devices; wearable devices, and other mobile terminals with corresponding functions.

[0048] See also Figure 1 , Figure 1 : This is a flow chart of an IoT device control method provided by an embodiment of the present application. The IoT device control method can be applied to electronic devices. The process of the IoT device control method may include:

[0049] 101. Get operation information.

[0050] With technological advancements, the use of electronic devices is becoming increasingly widespread. Simultaneously, the use of IoT devices is also gradually expanding. IoT devices have a simple local interface, called a local device interface (LDI), which allows for automatic control of IoT devices without manual user intervention. These LDIs are typically provided by manufacturers to facilitate access to IoT devices.

[0051] In related technologies, when users need to remotely control IoT devices using electronic devices such as smartphones, or control IoT devices through the network to which they are connected, they typically rely on third-party applications to achieve remote control of IoT devices. For example, a server is often required to transmit data from the remote user to the corresponding IoT device. However, using third-party applications to achieve remote control can lead to certain privacy and information security issues.

[0052] In order to solve this problem, the embodiment of the present application uses the cellular network of the electronic device to establish a dedicated connection between the electronic device and the IoT device when the user's electronic device is in a remote location. The call function is used to privately transmit data through the cellular network (i.e., a mobile network, such as a mobile phone network with a SIM card, usually used for making calls), and the requirements of third-party applications for electronic devices to control IoT devices are eliminated through the cellular network of the electronic device to ensure that privacy and information security are not compromised. In the related art, in the field of remote control of IoT devices, there has never been a method for using a cellular network to establish a call connection to achieve remote control. This will be described in detail below.

[0053] In an embodiment of the present application, an electronic device can obtain operation information. The operation information can be a user sending a voice message, a user performing a touch operation on the electronic device, etc. When the user sends a voice message, the electronic device can receive the voice message, or when the user performs a touch operation on the electronic device, the electronic device can obtain touch operation information.

[0054] 102. Encode the operation information to obtain voice command information.

[0055] In an embodiment of the present application, after an electronic device obtains operation information, it may encode the operation information to enhance information security. This encoding process is equivalent to encrypting the operation information, thereby improving information security. To enable the encoded operation information to be transmitted over a call connection channel, the operation information may be encoded as voice command information, which is then transmitted via the call connection. Voice command information can be considered to be information from a user's conversation.

[0056] 103. Send the voice command information to the local target device through a call connection channel, so that the local target device controls the Internet of Things device to perform a corresponding operation according to a command in a first preset format generated after decoding the voice command information, wherein the call connection channel is established through a cellular network.

[0057] In an embodiment of the present application, in order to avoid the need for assistance from any third-party application, a local target device is set up. The local target device can be a call-based device (CD), which is a device that can automatically receive user calls, that is, a device that can receive another remote phone and convert voice into text. A call connection channel can be established between the electronic device and the local target device through a cellular network, so that information can be transmitted between the electronic device and the local target device through a call connection. Since the call network data does not pass through third-party applications such as servers, and it is difficult for the outside world to access the call connection channel, the call connection channel is secure.

[0058] In an embodiment of the present application, when there is a cellular network, the electronic device sends voice command information to the local target device through a call connection channel. The local target device can decode the voice command information, for example, using natural language processing (Natural Language Processing, NLP) to decode the voice command information and convert it into a command in a first preset format. The command in the first preset format can then be applied to the IoT device as if the user were locally, controlling the IoT device to perform corresponding operations.

[0059] In the embodiment of the present application, the electronic device, the local target device and the IoT device can constitute an IoT device control system. Figure 2 , Figure 2 This is a schematic diagram of the architecture of an IoT device control system provided by an embodiment of the present application. Data is transmitted between an electronic device and a local target device via a call connection. IoT devices can be household appliances such as televisions, wall ovens, freezers, water heaters, coffee makers, air conditioners, and so on.

[0060] For example, when the IoT device includes a water heater, if the user says "turn on the water heater" during a call, the local target device will receive the voice command information encoded by the sound and convert it into a command in a first preset format. The command in the first preset format can be a command with a series of pre-coding methods, and the water heater is controlled to turn on according to the command.

[0061] For another example, when the IoT device includes an air conditioner, if the user says "adjust the air conditioner to 26°C" during a call, the local target device will receive the voice command information encoded by the sound and convert it into a command in a first preset format. The command in the first preset format can be a command with a series of precoding methods, and the air conditioner is controlled to adjust to 26°C according to the command.

[0062] It should be noted that IoT devices cannot be accessed without a cellular network.

[0063] It is understood that in the embodiments of the present application, the electronic device can obtain operation information; then encode the operation information to obtain voice command information, and send the voice command information to the local target device via a call connection channel, so that the local target device controls the IoT device to perform the corresponding operation according to the command in the first preset format generated after decoding the voice command information. The call connection channel is established through a cellular network and is a secure connection because its call function does not require the use of any third-party application. Therefore, the embodiments of the present application can prevent privacy leakage and enhance information security.

[0064] See also Figure 3 , Figure 3 FIG2 is another flow chart of the method for controlling an IoT device provided in an embodiment of the present application. The method for controlling an IoT device is applied to electronic devices. Figure 3 In the process of the IoT device control method, the process may include:

[0065] 201. Acquire touch operation information on a remote device interface.

[0066] For example, in an embodiment of the present application, in order to achieve remote access and improve user accessibility, the electronic device may include a remote device interface, that is, a remote device interface is set on the electronic device. The remote device interface is an application interface that the user always has in the electronic device. It is a simulation of the local device interface of the Internet of Things device and can simulate the complete interface of the local device interface. The remote device interface has the same application user interface as the local device interface, but the Internet of Things device cannot be accessed when there is no cellular network. The local device interface is a local application interface. The user can choose to access any smart device, and it can access all Internet of Things devices that exist locally. It should be noted that in an embodiment of the present application, when setting up, the remote device interface can collect current status information about each Internet of Things device from the local interface of the Internet of Things device so that the user can understand the exact status of each Internet of Things device.

[0067] Whenever a user opens a remote device interface on an electronic device, a call connection is automatically established between the remote device interface and the local target device. The remote device interface is paired with the local target device to establish the call connection using a security key. Thus, a call connection channel can be established between the remote device interface and the local target device using the security key. Because the application that opens the remote device interface requires a user-set security key, this mitigates the security issue of others mistakenly accessing the local target device, even if the remote device interface and the local target device are paired.

[0068] In an embodiment of the present application, the remote device interface can send accurate command information from the operations performed by the user on it. This command information can be the location where the user touches the remote device interface. The location where the user touches the remote device interface can be encoded and sent to the local target device through the call connection.

[0069] It should be noted that in embodiments of the present application, operation information may include touch operation information, and the remote device interface may obtain the user's touch operation information on the remote device interface. For example, in one embodiment, the touch operation information may include at least one of the following: selecting an IoT device, changing the state of an IoT device, and updating the parameter value of an IoT device. The user touches different locations on the remote device interface to select an IoT device, change the state of an IoT device, or update the parameter value of an IoT device.

[0070] See also Figure 4 , Figure 4 This is a schematic diagram of the interface of the remote device provided in the embodiment of the present application. Figure 4 The remote device interface includes various options related to IoT devices, such as Option 1, Option 2, Option 3, Option 4, Option 5, and so on. Option 1 allows you to select an IoT device, Option 2 allows you to change the state of an IoT device, Option 3 allows you to update a parameter value of an IoT device, and so on. This remote device interface is identical to the application user interface of the local device interface.

[0071] For example, if a user uses touch operation to select any option related to the IoT device, the remote device interface will record the user's action sequence, that is, record the user's operation information. The user's action sequence can be to select the IoT device, change the state of the IoT device, and update the parameter value of the IoT device. These action sequences can be converted into a simpler command format through the remote device interface type (Id, touch_info), and then encoded and sent to the local target device through the call connection setting. Among them, the Id is used to ensure that the commands are applied in sequence. When the Id is missing in the command sequence, it can ensure that the continuity is not lost.

[0072] For example, in one embodiment, touch operation information is received by the local target device and applied to the IoT device at the local device interface, which enables changes made by the user at the remote device interface side.

[0073] 202. Convert the touch operation information into a command in a second preset format according to the touch operation sequence.

[0074] In an embodiment of the present application, the electronic device can record user operations, such as recording user touch operation information, and convert the touch operation information into a command in a second preset format according to the touch operation sequence. For example, the second preset format can be a Linux command syntax format. The second preset format can be the same as the first preset format or different from the first preset format.

[0075] 203. Encode the command in the second preset format to obtain voice command information.

[0076] Since information needs to be sent via a call connection, in this embodiment of the present application, the electronic device needs to encode the command in the second preset format to obtain voice command information, so as to enable the voice command information to be sent via the call connection channel. Since only touch operation information is sent, the user does not need to speak a specific command, thereby reducing the workload on the user end.

[0077] It should be noted that after executing the process of 203 , the process of 207 can be executed directly.

[0078] 204. Get the voice message.

[0079] In an embodiment of the present application, the operation information may include a voice message. In the case of a cellular network, after the user sends a voice message, the electronic device can obtain the user's voice message. For example, if the user sends a voice message "turn on the water heater", the electronic device can obtain the voice message "turn on the water heater".

[0080] 205. Convert the voice message into a command in a second preset format in sequence.

[0081] In the embodiment of the present application, when a user sends voice messages, there is a sequence, and the electronic device can convert the voice messages sent by the user into commands in the second preset format in sequence. By converting the voice messages into commands in the second preset format, it is convenient to obtain the fisherman's command information later.

[0082] 206. Encode the command in the second preset format to obtain voice command information.

[0083] In the embodiment of the present application, the command in the second preset format is encoded to obtain voice command information. By encoding the command in the second preset format, not only can information security be enhanced, but the command in the second preset format can also be compressed to reduce transmission time.

[0084] It should be noted that after executing the process of 206 , the process of 207 can be directly executed.

[0085] 207. Send the voice command information to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the Internet of Things device controls the Internet of Things device to perform corresponding operations according to the command sequence in the first preset format.

[0086] In an embodiment of the present application, after obtaining the voice command information, the electronic device can send the voice command information to the local target device through the call connection channel, and the local target device uses natural language processing to convert the received voice command information into text information, wherein the text information is basically an action sequence to be copied on the local device interface of the Internet of Things device.

[0087] The local target device then converts the text message into a command sequence in a first preset format. The local device interface of the IoT device receives the command sequence in the first preset format, performs a certain aspect ratio or screen size change, and applies the changed screen to itself so that the user can perform the desired operation locally. In addition, in the embodiment of the present application, it is possible to check whether the remote device interface and the local device interface are in the same state in the middle to ensure that any unnecessary or repeated operations are not performed.

[0088] For example, in one embodiment, sending the voice command information to the local target device through the call connection channel in 207 so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the IoT device controls the IoT device to perform a corresponding operation according to the command sequence in the first preset format, may include:

[0089] sending the voice command information to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format;

[0090] If a request message for resending the lost command is received from the local device interface, the other commands after the lost command in the command sequence of the first preset format are cached, and the lost information corresponding to the lost command is resent, so that the local device interface controls the Internet of Things device to perform corresponding operations according to the lost command and other subsequent commands.

[0091] For example, in order to ensure the continuity of commands in the command sequence of the first preset format and prevent unnecessary changes to the IoT device, when a command is lost in the command sequence of the first preset format, the local device interface can know which ID is lost in the command sequence of the first preset format (i.e., regard it as "t0"), and request the remote device interface to send back the loss information corresponding to the lost command, store the commands after the lost command (i.e., the commands at t0+1, t0+2, etc.) in the buffer, and apply the subsequent commands after the command at t0 is successfully applied.

[0092] For example, in one embodiment, sending the voice command information to the local target device through the call connection channel in 207 so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the IoT device controls the IoT device to perform a corresponding operation according to the command sequence in the first preset format, may include:

[0093] sending the voice command information to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format;

[0094] If a request message for resending the damaged command is received from the local device interface, the other commands after the damaged command in the command sequence of the first preset format are cached, and the damage information corresponding to the damaged command is resent, so that the local device interface controls the Internet of Things device to perform corresponding operations according to the damaged command and other subsequent commands.

[0095] For example, an electronic device sends voice command information to a local target device via a call connection channel. The local target device converts the voice command information into text information and then converts the text information into a command sequence in a first preset format. If the local target device cannot completely decode the command sequence in the first preset format when applying the command sequence in the first preset format to the local device interface of the IoT device, the command sequence in the first preset format is considered to be corrupted, i.e., a corrupted command is present in the command sequence in the first preset format. The same mechanism as for lost commands is then used to resolve this issue. Specifically, the IoT device's local device interface sends a request to the remote device interface to resend the corrupted command. At this point, the command following the corrupted command is stored in a buffer and, after successfully applying the corrupted command, the subsequent command is applied to control the IoT device to perform the corresponding operation via the local device interface. Users can access the local target device using the remote device interface and the established call connection without the need for a third-party application, thereby enhancing information security without compromising user accessibility.

[0096] It should be noted that, in situations where security is less critical, messages can be used as a medium for transmitting commands, but this is not as secure as establishing a dedicated call connection over the cellular network. Using the cellular network to send commands and user action sequences as encoded information allows for receiving calls and data over the cellular network. Transmitting data over a cellular call connection can enhance security because it does not require a third-party application.

[0097] See also Figure 5 , Figure 5 This is a schematic diagram of the interaction between the remote device interface, the local target device, and the local device interface provided in an embodiment of the present application. Figure 5 In the process, the remote device interface receives the operation information input by the user, encodes the operation information, and transmits the encoded operation information to the local target device via a call connection (i.e., a call connection channel). The local target device receives the encoded operation information, decodes it to obtain the corresponding command, and determines whether the decoding is successful through the local device interface. If the decoding is successful, the local device interface applies the decoded command to the IoT device. If the decoding is unsuccessful, the local device interface saves the next command to the buffer and requests the remote device interface to send the command again.

[0098] See also Figure 6 , Figure 6 This is a schematic diagram of a scenario in which a local target device receives a voice message according to an embodiment of the present application. Figure 6 In the embodiment of the present invention, a local target device receives a voice message through a call, applies natural language processing to convert the voice message into a text message, and then decodes the text message into a command set, wherein the command set is composed of multiple commands. After that, the multiple commands in the command set are converted into a command sequence applied on the local device interface. The local device interface can control the relevant IoT device to perform corresponding operations according to the command sequence.

[0099] See also Figure 7 , Figure 7 This is a schematic diagram of the structure of an IoT device control device provided in an embodiment of the present application. The IoT device control device can be applied to electronic devices. The IoT device control device 300 may include: an acquisition module 301, an encoding module 302, and a control module 303.

[0100] Wherein, the acquisition module 301 is used to obtain operation information;

[0101] The encoding module 302 is used to encode the operation information to obtain voice command information;

[0102] The control module 303 is used to send the voice command information to the local target device through the call connection channel, so that the local target device controls the Internet of Things device to perform a corresponding operation according to the command in the first preset format generated after decoding the voice command information, wherein the call connection channel is established through the cellular network.

[0103] In one implementation, the electronic device includes a remote device interface, the operation information includes touch operation information, and the acquisition module 301 may be configured to acquire the touch operation information on the remote device interface.

[0104] In one embodiment, the encoding module 302 may be configured to: convert the touch operation information into a command in a second preset format according to the touch operation sequence; and encode the command in the second preset format to obtain voice command information.

[0105] In one embodiment, the operation information includes a voice message, and the encoding module 302 can be used to: convert the voice message into commands in a second preset format in sequence; and encode the commands in the second preset format to obtain voice command information.

[0106] In one embodiment, the control module 303 can be used to: send voice command information to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the Internet of Things device controls the Internet of Things device to perform corresponding operations according to the command sequence in the first preset format.

[0107] In one embodiment, the control module 303 can be used to: send voice command information to a local target device through a call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format; if a request information for resending a lost command is received from a local device interface, other commands after the lost command in the command sequence in the first preset format are cached, and the lost information corresponding to the lost command is resent, so that the local device interface controls the Internet of Things device to perform corresponding operations according to the lost command and other subsequent commands.

[0108] In one embodiment, the control module 303 can be used to: send voice command information to a local target device through a call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format; if a request information for resending the damaged command is received from the local device interface, the other commands after the damaged command in the command sequence in the first preset format are cached, and the damage information corresponding to the damaged command is resent, so that the local device interface controls the Internet of Things device to perform corresponding operations according to the damaged command and other subsequent commands.

[0109] In one embodiment, the remote device interface is paired with the local target device, and a call connection channel is set up between the remote device interface and the local target device via a security key.

[0110] In one embodiment, the touch operation information includes at least one of the following: selecting an IoT device, changing a state of an IoT device, and updating a parameter value of an IoT device.

[0111] In one embodiment, the remote device interface has the same application user interface as the local device interface.

[0112] An embodiment of the present application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed on a computer, the computer executes the process in the method for controlling an Internet of Things device as provided in this embodiment.

[0113] An embodiment of the present application also provides an electronic device, including a memory and a processor, wherein the processor is configured to execute the process in the method for controlling an IoT device provided in this embodiment by calling a computer program stored in the memory.

[0114] For example, the electronic device may be a handheld terminal such as a mobile phone, tablet computer, laptop computer, PDA, personal digital assistant, portable media player, etc.; a car navigation device; a wearable device, etc., which have corresponding functions. Figure 8 , Figure 8 A schematic diagram of the structure of an electronic device provided in an embodiment of the present application.

[0115] The electronic device 400 may include components such as a memory 401 and a processor 402. Those skilled in the art will appreciate that Figure 8 The electronic device structure shown in the figure does not constitute a limitation to the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0116] Memory 401 can be used to store applications and data. The applications stored in memory 401 include executable code. Applications can be composed of various functional modules. Processor 402 executes various functional applications and data processing by running the applications stored in memory 401.

[0117] The processor 402 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing applications stored in the memory 401 and calling data stored in the memory 401, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole.

[0118] In this embodiment, the processor 402 in the electronic device loads the executable code corresponding to one or more application processes into the memory 401 according to the following instructions, and the processor 402 runs the application stored in the memory 401 to execute:

[0119] Get operation information;

[0120] Encode the operation information to obtain voice command information;

[0121] The voice command information is sent to the local target device through a call connection channel, so that the local target device controls the Internet of Things device to perform corresponding operations according to the command in a first preset format generated after decoding the voice command information, wherein the call connection channel is established through a cellular network.

[0122] See also Figure 9 , Figure 9 4 is another structural diagram of an electronic device provided in an embodiment of the present application. The electronic device 400 may include a memory 401, a processor 402, an input unit 403, an output unit 404, a speaker 405 and other components.

[0123] Memory 401 can be used to store applications and data. The applications stored in memory 401 include executable code. Applications can be composed of various functional modules. Processor 402 executes various functional applications and data processing by running the applications stored in memory 401.

[0124] The processor 402 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. By running or executing applications stored in the memory 401 and calling data stored in the memory 401, it performs various functions of the electronic device and processes data, thereby monitoring the electronic device as a whole.

[0125] The input unit 403 may be configured to receive input numbers, character information, or user feature information (such as fingerprints), and generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.

[0126] The output unit 404 may be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device, which may be composed of graphics, text, icons, videos, or any combination thereof. The output unit may include a display panel.

[0127] The speaker 405 can be used to play sound signals.

[0128] In addition, the electronic device may also include components such as a battery, a microphone, etc. The battery is used to supply power to various modules of the electronic device, and the microphone can be used to pick up sound signals in the surrounding environment.

[0129] In this embodiment, the processor 402 in the electronic device loads the executable code corresponding to one or more application processes into the memory 401 according to the following instructions, and the processor 402 runs the application stored in the memory 401 to execute:

[0130] Get operation information;

[0131] Encode the operation information to obtain voice command information;

[0132] The voice command information is sent to the local target device through a call connection channel, so that the local target device controls the Internet of Things device to perform corresponding operations according to the command in a first preset format generated after decoding the voice command information, wherein the call connection channel is established through a cellular network.

[0133] In one embodiment, the electronic device includes a remote device interface, and the operation information includes touch operation information. When executing the acquisition of the operation information, the processor 402 may further execute: acquiring the touch operation information on the remote device interface.

[0134] In one embodiment, when the processor 402 encodes the operation information to obtain voice command information, it can execute: converting the touch operation information into a command in a second preset format according to the touch operation order; encoding the command in the second preset format to obtain voice command information.

[0135] In one embodiment, the operation information includes a voice message. When the processor 402 encodes the operation information to obtain voice command information, it can also execute: converting the voice message into commands in a second preset format in sequence; encoding the commands in the second preset format to obtain voice command information.

[0136] In one embodiment, when the processor 402 sends voice command information to the local target device through a call connection channel so that the local target device controls the Internet of Things device to perform corresponding operations according to the command in the first preset format generated after decoding the voice command information, it can execute: sending the voice command information to the local target device through the call connection channel so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in the first preset format, so that the local device interface of the Internet of Things device controls the Internet of Things device to perform corresponding operations according to the command sequence in the first preset format.

[0137] In one embodiment, when the processor 402 sends voice command information to the local target device through a call connection channel so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the Internet of Things device controls the Internet of Things device to perform corresponding operations according to the command sequence in the first preset format, it can execute: sending the voice command information to the local target device through the call connection channel so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in the first preset format; if a request message for resending the lost command is received from the local device interface, the other commands after the lost command in the command sequence in the first preset format are cached, and the lost information corresponding to the lost command is resent, so that the local device interface controls the Internet of Things device to perform corresponding operations according to the lost command and other commands thereafter.

[0138] In one embodiment, when the processor 402 sends voice command information to the local target device through a call connection channel so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the Internet of Things device controls the Internet of Things device to perform corresponding operations according to the command sequence in the first preset format, it can execute: sending the voice command information to the local target device through the call connection channel so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in the first preset format; if a request message for resending the damaged command is received from the local device interface, other commands after the damaged command in the command sequence in the first preset format are cached, and the damage information corresponding to the damaged command is resent, so that the local device interface controls the Internet of Things device to perform corresponding operations according to the damaged command and other commands thereafter.

[0139] In one embodiment, the remote device interface is paired with the local target device, and a call connection channel is set up between the remote device interface and the local target device via a security key.

[0140] In one embodiment, the touch operation information includes at least one of the following: selecting an IoT device, changing a state of an IoT device, and updating a parameter value of an IoT device.

[0141] In one embodiment, the remote device interface has the same application user interface as the local device interface.

[0142] In the embodiments of the electronic device and the readable storage medium provided in this application, all the technical features of the embodiments of the above method are included. The expanded and explained contents of the specification are applicable to the embodiments of the above positioning method in the same way and will not be repeated here.

[0143] See also Figure 10 , Figure 10 It is a structural diagram of the Internet of Things device control system provided in an embodiment of the present application. Figure 10 In the embodiment, the Internet of Things device control system 500 includes an electronic device 501, a local target device 502 and an Internet of Things device 503. The electronic device 501 receives the user's operation information, encodes the operation information to obtain voice command information, and sends the voice command information to the local target device 502 through a call connection channel. The local target device 502 decodes the voice command information to generate a command in a first preset format, and controls the Internet of Things device 503 to perform corresponding operations according to the command in the first preset format, wherein the call connection channel is established through a cellular network.

[0144] In one embodiment, electronic device 501 may include a remote device interface, and IoT device 503 may include a local device interface. The remote device interface has the same application user interface as the local device interface. A call connection channel is established between the remote device interface and the local target device 502 via a cellular network. When a cellular network is available, the remote device interface and the local target device 502 communicate data via the call connection channel, and the IoT device is controlled to perform corresponding operations via the local device interface.

[0145] An embodiment of the present application further provides a computer program product, which includes computer program code. When the computer program code runs on a computer, the computer executes the methods in the various possible embodiments described above.

[0146] An embodiment of the present application also provides a chip, including a memory and a processor, wherein the memory is used to store programs, and the processor is used to call and run programs from the memory, so that a device equipped with the chip executes the methods in the various possible embodiments above.

[0147] In the above embodiments, the description of each embodiment has its own focus. For the part that is not described in detail in a certain embodiment, please refer to the detailed description of the IoT device control method above, which will not be repeated here.

[0148] The Internet of Things device control device provided in the embodiment of the present application belongs to the same concept as the Internet of Things device control method in the above embodiment. Any method provided in the embodiment of the Internet of Things device control method can be run on the Internet of Things device control device. The specific implementation process is detailed in the embodiment of the Internet of Things device control method, which will not be repeated here.

[0149] It should be noted that, with respect to the IoT device control method according to the embodiment of the present application, those skilled in the art will understand that all or part of the process of implementing the IoT device control method according to the embodiment of the present application can be accomplished by controlling the relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, such as a memory, and executed by at least one processor. During the execution process, the process of the embodiment of the IoT device control method can be included. The storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), etc.

[0150] For the IoT device control device of the embodiment of the present application, its various functional modules can be integrated into a single processing chip, or each module can exist physically separately, or two or more modules can be integrated into a single module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software functional modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they can also be stored in a computer-readable storage medium, such as a read-only memory, a disk, or an optical disk.

[0151] The above is a detailed introduction to an Internet of Things device control method, device, storage medium, electronic device and system provided in the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea; at the same time, for technical personnel in this field, based on the ideas of the present application, there will be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. A method for controlling an Internet of Things device, applied to an electronic device, characterized in that: include: Get operation information; Encoding the operation information to obtain voice command information; The voice command information is sent to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the Internet of Things device controls the Internet of Things device to perform corresponding operations according to the command sequence in the first preset format.

2. The method for controlling an Internet of Things device according to claim 1, wherein: The electronic device includes a remote device interface, the operation information includes touch operation information, and the acquiring operation information includes: Acquire touch operation information on the remote device interface.

3. The method for controlling an Internet of Things device according to claim 2, wherein: The encoding of the operation information to obtain voice command information includes: converting the touch operation information into a command in a second preset format according to the touch operation sequence; The command in the second preset format is encoded to obtain the voice command information.

4. The method for controlling an Internet of Things device according to claim 1, wherein: The operation information includes a voice message, and encoding the operation information to obtain voice command information includes: Converting the voice message into commands in a second preset format in sequence; The command in the second preset format is encoded to obtain the voice command information.

5. The method for controlling an Internet of Things device according to claim 1, wherein: The sending of the voice command information to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the Internet of Things device controls the Internet of Things device to perform a corresponding operation according to the command sequence in the first preset format, includes: sending the voice command information to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format; If a request message for resending the lost command is received from the local device interface, the other commands after the lost command in the command sequence of the first preset format are cached, and the lost information corresponding to the lost command is resent, so that the local device interface controls the Internet of Things device to perform corresponding operations according to the lost command and other subsequent commands.

6. The method for controlling an Internet of Things device according to claim 5, wherein: The sending of the voice command information to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the Internet of Things device controls the Internet of Things device to perform a corresponding operation according to the command sequence in the first preset format, includes: sending the voice command information to the local target device through the call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format; If a request message for resending the damaged command is received from the local device interface, the other commands following the damaged command in the command sequence of the first preset format are cached, and the damage information corresponding to the damaged command is resent, so that the local device interface controls the Internet of Things device to perform corresponding operations according to the damaged command and other subsequent commands.

7. The method for controlling an Internet of Things device according to claim 2, wherein: The remote device interface is paired with the local target device for use, and a call connection channel is set between the remote device interface and the local target device via a security key.

8. The method for controlling an Internet of Things device according to claim 2 or 3, wherein: The touch operation information includes at least one of the following: Select IoT devices, change the status of IoT devices, and update parameter values ​​of IoT devices.

9. The method for controlling an Internet of Things device according to claim 2, wherein: The remote device interface has the same application user interface as the local device interface.

10. An Internet of Things device control device, applied to electronic equipment, characterized in that: The Internet of Things device control device includes: Acquisition module, used to obtain operation information; an encoding module, configured to encode the operation information to obtain voice command information; A control module is used to send the voice command information to a local target device through a call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the Internet of Things device controls the Internet of Things device to perform corresponding operations according to the command sequence in the first preset format.

11. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed on a computer, the computer is caused to execute the method according to any one of claims 1 to 9.

12. An electronic device, characterized in that: The method comprises a memory and a processor, wherein the processor is configured to execute the method according to any one of claims 1 to 9 by calling a computer program stored in the memory.

13. An Internet of Things device control system, characterized in that: The invention comprises an electronic device, a local target device and an Internet of Things device, wherein the electronic device receives operation information, encodes the operation information to obtain voice command information, and sends the voice command information to the local target device through a call connection channel, so that the local target device converts the voice command information into text information, and converts the text information into a command sequence in a first preset format, so that the local device interface of the Internet of Things device controls the Internet of Things device to perform corresponding operations according to the command sequence in the first preset format, wherein the call connection channel is established through a cellular network.

Images