Device Control Method, Device, Readable Storage Medium and Chip

After the target voice module wakes up, the voice information is converted into control commands to control smart home devices, which solves the problem that users cannot easily control smart homes, and realizes the convenience of voice control and the universality of the equipment.

CN115562054BActive Publication Date: 2025-06-10BEIJING XIAOMI MOBILE SOFTWARE CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202211193908.X
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2022-09-28
Publication Date
2025-06-10
Estimated Expiration
2042-09-28

AI Technical Summary

Technical Problem

When users do not carry terminal devices, they cannot conveniently control smart home devices, resulting in inconvenience in life.

Method used

After the target voice module wakes up, the collected voice information is sent to the server, converted into control commands and controlled the target device. The target voice module has IOT control capabilities and voice interaction capabilities to realize voice control.

Benefits of technology

Users can control smart home devices through voice without going to the device position, which improves control convenience, and the target voice module is versatile and suitable for a variety of smart devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN115562054B_ABST
    Figure CN115562054B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a device control method, apparatus, readable storage medium, and chip, and relates to the technical field of smart home. The method includes: when the target voice module is awakened, sending the collected first voice information to a first server, where the first voice information is used for the first server to convert the first voice information into a first control instruction and send it to a second server, and the first voice information contains information for controlling a second target device; receiving the first control instruction fed back by the second server; and controlling the second target device by using the target voice module or a processor according to the first control instruction, where the target voice module and the processor are located in a first target device. By using the device control method proposed in the present disclosure, a user can use the first target device capable of conversation to control the second target device, which brings convenience to the user for controlling the second target device.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the technical field of smart home, and particularly to a device control method, apparatus, readable storage medium, and chip. Background Art

[0002] With the increasing improvement of people's living standards, smart home plays an important role in people's daily life, bringing great convenience to people's lives.

[0003] In related technologies, users can control smart home on terminals such as mobile phones. However, when users do not carry the terminal and want to control the smart home, they need to walk to the location where the smart home is located to operate the smart home, or walk to the location where the terminal is located to use the terminal to control the smart home, which also brings some inconvenience to users' lives. Summary of the Invention

[0004] To overcome the problems existing in related technologies, the present disclosure provides a device control method, apparatus, readable storage medium, and chip.

[0005] According to a first aspect of an embodiment of the present disclosure, a device control method is provided. The method is applied to a target voice module, and the method includes:

[0006] When the target voice module is awakened, send the collected first voice information to a first server, where the first voice information is used for the first server to convert the first voice information into a first control instruction and send it to a second server, and the first voice information contains information for controlling a second target device;

[0007] Receive the first control instruction fed back by the second server;

[0008] Control the second target device using the target voice module or a processor according to the first control instruction, where the target voice module and the processor are located in a first target device.

[0009] Optionally, the target voice module is awakened through the following steps:

[0010] Receive second voice information sent by a third target device through a third server;

[0011] Through the third server, wake up the target voice module from multiple voice modules according to the priorities of the multiple voice modules and the distances between the multiple voice modules and the sound source outputting the second voice information.

[0012] Optionally, the controlling the second target device using the target voice module or a processor according to the first control instruction includes:

[0013] When the first voice message is the first preset voice message, send the first control instruction to the processor, where the first control instruction is used to instruct the processor to control the second target device according to the first control instruction.

[0014] Optionally, controlling the second target device using the target voice module or the processor according to the first control instruction includes:

[0015] When the first voice message is the second preset voice message, control the second target device according to the first control instruction.

[0016] Optionally, the method further includes:

[0017] When the first voice message is the third preset voice message, receive the second control instruction fed back by the first server;

[0018] Control the second target device according to the second control instruction.

[0019] Optionally, the method further includes:

[0020] When the first target device establishes a connection with the fourth server, receive the configuration file sent by the fourth server, where the configuration file is used to update the wake-up function of the target voice module.

[0021] Optionally, the method further includes:

[0022] Register the first device information of the first target device to both the second server and the fourth server at the same time, and both the second server and the fourth server establish a connection with the target voice module of the first target device based on the first device information.

[0023] Optionally, the method further includes:

[0024] Receive the upgrade file sent by the second server;

[0025] Upgrade the target voice module and the processor according to the upgrade file.

[0026] According to a second aspect of the embodiments of the present disclosure, there is provided a device control device, which is applied to a target voice module, and the device includes:

[0027] A voice sending module, configured to send the collected first voice information to a first server when the target voice module is awakened, where the first voice information is used by the first server to convert the first voice information into a first control instruction and send it to a second server, and the first voice information contains information for controlling a second target device;

[0028] A first control instruction receiving module, configured to receive the first control instruction fed back by the second server;

[0029] A control module, configured to control the second target device using the target voice module or the processor according to the first control instruction, where the target voice module and the processor are located in a first target device.

[0030] According to a third aspect of the embodiments of the present disclosure, there is provided a computer-readable storage medium, on which computer program instructions are stored, and when the program instructions are executed by a processor, the steps of the device control method provided in the first aspect of the present disclosure are implemented.

[0031] According to a fourth aspect of the embodiments of the present disclosure, there is provided a chip, including a processor and an interface; the processor is used to read instructions to execute the steps of the device control method provided in the first aspect of the present disclosure.

[0032] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

[0033] Through the device control method proposed by the present disclosure, when the target voice module is awakened, the user can send the first voice information output by the user to the first server and the second server, and the first server and the second server return the first control instruction corresponding to the first voice information to the target voice module of the first target device, so that the target voice module or the processor in the first target device controls the second target device according to the first control instruction; that is, the target voice module not only has the iot control ability but also has the voice interaction ability, so that the first target device connected to the target voice module can be used as a control entry for smart home to realize voice control of the second target device.

[0034] In this process, if the user does not carry a terminal, the user only needs to communicate with the first target device that can talk to itself to control the second target device, without having to go to the location of the second target device to control the second target device, nor having to go to the location of the terminal to control the second target device using the terminal, which brings convenience to the user to control the second target device.

[0035] In addition, in the related art, the Wi-Fi module has the ability to control IoT, but cannot perform voice interaction. The target voice module of the present disclosure, in addition to having the ability to control IoT, also has the ability of voice interaction, enabling the intelligent device connected to it to become the control center of the smart home, completing voice control of other home devices. Moreover, for this target voice module, it is not necessary to configure each intelligent device separately. As long as the intelligent device is connected to this target voice module, it can possess the capabilities of the above-mentioned target voice module and can achieve voice control of other devices, having a certain degree of generality.

[0036] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0037] The accompanying drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present disclosure, and are used together with the specification to explain the principles of the present disclosure.

[0038] Figure 1 is a flowchart of a device control method shown according to an exemplary embodiment.

[0039] Figure 2 is a block diagram of interaction between multiple servers and a target voice module shown according to an exemplary embodiment.

[0040] Figure 3 is a block diagram of a device control device shown according to an exemplary embodiment.

[0041] Figure 4 is a block diagram of a device shown according to an exemplary embodiment. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0042] Here, the exemplary embodiments will be described in detail, and the examples are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. On the contrary, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0043] It should be noted that all actions of obtaining signals, information, or data in this application are carried out on the premise of complying with the corresponding data protection regulations and policies of the country where the location is located and obtaining authorization from the owner of the corresponding device.

[0044] Figure 1 is a flowchart of a device control method shown according to an exemplary embodiment, as Figure 1As shown, the device control method can be applied to a target voice module, including the following steps.

[0045] In step S11, when the target voice module is awakened, the collected first voice information is sent to a first server. The first voice information is used by the first server to convert the first voice information into a first control instruction and send it to a second server. The first voice information contains information for controlling a second target device.

[0046] In the present disclosure, in addition to having IoT capabilities, the target voice module also has audio processing capabilities. That the target voice module has IoT capabilities can be understood as that the target voice module can establish a connection with a smart home control platform. For example, the target voice module can establish a connection with servers such as an IoT server, and can realize the control of smart devices. The target voice module and the processor can be located in a first target device. The target voice module and the processor are connected through a serial port. A voice module and a processor can also be configured in the second target device.

[0047] Among them, the first target device is a device that can be awakened and can control the second target device. The second target device is the device to be controlled. The first server can be a server capable of processing voice information. For example, it can be a Xiaoai server. The second server can be a server that issues control instructions in the entire device control method. Most instructions need to be issued by the second server to the target voice module in the first target device, and the target voice module determines whether it can process them. The second server can be an IoT (Internet of Things) server. The first control instruction corresponds to the first voice information and is used to control the functions on the second target device.

[0048] In the present disclosure, the target voice module can be awakened through the following sub-steps:

[0049] In sub-step A1, the second voice information sent by a third target device is received through a third server. In sub-step A2, through the third server, according to the priorities of multiple voice modules and the distances between multiple voice modules and the sound source that outputs the second voice information, the target voice module is awakened from multiple voice modules.

[0050] Among them, the third server can be a server that wakes up the target voice module in the first target device from multiple servers. For example, it can be Figure 2 the collaborative server shown. The third target device can be a device closer to the sound source that outputs the second voice information. The third target device, the second target device, and the first target device can be the same smart home or different smart homes.

[0051] Specifically, in the space where the sound source is located, the voice module in the third target device closer to the sound source receives the second voice message and sends the second voice message to the third server. The third server receives the second voice message sent by the voice module in the third target device, and wakes up the target voice module of the first target device from multiple voice modules according to the priorities of the voice modules of multiple devices in the space where the sound source is located and the distances between the multiple voice modules and the sound source.

[0052] Taking an example where there are three smart homes in a house, namely a washing machine, a television, and a microwave oven. The first target device is the washing machine, the second target device is the television, the third target device is the microwave oven, the first server is the Xiaoai server, the second server is the iot server, and the third server is the collaboration server.

[0053] Please refer to Figure 2 As shown, the user sends the second voice message "Xiaoai, are you there?" in the house. At this time, the voice module of the microwave oven, which is the closest to the user in the house, receives the second voice message and transmits the second voice message to the collaboration server. The collaboration server wakes up the target voice module of the washing machine from the voice modules of the three smart homes in the house according to the priorities of the voice modules of the three smart homes in the house and the distances between the voice modules of the three smart homes and the user, so that the target voice module of the washing machine is in a woken state.

[0054] Among them, please refer to Figure 2 As shown, the target voice module can be equipped with a sound collection device and an audio playback device. The sound collection device can be a microphone, and the audio playback device can be a player. When the target voice module is woken up, the target voice module can collect the first voice message output by the user through the sound collection device, and then play voice-related information through the audio playback device, or output the voice that gives feedback on the first voice message output by the user through the audio playback device.

[0055] The voice modules in smart homes such as the second target device and the third target device can also be equipped with a sound collection device and an audio playback device to implement the functions of collecting voice and playing audio, and achieve the same functions as the first target device. The present disclosure does not limit this here.

[0056] For example, when the voice module of the third target device receives the second voice message "Xiaoai, are you there?", the voice module of the third target device will wake up the target voice module of the first target device through the collaboration server. The target voice module can output the voice "I'm here" through the audio playback device, so as to give feedback on the voice message output by the user.

[0057] Among them, the third server can wake up the target voice module from multiple voice modules according to the priorities of the multiple voice modules and the distances between the multiple voice modules and the sound source that outputs the second voice information.

[0058] Specifically, when the number of voice modules in the space where the sound source is located is 1, the third server wakes up the only voice module as the target voice module; when the number of voice modules in the space where the sound source is located is greater than 1, the third server can first take the voice module with the highest priority from the multiple voice modules as the target voice module; in the case of multiple voice modules with the highest priority, the voice module closest to the sound source that outputs the second voice information among the multiple voice modules with the highest priority is taken as the target voice module.

[0059] It can be understood that the higher the priority, the higher the ability of the voice module to process audio data. For example, the audio processing ability of the voice modules in devices such as Xiaoai speakers and players is higher than that of the audio processing ability of devices such as washing machines and microwave ovens. Therefore, the priority of the voice module with higher audio processing ability is higher than the priority of the voice module with weaker audio processing ability.

[0060] For example, when the third server wakes up the target voice module from multiple voice modules, it can first wake up the voice module of devices such as Xiaoai speakers. In the absence of Xiaoai speakers, the priorities of the voice modules of devices such as washing machines and microwave ovens are the same. Therefore, the voice module of the washing machine closest to the user can be taken as the target voice module and woken up from multiple voice modules with the same priority.

[0061] In step S12, receive the first control instruction fed back by the second server.

[0062] In the present disclosure, please refer to Figure 2 As shown, the first target device includes a target voice module and a processor. The target voice module and the processor are connected through a serial port, which can also be understood as being connected through a serial communication interface. Since the voice module is related to audio, a voice collection device and an audio playback device are equipped on the target voice module; the processor is related to the functions of the device itself, and function buttons and lights are equipped on the processor. For example, function buttons such as turning on the washing machine and timing the washing machine are equipped on the processor of the washing machine, and the control of the lights on the display panel of the washing machine is also equipped.

[0063] Of course, the second target device and the third target device can also be the same as the first target device, including a voice module and a processor, and are used to receive the first control instruction fed back by the second server.

[0064] Among them, the voice module can be the Xiaoai voice module, which is a chip formed by several circuits; the processor is an MCU (Microcontroller Unit) processor.

[0065] Among them, the first control instruction received by the target voice module can be a request value. Different control instructions correspond to different request values. For example, the request value for requesting to turn on the washing machine is 1, and the request value for requesting to turn on the TV is 2, etc.

[0066] In step S13, the second target device is controlled using the target voice module or the processor according to the first control instruction. The target voice module and the processor are located in the first target device.

[0067] In the present disclosure, the second target device controlled by the first target device can be the first target device itself or other smart homes.

[0068] Among them, when the first voice message received by the target voice module is the first preset voice message, the target voice module determines that it cannot control the second target device according to the first control instruction sent by the second server; when the first voice message received by the target voice module is the second preset voice message, the target voice module determines that it can control the second target device according to the first control instruction sent by the second server; when the first voice message received by the target voice module is the third preset voice message, the target voice module determines that it can interact with the user who emits the sound source according to the second control instruction sent by the first server.

[0069] Specifically, the first preset voice message is a voice unrelated to audio playback, such as turning on the TV, adjusting the TV brightness, turning on the microwave oven, adjusting the microwave heating duration, etc. When the first voice message is the first preset voice message, it indicates that the user wants to control the second target device rather than play audio. At this time, after the target voice module receives the first control instruction output by the second server, it determines that the target voice module itself cannot process the first control instruction, so it will forward the first control instruction to the processor to instruct the processor to control the second target device according to the first control instruction.

[0070] For example, after the target voice module of the washing machine is awakened by the collaboration server, when the user outputs the first voice message of "turn on the TV" again, the awakened target voice module sends the first voice message to the Xiaoai server; after the Xiaoai server parses the first voice message, it converts the first voice message into a first control instruction and forwards the first control instruction to the iot server. The iot server forwards the first control instruction to the target voice module through the OT channel, and the target voice module forwards the first control instruction to the processor in the washing machine. The processor in the washing machine controls the TV to turn on according to the first control instruction.

[0071] Specifically, the second preset voice message is a voice related to audio playback, such as playing music, pausing music playback, etc. When the first voice message is the second preset voice message, it indicates that the user wants to control the audio function of the second target device. At this time, after the target voice module receives the first control instruction output by the second server, it determines that the target voice module itself can process the first control instruction, so it can directly control the second target device according to the first control instruction.

[0072] For example, after the user outputs the first voice message of "play music", the awakened target voice module uploads the first voice message to the Xiaoai server. The Xiaoai server converts the first voice message into a first control instruction and forwards the first control instruction to the iot server. The iot server forwards the first control instruction to the target voice module through the OT channel, and the target voice module controls itself or the player to play music according to the first control instruction.

[0073] Specifically, the third preset voice message can be a voice related to voice interaction, such as a voice for the user to interact with the second target device. When the first voice message is the third preset voice message, it indicates that the user wants to interact with the second target device. At this time, after the target voice module receives the second control instruction output by the first server, it determines that the target voice module itself can process the second control instruction, so it will directly respond to the first voice message emitted by the sound source according to the second control instruction to interact with the user in voice.

[0074] In the above process, since the target voice module is equipped with a voice collection device and an audio playback device, the target voice module can collect voices and play audio, so as to realize the audio playback function and voice interaction function of the second target device; the processor is directly connected to the device, so the processor can directly control the second target device to execute non-audio playback functions.

[0075] Among them, after the processor successfully executes the first control instruction, the processor returns the feedback information of successfully executing the first control instruction to the target voice module, and the target voice module then returns it to the second server, so that the second server determines that the processor meets the user's required functions; similarly, after the target voice module successfully executes the second control instruction, the target voice module can also return the feedback information of successfully executing the second control instruction to the second server or the first server, so that the first server or the second server determines that the target voice module meets the user's required functions.

[0076] Among them, please refer to Figure 2 as shown, the first server ( Figure 2 Xiaomi server in), the second server ( Figure 2 iot server in), the third server ( Figure 2 collaboration server in) and the fourth server ( Figure 2 mico server in) can all communicate and connect with the application. The user can perform initial network configuration on the application, so that the first target device connected to each server can be in an online state.

[0077] In addition, the user can also directly issue control instructions using the application to control the second target device, which will not be elaborated here in this disclosure.

[0078] Through the device control method proposed in this disclosure, when the target voice module is awakened, the user can send the first voice information output by the user to the first server and the second server. The first server and the second server return the first control instruction corresponding to the first voice information to the target voice module or the processor of the first target device, so that the target voice module or the processor in the first target device controls the second target device according to the first control instruction.

[0079] In this process, if the user does not carry a terminal, the user only needs to communicate with the target voice module of the first target device that can communicate with itself to control the second target device, without having to walk to the location of the second target device to control it, nor having to walk to the location of the terminal to control the second target device using the terminal, which brings convenience to the user in controlling the second target device.

[0080] In addition, in the related art, the device main control includes a WIFI module and a processor. The WIFI module receives control instructions from the server and then forwards the control instructions to the processor, which controls the second target device. Since the WIFI module does not have audio processing capabilities, the control of the second target device can only be achieved through the processor. When it is necessary to control the audio function of the second target device, a processor needs to be configured to control the second target device. When it is necessary to control the non-audio function of the second target device, another processor needs to be configured to control the second target device. That is, different second target devices with different functions require different device main controls for control, resulting in low versatility of the device main control.

[0081] In the present disclosure, compared with the WIFI module, the target voice module has audio processing capabilities. The target voice module processes the first control instructions that the target voice module itself can handle to implement functions related to audio control such as audio playback and pause. The target voice module can also forward the first control instructions that it cannot handle to the processor to directly control the second target device through the processor, implementing functions unrelated to audio control such as turning on the TV, controlling the screen brightness, and timing functions. It can be seen that the target audio module proposed in the present disclosure has audio processing capabilities, and the processor has non-audio processing capabilities. The combination of the two can control different second target devices, and its versatility is relatively high.

[0082] In a possible implementation manner, before the target voice module of the first target device communicates with each server, it is necessary to establish a communication connection between the target voice module of the first target device and each server. Based on this connection, data transmission between the target voice module of the first target device and each server can be achieved. Specifically, it includes:

[0083] In step S21, the first device information of the first target device is registered with the second server and the fourth server at the same time. Both the second server and the fourth server establish connections with the target voice module of the first target device based on the first device information.

[0084] In the present disclosure, the second server is an iot server, and the fourth server is a mico (Micro-controller based Internet Connectivity Operating system, Internet of Things operating system) server.

[0085] Among them, the first device information includes the identifier, registration information, and type of the device, etc. These information are used to uniquely identify a device.

[0086] Among them, when different servers establish connections with the target voice module of the first target device, the target voice module needs to upload the first device information in different formats in order to be parsed by different servers.

[0087] For example, when the target voice module registers the first device information on the second server, it is necessary to upload the first device information to the second server in the model format or the pid format; the second server can parse the first device information based on the first device information in the model format or the pid format, and determine the first target device based on the first device information, so as to establish a connection with the target voice module of the first target device.

[0088] Another example is that when the target voice module registers the first device information on the fourth server, it is necessary to upload the first device information to the fourth server in the hardware format; the fourth server can then parse the first device information in the hardware format and determine the first target device based on the first device information, so as to establish a connection with the target voice module of the first target device.

[0089] After the target voice module of the first target device establishes a connection with the second server, the transmission of the first control command or the transmission of the upgrade file can be realized through the OT channel between the two.

[0090] Specifically, please refer to Figure 2 As shown, the second server is communicatively connected to the application. The application can be the Mijia app (Application) installed in the terminal. The application checks the version information. When it determines that there is a version update, it sends the version information to the target voice module through the second server. The target voice module then obtains the upgrade file required for the upgrade from the second server to upgrade itself, or transmits it to the processor to upgrade the processor.

[0091] After the target voice module of the first target device establishes a connection with the fourth server, OTA (Over-the-Air Technology) can be realized, and the configuration file can also be downloaded from the fourth server to update the wake-up function of the target voice module in the first target device; the recorded log can also be uploaded to the fourth server.

[0092] Specifically, after the collaboration server wakes up the target voice module of the first target device multiple times, there may still be a situation where the wake-up of the target voice module fails. At this time, the log of the wake-up failure can be uploaded to the fourth server; developers develop a configuration file on the fourth server and then send the configuration file to the target voice module to update the wake-up function of the target voice module to ensure that the target voice module can be normally woken up.

[0093] In step S22, the first device information of the first target device is registered with the first server, and the first server establishes a connection with the target voice module of the first target device based on the first device information.

[0094] In the present disclosure, the first server may be a Xiaoai server. After the first device information is successfully registered with the fourth server and the second server, the first device information is then registered with the first server to establish a connection with the first server.

[0095] Among them, when the first target device registers the first device information with the first server, the first device information needs to be registered with the first server in the format of Appid. Only then can the first server parse the first device information in the Appid format and determine the first target device based on the first device information to establish a connection with the target voice module of the first target device.

[0096] Specifically, the target voice module sends the first device information to the first server through the Xiaoai sdk (Software Development Kit) to establish a voice interaction cloud channel between the target voice module and the first server, so as to upload the voice of the target voice module to the first server or download voice resources from the first server, etc.

[0097] In step S23, the first device information of the first target device is registered with the third server, and the third server establishes a connection with the target voice module of the first target device based on the first device information.

[0098] In the present disclosure, the third server may be a collaboration server. After the first device information is successfully registered with the first server, the first device information is then registered with the third server to establish a connection with the third server.

[0099] Among them, when the first target device registers the first device information with the third server, the first device information needs to be registered with the third server in the format of hardware. Only then can the third server parse the first device information in the hardware format and determine the first target device based on the first device information to establish a connection with the target voice module of the first target device.

[0100] Specifically, the target voice module registers the first device information to the third server through the collaboration SDK to establish a connection with the collaboration server, enabling the collaboration server to wake up and control the target voice module.

[0101] Figure 3 It is a block diagram of a device control device shown according to an exemplary embodiment. Refer to Figure 3 The device control device 120 includes a voice sending module 121, a first control instruction receiving module 122, and a control module 123.

[0102] The voice sending module 121 is configured to send the collected first voice information to the first server when the target voice module is awakened. The first voice information is used by the first server to convert the first voice information into a first control instruction and send it to the second server. The first voice information contains information for controlling the second target device.

[0103] The first control instruction receiving module 122 is configured to receive the first control instruction fed back by the second server.

[0104] The control module 123 is configured to use the target voice module or the processor to control the second target device according to the first control instruction. The target voice module and the processor are located in the first target device.

[0105] Optionally, the device control device 120 includes:

[0106] A second voice information receiving module, configured to receive the second voice information sent by the third target device through the third server.

[0107] A wake-up module, configured to wake up the target voice module from multiple voice modules through the third server according to the priorities of the multiple voice modules and the distances between the multiple voice modules and the sound source outputting the second voice information.

[0108] Optionally, the control module 123 includes:

[0109] A first control module, configured to send the first control instruction to the processor when the first voice information is the first preset voice information. The first control instruction is used to instruct the processor to control the second target device according to the first control instruction.

[0110] Optionally, the control module 123 includes:

[0111] A second control module, configured to control the second target device according to the first control instruction when the first voice information is the second preset voice information.

[0112] Optionally, the device control device 120 includes:

[0113] A second control instruction receiving module, configured to receive the second control instruction fed back by the first server when the first voice message is the third preset voice message;

[0114] A third control module, configured to control the second target device according to the second control instruction.

[0115] Optionally, the device control device 120 includes:

[0116] An update module, configured to receive a configuration file sent by the fourth server when the first target device establishes a connection with the fourth server, where the configuration file is used to update the wake-up function of the target voice module.

[0117] Optionally, the device control device 120 includes:

[0118] A registration module, configured to register the first device information of the first target device to both the second server and the fourth server at the same time, and both the second server and the fourth server establish a connection with the target voice module of the first target device according to the first device information.

[0119] Optionally, the device control device 120 includes:

[0120] An upgrade file receiving module, configured to receive an upgrade file sent by the second server;

[0121] An upgrade module, configured to upgrade the target voice module and the processor according to the upgrade file.

[0122] Regarding the device in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be elaborated here.

[0123] The present disclosure also provides a computer-readable storage medium, on which computer program instructions are stored, and when the program instructions are executed by a processor, the steps of the device control method provided by the present disclosure are implemented.

[0124] Figure 4 It is a block diagram of a device 800 for device control shown according to an exemplary embodiment. For example, the device 800 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0125] Refer toFigure 4 , device 800 may include one or more of the following components: a processing component 802, a memory 804, a power supply component 806, a multimedia component 808, an audio component 810, an input / output interface 812, a sensor component 814, and a communication component 816.

[0126] The processing component 802 generally controls the overall operation of the device 800, such as operations associated with display, telephone calls, data communication, camera operations, and recording operations. The processing component 802 may include one or more processors 820 to execute instructions to complete all or part of the steps of the above-described device control method. In addition, the processing component 802 may include one or more modules to facilitate the interaction between the processing component 802 and other components. For example, the processing component 802 may include a multimedia module to facilitate the interaction between the multimedia component 808 and the processing component 802.

[0127] The memory 804 is configured to store various types of data to support the operation of the device 800. Examples of such data include instructions for any application or method operating on the device 800, contact data, phone book data, messages, pictures, videos, etc. The memory 804 may be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, a magnetic disk, or an optical disk.

[0128] The power supply component 806 provides power to the various components of the device 800. The power supply component 806 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power for the device 800.

[0129] The multimedia component 808 includes a screen that provides an output interface between the device 800 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen can be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors can sense not only the boundaries of touch or swipe actions but also detect the duration and pressure associated with the touch or swipe operation. In some embodiments, the multimedia component 808 includes a front camera and / or a rear camera. When the device 800 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera can receive external multimedia data. Each of the front camera and the rear camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

[0130] The audio component 810 is configured to output and / or input audio signals. For example, the audio component 810 includes a microphone (MIC) that is configured to receive external audio signals when the device 800 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals can be further stored in the memory 804 or transmitted via the communication component 816. In some embodiments, the audio component 810 further includes a speaker for outputting audio signals.

[0131] The input / output interface 812 provides an interface between the processing component 802 and a peripheral interface module, and the peripheral interface module can be a keyboard, a click wheel, buttons, etc. These buttons can include but are not limited to: a home button, a volume button, a power button, and a lock button.

[0132] The sensor component 814 includes one or more sensors for providing an assessment of the status of the device 800 in various aspects. For example, the sensor component 814 can detect the on / off state of the device 800, the relative positioning of components, such as the display and the keypad of the device 800. The sensor component 814 can also detect a change in the position of the device 800 or a component of the device 800, the presence or absence of user contact with the device 800, the orientation or acceleration / deceleration of the device 800, and the temperature change of the device 800. The sensor component 814 can include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 814 can also include a light sensor, such as a CMOS or a CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 814 can further include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0133] The communication component 816 is configured to facilitate communication, either wired or wirelessly, between the device 800 and other devices. The device 800 may access a wireless network based on communication standards, such as WiFi, 2G, or 3G, or a combination thereof. In an exemplary embodiment, the communication component 816 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 816 further includes a Near Field Communication (NFC) module to facilitate short-range communication. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, Infrared Data Association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.

[0134] In an exemplary embodiment, the device 800 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components for performing the above-described device control method.

[0135] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions, such as the memory 804 including instructions, is also provided. The above instructions may be executed by the processor 820 of the device 800 to complete the above-described device control method. For example, the non-transitory computer-readable storage medium may be a ROM, Random Access Memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage device, etc.

[0136] In addition to being an independent electronic device, the above-mentioned device can also be a part of an independent electronic device. For example, in one embodiment, the device can be an integrated circuit (IC) or a chip. The integrated circuit can be a single IC or a collection of multiple ICs. The chip can include, but is not limited to, the following types: GPU (Graphics Processing Unit), CPU (Central Processing Unit), FPGA (Field Programmable Gate Array), DSP (Digital Signal Processor), ASIC (Application Specific Integrated Circuit), SOC (System on Chip), etc. The above-mentioned integrated circuit or chip can be used to execute executable instructions (or code) to implement the above-mentioned device control method. The executable instructions can be stored in the integrated circuit or chip, or obtained from other devices or equipment. For example, the integrated circuit or chip includes a processor, a memory, and an interface for communicating with other devices. The executable instructions can be stored in the memory, and when the executable instructions are executed by the processor, the above-mentioned device control method is implemented. Or, the integrated circuit or chip can receive the executable instructions through the interface and transmit them to the processor for execution to implement the above-mentioned device control method.

[0137] In another exemplary embodiment, a computer program product is also provided. The computer program product includes a computer program that can be executed by a programmable device. The computer program has a code portion for executing the above-mentioned device control method when executed by the programmable device.

[0138] Those skilled in the art will readily conceive of other embodiments of the present disclosure after considering the specification and practicing the present disclosure. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known common knowledge or conventional technical means in the technical field not disclosed by the present disclosure. The specification and embodiments are only regarded as exemplary, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0139] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes can be made without departing from its scope. The scope of the present disclosure is only limited by the appended claims.

Claims

1. A device control method, characterized in that, the method is applied to a target voice module, and the method includes: when the target voice module is awakened, sending the collected first voice information to a first server, where the first voice information is used for the first server to convert the first voice information into a first control instruction and send it to a second server, the first voice information contains information for controlling a target device, and the second server is an IOT server; receiving the first control instruction fed back by the second server; judging by the target voice module whether it can process the first control instruction; if the target voice module can process the first control instruction, performing audio function control on the target device according to the first control instruction, where the target device is a first target device where the target voice module is located, or a second target device that allows IoT control and is different from the first target device; if the target voice module cannot process the first control instruction, controlling non-audio functions of the target device through a processor of the first target device.

2. The method according to claim 1, characterized in that, the target voice module is awakened through the following steps: receiving second voice information sent by a third target device through a third server; through the third server, waking up the target voice module from multiple voice modules according to the priorities of multiple voice modules and the distances between multiple voice modules and the sound source outputting the second voice information.

3. The method according to claim 1, characterized in that, the controlling non-audio functions of the target device through a processor of the first target device includes: when the first voice information is first preset voice information, sending the first control instruction to the processor, where the first control instruction is used to instruct the processor to control the second target device according to the first control instruction, and the first preset voice information is voice information unrelated to audio playback.

4. The method according to claim 1, characterized in that, the performing audio function control on the target device according to the first control instruction includes: when the first voice information is second preset voice information, controlling the second target device according to the first control instruction, and the second preset voice information is voice information related to audio playback.

5. The method according to claim 1, characterized in that, the method further includes: when the first voice information is third preset voice information, receiving a second control instruction fed back by the first server, and the third preset voice information is voice information related to voice interaction; controlling the second target device according to the second control instruction.

6. The method according to claim 3, characterized in that, the method further includes: when the first target device is connected to a fourth server, receiving a configuration file sent by the fourth server, where the configuration file is used to update the wake-up function of the target voice module.

7. The method according to claim 1, wherein, the method further comprises: simultaneously registering the first device information of the first target device to the second server and the fourth server, and both the second server and the fourth server establish a connection with the target voice module of the first target device according to the first device information.

8. The method according to claim 1, wherein, the method further comprises: receiving an upgrade file sent by the second server; upgrading the target voice module and the processor according to the upgrade file.

9. A device control device, wherein, the device is applied to a target voice module, and the device comprises: a voice sending module, configured to send the collected first voice information to a first server when the target voice module is awakened, and the first voice information is used for the first server to convert the first voice information into a first control instruction and send it to a second server, and the first voice information contains information for controlling a target device, and the second server is an IOT server; a first control instruction receiving module, configured to receive the first control instruction fed back by the second server; a control module, configured to: judge by the target voice module whether it can process the first control instruction; if the target voice module can process the first control instruction, perform audio function control on the target device according to the first control instruction, where the target device is the first target device where the target voice module is located, or a second target device that allows IoT control and is different from the first target device; if the target voice module cannot process the first control instruction, control the non-audio function of the target device through the processor of the first target device.

10. A computer-readable storage medium, on which computer program instructions are stored, wherein, when the program instructions are executed by a processor, the steps of the method according to any one of claims 1 to 8 are implemented.

11. A chip, wherein, comprising a processor and an interface; the processor is used to read instructions to execute the method according to any one of claims 1 to 8.

Citation Information

Patent Citations

  • Speech processing method, device, electronic equipment and storage medium

    CN111261151A

  • Voice control method and device

    CN115083401A