Voice equipment control method and device, electronic equipment and storage medium

By storing offline voice models in the management device and performing semantic recognition of voice signals, the problem of poor recognition accuracy in offline voice control of home appliances is solved, realizing the improvement of immediacy and compatibility, ensuring that users can effectively pass voice control Home appliances.

CN118982985APending Publication Date: 2024-11-19GREE ELECTRIC APPLIANCE INC OF ZHUHAI +1
View PDF 0 Cites 2 Cited by

Patent Information

Application Number
CN202411278275.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-12
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

During offline voice control, home appliances have problems such as poor speech recognition accuracy and many restrictions, which leads to users being unable to effectively control home appliances through voice.

Method used

A control method of voice equipment is adopted, through the management device communication connection with voice equipment, the offline voice model is stored, each model corresponds to a device category, and semantic recognition is performed after receiving voice signals, to determine whether the device supports control instructions, and to send corresponding Execute or silent command to instruct the device to respond.

Benefits of technology

It improves the semantic recognition and processing speed of speech signals without relying on the network, ensures the immediacy of control, improves the pertinence and accuracy of speech recognition, reduces the limitations of the recognition process, and ensures compatibility and scalability .

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118982985A_ABST
    Figure CN118982985A_ABST
Patent Text Reader

Abstract

The embodiment of the invention provides a voice equipment control method and device, electronic equipment and a storage medium, and relates to the technical field of equipment control, and the method comprises the steps: responding to a received voice signal sent by target voice equipment, determining a target equipment category corresponding to the target voice equipment, the voice signal is a signal obtained by converting the target voice equipment according to voice information input by a user; inputting the voice signal into a target offline voice model for semantic recognition, and obtaining an equipment control instruction corresponding to the voice signal; whether the target voice equipment supports the equipment control instruction or not is judged according to the target voice equipment and the equipment control instruction, and the judgment result is sent to the target voice equipment, so that the response speed is greatly increased, the control instantaneity is ensured, the pertinence and accuracy of voice recognition are improved, and the limitation of the voice recognition process is reduced.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of device control technology, and in particular to a control method for a voice device, a control device for a voice device, an electronic device and a computer-readable storage medium. Background Art

[0002] With the development of voice technology, more and more home appliances support voice control. At the same time, with the development of offline voice technology, users are allowed to achieve interactive control between users and home appliances when the home appliances are not connected to the Internet. However, in the offline control process of home appliances, there are still poor recognition accuracy and many restrictions, which makes it impossible for users to effectively control home appliances through voice. Summary of the invention

[0003] The embodiments of the present invention provide a control method, device, electronic device and computer-readable storage medium for a voice device to solve or partially solve the problem of poor voice recognition accuracy and many limitations in the process of offline voice control of household appliances.

[0004] The embodiment of the present invention discloses a control method for a voice device, which is applied to a management device, wherein the management device is communicatively connected with at least one voice device, and the management device stores an offline voice model, each of which corresponds to a device category. The method includes:

[0005] In response to receiving a voice signal sent by a target voice device, determining a target device category corresponding to the target voice device and a target offline voice model corresponding to the target device category, wherein the voice signal is a signal obtained by the target voice device according to voice information input by a user;

[0006] Inputting the speech signal into the target offline speech model for semantic recognition to obtain a device control instruction corresponding to the speech signal;

[0007] Whether the target voice device supports the device control instruction is determined based on the target voice device and the device control instruction, and a determination result is sent to the target voice device, wherein the determination result is used to indicate whether the target voice device responds to the voice signal or not.

[0008] In some feasible embodiments, judging whether the target voice device supports the device control instruction according to the target voice device and the device control instruction, and sending the judgment result to the target voice device, includes:

[0009] Determine a support instruction table corresponding to the target voice device, wherein the support instruction table includes control instructions that the target voice device can support;

[0010] If the device control instruction is found in the support instruction table, a device execution instruction is sent to the target voice device, where the device execution instruction is used to instruct the target voice device to perform a device operation corresponding to the device control instruction;

[0011] If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, a device silence instruction is sent to the target voice device. The device silence instruction is used to instruct the target voice device to output a voice reply message for the voice signal. The voice reply message is a message indicating that the target voice device does not perform the device operation.

[0012] In some feasible embodiments, if the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, sending a device silent instruction to the target voice device includes:

[0013] If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, and there is a designated reply message corresponding to the device control instruction, a designated device silent instruction is sent to the target voice device, wherein the designated device silent instruction is used to instruct the target voice device to output a designated voice reply message for the voice signal;

[0014] If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, and there is no designated reply message corresponding to the device control instruction, a general device silent instruction is sent to the target voice device, and the general device silent instruction is used to instruct the target voice device to output a general voice reply message for the voice signal.

[0015] In some feasible embodiments, determining the supported instruction table corresponding to the target voice device includes:

[0016] Obtain the device model of the target voice device and the support instruction table corresponding to the device model.

[0017] In some feasible embodiments, it also includes:

[0018] In response to the voice device accessing the management device, obtaining a device category corresponding to the voice device;

[0019] If there is currently no offline voice model corresponding to the device category, the offline voice model corresponding to the device category is obtained from the server.

[0020] In some feasible embodiments, the management device and the voice device are communicated via a local area network that is not connected to the Internet, or a wireless communication connection, or a wired communication connection; wherein the wireless communication connection includes at least one of a Bluetooth communication connection, an infrared communication connection, a near-field communication connection, a Zigbee communication connection, and a Thread communication connection.

[0021] In some feasible embodiments, the device categories include at least one of kitchen appliances, cleaning appliances, personal care appliances, entertainment and multimedia appliances, air conditioning and heating appliances, and health and fitness appliances.

[0022] The embodiment of the present invention further discloses a control device for a voice device, which is applied to a management device, wherein the management device is communicatively connected with at least one voice device, and the management device stores an offline voice model, each of which corresponds to a device category, and the device includes:

[0023] A signal response module, configured to determine, in response to receiving a voice signal sent by a target voice device, a target device category corresponding to the target voice device and a target offline voice model corresponding to the target device category, wherein the voice signal is a signal converted by the target voice device according to voice information input by a user;

[0024] A recognition module, used for inputting the voice signal into the target offline voice model for semantic recognition, and obtaining a device control instruction corresponding to the voice signal;

[0025] A feedback module is used to determine whether the target voice device supports the device control instruction based on the target voice device and the device control instruction, and send a determination result to the target voice device, wherein the determination result is used to indicate whether the target voice device responds to the voice signal or does not respond to the voice signal.

[0026] In some feasible embodiments, the feedback module is specifically used for:

[0027] Determine a support instruction table corresponding to the target voice device, wherein the support instruction table includes control instructions that the target voice device can support;

[0028] If the device control instruction is found in the support instruction table, a device execution instruction is sent to the target voice device, where the device execution instruction is used to instruct the target voice device to perform a device operation corresponding to the device control instruction;

[0029] If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, a device silence instruction is sent to the target voice device. The device silence instruction is used to instruct the target voice device to output a voice reply message for the voice signal. The voice reply message is a message indicating that the target voice device does not perform the device operation.

[0030] In some feasible embodiments, the feedback module is specifically used for:

[0031] If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, and there is a designated reply message corresponding to the device control instruction, a designated device silent instruction is sent to the target voice device, wherein the designated device silent instruction is used to instruct the target voice device to output a designated voice reply message for the voice signal;

[0032] If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, and there is no designated reply message corresponding to the device control instruction, a general device silent instruction is sent to the target voice device, and the general device silent instruction is used to instruct the target voice device to output a general voice reply message for the voice signal.

[0033] In some feasible embodiments, the feedback module is specifically used for:

[0034] Obtain the device model of the target voice device and the support instruction table corresponding to the device model.

[0035] In some feasible embodiments, it also includes:

[0036] A category acquisition module, configured to acquire a device category corresponding to the voice device in response to the voice device accessing the management device;

[0037] The model acquisition module is used to obtain the offline speech model corresponding to the device category from the server if the offline speech model corresponding to the device category does not currently exist.

[0038] In some feasible embodiments, the management device and the voice device are communicated via a local area network that is not connected to the Internet, or a wireless communication connection, or a wired communication connection; wherein the wireless communication connection includes at least one of a Bluetooth communication connection, an infrared communication connection, a near-field communication connection, a Zigbee communication connection, and a Thread communication connection.

[0039] In some feasible embodiments, the device categories include at least one of kitchen appliances, cleaning appliances, personal care appliances, entertainment and multimedia appliances, air conditioning and heating appliances, and health and fitness appliances.

[0040] The embodiment of the present invention further discloses an electronic device, comprising a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other via the communication bus;

[0041] The memory is used to store computer programs;

[0042] The processor is used to implement the method described in the embodiment of the present invention when executing the program stored in the memory.

[0043] The embodiment of the present invention further discloses a computer-readable storage medium having instructions stored thereon, which, when executed by one or more processors, enables the processors to execute the method described in the embodiment of the present invention.

[0044] The embodiments of the present invention include the following advantages:

[0045] In an embodiment of the present invention, it can be applied to a management device, the management device can be connected to at least one voice device in communication, and the management device stores an offline voice model, each offline voice model can correspond to a device category, then in the offline control process of the voice device, the management device can respond to the voice signal sent by the target voice device, determine the target device category corresponding to the target voice device, and the target offline voice model corresponding to the target device category, the voice signal is a signal converted by the target voice device according to the voice information input by the user, and then the voice signal is input into the target offline voice model for semantic recognition, and the device control instruction corresponding to the voice signal is obtained, and then it is judged whether the target voice device supports the device control instruction according to the target voice device and the device control instruction, and the judgment result is sent to the target voice device, and the judgment result is used to indicate whether the target voice device responds to the voice signal or not. Therefore, on the one hand, since the management device stores the offline voice model, the semantic recognition and processing of the voice signal can be performed without relying on the network, which greatly improves the response speed and ensures the immediacy of the control. On the other hand, one device category corresponds to one offline voice model, which not only ensures the compatibility and scalability between the management device and different voice devices, but also improves the pertinence and accuracy of voice recognition, and reduces the limitation of the voice recognition process. BRIEF DESCRIPTION OF THE DRAWINGS

[0046] Figure 1 is a flowchart of a method for controlling a voice device provided in an embodiment of the present invention;

[0047] Figure 2 is a schematic diagram of the architecture of device communication provided in an embodiment of the present invention;

[0048] Figure 3 is a structural block diagram of a control device for a voice device provided in an embodiment of the present invention;

[0049] Figure 4 It is a block diagram of an electronic device provided in an embodiment of the present invention. DETAILED DESCRIPTION

[0050] In order to make the above-mentioned objects, features and advantages of the present invention more obvious and easy to understand, the present invention is further described in detail below with reference to the accompanying drawings and specific embodiments.

[0051] As an example, the offline voice model directly recognizes the intent through voiceprints, and lacks the steps of "speech to text" and "semantic understanding" that can only be supported by online voice. As a result, the same command will not be recognized at all if it is changed to a different sentence structure (generalized expression). For example, "turn on the air conditioner" is a command, and generalized expressions such as "turn on the air conditioner", "turn on the air conditioner", and "turn on the air conditioner" can be recognized as one command like "turn on the air conditioner" through the semantic understanding of online voice; but offline voice does not have semantic understanding and generalization ability, and it is necessary to add entries to each expression into the offline model to support it. Therefore, it is easily restricted by another condition - the offline voice module has limited memory and generally can only support 100-300 entries. Therefore, it can only give priority to supporting particularly typical expressions such as "turn on the air conditioner". It is impossible to take into account less typical expressions such as generalized expressions such as "please help turn on the air conditioner" and fuzzy expressions such as "it's so hot, help me lower the indoor temperature". Otherwise, the entries for a home appliance category can easily reach hundreds of thousands, which is impossible to store in the offline voice module. Based on the above, in the offline control process of home appliances, there are still poor recognition accuracy and many limitations, which makes it impossible for users to effectively control home appliances through voice.

[0052] In this regard, in the present invention, a device management architecture is constructed for voice devices that are not connected to the Internet. The device management architecture may include a server, a management device, and a voice device. The management device may be connected to communicate with at least one voice device, and the management device stores an offline voice model. Each offline voice model may correspond to a device category. In the offline control process of the voice device, the management device may determine the target device category corresponding to the target voice device and the target offline voice model corresponding to the target device category in response to receiving a voice signal sent by the target voice device. The voice signal is a signal converted by the target voice device according to the voice information input by the user, and then the voice signal is input into the target offline voice model for semantic recognition. , obtain the device control instruction corresponding to the voice signal, then judge whether the target voice device supports the device control instruction according to the target voice device and the device control instruction, and send the judgment result to the target voice device. The judgment result is used to indicate whether the target voice device responds to the voice signal or not. Therefore, on the one hand, since the management device stores the offline voice model, the semantic recognition and processing of the voice signal can be performed without relying on the network, which greatly improves the response speed and ensures the immediacy of control. On the other hand, one device category corresponds to one offline voice model, which not only ensures the compatibility and scalability between the management device and different voice devices, but also improves the pertinence and accuracy of voice recognition and reduces the limitations of the voice recognition process.

[0053] Reference Figure 1 , shows a flowchart of a method for controlling a voice device provided in an embodiment of the present invention, which is applied to a management device, wherein the management device is in communication connection with at least one voice device, and the management device stores an offline voice model, each of which corresponds to a device category, and specifically may include the following steps:

[0054] Step 101, in response to receiving a voice signal sent by a target voice device, determining a target device category corresponding to the target voice device and a target offline voice model corresponding to the target device category, wherein the voice signal is a signal converted by the target voice device according to voice information input by a user;

[0055] In an embodiment of the present invention, the management device may be a device connected to the Internet. The management device communicates with the server through the Internet, obtains the corresponding offline voice model from the server, and updates the offline voice model in a timely manner. The voice device may be a device supporting voice control, such as household appliances supporting voice control. Different voice devices may communicate with the management device through a local area network that is not connected to the Internet, a wireless communication connection, or a wired communication connection, so that the management device can manage the voice device.

[0056] It should be noted that, for voice devices, under normal circumstances, they can perform voice recognition by accessing the Internet, and in relevant specific circumstances, when the voice device is not connected to the Internet and the management device is connected to the Internet, the voice device can transmit the corresponding voice signal to the management device, which processes the voice signal, determines the corresponding control instruction, and then returns the control instruction to the voice device, which executes the device operation corresponding to the control instruction. Since the management device stores an offline voice model, it can perform semantic recognition and processing of voice signals without relying on the network, which greatly improves the response speed and ensures the immediacy of control. Optionally, the wireless communication connection between the management device and the voice device can include at least one of a Bluetooth communication connection, an infrared communication connection, a near-field communication connection, a Zigbee communication connection, and a Thread communication connection.

[0057] Among them, Bluetooth can be a short-range wireless communication technology, which is suitable for point-to-point connection between devices. Electrical devices such as wireless headphones, smart speakers, some smart light bulbs and kitchen appliances often use Bluetooth for connection; Zigbee is a low-rate wireless personal area network technology based on the IEEE 802.15.4 standard, which is suitable for low-power, low-data-rate devices such as smart sockets, thermostats, smoke alarms, etc.; Thread is an IPv6-based wireless network protocol designed for smart home devices to provide secure, reliable, and low-power communication; Near Field Communication connection can be NFC (Near Field Communication), which is a short-range high-frequency wireless communication technology that allows contactless point-to-point data transmission between electronic devices. It can be commonly used for mobile payments and device pairing, etc., and the present invention does not limit this.

[0058] In one example, referring to Figure 2 , shows a schematic diagram of the architecture of device communication provided in an embodiment of the present invention. For the management device 210, it can be connected to the server 220 through the Internet, and can be connected to several voice devices 230 through the corresponding local area network. In the offline control process of the voice device, the corresponding network can be configured for the management device first, and each voice device can be connected to the management device. The management device obtains the corresponding offline voice model from the server based on the connected voice device. When the voice device receives the corresponding voice signal, the voice signal can be transmitted to the management device, and the management device processes the voice signal through the offline voice model, and returns the processing result (such as the device control instruction) to the voice device, and the voice device performs the corresponding device operation.

[0059] In some feasible implementations, the management device can obtain the device category corresponding to the voice device in response to the voice device accessing the management device, and then detect whether there is an offline voice model corresponding to the device category locally. If there is no offline voice model corresponding to the device category, the offline voice model corresponding to the device category is obtained from the server; if it exists, there is no need to obtain the corresponding offline voice model from the server. Optionally, voice devices that provide the same or similar functions can be divided into the same device category, and the same device category corresponds to an offline voice model, so that an offline voice model can support all voice entries with existing functions under a category, effectively reducing the content redundancy of the offline voice model and improving the utilization of the storage space of the management device.

[0060] Among them, the device categories of voice devices include at least one of kitchen appliances, cleaning appliances, personal care appliances, entertainment and multimedia appliances, air conditioning and heating appliances, and health and fitness appliances, and the present invention is not limited to this.

[0061] During the offline control process of the voice device, when the user inputs the corresponding voice information to the target voice device, the target voice device can detect the corresponding voice audio, and then perform analog-to-digital conversion on the voice audio, and after the corresponding algorithm preprocessing, transmit the processed voice signal to the management device through the communication connection with the management device. After the management device receives the voice signal sent by the target voice device, it can first determine the target device category corresponding to the target voice device, and then determine the target offline voice model corresponding to the target device category, so as to recognize the voice signal through the target offline voice model and determine the control instructions for the target voice device.

[0062] Step 102, inputting the voice signal into the target offline voice model for semantic recognition to obtain a device control instruction corresponding to the voice signal;

[0063] After the target offline voice model corresponding to the target voice device is determined, the voice signal can be input into the target offline voice model for semantic recognition to obtain the device control instruction corresponding to the voice signal. Thus, by recognizing the voice signal, the user's control intention can be accurately identified. At the same time, since the management device stores the offline voice model, the semantic recognition and processing of the voice signal can be performed without relying on the network, which greatly improves the response speed and ensures the immediacy of control.

[0064] In one example, the management device extracts features from the preprocessed voice signal, and the relevant features may include Mel frequency cepstral coefficients, linear prediction coding, etc., which can represent the acoustic characteristics of the voice signal. Then the management device can input the extracted features into the target offline voice model. The offline voice model can analyze and calculate the input features and identify the semantic content corresponding to the voice signal. Then, according to the identified semantic content, the model generates corresponding device control instructions. These instructions are predefined and correspond to the operation of the device, such as "open", "close", "turn up the volume", etc. After receiving the generated control instruction, the management device verifies whether the target voice device supports the instruction. If supported, the instruction is sent to the target voice device for execution; if not supported, an error prompt may be sent or no operation is performed. Among them, the offline voice model is usually pre-trained, and it contains voice commands and corresponding operation instructions for a specific device category. The model can be a neural network model based on deep learning, such as a convolutional neural network, a recurrent neural network, or a long short-term memory network.

[0065] Step 103, judging whether the target voice device supports the device control instruction according to the target voice device and the device control instruction, and sending a judgment result to the target voice device, wherein the judgment result is used to indicate whether the target voice device responds to the voice signal or does not respond to the voice signal.

[0066] In an embodiment of the present invention, since one device category corresponds to one offline voice model, after the management device recognizes the device control instruction corresponding to the voice signal through the offline voice model, it is also necessary to determine whether the target voice device supports the device control instruction based on the relationship between the target voice device and the device control instruction, and then return the judgment result to the target voice device to indicate whether the target voice device responds to the voice signal or not. Therefore, on the one hand, since the management device stores the offline voice model, it can perform semantic recognition and processing of voice signals without relying on the network, which greatly improves the response speed and ensures the immediacy of control. On the other hand, one device category corresponds to one offline voice model, which not only ensures the compatibility and scalability between the management device and different voice devices, but also improves the pertinence and accuracy of voice recognition and reduces the limitations of the voice recognition process.

[0067] In some feasible implementations, the management device may first determine the support instruction table corresponding to the target voice device, the support instruction table containing control instructions that the target voice device can support, and then compare the identified device control instructions with the instructions in the support instruction table. If the device control instruction is found in the support instruction table, a device execution instruction is sent to the target voice device, and the device execution instruction is used to instruct the target voice device to perform the device operation corresponding to the device control instruction. If the device control instruction is not found in the support instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, a device silent instruction is sent to the target voice device, and the device silent instruction is used to instruct the target voice device to output a voice reply message for the voice signal, and the voice reply message is a message indicating that the target voice device does not perform the device operation.

[0068] It should be noted that a device category may include several different voice devices, and different voice devices may correspond to different device models, and different device models may correspond to different support instruction tables. The management device can obtain the device model of the target voice device and the support instruction table corresponding to the device model, and determine the instructions that the target voice device can support through the support instruction table. For example, for a fan, its support instruction table can be shown in Table 1 below:

[0069]

[0070] Table 1

[0071] In a specific implementation, different feedback modes can be set for the case where the device control instruction is not found in the supported instruction table. If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, and there is a designated reply message corresponding to the device control instruction, a designated device silent instruction is sent to the target voice device, and the designated device silent instruction is used to instruct the target voice device to output a designated voice reply message for the voice signal; if the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, and there is no designated reply message corresponding to the device control instruction, a general device silent instruction is sent to the target voice device, and the general device silent instruction is used to instruct the target voice device to output a general voice reply message for the voice signal. By setting different feedback modes, the management device can provide personalized voice replies according to specific circumstances, so that the user can clearly understand the status or operation results of the device, thereby improving the user's interactive experience, and the management device can adapt to different voice signals and device states and provide corresponding feedback, which enhances the adaptability of the system to different user needs and device environments.

[0072] It should be noted that, in the above examples, for the case of unsupported or mutually exclusive instructions, feedback can be provided in a unified manner or in a differentiated manner, so that based on different feedback methods, the voice device can be more user-friendly in the process of processing voice signals, thereby improving the user experience. For example, when the fan is in silent wind mode, the user inputs voice content to adjust the wind speed, then the specific reply of the fan can be "Currently in silent wind mode, the wind speed cannot be adjusted, please switch to other modes first", the general reply can be "This operation cannot be performed in the current state", etc. The same is true for unsupported functions, the specific reply can be "The device does not support the negative ion function", and the general reply can be "I don't understand what you mean", which is not limited by the present invention.

[0073] It should be noted that the embodiments of the present invention include but are not limited to the above examples. It is understandable that those skilled in the art can also make settings according to actual needs under the guidance of the ideas of the embodiments of the present invention, and the present invention is not limited to this.

[0074] In an embodiment of the present invention, it can be applied to a management device, the management device can be connected to at least one voice device in communication, and the management device stores an offline voice model, each offline voice model can correspond to a device category, then in the offline control process of the voice device, the management device can respond to the voice signal sent by the target voice device, determine the target device category corresponding to the target voice device, and the target offline voice model corresponding to the target device category, the voice signal is a signal converted by the target voice device according to the voice information input by the user, and then the voice signal is input into the target offline voice model for semantic recognition, and the device control instruction corresponding to the voice signal is obtained, and then it is judged whether the target voice device supports the device control instruction according to the target voice device and the device control instruction, and the judgment result is sent to the target voice device, and the judgment result is used to indicate whether the target voice device responds to the voice signal or not. Therefore, on the one hand, since the management device stores the offline voice model, the semantic recognition and processing of the voice signal can be performed without relying on the network, which greatly improves the response speed and ensures the immediacy of the control. On the other hand, one device category corresponds to one offline voice model, which not only ensures the compatibility and scalability between the management device and different voice devices, but also improves the pertinence and accuracy of voice recognition, and reduces the limitation of the voice recognition process.

[0075] In order to enable those skilled in the art to better understand the technical solutions in the embodiments of the present invention, the following examples are used for exemplary description:

[0076] For each category, train an offline voice model with rich entries. Although the built-in voice models of the device are independent of each other, there will be a lot of redundancy for the same category. For example, offline voice air conditioner A supports heating but not fresh air ventilation, while offline air conditioner B supports fresh air ventilation but not heating. The difference between their built-in voice models (mainly because the storage space limits the number of entries) is that one supports heating-related entries and the other supports fresh air-related entries, but their other basic functions are the same. Therefore, the offline voice model used for the home host needs to be universal for one category, that is, it needs to support all the voice entries of the existing functions under the category. Otherwise, if there is an air conditioner A and an air conditioner B at home, the extended model A and extended model B need to be stored in the host. The two models themselves occupy a certain space due to the extended entries, and most of the content of the two extended models is redundant, which is tantamount to wasting the host space. When the host calls the offline voice model to output a command, it looks up the command table corresponding to the requested device model, and returns the supported commands to the requesting device. Unsupported commands are returned to the device through unified or specific unsupported information (then the device will not execute).

[0077] After the device joins the family (directly or through the host), the home host accesses the IoT server when it is connected to the Internet, obtains the extended offline voice model corresponding to the category in the home, and the support instruction table corresponding to the offline voice device model, and saves it locally. When a device's offline extended model and instruction table are downloaded, the host notifies the device to modify a configuration - that is, when connected to the host, the received voice command is forwarded to the host for processing. When the offline voice device receives the voice command, it can first convert the audio analog signal into digital and pre-process it with the algorithm specified by the model, and then transmit the digital signal to the host through the local area network (it may be local WiFi (Wireless Fidelity), it may be Bluetooth, or it may be a wired connection, depending on the protocol between the host and the device).

[0078] The host receives the digital signal, then obtains the category and specific model of the device through the device mac, inputs the digital signal into the extended offline model of the specific category, and obtains the instruction; the instruction is then matched with the supported instruction table of the specific signal. If it is a command supported by the device, it is directly replied to the device for execution. If it is a command not supported by the device, a unified or specific unsupported instruction is replied to the device, and the device does not execute it. (Here is a brief explanation of why the processing of unsupported instructions is divided into "unified" and "specific", because most offline voice devices will have no reply or a unified reply such as "I don't understand what you mean" when encountering unsupported voice terms; some high-end models can provide specific replies to specific requests, such as "Fresh air function is not supported" and "Heating function is not supported". Adapting such models by replying "specific unsupported instructions" can bring a better experience)

[0079] Through the above process, on the one hand, since the management device stores offline voice models, it can perform semantic recognition and processing of voice signals without relying on the network, which greatly improves the response speed and ensures the immediacy of control. On the other hand, one device category corresponds to one offline voice model, which not only ensures the compatibility and scalability between the management device and different voice devices, but also improves the pertinence and accuracy of voice recognition and reduces the limitations of the voice recognition process.

[0080] It should be noted that, for the sake of simplicity, the method embodiments are described as a series of action combinations, but those skilled in the art should be aware that the embodiments of the present invention are not limited by the order of the actions described, because according to the embodiments of the present invention, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions involved are not necessarily required by the embodiments of the present invention.

[0081] Reference Figure 3 , shows a structural block diagram of a control device for a voice device provided in an embodiment of the present invention, which is applied to a management device, wherein the management device is in communication connection with at least one voice device, and the management device stores an offline voice model, each of which corresponds to a device category, and specifically may include the following modules:

[0082] The signal response module 301 is used to determine the target device category corresponding to the target voice device and the target offline voice model corresponding to the target device category in response to receiving the voice signal sent by the target voice device, wherein the voice signal is a signal converted by the target voice device according to the voice information input by the user;

[0083] A recognition module 302, configured to input the speech signal into the target offline speech model for semantic recognition, and obtain a device control instruction corresponding to the speech signal;

[0084] The feedback module 303 is used to determine whether the target voice device supports the device control instruction based on the target voice device and the device control instruction, and send a determination result to the target voice device, wherein the determination result is used to indicate whether the target voice device responds to the voice signal or does not respond to the voice signal.

[0085] In some feasible embodiments, the feedback module 303 is specifically used for:

[0086] Determine a support instruction table corresponding to the target voice device, wherein the support instruction table includes control instructions that the target voice device can support;

[0087] If the device control instruction is found in the support instruction table, a device execution instruction is sent to the target voice device, where the device execution instruction is used to instruct the target voice device to perform a device operation corresponding to the device control instruction;

[0088] If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, a device silence instruction is sent to the target voice device. The device silence instruction is used to instruct the target voice device to output a voice reply message for the voice signal. The voice reply message is a message indicating that the target voice device does not perform the device operation.

[0089] In some feasible embodiments, the feedback module 303 is specifically used for:

[0090] If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, and there is a designated reply message corresponding to the device control instruction, a designated device silent instruction is sent to the target voice device, wherein the designated device silent instruction is used to instruct the target voice device to output a designated voice reply message for the voice signal;

[0091] If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, and there is no designated reply message corresponding to the device control instruction, a general device silent instruction is sent to the target voice device, and the general device silent instruction is used to instruct the target voice device to output a general voice reply message for the voice signal.

[0092] In some feasible embodiments, the feedback module 303 is specifically used for:

[0093] Obtain the device model of the target voice device and the support instruction table corresponding to the device model.

[0094] In some feasible embodiments, it also includes:

[0095] A category acquisition module, configured to acquire a device category corresponding to the voice device in response to the voice device accessing the management device;

[0096] The model acquisition module is used to obtain the offline speech model corresponding to the device category from the server if the offline speech model corresponding to the device category does not currently exist.

[0097] In some feasible embodiments, the management device and the voice device are communicated via a local area network that is not connected to the Internet, or a wireless communication connection, or a wired communication connection; wherein the wireless communication connection includes at least one of a Bluetooth communication connection, an infrared communication connection, a near-field communication connection, a Zigbee communication connection, and a Thread communication connection.

[0098] In some feasible embodiments, the device categories include at least one of kitchen appliances, cleaning appliances, personal care appliances, entertainment and multimedia appliances, air conditioning and heating appliances, and health and fitness appliances.

[0099] As for the device embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the partial description of the method embodiment.

[0100] In addition, an embodiment of the present invention further provides an electronic device, comprising: a processor, a memory, and a computer program stored in the memory and executable on the processor. When the computer program is executed by the processor, the various processes of the control method embodiment of the above-mentioned voice device are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be described here.

[0101] The embodiment of the present invention further provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, each process of the control method of the above-mentioned voice device is implemented, and the same technical effect can be achieved. To avoid repetition, it is not repeated here. The computer-readable storage medium is, for example, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0102] Figure 4 A schematic diagram of the hardware structure of an electronic device for implementing various embodiments of the present invention.

[0103] The electronic device 400 includes but is not limited to: a radio frequency unit 401, a network module 402, an audio output unit 403, an input unit 404, a sensor 405, a display unit 406, a user input unit 407, an interface unit 408, a memory 409, a processor 410, and a power supply 411. Those skilled in the art will appreciate that the electronic device structure involved in the embodiments of the present invention does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown in the figure, or combine certain components, or arrange components differently. In the embodiments of the present invention, the electronic device includes but is not limited to a mobile phone, a tablet computer, a laptop computer, a PDA, a vehicle-mounted terminal, a wearable device, and a pedometer.

[0104] It should be understood that in the embodiment of the present invention, the radio frequency unit 401 can be used for receiving and sending signals during information transmission or communication. Specifically, after receiving downlink data from the base station, it is sent to the processor 410 for processing; in addition, uplink data is sent to the base station. Generally, the radio frequency unit 401 includes but is not limited to an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, etc. In addition, the radio frequency unit 401 can also communicate with the network and other devices through a wireless communication system.

[0105] The electronic device provides users with wireless broadband Internet access through the network module 402, such as helping users to send and receive emails, browse web pages, and access streaming media.

[0106] The audio output unit 403 can convert the audio data received by the RF unit 401 or the network module 402 or stored in the memory 409 into an audio signal and output it as sound. Moreover, the audio output unit 403 can also provide audio output related to a specific function performed by the electronic device 400 (for example, a call signal reception sound, a message reception sound, etc.). The audio output unit 403 includes a speaker, a buzzer, a receiver, etc.

[0107] The input unit 404 is used to receive audio or video signals. The input unit 404 may include a graphics processor (GPU) 4041 and a microphone 4042, and the graphics processor 4041 processes the image data of a static picture or video obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode. The processed image frame can be displayed on the display unit 406. The image frame processed by the graphics processor 4041 can be stored in the memory 409 (or other storage medium) or sent via the radio frequency unit 401 or the network module 402. The microphone 4042 can receive sound and can process such sound into audio data. The processed audio data can be converted into a format output that can be sent to a mobile communication base station via the radio frequency unit 401 in the case of a telephone call mode.

[0108] The electronic device 400 also includes at least one sensor 405, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor includes an ambient light sensor and a proximity sensor, wherein the ambient light sensor can adjust the brightness of the display panel 4061 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 4061 and / or the backlight when the electronic device 400 is moved to the ear. As a type of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in each direction (generally three axes), and can detect the magnitude and direction of gravity when stationary, which can be used to identify the posture of the electronic device (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; the sensor 405 can also include a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, etc., which will not be repeated here.

[0109] The display unit 406 is used to display information input by the user or information provided to the user. The display unit 406 may include a display panel 4061, which may be configured in the form of a liquid crystal display (LCD), an organic light-emitting diode (OLED), or the like.

[0110] The user input unit 407 can be used to receive input digital or character information, and to generate key signal input related to user settings and function control of the electronic device. Specifically, the user input unit 407 includes a touch panel 4071 and other input devices 4072. The touch panel 4071, also known as a touch screen, can collect the user's touch operation on or near it (such as the user's operation on the touch panel 4071 or near the touch panel 4071 using any suitable object or accessory such as a finger, stylus, etc.). The touch panel 4071 may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the contact point coordinates, and then sends it to the processor 410, receives the command sent by the processor 410 and executes it. In addition, the touch panel 4071 can be implemented using various types such as resistive, capacitive, infrared and surface acoustic waves. In addition to the touch panel 4071, the user input unit 407 may also include other input devices 4072. Specifically, other input devices 4072 may include but are not limited to a physical keyboard, function keys (such as volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail here.

[0111] Further, the touch panel 4071 may be covered on the display panel 4061. When the touch panel 4071 detects a touch operation on or near it, it is transmitted to the processor 410 to determine the type of the touch event, and then the processor 410 provides a corresponding visual output on the display panel 4061 according to the type of the touch event. It can be understood that in one embodiment, the touch panel 4071 and the display panel 4061 are used as two independent components to implement the input and output functions of the electronic device, but in some embodiments, the touch panel 4071 and the display panel 4061 can be integrated to implement the input and output functions of the electronic device, which is not limited here.

[0112] The interface unit 408 is an interface for connecting an external device to the electronic device 400. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device with an identification module, an audio input / output (I / O) port, a video I / O port, a headphone port, etc. The interface unit 408 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic device 400 or may be used to transmit data between the electronic device 400 and an external device.

[0113] The memory 409 can be used to store software programs and various data. The memory 409 can mainly include a program storage area and a data storage area, wherein the program storage area can store an operating system, at least one application required for a function (such as a sound playback function, an image playback function, etc.), etc.; the data storage area can store data created according to the use of the mobile phone (such as audio data, a phone book, etc.), etc. In addition, the memory 409 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage devices.

[0114] The processor 410 is the control center of the electronic device. It uses various interfaces and lines to connect various parts of the entire electronic device. It executes various functions of the electronic device and processes data by running or executing software programs and / or modules stored in the memory 409, and calling data stored in the memory 409, so as to monitor the electronic device as a whole. The processor 410 may include one or more processing units; preferably, the processor 410 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communications. It is understandable that the above-mentioned modem processor may not be integrated into the processor 410.

[0115] The electronic device 400 may also include a power supply 411 (such as a battery) for supplying power to each component. Preferably, the power supply 411 may be logically connected to the processor 410 through a power management system, thereby implementing functions such as charging, discharging, and power consumption management through the power management system.

[0116] In addition, the electronic device 400 includes some functional modules not shown, which will not be described in detail here.

[0117] It should be noted that, in this article, the terms "include", "comprises" or any other variations thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, an element defined by the sentence "comprises a ..." does not exclude the existence of other identical elements in the process, method, article or device including the element.

[0118] Through the description of the above implementation methods, those skilled in the art can clearly understand that the above-mentioned embodiment methods can be implemented by means of software plus a necessary general hardware platform, and of course by hardware, but in many cases the former is a better implementation method. Based on such an understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product, which is stored in a storage medium (such as ROM / RAM, a magnetic disk, or an optical disk), and includes a number of instructions for enabling a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in each embodiment of the present invention.

[0119] The embodiments of the present invention are described above in conjunction with the accompanying drawings, but the present invention is not limited to the above-mentioned specific implementation modes, which are merely illustrative rather than restrictive. Under the guidance of the present invention, ordinary technicians in this field can also make many forms without departing from the scope of protection of the present invention and the claims, all of which are within the protection of the present invention.

[0120] Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed in the embodiments of the present invention can be implemented in electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of the present invention.

[0121] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the systems, devices and units described above can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0122] In the embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the units is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0123] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0124] In addition, each functional unit in each embodiment of the present invention may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0125] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: various media that can store program codes, such as USB flash drives, mobile hard disks, ROM, RAM, magnetic disks, or optical disks.

[0126] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention, which should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention should be based on the protection scope of the claims.

Claims

1. A method for controlling a voice device, characterized in that: Applied to a management device, the management device is in communication connection with at least one voice device, and the management device stores an offline voice model, each of the offline voice models corresponds to a device category, the method includes: In response to receiving a voice signal sent by a target voice device, determining a target device category corresponding to the target voice device and a target offline voice model corresponding to the target device category, wherein the voice signal is a signal obtained by the target voice device according to voice information input by a user; Inputting the speech signal into the target offline speech model for semantic recognition to obtain a device control instruction corresponding to the speech signal; Whether the target voice device supports the device control instruction is determined based on the target voice device and the device control instruction, and a determination result is sent to the target voice device, wherein the determination result is used to indicate whether the target voice device responds to the voice signal or not.

2. The method according to claim 1, characterized in that The determining, according to the target voice device and the device control instruction, whether the target voice device supports the device control instruction, and sending the determination result to the target voice device, comprises: Determine a support instruction table corresponding to the target voice device, wherein the support instruction table includes control instructions that the target voice device can support; If the device control instruction is found in the support instruction table, a device execution instruction is sent to the target voice device, where the device execution instruction is used to instruct the target voice device to perform a device operation corresponding to the device control instruction; If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, a device silence instruction is sent to the target voice device. The device silence instruction is used to instruct the target voice device to output a voice reply message for the voice signal. The voice reply message is a message indicating that the target voice device does not perform the device operation.

3. The method according to claim 2, characterized in that If the device control instruction is not found in the support instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, sending a device silent instruction to the target voice device includes: If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, and there is a designated reply message corresponding to the device control instruction, a designated device silent instruction is sent to the target voice device, wherein the designated device silent instruction is used to instruct the target voice device to output a designated voice reply message for the voice signal; If the device control instruction is not found in the supported instruction table, or the device control instruction is mutually exclusive with the current device operation of the target voice device, and there is no designated reply message corresponding to the device control instruction, a general device silent instruction is sent to the target voice device, and the general device silent instruction is used to instruct the target voice device to output a general voice reply message for the voice signal.

4. The method according to claim 2 or 3, characterized in that: The step of determining a supported instruction table corresponding to the target voice device includes: Obtain the device model of the target voice device and the support instruction table corresponding to the device model.

5. The method according to claim 1, characterized in that Also includes: In response to the voice device accessing the management device, obtaining a device category corresponding to the voice device; If there is currently no offline voice model corresponding to the device category, the offline voice model corresponding to the device category is obtained from the server.

6. The method according to claim 1, characterized in that The management device and the voice device are communicated via a local area network that is not connected to the Internet, or a wireless communication connection, or a wired communication connection; wherein the wireless communication connection includes at least one of a Bluetooth communication connection, an infrared communication connection, a near-field communication connection, a Zigbee communication connection, and a Thread communication connection.

7. The method according to claim 1, characterized in that The equipment categories include at least one of kitchen appliances, cleaning appliances, personal care appliances, entertainment and multimedia appliances, air conditioning and heating appliances, and health and fitness appliances.

8. A control device for a voice device, characterized in that: Applied to a management device, the management device is connected to at least one voice device in communication, and the management device stores an offline voice model, each of which corresponds to a device category, and the device includes: A signal response module, configured to determine, in response to receiving a voice signal sent by a target voice device, a target device category corresponding to the target voice device and a target offline voice model corresponding to the target device category, wherein the voice signal is a signal converted by the target voice device according to voice information input by a user; A recognition module, used for inputting the voice signal into the target offline voice model for semantic recognition, and obtaining a device control instruction corresponding to the voice signal; A feedback module is used to determine whether the target voice device supports the device control instruction based on the target voice device and the device control instruction, and send a determination result to the target voice device, wherein the determination result is used to indicate whether the target voice device responds to the voice signal or does not respond to the voice signal.

9. An electronic device, characterized in that: It includes a processor, a communication interface, a memory and a communication bus, wherein the processor, the communication interface and the memory communicate with each other through the communication bus; The memory is used to store computer programs; The processor is used to implement the method according to any one of claims 1 to 7 when executing the program stored in the memory.

10. A computer-readable storage medium having instructions stored thereon, which, when executed by one or more processors, cause the processors to perform the method according to any one of claims 1 to 7.

Citation Information

Cited By

  • Voice control method and chip system

    CN119580717A

  • Device wakeup method and system, electronic device and storage medium

    CN119649810A