Voice control system and method for household appliances

Abstract

The invention discloses a household electrical appliance voice control system and method, and belongs to the technical field of household electrical appliance control, and the system comprises a voice collection module which is used for carrying out the real-time monitoring and capturing of the household electrical appliance control voice of a user, and determining the real-time data of the household electrical appliance control voice; the voice processing module is used for processing the household appliance product control voice real-time data and determining household appliance product control voice feature data; the voice recognition module is used for comparing and recognizing the household appliance product control voice feature data and determining household appliance product voice recognition information; and the voice control module is used for controlling the household electrical appliance product to enable the household electrical appliance product to execute corresponding actions. The problems that an existing household appliance cannot be effectively controlled based on voice, so that the household appliance is inconvenient to use, and the use effect of the household appliance is poor are solved. According to the invention, the household electrical appliance can be effectively controlled based on voice, so that the household electrical appliance is convenient to use, and the use effect of the household electrical appliance can be improved.

Description

Technical Field

[0001] The present invention relates to the technical field of household appliance control, and in particular to a household appliance voice control system and method. Background Art

[0002] Currently, household appliances on the market, such as televisions, air conditioners, refrigerators, etc., are usually equipped with remote controls and / or touch screen operating systems; however, in these traditional operating methods, it is often necessary to press multiple buttons or slide gestures, which brings high learning costs and operating burdens to users; especially at night, in low light or with wet hands, using traditional remote controls to operate household appliances may cause great trouble.

[0003] The Chinese patent application document with publication number CN113259921B discloses a home appliance product, in which the communication module integrates a near field communication NFC chip, an NFC antenna, a wireless fidelity Wi-Fi chip and a Wi-Fi antenna, which is equivalent to configuring the Wi-Fi chip with NFC function. The Wi-Fi chip can directly obtain the network configuration information from the NFC chip, instead of the home appliance control module transmitting the network configuration information received by NFC to the Wi-Fi chip, thereby improving the efficiency and reliability of the network configuration information transmission; however, the patent has the following defects:

[0004] Existing home appliances cannot be effectively controlled based on voice, which makes the home appliances inconvenient to use and the use effect of the home appliances poor. Summary of the invention

[0005] The purpose of the present invention is to provide a voice control system and method for household appliances, which can enable household appliances to be effectively controlled based on voice, make the household appliances convenient to use, improve the use effect of the household appliances, and solve the problems raised in the above-mentioned background technology.

[0006] To achieve the above object, the present invention provides the following technical solutions:

[0007] A voice control system for household appliances, comprising:

[0008] The voice collection module is used to monitor and capture the home appliance control voice output by the user in real time, and determine the real-time data of the home appliance control voice output by the user;

[0009] A voice processing module is used to process the real-time data of the home appliance control voice output by the user and determine the characteristic data of the home appliance control voice;

[0010] A speech recognition module, which is used to compare and recognize the speech feature data of the home appliance control speech based on the home appliance control speech standard data, and determine the speech recognition information of the home appliance;

[0011] The voice control module is used to match the voice recognition information of the home appliance with the voice control command of the home appliance, determine the voice control command of the home appliance, control the home appliance, and make the home appliance perform corresponding actions.

[0012] Preferably, the voice collection module includes:

[0013] A voice monitoring unit, used to monitor the home appliance control voice output by the user in real time;

[0014] Install voice monitors at different locations in the room, and monitor the home appliance control voice output by the user in real time based on the voice monitor to determine whether there is abnormal sound in the room and whether the user outputs the home appliance control voice;

[0015] A voice capture unit, used to capture the home appliance control voice output by the user in real time;

[0016] When it is detected that the user outputs the home appliance control voice, the voice capture unit is awakened, and the home appliance control voice output by the user is captured in real time based on the voice capture unit to determine the real-time data of the home appliance control voice output by the user.

[0017] Preferably, the voice collection module further includes:

[0018] The first moment information extraction module is used to extract the voice collection moment of the user outputting the home appliance control voice monitored in real time;

[0019] A second moment information extraction module is used to extract the wake-up moment of the voice capture unit corresponding to each home appliance control voice output by the user;

[0020] A wake-up response duration acquisition module, used to acquire the wake-up response duration of the voice capture unit by using the voice collection moment of the user outputting the home appliance control voice and the wake-up moment of the voice capture unit;

[0021] A volume intensity acquisition module is used to extract the volume intensity of the user's output voice control of home appliances;

[0022] A wake-up response evaluation coefficient acquisition module, used to acquire a wake-up response evaluation coefficient according to the volume intensity of the home appliance control voice output by the user and the wake-up response duration of the voice capture unit corresponding to each home appliance control voice output by the user;

[0023] The awakening response evaluation coefficient is obtained by the following formula:

[0024]

[0025] Where C represents the awakening response evaluation coefficient; Vmax Indicates the maximum volume intensity of the user's output of home appliance control voice; T m Indicates the wake-up response duration corresponding to the maximum volume intensity of the user's output voice control voice for home appliances; T c Indicates the preset wake-up response time reference value; T max Indicates the maximum wake-up response duration of the voice capture unit; V m represents the volume intensity corresponding to the maximum wake-up response duration of the voice capture unit; n represents the number of home appliance control voices output by the user; T i V represents the wake-up response duration of the voice capture unit corresponding to the i-th home appliance control voice output by the user; i Indicates the volume intensity corresponding to the i-th home appliance control voice output by the user;

[0026] A first comparison module, configured to compare the wake-up response evaluation coefficient with a preset coefficient threshold;

[0027] The quality determination module is used to determine the operation quality of the voice capture unit when the wake-up response evaluation coefficient is lower than a preset coefficient threshold.

[0028] Preferably, the quality determination module includes:

[0029] An operating parameter extraction module, used to extract operating parameters of the voice capture unit, wherein the operating parameters of the voice capture unit include a noise suppression rate, an echo cancellation rate, and a captured audio loss rate;

[0030] An operation quality evaluation parameter acquisition module, used to obtain an operation quality evaluation parameter of a voice capture unit by using the noise suppression rate, echo cancellation rate and captured audio loss rate in combination with a volume intensity change rate of the captured home appliance control voice;

[0031] The operation quality evaluation parameter is obtained by the following formula:

[0032]

[0033] Where Q represents the operation quality evaluation parameter; m represents the number of home appliance control voices captured by the voice capture unit; V mi V represents the volume intensity variation of the home appliance control voice captured for the i-th time; c Indicates the preset volume intensity reference value; M i N represents the audio loss rate of the i-th captured home appliance control voice; i and E i They represent the noise suppression rate and echo cancellation rate of the i-th captured home appliance control voice respectively; V bIndicates the volume intensity corresponding to the maximum value of the captured audio loss rate; M max Indicates the maximum value of the captured audio loss rate;

[0034] A second comparison module, used for comparing the operation quality evaluation parameter with a preset evaluation parameter threshold;

[0035] The abnormality determination and alarm module is used to determine that the voice capture unit is operating abnormally and issue an abnormality alarm when the operation quality evaluation parameter is lower than a preset evaluation parameter threshold.

[0036] Preferably, the speech processing module comprises:

[0037] A data cleaning unit, used for cleaning the real-time data of the home appliance control voice output by the user;

[0038] Obtain real-time data of home appliance control voice output by users;

[0039] Clean the real-time data of home appliance control voice output by users;

[0040] Remove inconsistent data, invalid data and missing data from the real-time data of home appliance control voice output by the user;

[0041] Determine the real-time home appliance product control voice data useful for the home appliance product voice control;

[0042] A feature extraction unit, used to extract features from real-time voice data of the cleaning home appliance control product;

[0043] Acquire real-time data of home appliance control voice that is useful for home appliance voice control after cleaning;

[0044] Extract features from real-time data of home appliance control speech that is useful for home appliance voice control;

[0045] Extract features that reflect voice control of home appliances;

[0046] Determine the voice feature data for controlling home appliances.

[0047] Preferably, the speech recognition module comprises:

[0048] Distributed database for storing home appliance control voice standard data;

[0049] According to the voice control requirements of home appliances, standard voice control data of home appliances are pre-set, and the pre-set standard voice control data of home appliances are stored for backup;

[0050] There are a plurality of home appliance product control voice standard data, and the plurality of home appliance product control voice standard data are respectively used to control different actions of the home appliance product;

[0051] An index calling unit, used for indexing and calling home appliance control voice standard data;

[0052] According to the requirements of the home appliance voice control, the plurality of home appliance control voice standard data stored are indexed one by one, and the home appliance control voice standard data matching the home appliance control voice feature data is called;

[0053] A comparison and recognition unit, used for comparing and recognizing the characteristic data of the control voice of the home appliance product;

[0054] Obtain standard data on voice control for home appliances;

[0055] Based on the home appliance product control voice standard data, the home appliance product control voice feature data is compared and identified to determine the home appliance product voice recognition information.

[0056] Preferably, based on the home appliance product control voice standard data, the home appliance product control voice feature data is compared and identified, and the following operations are performed:

[0057] Indexing the plurality of home appliance control voice standard data one by one, and comparing and identifying the indexed home appliance control voice standard data with the home appliance control voice feature data;

[0058] Wherein, if the indexed home appliance product control voice standard data matches the home appliance product control voice feature data, the indexed home appliance product control voice standard data is called, that is, the indexed home appliance product control voice standard data is the home appliance product control intention output by the user, and then the home appliance product voice recognition information is determined;

[0059] If the indexed home appliance product control voice standard data does not match the home appliance product control voice feature data, the indexed home appliance product control voice standard data is not called, that is, the indexed home appliance product control voice standard data is not the home appliance product control intention output by the user;

[0060] When the indexed home appliance product control voice standard data is not the home appliance product control intention output by the user, the next home appliance product control voice standard data is indexed in sequence, and the next home appliance product control voice standard data indexed in sequence is compared and identified with the home appliance product control voice feature data until the next home appliance product control voice standard data indexed in sequence matches the home appliance product control voice feature data, then the next home appliance product control voice standard data indexed in sequence is called, that is, the next home appliance product control voice standard data indexed in sequence is the home appliance product control intention output by the user, and the home appliance product voice recognition information is determined.

[0061] Preferably, the voice control module includes:

[0062] A command matching unit, used to match voice control commands for home appliances;

[0063] Obtain voice recognition information of home appliances;

[0064] Matching home appliance product voice recognition information with home appliance product voice control commands;

[0065] A home appliance product voice control instruction corresponding to the home appliance product voice recognition information is determined.

[0066] Preferably, the voice control module further includes:

[0067] The command control unit is used to control the home appliance so that the home appliance performs corresponding actions;

[0068] Acquire a home appliance product voice control instruction corresponding to the home appliance product voice recognition information;

[0069] The home appliance voice control command is sent to the home appliance controller. After receiving the home appliance voice control command, the home appliance controller outputs a corresponding control signal to control the home appliance so that the home appliance performs a corresponding action.

[0070] According to another aspect of the present invention, a method for voice control of a household appliance is provided, which is implemented based on the above-mentioned voice control system of the household appliance, and comprises the following steps:

[0071] S1: Real-time monitoring of the home appliance control voice output by the user is performed through the voice collection module. When the home appliance control voice output by the user is detected, the home appliance control voice output by the user is captured in real time to determine the real-time data of the home appliance control voice output by the user;

[0072] S2: cleaning the real-time home appliance control voice data output by the user through the voice processing module, determining the real-time home appliance control voice data useful for the home appliance voice control, extracting features of the real-time home appliance control voice data useful for the home appliance voice control, and determining the home appliance control voice feature data;

[0073] S3: comparing and identifying the plurality of stored home appliance control voice standard data with the home appliance control voice feature data through a voice recognition module, calling the home appliance control voice standard data matching the home appliance control voice feature data, and determining the home appliance voice recognition information;

[0074] S4: Matching the home appliance voice recognition information with the home appliance voice control command through the voice control module, determining the home appliance voice control command corresponding to the home appliance voice recognition information, and controlling the home appliance based on the home appliance voice control command so that the home appliance performs a corresponding action.

[0075] Compared with the prior art, the present invention has the following beneficial effects:

[0076] The present invention determines the real-time data of the home appliance control voice output by the user by real-time monitoring and capturing of the home appliance control voice output by the user, determines the feature data of the home appliance control voice by processing the real-time data of the home appliance control voice output by the user, determines the home appliance control voice by comparing and identifying a plurality of stored home appliance control voice standard data with the home appliance control voice feature data, calls the home appliance control voice standard data matching the home appliance control voice feature data, determines the home appliance voice recognition information by matching the home appliance voice recognition information with the home appliance voice control instruction, determines the home appliance voice control instruction corresponding to the home appliance voice recognition information, controls the home appliance based on the home appliance voice control instruction, and makes the home appliance execute corresponding actions, so that the home appliance can be effectively controlled based on voice, makes the home appliance convenient to use, and improves the use effect of the home appliance. BRIEF DESCRIPTION OF THE DRAWINGS

[0077] Figure 1 It is a structural framework diagram of the home appliance voice control system of the present invention;

[0078] Figure 2 The present invention is a flowchart of the operation of the method for voice control of household appliances. DETAILED DESCRIPTION

[0079] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0080] In order to solve the problem that existing home appliances cannot be effectively controlled based on voice, resulting in inconvenience in using home appliances and poor use effects of home appliances, please refer to Figure 1-Figure 2 , this embodiment provides the following technical solutions:

[0081] A voice control system for household appliances, comprising:

[0082] The voice collection module is used to monitor and capture the home appliance control voice output by the user in real time, and determine the real-time data of the home appliance control voice output by the user;

[0083] In this embodiment, the voice collection module includes:

[0084] A voice monitoring unit, used to monitor the home appliance control voice output by the user in real time;

[0085] Install voice monitors at different locations in the room, and monitor the home appliance control voice output by the user in real time based on the voice monitor to determine whether there is abnormal sound in the room and whether the user outputs the home appliance control voice;

[0086] It should be noted that the voice monitor is used to monitor the home appliance control voice output by the user in real time. When the user is detected outputting the home appliance control voice, the voice capture unit is awakened. When the user is not detected outputting the home appliance control voice, the voice capture unit is not awakened. The voice capture unit will only start working when the user is detected outputting the home appliance control voice, which can save energy and avoid energy waste.

[0087] A voice capture unit, used to capture the home appliance control voice output by the user in real time;

[0088] When it is detected that the user outputs the home appliance control voice, the voice capture unit is awakened, and the home appliance control voice output by the user is captured in real time based on the voice capture unit to determine the real-time data of the home appliance control voice output by the user.

[0089] A voice processing module is used to process the real-time data of the home appliance control voice output by the user and determine the characteristic data of the home appliance control voice;

[0090] Specifically, the voice collection module further includes:

[0091] The first moment information extraction module is used to extract the voice collection moment of the user outputting the home appliance control voice monitored in real time;

[0092] A second moment information extraction module is used to extract the wake-up moment of the voice capture unit corresponding to each home appliance control voice output by the user;

[0093] A wake-up response duration acquisition module, used to acquire the wake-up response duration of the voice capture unit by using the voice collection moment of the user outputting the home appliance control voice and the wake-up moment of the voice capture unit;

[0094] A volume intensity acquisition module is used to extract the volume intensity of the user's output voice control of home appliances;

[0095] A wake-up response evaluation coefficient acquisition module, used to acquire a wake-up response evaluation coefficient according to the volume intensity of the home appliance control voice output by the user and the wake-up response duration of the voice capture unit corresponding to each home appliance control voice output by the user;

[0096] The awakening response evaluation coefficient is obtained by the following formula:

[0097]

[0098] Where C represents the awakening response evaluation coefficient; V max Indicates the maximum volume intensity of the user's output of home appliance control voice; T m Indicates the wake-up response duration corresponding to the maximum volume intensity of the user's output voice control voice for home appliances; T c Indicates the preset wake-up response time reference value; T max Indicates the maximum wake-up response duration of the voice capture unit; V m represents the volume intensity corresponding to the maximum wake-up response duration of the voice capture unit; n represents the number of home appliance control voices output by the user; T i V represents the wake-up response duration of the voice capture unit corresponding to the i-th home appliance control voice output by the user; i Indicates the volume intensity corresponding to the i-th home appliance control voice output by the user;

[0099] A first comparison module, configured to compare the wake-up response evaluation coefficient with a preset coefficient threshold;

[0100] The quality determination module is used to determine the operation quality of the voice capture unit when the wake-up response evaluation coefficient is lower than a preset coefficient threshold.

[0101] The technical effect of the above technical solution is: by extracting the voice collection time of the user outputting the home appliance control voice and the wake-up time of the voice capture unit, the wake-up response time of the voice capture unit can be accurately calculated. This indicator directly reflects the response speed of the voice capture unit to the user's voice input and is one of the important indicators for evaluating its performance. The volume intensity is introduced as another evaluation dimension, and combined with the wake-up response time, the wake-up response evaluation coefficient C is calculated by a complex formula. This method not only considers the response speed, but also considers the impact of the volume of the user's voice on the wake-up effect, so as to more comprehensively evaluate the performance of the voice capture unit. The parameters in the above formula and the number n of home appliance control voices output by the user enable the evaluation coefficient C to dynamically adapt to different voice input situations. This means that whether the user speaks loudly or softly, or in different environmental noises, the system can give a relatively accurate performance evaluation. By setting a preset coefficient threshold and comparing the wake-up response evaluation coefficient C with the threshold, the operation quality of the voice capture unit can be automatically determined. This method not only improves the accuracy of the determination, but also greatly simplifies the operation process, so that the system can respond and solve problems more quickly. By accurately evaluating the performance of the voice capture unit and promptly identifying and addressing potential issues, users can be ensured to have a better experience when using voice to control home appliances.

[0102] In summary, the technical effects of the above technical solutions in terms of performance indicators are mainly reflected in accurately evaluating the response performance of the voice capture unit, comprehensively considering the volume intensity and response time, dynamically adapting to different voice input situations, realizing automated quality judgment, and optimizing user experience. These effects jointly improve the overall performance and user experience of the system.

[0103] Specifically, the quality determination module includes:

[0104] An operating parameter extraction module, used to extract operating parameters of the voice capture unit, wherein the operating parameters of the voice capture unit include a noise suppression rate, an echo cancellation rate, and a captured audio loss rate;

[0105] An operation quality evaluation parameter acquisition module, used to obtain an operation quality evaluation parameter of a voice capture unit by using the noise suppression rate, echo cancellation rate and captured audio loss rate in combination with a volume intensity change rate of the captured home appliance control voice;

[0106] The operation quality evaluation parameter is obtained by the following formula:

[0107]

[0108] Where Q represents the operation quality evaluation parameter; m represents the number of home appliance control voices captured by the voice capture unit; V mi V represents the volume intensity variation of the home appliance control voice captured for the i-th time; c Indicates the preset volume intensity reference value; M i N represents the audio loss rate of the i-th captured home appliance control voice; i and E i They represent the noise suppression rate and echo cancellation rate of the i-th captured home appliance control voice respectively; V b Indicates the volume intensity corresponding to the maximum value of the captured audio loss rate; M max Indicates the maximum value of the captured audio loss rate;

[0109] A second comparison module, used for comparing the operation quality evaluation parameter with a preset evaluation parameter threshold;

[0110] The abnormality determination and alarm module is used to determine that the voice capture unit is operating abnormally and issue an abnormality alarm when the operation quality evaluation parameter is lower than a preset evaluation parameter threshold.

[0111] The technical effect of the above technical solution is: by extracting multiple operating parameters of the voice capture unit (noise suppression rate, echo cancellation rate and captured audio loss rate), and combining the volume intensity change rate of the captured home appliance control voice, the operation quality of the voice capture unit can be comprehensively and accurately evaluated. This evaluation method not only takes into account the basic performance indicators of the voice capture unit, but also takes into account the dynamic changes in actual use, making the evaluation result more reliable. The multiple variables in the formula and the capture quantity m enable the operation quality evaluation parameter Q to dynamically adapt to different voice capture situations. This shows that whether the voice capture unit is working in a high noise environment or a low noise environment, the system can give a very accurate performance evaluation. By setting a preset evaluation parameter threshold and comparing the operation quality evaluation parameter Q with the threshold, the operation abnormality of the voice capture unit can be discovered in time. This highly sensitive abnormality detection mechanism helps to quickly locate the problem and take corresponding measures to avoid possible failures or erroneous operations. When the operation quality evaluation parameter Q is lower than the preset evaluation parameter threshold, the abnormality judgment and alarm module will determine that the voice capture unit is operating abnormally and issue an abnormal alarm. At the same time, because multiple operating parameters and volume intensity change rates are taken into account during the evaluation process, detailed abnormal information can be provided to help technicians quickly diagnose the cause of the problem. By accurately evaluating the operating quality of the voice capture unit and promptly discovering and addressing potential problems, users can be ensured to have a better experience when using home appliances to control voice. At the same time, this also helps to improve the performance and stability of the entire system and reduce system crashes or misoperations caused by voice capture unit failures.

[0112] In summary, the technical effects of the above technical solutions in terms of performance indicators are mainly reflected in the comprehensive evaluation of the operation quality of the voice capture unit, strong dynamic adaptability, high sensitivity, provision of detailed abnormal information, and optimization of user experience and system performance. These effects jointly improve the overall performance and user experience of the system, and also provide technicians with more convenient and efficient fault diagnosis methods.

[0113] In this embodiment, the speech processing module includes:

[0114] A data cleaning unit, used for cleaning the real-time data of the home appliance control voice output by the user;

[0115] Obtain real-time data of home appliance control voice output by users;

[0116] Clean the real-time data of home appliance control voice output by users;

[0117] Remove inconsistent data, invalid data and missing data from the real-time data of home appliance control voice output by the user;

[0118] Determine the real-time home appliance product control voice data useful for the home appliance product voice control;

[0119] Specifically, the real-time data of the home appliance control voice output by the user is cleaned, including:

[0120] Conduct consistency checks on the real-time data of home appliance control voice output by users to check whether the real-time data of home appliance control voice output by users meets the requirements, and remove inconsistent data that exceeds the normal range, is logically unreasonable, or contradictory in the real-time data of home appliance control voice output by users;

[0121] Processing invalid values ​​and missing values ​​of the real-time data of the home appliance product control voice output by the user, checking whether the real-time data of the home appliance product control voice output by the user contains invalid values ​​and missing values, and removing invalid values ​​and missing values ​​that are useless for the home appliance product voice control in the real-time data of the home appliance product control voice output by the user;

[0122] A feature extraction unit, used to extract features from real-time voice data of the cleaning home appliance control product;

[0123] Acquire real-time data of home appliance control voice that is useful for home appliance voice control after cleaning;

[0124] Extract features from real-time data of home appliance control speech that is useful for home appliance voice control;

[0125] Extract features that reflect voice control of home appliances;

[0126] Determine the voice feature data for controlling home appliances.

[0127] A speech recognition module, which is used to compare and recognize the speech feature data of the home appliance control speech based on the home appliance control speech standard data, and determine the speech recognition information of the home appliance;

[0128] In this embodiment, the speech recognition module includes:

[0129] Distributed database for storing home appliance control voice standard data;

[0130] According to the voice control requirements of home appliances, standard voice control data of home appliances are pre-set, and the pre-set standard voice control data of home appliances are stored for backup;

[0131] There are a plurality of home appliance product control voice standard data, and the plurality of home appliance product control voice standard data are respectively used to control different actions of the home appliance product;

[0132] An index calling unit, used for indexing and calling home appliance control voice standard data;

[0133] According to the requirements of the home appliance voice control, the plurality of home appliance control voice standard data stored are indexed one by one, and the home appliance control voice standard data matching the home appliance control voice feature data is called;

[0134] A comparison and recognition unit, used for comparing and recognizing the characteristic data of the control voice of the home appliance product;

[0135] Obtain standard data on voice control for home appliances;

[0136] Based on the home appliance product control voice standard data, the home appliance product control voice feature data is compared and identified to determine the home appliance product voice recognition information.

[0137] Specifically, based on the home appliance product control voice standard data, the home appliance product control voice feature data is compared and identified, and the following operations are performed:

[0138] Indexing the plurality of home appliance control voice standard data one by one, and comparing and identifying the indexed home appliance control voice standard data with the home appliance control voice feature data;

[0139] Wherein, if the indexed home appliance product control voice standard data matches the home appliance product control voice feature data, the indexed home appliance product control voice standard data is called, that is, the indexed home appliance product control voice standard data is the home appliance product control intention output by the user, and then the home appliance product voice recognition information is determined;

[0140] If the indexed home appliance product control voice standard data does not match the home appliance product control voice feature data, the indexed home appliance product control voice standard data is not called, that is, the indexed home appliance product control voice standard data is not the home appliance product control intention output by the user;

[0141] When the indexed home appliance product control voice standard data is not the home appliance product control intention output by the user, the next home appliance product control voice standard data is indexed in sequence, and the next home appliance product control voice standard data indexed in sequence is compared and identified with the home appliance product control voice feature data until the next home appliance product control voice standard data indexed in sequence matches the home appliance product control voice feature data, then the next home appliance product control voice standard data indexed in sequence is called, that is, the next home appliance product control voice standard data indexed in sequence is the home appliance product control intention output by the user, and the home appliance product voice recognition information is determined.

[0142] The voice control module is used to match the voice recognition information of the home appliance with the voice control command of the home appliance, determine the voice control command of the home appliance, control the home appliance, and make the home appliance perform corresponding actions.

[0143] In this embodiment, the voice control module includes:

[0144] A command matching unit, used to match voice control commands for home appliances;

[0145] Obtain voice recognition information of home appliances;

[0146] Matching home appliance product voice recognition information with home appliance product voice control commands;

[0147] A home appliance product voice control instruction corresponding to the home appliance product voice recognition information is determined.

[0148] In this embodiment, the voice control module further includes:

[0149] The command control unit is used to control the home appliance so that the home appliance performs corresponding actions;

[0150] Acquire a home appliance product voice control instruction corresponding to the home appliance product voice recognition information;

[0151] The voice control command of the home appliance is sent to the home appliance controller. After receiving the voice control command of the home appliance, the home appliance controller outputs a corresponding control signal to control the home appliance so that the home appliance performs corresponding actions, including turning the home appliance on, off, adjusting the volume or adjusting the temperature.

[0152] In order to better demonstrate the process of voice control of household appliances, this embodiment now provides a method for voice control of household appliances, which is implemented based on a voice control system of household appliances as described above, and includes the following steps:

[0153] S1: Real-time monitoring of the home appliance control voice output by the user is performed through the voice collection module. When the home appliance control voice output by the user is detected, the home appliance control voice output by the user is captured in real time to determine the real-time data of the home appliance control voice output by the user;

[0154] S2: cleaning the real-time home appliance control voice data output by the user through the voice processing module, determining the real-time home appliance control voice data useful for the home appliance voice control, extracting features of the real-time home appliance control voice data useful for the home appliance voice control, and determining the home appliance control voice feature data;

[0155] S3: comparing and identifying the plurality of stored home appliance control voice standard data with the home appliance control voice feature data through a voice recognition module, calling the home appliance control voice standard data matching the home appliance control voice feature data, and determining the home appliance voice recognition information;

[0156] S4: Matching the home appliance voice recognition information with the home appliance voice control command through the voice control module, determining the home appliance voice control command corresponding to the home appliance voice recognition information, and controlling the home appliance based on the home appliance voice control command so that the home appliance performs a corresponding action.

[0157] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.

[0158] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.

Claims

1. A voice control system for household appliances, characterized in that: include: The voice collection module is used to monitor and capture the home appliance control voice output by the user in real time, and determine the real-time data of the home appliance control voice output by the user; A voice processing module is used to process the real-time data of the home appliance control voice output by the user and determine the characteristic data of the home appliance control voice; A speech recognition module, which is used to compare and recognize the speech feature data of the home appliance control speech based on the home appliance control speech standard data, and determine the speech recognition information of the home appliance; The voice control module is used to match the voice recognition information of the home appliance with the voice control command of the home appliance, determine the voice control command of the home appliance, control the home appliance, and make the home appliance perform corresponding actions.

2. A voice control system for household appliances according to claim 1, characterized in that: The voice collection module comprises: A voice monitoring unit, used to monitor the home appliance control voice output by the user in real time; Install voice monitors at different locations in the room, and monitor the home appliance control voice output by the user in real time based on the voice monitor to determine whether there is abnormal sound in the room and whether the user outputs the home appliance control voice; A voice capture unit, used to capture the home appliance control voice output by the user in real time; When it is detected that the user outputs the home appliance control voice, the voice capture unit is awakened, and the home appliance control voice output by the user is captured in real time based on the voice capture unit to determine the real-time data of the home appliance control voice output by the user.

3. A voice control system for household appliances according to claim 2, characterized in that: The voice collection module also includes: The first moment information extraction module is used to extract the voice collection moment of the user outputting the home appliance control voice monitored in real time; A second moment information extraction module is used to extract the wake-up moment of the voice capture unit corresponding to each home appliance control voice output by the user; A wake-up response duration acquisition module, used to acquire the wake-up response duration of the voice capture unit by using the voice collection moment of the user outputting the home appliance control voice and the wake-up moment of the voice capture unit; A volume intensity acquisition module is used to extract the volume intensity of the user's output voice control of home appliances; A wake-up response evaluation coefficient acquisition module, used to acquire a wake-up response evaluation coefficient according to the volume intensity of the home appliance control voice output by the user and the wake-up response duration of the voice capture unit corresponding to each home appliance control voice output by the user; The awakening response evaluation coefficient is obtained by the following formula: Where C represents the awakening response evaluation coefficient; V max Indicates the maximum volume intensity of the user's output of home appliance control voice; T m Indicates the wake-up response duration corresponding to the maximum volume intensity of the user's output voice control voice for home appliances; T c Indicates the preset wake-up response time reference value; T max Indicates the maximum wake-up response duration of the voice capture unit; V m represents the volume intensity corresponding to the maximum wake-up response duration of the voice capture unit; n represents the number of home appliance control voices output by the user; T i V represents the wake-up response duration of the voice capture unit corresponding to the i-th home appliance control voice output by the user; i Indicates the volume intensity corresponding to the i-th home appliance control voice output by the user; A first comparison module, configured to compare the wake-up response evaluation coefficient with a preset coefficient threshold; The quality determination module is used to determine the operation quality of the voice capture unit when the wake-up response evaluation coefficient is lower than a preset coefficient threshold.

4. A voice control system for household appliances according to claim 3, characterized in that: Quality determination module, including: An operating parameter extraction module, used to extract operating parameters of the voice capture unit, wherein the operating parameters of the voice capture unit include a noise suppression rate, an echo cancellation rate, and a captured audio loss rate; An operation quality evaluation parameter acquisition module, used to obtain an operation quality evaluation parameter of a voice capture unit by using the noise suppression rate, echo cancellation rate and captured audio loss rate in combination with a volume intensity change rate of the captured home appliance control voice; The operation quality evaluation parameter is obtained by the following formula: Where Q represents the operation quality evaluation parameter; m represents the number of home appliance control voices captured by the voice capture unit; V mi V represents the volume intensity variation of the home appliance control voice captured for the i-th time; c Indicates the preset volume intensity reference value; M i N represents the audio loss rate of the i-th captured home appliance control voice; i and E i They represent the noise suppression rate and echo cancellation rate of the i-th captured home appliance control voice respectively; V b Indicates the volume intensity corresponding to the maximum value of the captured audio loss rate; M max Indicates the maximum value of the captured audio loss rate; A second comparison module, used for comparing the operation quality evaluation parameter with a preset evaluation parameter threshold; The abnormality determination and alarm module is used to determine that the voice capture unit is operating abnormally and issue an abnormality alarm when the operation quality evaluation parameter is lower than a preset evaluation parameter threshold.

5. The home appliance voice control system according to claim 2, characterized in that: The speech processing module comprises: A data cleaning unit, used for cleaning the real-time data of the home appliance control voice output by the user; Obtain real-time data of home appliance control voice output by users; Clean the real-time data of home appliance control voice output by users; Remove inconsistent data, invalid data and missing data from the real-time data of home appliance control voice output by the user; Determine the real-time home appliance product control voice data useful for the home appliance product voice control; A feature extraction unit, used to extract features from real-time voice data of the cleaning home appliance control product; Acquire real-time data of home appliance control voice that is useful for home appliance voice control after cleaning; Extract features from real-time data of home appliance control speech that is useful for home appliance voice control; Extract features that reflect voice control of home appliances; Determine the voice feature data for controlling home appliances.

6. A voice control system for household appliances according to claim 5, characterized in that: The speech recognition module comprises: Distributed database for storing home appliance control voice standard data; According to the voice control requirements of home appliances, standard voice control data of home appliances are pre-set, and the pre-set standard voice control data of home appliances are stored for backup; There are a plurality of home appliance product control voice standard data, and the plurality of home appliance product control voice standard data are respectively used to control different actions of the home appliance product; An index calling unit, used for indexing and calling home appliance control voice standard data; According to the requirements of the home appliance voice control, the plurality of home appliance control voice standard data stored are indexed one by one, and the home appliance control voice standard data matching the home appliance control voice feature data is called; A comparison and recognition unit, used for comparing and recognizing the characteristic data of the control voice of the home appliance product; Obtain standard data on voice control for home appliances; Based on the home appliance product control voice standard data, the home appliance product control voice feature data is compared and identified to determine the home appliance product voice recognition information.

7. A voice control system for household appliances according to claim 6, characterized in that: Based on the home appliance product control voice standard data, compare and identify the home appliance product control voice feature data, and perform the following operations: Indexing the plurality of home appliance control voice standard data one by one, and comparing and identifying the indexed home appliance control voice standard data with the home appliance control voice feature data; Wherein, if the indexed home appliance product control voice standard data matches the home appliance product control voice feature data, the indexed home appliance product control voice standard data is called, that is, the indexed home appliance product control voice standard data is the home appliance product control intention output by the user, and then the home appliance product voice recognition information is determined; If the indexed home appliance product control voice standard data does not match the home appliance product control voice feature data, the indexed home appliance product control voice standard data is not called, that is, the indexed home appliance product control voice standard data is not the home appliance product control intention output by the user; When the indexed home appliance product control voice standard data is not the home appliance product control intention output by the user, the next home appliance product control voice standard data is indexed in sequence, and the next home appliance product control voice standard data indexed in sequence is compared and identified with the home appliance product control voice feature data until the next home appliance product control voice standard data indexed in sequence matches the home appliance product control voice feature data, then the next home appliance product control voice standard data indexed in sequence is called, and the next home appliance product control voice standard data indexed in sequence is the home appliance product control intention output by the user, and the home appliance product voice recognition information is determined.

8. A household appliance voice control system according to claim 7, characterized in that: The voice control module comprises: A command matching unit, used to match voice control commands for home appliances; Obtain voice recognition information of home appliances; Matching home appliance product voice recognition information with home appliance product voice control commands; A home appliance product voice control instruction corresponding to the home appliance product voice recognition information is determined.

9. A voice control system for household appliances according to claim 8, characterized in that: The voice control module further includes: The command control unit is used to control the home appliance so that the home appliance performs corresponding actions; Acquire a home appliance product voice control instruction corresponding to the home appliance product voice recognition information; The home appliance voice control command is sent to the home appliance controller. After receiving the home appliance voice control command, the home appliance controller outputs a corresponding control signal to control the home appliance so that the home appliance performs a corresponding action.

10. A method for voice control of household appliances, implemented based on the voice control system of household appliances according to claim 9, characterized in that: The steps include: S1: Real-time monitoring of the home appliance control voice output by the user is performed through the voice collection module. When the home appliance control voice output by the user is detected, the home appliance control voice output by the user is captured in real time to determine the real-time data of the home appliance control voice output by the user; S2: cleaning the real-time home appliance control voice data output by the user through the voice processing module, determining the real-time home appliance control voice data useful for the home appliance voice control, extracting features of the real-time home appliance control voice data useful for the home appliance voice control, and determining the home appliance control voice feature data; S3: comparing and identifying the plurality of stored home appliance control voice standard data with the home appliance control voice feature data through a voice recognition module, calling the home appliance control voice standard data matching the home appliance control voice feature data, and determining the home appliance voice recognition information; S4: Matching the home appliance voice recognition information with the home appliance voice control command through the voice control module, determining the home appliance voice control command corresponding to the home appliance voice recognition information, and controlling the home appliance based on the home appliance voice control command so that the home appliance performs a corresponding action.

Images