Electric appliance, control method and device thereof, storage medium and computer program product

By detecting the ambient light intensity and adjusting the gain of the sound acquisition device, and adjusting the voice feedback according to the ambient light intensity and average volume value, the problem of the impact of voice feedback on other users during late-night voice control is solved, and the effect of users completing voice control can be achieved using a smaller volume.

CN119724180AInactive Publication Date: 2025-03-28GREE ELECTRIC APPLIANCES (NANJING) CO LTD +1
View PDF 4 Cites 0 Cited by

Patent Information

Application Number
CN202411914304.9
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-24
Publication Date
2025-03-28
Estimated Expiration
Not applicable · inactive patent

AI Technical Summary

Technical Problem

When using voice control appliances late at night, voice feedback will affect other users in the room, especially when the user issues voice commands while sleeping, the sound is weak and difficult to recognize.

Method used

By detecting the ambient light intensity, when the ambient light intensity is less than the preset value, it is judged that the indoor environment is in a dark state, and the gain of the sound acquisition device is adjusted according to this state. When a voice command is received, voice recognition is performed, and feedback is performed based on the ambient light intensity and the ambient average volume value, adjust the voice broadcast volume or switch the feedback method.

Benefits of technology

It enables users to wake up the appliances to use a smaller volume late at night for voice control, reducing the impact of voice operations on other users in the room, and ensuring that major users can effectively complete the control of the appliances.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119724180A_ABST
    Figure CN119724180A_ABST
Patent Text Reader

Abstract

The invention provides an electric appliance and a control method and device thereof, a storage medium and a computer program product, and the method comprises the steps: detecting whether the ambient light intensity is smaller than a preset light intensity value or not in a set time period; when it is detected that the environment light intensity is smaller than a preset light intensity value, it is determined that the indoor environment is in a dark state; adjusting the gain of sound acquisition equipment of the electric appliance according to the time when the indoor environment is in the dark state; when a voice command for the electric appliance is received, performing voice recognition on the voice command; and executing the voice command according to the recognition result of the voice command, and performing feedback according to the ambient light intensity and the ambient average volume value. According to the scheme provided by the invention, a user can wake up the air conditioner for voice control by using a small volume at night.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of control, and in particular to an electrical appliance and a control method, device, storage medium and computer program product thereof. Background Art

[0002] When using electrical appliances, people are increasingly accustomed to using voice to control them. Compared with manual control by remote control, voice control can adjust more parameters of the air conditioner at one time, control various functions of the appliance more directly, and greatly reduce the problem of users not being able to find the remote control. However, in the related art, when the voice control function is used late at night, the voice feedback from the appliance will affect other users in the room. When users issue voice commands in sleep mode, the sound is generally weak and the volume is much smaller than normal use, making it difficult to recognize. Summary of the invention

[0003] The main purpose of the present invention is to overcome the defects of the above-mentioned related technologies and to provide an electrical appliance and its control method, device, storage medium and computer program product to solve the problem in the related technologies that voice feedback may affect other users in the room when using the voice control function.

[0004] On the one hand, the present invention provides a method for controlling an electrical appliance, comprising: when in a set time period, detecting whether the ambient light intensity is less than a preset light intensity value; when detecting that the ambient light intensity is less than the preset light intensity value, determining that the indoor environment is in a dark state; adjusting the gain of a sound collection device of the electrical appliance according to the time the indoor environment is in the dark state; when receiving a voice command to the electrical appliance, performing voice recognition on the voice command; executing the voice command according to the recognition result of the voice command, and providing feedback according to the ambient light intensity and the average volume value of the environment.

[0005] Optionally, adjusting the gain of the sound collection device of the appliance according to the time the indoor environment is in a dark state includes: when it is determined that the indoor environment is in a dark state, increasing the gain of the sound collection device by a preset value at every preset adjustment interval as the time the indoor environment is in a dark state increases.

[0006] Optionally, feedback is provided based on the ambient light intensity and the ambient average volume value, including: when the ambient average volume value is not lower than the preset volume value, and the ambient light intensity is less than the preset light intensity value, voice broadcast feedback is provided according to the set voice broadcast volume; when the ambient average volume value is lower than the preset volume value, and the ambient light intensity is less than the preset light intensity value, the set voice broadcast volume is reduced, and voice broadcast feedback is provided according to the reduced set voice broadcast volume; when the ambient average volume value is lower than the preset volume value, and the duration for which the ambient light intensity is less than the preset light intensity value reaches a preset duration, no voice broadcast feedback is provided, and feedback is provided through a beep.

[0007] Optionally, it also includes: when in a set time period, detecting whether the average volume value of the environment is lower than a preset volume value; if it is detected that the average volume value of the environment is lower than the preset volume value, collecting the current environmental noise as a background noise sample; when a voice command to the electrical appliance is received, performing voice recognition on the voice command, including: using the background noise sample to perform noise reduction processing on the audio of the received voice command; performing voice recognition on the audio of the voice command after the noise reduction processing to obtain a recognition result of the voice command.

[0008] Optionally, the received audio of the voice command is subjected to noise reduction processing using the background noise samples, including: according to the background noise samples, using spectral subtraction to remove the background noise in the audio of the voice command, to obtain the audio of the voice command after the background noise is removed.

[0009] Optionally, it also includes: after executing the voice command according to the recognition result of the voice command, sending a prompt to a wearable device bound to the electrical appliance, and the wearable device provides feedback in a preset manner.

[0010] On the other hand, the present invention provides a control device for an electrical appliance, comprising: a first detection unit, used to detect whether the ambient light intensity is less than a preset light intensity value when in a set time period; a determination unit, used to determine that the indoor environment is in a dark state when the first detection unit detects that the ambient light intensity is less than the preset light intensity value; an adjustment unit, used to adjust the gain of the sound collection device of the electrical appliance according to the time when the indoor environment is in a dark state; a recognition unit, used to perform voice recognition on the voice command to the electrical appliance when receiving the voice command; and a feedback unit, used to execute the voice command according to the recognition result of the voice command, and provide feedback according to the ambient light intensity and the average volume value of the environment.

[0011] Optionally, the adjustment unit adjusts the gain of the sound collection device of the electrical appliance according to the time the indoor environment is in a dark state, including: when it is determined that the indoor environment is in a dark state, as the time the indoor environment is in a dark state increases, the gain of the sound collection device is increased by a preset value at every preset adjustment interval.

[0012] Optionally, the feedback unit provides feedback based on the ambient light intensity and the ambient average volume value, including: when the ambient average volume value is not lower than the preset volume value and the ambient light intensity is less than the preset light intensity value, voice broadcast feedback is provided according to the set voice broadcast volume; when the ambient average volume value is lower than the preset volume value and the ambient light intensity is less than the preset light intensity value, the set voice broadcast volume is reduced, and voice broadcast feedback is provided according to the reduced set voice broadcast volume; when the ambient average volume value is lower than the preset volume value and the duration for which the ambient light intensity is less than the preset light intensity value reaches a preset duration, no voice broadcast feedback is provided, and feedback is provided through a beep.

[0013] Optionally, it also includes: a second detection unit, which is used to detect whether the average volume value of the environment is lower than the preset volume value when in a set time period; a collection unit, which collects the current environmental noise as a background noise sample if the second detection unit detects that the average volume value of the environment is lower than the preset volume value; the recognition unit, when receiving a voice command to the electrical appliance, performs voice recognition on the voice command, including: using the background noise sample to perform noise reduction processing on the audio of the received voice command; and performing voice recognition on the audio of the voice command after the noise reduction processing to obtain a recognition result of the voice command.

[0014] Optionally, the recognition unit uses the background noise samples to perform noise reduction processing on the audio of the received voice command, including: according to the background noise samples, using spectral subtraction to remove the background noise in the audio of the voice command, to obtain the audio of the voice command after removing the background noise.

[0015] Optionally, it also includes: a prompt unit, which is used to send a prompt to a wearable device bound to the electrical appliance after executing the voice command according to the recognition result of the voice command, and the wearable device provides feedback in a preset manner.

[0016] Another aspect of the present invention provides a storage medium having a computer program stored thereon, wherein the program implements the steps of any of the aforementioned methods when executed by a processor.

[0017] In another aspect, the present invention provides an electrical appliance, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the aforementioned methods when executing the program.

[0018] Another aspect of the present invention provides an electrical appliance, comprising any of the aforementioned control devices for the electrical appliance.

[0019] In yet another aspect, the present invention provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the steps of any of the aforementioned methods are implemented.

[0020] According to the technical solution of the present invention, the gain of the sound collection device is adjusted according to the ambient light intensity, so that the user can wake up the air conditioner for voice control at a relatively low volume late at night.

[0021] According to the technical solution of the present invention, adjusting the volume of voice feedback or switching the feedback mode according to the ambient light intensity and the average ambient volume value can effectively reduce the impact of the feedback operation performed after receiving the voice command on the user.

[0022] According to the technical solution of the present invention, it is possible to reduce the impact of voice operation on other users in the room, and also enable the main user to control the air conditioner using a relatively low volume. BRIEF DESCRIPTION OF THE DRAWINGS

[0023] The drawings described herein are used to provide a further understanding of the present invention and constitute a part of the present invention. The exemplary embodiments of the present invention and their descriptions are used to explain the present invention and do not constitute an improper limitation of the present invention. In the drawings:

[0024] Figure 1 is a method schematic diagram of an embodiment of a method for controlling an electrical appliance provided by the present invention;

[0025] Figure 2 is a method schematic diagram of another embodiment of the method for controlling an electrical appliance provided by the present invention;

[0026] Figure 3 is a method schematic diagram of another embodiment of the method for controlling an electrical appliance provided by the present invention;

[0027] Figure 4 is a method schematic diagram of a specific embodiment of the method for controlling an electrical appliance provided by the present invention;

[0028] Figure 5 is a structural block diagram of an embodiment of a control device for an electrical appliance provided by the present invention;

[0029] Figure 6 is a structural block diagram of another embodiment of the control device for an electrical appliance provided by the present invention;

[0030] Figure 7 It is a structural block diagram of another embodiment of the control device of an electrical appliance provided by the present invention. DETAILED DESCRIPTION

[0031] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the specific embodiments of the present invention and the corresponding drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making creative work are within the scope of protection of the present invention.

[0032] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0033] The present invention provides a control method for an electrical appliance. The electrical appliance may be an electrical appliance with a voice function and capable of being controlled by voice, such as at least one of an air conditioner, a washing machine, a refrigerator, a television, a dehumidifier, and a humidifier with a voice function; or the electrical appliance may be an electrical appliance that can be connected to a voice device (such as a smart speaker) and can be controlled by the voice device.

[0034] The system composition of the electrical appliance includes the main unit of the electrical appliance (such as the main unit of the air conditioner) and the intelligent terminal. The main unit of the electrical appliance may include a control module, a memory, a microphone, a light intensity sensor, and a sound collection device. The control module is responsible for the overall control and coordination of the system; the memory is used to store background noise samples, and is subsequently used to perform noise reduction processing on the collected sound commands; the sound collection device, such as a microphone, is used to collect the voice information issued by the user, and the gain can be adjusted dynamically, and it is also used to collect background environmental noise for storage in the memory. The intelligent terminal may be, for example, a terminal with a sound collection device and a sound playback device, such as a smart speaker with a microphone and a speaker, which is used to assist in receiving or assist in prompting the user of the execution of the command by the air conditioner.

[0035] Figure 1 It is a method schematic diagram of an embodiment of the method for controlling an electrical appliance provided by the present invention.

[0036] like Figure 1As shown, according to an embodiment of the present invention, the control method of the electrical appliance at least includes step S110, step S120, step S130, step S140 and step S150.

[0037] Step S110: When in a set time period, detect whether the ambient light intensity is less than a preset light intensity value.

[0038] The set time period may be a nighttime rest period, for example, from 22:00 to 7:00 the next morning. During the set time period, the light intensity sensor may be used to detect whether the ambient light intensity is less than a preset light intensity value.

[0039] Step S120: When it is detected that the ambient light intensity is less than a preset light intensity value, it is determined that the indoor environment is in a dark state.

[0040] Specifically, when the light intensity sensor detects that the ambient light intensity is less than a preset light intensity value, it is determined that the indoor environment is in a dark state.

[0041] Step S130, adjusting the gain of the sound collection device of the electrical appliance according to the time when the indoor environment is in a dark state.

[0042] In a specific implementation, when it is determined that the indoor environment is in a dark state, as the time the indoor environment is in the dark state increases, the gain of the sound collection device is increased by a preset value at every preset adjustment interval.

[0043] Specifically, after determining that the indoor environment is in a dark state, the gain of the sound collection device (such as a microphone) is gradually adjusted, and as the time the indoor environment is in a dark state increases, the gain level gradually increases. The preset adjustment interval time can change as the time the indoor environment is in a dark state increases, that is, the adjustment interval time from each gain adjustment to the next gain adjustment becomes longer, that is, as the number of adjustments increases, the adjustment interval time of adjusting the gain of the sound collection device (such as a microphone) increases.

[0044] For example, the preset light intensity value is 100lux. When it is night time, the ambient light level is continuously monitored (using a light sensor). When the ambient light intensity is lower than the preset light intensity value, the indoor environment is judged to be in a dark state. As the indoor environment is in a dark state for a longer time, the gain level is gradually increased, for example, the set value is increased by 1db each time. The formula for adjusting the interval time is as follows:

[0045] T interval (t) = T initial ·k n

[0046] Wherein, Tinitial is the initial gain adjustment interval, k is the growth factor, Tinterval(t) is the gain adjustment interval, and n is the number of adjustments, n=1, 2, 3, ….

[0047] The gain adjustment strategy is that in the early stage of the dark environment, the gain adjustment frequency is high, and the adjustment frequency gradually decreases as time goes by. When the gain reaches the set maximum value, the adjustment stops.

[0048] After increasing the gain of the microphone, users can use the voice control function late at night to wake up the appliance at a lower volume than usual, thereby reducing the impact on other sleeping users in the room.

[0049] Step S140: When a voice command to the electrical appliance is received, voice recognition is performed on the voice command.

[0050] Specifically, when a voice command to the electrical appliance is received, voice recognition is performed on the voice command to obtain a recognition result of the voice command, for example, the voice command is recognized as text and semantic analysis is performed to obtain a control command that is ultimately required to control the electrical appliance.

[0051] Step S150: executing the voice command according to the recognition result of the voice command, and providing feedback according to the ambient light intensity and the ambient average volume value.

[0052] For example, after the voice command is recognized as text, semantic analysis is performed to obtain the control command that ultimately needs to be executed to control the electrical appliance, and the control command is executed.

[0053] After executing the voice command, feedback needs to be given to the user, such as the execution result of the voice command, which can be specifically provided based on the ambient light intensity and the average ambient volume value. In a specific implementation, providing feedback based on the ambient light intensity and the average ambient volume value includes the following situations:

[0054] (1) When the average volume value of the environment is not lower than the preset volume value, and the ambient light intensity is lower than the preset light intensity value, voice broadcast feedback is performed according to the set voice broadcast volume.

[0055] Specifically, the set voice broadcast volume can be the volume of normal voice broadcast feedback. When the average volume value of the environment is lower than the preset volume value and the ambient light intensity is lower than the preset light intensity value, voice broadcast feedback can be given to the user at the volume of normal voice broadcast feedback.

[0056] (2) When the average volume value of the environment is lower than the preset volume value and the ambient light intensity is lower than the preset light intensity value, the set voice broadcast volume is reduced, and voice broadcast feedback is performed according to the reduced set voice broadcast volume.

[0057] Specifically, when the average volume value of the environment is lower than the preset volume value, and the ambient light intensity is lower than the preset light intensity value, the volume of the voice broadcast begins to be gradually reduced. The volume of the voice broadcast can be gradually reduced as the time when the average volume value of the environment is lower than the preset volume value, and the ambient light intensity is lower than the preset light intensity value increases.

[0058] (3) When the average volume value of the environment is lower than the preset volume value, and the duration of the ambient light intensity being lower than the preset light intensity value reaches the preset duration, no voice broadcast feedback is performed, but feedback is performed through a beep sound.

[0059] For example, if the average volume of the environment is lower than the preset volume value, and the duration of the ambient light intensity being lower than the preset light intensity value reaches two hours, it is determined that the user is in a deep sleep state, and the feedback mode is switched to feedback through a beep. Specifically, a preset beep volume is used for feedback, and the preset beep volume is lower than the standard beep volume.

[0060] Figure 2 It is a method schematic diagram of another embodiment of the method for controlling an electrical appliance provided by the present invention.

[0061] like Figure 2 As shown, according to another embodiment of the present invention, the control method of the electrical appliance further includes step S102 and step S104.

[0062] Step S102: When in a set time period, detect whether the average volume value of the environment is lower than a preset volume value.

[0063] Specifically, when in the set time period, the sound collection device detects whether the average volume value of the environment is lower than the preset volume value, for example, the microphone detects whether the average volume value of the environment is lower than the preset volume value.

[0064] Step S104: if it is detected that the average volume value of the environment is lower than the preset volume value, the current environment noise is collected as a background noise sample.

[0065] Specifically, when the average volume of the environment is lower than the preset value, the environment noise is recorded to produce background noise samples for background noise modeling. The main noise source is the operating noise of household appliances such as air conditioners. For example, when in a set time period, under different working modes (such as cooling, heating, dehumidification, etc.) and different wind speed conditions, noise samples generated by the operation of the air conditioner are collected.

[0066] Furthermore, in step S140, when a voice command to the electrical appliance is received, the audio of the received voice command is first subjected to noise reduction processing using the background noise sample; then, voice recognition is performed on the audio of the voice command after the noise reduction processing to obtain a recognition result of the voice command.

[0067] In a specific implementation, the background noise in the audio of the voice command is removed by spectral subtraction based on the background noise sample to obtain the audio of the voice command after the background noise is removed.

[0068] The noise in the late night environment basically comes from the operating noise inside the air conditioner or other indoor electrical appliances. It is a steady-state noise with relatively stable intensity and little change in frequency distribution. Therefore, spectral subtraction is used to reduce noise using background noise samples. When an appliance (such as an air conditioner) receives a voice command, the original time domain sound signal is first converted into a frequency domain signal, the noise spectrum of the background noise sample is subtracted, and then the processed spectrum is converted back to a time domain signal through an inverse Fourier transform (IFFT) for speech recognition.

[0069] Figure 3 It is a method schematic diagram of another embodiment of the method for controlling an electrical appliance provided by the present invention.

[0070] like Figure 3 As shown, according to another embodiment of the present invention, the control method of the electrical appliance further includes step S160.

[0071] Step S160, after executing the voice command according to the recognition result of the voice command, a prompt is sent to the wearable device bound to the electrical appliance, and the wearable device provides feedback in a preset manner.

[0072] The preset mode is, for example, vibration. For example, after the smart wearable device (such as a bracelet or a watch) is bound to the air conditioner, the wearable device gives feedback to the user through slight vibration after the air conditioner executes the user's voice command.

[0073] In order to clearly illustrate the technical solution of the present invention, the execution process of the control method of the electrical appliance provided by the present invention is described below with reference to a specific embodiment.

[0074] Figure 4 FIG. 1 is a schematic diagram of a specific embodiment of the control method of an electrical appliance provided by the present invention. Figure 4As shown, after the electrical appliance (such as an air conditioner) is started, it is determined whether it is currently in a set time period. If it is currently in the set time period, the indoor environment is detected through a light sensor and a sound collection device; when the average volume of the indoor environment is lower than the preset volume value, the ambient noise is recorded and a background noise sample is produced for subsequent noise reduction processing. When it is detected that the ambient light intensity drops to the preset light intensity value, it is determined that the indoor environment is in a dark state. According to the time that the indoor environment is in a dark state, the gain of the sound collection device (such as a microphone) is gradually increased, so that the user can wake up the electrical appliance (such as an air conditioner) using a lower volume.

[0075] The present invention also provides a control device for an electrical appliance. The electrical appliance may be an electrical appliance with a voice function and capable of being controlled by voice, such as at least one of an air conditioner, a washing machine, a refrigerator, a television, a dehumidifier, and a humidifier with a voice function; or the electrical appliance may be an electrical appliance that can be connected to a voice device (such as a smart speaker) and can be controlled by the voice device.

[0076] The system composition of the electrical appliance includes the main unit of the electrical appliance (such as the main unit of the air conditioner) and the intelligent terminal. The main unit of the electrical appliance may include a control module, a memory, a microphone, a light intensity sensor, and a sound collection device. The control module is responsible for the overall control and coordination of the system; the memory is used to store background noise samples, and is subsequently used to perform noise reduction processing on the collected sound commands; the sound collection device, such as a microphone, is used to collect the voice information issued by the user, and the gain can be adjusted dynamically, and it is also used to collect background environmental noise for storage in the memory. The intelligent terminal may be, for example, a terminal with a sound collection device and a sound playback device, such as a smart speaker with a microphone and a speaker, which is used to assist in receiving or assist in prompting the user of the execution of the command by the air conditioner.

[0077] Figure 5 FIG. 1 is a structural block diagram of an embodiment of the control device of an electrical appliance provided by the present invention. Figure 5 As shown, the control device 100 of the electrical appliance includes: a first detection unit 110 , a determination unit 120 , an adjustment unit 130 , an identification unit 140 and a feedback unit 150 .

[0078] The first detection unit 110 is used to detect whether the ambient light intensity is less than a preset light intensity value when in a set time period.

[0079] The set time period may be a nighttime rest period, for example, from 22:00 to 7:00 the next morning. During the set time period, the light intensity sensor may be used to detect whether the ambient light intensity is less than a preset light intensity value.

[0080] The determination unit 120 is configured to determine that the indoor environment is in a dark state when the first detection unit detects that the ambient light intensity is less than a preset light intensity value.

[0081] Specifically, when the light intensity sensor detects that the ambient light intensity is less than a preset light intensity value, it is determined that the indoor environment is in a dark state.

[0082] The adjustment unit 130 is used to adjust the gain of the sound collection device of the electrical appliance according to the time when the indoor environment is in a dark state.

[0083] In a specific implementation, when it is determined that the indoor environment is in a dark state, as the time the indoor environment is in the dark state increases, the gain of the sound collection device is increased by a preset value at every preset adjustment interval.

[0084] Specifically, after determining that the indoor environment is in a dark state, the gain of the sound collection device (such as a microphone) is gradually adjusted, and as the time the indoor environment is in a dark state increases, the gain level gradually increases. The preset adjustment interval time can change as the time the indoor environment is in a dark state increases, that is, the adjustment interval time from each gain adjustment to the next gain adjustment becomes longer, that is, as the number of adjustments increases, the adjustment interval time of adjusting the gain of the sound collection device (such as a microphone) increases.

[0085] For example, the preset light intensity value is 100lux. When it is night time, the ambient light level is continuously monitored (using a light sensor). When the ambient light intensity is lower than the preset light intensity value, the indoor environment is judged to be in a dark state. As the indoor environment is in a dark state for a longer time, the gain level is gradually increased, for example, the set value is increased by 1db each time. The formula for adjusting the interval time is as follows:

[0086] T interval (t) = T initial ·k n

[0087] Wherein, Tinitial is the initial gain adjustment interval, k is the growth factor, Tinterval(t) is the gain adjustment interval, and n is the number of adjustments, n=1, 2, 3, ….

[0088] The gain adjustment strategy is that in the early stage of the dark environment, the gain adjustment frequency is high, and the adjustment frequency gradually decreases as time goes by. When the gain reaches the set maximum value, the adjustment stops.

[0089] After increasing the gain of the microphone, users can use the voice control function late at night to wake up the appliance at a lower volume than usual, thereby reducing the impact on other sleeping users in the room.

[0090] The recognition unit 140 is configured to perform voice recognition on a voice command to the electrical appliance when the voice command is received.

[0091] Specifically, when a voice command to the electrical appliance is received, voice recognition is performed on the voice command to obtain a recognition result of the voice command, for example, the voice command is recognized as text and semantic analysis is performed to obtain a control command that is ultimately required to control the electrical appliance.

[0092] The feedback unit 150 is used to execute the voice command according to the recognition result of the voice command, and provide feedback according to the ambient light intensity and the ambient average volume value.

[0093] For example, after the voice command is recognized as text, semantic analysis is performed to obtain the control command that ultimately needs to be executed to control the electrical appliance, and the control command is executed.

[0094] After executing the voice command, feedback needs to be provided to the user, such as the execution result of the voice command, which can be provided based on the ambient light intensity and the average volume value of the environment. In a specific implementation, the feedback unit 150 provides feedback based on the ambient light intensity and the average volume value of the environment, including the following situations:

[0095] (1) When the average volume value of the environment is not lower than the preset volume value, and the ambient light intensity is lower than the preset light intensity value, voice broadcast feedback is performed according to the set voice broadcast volume.

[0096] Specifically, the set voice broadcast volume can be the volume of normal voice broadcast feedback. When the average volume value of the environment is lower than the preset volume value and the ambient light intensity is lower than the preset light intensity value, voice broadcast feedback can be given to the user at the volume of normal voice broadcast feedback.

[0097] (2) When the average volume value of the environment is lower than the preset volume value and the ambient light intensity is lower than the preset light intensity value, the set voice broadcast volume is reduced, and voice broadcast feedback is performed according to the reduced set voice broadcast volume.

[0098] Specifically, when the average volume value of the environment is lower than the preset volume value, and the ambient light intensity is lower than the preset light intensity value, the volume of the voice broadcast begins to be gradually reduced. The volume of the voice broadcast can be gradually reduced as the time when the average volume value of the environment is lower than the preset volume value, and the ambient light intensity is lower than the preset light intensity value increases.

[0099] (3) When the average volume value of the environment is lower than the preset volume value, and the duration of the ambient light intensity being lower than the preset light intensity value reaches the preset duration, no voice broadcast feedback is performed, but feedback is performed through a beep sound.

[0100] For example, if the average volume of the environment is lower than the preset volume value, and the duration of the ambient light intensity being lower than the preset light intensity value reaches two hours, it is determined that the user is in a deep sleep state, and the feedback mode is switched to feedback through a beep. Specifically, a preset beep volume is used for feedback, and the preset beep volume is lower than the standard beep volume.

[0101] Figure 6 FIG. 1 is a structural block diagram of another embodiment of the control device for an electrical appliance provided by the present invention. Figure 6 As shown, the control device 100 of the electrical appliance further includes: a second detection unit 160 and a collection unit 170 .

[0102] The second detection unit 160 is used to detect whether the average volume value of the environment is lower than a preset volume value during a set time period.

[0103] Specifically, when in the set time period, the sound collection device detects whether the average volume value of the environment is lower than the preset volume value, for example, the microphone detects whether the average volume value of the environment is lower than the preset volume value.

[0104] The collecting unit 170 collects the current environmental noise as a background noise sample if the second detecting unit 160 detects that the average volume value of the environment is lower than the preset volume value.

[0105] Specifically, when the average volume of the environment is lower than the preset value, the environment noise is recorded to produce background noise samples for background noise modeling. The main noise source is the operating noise of household appliances such as air conditioners. For example, when in a set time period, under different working modes (such as cooling, heating, dehumidification, etc.) and different wind speed conditions, noise samples generated by the operation of the air conditioner are collected.

[0106] Furthermore, when a voice command to the electrical appliance is received, the recognition unit 120 performs noise reduction processing on the audio of the received voice command using the background noise sample; performs voice recognition on the audio of the voice command after the noise reduction processing to obtain a recognition result of the voice command.

[0107] In a specific implementation, the recognition unit uses the background noise sample to perform noise reduction processing on the audio of the received voice command, including: according to the background noise sample, using spectral subtraction to remove the background noise in the audio of the voice command, to obtain the audio of the voice command after removing the background noise.

[0108] The noise in the late night environment basically comes from the operating noise inside the air conditioner or other indoor electrical appliances. It is a steady-state noise with relatively stable intensity and little change in frequency distribution. Therefore, spectral subtraction is used to reduce noise using background noise samples. When an appliance (such as an air conditioner) receives a voice command, the original time domain sound signal is first converted into a frequency domain signal, the noise spectrum of the background noise sample is subtracted, and then the processed spectrum is converted back to a time domain signal through an inverse Fourier transform (IFFT) for speech recognition.

[0109] Figure 7 FIG. 1 is a structural block diagram of another embodiment of the control device for an electrical appliance provided by the present invention. Figure 7 As shown, the control device 100 of the electrical appliance further includes: a prompt unit 180 .

[0110] The prompt unit 180 is used to send a prompt to the wearable device bound to the electrical appliance after executing the voice command according to the recognition result of the voice command, and the wearable device provides feedback in a preset manner.

[0111] The preset mode is, for example, vibration. For example, after the smart wearable device (such as a bracelet or a watch) is bound to the air conditioner, the wearable device gives feedback to the user through slight vibration after the air conditioner executes the user's voice command.

[0112] The present invention also provides a storage medium corresponding to the control method of the electrical appliance, on which a computer program is stored, and when the program is executed by a processor, the steps of any of the above methods are implemented.

[0113] The present invention also provides an electrical appliance corresponding to the control method of the electrical appliance, comprising a processor, a memory, and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any of the aforementioned methods when executing the program.

[0114] The present invention also provides an electrical appliance corresponding to the control device of the electrical appliance, comprising any of the control devices of the electrical appliances described above.

[0115] The present invention also provides a computer program product corresponding to the control method of the electrical appliance, comprising a computer program, and when the computer program is executed by a processor, the steps of any of the aforementioned methods are implemented.

[0116] According to the solution provided by the present invention, according to the technical solution of the present invention, the gain of the sound collection device is adjusted according to the ambient light intensity so that the user can wake up the air conditioner for voice control at a relatively low volume in the middle of the night.

[0117] According to the technical solution of the present invention, adjusting the volume of voice feedback or switching the feedback mode according to the ambient light intensity and the average ambient volume value can effectively reduce the impact of the feedback operation performed after receiving the voice command on the user.

[0118] According to the technical solution of the present invention, it is possible to reduce the impact of voice operation on other users in the room, and also enable the main user to control the air conditioner using a relatively low volume.

[0119] The functions described herein may be implemented in hardware, software executed by a processor, firmware, or any combination thereof. If implemented in software executed by a processor, the functions may be stored as one or more instructions or codes on a computer-readable medium or transmitted via a computer-readable medium. Other examples and implementations are within the scope and spirit of the present invention and the appended claims. For example, due to the nature of software, the functions described above may be implemented using software executed by a processor, hardware, firmware, hard wiring, or a combination of any of these. In addition, each functional unit may be integrated into a processing unit, each unit may exist physically separately, or two or more units may be integrated into one unit.

[0120] In the several embodiments provided in this application, it should be understood that the disclosed technical content can be implemented in other ways. Among them, the device embodiments described above are only schematic. For example, the division of the units can be a logical function division. There may be other division methods in actual implementation. For example, multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of units or modules, which can be electrical or other forms.

[0121] The units described as separate components may or may not be physically separated, and the components of the control device may or may not be physical units, that is, they may be located in one place or distributed in multiple units. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0122] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, in essence, or the part that contributes to the relevant technology or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or optical disk and other media that can store program codes.

[0123] The above description is only an embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent substitution, improvement, etc. made within the spirit and principle of the present invention shall be included in the scope of the claims of the present invention.

Claims

1. A method for controlling an electrical appliance, characterized in that: include: When in the set time period, detect whether the ambient light intensity is less than the preset light intensity value; When it is detected that the ambient light intensity is less than a preset light intensity value, it is determined that the indoor environment is in a dark state; adjusting the gain of the sound collection device of the electrical appliance according to the time when the indoor environment is in a dark state; When receiving a voice command for the electrical appliance, performing voice recognition on the voice command; The voice command is executed according to the recognition result of the voice command, and feedback is provided according to the ambient light intensity and the ambient average volume value.

2. The method according to claim 1, characterized in that According to the time when the indoor environment is in a dark state, the gain of the sound collection device of the electrical appliance is adjusted, including: When it is determined that the indoor environment is in a dark state, as the time for which the indoor environment is in the dark state increases, the gain of the sound collecting device is increased by a preset value at every preset adjustment interval.

3. The method according to claim 1, characterized in that Provide feedback based on ambient light intensity and average ambient volume, including: When the average volume value of the environment is not lower than the preset volume value, and the ambient light intensity is lower than the preset light intensity value, voice broadcast feedback is performed according to the set voice broadcast volume; When the average volume value of the environment is lower than the preset volume value, and the ambient light intensity is lower than the preset light intensity value, the set voice broadcast volume is reduced, and voice broadcast feedback is performed according to the reduced set voice broadcast volume; When the average volume value of the environment is lower than the preset volume value, and the duration of the ambient light intensity being lower than the preset light intensity value reaches the preset duration, no voice broadcast feedback is performed, and feedback is performed through a beep sound.

4. The method according to any one of claims 1 to 3, characterized in that: Also includes: When in the set time period, detect whether the average volume value of the environment is lower than the preset volume value; If it is detected that the average volume value of the environment is lower than the preset volume value, the current environmental noise is collected as a background noise sample; When a voice command to the electrical appliance is received, voice recognition is performed on the voice command, including: Performing noise reduction processing on the received audio of the voice command using the background noise sample; Speech recognition is performed on the audio of the voice command after the noise reduction processing to obtain a recognition result of the voice command.

5. The method according to claim 4, characterized in that Performing noise reduction processing on the audio of the received voice command using the background noise sample, including: According to the background noise samples, the background noise in the audio of the voice command is removed by using spectral subtraction to obtain the audio of the voice command after the background noise is removed.

6. The method according to any one of claims 1 to 3, characterized in that: Also includes: After the voice command is executed according to the recognition result of the voice command, a prompt is sent to the wearable device bound to the electrical appliance, and the wearable device provides feedback in a preset manner.

7. A control device for an electrical appliance, characterized in that: include: A first detection unit, used to detect whether the ambient light intensity is less than a preset light intensity value when in a set time period; a determination unit, configured to determine that the indoor environment is in a dark state when the first detection unit detects that the ambient light intensity is less than a preset light intensity value; An adjustment unit, used for adjusting the gain of the sound collection device of the electrical appliance according to the time when the indoor environment is in a dark state; a recognition unit, configured to perform voice recognition on a voice command to the electrical appliance when receiving the voice command; A feedback unit is used to execute the voice command according to the recognition result of the voice command, and to provide feedback according to the ambient light intensity and the ambient average volume value.

8. A storage medium, characterized in that: A computer program is stored thereon, and when the program is executed by a processor, the steps of any method described in claims 1-6 are implemented.

9. An electrical appliance, characterized in that: The method comprises a processor, a memory and a computer program stored in the memory and executable on the processor, wherein the processor implements the steps of any method described in claims 1 to 6 when executing the program, or comprises the control device described in claim 7.

10. A computer program product, characterized in that The invention comprises a computer program, which implements the steps of any one of the methods of claims 1 to 6 when executed by a processor.

Citation Information

Patent Citations

  • Audio feedback prompt control method, system thereof and air conditioner

    CN109166580A

  • Method and device for air conditioner control, air conditioner and a storage medium

    CN113932389A

  • Speech recognition gain method and device, storage medium and microphone

    CN117789717A

  • Sound output control apparatus and sound output control method

    JP2007060019A