Household appliance control method and device and medium

Abstract

The invention discloses a household appliance control method and device and a medium. The method comprises the following steps: acquiring a vibration signal acquired by a bone voiceprint sensor installed on a household appliance; based on the vibration signal, whether knocking operation of a set knocking surface of the household appliance exists or not is determined; and under the condition that the knocking operation on the set knocking surface of the household appliance exists, controlling the household appliance to execute an action instruction.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of home appliance control, and more particularly, to a home appliance control method, a home appliance, an electronic device, and a storage medium. BACKGROUND

[0002] With the rapid development of smart home technology, people have higher requirements for the operation convenience of home appliances. Traditional home appliance control methods mainly rely on keys, remote controls, or touch screens, etc. These control methods have certain limitations in certain scenarios, for example, users cannot operate conveniently when their hands are occupied. In order to solve this problem, various home appliance control schemes based on tapping have been proposed in the industry.

[0003] In related technologies, there are some schemes for controlling home appliances to automatically open and close doors. For example, a piezoelectric sensor is used to sense the tapping operation of a user to control the home appliance to automatically open and close the door. However, the piezoelectric sensor has a complex process and is expensive, and the tapping position is usually limited to the installation position of the sensor, which results in poor user experience. For another example, an acceleration sensor is used to sense the tapping operation of a user to control the home appliance to automatically open and close the door. However, this scheme can only identify the tapping operation, and cannot identify whether the tapping operation is applied to the set tapping surface (such as the front door panel) of the home appliance, which is likely to cause false triggering and affect normal use of the user. SUMMARY

[0004] An object of the present application is to provide a new technical solution for controlling a home appliance.

[0005] According to a first aspect of the present application, a home appliance control method is provided, comprising:

[0006] obtaining a vibration signal collected by an osteophonic print sensor installed on a home appliance;

[0007] determining, based on the vibration signal, whether there is a tapping operation on a set tapping surface of the home appliance;

[0008] in a case where there is a tapping operation on the set tapping surface of the home appliance, controlling the home appliance to execute an action instruction.

[0009] Optionally, the determining, based on the vibration signal, whether there is a tapping operation on the set tapping surface of the home appliance, comprises:

[0010] determining, based on the energy duration of the vibration signal, whether there is a tapping operation on the set tapping surface of the home appliance;

[0011] wherein the energy duration of the vibration signal generated by the set tapping surface is different from the energy duration of the vibration signal generated by other non-tapping surfaces.

[0012] Optionally, the determining whether the knocking operation on the set knocking surface of the home appliance exists based on the energy duration of the vibration signal comprises:

[0013] In a case where the energy duration is less than or equal to a first duration threshold, it is determined that the knocking operation on the set knocking surface of the home appliance exists.

[0014] Optionally, the determining whether the knocking operation on the set knocking surface of the home appliance exists based on the energy of the vibration signal comprises:

[0015] In a case where the energy duration is greater than the first duration threshold, a maximum energy value of the vibration signal is obtained;

[0016] In a case where the maximum energy value is greater than an energy threshold and the energy duration is less than a second duration threshold, it is determined that the knocking operation on the set knocking surface of the home appliance exists;

[0017] The first duration threshold is less than the second duration threshold.

[0018] Optionally, the controlling the home appliance to execute the action instruction in a case where the knocking operation on the set knocking surface of the home appliance exists comprises:

[0019] In a case where the knocking operation on the set knocking surface of the home appliance exists and the knocking operation is a knocking operation of a user's finger, the home appliance is controlled to execute the action instruction.

[0020] Optionally, the method further comprises:

[0021] obtaining a frequency domain signal corresponding to a frequency domain of the vibration signal, a first energy value of the frequency domain signal in a first set frequency band, and a second energy value of the frequency domain signal in a second set frequency band, the first set frequency band being determined based on an energy concentration frequency band of a target vibration signal, the target vibration signal being a vibration signal of a user's finger knocking the home appliance collected in advance by using the bone voiceprint sensor;

[0022] According to the first energy value and the second energy value, it is determined whether the knocking operation is a knocking operation of a user's finger.

[0023] Optionally, the determining whether the knocking operation is a knocking operation of a user's finger according to the first energy value and the second energy value comprises:

[0024] An energy ratio value of the first energy value and the second energy value is obtained;

[0025] determine, according to an energy ratio of the first energy value and the second energy value, whether the tapping operation is a tapping operation of a user's finger tapping.

[0026] According to a second aspect of the present application, a household appliance is provided, comprising a bone acoustic print sensor,

[0027] The bone acoustic print sensor is configured to collect a vibration signal, and the vibration signal is configured to determine whether a tapping operation on a set tapping surface of the household appliance exists, and in the case that the tapping operation on the set tapping surface of the household appliance exists, control the household appliance to execute an action instruction.

[0028] According to a third aspect of the present application, an electronic device is provided, comprising a memory and a processor, the memory is configured to store computer instructions, and the processor is configured to call the computer instructions from the memory to execute the method according to any one of the first aspect.

[0029] According to a fourth aspect of the present application, a computer readable storage medium is provided, and the computer readable storage medium stores a computer program, and the computer program is configured to implement the method according to any one of the first aspect when executed by a processor.

[0030] The bone acoustic print sensor is first applied to the control of the household appliance, and the vibration signal collected by the bone acoustic print sensor is used to determine whether a tapping operation on a set tapping surface of the household appliance exists, and in the case that the tapping operation on the set tapping surface of the household appliance exists, control the household appliance to execute an action instruction. The price of the bone acoustic print sensor is more advantageous than that of the piezoelectric sensor, and the cost can be reduced. At the same time, the bone acoustic print sensor can sense the tapping of any position on the surface of the household appliance, so that the tapping position is not limited, and the convenience of user operation is improved. In addition, the bone acoustic print sensor has a higher signal-to-noise ratio, and can effectively distinguish the tapping signal from the environmental noise. The bone acoustic print sensor can also support a higher sampling frequency, and can collect more rich features, so that the features related to the tapping of the tapping surface can be extracted from these rich features, so that the tapping operation of the tapping surface can be more accurately recognized, the problem of false triggering can be effectively avoided, and the reliability of the control of the household appliance is improved.

[0031] Other features and advantages of the present application will become apparent from the following detailed description of exemplary embodiments thereof, taken in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0032] The accompanying drawings incorporated in and forming a part of the specification, illustrate embodiments of the present application and, together with the description, serve to explain the principles of the application.

[0033] Figure 1 is a flowchart of a household appliance control method provided according to an embodiment of the present application;

[0034] Figure 2 are vibration signals generated by knocking a glass panel and vibration signals generated by knocking a metal panel according to an embodiment of the present application;

[0035] Figure 3 is a schematic diagram of a time-domain vibration signal collected by a bone voiceprint sensor and converted by a digital-to-analog converter according to an embodiment of the present application;

[0036] Figure 4 is a schematic diagram of a frequency-domain signal corresponding to a time-domain vibration signal according to an embodiment of the present application;

[0037] Figure 5 is a schematic diagram of a frequency-domain signal corresponding to a vibration signal generated by knocking another hard object according to an embodiment of the present application;

[0038] Figure 6 is a schematic diagram of a corresponding relationship between a first energy value corresponding to a first knocking operation, a second energy value corresponding to a second knocking operation, and time according to an embodiment of the present application;

[0039] Figure 7 is a schematic block diagram of a home appliance control device according to an embodiment of the present application.

[0040] Figure 8 is a schematic block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0041] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of the components and steps, numerical expressions, and numerical values set forth in these embodiments are not limitations on the scope of the present application unless otherwise specifically stated.

[0042] The following description of at least one exemplary embodiment is merely exemplary in nature and is in no way intended to limit the scope of the application, its application, or uses.

[0043] Techniques, methods, and devices known to those of ordinary skill in the relevant art can not be discussed in detail herein. However, where appropriate, such techniques, methods, and devices can be viewed as part of the specification and may

[0044] In all of the compositions and methods described herein, any of the specific values should be interpreted as merely exemplary, and are not intended to be limiting. Thus, other examples of the exemplary embodiments can have different values.

[0045] It should be noted that like references and characters herein relate to like items throughout the figures, and once an item is defined in one figure, it need not be discussed further in subsequent figures.

[0046] With the rapid development of smart home technology, people have higher requirements for the operation convenience of home appliances. The traditional control method of home appliances mainly relies on keys, remote controls or touch screens, etc. These control methods have certain limitations in certain scenarios, for example, users cannot operate conveniently when their hands are occupied. In order to solve this problem, various knock-based control schemes of home appliances have been proposed in the industry.

[0047] In related technologies, there are some schemes for controlling home appliances to automatically open and close doors. For example, a piezoelectric sensor is used to sense the user's knock operation to control the home appliances to automatically open and close doors. However, the piezoelectric sensor has a complex process and is expensive. Moreover, based on the sensing principle of the piezoelectric sensor, it can be obtained that when the piezoelectric sensor is used to collect the user's knock operation, the user must knock at the position of the piezoelectric sensor so that the piezoelectric sensor can collect it, that is, the knock position is limited.

[0048] In related technologies, there are also some schemes for controlling home appliances to automatically open and close doors. For example, an acceleration sensor is used to sense the user's knock operation to control the home appliances to automatically open and close doors, but this scheme can only identify the knock operation and cannot identify whether it is a knock operation applied to a set knock surface (such as the front door panel of the home appliance). However, the knock control scheme of the home appliance usually only allows knocking on one set knock surface, for example, only allows knocking on the front door panel of the home appliance and does not allow knocking on the top panel and side panel of the home appliance. Taking a washing machine as an example, only knocking on the glass door in the front of the washing machine can trigger the door to open, and knocking on the side and top of the washing machine is not allowed to open the door. Therefore, the acceleration sensor knock control scheme is prone to false triggering, affecting the normal use of the user.

[0049] The applicant found through research that the reason why the acceleration sensor scheme cannot identify whether it is applied to the set knock surface is that the sampling frequency it can support is low, the characteristics of the vibration signals collected are limited, and it cannot identify whether it is the characteristics of the knock surface from the limited characteristics, so it cannot identify whether it is a knock operation applied to the set knock surface.

[0050] Therefore, the applicant first applies the bone conduction sensor to the control of the household appliance. When a user taps the household appliance, the generated vibration signal is transmitted to the bone conduction sensor through the shell of the household appliance, causing the air in the sealed cavity in the bone conduction sensor to be compressed, and the diaphragm in the bone conduction sensor senses the air compression, thereby collecting the vibration signal. Therefore, the household appliance control scheme of the embodiment of the present application does not have the limitation of the tapping position, and the price of the bone conduction sensor is more advantageous than that of the piezoelectric sensor, which can solve the technical problems existing in the piezoelectric ceramic scheme. In addition, the bone conduction sensor can support a higher sampling rate and has a higher signal-to-noise ratio, and the relevant features in the collected vibration signal are more abundant, so it is easier to identify whether it is a tapping operation applied to the set tapping surface.

[0051] The household appliance control method provided in the embodiment of the present application is as shown in Figure 1 The method can include steps S110 to S130.

[0052] Step S110, obtaining the vibration signal collected by the bone conduction sensor installed on the household appliance.

[0053] The vibration signal in the embodiment of the present application can be picked up by the high-sensitivity diaphragm of the bone conduction sensor. When the household appliance is tapped, the vibration signal generated by the tapping drives the air in the sealed cavity in the bone conduction sensor to be compressed, and the signal reflecting the degree of air compression picked up by the high-sensitivity diaphragm of the bone conduction sensor is the vibration signal in the embodiment of the present application. The bone conduction sensor can collect the vibration signal in a plurality of continuous sampling windows.

[0054] In the embodiment of the present application, the bone conduction sensor can be installed on the surface or internal structure of the household appliance for real-time collection of the vibration signal. The specific deployment position of the bone conduction sensor can be determined based on design requirements, for example, it can be deployed in the front door panel of the household appliance, it can also be deployed in the side panel of the household appliance, and it can also be deployed in the upper panel of the household appliance. In one example, the bone conduction sensor can be embedded in any position of the front door panel of the household appliance that is convenient for collecting the vibration signal.

[0055] In the embodiment of the present application, the set tapping surface of the household appliance has a different material or a different structure from other surfaces. Different materials can have different hardness, and the energy duration of the vibration signal in different materials or different structures is different. In other words, the energy attenuation speed of the vibration signal in different materials is different. Taking a drum washing machine as an example, the material of the front door panel of the drum washing machine is usually glass, and the material of the side panel is usually metal. Figure 2The vibration signals generated by knocking the glass panel and the metal panel under two different knocking forces are shown schematically. S1 is the vibration signal generated by knocking the glass panel under the first knocking force. S2 is the vibration signal generated by knocking the metal panel under the first knocking force. S3 is the vibration signal generated by knocking the glass panel under the second knocking force. S4 is the vibration signal generated by knocking the metal panel under the second knocking force. It can be seen that, under the same knocking force, the energy duration of the vibration signal S1 (or S3) generated by knocking the glass panel is much smaller than that of the vibration signal S2 (or S4) generated by knocking the metal panel.

[0056] The energy duration of the vibration signal is the duration range of the energy distribution of the vibration signal on the time axis. The energy duration of the vibration signal can be understood as the time interval from the start of the vibration signal to the decay to a set value. The longer the energy duration of the vibration signal, the slower the decay speed of the vibration signal.

[0057] In one example, the energy duration of the vibration signal can be embodied by the amplitude duration of the vibration signal.

[0058] In another example, the energy duration of the vibration signal can be determined by the frequency spectrum energy distribution of the vibration signal corresponding to the frequency domain. In this example, the energy distribution of the frequency domain signal corresponding to the frequency domain of the vibration signal in different time segments can be analyzed. The energy duration can be understood as the time span corresponding to the region where the signal energy has a significant contribution on the time-frequency plane. The vibration signal is spliced from multiple signal segments collected by multiple sampling windows. For example, the sampling frequency is 8KHz, and the number of sampling points is 256. The sampling window duration is 16ms. The vibration signal can be a vibration signal spliced from multiple 16ms time domain signal segments. The energy accumulation sum of the frequency domain signal corresponding to each signal frequency band in the set frequency band can be calculated. The time interval corresponding to the case that the energy accumulation sum of a plurality of consecutive energy accumulation sums is greater than a set value is taken as the energy duration of the vibration signal. The energy accumulation sum of the frequency domain signal in the set frequency band can be understood as the accumulation sum of the energy values of the frequency components in the set frequency band.

[0059] In step S120, whether there is a knocking operation on the set knocking surface of the household appliance is determined based on the vibration signal collected by the bone voiceprint sensor.

[0060] In the embodiments of the present application, step S120 can include step S121: determining whether there is a knocking operation on the set knocking surface of the household appliance based on the energy duration of the vibration signal collected by the bone voiceprint sensor.

[0061] In the embodiments of the present application, the energy duration of the vibration signal generated by the setting knock surface is different from the energy duration of the vibration signal generated by other non-setting knock surfaces. Therefore, whether the knock operation of the setting knock surface of the household appliance exists can be determined based on the energy duration of the vibration signal collected by the bone-voiceprint sensor. It can be understood that the energy duration of the vibration signal generated by the setting knock surface is different from the energy duration of the vibration signal generated by other non-setting knock surfaces is for the vibration signal generated by the setting knock surface and the vibration signal generated by the non-setting knock surface under the same knock strength.

[0062] In one example, the collected vibration signal can be sequentially subjected to signal amplification and analog-to-digital conversion processing to obtain a processed vibration signal; and whether the knock operation of the setting knock surface of the household appliance exists can be determined based on the processed vibration signal. For example, the vibration signal collected by the bone-voiceprint sensor is output through a voltage signal. The weak voltage signal can be amplified to a suitable level for processing by a signal amplification circuit (such as a low-noise amplifier) to obtain an amplified signal. The amplified signal can be an analog signal. The amplified analog signal is input into an analog-to-digital conversion circuit (such as a high-precision ADC chip) to convert the amplified analog signal to obtain a digital signal. The digital signal is a time-domain digital signal corresponding to the vibration signal collected by the bone-voiceprint sensor. The time-domain digital signal can reflect the vibration frequency and energy size of the vibration signal. In this example, whether the knock operation of the setting knock surface of the household appliance exists can be determined according to the energy duration of a plurality of the time-domain digital signals.

[0063] In another example, a plurality of the time-domain vibration signals can be converted into a frequency domain to obtain a plurality of frequency-domain signals corresponding to the frequency domain of the vibration signals; and whether the knock operation of the setting knock surface of the household appliance exists can be determined based on the plurality of frequency-domain signals. In this example, whether the knock operation of the setting knock surface of the household appliance exists can be determined according to the energy duration of a plurality of the frequency-domain signals.

[0064] In one example, whether the knock operation of the household appliance exists can be determined based on the vibration signal, and whether the knock operation of the setting knock surface of the household appliance exists can be determined based on the vibration signal in the case that the knock operation of the household appliance exists. For example, whether the knock operation exists can be determined according to the vibration frequency and energy size of the vibration signal, and whether the knock operation of the setting knock surface exists can be determined according to the energy duration of the vibration signal.

[0065] Step S130, in the case that the knock operation on the setting knock surface of the household appliance exists, controlling the household appliance to perform the action instruction.

[0066] In one example, the action instruction in the embodiment of the present application can include any one of the instructions of opening the door, closing the door and starting.

[0067] In the embodiment of the present application, in the case that the knocking operation on the set knocking surface of the household appliance exists, the current state of the door panel of the household appliance can be acquired; and the household appliance is controlled to execute the action instruction according to the current state of the door panel of the household appliance. In one example, if the current state of the door panel of the household appliance is the closed door state, the household appliance is controlled to open the door. If the current state of the door panel of the household appliance is the open door state, the household appliance is controlled to close the door.

[0068] In the embodiment of the present application, it can also be previously set that the household appliance is controlled to execute the action instruction in the case that one time of the knocking operation on the set knocking surface is detected. Or, it can be previously set that the household appliance is controlled to execute the action instruction in the case that continuous multiple times of the knocking operation on the set knocking surface are detected. In one example, it can be set that the household appliance is controlled to close the door in the case that one time of the knocking operation on the set knocking surface is detected; or the household appliance is controlled to open the door in the case that two times of the knocking operation on the set knocking surface are detected; or the household appliance is controlled to start in the case that three times of the knocking operation on the set knocking surface are detected.

[0069] In the embodiment of the present application, the household appliance can also be controlled to execute the action instruction according to the current state of the door panel of the household appliance and the number of the knocking operation on the set knocking surface. In one example, the household appliance is controlled to open the door in the case that the current state of the door panel of the household appliance is the closed door and the number of the knocking operation on the set knocking surface is two. The household appliance is controlled to close the door in the case that the current state of the door panel of the household appliance is the open door and the number of the knocking operation on the set knocking surface is one. The household appliance is controlled to start in the case that the current state of the door panel of the household appliance is the closed door and the number of the knocking operation on the set knocking surface is three.

[0070] The application first applies the bone acoustic print sensor to the control of the household appliance, determines whether there is a knocking operation on the set knocking surface of the household appliance by using the vibration signal collected by the bone acoustic print sensor, and controls the household appliance to execute the action instruction in the case that there is a knocking operation on the set knocking surface of the household appliance. The bone acoustic print sensor has a more advantageous price than the piezoelectric sensor, and can reduce the cost. Meanwhile, the bone acoustic print sensor can sense the knocking of any position on the surface of the household appliance, so that the knocking position is not limited, and the convenience of user operation is improved. In addition, the bone acoustic print sensor has a higher signal-to-noise ratio, and can effectively distinguish the knocking signal from the environmental noise. The bone acoustic print sensor can also support a higher sampling frequency, the vibration signal collected by the bone acoustic print sensor contains more time domain signal features, so that the features related to the knocking of the knocking surface are more easily extracted from the time domain signal features. Furthermore, the time domain signal can be converted to the frequency domain to obtain more detailed signal features in the frequency domain, which can further improve the recognition accuracy, effectively avoid the false triggering problem, and improve the reliability of the control of the household appliance.

[0071] In some embodiments, step S121 can include: in the case that the energy duration of the vibration signal is less than or equal to the first time threshold, determining that there is a knocking operation on the set knocking surface of the household appliance.

[0072] In the embodiments of the application, the first time threshold can be determined based on the energy duration of the vibration signal when a user knocks the set knocking surface with a conventional knocking force. In one example, the conventional knocking force can be the average or maximum value of the knocking force of the user's finger obtained through multiple experiments.

[0073] Taking the sampling frequency as 8KHz and the sampling window duration as 16ms, the vibration signal can be a vibration signal spliced by multiple 16ms time domain signal segments, and the first time threshold is 80ms. In the case that the energy duration of the vibration signal does not exceed 5 sampling window durations, it is determined that there is a knocking operation on the set knocking surface of the household appliance. In the case that the energy duration of the vibration signal exceeds 5 sampling window durations, it is determined that there is no knocking operation on the set knocking surface of the household appliance.

[0074] Considering that the force of the user knocking the set knocking surface can be greater than the conventional force, the energy duration of the vibration signal generated by the knocking will be correspondingly longer and will exceed the first time threshold. Therefore, in order to reduce misjudgment, in some embodiments, step S121 can include: in the case that the energy duration of the vibration signal is greater than the first time threshold, obtaining the maximum energy value of the vibration signal; and in the case that the maximum energy value of the vibration signal is greater than the first energy threshold and the energy duration of the vibration signal is less than the second time threshold, determining that there is a knocking operation on the set knocking surface of the household appliance.

[0075] In the embodiments of the present application, a plurality of vibration signals can be generated by a plurality of strikes with a greater force than a regular strike on the set striking surface through a plurality of experiments in advance. A first energy threshold can be determined according to a plurality of maximum energy values corresponding to the plurality of vibration signals, and stored.

[0076] In the embodiments of the present application, the maximum energy value of the vibration signal refers to the maximum energy in the process from generation to decay to 0 of the vibration signal. In one example, the maximum energy value of the vibration signal can be the maximum amplitude value of the vibration signal. In another example, the maximum energy value of the vibration signal can be the maximum energy value of the frequency domain signal corresponding to the vibration signal. Taking a signal composed of a plurality of signal segments collected in a plurality of sampling windows as an example, the maximum energy value of the frequency domain signal corresponding to the vibration signal is the maximum energy sum of the energy sum of the frequency domain signal corresponding to each signal segment in the plurality of signal segments in a set frequency band.

[0077] The second duration threshold in the embodiments of the present application is greater than the first duration threshold. The second duration threshold can be a threshold greater than the first duration threshold by one sampling window duration. In one example, the value of the second duration threshold can be reduced or enlarged based on the strike recognition accuracy.

[0078] In the embodiments of the present application, in the case that the maximum energy value of the vibration signal is greater than the first energy threshold and the energy duration of the vibration signal is greater than the second duration threshold, it is determined that there is no strike operation on the set striking surface of the household appliance.

[0079] Considering that the energy duration of the vibration signal generated by the user striking the set striking surface will not be too small, if the energy duration of the detected vibration signal is too small, the vibration signal can not be a vibration signal generated by a normal strike operation. Alternatively, the energy of the vibration signal generated by the user striking the set striking surface will not be too small, if the energy of the detected vibration signal is too small, the vibration signal can also not be a vibration signal generated by a normal strike operation. Therefore, in some embodiments, step S121 can include: in the case that the energy duration of the vibration signal is greater than a third duration threshold and less than or equal to the first duration threshold, it is determined that there is a strike operation on the set striking surface of the household appliance. The third duration threshold can be determined based on the minimum energy duration of the vibration signal generated by the strike operation.

[0080] In other embodiments, step S121 can include: in the case that the energy of the vibration signal is greater than a second energy threshold and the energy duration of the vibration signal is less than or equal to the first duration threshold, it is determined that there is a strike operation on the set striking surface of the household appliance.

[0081] In one example, the maximum energy value corresponding to the environmental noise can be collected, and the maximum energy value is taken as the second energy threshold. In this way, the phenomenon of the household appliance being controlled by mistake due to the environmental noise can be avoided.

[0082] In another example, the maximum energy values of the vibration signals generated by the multiple different set strength tapping operations obtained through multiple tests in advance can be taken as the third energy threshold. In another example, the maximum energy value corresponding to the vibration signal generated by the set strength tapping operation can be taken as the third energy threshold. In this way, the phenomenon of the household appliance being controlled by mistake due to the tapping with small strength caused by the user's unintentional touch can be avoided.

[0083] Through the control method of the embodiment, some abnormal tapping operations can be filtered, and the recognition accuracy of the user tapping operation is improved. In the case that the user tapping operation is correctly recognized, it is determined whether the tapping operation is the tapping operation on the set tapping surface.

[0084] In some other embodiments, the step S121 can include: in the case that the energy of the vibration signal is greater than the second energy threshold and the energy duration of the vibration signal is greater than the first duration threshold, obtaining the maximum energy value of the vibration signal; and in the case that the maximum energy value of the vibration signal is greater than the first energy threshold and the energy duration of the vibration signal is less than the second duration threshold, determining that there is the tapping operation on the set tapping surface of the household appliance.

[0085] In some embodiments, the step S130 can include: in the case that there is the tapping operation on the set tapping surface of the household appliance, and the tapping operation is the tapping operation of the user's finger, controlling the household appliance to perform the action instruction. In this way, the tapping operation of other hard objects can be filtered out, and the false triggering is avoided.

[0086] In the embodiments of the present application, it can be determined whether the tapping operation of the user's finger exists first, and then it is determined whether the tapping operation is on the set tapping surface. Alternatively, it can be determined whether the tapping operation on the set tapping surface exists first, and then it is determined whether the tapping operation is the tapping operation of the user's finger. Alternatively, it can be determined whether the tapping operation on the set tapping surface exists and whether the tapping operation is the tapping operation of the user's finger in parallel. Here, no specific limitation is made.

[0087] In the embodiments of the present application, the step of determining whether the tapping operation is the tapping operation of the user's finger can be implemented through the following steps S131 to step S132.

[0088] In the step S131, the frequency domain signal corresponding to the frequency domain of the vibration signal collected by the bone voiceprint sensor, the first energy value of the frequency domain signal in the first set frequency band, and the second energy value of the frequency domain signal in the second set frequency band are obtained.

[0089] In the embodiments of the present application, time-frequency conversion processing can be performed on the vibration signal collected by the bone voiceprint sensor to obtain a frequency domain signal corresponding to the frequency domain of the vibration signal. In one example, Fourier transform algorithm can be used on the vibration signal collected by the bone voiceprint sensor to convert the time domain vibration signal into a frequency domain signal corresponding to the frequency domain of the vibration signal. In one example, signal amplification, analog-to-digital conversion and time-frequency conversion processing can be sequentially performed on the vibration signal collected by the bone voiceprint sensor to obtain a frequency domain signal corresponding to the frequency domain of the vibration signal.

[0090] The frequency domain signal can be a frequency domain signal corresponding to the time domain vibration signal collected by the bone voiceprint sensor in a sampling window. Taking the sampling frequency of the bone voiceprint sensor as 8KHz and the number of sampling points as 256 as an example, Figure 3 The time domain digital signal after analog-to-digital conversion of the vibration signal collected by the bone voiceprint sensor in a sampling window is schematically shown, and the time domain digital signal is a 16ms long signal. The time domain digital signal is converted to the frequency domain, as shown in Figure 4 The frequency domain signal corresponding to the 16ms long vibration signal is obtained.

[0091] The first set frequency band in the embodiments of the present application is determined based on the energy concentration frequency band of a target vibration signal. The target vibration signal is a vibration signal collected by the bone voiceprint sensor in advance when a user's finger taps a home appliance. Figure 4 The frequency domain signal of the target vibration signal of the user's finger tapping the home appliance in the frequency domain is schematically shown. In Figure 4 In this example, the energy of the frequency domain signal of the target vibration signal is concentrated in the frequency band of 0KHz to 2KHz, and the energy in the frequency band higher than 2KHz is very weak. In this example, the first set frequency band can be, for example, the frequency band of 0KHz to 2KHz.

[0092] Figure 5 The frequency domain signal of the vibration signal of the other hard object tapping the home appliance in the frequency domain is schematically shown. In Figure 5 In this example, the energy of the frequency domain signal of the vibration signal is not only concentrated in the frequency band of 0KHz to 2KHz, but the energy in the other frequency band of 2KHz to 8KHz is also obvious. Therefore, whether the tapping operation of the user's finger tapping the home appliance exists can be determined according to the energy values in different frequency bands.

[0093] The second set frequency band in the embodiments of the present application is another frequency band different from the first set frequency band. In one example, each frequency component of the second set frequency band is greater than each frequency component of the first set frequency band. For example, the second set frequency band can be the frequency band of 6KHz to 8KHz.

[0094] In the embodiments of the present application, the spectral energy distribution of the first frequency domain signal can be obtained. The spectral energy distribution of the first frequency domain signal refers to the distribution of the total energy of the first frequency domain signal at different frequency components. It describes how the energy of the first frequency domain signal changes with frequency.

[0095] In one example, the energy value corresponding to each frequency component of the frequency domain signal corresponding to the vibration signal collected by the bone voiceprint sensor in the first set frequency band can be taken as the first energy value, and the energy value corresponding to each frequency component of the frequency domain signal in the second set frequency band can be taken as the second energy value.

[0096] In another example, the first energy value in the embodiments of the present application can be the energy accumulation of the frequency domain signal corresponding to the vibration signal collected by the bone voiceprint sensor in the first set frequency band, that is, the accumulation of the energy values of each frequency component of the frequency domain signal in the first set frequency band. The second energy value can be the energy accumulation of the frequency domain signal in the second set frequency band, that is, the accumulation of the energy values of each frequency component of the frequency domain signal in the second set frequency band. In this example, the energy accumulation of the frequency domain signal in the set frequency band refers to the energy value obtained by accumulating the energy of each frequency component in the set frequency band in the current sampling window. Taking the frequency domain signal with a sampling frequency of 8K and a sampling point number of 256 as an example, the energy accumulation of the frequency domain signal in the set frequency band is the energy value obtained by accumulating the energy of each frequency component in the set frequency band in 16ms.

[0097] The frequency domain signal can also be the frequency domain signal corresponding to the time domain vibration signal collected by the bone voiceprint sensor in a plurality of continuous sampling windows. In this example, the frequency domain signal corresponding to a signal segment of one sampling window can be used to determine whether the tapping operation is a tapping operation of the user's finger tapping. In this example, step S131 can include obtaining a third energy value of the frequency domain signal corresponding to a signal segment in the first set frequency band and a fourth energy value in the second set frequency band.

[0098] Step S132, determining whether there is a tapping operation of the user's finger tapping the household appliance according to the first energy value and the second energy value.

[0099] In one example, step S132 can include: in the case that the first energy value is greater than a third energy threshold and the second energy value is less than a fourth energy threshold, determining that there is a tapping operation of the user's finger tapping the household appliance. Or, in the case that the first energy value is greater than the third energy threshold and the second energy value is greater than the fourth energy threshold, determining that there is no tapping operation of the user's finger tapping the household appliance, that is, determining that there is a tapping operation of other hard objects tapping the household appliance. Or, in the case that the first energy value is less than the third energy threshold, determining that there is no tapping operation of the user's finger tapping the household appliance.

[0100] In one example, the third energy threshold can be determined based on an average of a plurality of maximum energy values generated by user finger tapping operations with different set intensities in the first set frequency band in a plurality of experiments. The second energy threshold can be determined based on an average of a plurality of maximum energy values generated by user finger tapping operations with different set intensities in the second set frequency band in a plurality of experiments.

[0101] In another example, the first energy threshold can be determined based on a maximum energy value generated by a user finger tapping operation with a set intensity in the first set frequency band. The second energy threshold can be determined based on a maximum energy value generated by a user finger tapping operation with a set intensity in the second set frequency band.

[0102] In one example, the third energy threshold can be the same as the second energy threshold.

[0103] In another example, the step S132 can include steps S1321-S1322.

[0104] In step S1321, an energy ratio of the first energy value and the second energy value is obtained.

[0105] In step S1322, whether the tapping operation of the user finger tapping the home appliance exists or not is determined according to the energy ratio of the first energy value and the second energy value.

[0106] In the embodiments of the present application, in the case that the energy ratio of the first energy value and the second energy value is within a set ratio range, it is determined that the tapping operation of the user finger tapping the home appliance does not exist.

[0107] In the embodiments of the present application, the energy ratio of the first energy value and the second energy value generated by the finger tapping and the energy ratio of the first energy value and the second energy value generated by the other hard object tapping can be determined respectively in advance under the same tapping intensity. The set ratio range can be obtained through a plurality of experiments. In one example, the set ratio range can be between 1 and 3. When the energy ratio of the first energy value and the second energy value is between 1 and 3, it is considered that the tapping is the other hard object tapping.

[0108] In step S1322, whether the tapping operation of the user finger tapping the home appliance exists or not is determined according to the energy ratio of the first energy value and the second energy value.

[0109] In one example, the set ratio range can be between 1 and 3. When the energy ratio of the first energy value and the second energy value exceeds 3, it is considered that the tapping is the user finger tapping.

[0110] In the example where the vibration signal collected by the bone-voiceprint sensor is a time-domain vibration signal collected in a plurality of continuous sampling windows, step S132 can include determining, according to the third energy value and the fourth energy value, whether the tapping operation of tapping the home appliance by the user's finger exists. The specific implementation can refer to the above-described embodiment corresponding to the time-domain vibration signal collected in one sampling window, and details are not repeated here.

[0111] The embodiment of the present application fully utilizes the frequency-domain characteristics of the frequency-domain signal corresponding to the vibration signal collected by the bone-voiceprint sensor, and determines whether the tapping operation of tapping by the user's finger exists through the energy values of different set frequency bands of the frequency-domain signal. In this way, the problem that the acceleration sensor has a low sampling rate and cannot determine whether it is a tapping operation of tapping by the finger through the frequency-domain signal is solved.

[0112] In some embodiments, it can be determined whether the tapping operation of tapping the home appliance exists first, and then it is determined whether the tapping operation is the tapping operation of tapping by the user's finger in the case where the tapping operation exists. Based on this, obtaining the second energy value of the frequency-domain signal in the second set frequency band in step S131 can include obtaining the second energy value of the frequency-domain signal in the second set frequency band in the case where the first energy value of the frequency-domain signal in the first set frequency band is greater than the second energy threshold.

[0113] In the embodiment of the present application, when the first energy value of the frequency-domain signal in the first set frequency band is greater than the second energy threshold, it can be determined that the tapping operation of tapping the home appliance exists. That is, after it is determined that the tapping operation of tapping the home appliance exists, the second energy value of the frequency-domain signal in the second set frequency band is obtained.

[0114] In one example, the energy accumulation sum of the frequency-domain signal in the first set frequency band can be obtained according to the spectral energy distribution of the frequency-domain signal, the tapping operation of tapping the home appliance is determined in the case where the energy accumulation sum in the first set frequency band is greater than the second energy threshold, the energy accumulation sum of the first frequency-domain signal in the second set frequency band is obtained, and the tapping operation is determined to be the tapping operation of tapping by the user's finger in the case where the energy accumulation sum in the second set frequency band is less than the fourth energy threshold.

[0115] The method of the embodiment only needs to obtain the second energy value of the second set frequency band after it is determined that the tapping operation exists, which can avoid unnecessary waste of resources.

[0116] In order to avoid the problem of false triggering caused by user misoperation, in some embodiments, step S130 can include steps S133 to S134.

[0117] Step S133, in the case that the first tapping operation on the setting tapping surface of the household appliance exists, detecting whether the second tapping operation on the setting tapping surface of the household appliance exists within a preset time range after the first tapping operation.

[0118] Step S134, in the case that the second tapping operation exists, controlling the household appliance to execute the action instruction.

[0119] In one example, Figure 6 The corresponding relationship between the first energy value (such as the first energy peak in the figure) corresponding to the first tapping operation and the energy value (such as the second energy peak in the figure) corresponding to the second tapping operation and time is schematically shown. Figure 6 Figure 6 In the case that the time length between the first energy peak and the second energy peak is within the preset time range, the household appliance is controlled to execute the action instruction.

[0120] It can be understood that the second preset time range in the embodiments of the present application can be determined according to the time range of the user's continuous tapping operation habit.

[0121] In one example, step S133 can include: in the case that the first tapping operation on the setting tapping surface of the household appliance exists and the first tapping operation is a tapping operation of the user's finger tapping, detecting whether the second tapping operation of the user's finger on the setting tapping surface of the household appliance exists within a preset time range after the first tapping operation.

[0122] The method of the present embodiment can avoid the false triggering problem caused by user misoperation. At the same time, the method is also applicable to the scene where the user's double tapping operation is required to control the execution of the action instruction.

[0123] The embodiments of the present application also provide a household appliance, which comprises: an osteo-voiceprint sensor, wherein the osteo-voiceprint sensor is used to collect a vibration signal, the vibration signal is used to determine whether a tapping operation on a setting tapping surface of the household appliance exists, and in the case that the tapping operation on the setting tapping surface of the household appliance exists, the household appliance is controlled to execute an action instruction.

[0124] The embodiments of the present application also provide a household appliance control device, as shown in Figure 7 The household appliance control device 1000 can comprise:

[0125] The acquisition module 1100 is used to acquire the vibration signal collected by the osteo-voiceprint sensor installed on the household appliance;

[0126] The determination module 1200 is used to determine whether a tapping operation on a setting tapping surface of the household appliance exists based on the vibration signal collected by the osteo-voiceprint sensor;

[0127] ​The control module 1300 is configured to control the home appliance to perform the action instruction in the case that the knocking operation of the set knocking surface of the home appliance exists.

[0128] The specific implementation of the steps in the device scheme in the embodiments of the present application has been described in detail in the home appliance control method embodiments, and will not be repeated here.

[0129] The embodiments of the present application also provide an electronic device, which comprises the home appliance control device 1000 provided in the device embodiments described above.

[0130] Alternatively, as shown in the following table, the electronic device 2000 comprises a memory 2100 and a processor 2200, the memory 2100 is configured to store computer instructions, and the processor 2200 is configured to call the computer instructions from the memory 2100 to execute any one of the home appliance control methods provided in the method embodiments described above. Figure 8

[0131] The embodiments of the present application also provide a computer readable storage medium, which stores a computer program, and the computer program implements any one of the home appliance control methods provided in the method embodiments described above when executed by a processor.

[0132] The present application can be a system, a method, and / or a computer program product. The computer program product can include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present application.

[0133] The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium can be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium include the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanism that reads a computer program from a computer program product, such as a punch card or a punch tape, or any suitable combination of the foregoing. The computer readable storage medium is not, however, a transitory signal per se, such as a radio wave or other freely propagating electromagnetic wave, an electromagnetic wave propagating through a waveguide or other transmission media (e.g., an optical pulse through a fiber-optic cable), or an electrical signal through an electrical cable.

[0134] ​Computer readable program instructions described herein can be downloaded to respective computing / processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and / or a wireless network. The network can comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and / or edge servers. A network adapter card or network interface in each computing / processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing / processing device.

[0135] Computer readable program instructions for carrying out operations of the present application can be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions can execute entirely on the user's computing / processing device, partly on the user's computing / processing device, as a stand-alone software package, partly on the user's computing / processing device and partly on a remote computing / processing device or entirely on the remote computing / processing device or server. In the latter scenario, the remote computing / processing device can be connected to the user's computing / processing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computing / processing device, for example, through the Internet using an Internet Service Provider. In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) can execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present application.

[0136] The computer readable program instructions can also be loaded onto a computing / processing device, other programmable data processing apparatus, or other device to cause a series of operations to be performed on the computing / processing device, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computing / processing device, other programmable apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0137] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can be a computer- readable storage medium having no data, programs, program modules, e.g., instructions for operation, or digital content stored thereon or therein for a short time or not at all. The computer readable storage medium can also have instructions stored thereon or therein which may

[0138] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0139] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0140] Having described various embodiments of the application, it is to be understood that the above description is meant not to limit and not to encompass all of the possible embodiments. Many modifications and variations of this application can be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The use of the terms "including", "containing", etc. are meant to encompass the items listed thereafter, but do not preclude the presence or addition of one or more other items. It is intended that the scope of the application be defined by the following claims.

Claims

1. A home appliance control method, characterized by, The method comprises: obtaining a vibration signal collected by a bone-voiceprint sensor installed on a household appliance; based on the vibration signal, determining whether there is a knocking operation on a set knocking surface of the household appliance; in the case where there is a knocking operation on the set knocking surface of the household appliance, controlling the household appliance to execute an action instruction.

2. The method of claim 1, wherein, The determination of whether there is a knocking operation on the set knocking surface of the household appliance based on the vibration signal comprises: based on the energy duration of the vibration signal, determining whether there is a knocking operation on the set knocking surface of the household appliance; wherein the energy duration of the vibration signal generated by the set knocking surface is different from the energy duration of the vibration signal generated by other non-knocking surfaces.

3. The method of claim 2, wherein, The determination of whether there is a knocking operation on the set knocking surface of the household appliance based on the energy duration of the vibration signal comprises: in the case where the energy duration is less than or equal to a first time threshold, it is determined that there is a knocking operation on the set knocking surface of the household appliance.

4. The method of claim 2, wherein, The determination of whether there is a knocking operation on the set knocking surface of the household appliance based on the energy of the vibration signal comprises: in the case where the energy duration is greater than a first time threshold, obtaining a maximum energy value of the vibration signal; in the case where the maximum energy value is greater than an energy threshold and the energy duration is less than a second time threshold, it is determined that there is a knocking operation on the set knocking surface of the household appliance; wherein the first time threshold is less than the second time threshold.

5. The method of claim 1, wherein, The control of the household appliance to execute an action instruction in the case where there is a knocking operation on the set knocking surface of the household appliance comprises: in the case where there is a knocking operation on the set knocking surface of the household appliance and the knocking operation is a user finger knocking operation, controlling the household appliance to execute an action instruction.

6. The method of claim 5, wherein, The method further comprises: obtaining a frequency domain signal corresponding to a frequency domain of the vibration signal, a first energy value of the frequency domain signal in a first set frequency band, and a second energy value of the frequency domain signal in a second set frequency band, the first set frequency band being determined based on an energy concentration frequency band of a target vibration signal, the target vibration signal being a vibration signal of a user finger knocking the household appliance collected in advance by the bone-voiceprint sensor; determining whether the knocking operation is a user finger knocking operation according to the first energy value and the second energy value.

7. The method of claim 6, wherein, The determination of whether the knocking operation is a user finger knocking operation according to the first energy value and the second energy value comprises: obtaining an energy ratio of the first energy value and the second energy value; determining whether the knocking operation is a user finger knocking operation according to the energy ratio of the first energy value and the second energy value.

8. An electric home appliance characterized by comprising: The method comprises: a bone-voiceprint sensor, wherein the bone-voiceprint sensor is used to collect a vibration signal, and the vibration signal is used to determine whether there is a knocking operation on a set knocking surface of a household appliance, so as to control the household appliance to execute an action instruction in the case where there is a knocking operation on the set knocking surface of the household appliance.

9. An electronic device, comprising: A computer program product comprising a memory for storing computer instructions and a processor for invoking the computer instructions from the memory to perform the method of any of claims 1-7.

10. A computer-readable storage medium, characterized in that, A computer program product comprising a memory for storing computer instructions and a processor for invoking the computer instructions from the memory to perform the method of any of claims 1-7.

Images