Household appliance control method and device, medium and equipment

Abstract

The invention discloses a household appliance control method and device, a medium and equipment. The method comprises the following steps: acquiring a vibration signal acquired by a bone voiceprint sensor deployed in a household appliance within a sampling time length; based on the vibration signal, determining whether a first knocking operation of knocking the household appliance by a user exists or not; and under the condition that the first knocking operation of knocking the household appliance by the user exists, controlling the household appliance to execute an action instruction.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of home appliance control, and more particularly, to a home appliance control method, a home appliance control apparatus, a storage medium, a home appliance, and an electronic device. BACKGROUND

[0002] With the rapid development of smart home technology, people have higher requirements for the operation convenience of home appliances. Traditional home appliance control methods mainly rely on keys, remote controls, or touch screens, and the like to achieve control. These control methods have certain limitations in specific scenarios, such as when a user's hands are occupied and the user cannot conveniently operate. In order to solve this problem, various home appliance control schemes based on tapping have been proposed in the industry.

[0003] In related technologies, there are some schemes for controlling home appliances to automatically open and close doors. For example, a piezoelectric sensor is used to sense a user's tapping operation to control the home appliance to automatically open and close the door. However, the piezoelectric sensor has a complex process and is expensive, and the tapping position is usually limited to the installation position of the sensor, which results in poor user experience. For another example, an acceleration sensor is used to sense a user's tapping operation to control the home appliance to automatically open and close the door. However, this scheme has poor flexibility and is easily triggered by other environmental vibrations, which leads to misoperation of the home appliance and affects normal use by the user. SUMMARY

[0004] An object of the present application is to provide a new technical solution for controlling a home appliance.

[0005] According to a first aspect of the present application, a home appliance control method is provided, comprising:

[0006] obtaining a vibration signal collected by an osteophony sensor deployed on a home appliance within a sampling duration;

[0007] determining, based on the vibration signal, whether a first tapping operation of tapping the home appliance by a user exists;

[0008] in a case where the first tapping operation of tapping the home appliance by the user exists, controlling the home appliance to execute an action instruction.

[0009] Optionally, the determining, based on the vibration signal, whether the first tapping operation of tapping the home appliance by the user exists comprises:

[0010] obtaining a frequency domain signal corresponding to a frequency domain of the vibration signal and a spectral energy distribution of the frequency domain signal;

[0011] determining, according to the spectral energy distribution of the frequency domain signal, whether the first tapping operation of tapping the home appliance by the user exists.

[0012] Optionally, the determining, according to the spectral energy distribution of the frequency domain signal, whether the first knocking operation of the user knocking the home appliance exists, comprises:

[0013] The energy accumulation sum of the frequency domain signal in a set frequency band is obtained according to the spectral energy distribution of the frequency domain signal.

[0014] In a case where the energy accumulation sum is greater than an energy threshold, it is determined that the first knocking operation of the user knocking the home appliance exists.

[0015] Optionally, the determining, in a case where the energy accumulation sum is greater than an energy threshold, that the first knocking operation of the user knocking the home appliance exists, comprises:

[0016] A plurality of energy accumulation sums corresponding to vibration signals collected in a plurality of continuous sampling time lengths are obtained.

[0017] In a case where a duration in which the plurality of energy accumulation sums are all greater than an energy threshold is within a first preset time length range, it is determined that the first knocking operation of the user knocking the home appliance exists.

[0018] Optionally, the obtaining of the frequency domain signal corresponding to the frequency domain of the vibration signal comprises:

[0019] The vibration signal is sequentially subjected to signal amplification, analog-to-digital conversion, and time-frequency conversion processing to obtain the frequency domain signal corresponding to the frequency domain of the vibration signal.

[0020] Optionally, the controlling, in a case where the first knocking operation of the user knocking the home appliance exists, of the home appliance to execute an action instruction, comprises:

[0021] In a case where the first knocking operation of the user knocking the home appliance exists, it is detected whether a second knocking operation of the user knocking the home appliance exists within a second preset time length range after the first knocking operation.

[0022] In a case where the second knocking operation exists, the home appliance is controlled to execute an action instruction.

[0023] According to a second aspect of the present application, a home appliance is provided, comprising:

[0024] The bone acoustic print sensor is configured to collect a vibration signal, and the vibration signal is configured to determine whether a knocking operation of the user knocking the home appliance exists, so as to control the home appliance to execute an action instruction in a case where the knocking operation of the user knocking the home appliance exists.

[0025] According to a third aspect of the present application, a home appliance control device is provided, comprising:

[0026] obtain a vibration signal collected by an osteo-sonic sensor deployed on the home appliance device;

[0027] determine, based on the vibration signal, whether there is a first knocking operation of knocking the home appliance device by a user;

[0028] control the home appliance device to execute an action instruction in a case where there is the first knocking operation of knocking the home appliance device by the user.

[0029] According to a fourth aspect of the present application, an electronic device is provided, which comprises the apparatus according to the third aspect;

[0030] Alternatively, the electronic device comprises a memory and a processor, the memory is configured to store computer instructions, and the processor is configured to invoke the computer instructions from the memory to execute the method according to any one of the first aspect.

[0031] According to a fifth aspect of the present application, a computer readable storage medium is provided, which stores a computer program, the computer program is executed by a processor to implement the method according to any one of the first aspect.

[0032] The present application first applies the osteo-sonic sensor to the control of the home appliance device, collects the vibration signal by the osteo-sonic sensor, determines whether there is the knocking operation of knocking the home appliance device by the user based on the vibration signal, and controls the home appliance device to execute the action instruction in a case where there is the knocking operation of knocking the home appliance device by the user. The price of the osteo-sonic sensor is more advantageous than that of the piezoelectric sensor, which can reduce the cost. At the same time, the osteo-sonic sensor can sense the knocking at any position on the surface of the home appliance device, so that the knocking position is not limited, and the convenience of user operation is improved. In addition, the osteo-sonic sensor can support a higher sampling frequency, which can more accurately capture the characteristics of the vibration signal. The osteo-sonic sensor also has a higher signal-to-noise ratio, which can effectively distinguish the knocking signal from the environmental noise, so as to more accurately identify the knocking operation of the user, effectively avoid the false triggering problem, and improve the reliability of the control of the home appliance device.

[0033] Other features and advantages of the present application will become apparent from the following detailed description of exemplary embodiments thereof, taken in conjunction with the accompanying drawings. BRIEF DESCRIPTION OF DRAWINGS

[0034] The accompanying drawings incorporated in and forming a part of the specification, illustrate embodiments of the present application and, together with the description, serve to explain the principles of the application.

[0035] Figure 1 is a flow diagram of a home appliance control method provided according to an embodiment of the present application;

[0036] Figure 2 FIG. 7 is a schematic diagram of a time-domain vibration signal collected by a bone-voiceprint sensor according to an embodiment of the present application;

[0037] Figure 3 FIG. 8 is a schematic diagram of a frequency-domain signal corresponding to the time-domain vibration signal according to an embodiment of the present application;

[0038] Figure 4 FIG. 9 is a schematic diagram of a corresponding relationship between a first energy accumulation sum corresponding to a first knocking operation and an energy accumulation sum corresponding to a second knocking operation and time according to an embodiment of the present application;

[0039] Figure 5 FIG. 10 is a schematic block diagram of a home appliance control device according to an embodiment of the present application.

[0040] Figure 6 FIG. 11 is a schematic block diagram of an electronic device according to an embodiment of the present application. DETAILED DESCRIPTION

[0041] Various exemplary embodiments of the present application will now be described in detail with reference to the accompanying drawings. It should be noted that the relative arrangement of the components and steps set forth in the embodiments, the numerical expressions, and the numerical values are not limiting to the scope of the present application unless otherwise specifically stated.

[0042] The following description of at least one exemplary embodiment is merely exemplary in nature and is in no way intended to limit the scope of the application, its application, or uses.

[0043] Techniques, methods, and devices known to those of ordinary skill in the relevant art can not be discussed in detail herein. However, where appropriate, such techniques, methods, and devices can be viewed as part of the specification and can be claimed as such.

[0044] In all of the examples shown and discussed herein, any specific values should be interpreted as merely exemplary and not as a limitation on the scope of the exemplary embodiments. Thus, other examples of the exemplary embodiments can have different values.

[0045] It should be noted that like numbers and letters refer to like items throughout the drawings, and that, once an item is defined in one drawing, it should not require further discussion in subsequent drawings.

[0046] With the development of smart home appliance technology, the interactive control between home appliances and users is becoming more and more diversified, such as automatic door opening or automatic door closing of a home appliance by sensing a user operation.

[0047] Some solutions exist in the related art for controlling the automatic opening and closing of household appliances. For example, piezoelectric sensors can be used to sense a user's tapping operation to control the automatic opening and closing of household appliances. However, piezoelectric sensors are complex and expensive to manufacture. Furthermore, based on the sensing principle of piezoelectric sensors, it is understood that when using piezoelectric sensors to detect user tapping operations, the user must tap at the piezoelectric sensor's location for the piezoelectric sensor to detect the user's tapping operation, which means that there are restrictions on the tapping location.

[0048] Some related technologies also exist for controlling the automatic opening and closing of household appliances. For example, an accelerometer can sense a user's tapping operation to control the automatic opening and closing of household appliances. However, this solution is inflexible and prone to false triggering. The applicant has discovered that the accelerometer solution is prone to false triggering due to its low supported sampling frequency and limited detection accuracy, making it prone to false triggering.

[0049] Based on this, the applicant applied the bone voiceprint sensor to the control of household appliances for the first time. When the user knocks on the household appliance, the generated vibration signal is transmitted to the bone voiceprint sensor through the housing of the household appliance, causing the air in the sealed cavity of the bone voiceprint sensor to be compressed. The diaphragm in the bone voiceprint sensor senses the air compression, thereby collecting the vibration signal. Therefore, the household appliance control scheme of the embodiment of the present application does not have any restrictions on the knocking position, and the price of the bone voiceprint sensor is more advantageous than that of the piezoelectric sensor, which can solve the technical problems existing in the piezoelectric ceramic solution. In addition, the bone voiceprint sensor can support a higher sampling rate and have a higher signal-to-noise ratio, with higher detection accuracy, so it is easier to avoid false triggering.

[0050] The embodiment of the present application provides a method for controlling a household appliance. Figure 1 The method may include steps S110 to S130.

[0051] Step S110: obtaining a vibration signal collected by a bone voiceprint sensor deployed on a home appliance within a sampling period.

[0052] In the embodiment of the present application, the household appliance may be, for example, a refrigerator, a washing machine, a microwave oven, or other household appliance with a door opening and closing function.

[0053] In an embodiment of the present application, a bone voiceprint sensor can be installed on the surface or internal structure of a household appliance to collect vibration signals applied to the surface of the household appliance in real time. The specific deployment location of the bone voiceprint sensor can be determined based on design requirements. For example, it can be deployed in the front door panel of the household appliance, in the side panel of the household appliance, or in the upper panel of the household appliance. In one example, the bone voiceprint sensor can be embedded in any position in the front door panel of the household appliance that is convenient for collecting vibration signals from user tapping operations.

[0054] In the embodiment of the present application, the bone conduction sensor can support a higher sampling frequency, for example, 8KHz. Taking 256 sampling points as an example, the sampling time length is 16ms, and the vibration signal is a time domain signal lasting for 16ms.

[0055] In step S120, whether the first knocking operation of the user knocking the household appliance is determined based on the vibration signal collected by the bone conduction sensor.

[0056] In one example, the collected vibration signal can be sequentially subjected to signal amplification and analog-to-digital conversion processing to obtain a processed vibration signal. Whether the first knocking operation of the user knocking the household appliance is determined based on the processed vibration signal. For example, the vibration signal collected by the bone conduction sensor is output in the form of a voltage signal. The weak voltage signal can be amplified to a suitable level for processing by a signal amplification circuit (for example, a low-noise amplifier) to obtain an amplified signal. The amplified signal can be an analog signal. The amplified analog signal is input into an analog-to-digital conversion circuit (for example, a high-precision ADC chip) to convert the amplified analog signal to obtain a digital signal. The digital signal is a time domain digital signal corresponding to the vibration signal collected by the bone conduction sensor. The time domain digital signal can reflect the vibration frequency and energy size of the vibration signal. In this example, whether the first knocking operation of the user knocking the household appliance is determined based on the time domain digital signal.

[0057] In another example, the time domain vibration signal can be converted to a frequency domain to obtain a frequency domain signal corresponding to the frequency domain of the vibration signal. Whether the first knocking operation of the user knocking the household appliance is determined based on the frequency domain signal.

[0058] In one example, the energy size of the vibration signal or the energy size of the frequency domain signal corresponding to the vibration signal can be understood as the size of the signal amplitude.

[0059] In step S130, the household appliance is controlled to execute the action instruction in the case where the first knocking operation of the user knocking the household appliance exists.

[0060] In one example, the action instruction in the embodiment of the present application can include any one of the instructions of opening the door, closing the door, and starting.

[0061] In the embodiment of the present application, the current state of the door panel of the household appliance can be obtained in the case where the first knocking operation of the user knocking the household appliance exists. The household appliance is controlled to execute the opening door or closing door instruction according to the current state of the door panel of the household appliance. Specifically, if the current state of the door panel of the household appliance is the closed door state, the household appliance is controlled to open the door. If the current state of the door panel of the household appliance is the open door state, the household appliance is controlled to close the door.

[0062] In the embodiments of the present application, it can be pre-configured that the home appliance device is controlled to execute the action instruction in the case that one tapping operation of the user is detected. Alternatively, it can be pre-configured that the home appliance device is controlled to execute the action instruction in the case that multiple continuous tapping operations of the user are detected. In one example, it can be configured that the home appliance device is controlled to close the door in the case that one tapping operation of the user is detected; or the home appliance device is controlled to open the door in the case that two continuous tapping operations of the user are detected; or the home appliance device is controlled to start in the case that three continuous tapping operations of the user are detected.

[0063] In the embodiments of the present application, the home appliance device can also be controlled to execute the action instruction according to the current state of the door panel of the home appliance device and the number of detected tapping operations of the user. In one example, the home appliance device is controlled to open the door in the case that the current state of the door panel of the home appliance device is closing and the number of tapping operations of the user is two. The home appliance device is controlled to close the door in the case that the current state of the door panel of the home appliance device is opening and the number of tapping operations of the user is one. The home appliance device is controlled to start in the case that the current state of the door panel of the home appliance device is closing and the number of tapping operations of the user is three.

[0064] The present application first applies the bone soundprint sensor to the control of the home appliance device. The vibration signal is collected by the bone soundprint sensor. It is determined whether there is a tapping operation of the user tapping the home appliance device based on the vibration signal. The home appliance device is controlled to execute the action instruction in the case that there is a tapping operation of the user tapping the home appliance device. The bone soundprint sensor has a more advantageous price than the piezoelectric sensor, which can reduce the cost. At the same time, the bone soundprint sensor can sense tapping at any position on the surface of the home appliance device, so that the tapping position is not limited, and the convenience of user operation is improved. In addition, the bone soundprint sensor can support a higher sampling frequency, which can more accurately capture the characteristics of the vibration signal. The bone soundprint sensor also has a higher signal-to-noise ratio, which can effectively distinguish the tapping signal from the environmental noise, so as to more accurately identify the tapping operation of the user, effectively avoid the problem of false triggering, and improve the reliability of the control of the home appliance device.

[0065] Since the bone soundprint sensor has the advantage of supporting a higher sampling frequency, the time-domain vibration signal collected by the bone soundprint sensor can be converted to the frequency domain to obtain a frequency-domain signal corresponding to the frequency domain of the vibration signal, so that the vibration signal can work in the frequency domain. Thus, it can be determined whether there is a first tapping operation of the user tapping the home appliance device based on the frequency-domain signal. Based on this, in some embodiments, step S120 can include steps S121 to S122.

[0066] In step S121, the frequency-domain signal corresponding to the frequency domain of the vibration signal collected by the bone soundprint sensor and the spectral energy distribution of the frequency-domain signal are obtained.

[0067] In the embodiment of the present application, time-frequency conversion processing can be performed on the vibration signal collected by the bone voiceprint sensor to obtain a frequency domain signal corresponding to the frequency domain of the vibration signal. In one example, Fourier transform algorithm can be used on the vibration signal collected by the bone voiceprint sensor to convert the time domain vibration signal into a frequency domain signal corresponding to the frequency domain of the vibration signal. In one example, signal amplification, analog-to-digital conversion and time-frequency conversion processing can be sequentially performed on the vibration signal collected by the bone voiceprint sensor to obtain a frequency domain signal corresponding to the frequency domain of the vibration signal. The frequency domain signal is a frequency domain signal corresponding to the time domain vibration signal collected by the bone voiceprint sensor at each sampling.

[0068] The frequency spectrum energy distribution of the frequency domain signal in the embodiment of the present application refers to the distribution of the total energy of the frequency domain signal at different frequency components. It describes how the signal energy changes with the change of frequency.

[0069] Taking the sampling frequency as 8K and the sampling point number as 256 as an example, Figure 2 The time domain vibration signal collected by the bone voiceprint sensor after digital-to-analog conversion is schematically shown, i.e., a 16ms time length time domain vibration signal. The time domain vibration signal is converted to the frequency domain, as shown in Figure 3 The frequency domain signal corresponding to the vibration signal in the 0KHz to 8KHz (i.e., 8000Hz) frequency band is obtained. It can be seen that the frequency domain signal has multiple large energy values in the 0KHz to 2KHz frequency band, and the energy values are almost 0 in the 2KHz to 8KHz frequency band.

[0070] Step S122, according to the frequency spectrum energy distribution of the frequency domain signal, it is determined whether there is a first knocking operation of the user knocking the household appliance.

[0071] In one example, step S122 can include: in the case that the frequency spectrum energy distribution of the frequency domain signal represents that the frequency domain signal has at least one frequency component corresponding to an energy value greater than a first energy threshold in a set frequency band, it is determined that there is a first knocking operation of the user knocking the household appliance.

[0072] In one example, step S122 can include: according to the frequency spectrum energy distribution of the frequency domain signal, an energy accumulation sum of the frequency domain signal in a set frequency band is obtained; in the case that the energy accumulation sum is greater than a second energy threshold, it is determined that there is a first knocking operation of the user knocking the household appliance. In this example, the energy accumulation sum of the frequency domain signal in the set frequency band refers to the energy value obtained by accumulating the energy of the set frequency band in the current sampling duration. Taking the frequency domain signal corresponding to the sampling frequency of 8K and the sampling point number of 256 as an example, the energy accumulation sum of the frequency domain signal in the set frequency band is the energy value obtained by accumulating the energy of the set frequency band in 16ms.

[0073] The frequency band in the embodiments of the present application can be set according to the frequency band in the set of vibration signals generated by the user's tapping action, for example, the frequency band can be 0KHz to 2KHz.

[0074] The energy threshold in the embodiments of the present application can be set according to experiments, for example, it can be set to a value that can effectively distinguish between user tapping vibration and vibration caused by environmental noise.

[0075] In the present embodiment, the advantage of high sampling frequency of the bone voiceprint sensor is effectively utilized, and the frequency spectrum energy distribution of the vibration signal collected by the bone voiceprint sensor in the frequency domain is used to determine the user's tapping operation, effectively reducing the occurrence of problems such as low recognition rate and high false triggering rate caused by low sampling frequency of the acceleration sensor.

[0076] Considering that when the energy of a signal is too large or too small, that is, the duration is too long or too short, the signal can not be a normal tapping signal, therefore, in some embodiments, in the case where the energy accumulation sum is greater than the second energy threshold, the step of determining that the first tapping operation of tapping the home appliance by the user exists can include: obtaining a plurality of energy accumulation sums corresponding to the vibration signals collected in a plurality of sampling time lengths; in the case where the duration in which the plurality of energy accumulation sums are all greater than the second energy threshold is within the first preset time length range, determining that the first tapping operation of tapping the home appliance by the user exists.

[0077] In one example, in the case where it is detected that the energy accumulation sum corresponding to the vibration signal collected in the current sampling time length is greater than the second energy threshold, the energy accumulation sum corresponding to the vibration signal collected in the next sampling time length can be continuously obtained. Each time an energy accumulation sum is obtained and the energy accumulation sum is greater than the second energy threshold, the duration in which the energy accumulation sum is greater than the second energy threshold is accumulated. If the duration in which the energy accumulation sum is greater than the second energy threshold obtained finally is less than the minimum value of the first preset time length range, it is determined that the first tapping operation of tapping the home appliance by the user does not exist. If the duration in which the energy accumulation sum is greater than the second energy threshold obtained finally is greater than the maximum value of the first preset time length range, it is also determined that the first tapping operation of tapping the home appliance by the user does not exist. If the duration in which the energy accumulation sum is greater than the second energy threshold obtained finally is within the first preset time length range, it is determined that the first tapping operation of tapping the home appliance by the user exists.

[0078] For example, taking the sampling duration as 16 ms and the first preset duration range as 16 ms to 80 ms, in a case where it is detected that the energy accumulation corresponding to the vibration signal collected in the first 16 ms is greater than the second energy threshold, the duration for which the energy accumulation is greater than the second energy threshold is accumulated by one sampling duration, at this time the accumulated duration is 16 ms, then the energy accumulation corresponding to the vibration signal collected in the second 16 ms is continuously acquired. In a case where it is detected that the energy accumulation corresponding to the vibration signal collected in the second 16 ms is greater than the second energy threshold, the duration for which the energy accumulation is greater than the second energy threshold is accumulated by one sampling duration, at this time the accumulated duration is 32 ms, then the energy accumulation corresponding to the vibration signal collected in the third 16 ms is continuously acquired. In a case where it is detected that the energy accumulation corresponding to the vibration signal collected in the third 16 ms is greater than the second energy threshold, the duration for which the energy accumulation is greater than the second energy threshold is continuously accumulated by one sampling duration, at this time the accumulated duration is 48 ms, then the energy accumulation corresponding to the vibration signal collected in the fourth 16 ms is continuously acquired. In a case where it is detected that the energy accumulation corresponding to the vibration signal collected in the fourth 16 ms is greater than the second energy threshold, the duration for which the energy accumulation is greater than the second energy threshold is continuously accumulated by one sampling duration, at this time the accumulated duration is 64 ms, then the energy accumulation corresponding to the vibration signal collected in the fifth 16 ms is continuously acquired. In a case where it is detected that the energy accumulation corresponding to the vibration signal collected in the fifth 16 ms is less than the second energy threshold, it is determined that the first knocking operation of the user knocking the home appliance exists. In a case where it is detected that the energy accumulation corresponding to the vibration signal collected in the fifth 16 ms is greater than the second energy threshold, the duration for which the energy accumulation is greater than the second energy threshold is continuously accumulated by one sampling duration, at this time the accumulated duration is 80 ms, then the energy accumulation corresponding to the vibration signal collected in the sixth 16 ms is continuously acquired. In a case where it is detected that the energy accumulation corresponding to the vibration signal collected in the sixth 16 ms is greater than the second energy threshold, the duration for which the energy accumulation is greater than the second energy threshold is continuously accumulated by one sampling duration, at this time the accumulated duration is 96 ms, then it is determined that the first knocking operation of the user knocking the home appliance does not exist.

[0079] Through the method of the embodiment, some non-normal knocking operations can be filtered, and the recognition accuracy of the user knocking operation is improved.

[0080] In order to avoid the false triggering problem caused by user misoperation, in some embodiments, step S130 can include steps S131 to S132.

[0081] Step S131, in the case that the first knock operation of the user knocking the home appliance exists, it is detected whether the second knock operation of the user knocking the home appliance exists within the second preset time length range after the first knock operation.

[0082] Step S132, in the case that the second knock operation exists, the home appliance is controlled to execute the action instruction.

[0083] In one example, Figure 4 The first energy accumulation corresponding to the first knock operation (such as the first energy peak in the middle) and the energy accumulation corresponding to the second knock operation (such as the second energy peak in the middle) are schematically shown corresponding to the time. In the case that the time length between the first energy peak and the second energy peak is within the second preset time length range, the home appliance is controlled to execute the action instruction. Figure 4 Figure 4 It can be understood that the second preset time length range in the embodiment of the application is greater than the first preset time length range. The second preset time length range can be determined according to the time length range of the user's continuous knock operation habit. In one example, the second preset time length range can be set to 500ms to 2000ms.

[0084] It can be understood that the second preset time length range in the embodiment of the application is greater than the first preset time length range. The second preset time length range can be determined according to the time length range of the user's continuous knock operation habit. In one example, the second preset time length range can be set to 500ms to 2000ms.

[0085] The method of the embodiment can avoid the false triggering problem caused by the user's misoperation.

[0086] The embodiment of the application also provides a home appliance, which comprises: a bone voiceprint sensor, wherein the bone voiceprint sensor is used to collect a vibration signal, the vibration signal is used to determine whether a knock operation of the user knocking the home appliance exists, and in the case that the knock operation of the user knocking the home appliance exists, the home appliance is controlled to execute an action instruction.

[0087] The embodiment of the application also provides a home appliance control device, as shown in Figure 5 The home appliance control device 1000 can comprise:

[0088] The acquisition module 1100 is used to acquire the vibration signal collected by the bone voiceprint sensor arranged on the home appliance;

[0089] The determination module 1200 is used to determine whether the first knock operation of the user knocking the home appliance exists based on the vibration signal collected by the bone voiceprint sensor.

[0090] The control module 1300 is used to control the home appliance to execute the action instruction in the case that the first knock operation of the user knocking the home appliance exists.

[0091] ​The specific implementation manners of the steps in the device scheme in the embodiments of the present application have been described in detail in the method embodiments for controlling the household appliance, which will not be repeated here.

[0092] The embodiments of the present application further provide an electronic device, which comprises the household appliance control device 1000 provided in the device embodiments above.

[0093] Alternatively, as shown in FIG. 2, the electronic device 2000 comprises a memory 2100 and a processor 2200, the memory 2100 is configured to store computer instructions, and the processor 2200 is configured to call the computer instructions from the memory 2100 to execute any one of the household appliance control methods provided in the method embodiments above. Figure 6

[0094] The embodiments of the present application further provide a computer readable storage medium, which stores a computer program, and the computer program is configured to implement any one of the household appliance control methods provided in the method embodiments above when executed by a processor.

[0095] The present application can be a system, a method, and / or a computer program product. The computer program product can include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present application.

[0096] The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium can be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. More specific examples (a non-exhaustive list) of the computer readable storage medium include the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or punched tape, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.

[0097] ​Computer readable program instructions described herein can be downloaded to respective computing / processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and / or a wireless network. The network can comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and / or edge servers. A network adapter card or network interface in each computing / processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing / processing device.

[0098] Computer readable program instructions for carrying out operations of the present application can be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the "C" programming language or similar programming languages. The computer readable program instructions can execute entirely on the user's computing / processing device, partly on the user's computing / processing device, as a stand-alone software package, partly on the user's computing / processing device and partly on a remote computing / processing device or entirely on the remote computing / processing device or server. In the latter scenario, the remote computing / processing device can be connected to the user's computing / processing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection can be made to an external computing / processing device, for example, through the Internet using an Internet Service Provider. In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate array (FPGA), or programmable logic array (PLA) can execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present application.

[0099] The computer readable program instructions can also be loaded onto a computing / processing device, other programmable data processing apparatus, or other device to cause a series of operations to be performed on the computing / processing device, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computing / processing device, other programmable apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0100] These computer readable program instructions can be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions / acts specified in the flowchart and / or block diagram block or blocks. These computer readable program instructions can also be stored in a computer readable storage medium that can include a non-transitory computer readable storage medium that can be a computer- readable storage medium having no data, programs, program modules, e.g., instructions for operation, or digital content stored thereon or therein for a short time or not at all. The computer readable storage medium can also have instructions stored thereon or therein which may

[0101] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0102] The computer readable program instructions can also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable data processing apparatus, or other device implement the functions / acts specified in the flowchart and / or block diagram block or blocks.

[0103] Having described various embodiments of the application, it is to be understood that the above description is meant not to be exhaustive or limited to the various embodiments disclosed. Many modifications and variations are possible in light of the above teachings without departing from the scope and spirit of the described embodiments. It is also to be understood that the terminology used herein is for the purpose of describing particular embodiments only, and is not intended to limit the scope of the various embodiments described herein. It is also to be understood that any feature described herein can be included with any of the various embodiments described herein, unless otherwise specified.

Claims

1. A method for controlling household appliances, characterized in that: include: Obtain the vibration signal collected by the bone voiceprint sensor deployed in the home appliance within the sampling period; determining, based on the vibration signal, whether a first tapping operation of the user tapping the household appliance exists; When a first tapping operation is performed by a user tapping the home appliance, the home appliance is controlled to execute an action instruction.

2. The method according to claim 1, characterized in that The determining, based on the vibration signal, whether a first tapping operation of the user tapping the household appliance occurs includes: Acquire a frequency domain signal corresponding to the frequency domain of the vibration signal and a spectrum energy distribution of the frequency domain signal; Determine whether a first tapping operation of the user tapping the household appliance occurs according to the spectrum energy distribution of the frequency domain signal.

3. The method according to claim 2, characterized in that The determining, based on the spectrum energy distribution of the frequency domain signal, whether a first tapping operation of the user tapping the household appliance occurs includes: Obtaining an energy accumulation sum of the frequency domain signal within a set frequency band according to the spectrum energy distribution of the frequency domain signal; When the accumulated energy is greater than the energy threshold, it is determined that a first tapping operation of the user tapping the household appliance occurs.

4. The method according to claim 3, characterized in that When the accumulated energy is greater than the energy threshold, determining that a first tapping operation of the user tapping the household appliance occurs includes: Obtaining a plurality of energy accumulation sums corresponding to vibration signals collected over a plurality of consecutive sampling periods; When the duration during which the cumulative sum of multiple energies is greater than the energy threshold is within a first preset duration range, it is determined that a first tapping operation of the user tapping the household appliance occurs.

5. The method according to any one of claims 2 to 4, characterized in that The obtaining of a frequency domain signal corresponding to the frequency domain of the vibration signal includes: The vibration signal is sequentially subjected to signal amplification, analog-to-digital conversion, and time-frequency conversion to obtain a frequency domain signal corresponding to the frequency domain of the vibration signal.

6. The method according to claim 1, characterized in that When a user performs a first tapping operation on the home appliance, controlling the home appliance to execute an action instruction includes: In a case where a user performs a first tapping operation on the home appliance, detecting whether the user performs a second tapping operation on the home appliance within a second preset time period after the first tapping operation; In the case where the second tapping operation occurs, the home appliance is controlled to execute an action instruction.

7. A household appliance, characterized in that: include: Bone voiceprint sensor, Among them, the bone voiceprint sensor is used to collect vibration signals, and the vibration signals are used to determine whether there is a knocking operation of the user knocking on the home appliance, so as to control the home appliance to execute action instructions when there is a knocking operation of the user knocking on the home appliance.

8. A home appliance control device, characterized in that: include: An acquisition module is used to acquire vibration signals collected by a bone voiceprint sensor deployed on a home appliance; a determining module, configured to determine, based on the vibration signal, whether a first tapping operation of the user tapping the household appliance occurs; The control module is used to control the home appliance to execute an action instruction when a first tapping operation is performed by a user.

9. An electronic device, characterized in that: The electronic device comprises the apparatus according to claim 8; Alternatively, the electronic device includes a memory and a processor, the memory is used to store computer instructions, and the processor is used to call the computer instructions from the memory to execute the method according to any one of claims 1 to 6.

10. A computer-readable storage medium, characterized in that A computer program is stored thereon, which implements the method according to any one of claims 1 to 6 when executed by a processor.

Images