Method for judging the operation status of electrical appliances, detection device, refrigerator and readable storage medium

Abstract

The present invention discloses a method for judging the operating status of an electrical appliance, a detection device, a refrigerator, and a readable storage medium. According to the spectrum information of the first microphone, the spectrum information of the second microphone, the straight-line distance, and the propagation speed of sound in the air, the angle relationship between the electrical appliance emitting the sound and the sound pickup device is determined. When the angle relationship matches the angle information of the electrical appliance relative to the sound pickup device, the matching electrical appliance is determined to be in a working state. Without affecting the existing kitchen layout, the operating status of the electrical appliances in the kitchen is judged from the perspective of sound, with high operability, and intelligent perception of any number of non-intelligent devices in the kitchen is realized, so that the cost of judging the operating status of kitchen appliances is greatly reduced, thereby realizing the judgment of the operating status of the electrical appliances on the one hand, laying a good foundation for other further intelligence, and because of the low cost and no impact on the existing kitchen layout, the intelligence of the kitchen is more convenient to promote.

Description

Technical Field

[0001] The present invention relates to the field of noise reduction, and in particular to a method for determining the operating state of an electrical appliance, a detection device, a refrigerator and a readable storage medium. Background Art

[0002] There are many electrical appliances in the kitchen, such as range hoods, microwave ovens, electric kettles, etc. In order to make the use of the kitchen more intelligent and meet the needs of smart homes, some intelligent operations will be required on these electrical appliances. The premise of some operations is to perceive the operating status of kitchen appliances.

[0003] However, when the kitchen has been arranged, it is difficult to perceive the operating status of each device individually, and it is impossible to require users to replace all devices with smart devices that can be connected to the Internet. This is an obstacle encountered in the development of kitchen intelligence, which hinders other smart upgrade operations on electrical equipment and cannot meet the needs of smart homes. Summary of the invention

[0004] In order to solve the problems in the prior art, an object of the present invention is to provide a method for determining the operating state of an electrical appliance, a detection device, a refrigerator and a readable storage medium.

[0005] To achieve the above-mentioned purpose, an embodiment of the present invention provides a method for determining the operating state of an electrical appliance, comprising the following steps:

[0006] Acquire frequency spectrum information of a sound source received by a first microphone and a second microphone of a sound pickup device;

[0007] Determine an angular relationship between the sound source and the sound pickup device according to the frequency spectrum information of the first microphone, the frequency spectrum information of the second microphone, a straight-line distance l between the first microphone and the second microphone, and a propagation speed v of sound in air;

[0008] If there is an electrical appliance whose preset angle information relative to the sound pickup device matches the angle relationship, it is marked that the electrical appliance is in working state.

[0009] As a further improvement of the present invention, the step of "determining the angular relationship between the sound-emitting appliance and the sound pickup device according to the spectrum information of the first microphone, the spectrum information of the second microphone, the straight-line distance l between the first microphone and the second microphone, and the propagation speed v of sound in the air" includes:

[0010] Calculate the time difference Δt of the same phase between the spectrum information of the first microphone and the spectrum information of the second microphone,

[0011] The angular relationship between the electrical appliance emitting the sound and the sound pickup device is determined according to the difference Δt, the straight-line distance l between the first microphone and the second microphone, and the propagation speed v of the sound in the air.

[0012] As a further improvement of the present invention, the step of "determining the angular relationship between the electrical appliance emitting sound and the sound pickup device" includes:

[0013] According to θ=arccos(Δt*v / l), it is determined that the angle relationship between the electrical appliance that emits the sound and the sound pickup device is θ.

[0014] As a further improvement of the present invention, the steps are also included:

[0015] When the difference Δt is a positive value, it is determined that the sound-emitting electrical device is located on one side of the second microphone;

[0016] When the difference Δt is a negative value, it is determined that the sound-emitting electrical device is located on one side of the first microphone;

[0017] When the difference Δt is 0, it is determined that the sound-emitting electrical device is located on the perpendicular midline of the line connecting the first microphone and the second microphone.

[0018] As a further improvement of the present invention, the steps are also included:

[0019] Acquire unit noise signals emitted by a number of electrical appliances in working state;

[0020] Processing the unit noise signal to obtain a noise reduction signal corresponding to the electrical appliance;

[0021] When it is determined that one of the electrical appliances is in the working state, a noise reduction wave corresponding to the noise reduction signal of the one of the electrical appliances is emitted.

[0022] To achieve one of the above-mentioned purposes of the invention, an embodiment of the present invention provides a method for determining the operating state of an electrical appliance, comprising the following steps:

[0023] Acquiring spectrum information of the sound emitted by the electrical appliance received by the first microphone, the second microphone, the third microphone, and the fourth microphone of the sound pickup device;

[0024] Determine the angular relationship between the appliance emitting the sound and the sound pickup device according to the spectrum information of the first microphone, the spectrum information of the second microphone, the spectrum information of the third microphone, the spectrum information of the fourth microphone, the straight-line distance between any two microphones, and the propagation speed of sound in the air;

[0025] When the preset angle information of the electrical appliance relative to the sound pickup device matches the angle relationship, it is determined that the electrical appliance is in a working state.

[0026] To achieve one of the above-mentioned purposes of the invention, an embodiment of the present invention provides a detection device, comprising:

[0027] A sound pickup device, arranged toward other electrical appliances, the sound pickup device comprising at least two microphones;

[0028] A memory for storing computer programs and angle information of other electrical appliances relative to the sound pickup device;

[0029] The processor can implement the steps in the above-mentioned method for determining the operating status of an electrical appliance when executing the computer program.

[0030] As a further improvement of the present invention, the distance between the other electrical appliances and the sound pickup device is not less than 0.5 meters.

[0031] To achieve one of the above-mentioned objects of the invention, an embodiment of the present invention provides a refrigerator, including a door body, wherein the door body is arranged toward other electrical appliances, the refrigerator also includes the above-mentioned detection device, and the sound pickup device is arranged on the surface of the door body.

[0032] To achieve one of the above-mentioned purposes of the invention, an embodiment of the present invention provides a readable storage medium storing a computer program, which can implement the steps of the above-mentioned method for determining the operating status of an electrical appliance when executed by a processor.

[0033] Compared with the prior art, the present invention has the following beneficial effects: without affecting the existing kitchen layout, the operating status of the kitchen appliances can be judged from the perspective of sound, with high operability, and intelligent perception of any number of non-intelligent devices in the kitchen can be realized, so that the cost of judging the operating status of kitchen appliances is greatly reduced, thereby realizing the judgment of the operating status of the appliances on the one hand, laying a good foundation for other further intelligence, and because of the low cost and no impact on the existing kitchen layout, the intelligence of the kitchen is more convenient to promote. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 is a flow chart of a method for determining the operating status of an electrical appliance according to an embodiment of the present invention;

[0035] Figure 2 is a schematic diagram of a kitchen according to an embodiment of the present invention;

[0036] Figure 3 is a schematic diagram of determining an angle of a sound pickup device according to an embodiment of the present invention;

[0037] Figure 4 is a schematic diagram of a control module according to an embodiment of the present invention;

[0038] Among them, 1. first microphone; 2. second microphone; 3. sound pickup device; 4. processor; 5. memory; 6. communication bus; S0, refrigerator. DETAILED DESCRIPTION

[0039] The present invention will be described in detail below in conjunction with the specific embodiments shown in the accompanying drawings. However, these embodiments do not limit the present invention, and any structural, methodological, or functional changes made by a person skilled in the art based on these embodiments are all within the scope of protection of the present invention.

[0040] An embodiment of the present invention provides a method for determining the operating status of an electrical appliance, a detection device, a refrigerator, and a readable storage medium. The refrigerator is used as a carrier to determine the operating status of electrical appliances in the kitchen without affecting the existing kitchen layout, thereby providing the necessary basis for the intelligence of the kitchen.

[0041] Specifically, Figure 1 This is a method for determining the operating status of an electrical appliance in one embodiment of the present application. Although the present application provides method operation steps as described in the following embodiment or flowchart, based on routine or no creative labor, there are steps in the method that do not logically have necessary causal relationships, and the execution order of these steps is not limited to the execution order provided in the embodiment of the present application.

[0042] The method for determining the operating status of an electrical appliance in this embodiment is as follows: Figure 1 As shown, the following steps are included:

[0043] Step 101: Obtaining angle information of a plurality of electrical appliances relative to a sound pickup device;

[0044] Among them, the angular relationship between these electrical devices and the sound pickup device can be pre-recorded into the system. When there are not many devices, the angular relationship is a rough estimate made manually. The following steps can also be used to detect the angle information through multiple microphones in the sound pickup device after the sound is emitted, and the angle information is stored as the preset angle information.

[0045] Step 102: obtaining a straight-line distance l between the first microphone and the second microphone of the sound pickup device, and obtaining a propagation speed v of sound in the air;

[0046] Among them, the two microphones can be arranged on the same horizontal plane as the electrical equipment, and there can be a height difference in the vertical direction, and it is best to make the height difference in the vertical direction the same as that of the electrical equipment, for example, one is above the electrical equipment and the other is below the electrical equipment. Of course, preferably, multiple microphones are arranged on the same horizontal plane.

[0047] Step 103: Acquire frequency spectrum information of the sound emitted by the electrical appliance received by the first microphone and the second microphone;

[0048] When the sound source is in the far field from the sound pickup device, the sound wave can be regarded as a plane wave, that is, the sound wave can be regarded as parallel to each other when it reaches the two microphones of the sound pickup device.

[0049] Step 105: determining the angle relationship between the electrical appliance emitting the sound and the sound pickup device according to the frequency spectrum information of the first microphone, the frequency spectrum information of the second microphone, the straight-line distance and the propagation speed of the sound in the air;

[0050] When the two microphones are at different distances from the electrical device emitting the sound waves, there is a time difference between the waveforms received by the two microphones. The angular relationship between the electrical device and the sound pickup device can be calculated using the time difference and the known distance between the two microphones.

[0051] Step 106: If there is an electrical appliance whose preset angle information relative to the sound pickup device matches the angle relationship, then the electrical appliance is marked as being in working state.

[0052] The sound pickup device and the electrical device that emits sound in this embodiment can be placed in the kitchen, that is, the angle between the electrical device and the sound pickup device can be determined in the kitchen scene, such as Figure 2 By comparing the determined orientation relationship with the preset orientation relationship, the device currently emitting sound can be determined, and it can be determined that the device is in operation.

[0053] Furthermore, the method further comprises step 104:

[0054] The time difference Δt between the audio obtained by the first microphone and the audio obtained by the second microphone and the time difference Δt in the same phase is determined according to the frequency spectrum information of the first microphone and the frequency spectrum information of the second microphone.

[0055] Furthermore, the method further comprises the steps of:

[0056] The straight-line distance and the speed of sound in air are v;

[0057] The straight-line distance is l;

[0058] The angle θ between the sound-emitting appliance and the sound pickup device is arccos(Δt*v / l).

[0059] The principle of this step to detect specific angles is as follows: Figure 3As shown in the figure, when the sound wave is regarded as a plane wave, the time difference Δt for the same phase in the sound wave to reach the two microphones, the speed of sound propagation in the air is a known value v, generally, v = 340m / s, then the displacement difference between the electrical equipment and the two microphones is Δt*v, and then the value of θ can be determined based on the trigonometric function relationship. Δt can be obtained based on the spectrum of the sound signal detected by the two microphones. Since the sound signal is not completely regular and periodic, that is, the sound waveform of the same microphone will have non-periodic changes, the corresponding points can be found on the spectrum of the two microphones, and then Δt can be determined based on the time difference of reaching the same phase on the waveform.

[0060] Furthermore, when there are few devices, and only the left-right relationship between other electrical devices and the sound pickup unit needs to be determined, or when the left-right relationship needs to be considered in the determination of the above-mentioned θ angle, the method further includes the following steps:

[0061] When the difference Δt is a positive value, it is determined that the sound-emitting electrical device is located on one side of the second microphone;

[0062] When the difference Δt is a negative value, it is determined that the sound-emitting electrical device is located on one side of the first microphone;

[0063] When the difference Δt is 0, it is determined that the sound-emitting electrical device is located on the perpendicular midline of the line connecting the first microphone and the second microphone.

[0064] When the difference Δt is a positive value, it means that the time to reach the first microphone is longer than the time to reach the second microphone, so the sound-emitting appliance is closer to the second microphone, that is, it is determined that the sound-emitting appliance is located on one side of the second microphone. Similarly, when Δt is a negative value, it is determined that the sound-emitting appliance is located on one side of the first microphone. In addition, when Δt is 0, it means that the distance between the sound-emitting appliance and the first microphone and the second microphone is the same, that is, it is determined that the sound-emitting appliance is located on the perpendicular midline of the line connecting the first microphone and the second microphone.

[0065] Furthermore, the method further comprises the steps of:

[0066] Acquire a linear distance in a horizontal direction between two adjacent microphones of a first microphone, a second microphone, a third microphone, and a fourth microphone of the sound pickup device;

[0067] The angular relationship between the sound-emitting appliance and the sound pickup device is determined based on the spectrum information of the first microphone, the spectrum information of the second microphone, the spectrum information of the third microphone, the spectrum information of the fourth microphone, the straight-line distance between the microphones and the speed of sound propagation in the air.

[0068] When two microphones are set, after experiments, the current positioning accuracy of electrical equipment is about 10°. When four microphones are set, the positioning accuracy of electrical equipment is about 5°. The positioning principle of four microphones is the same as that of two microphones. It is also based on the pre-recorded straight-line distance between adjacent microphones, and then the angle information is calculated by the time difference of the same phase arriving at the microphone. In other words, in order to improve the detection accuracy, more microphone arrays can be set, such as 4, 8, etc.

[0069] Furthermore, the method further comprises the steps of:

[0070] Acquiring unit noise signals emitted by the plurality of electrical appliances when they are in working state;

[0071] Processing the unit noise signal to obtain a noise reduction signal corresponding to the electrical appliance;

[0072] When it is determined that one of the electrical appliances is in the working state, a noise reduction wave is emitted according to a noise reduction signal corresponding to the one of the electrical appliances.

[0073] Since the noise of electrical equipment is generally relatively stable, the spectrum information of the sound formed is also stable, which is different from the sound information of people talking, which may change at any time. It is relatively easy to reduce the noise of electrical equipment through active noise reduction. Therefore, by pre-storing the set noise reduction information, when the corresponding equipment is judged to be in working state, the noise reduction wave is played. Experimental detection can significantly reduce the noise of the environment. At the same time, this embodiment does not affect the noise of human voice, TV sound and other objects, ensuring that people working in the kitchen can operate in an environment where they are not disturbed by the noise of kitchen electrical equipment, and do not affect the sound needs of normal life. This embodiment is easy to operate and has a good user experience, making the home environment more comfortable and intelligent.

[0074] Furthermore, an embodiment of the present invention provides a detection device, the module diagram of which is as follows Figure 4 As shown, including:

[0075] A sound pickup device 3 is arranged toward other electrical appliances, and the sound pickup device 3 includes at least two microphones;

[0076] A memory 5 for storing computer programs and angle information of other electrical appliances relative to the sound pickup device 3;

[0077] The processor 4 can implement any one of the steps in the above-mentioned method for determining the operating state of an electrical appliance when executing the computer program, that is, implement the steps in any one of the technical solutions in the above-mentioned method for determining the operating state of an electrical appliance.

[0078] In addition, the detection device may further include a communication bus 6, which is used to establish a connection between the processor 4, the memory 5 and the sound pickup device 3. The communication bus 6 may include a path to transmit information between the above-mentioned sound pickup module, the processor 4 and the memory 5.

[0079] like Figure 2 and Figure 4 As shown, the sound pickup device 3 includes a first microphone 1 and a second microphone 2, which are used to detect the sounds emitted by other devices S1, S2, S3 and the like in the space. These devices emit sounds from all directions and transmit them to the sound pickup device 3. The sound pickup device 3 can be set on a device S0 facing these electrical devices. The sound pickup device 3 transmits the detected audio information to the processor 4, which performs calculations according to the computer program stored in the memory 5 and compares it with the stored angle information.

[0080] The memory 5 can be independent and connected to the processor 4 via the communication bus 6. The memory 5 can also be integrated with the processor 4. The processor 4 can be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), or one or more integrated circuits for controlling the execution of the program of the present application.

[0081] Furthermore, the distance between the other electrical appliances and the sound pickup device 3 is not less than 0.5 meters.

[0082] In order to make the sound waves reaching the sound pickup device 3 more similar to plane waves, the distance between other electrical appliances and the sound pickup device 3 is preferably greater than 0.5 meters.

[0083] Furthermore, an embodiment of the present invention provides a refrigerator S0, which is placed in a kitchen and detects the operating status of other electrical appliances in the kitchen, such as Figure 2 The refrigerator S0 includes a door body, which is arranged toward other electrical appliances, and the refrigerator S0 also includes the above-mentioned detection device. The above-mentioned sound pickup module, processor 4, memory 5 and communication bus 6 are all integrated on the refrigerator S0, and the sound pickup device 3 is arranged on the surface of the door body. The refrigerator S0 receives sounds from other devices through the sound pickup module, and analyzes and processes these sounds using the above-mentioned method for judging the operating status of electrical appliances.

[0084] Furthermore, an embodiment of the present invention provides a readable storage medium storing a computer program, which, when executed by the processor 4, can implement any one of the steps in the above-mentioned method for determining the operating status of an electrical appliance, that is, implement the steps in any one of the technical solutions in the above-mentioned method for determining the operating status of an electrical appliance.

[0085] In the above description, it should be understood that the disclosed systems, systems and methods can be implemented in other ways. For example, the system implementation described above is only schematic, for example, the division of device modules is only a logical function division, and there may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point, the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of systems or modules, which can be electrical, mechanical or other forms.

[0086] For example, the processor 4 of the present application may be concentrated in one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above integrated modules may be implemented in the form of hardware or in the form of hardware plus software functional modules.

[0087] The above-mentioned integrated module implemented in the form of a software function module can be stored in a computer-readable storage medium. The above-mentioned software function module is stored in a storage medium, including a number of instructions for a computer system (which can be a personal computer, a server, or a network system, etc.) or a processor 4 (processor) to perform some steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), disk or optical disk and other media that can store program codes.

[0088] Compared with the prior art, this embodiment has the following beneficial effects:

[0089] Without affecting the existing kitchen layout, the operating status of the kitchen appliances can be judged from the perspective of sound, with high operability, and intelligent perception of any number of non-intelligent devices in the kitchen can be realized, so that the cost of judging the operating status of kitchen appliances is greatly reduced. On the one hand, the judgment of the operating status of the appliances is realized, laying a good foundation for other further intelligence. In addition, due to the low cost and no impact on the existing kitchen layout, the intelligence of the kitchen is more convenient to promote.

[0090] It should be understood that although this specification is described according to implementation modes, not every implementation mode contains only one independent technical solution. This description of the specification is only for the sake of clarity. Those skilled in the art should regard the specification as a whole. The technical solutions in each implementation mode may also be appropriately combined to form other implementation modes that can be understood by those skilled in the art.

[0091] The series of detailed descriptions listed above are only specific descriptions of feasible implementation methods of the present invention. They are not intended to limit the scope of protection of the present invention. Any equivalent implementation methods or changes that do not deviate from the technical spirit of the present invention should be included in the scope of protection of the present invention.

Claims

1. A method for determining the operating status of an electrical appliance, wherein: The electrical appliance is an electrical appliance in a kitchen, and is characterized by comprising the following steps: Acquire frequency spectrum information of a sound source received by a first microphone and a second microphone of a sound pickup device, wherein the sound pickup device is also in the kitchen; Determine an angular relationship between the sound source and the sound pickup device according to the frequency spectrum information of the first microphone, the frequency spectrum information of the second microphone, a straight-line distance l between the first microphone and the second microphone, and a propagation speed v of sound in air; If there is an electrical appliance whose preset angle information relative to the sound pickup device matches the angle relationship, then the electrical appliance is marked as being in working state; Acquire unit noise signals emitted by a number of electrical appliances in working state; Processing the unit noise signal to obtain a noise reduction signal corresponding to the electrical appliance; When it is determined that one of the electrical appliances is in the working state, a noise reduction wave corresponding to the noise reduction signal of the one of the electrical appliances is emitted.

2. The method for determining the operating status of an electrical appliance according to claim 1, characterized in that: The step of "determining the angular relationship between the appliance emitting the sound and the sound pickup device according to the spectrum information of the first microphone, the spectrum information of the second microphone, the straight-line distance l between the first microphone and the second microphone, and the propagation speed v of the sound in the air" includes: Calculate the time difference Δt of the same phase between the spectrum information of the first microphone and the spectrum information of the second microphone, The angular relationship between the electrical appliance emitting the sound and the sound pickup device is determined according to the difference Δt, the straight-line distance l between the first microphone and the second microphone, and the propagation speed v of the sound in the air.

3. The method for determining the operating status of an electrical appliance according to claim 2, characterized in that: The step of "determining the angle relationship between the electrical appliance emitting sound and the sound pickup device" includes: According to θ=arccos(Δt*v / l), it is determined that the angle relationship between the electrical appliance that emits the sound and the sound pickup device is θ.

4. The method for determining the operating status of an electrical appliance according to claim 2, characterized in that: Also includes the steps: When the difference Δt is a positive value, it is determined that the sound-emitting electrical device is located on one side of the second microphone; When the difference Δt is a negative value, it is determined that the sound-emitting electrical device is located on one side of the first microphone; When the difference Δt is 0, it is determined that the sound-emitting electrical device is located on the perpendicular midline of the line connecting the first microphone and the second microphone.

5. A method for determining the operating status of an electrical appliance, wherein: The electrical appliance is an electrical appliance in a kitchen, and is characterized by comprising the following steps: Acquiring frequency spectrum information of the sound emitted by the electrical appliance received by a first microphone, a second microphone, a third microphone, and a fourth microphone of a sound pickup device, wherein the sound pickup device is also in the kitchen; Determine the angular relationship between the appliance emitting the sound and the sound pickup device according to the spectrum information of the first microphone, the spectrum information of the second microphone, the spectrum information of the third microphone, the spectrum information of the fourth microphone, the straight-line distance between any two microphones, and the propagation speed of sound in the air; When the preset angle information of the electrical appliance relative to the sound pickup device matches the angle relationship, it is determined that the electrical appliance is in a working state; Acquire unit noise signals emitted by a number of electrical appliances in working state; Processing the unit noise signal to obtain a noise reduction signal corresponding to the electrical appliance; When it is determined that one of the electrical appliances is in the working state, a noise reduction wave corresponding to the noise reduction signal of the one of the electrical appliances is emitted.

6. A detection device, characterized in that: include: A sound pickup device, arranged toward other electrical appliances, the sound pickup device comprising at least two microphones; A memory for storing computer programs and angle information of other electrical appliances relative to the sound pickup device; The processor can implement the steps of the method for determining the operating status of an electrical appliance as described in any one of claims 1 to 5 when executing the computer program.

7. The detection device according to claim 6, characterized in that: The distance between the other electrical appliances and the sound pickup device is not less than 0.5 meters.

8. A refrigerator, comprising a door body, wherein the door body is arranged toward other electrical appliances, characterized in that: The refrigerator also includes the detection device according to claim 6, and the sound pickup device is arranged on the surface of the door body.

9. A readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the steps of the method for determining the operating status of an electrical appliance described in any one of claims 1 to 5 can be implemented.

Images