Control method and device

Abstract

The embodiment of the present application provides a control method and device, the method is applied to a control device, the control device includes a microphone array, the method includes: responding to a control instruction acting on the control device, broadcasting a first infrared signal according to the control instruction; receiving at least one sound source signal, and obtaining the angle between each of the sound source signals and the microphone array, the sound source signal is sent by the household appliance in response to the first infrared signal; determining a target device in at least one corresponding household appliance according to the angle between each of the sound source signals and the microphone array; controlling the target device to perform the operation corresponding to the control instruction. The solution provided by the embodiment of the present application determines the target device that the user wants to control based on the sound source signals emitted by each household appliance, so that all household appliances can be controlled by one control device, and the operation is convenient and concise.

Description

Technical Field

[0001] The embodiments of the present application relate to the technical field of smart home appliances, and in particular, to a control method and device. Background Art

[0002] With the rapid development of science and technology, various smart home appliances have gradually entered thousands of households, providing great convenience for people's lives.

[0003] At present, smart home appliances can be controlled by voice or remote control, etc. For example, the air conditioner remote control can be used to turn on, turn off, and adjust the temperature of the air conditioner, and the TV remote control can be used to turn on, turn off, and change the channel of the TV.

[0004] However, the above control method requires that corresponding remote controllers be configured for different home appliances, and the operation is relatively complicated. Summary of the invention

[0005] In order to solve the above-mentioned problems, the embodiments of the present application provide a control method and device.

[0006] In a first aspect, an embodiment of the present application provides a control method, which is applied to a control device, wherein the control device includes a microphone array, and the control method includes:

[0007] In response to a control instruction acting on the control device, broadcast a first infrared signal according to the control instruction;

[0008] receiving at least one sound source signal, and acquiring an angle between each of the sound source signals and the microphone array, wherein the sound source signal is sent by the household appliance in response to the first infrared signal;

[0009] Determining a target device in at least one corresponding household electrical appliance according to an angle between each of the sound source signals and the microphone array;

[0010] Control the target device to execute the operation corresponding to the control instruction.

[0011] In a possible implementation manner, obtaining the angle between each of the sound source signals and the microphone array includes:

[0012] According to each of the sound source signals, a sound source signal matrix is ​​established;

[0013] According to the sound source signal matrix, obtaining a covariance matrix of the sound source signal;

[0014] A signal subspace spectrum of each of the sound source signals is obtained according to the covariance matrix, where the signal subspace spectrum is used to indicate an angle between each of the sound source signals and the microphone array.

[0015] In a possible implementation, determining a target device in at least one corresponding household appliance according to an angle between each of the sound source signals and the microphone array includes:

[0016] Determine a target sound source signal in each of the sound source signals according to an angle between each of the sound source signals and the microphone array, wherein the angle between the target sound source signal and the microphone array is within a preset range;

[0017] The target device is determined in the at least one household electrical appliance according to the target sound source signal.

[0018] In a possible implementation manner, if the angle between any sound source signal and the microphone array is not within the preset range, the method further includes:

[0019] A voice prompt message is played, where the voice prompt message is used to indicate that the target device does not exist in the at least one household electrical appliance.

[0020] In a possible implementation, determining the target device in the at least one household appliance according to the target sound source signal includes:

[0021] Acquire the frequency band where the target sound source signal is located, wherein different sound source signals are located in different frequency bands;

[0022] The target device is determined in the at least one home appliance according to the correspondence between the frequency bands of the sound source signals and the home appliances, and the frequency band of the target sound source signal.

[0023] In a possible implementation, controlling the target device to execute the operation corresponding to the control instruction includes:

[0024] A second infrared signal is broadcast according to the control instruction, wherein the second infrared signal includes a device identification of the target device, and the second infrared signal is used to instruct the target device to execute an operation corresponding to the control instruction.

[0025] In a possible implementation, the sound source signal is an ultrasonic sound source signal, or an infrasonic sound source signal.

[0026] In a second aspect, an embodiment of the present application provides a control method, which is applied to a household appliance. The control method includes:

[0027] receiving a first infrared signal, where the first infrared signal is a signal broadcast by a control device according to a control instruction;

[0028] Sending a sound source signal to the control device, wherein the sound source signal is used to instruct the control device to determine a target device according to the received sound source signal;

[0029] receiving a second infrared signal, wherein the second infrared signal includes a device identification of the target device;

[0030] Determine whether to execute the operation corresponding to the control instruction according to the second infrared signal.

[0031] In a possible implementation manner, determining whether to execute the operation corresponding to the control instruction according to the second infrared signal includes:

[0032] If the device identifier included in the second infrared signal is the device identifier of the household appliance, performing the operation corresponding to the control instruction according to the second infrared signal;

[0033] Otherwise, it is determined not to execute the operation corresponding to the control instruction.

[0034] In a possible implementation, the sound source signal is an ultrasonic sound source signal, or an infrasonic sound source signal.

[0035] In a third aspect, an embodiment of the present application provides a control device, including:

[0036] A first broadcast module, configured to respond to a control instruction acting on a control device and broadcast a first infrared signal according to the control instruction, wherein the control device includes a microphone array;

[0037] a receiving module, configured to receive at least one sound source signal and obtain an angle between each of the sound source signals and the microphone array, wherein the sound source signal is sent by the household appliance in response to the first infrared signal;

[0038] A processing module, configured to determine a target device in at least one corresponding home appliance according to an angle between each of the sound source signals and the microphone array;

[0039] The second broadcast module is used to control the target device to execute the operation corresponding to the control instruction.

[0040] In a possible implementation manner, the receiving module is specifically configured to:

[0041] According to each of the sound source signals, a sound source signal matrix is ​​established;

[0042] According to the sound source signal matrix, obtaining a covariance matrix of the sound source signal;

[0043] A signal subspace spectrum of each of the sound source signals is obtained according to the covariance matrix, where the signal subspace spectrum is used to indicate an angle between each of the sound source signals and the microphone array.

[0044] In a possible implementation manner, the processing module is specifically used to:

[0045] Determine a target sound source signal in each of the sound source signals according to an angle between each of the sound source signals and the microphone array, wherein the angle between the target sound source signal and the microphone array is within a preset range;

[0046] The target device is determined in the at least one household electrical appliance according to the target sound source signal.

[0047] In a possible implementation manner, if the angle between any sound source signal and the microphone array is not within the preset range, the processing module is further configured to:

[0048] A voice prompt message is played, where the voice prompt message is used to indicate that the target device does not exist in the at least one household electrical appliance.

[0049] In a possible implementation manner, the processing module is specifically used to:

[0050] Acquire the frequency band where the target sound source signal is located, wherein different sound source signals are located in different frequency bands;

[0051] The target device is determined in the at least one home appliance according to the correspondence between the frequency bands of the sound source signals and the home appliances, and the frequency band of the target sound source signal.

[0052] In a possible implementation manner, the control module is specifically used to:

[0053] A second infrared signal is broadcast according to the control instruction, wherein the second infrared signal includes a device identification of the target device, and the second infrared signal is used to instruct the target device to execute an operation corresponding to the control instruction.

[0054] In a possible implementation, the sound source signal is an ultrasonic sound source signal, or an infrasonic sound source signal.

[0055] In a fourth aspect, an embodiment of the present application provides a control device, including:

[0056] A first receiving module, used to receive a first infrared signal, where the first infrared signal is a signal broadcast by the control device according to a control instruction;

[0057] A sending module, used to send a sound source signal to the control device, wherein the sound source signal is used to instruct the control device to determine a target device according to the received sound source signal;

[0058] A second receiving module, used for receiving a second infrared signal, wherein the second infrared signal includes a device identification of the target device;

[0059] The processing module is used to determine whether to execute the operation corresponding to the control instruction according to the second infrared signal.

[0060] In a possible implementation manner, the processing module is specifically used to:

[0061] If the device identifier included in the second infrared signal is the device identifier of the household appliance, performing the operation corresponding to the control instruction according to the second infrared signal;

[0062] Otherwise, it is determined not to execute the operation corresponding to the control instruction.

[0063] In a possible implementation, the sound source signal is an ultrasonic sound source signal, or an infrasonic sound source signal.

[0064] In a fifth aspect, an embodiment of the present application provides a control device, including a microphone array, a memory, and at least one processor, wherein:

[0065] The memory stores computer-executable instructions;

[0066] The at least one processor executes the computer-executable instructions stored in the memory to implement the control method as described in any one of the first aspects, wherein the processor receives at least one sound source signal through the microphone array.

[0067] In a sixth aspect, an embodiment of the present application provides a home appliance, comprising: at least one processor and a memory;

[0068] The memory stores computer-executable instructions;

[0069] The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor performs the control method as described in any one of the second aspects.

[0070] In a seventh aspect, an embodiment of the present application provides a control system, comprising the control device described in the fifth aspect and the household appliance described in the sixth aspect.

[0071] In an eighth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores computer-executable instructions. When a processor executes the computer-executable instructions, the control method as described in any one of the first aspect or the second aspect is implemented.

[0072] In a ninth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a computer program; the computer program is executed by the control method described in any one of the first aspect or the second aspect.

[0073] The control method and device provided in the embodiment of the present application first respond to the control instruction acting on the control device, broadcast a first infrared signal according to the control instruction, then receive at least one sound source signal, and obtain the angle between each sound source signal and the microphone array in the control device, and then determine the target device in the corresponding at least one home appliance, so as to control the target device to perform the operation corresponding to the control instruction. The solution provided in the embodiment of the present application performs sound source positioning based on the sound source signals emitted by each home appliance, determines the target device that the user wants to control, so that all home appliances can be controlled by one control device, and the operation is convenient and simple. BRIEF DESCRIPTION OF THE DRAWINGS

[0074] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, a brief introduction will be given below to the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0075] Figure 1 A schematic diagram of an application scenario provided for an embodiment of the present application;

[0076] Figure 2 A flow chart of a control method provided in an embodiment of the present application;

[0077] Figure 3 A schematic diagram of determining the direction information of a sound source signal provided in an embodiment of the present application;

[0078] Figure 4 A signal subspace spectrum simulation diagram provided in an embodiment of the present application;

[0079] Figure 5 A schematic diagram of a control target device provided in an embodiment of the present application;

[0080] Figure 6 A flow chart of a control method provided in an embodiment of the present application;

[0081] Figure 7A schematic diagram of a control device provided in an embodiment of the present application Figure 1 ;

[0082] Figure 8 A schematic diagram of a control device provided in an embodiment of the present application Figure 2 ;

[0083] Fig. 9 A schematic diagram of the hardware structure of a control device provided in an embodiment of the present application;

[0084] Fig.10 A schematic diagram of the hardware structure of a household appliance provided in an embodiment of the present application;

[0085] Fig.11 A schematic diagram of the structure of a control system provided in an embodiment of the present application. DETAILED DESCRIPTION

[0086] In order to make the purpose, technical solution and advantages of the embodiments of the present application clearer, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0087] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise indicated. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances, for example, they can be implemented according to orders other than those given in the diagrams or descriptions of the embodiments of this application.

[0088] In addition, the terms "include" and "have" and any variations thereof are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to those components expressly listed but may include other components not expressly listed or inherent to such products or devices.

[0089] The term "module" as used in this application refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0090] The term "remote control" as used in this application refers to a component of an electronic device (such as the display device disclosed in this application), which can usually wirelessly control the electronic device within a short range. It is generally connected to the electronic device using infrared and / or radio frequency (RF) signals and / or Bluetooth, and may also include functional modules such as WiFi, wireless USB, Bluetooth, motion sensors, etc. For example: a handheld touch remote control replaces most of the physical built-in hard keys in a general remote control device with a user interface in a touch screen.

[0091] First, an application scenario to which this application is applicable is introduced.

[0092] Figure 1 A schematic diagram of an application scenario provided in an embodiment of the present application, such as Figure 1 As shown, it includes a lamp 11, an air conditioner 12 and a television 13, and these three devices are all smart home appliances.

[0093] These smart home appliances can be controlled by corresponding instructions, wherein the instructions for controlling the smart home appliances can be voice instructions, key instructions, or a combination of the two.

[0094] For example, a key command can be performed by operating Figure 1 The example remote controller 10 is used to implement the interaction between the remote controller and the smart home appliances. The current interactive communication protocols are mainly based on Bluetooth or infrared. The interactions based on Bluetooth or infrared are all broadcast-type, that is, if a command is issued based on Bluetooth or infrared, all smart home appliances can receive it.

[0095] Based on the interaction of Bluetooth, the device can be bound before use. For example, turn on the Bluetooth switch of the TV 13 and bind it with the remote control 10. After the binding is completed, only the TV 13 can respond to all the instructions issued by the remote control 10, and other home appliances, such as the light 11 and the air conditioner 12, will not respond to the instructions issued by the remote control 10. If you need to use the remote control 10 to control the light 11 or the air conditioner 12, you need to unbind the remote control 10 and the TV 13, and then bind the Bluetooth to the home appliance to be controlled. In this way, every time you need to control a new home appliance, you need to unbind and rebind Bluetooth, which is troublesome. Another way is to equip each home appliance with a remote control for control, and there is a corresponding relationship between the home appliance and the remote control, so there is no need to unbind and rebind the home appliance and the remote control. However, in this way, the number of remote controls equipped is large and the operation is also troublesome.

[0096] When the command to control the smart home appliance is a voice command, since each home appliance can receive this command, the specific home appliance to be operated must also be indicated in the voice command. For example, when the user wants to turn off the air conditioner 12, a command such as "turn off the air conditioner" needs to be issued. If the voice command is "turn off", each home appliance does not know which device the user wants to turn off and cannot respond.

[0097] Based on this, the embodiment of the present application provides a control solution, which can realize the control of all home appliances through one control device, without the need to bind and unbind devices, and the operation is relatively simple. The solution of the present application will be introduced below.

[0098] Figure 2 A flow chart of a control method provided in an embodiment of the present application is shown in FIG. 1 , wherein the method is applied to a control device, wherein the control device includes a microphone array, such as Figure 2 As shown, the method may include:

[0099] S21, responding to a control instruction acting on the control device, broadcasting a first infrared signal according to the control instruction.

[0100] The method provided in the embodiment of the present application is applicable to Figure 1 The application scenario shown in the figure. The control device can control different household appliances. The control device can be, for example, a remote controller, and the number of household appliances can be one or more, and the household appliances can include, for example, air conditioners, refrigerators, electric lights, and the like.

[0101] When a user wants to control a target device, the user can first issue a control instruction to act on the control device. After receiving the control instruction, the control device responds and broadcasts a first infrared signal according to the control instruction. The control instruction can be a voice instruction issued by the user or an operation instruction acting on the control device. For example, when the control device is a remote controller, the control instruction can be a key instruction acting on the remote controller.

[0102] S22, receiving at least one sound source signal, and obtaining an angle between each sound source signal and the microphone array, wherein the sound source signal is sent by the household appliance in response to the first infrared signal.

[0103] After the control device broadcasts the first infrared signal, all home appliances in the scene can receive the first infrared signal. After receiving the first infrared signal, each home appliance will respond to the first infrared signal, generate a sound source signal and send it. The sound source signal generated by each home appliance will be received by the control device.

[0104] After each household appliance sends out a sound source signal and is received by the control device, since the sound source signal has a certain directionality, the household appliance can be positioned based on the directionality of the sound source signal.

[0105] A microphone array is installed inside the control device, and the microphone array is used to receive the sound source signal sent by the household appliance. In the embodiment of the present application, the direction information of the sound source signal is the angle between the sound source signal and the microphone array.

[0106] S23: determining a target device in at least one corresponding household electrical appliance according to an angle between each sound source signal and the microphone array.

[0107] After determining the angle between each sound source signal and the microphone array, the control device can locate the sound source according to the angle between each sound source signal and the microphone array, and determine the target device in the corresponding at least one household appliance. The target device is the device in the at least one household appliance that the user wants to control.

[0108] S24, controlling the target device to execute an operation corresponding to the control instruction.

[0109] After determining the target device, the control device can control the target device to perform the operation corresponding to the control instruction, where the operation corresponding to the control instruction can be, for example, basic operations such as power on and off, or operations specific to different types of home appliances.

[0110] The control method provided in the embodiment of the present application is applied to a control device, first responding to a control instruction acting on the control device, broadcasting a first infrared signal according to the control instruction, then receiving at least one sound source signal, and obtaining the angle between each sound source signal and the microphone array in the control device, and then determining the target device in the corresponding at least one home appliance, thereby controlling the target device to perform the operation corresponding to the control instruction. The solution provided in the embodiment of the present application performs sound source positioning based on the sound source signals emitted by each home appliance, determines the target device that the user wants to control, and thus can control all home appliances through one control device, which is convenient and simple to operate.

[0111] The solution of the present application will be described in detail below with reference to the accompanying drawings.

[0112] After the control device broadcasts the first infrared signal according to the control instruction, each household appliance can receive the first infrared signal and send a sound source signal to the control device according to the first infrared signal.

[0113] In a possible implementation, the sound source signal is an ultrasonic sound source signal or an infrasonic sound source signal. Since ultrasonic waves and infrasonic waves are sounds that cannot be heard by human ears, it is possible to prevent household appliances from generating noise that affects users.

[0114] Taking the sound source signal as an ultrasonic sound source signal as an example, when the household appliance receives the first infrared signal, it responds to the first infrared signal and sends out a corresponding ultrasonic sound source signal. Optionally, the sound source signals sent out by different household appliances have different frequency bands, and the control device can know in advance the frequency bands of the sound source signals sent out by each household appliance, thereby obtaining the corresponding relationship between the frequency bands of each sound source signal and the household appliance.

[0115] The control device is equipped with a microphone array to receive the sound source signal sent by the home appliance. After receiving the sound source signal, the control device needs to locate the sound source based on the sound source signal to determine the target device. Before locating the sound source, the control device must first obtain the angle between each sound source signal and the microphone array.

[0116] Figure 3 A schematic diagram of determining the direction information of a sound source signal provided in an embodiment of the present application, such as Figure 3 As shown, the household appliances include a lamp 11, an air conditioner 12 and a television 13, and the control device includes a microphone array 30. The direction information of the sound source signal is the angle between the sound source signal and the microphone array in the control device.

[0117] The microphone array 30 is used to receive the sound source signal A sent by the lamp 11, the sound source signal B sent by the air conditioner 12, and the sound source signal C sent by the TV. The directional information of the three sound source signals is the angle between the three sound source signals and the microphone array. Figure 3 In the example, the angle between the sound source signal A and the microphone array is α, the angle between the sound source signal B and the microphone array is β, and the angle between the sound source signal C and the microphone array is γ. When the microphone array receives the sound source signal, the angle between the sound source signal and the microphone array is unknown and needs to be solved based on the sound source signal. First, a sound source signal matrix needs to be established based on each sound source signal.

[0118] Specifically, after receiving multiple sound source signals, the microphone array can establish a matrix according to the multiple sound source signals as follows:

[0119]

[0120] Wherein, P represents the number of microphones in the microphone array, M represents the preset number of sound sources, t is the independent variable time, and X(t) is the established sound source signal matrix.

[0121] Formula (1) can be simplified as follows:

[0122] X(t)=A(θ)s(t)+n(t). (2)

[0123] Discretizing formula (2) yields:

[0124] X(k)=A(θ)s(k)+n(k), (3)

[0125] Among them, X(k) is the discrete expression of X(t), that is, X(t) is continuous in time, and X(k) is the discrete function obtained by sampling X(t) in time. A(θ) is the steering vector of the matrix X(k), s(k) is the sound source signal, and n(k) is the noise vector.

[0126] After establishing the sound source signal matrix, it is necessary to obtain the covariance matrix of the sound source signal according to the sound source signal matrix. One possible implementation method is to perform a Direction Of Arrival (DOA) estimation based on the Multiple Signal Classification (MUSIC) algorithm on equation (3) to obtain the covariance matrix of the sound source signal as follows:

[0127] R = E{X(k)X H (k)}. (4)

[0128] Where R is the covariance matrix of the sound source signal.

[0129] After obtaining the covariance matrix of the sound source signal, the signal subspace spectrum of the sound source signal can be obtained based on the covariance matrix of the sound source signal. The signal subspace spectrum of each sound source signal can indicate the angle between each sound source signal and the microphone array.

[0130] Specifically, since the frequency bands of the sound source signals are different, non-overlapping, and unrelated, and the sound source signals are orthogonal to the noise signal, the covariance matrix eigenvalues ​​of equation (4) are decomposed to obtain:

[0131] R=AR S A H +δ 2 I, (5)

[0132] Where A is the steering vector of the matrix X(k), i.e., A(θ) in equation (3).

[0133] The eigenvalues ​​in the matrix R can be obtained by formula (5). Then, the eigenvalues ​​in the matrix R are sorted. Taking MATLAB simulation as an example, the eigenvalues ​​of the matrix can be obtained by the function [V, D] = eig_sort (R), where V is a vector matrix and D is the eigenvalue of the vector matrix.

[0134] The number of eigenvalues ​​of the matrix is ​​M, where M is the preset number of sound sources. After obtaining M eigenvalues, the first N eigenvalues ​​can be understood as the signal subspace corresponding to the sound source signal, which has stronger energy. Figure 3The signal subspaces of the sound source signals A, B and C in the example are shown in FIG. 1 , where N = 3. The remaining MN eigenvalues ​​can be understood as noise subspaces, for example, including scattered noise with relatively small energy. According to the above formula (5), the distribution of the sound source signal and the noise signal in the space can be obtained.

[0135] For example, the eigenvalues ​​obtained by the function [V, D] = eig_sort(R) are as follows: 34.4792 29.0823 4.9426 0.6438 0.0227 0.0200 0.0178

[0137] The first three values ​​are relatively large, which may correspond to the three sound source signals in the space, and the following values ​​are relatively small, which may correspond to the noise signals in the space.

[0138] After obtaining the eigenvalues ​​corresponding to each signal space, the spatial spectrum can be obtained based on the MUSIC algorithm. For example, through the function J(t) = MUSIC_DOA(D, theta), where D is the eigenvalue obtained according to the above embodiment, and theta (i.e., θ) is the angle of the sound source signal corresponding to each eigenvalue. Then, according to the steering vector a = exp(coefficient*f0*d*sind(theta) / c corresponding to each angle, multiply it by the autocorrelation matrix, that is:

[0139] J=a*Rx*a', generating the signal subspace spectrum.

[0140] Wherein, J represents the beam gain value corresponding to the theta angle of the microphone array, that is, the sound receiving energy gain degree corresponding to the theta angle of the microphone array. Rx is the covariance matrix in formula (4). The angle between each sound source signal and the microphone array can be indicated by the signal subspace spectrum. After obtaining the signal subspace spectrum of each sound source signal, the signal subspace spectrum is simulated to obtain the angle between each sound source signal and the microphone array.

[0141] Figure 4 A signal subspace spectrum simulation diagram provided in an embodiment of the present application, such as Figure 4 As shown in the figure, the horizontal axis represents the angle and the vertical axis represents the signal size. Figure 4 It can be seen that in the three directions of about 65 degrees, about 88 degrees and about 114 degrees, there are sound sources emitting sound energy, indicating that the angles of sound source signal A, sound source signal B and sound source signal C are 65 degrees, 88 degrees and 114 degrees.

[0142] After determining the angles between each sound source signal and the microphone array, the target sound source signal can be determined in the sound source signal according to the angles between each sound source signal and the microphone array, wherein the angle between the target sound source signal and the microphone array is within a preset range.

[0143] The preset range is determined according to the position of the microphone array in the control device. Taking the control device as a remote control as an example, when a user wants to control a home appliance through the remote control, the remote control is usually aimed at the home appliance. At this time, the angle between the sound source signal emitted by the home appliance and the microphone array is within the preset range.

[0144] For example, when the microphone array is horizontally located in the control device, if the control device is aimed at the target device, the angle between the sound source signal emitted by the target device and the microphone array should be about 90 degrees. At this time, the preset range can be set to a range of about 90 degrees, for example, between 80-100 degrees.

[0145] For example, Figure 4 In the figure, the angle β between the sound source signal B and the microphone array is 90 degrees, which is within the preset range, while α is 130 degrees and γ is 40 degrees, both of which are not within the preset range. Therefore, the sound source signal B can be determined as the target sound source signal.

[0146] If the angle between any sound source signal and the microphone array is not within the preset range, it means that the control device is not aimed at any home appliance. At this time, the control device can play a voice prompt message to indicate that the target device does not exist in at least one home appliance.

[0147] After the target sound source signal is determined, the target device can be determined in at least one household electrical appliance according to the target sound source signal.

[0148] Specifically, the frequency band of the target sound source signal can be obtained, and then the target device can be determined in at least one home appliance according to the correspondence between the frequency bands of each sound source signal and the home appliance, and the frequency band of the target sound source signal. Each eigenvalue is related to the frequency of the sound source signal, that is, the frequency band of the sound source signal can be used to characterize the characteristics of the sound source. Then, the home appliance corresponding to the sound source signal is inferred by the frequency band of the sound source signal corresponding to its eigenvalue. For example, Figure 4 In the figure, the eigenvalue corresponding to the 90-degree sound source signal is 34.4792, which can correspond to a sound source signal with a frequency band of 2kHz centered at 30k, so it can be fixed as the sound frequency band emitted by the air conditioner 12.

[0149] After the target device is determined, it is necessary to control the target device to perform the operation corresponding to the control instruction. In a possible implementation, the control device can broadcast a second infrared signal according to the control instruction. Figure 5 Provide explanation.

[0150] Figure 5 A schematic diagram of a control target device provided in an embodiment of the present application, such as Figure 5 As shown, the household appliances include a lamp 11, an air conditioner 12 and a television 13, wherein the remote controller 10 determines the air conditioner 12 as the target device and then broadcasts the second infrared signal. Since the second infrared signal is transmitted in a broadcast form, each household appliance can receive the second infrared signal.

[0151] The second infrared signal also includes the device identification of the target device. Figure 5 In the example, the second infrared signal includes the device identification of the air conditioner 12. After receiving the second infrared signal, each household appliance can obtain the device identification of the target device, and then determine whether the device identification of the target device is its own device identification.

[0152] If the device identification of the home appliance is different from the device identification of the target device, it means that the home appliance is not the target device, and the home appliance does not respond to the second infrared signal. For example, after receiving the second infrared signal, the light 11 obtains the device identification of the air conditioner 12, compares it with the device identification of its own light 11, and finds that they are not the same device identification, so the operation corresponding to the control instruction is not executed.

[0153] If the device identification of the home appliance is the same as the device identification of the target device, it indicates that the home appliance is the target device, and the home appliance responds to the second infrared signal and executes the operation corresponding to the control instruction according to the second infrared signal. For example, after receiving the second infrared signal, the air conditioner 12 obtains the device identification of the air conditioner 12, compares it with the device identification of its own air conditioner 12, and finds that they are the same device identification, so it executes the operation corresponding to the control instruction.

[0154] The solution of this application will be introduced below with reference to a specific example.

[0155] Figure 6 A flow chart of the control method provided in the embodiment of the present application is as follows: Figure 6 As shown, including:

[0156] S601, the user presses the remote control and inputs a command by voice or key.

[0157] The remote control is a control device. After the user presses the remote control, the voice or key input command is the control command. Because different home appliances can perform different operations, there are common operations and different operations between home appliances. For common operations, corresponding commands can be set on the remote control. For example, "power on" and "power off" exist in all home appliances and can be set on the remote control.

[0158] For different operations, commands can be issued through voice. For example, for a light, the brightness can be adjusted. This command cannot be responded to by home appliances such as air conditioners and refrigerators. Therefore, this command is usually not set on the remote control, but is operated by the user through voice commands.

[0159] For key commands, there is no need to bind or unbind the remote control and any home appliances. All home appliances can be controlled with just one remote control. For voice commands, there is no need to specify the specific home appliances to be operated. For example, when the user wants to adjust the air conditioner temperature to 23 degrees, there is no need to say "adjust the air conditioner to 23 degrees", but only need to say "adjust to 23 degrees". In other words, there is no need to specify the device to be controlled in the voice command, and the user only needs to point the remote control at the device to control it.

[0160] S602: The user presses and holds a button and points to a target device.

[0161] When the user wants to control a target device, the user usually points the remote control at the target device, that is, the user picks up the remote control and points it at the target device.

[0162] S603, the command is sent to each home appliance via infrared, and the user releases the button.

[0163] When the user presses the remote control, the remote control will broadcast a first infrared signal, and each home appliance will receive the first infrared signal.

[0164] S604, after receiving the command, each household appliance sends out a sound source signal.

[0165] After receiving the first infrared signal, each household appliance responds to the first infrared signal and sends out a sound source signal. The frequency bands of the sounds sent out by each household appliance are different, for example, ultrasonic signals of different frequency bands may be used.

[0166] S605: The remote controller locates the sound source according to the sound source signal.

[0167] After the microphone array in the remote control receives the sound source signals emitted by various household appliances, it can locate the sound source according to the sound source signals and determine the direction information of each sound source signal.

[0168] S606, determine whether there is a sound source signal of about 90 degrees, if so, execute S608, if not, execute S607.

[0169] In the embodiment of the present application, when the remote control is aimed at the target device, the angle between the sound source signal emitted by the target device and the microphone array is about 90 degrees. Therefore, after the sound source localization obtains the direction information of each sound source signal, the remote control determines whether there is a sound source signal at about 90 degrees.

[0170] S607, prompt "Cannot find the target device, please aim and try again."

[0171] If there is no sound source signal at about 90 degrees, it means that the remote control is not aimed at any home appliance. At this time, the remote control can issue a reminder to remind the user to realign it with the target device to be controlled.

[0172] S608, the remote controller analyzes the frequency band corresponding to the 90-degree sound source signal.

[0173] If there is a sound source signal at about 90 degrees, it means that the remote control is aimed at a certain home appliance. At this time, the remote control analyzes and obtains the frequency band corresponding to the sound source signal.

[0174] S609, the remote controller confirms the device of the corresponding frequency band.

[0175] Since the frequency bands of the sound source signals emitted by different household electrical appliances are different, the target device can be determined based on the corresponding relationship between the frequency band and the household electrical appliances and the frequency band of the sound source signal.

[0176] S610, the remote controller verifies the target device through infrared.

[0177] Specifically, the remote controller broadcasts a second infrared signal, and the second infrared signal includes a device identification of the target device.

[0178] S611, the home appliance receives the infrared information and compares it to confirm whether it is the target device. If so, execute S612, if not, end the process.

[0179] Since the second infrared signal includes the device identification of the target device, each household appliance obtains the device identification of the target device after receiving the second infrared signal, and then determines whether the device identification of the target device is consistent with its own device identification. If they are consistent, it means that it is the target device and responds to the control instruction. If they are different, it means that it is not the target device and does not respond.

[0180] S612, perform instruction operation.

[0181] The target device performs corresponding operations according to the control instructions, such as "shut down", "start up", etc.

[0182] The control method provided in the embodiment of the present application first responds to the control instruction acting on the control device, broadcasts a first infrared signal according to the control instruction, then receives at least one sound source signal, and obtains the angle between each sound source signal and the microphone array in the control device, and then determines the target device in the corresponding at least one home appliance, thereby controlling the target device to perform the operation corresponding to the control instruction. The solution provided in the embodiment of the present application performs sound source positioning based on the sound source signals emitted by each home appliance, determines the target device that the user wants to control, and thus can control all home appliances through one control device, which is convenient and simple to operate.

[0183] Figure 7 A schematic diagram of a control device provided in an embodiment of the present application Figure 1 ,like Figure 7 As shown, the control device 70 includes:

[0184] A first broadcast module 71, configured to respond to a control instruction acting on a control device and broadcast a first infrared signal according to the control instruction, wherein the control device includes a microphone array;

[0185] A receiving module 72, configured to receive at least one sound source signal and obtain an angle between each of the sound source signals and the microphone array, wherein the sound source signal is sent by the household appliance in response to the first infrared signal;

[0186] A processing module 73, configured to determine a target device in at least one corresponding household electrical appliance according to an angle between each of the sound source signals and the microphone array;

[0187] The second broadcast module 74 is used to control the target device to execute the operation corresponding to the control instruction.

[0188] In a possible implementation manner, the receiving module 72 is specifically configured to:

[0189] According to each of the sound source signals, a sound source signal matrix is ​​established;

[0190] According to the sound source signal matrix, obtaining a covariance matrix of the sound source signal;

[0191] A signal subspace spectrum of each of the sound source signals is obtained according to the covariance matrix, where the signal subspace spectrum is used to indicate an angle between each of the sound source signals and the microphone array.

[0192] In a possible implementation manner, the processing module 73 is specifically configured to:

[0193] Determine a target sound source signal in each of the sound source signals according to an angle between each of the sound source signals and the microphone array, wherein the angle between the target sound source signal and the microphone array is within a preset range;

[0194] The target device is determined in the at least one household electrical appliance according to the target sound source signal.

[0195] In a possible implementation manner, if the angle between any sound source signal and the microphone array is not within the preset range, the processing module 73 is further configured to:

[0196] A voice prompt message is played, where the voice prompt message is used to indicate that the target device does not exist in the at least one household electrical appliance.

[0197] In a possible implementation manner, the processing module 73 is specifically configured to:

[0198] Acquire the frequency band where the target sound source signal is located, wherein different sound source signals are located in different frequency bands;

[0199] The target device is determined in the at least one home appliance according to the correspondence between the frequency bands of the sound source signals and the home appliances, and the frequency band of the target sound source signal.

[0200] In a possible implementation manner, the second broadcast module 74 is specifically configured to:

[0201] A second infrared signal is broadcast according to the control instruction, wherein the second infrared signal includes a device identification of the target device, and the second infrared signal is used to instruct the target device to execute an operation corresponding to the control instruction.

[0202] In a possible implementation, the sound source signal is an ultrasonic sound source signal, or an infrasonic sound source signal.

[0203] The device provided in the embodiment of the present application can be used to execute the technical solution of the above-mentioned method embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0204] Figure 8 A schematic diagram of a control device provided in an embodiment of the present application Figure 2 ,like Figure 8 As shown, the control device 80 includes:

[0205] A first receiving module 81, used to receive a first infrared signal, where the first infrared signal is a signal broadcast by the control device according to a control instruction;

[0206] A sending module 82, configured to send a sound source signal to the control device, wherein the sound source signal is used to instruct the control device to determine a target device according to the received sound source signal;

[0207] A second receiving module 83, used to receive a second infrared signal, where the second infrared signal includes a device identification of the target device;

[0208] The processing module 84 is used to determine whether to execute the operation corresponding to the control instruction according to the second infrared signal.

[0209] In a possible implementation manner, the processing module 84 is specifically configured to:

[0210] If the device identifier included in the second infrared signal is the device identifier of the household appliance, performing the operation corresponding to the control instruction according to the second infrared signal;

[0211] Otherwise, it is determined not to execute the operation corresponding to the control instruction.

[0212] In a possible implementation, the sound source signal is an ultrasonic sound source signal, or an infrasonic sound source signal.

[0213] The device provided in the embodiment of the present application can be used to execute the technical solution of the above-mentioned method embodiment. Its implementation principle and technical effect are similar and will not be repeated here.

[0214] Fig. 9 A schematic diagram of the hardware structure of the control device provided in the embodiment of the present application is shown in FIG. Fig. 9 As shown, the control device includes: a microphone array 91, at least one processor 92 and a memory 93. The microphone array 91, the processor 92 and the memory 93 are connected via a bus 94.

[0215] Optionally, the model determination also includes a communication component. For example, the communication component may include a receiver and / or a transmitter.

[0216] In the specific implementation process, at least one processor 92 executes the computer execution instructions stored in the memory 93, so that at least one processor 92 performs the above control method, wherein the processor 92 receives at least one sound source signal through the microphone array 91.

[0217] The specific implementation process of the processor 92 can be found in the above method embodiment, and its implementation principle and technical effect are similar, so this embodiment will not be repeated here.

[0218] Fig.10 A schematic diagram of the hardware structure of the household appliance provided in the embodiment of the present application is shown in FIG. Fig.10As shown, the household appliance includes: at least one processor 101 and a memory 102. The processor 101 and the memory 102 are connected via a bus 103.

[0219] Optionally, the model determination also includes a communication component. For example, the communication component may include a receiver and / or a transmitter.

[0220] In a specific implementation process, at least one processor 101 executes the computer-executable instructions stored in the memory 102, so that at least one processor 101 executes the above control method.

[0221] The specific implementation process of the processor 101 can be found in the above method embodiment, and its implementation principle and technical effect are similar, so this embodiment will not be repeated here.

[0222] In the above Fig. 9 or Fig.10 In the illustrated embodiment, it should be understood that the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), etc. A general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in the application may be directly implemented as being executed by a hardware processor, or may be executed by a combination of hardware and software modules in the processor.

[0223] The memory may include a high-speed RAM memory, and may also include a non-volatile storage NVM, such as at least one disk storage.

[0224] The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus, etc. The bus may be divided into an address bus, a data bus, a control bus, etc. For ease of representation, the bus in the drawings of the present application is not limited to only one bus or one type of bus.

[0225] Fig.11 A schematic diagram of a control system provided in an embodiment of the present application is shown in FIG. Fig.11As shown, it includes a control device 111 and a household appliance 112. The method steps executed by the control device 111 and the household appliance 112 are detailed in the above embodiment and will not be repeated here.

[0226] The present application also provides a computer-readable storage medium, in which computer-executable instructions are stored. When a processor executes the computer-executable instructions, the control method described above is implemented.

[0227] The present application also provides a computer program product, which includes: a computer program, which is stored in a readable storage medium. At least one processor of an electronic device can read the computer program from the readable storage medium, and at least one processor executes the computer program so that the electronic device executes the solution provided by any of the above embodiments.

[0228] The computer-readable storage medium mentioned above can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk. The readable storage medium can be any available medium that can be accessed by a general or special-purpose computer.

[0229] An exemplary readable storage medium is coupled to a processor so that the processor can read information from the readable storage medium and write information to the readable storage medium. Of course, the readable storage medium can also be a component of the processor. The processor and the readable storage medium can be located in an application specific integrated circuit (Application Specific Integrated Circuits, referred to as: ASIC). Of course, the processor and the readable storage medium can also exist in the device as discrete components.

[0230] The division of the units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, which may be electrical, mechanical or other forms.

[0231] The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0232] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit.

[0233] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art or the part of the technical solution, can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the methods described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk.

[0234] Those skilled in the art can understand that all or part of the steps of implementing the above-mentioned method embodiments can be completed by hardware related to program instructions. The aforementioned program can be stored in a computer-readable storage medium. When the program is executed, the steps of the above-mentioned method embodiments are executed; and the aforementioned storage medium includes: ROM, RAM, disk or optical disk and other media that can store program codes.

[0235] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit it. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or replace some or all of the technical features therein with equivalents. However, these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present application.

Claims

1. A control method, characterized in that: Applied to a control device, the control device includes a microphone array, and the control method includes: In response to a control instruction acting on the control device, broadcast a first infrared signal according to the control instruction; receiving at least one sound source signal, and acquiring an angle between each of the sound source signals and the microphone array, wherein the sound source signal is sent by the household appliance in response to the first infrared signal; Determining a target device in at least one corresponding household electrical appliance according to an angle between each of the sound source signals and the microphone array; Control the target device to execute the operation corresponding to the control instruction.

2. The control method according to claim 1, characterized in that: The obtaining of the angle between each of the sound source signals and the microphone array comprises: According to each of the sound source signals, a sound source signal matrix is ​​established; According to the sound source signal matrix, obtaining a covariance matrix of the sound source signal; A signal subspace spectrum of each of the sound source signals is obtained according to the covariance matrix, where the signal subspace spectrum is used to indicate an angle between each of the sound source signals and the microphone array.

3. The control method according to claim 1, characterized in that: The step of determining a target device in at least one corresponding household appliance according to an angle between each of the sound source signals and the microphone array comprises: Determine a target sound source signal in each of the sound source signals according to an angle between each of the sound source signals and the microphone array, wherein the angle between the target sound source signal and the microphone array is within a preset range; The target device is determined in the at least one household electrical appliance according to the target sound source signal.

4. The control method according to claim 3, characterized in that: If the angle between any sound source signal and the microphone array is not within the preset range, the method further includes: A voice prompt message is played, where the voice prompt message is used to indicate that the target device does not exist in the at least one household electrical appliance.

5. The control method according to claim 3, characterized in that: The step of determining the target device in the at least one household appliance according to the target sound source signal includes: Acquire the frequency band where the target sound source signal is located, wherein different sound source signals are located in different frequency bands; The target device is determined in the at least one home appliance according to the correspondence between the frequency bands of the sound source signals and the home appliances, and the frequency band of the target sound source signal.

6. The control method according to any one of claims 2 to 5, characterized in that: Controlling the target device to execute the operation corresponding to the control instruction includes: A second infrared signal is broadcast according to the control instruction, wherein the second infrared signal includes a device identification of the target device, and the second infrared signal is used to instruct the target device to execute an operation corresponding to the control instruction.

7. The control method according to any one of claims 1 to 5, characterized in that: The sound source signal is an ultrasonic sound source signal, or an infrasonic sound source signal.

8. A control method, characterized in that: Applied to household electrical appliances, the control method includes: receiving a first infrared signal, where the first infrared signal is a signal broadcast by a control device according to a control instruction; Sending a sound source signal to the control device, wherein the sound source signal is used to instruct the control device to determine a target device according to the received sound source signal; receiving a second infrared signal, wherein the second infrared signal includes a device identification of the target device; Determine whether to execute the operation corresponding to the control instruction according to the second infrared signal.

9. The control method according to claim 8, characterized in that: The determining, according to the second infrared signal, whether to execute the operation corresponding to the control instruction includes: If the device identifier included in the second infrared signal is the device identifier of the household appliance, performing the operation corresponding to the control instruction according to the second infrared signal; Otherwise, it is determined not to execute the operation corresponding to the control instruction.

10. The control method according to claim 8 or 9, characterized in that: The sound source signal is an ultrasonic sound source signal, or an infrasonic sound source signal.

11. A control device, characterized in that: include: A first broadcast module, configured to respond to a control instruction acting on a control device and broadcast a first infrared signal according to the control instruction, wherein the control device includes a microphone array; a receiving module, configured to receive at least one sound source signal and obtain an angle between each of the sound source signals and the microphone array, wherein the sound source signal is sent by the household appliance in response to the first infrared signal; A processing module, configured to determine a target device in at least one corresponding home appliance according to an angle between each of the sound source signals and the microphone array; The second broadcast module is used to control the target device to execute the operation corresponding to the control instruction.

12. A control device, characterized in that: include: A first receiving module, used to receive a first infrared signal, where the first infrared signal is a signal broadcast by the control device according to a control instruction; A sending module, used to send a sound source signal to the control device, wherein the sound source signal is used to instruct the control device to determine a target device according to the received sound source signal; A second receiving module, used for receiving a second infrared signal, wherein the second infrared signal includes a device identification of the target device; The processing module is used to determine whether to execute the operation corresponding to the control instruction according to the second infrared signal.

13. A control device, characterized in that: The invention comprises a microphone array, a memory and at least one processor, wherein: The memory stores computer-executable instructions; The at least one processor executes the computer-executable instructions stored in the memory to implement the control method according to any one of claims 1 to 7, wherein the processor receives at least one sound source signal through the microphone array.

14. A household appliance, characterized in that: include: at least one processor and memory; The memory stores computer-executable instructions; The at least one processor executes the computer-executable instructions stored in the memory, so that the at least one processor executes the control method according to any one of claims 8 to 10.

15. A control system, characterized in that: It includes the control device according to claim 13 and the household appliance according to claim 14.

16. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer-executable instructions, and when the processor executes the computer-executable instructions, the control method according to any one of claims 1 to 10 is implemented.

17. A computer program product, characterized in that The computer program product comprises a computer program; the computer program is used to execute the control method according to any one of claims 1 to 10.

Images