A wake-up method and electronic device

Abstract

The present application relates to a wake-up method and an electronic device. The electronic device includes: a processor; a memory; M microphones; P ultrasonic transmitters; Q ultrasonic receivers; a computer program on the memory, when executed by the processor, the electronic device executes: detecting a first sound wave signal through M microphones; obtaining a first sound pickup direction; when the similarity between the component of the first sound wave signal in the first sound pickup direction and the preset wake-up word is less than a preset first threshold, and greater than or equal to a preset second threshold, by sending and receiving a second sound wave signal, the second sound wave signal is an ultrasonic signal to obtain a second sound pickup direction; when the similarity between the component of the first sound wave signal in the second sound pickup direction and the preset wake-up word is greater than a preset third threshold, the electronic device wakes up, thereby improving the wake-up accuracy of the electronic device, reducing the probability of false wake-up, and improving the user experience.

Description

Technical Field

[0001] The present application relates to the field of terminals, and in particular to a wake-up method and an electronic device. Background Art

[0002] With the development of voice recognition technology, many electronic devices are equipped with voice assistants (e.g., XiaoE, Siri, etc.) to realize voice interaction with users. Generally speaking, electronic devices will preset one or more wake-up words (e.g., "hello XiaoE", "hi Siri", etc.). After detecting the preset wake-up words, the electronic device wakes up and interacts with the user's voice through the voice assistant.

[0003] However, in practice, it is found that sometimes, even if the sound wave signal sent by the user contains the preset wake-up word, the electronic device does not wake up; or sometimes, even if the sound wave signal sent by the user does not contain the preset wake-up word, the electronic device wakes up. This brings a bad experience to the user. Summary of the invention

[0004] In order to solve the above technical problems, the present application provides a wake-up method and an electronic device. The technical solution provided by the present application can improve the accuracy of waking up the electronic device, reduce the probability of false waking up of the electronic device, and improve the user experience.

[0005] In the first aspect, an electronic device is provided, which is in an unawakened state. The electronic device includes: a processor; a memory; M (M is a positive integer greater than 1) microphones, each microphone corresponds to a sound pickup entrance; the M sound pickup entrances of the M microphones are located on the first surface of the electronic device, and the first surface is on a plane; the distance between any two of the M microphones is fixed; P (P is a positive integer greater than or equal to 1) ultrasonic transmitters, each ultrasonic transmitter corresponds to an ultrasonic transmission port; the P ultrasonic transmission ports of the P ultrasonic transmitters are located on the second surface; the second surface is different from the first surface; Q (Q is a positive integer greater than 1) ultrasonic receivers, each ultrasonic receiver corresponds to an ultrasonic receiving port; the Q ultrasonic receiving ports of the Q ultrasonic receivers are located on the third surface of the electronic device, and the third surface is on a plane; the third surface is different from the first surface; the distance between any two of the Q ultrasonic receivers is fixed; the Q ultrasonic receiving ports and the P ultrasonic transmission ports face different directions; and a computer program, wherein the computer program is stored in the memory, and when the computer program is executed by the processor, the electronic device performs the following steps:

[0006] A first sound wave signal is detected by the above-mentioned M microphones; in response to the first sound wave signal, a first sound pickup direction is obtained according to the arrival time difference of the first sound wave signal at at least two of the M microphones, and the distance between some or all of the at least two microphones; wherein the first sound pickup direction is used to indicate: a first projection point of the first sound source position on the plane where the first surface is located, relative to a fixed point on the plane where the first surface is located (the fixed point is different from the first projection point); furthermore, a first sound wave signal component of the first sound wave signal in the first sound pickup direction is obtained; after the similarity between the first sound wave signal component and the preset wake-up word is less than a preset first threshold value, and greater than or equal to a preset second threshold value, a second sound wave signal can be emitted through P ultrasonic transmitters, and the second sound wave signal It is an ultrasonic signal; furthermore, a second sound wave signal can be received by Q ultrasonic receivers; in response to the second sound wave signal, a second sound pickup direction is obtained according to the arrival time difference of the second sound wave signal at at least two of the Q ultrasonic receivers, and the distance between some or all of the at least two ultrasonic receivers; wherein the second sound pickup direction is used to indicate: the direction of the second projection point of the second sound source position on the plane where the first surface is located, relative to the fixed point (the fixed point is different from the second projection point); furthermore, a second sound wave signal component of the first sound wave signal in the second sound pickup direction is obtained; after the similarity between the second sound wave signal component and the preset wake-up word is greater than the preset third threshold, it indicates that the first sound wave signal contains the wake-up word, and the electronic device wakes up.

[0007] It can be seen that the first aspect provides that the electronic device can be divided into two stages when executing the wake-up method. In the first stage, the electronic device can first locate the first pickup direction according to the sound wake-up process, and then identify the similarity between the sound wave signal component of the first sound wave signal in the first pickup direction and the preset wake-up word. When the similarity between the sound wave signal component in the first pickup direction and the preset wake-up word is between the first threshold and the second threshold, the above-mentioned wake-up method can enter the second stage. In the second stage, the electronic device can use an ultrasonic signal to locate the second pickup direction, and then identify the similarity between the sound wave signal component of the first sound wave signal in the second pickup direction and the preset wake-up word. When the similarity between the sound wave signal component in the second pickup direction and the preset wake-up word meets the corresponding threshold condition, the electronic device wakes up. In this way, the electronic device can determine the sound source position of the end user by locating the pickup direction in two stages, so as to identify the wake-up word according to the final determined sound source position, improve the accuracy of the electronic device wake-up, and reduce the probability of false wake-up of the electronic device.

[0008] According to the first aspect, after the similarity between the first sound wave signal component and the preset wake-up word is greater than the first threshold, the electronic device further performs: waking up the electronic device. That is, if in the above-mentioned first stage, the similarity between the sound wave signal component of the first sound wave signal in the first sound pickup direction and the preset wake-up word is high, it means that the first sound wave signal detected by the electronic device is relatively close to the preset wake-up word, then the electronic device is woken up, and there is no need to enter the above-mentioned second stage for positioning again.

[0009] According to the first aspect, or any implementation of the first aspect above, after the similarity between the first sound wave signal component and the preset wake-up word is less than the second threshold, the electronic device further executes: maintaining an unawakened state. That is, if in the above-mentioned first stage, the similarity between the sound wave signal component of the first sound wave signal in the first sound pickup direction and the preset wake-up word is low, indicating that the first sound wave signal detected by the electronic device is quite different from the preset wake-up word, then the electronic device can continue to maintain an unawakened state, and there is no need to enter the above-mentioned second stage for positioning again.

[0010] According to the first aspect, or any implementation of the first aspect above, after the similarity between the second sound wave signal component and the preset wake-up word is less than or equal to the third threshold, the electronic device further executes: maintaining an unawakened state. That is, if in the above-mentioned second stage, the similarity between the sound wave signal component of the first sound wave signal in the second sound pickup direction and the preset wake-up word is high, it means that although the similarity between the first sound wave signal and the wake-up word is not high in the first stage, it can be determined through ultrasonic positioning that the actual first sound wave signal is close to the preset wake-up word, and then the electronic device is woken up.

[0011] According to the first aspect, or any implementation of the first aspect, the Q ultrasonic receivers may be part or all of the M microphones; wherein Q is less than or equal to M; the ultrasonic receiving port is a sound pickup port; and the third surface is the same as the first surface. In this way, the electronic device can use the existing microphones to participate in ultrasonic positioning without the need for additional ultrasonic receivers, thereby reducing the cost of ultrasonic positioning in voice interaction scenarios.

[0012] According to the first aspect, or any implementation of the first aspect, the Q ultrasonic receivers may be different from part or all of the M microphones.

[0013] According to the first aspect, or any implementation of the first aspect above, the electronic device also includes: N speakers, N sound wave emitting ports of the N speakers are located on the fourth surface; N is a positive integer greater than or equal to 1; the fourth surface is different from the above-mentioned first surface.

[0014] According to the first aspect, or any implementation of the first aspect above, the electronic device further includes: the P ultrasonic transmitters are part or all of the N speakers; wherein P is less than or equal to N; the ultrasonic transmitting port is a sound wave transmitting port at this time; and the fourth surface is the same as the second surface. In this way, the electronic device can use the existing speakers to participate in ultrasonic positioning without the need for additional ultrasonic transmitters, thereby reducing the cost of ultrasonic positioning in voice interaction scenarios.

[0015] According to the first aspect, or any implementation of the first aspect, the P ultrasonic transmitters may be different from part or all of the N speakers.

[0016] According to the first aspect, or any implementation of the first aspect, the second surface is parallel to the first surface.

[0017] In the second aspect, an electronic device is provided, which is in an unawakened state. The electronic device includes: a processor; a memory; M (M is a positive integer greater than 1) microphones, each microphone corresponds to a sound pickup entrance; the M sound pickup entrances of the M microphones are located on the first surface of the electronic device, and the first surface is on a plane; the distance between any two of the M microphones is fixed; P (P is a positive integer greater than or equal to 1) ultrasonic transmitters, each ultrasonic transmitter corresponds to an ultrasonic transmission port; the P ultrasonic transmission ports of the P ultrasonic transmitters are located on the second surface; the second surface is different from the first surface; Q (Q is a positive integer greater than 1) ultrasonic receivers, each ultrasonic receiver corresponds to an ultrasonic receiving port; the Q ultrasonic receiving ports of the Q ultrasonic receivers are located on the third surface of the electronic device, and the third surface is on a plane; the third surface is different from the first surface; the distance between any two of the Q ultrasonic receivers is fixed; the Q ultrasonic receiving ports and the P ultrasonic transmission ports face different directions; and a computer program, wherein the computer program is stored in the memory, and when the computer program is executed by the processor, the electronic device performs the following steps:

[0018] A first sound wave signal is detected by M microphones; in response to the first sound wave signal, a first sound pickup direction is obtained according to the arrival time difference of the first sound wave signal at at least two of the M microphones, and the distance between some or all of the at least two microphones; the first sound pickup direction is used to indicate: the direction of a first projection point of a first sound source position on the plane where the first surface is located, relative to a fixed point on the plane where the first surface is located; the fixed point is different from the first projection point; a first sound wave signal component of the first sound wave signal in the first sound pickup direction is obtained; after the similarity between the first sound wave signal component and the preset wake-up word is less than a preset first threshold and greater than or equal to a preset second threshold, a second sound wave signal is emitted by P ultrasonic transmitters, and the second sound wave signal is an ultrasonic signal; the second sound wave signal is received by Q ultrasonic receivers wave signal; in response to the second sound wave signal, a second sound pickup direction is obtained according to the arrival time difference of the second sound wave signal at at least two of the Q ultrasonic receivers, and the distance between some or all of the at least two ultrasonic receivers; the second sound pickup direction is used to indicate the direction of the second projection point of the second sound source position on the plane where the first surface is located relative to the fixed point; the fixed point is different from the second projection point; a third sound pickup direction is determined according to the first sound pickup direction and the second sound pickup direction, and the third sound pickup direction is used to indicate the direction of the third projection point of the third sound source position on the plane where the first surface is located relative to the fixed point; a third sound wave signal component of the first sound wave signal in the third sound pickup direction is obtained; after the similarity between the third sound wave signal component and the preset wake-up word is greater than a preset third threshold, the electronic device wakes up.

[0019] It can be seen that the wake-up method performed by the electronic device provided in the second aspect can also be divided into two stages. In the first stage, the electronic device can first locate the first sound pickup direction according to the sound wake-up process, and then identify the similarity between the sound wave signal component of the first sound wave signal in the first sound pickup direction and the preset wake-up word. When the similarity between the sound wave signal component in the first sound pickup direction and the preset wake-up word is between the first threshold and the second threshold, the above-mentioned wake-up method can enter the second stage. Different from the first aspect, in the second stage, the electronic device can use an ultrasonic signal to locate the second sound pickup direction, and then correct the first sound pickup direction by the second sound pickup direction to obtain a third sound pickup direction closer to the actual location of the user. In this way, the electronic device can identify the similarity between the sound wave signal component of the first sound wave signal in the third sound pickup direction and the preset wake-up word. When the similarity between the sound wave signal component in the third sound pickup direction and the preset wake-up word meets the corresponding threshold condition, the electronic device wakes up. As a result, the accuracy of the electronic device waking up is higher, and the probability of the electronic device waking up by mistake is lower.

[0020] According to the second aspect, after the similarity between the first sound wave signal component and the preset wake-up word is greater than the first threshold, the electronic device further performs: waking up the electronic device. Similar to the first aspect, if in the above-mentioned first stage, the similarity between the sound wave signal component of the first sound wave signal in the first sound pickup direction and the preset wake-up word is high, it means that the first sound wave signal detected by the electronic device is relatively close to the preset wake-up word, then the electronic device is woken up, and there is no need to enter the above-mentioned second stage for positioning again.

[0021] According to the second aspect, or any implementation of the second aspect above, after the similarity between the first sound wave signal component and the preset wake-up word is less than the second threshold, the electronic device also executes: maintaining an unawakened state. Similar to the first aspect, if in the above-mentioned first stage, the similarity between the sound wave signal component of the first sound wave signal in the first sound pickup direction and the preset wake-up word is low, indicating that the first sound wave signal detected by the electronic device is quite different from the preset wake-up word, the electronic device can continue to maintain an unawakened state, and there is no need to enter the above-mentioned second stage for positioning again.

[0022] According to the second aspect, or any implementation of the second aspect above, after the similarity between the third sound wave signal component and the preset wake-up word is less than or equal to the third threshold, the electronic device further executes: maintaining a non-awakened state.

[0023] According to the second aspect, or any implementation of the second aspect above, the electronic device determines a third sound pickup direction based on the first sound pickup direction and the second sound pickup direction; including: if the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction is less than a preset fourth threshold, or the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction is greater than a preset fifth threshold, then the third sound pickup direction is the same as the first sound pickup direction.

[0024] According to the second aspect, or any implementation of the second aspect above, the electronic device determines a third sound pickup direction based on the first sound pickup direction and the second sound pickup direction; including: if the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction is greater than a preset fourth threshold and less than a fifth threshold, then the third sound pickup direction is the product of the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction and a preset proportional coefficient superimposed on the first sound pickup direction.

[0025] According to the second aspect, or any implementation of the second aspect above, the Q ultrasonic receivers are part or all of the M microphones; wherein Q is less than or equal to M; wherein the ultrasonic receiving port is a sound pickup entrance; and the third surface is the same as the first surface.

[0026] According to the second aspect, or any implementation of the second aspect, the Q ultrasonic receivers are different from part or all of the M microphones.

[0027] According to the second aspect, or any implementation of the second aspect above, the electronic device also includes: N speakers, N sound wave emitting ports of the N speakers are located on the fourth surface; N is a positive integer greater than or equal to 1; and the fourth surface is different from the first surface.

[0028] According to the second aspect, or any implementation of the second aspect above, the above-mentioned P ultrasonic transmitters are part or all of the above-mentioned N speakers; wherein P is less than or equal to N; the above-mentioned ultrasonic transmitting port is a sound wave transmitting port; and the fourth surface is the same as the second surface.

[0029] According to the second aspect, or any implementation of the second aspect, the P ultrasonic transmitters are different from some or all of the N speakers.

[0030] According to the second aspect, or any implementation of the second aspect, the second surface is parallel to the first surface.

[0031] In the third aspect, a wake-up method is provided. The wake-up method includes: detecting a first sound wave signal through M microphones; in response to the first sound wave signal, obtaining a first sound pickup direction according to the arrival time difference of the first sound wave signal to at least two of the above-mentioned M microphones, and the distance between some or all of the at least two microphones; wherein the first sound pickup direction is used to indicate the direction of the first projection point of the first sound source position on the plane where the first surface is located, relative to a fixed point on the plane where the first surface is located; the fixed point is different from the first projection point; obtaining a first sound wave signal component of the first sound wave signal in the first sound pickup direction; after the similarity between the first sound wave signal component and the preset wake-up word is less than a preset first threshold, and greater than or equal to a preset second threshold, through P ultrasonic transmitters A second sound wave signal is emitted, where the second sound wave signal is an ultrasonic signal; the second sound wave signal is received by Q ultrasonic receivers; in response to the second sound wave signal, a second sound pickup direction is obtained according to the arrival time difference of the second sound wave signal at at least two of the Q ultrasonic receivers, and the distance between some or all of the at least two ultrasonic receivers; wherein the second sound pickup direction is used to indicate the direction of a second projection point of a second sound source position on the plane where the first surface is located, relative to a fixed point; the fixed point is different from the second projection point; a second sound wave signal component of the first sound wave signal in the second sound pickup direction is obtained; after the similarity between the second sound wave signal component and a preset wake-up word is greater than a preset third threshold, the electronic device wakes up.

[0032] Corresponding to the electronic device provided in the first aspect, the wake-up method provided in the third aspect can be divided into two stages. In the first stage, the electronic device can first locate the first pickup direction according to the sound wake-up process, and then identify the similarity between the sound wave signal component of the first sound wave signal in the first pickup direction and the preset wake-up word. When the similarity between the sound wave signal component in the first pickup direction and the preset wake-up word is between the first threshold and the second threshold, the above-mentioned wake-up method can enter the second stage. In the second stage, the electronic device can use an ultrasonic signal to locate the second pickup direction, and then identify the similarity between the sound wave signal component of the first sound wave signal in the second pickup direction and the preset wake-up word. When the similarity between the sound wave signal component in the second pickup direction and the preset wake-up word meets the corresponding threshold condition, the electronic device wakes up. In this way, the electronic device can determine the sound source position of the end user by locating the pickup direction in two stages, so as to identify the wake-up word according to the final determined sound source position, improve the accuracy of the electronic device wake-up, and reduce the probability of false wake-up of the electronic device.

[0033] According to the third aspect, after the similarity between the first sound wave signal component and the preset wake-up word is greater than a first threshold, the method further includes: waking up the electronic device.

[0034] According to the third aspect, or any implementation of the third aspect above, after the similarity between the first sound wave signal component and the preset wake-up word is less than a second threshold, the method further includes: the electronic device remains in an unawakened state.

[0035] According to the third aspect, or any implementation of the third aspect above, after the similarity between the second sound wave signal component and the preset wake-up word is less than or equal to a third threshold, the method also includes: the electronic device remains in an unawakened state.

[0036] Any implementation of the third aspect corresponds to any implementation of the first aspect. The technical effect corresponding to any implementation of the third aspect can refer to the technical effect corresponding to any implementation of the first aspect, which will not be repeated here.

[0037] In a fourth aspect, a wake-up method is provided. The wake-up method includes: detecting a first sound wave signal through M microphones; in response to the first sound wave signal, obtaining a first sound pickup direction according to the arrival time difference of the first sound wave signal to at least two of the M microphones, and the distance between some or all of the at least two microphones; wherein the first sound pickup direction is used to indicate the direction of a first projection point of a first sound source position on a plane where the first surface is located, relative to a fixed point on the plane where the first surface is located; the fixed point is different from the first projection point; obtaining a first sound wave signal component of the first sound wave signal in the first sound pickup direction; after the similarity between the first sound wave signal component and a preset wake-up word is less than a preset first threshold value, and greater than or equal to a preset second threshold value, transmitting a second sound wave signal through P ultrasonic transmitters, the second sound wave signal being an ultrasonic signal; receiving the second sound wave signal through Q ultrasonic receivers Acoustic wave signal; in response to the second acoustic wave signal, a second sound pickup direction is obtained according to the arrival time difference of the second acoustic wave signal at at least two of the Q ultrasonic receivers, and the distance between some or all of the at least two ultrasonic receivers; wherein the second sound pickup direction is used to indicate the direction of the second projection point of the second sound source position on the plane where the first surface is located relative to the fixed point; the fixed point is different from the second projection point; a third sound pickup direction is determined according to the first sound pickup direction and the second sound pickup direction, wherein the third sound pickup direction is used to indicate the direction of the third projection point of the third sound source position on the plane where the first surface is located relative to the above-mentioned fixed point; a third acoustic wave signal component of the first acoustic wave signal in the third sound pickup direction is obtained; after the similarity between the third acoustic wave signal component and the preset wake-up word is greater than a preset third threshold, the electronic device wakes up.

[0038] Corresponding to the electronic device provided in the second aspect, the wake-up method provided in the fourth aspect can also be divided into two stages. In the first stage, the electronic device can first locate the first pickup direction according to the sound wake-up process, and then identify the similarity between the sound wave signal component of the first sound wave signal in the first pickup direction and the preset wake-up word. When the similarity between the sound wave signal component in the first pickup direction and the preset wake-up word is between the first threshold and the second threshold, the above-mentioned wake-up method can enter the second stage. Different from the third aspect, in the second stage, the electronic device can use an ultrasonic signal to locate the second pickup direction, and then correct the first pickup direction by the second pickup direction to obtain a third pickup direction closer to the actual location of the user. In this way, the electronic device can identify the similarity between the sound wave signal component of the first sound wave signal in the third pickup direction and the preset wake-up word. When the similarity between the sound wave signal component in the third pickup direction and the preset wake-up word meets the corresponding threshold condition, the electronic device wakes up. As a result, the accuracy of the electronic device waking up is higher, and the probability of the electronic device waking up by mistake is lower.

[0039] According to the fourth aspect, after the similarity between the first sound wave signal component and the preset wake-up word is greater than a first threshold, the method further includes: waking up the electronic device.

[0040] According to the fourth aspect, or any implementation of the fourth aspect above, after the similarity between the first sound wave signal component and the preset wake-up word is less than a second threshold, the method also includes: the electronic device remains in an unawakened state.

[0041] According to the fourth aspect, or any implementation of the fourth aspect above, after the similarity between the third sound wave signal component and the preset wake-up word is less than or equal to a third threshold, the method also includes: the electronic device remains in an unawakened state.

[0042] According to the fourth aspect, or any one of the implementations of the fourth aspect, a third sound pickup direction is determined based on the first sound pickup direction and the second sound pickup direction; including: when the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction is less than a preset fourth threshold, or when the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction is greater than a preset fifth threshold, the third sound pickup direction is the same as the first sound pickup direction.

[0043] According to the fourth aspect, or any one of the implementations of the fourth aspect, a third sound pickup direction is determined based on the first sound pickup direction and the second sound pickup direction; including: when the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction is greater than a preset fourth threshold value and less than a fifth threshold value, the third sound pickup direction is the product of the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction and a preset proportional coefficient superimposed on the first sound pickup direction.

[0044] Any implementation of the fourth aspect corresponds to any implementation of the second aspect. The technical effect corresponding to any implementation of the fourth aspect can refer to the technical effect corresponding to any implementation of the second aspect, which will not be repeated here.

[0045] In a fifth aspect, a wake-up method is provided. The wake-up method comprises: detecting a first sound wave signal through M microphones; in response to the first sound wave signal, obtaining a first sound pickup direction according to the arrival time difference of the first sound wave signal at at least two of the M microphones, and the distance between some or all of the at least two microphones; wherein the first sound pickup direction is used to indicate the direction of a first projection point of a first sound source position on a plane where a first surface is located, relative to a fixed point on the plane where the first surface is located; the fixed point is different from the first projection point; transmitting a second sound wave signal through P ultrasonic transmitters, the second sound wave signal being an ultrasonic signal; receiving the second sound wave signal through Q ultrasonic receivers; in response to the second sound wave signal, obtaining a first sound pickup direction according to the arrival time difference of the second sound wave signal at at least two of the Q ultrasonic receivers The second sound pickup direction is obtained by using the arrival time difference of the ultrasonic receivers and the distance between some or all of the ultrasonic receivers in at least two ultrasonic receivers; wherein the second sound pickup direction is used to indicate the direction of the second projection point of the second sound source position on the plane where the first surface is located relative to the fixed point; the fixed point is different from the second projection point; the third sound pickup direction is determined according to the first sound pickup direction and the second sound pickup direction, wherein the third sound pickup direction is used to indicate the direction of the third projection point of the third sound source position on the plane where the first surface is located relative to the above-mentioned fixed point; the third sound wave signal component of the first sound wave signal in the third sound pickup direction is obtained; after the similarity between the third sound wave signal component and the preset wake-up word is greater than a preset third threshold, the electronic device wakes up.

[0046] In the wake-up method provided in the fifth aspect, after the electronic device detects the first sound wave signal, two positioning processes can be performed. Once, positioning can be performed based on the time when the first sound wave signal reaches M microphones to obtain the first sound pickup direction; once, the obstacle can be positioned by sending and receiving ultrasonic signals to obtain the second sound pickup direction. Furthermore, after correcting the first sound pickup direction by the second sound pickup direction, a third sound pickup direction that is closer to the actual location of the user can be obtained. In this way, the electronic device can identify the similarity between the sound wave signal component of the first sound wave signal in the third sound pickup direction and the preset wake-up word. When the similarity between the sound wave signal component in the third sound pickup direction and the preset wake-up word meets the corresponding threshold condition, the electronic device wakes up. As a result, the accuracy of the electronic device waking up is higher, and the probability of the electronic device waking up by mistake is lower.

[0047] In a sixth aspect, the present application provides a computer-readable storage medium, comprising computer instructions. When the computer instructions are executed on the above-mentioned electronic device, the electronic device executes any of the wake-up methods described above.

[0048] In a seventh aspect, the present application provides a computer program product. When the computer program product is run on the above-mentioned electronic device, the electronic device executes any of the wake-up methods described above.

[0049] It can be understood that the computer-readable storage media and computer program products provided in the above-mentioned aspects are all applied to the corresponding methods and corresponding electronic devices provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding electronic devices or methods provided above, and will not be repeated here. BRIEF DESCRIPTION OF THE DRAWINGS

[0050] Figure 1A A schematic diagram of a scenario of a wake-up method provided in an embodiment of the present application;

[0051] Figure 1B A schematic diagram of the location of the sound source located for the provided electronic device;

[0052] Figure 1C A schematic diagram of the location of the sound source located for the provided electronic device;

[0053] Figure 2 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application;

[0054] Figure 3 A schematic diagram of the principle of acoustic signal positioning in the wake-up method provided in an embodiment of the present application;

[0055] Figure 4-Figure 7 A schematic diagram of the process of processing sound wave signals in the wake-up method provided in an embodiment of the present application;

[0056] Figure 8 A partial flow chart of a wake-up method provided in an embodiment of the present application;

[0057] Fig. 9 A schematic diagram of the principle of locating obstacles using ultrasonic signals in a wake-up method provided in an embodiment of the present application;

[0058] Fig.10 A schematic diagram of locating an obstacle using an ultrasonic signal in a wake-up method provided in an embodiment of the present application;

[0059] Fig.11 A schematic diagram of a process of processing a sound wave signal in a wake-up method provided in an embodiment of the present application;

[0060] Fig.12 A partial flow chart of another wake-up method provided in an embodiment of the present application;

[0061] Fig.13 A schematic diagram of the location of a sound source in another wake-up method provided in an embodiment of the present application;

[0062] Fig.14 A schematic diagram of sound wave signal processing in another wake-up method provided in an embodiment of the present application;

[0063] Fig.15 A schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0064] The technical solutions in the embodiments of the present application are described below in conjunction with the drawings in the embodiments of the present application. Among them, in the description of the embodiments of the present application, the terms used in the following embodiments are only for the purpose of describing specific embodiments, and are not intended to be used as limitations on the present application. As used in the specification and the appended claims of the present application, the singular expressions "a", "said", "above", "the" and "this" are intended to also include expressions such as "one or more", unless there is a clear indication to the contrary in the context. It should also be understood that in the following embodiments of the present application, "at least one", "one or more" refer to one or more (including two). The term "and / or" is used to describe the association relationship of associated objects, indicating that three relationships can exist; for example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone, where A and B can be singular or plural. The character " / " generally indicates that the associated objects before and after are in a "or" relationship.

[0065] References to "one embodiment" or "some embodiments" etc. described in this specification mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Thus, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some other embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways. The term "connection" includes direct connection and indirect connection, unless otherwise specified. "First" and "second" are used for descriptive purposes only and cannot be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.

[0066] In the embodiments of the present application, the words "exemplarily" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplarily" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplarily" or "for example" is intended to present related concepts in a specific way.

[0067] Figure 1A A schematic diagram of a scenario of a wake-up method provided in an embodiment of the present application. Figure 1A As shown, the electronic device 100 has a voice interaction function and can receive sound wave signals. Specifically, the upper surface of the electronic device 100 is provided with a plurality of microphones or a microphone array 170C for sound pickup inlets; each microphone or each microphone array corresponds to a sound pickup inlet; and a plurality of microphones or a microphone array 170C receive sound wave signals through different sound pickup inlets on the upper surface. Optionally, other parts (such as the sides, etc.) or the upper surface of the electronic device 100 may be provided with a speaker (not shown in the figure) for outputting sound wave signals. The user 200 can wake up the electronic device 100 through a sound wave signal, and then after the electronic device 100 wakes up, the electronic device is controlled by further voice commands to perform the corresponding function. Exemplarily, the electronic device 100 may be a device with a voice interaction function such as a smart speaker, a smart TV, a smart air conditioner, a smart door lock, a smart lamp, etc. This application is not limited to this.

[0068] It should be noted that the sound wave signal includes a voice signal (a signal with a frequency of 20 Hz-20000 Hz). Optionally, the sound wave signal also includes an ultrasonic signal (a signal with a frequency greater than 20000 Hz). Optionally, the sound wave signal may also include an infrasonic signal (a signal with a frequency lower than 20 Hz). The sound wave signal emitted by the user refers to a voice signal emitted by the user.

[0069] It should be noted that Figure 1A The multiple sound pickup inlets of the multiple microphones or microphone array 170C are arranged on the upper surface of the electronic device 100, which is only a schematic example. The above-mentioned multiple sound pickup inlets can also be arranged on another surface. When the electronic device 100 is in use, the upper surface or another surface is in a horizontal plane or close to a horizontal plane. Another surface is close to a horizontal plane means that although the other surface is uneven and has certain bumps, the bumps have little effect and can be approximately considered as a horizontal plane. For the sake of convenience of explanation, the following is an example in which multiple microphones or a microphone array 170C are arranged on the upper surface of the electronic device 100.

[0070] In practice, it is found that sometimes, even if the sound wave signal sent by the user 200 contains the preset wake-up word, the electronic device 100 does not wake up; or sometimes, even if the sound wave signal sent by the user 200 does not contain the preset wake-up word, the electronic device 100 wakes up. This disturbs the user and brings a bad experience to the user.

[0071] In order to solve the above technical problems, the inventors have concluded that there are two main reasons for the above errors after long-term in-depth research, experiments and analysis. Before explaining the above two reasons, the voice interaction process on the electronic device side and the process of locating the sound source position of the electronic device based on the detected sound wave signal are introduced.

[0072] It should be noted that, since the sound pickup entrances of the multiple microphones or microphone array 170C are arranged on the upper surface of the electronic device 100, the electronic device 100 cannot identify the three-dimensional position of the sound source, but can only identify the position corresponding to the projection of the sound source on the plane where the upper surface is located, that is, the two-dimensional position. Figure 1B Specific instructions. Figure 1B FIG. 1 is a schematic diagram of the sound source position located by the electronic device 100. Figure 1B As shown, the upper surface of the electronic device 100 is an XY axis plane, and the center point of the upper surface is point O. Based on the received sound wave signal, the electronic device 100 can only identify the sound source position A1 (X1, Y1), and cannot identify the height of the sound source position. Therefore, the concept of the sound source position below is essentially the projection of the sound source position on the upper surface of the electronic device 100. The above-mentioned point O as the center point of the upper surface is only an illustrative example. In fact, any fixed point on the upper surface can be point O.

[0073] Generally speaking, the voice interaction process on the electronic device side can be divided into five steps: wake-up, response, input, understanding and feedback. For example, the voice interaction function can be implemented by a voice assistant installed in the electronic device 100. Figure 1A , further elaborate on the above five links. Figure 1A As shown, the electronic device 100 is in a state before waking up (e.g., standby state, etc.). User 200 outputs a sound wave signal containing a preset wake-up word. After receiving the sound wave signal, the electronic device 100 identifies whether the sound wave signal contains a preset wake-up word. If the preset wake-up word is identified from the sound wave signal, the electronic device 100 calls the voice interaction assistant, or activates the voice interaction function of the electronic device 100, and the electronic device 100 wakes up and enters the working state. Optionally, the electronic device 100 can also respond to the above-mentioned sound wave signal issued by the user. In this way, the electronic device 100 switches from a first state (e.g., standby state, etc.) to a second state (e.g., working state, etc.). Afterwards, the user 200 can issue further voice commands. After receiving further voice commands, the electronic device 100 can identify the corresponding semantic content through a voice recognition algorithm, that is, understand the further voice command, thereby executing the corresponding function. In order to respond to the sound wave signal in a timely manner, the sound pickup device of the electronic device 100 usually needs to be always on. Exemplarily, the sound pickup device of the electronic device 100 may be a microphone array or a plurality of microphones. The electronic device 100 may detect the sound wave signal in real time through a microphone array or a plurality of microphones.

[0074] In order to achieve accurate wake-up and quick response to the user's voice, the electronic device 100 will identify the sound source position corresponding to the sound wave signal according to the detected sound wave signal, obtain the direction from the sound source position (which can be called the sound pickup direction), and then obtain the component of the sound wave signal in the sound pickup direction, and perform processing based on the component. In this way, the amount of data processed can be reduced and the response speed can be improved.

[0075] Specifically, if Figure 1B As shown, after detecting the sound wave signal, the electronic device 100 can locate the sound source position A1 corresponding to the sound wave signal and obtain the sound source position A1 where the sound wave signal is located. Furthermore, the electronic device 100 can use the direction from the sound source position A1 as the sound pickup direction, and obtain the sound wave signal component in the sound pickup direction according to the sound pickup direction. Subsequently, the electronic device 100 can input the acquired sound wave signal component into the wake-up word model. In the wake-up word model, the sound wave features of the sound wave signal component are extracted using a preset algorithm, and the similarity (also called confidence) between the sound wave features and the sound wave features corresponding to the preset wake-up words is compared. If the similarity is greater than the preset threshold, the electronic device 100 can confirm that the detected sound wave signal contains the preset wake-up word; at this time, the electronic device 100 wakes up and enters the working state. If the similarity is less than the preset threshold, the electronic device 100 can confirm that the detected sound wave signal does not contain the preset wake-up word; at this time, the electronic device 100 can continue to maintain the state before awakening (for example, standby state, etc.).

[0076] However, the inventors have discovered that the sound source position located by the electronic device 100 based on the detected sound wave signal generally has deviations. Figure 1C Schematic diagram of the sound source position located by the provided electronic device 100. Figure 1C As shown, the electronic device 100 locates the sound source position as the sound source position A1 based on the detected sound wave signal, but in fact the user 200 emits the sound wave signal at the sound source position A2. Therefore, there is a deviation. Such a deviation will affect a series of subsequent processing of the electronic device 100, resulting in inaccurate processing results and large errors.

[0077] After long-term and in-depth research, experiments and analysis, the inventors concluded that the above-mentioned sound source location deviation is mainly caused by two aspects:

[0078] 1. The time of arrival (TOA) algorithm or the time difference of arrival (TDOA) algorithm used by the electronic device 100 to locate the sound source position is not accurate enough, and the calculated sound source position itself has deviations;

[0079] 2. The environment where the electronic device 100 and the user 200 are located generally has noise sources, and the noise emitted by the noise sources will also cause positioning deviations of the sound source positions. Although the electronic device 100 can filter out part of the noise signal through the noise reduction algorithm, the residual noise signal will still affect the sound source position positioning result of the electronic device 100, causing the sound source position A1 located by the electronic device 100 to deviate from the actual sound source position A2 of the user 200.

[0080] When the sound source position A1 located by the electronic device 100 deviates from the actual sound source position A2 where the user 200 is located, if the electronic device 100 uses the direction from the sound source position A1 as the sound pickup direction and further extracts the sound wave signal component in the sound pickup direction, it cannot accurately reflect the sound wave signal input by the user. Subsequently, the accuracy of the electronic device 100 in recognizing the wake-up word is reduced, and the user experience is poor.

[0081] In order to improve the accuracy of electronic device awakening, reduce the probability of false awakening of electronic devices, and improve user experience, the present application provides a wake-up method and electronic device. The wake-up method provided in the embodiment of the present application is applied to electronic devices. The electronic device can be various smart home devices such as smart speakers, smart TVs, smart air conditioners, smart refrigerators, smart lights, smart doors, smart locks, smart curtains, smart phones, smart glasses, smart watches, smart bracelets, etc. Various wearable electronic devices, tablet computers, laptops, personal digital assistants (personal digital assistants, PDAs), vehicle-mounted devices, virtual reality devices, augmented reality devices, and other electronic devices with voice interaction functions. This application does not limit this.

[0082] For example, Figure 2 FIG. 1 shows a schematic diagram of the hardware structure of the electronic device 100 provided in an embodiment of the present application. Figure 2 As shown, the electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone array 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, a subscriber identification module (SIM) card interface 195, an ultrasonic transmitter 196, an ultrasonic receiver 197, and a USB interface 198, etc.

[0083] It is to be understood that the structure shown in the embodiment of the present application does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include Figure 2 More or fewer components may be shown, or some components may be combined or separated, or the components may be arranged differently. Figure 2 The components shown may be implemented in hardware, software or a combination of software and hardware.

[0084] The processor 110 may include one or more processing units. For example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU). Different processing units may be independent devices or integrated into one or more processors.

[0085] The processor 110 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in the processor 110 is a cache memory. The memory may store instructions or data that the processor 110 has just used or cyclically used. If the processor 110 needs to use the instruction or data again, it may be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0086] In some embodiments, the processor 110 may include one or more interfaces. The interface may include an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, a subscriber identity module (SIM) interface, and / or a universal serial bus (USB) interface, etc.

[0087] The charging management module 140 is used to receive charging input from a charger. The charger may be a wireless charger or a wired charger. In some wired charging embodiments, the charging management module 140 may receive charging input from a wired charger through the USB interface 130. In some wireless charging embodiments, the charging management module 140 may receive wireless charging input through a wireless charging coil of the electronic device 100. While the charging management module 140 is charging the battery 142, it may also power the electronic device through the power management module 141.

[0088] The power management module 141 is used to connect the battery 142, the charging management module 140 and the processor 110. The power management module 141 receives input from the battery 142 and / or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory interface 120 and the wireless communication module 150. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle number, battery health status (leakage, impedance), etc. In some other embodiments, the power management module 141 can also be set in the processor 110. In other embodiments, the power management module 141 and the charging management module 140 can also be set in the same device.

[0089] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2 and the wireless communication module 150.

[0090] The mobile communication module 150 can provide solutions for wireless communications including 2G / 3G / 4G / 5G, etc., applied to electronic devices. The mobile communication module 150 may include one or more filters, switches, power amplifiers, low noise amplifiers (LNA), etc. The mobile communication module 150 can receive electromagnetic waves from the antenna 1, and filter, amplify, and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna 1. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the processor 110. In some embodiments, at least some of the functional modules of the mobile communication module 150 can be set in the same device as at least some of the modules of the processor 110.

[0091] The wireless communication module 160 can provide wireless communication solutions for electronic devices, including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), Bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc. The wireless communication module 160 can be one or more devices integrating one or more communication processing modules. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of the signal, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0092] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function. For example, files such as music and videos can be stored in the external memory card.

[0093] The internal memory 121 can be used to store one or more computer programs, which include instructions. The processor 110 can execute the above instructions stored in the internal memory 121, so that the electronic device performs the wake-up method provided in some embodiments of the present application, as well as various functional applications and data processing. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area can store an operating system; the program storage area can also store one or more applications (such as a gallery, contacts, etc.). The data storage area can store data (such as photos, contacts, etc.) created during the use of the electronic device. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as one or more disk storage devices, flash memory devices, universal flash storage (UFS), etc. In other embodiments, the processor 110 executes the instructions stored in the internal memory 121, and / or the instructions stored in the memory provided in the processor, so that the electronic device executes the wake-up method provided in the embodiment of the present application, as well as various functional applications and data processing.

[0094] The electronic device can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone array 170C, the headphone interface 170D and the application processor.

[0095] The audio module 170 is used to convert digital audio information into analog sound wave signal output, and is also used to convert analog audio input into digital sound wave signals. The audio module 170 can also be used to encode and decode sound wave signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0096] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound wave signal. The electronic device can listen to music or listen to a hands-free call through the speaker 170A.

[0097] The microphone array 170C includes multiple microphones. Among them, the microphone can also be called a "microphone" or a "microphone", which is used to convert sound wave signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone with his mouth to input the sound wave signal into the microphone. In some embodiments, the electronic device can use the microphone array 170C to collect sound wave signals, and then identify the source of the sound according to the sound wave signals collected by each microphone in the microphone array 170C, so as to realize functions such as sound source positioning and directional recording. The electronic device can be provided with one or more microphone arrays 170C. In another embodiment, the microphone array 170C can be replaced with multiple microphones; that is, the electronic device 100 does not include the microphone array 170C, but includes multiple microphones. The sound pickup entrances of the multiple microphones are located on the same surface of the electronic device 100, such as the upper surface.

[0098] The sensor 180 may include a pressure sensor, a gyroscope sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, a touch sensor, an ambient light sensor, a bone conduction sensor, etc., and the embodiments of the present application do not impose any restrictions on this.

[0099] The ultrasonic transmitter 196 and the ultrasonic receiver 197 are used to transmit ultrasonic signals and receive ultrasonic signals, respectively. The ultrasonic transmitter 196 and the ultrasonic receiver 197 can be one or more; this application does not limit this. Those skilled in the art can set this according to actual experience or actual application scenarios. Ultrasonic signals are sound wave signals with a frequency higher than 20000 Hz (Hertz). Ultrasonic signals have the characteristics of good directionality, strong reflection ability and penetration ability.

[0100] For example, the ultrasonic transmitter 196 may be a plurality of speakers 196A ( Figure 2 (not shown), that is, the speaker 196A has the function of transmitting ultrasonic signals. For example, the ultrasonic receiver 197 can be specifically a microphone array 197A ( Figure 2 ) or multiple microphones 197B (not shown) Figure 2 (not shown), that is, the microphone array 197A and multiple microphones 197B have the function of receiving ultrasonic signals.

[0101] In some embodiments, the electronic device 100 does not include the ultrasonic transmitter 196; the function of the ultrasonic transmitter 196 is integrated in the speaker 170A. In other words, the speaker 170A can emit both sound wave signals that can be perceived by the human ear and ultrasonic signals. In this way, the electronic device no longer needs to be equipped with an additional ultrasonic transmitter 196.

[0102] In some embodiments, similarly, the electronic device 100 does not include the ultrasonic receiver 197; the function of the ultrasonic receiver 197 is integrated in the microphone array 170C. That is, the microphone array 170C can receive both sound wave signals that can be perceived by the human ear and ultrasonic signals. In this way, the electronic device no longer needs to be equipped with an additional ultrasonic receiver 197.

[0103] In some embodiments, the electronic device 100 does not include the ultrasonic transmitter 196 or the ultrasonic receiver 197. The function of the ultrasonic transmitter 196 is integrated into the speaker 170A, and the function of the ultrasonic receiver 197 is integrated into the microphone array 170C.

[0104] The USB interface 198 can be used to connect other devices. Exemplarily, the USB interface 198 can be one or more USB interfaces.

[0105] It should be noted that when the electronic device 100 includes an ultrasonic transmitter 196 and multiple microphones or microphone array 170C, and the ultrasonic transmitter 196 and the multiple microphones or microphone array 170C are not integrated into one body, the plane where the top of the ultrasonic transmitter 196 is located is parallel or approximately parallel to the plane where the sound pickup entrances of the multiple microphones or microphone array 170C are located. Approximately parallel means that although the two planes are not parallel, the angle difference is very small and can be regarded as parallel.

[0106] Optionally, when the electronic device 100 is a smart speaker, the electronic device 100 may further include one or more components such as a GPU, a display screen, and a button, etc. The embodiment of the present application does not impose any limitation on this.

[0107] Optionally, when the electronic device 100 is a smart TV, the electronic device 100 may further include one or more components such as a GPU and a display screen, and may also be equipped with one or more components such as a remote controller and an infrared sensor. The present application embodiment does not impose any limitation on this.

[0108] Optionally, when the electronic device 100 is a smart phone, the electronic device 100 may further include one or more components such as a GPU, a display screen, an earphone jack, a button, a battery, a motor, an indicator, and a SIM card interface, etc. The present application embodiment does not impose any limitation on this.

[0109] In an embodiment of the present application, when detecting whether a received sound wave signal contains a wake-up word, the electronic device 100 may introduce an ultrasonic signal to detect the sound source position of the user, thereby improving the detection accuracy of the sound source position.

[0110] Figure 3 A schematic diagram of the principle of acoustic signal positioning in the wake-up method provided in an embodiment of the present application.

[0111] like Figure 3 As shown, the user 200 sends a sound wave signal at the sound source position B1. The electronic device 100 uses the TOA algorithm or the TDOA algorithm to locate the sound source position B2 according to the received sound wave signal (the received sound wave signal includes but is not limited to the sound wave signal sent by the user 200). In addition, after receiving the sound wave signal, the electronic device 100 can also use the ultrasonic positioning method to locate the user and obtain the obstacle position B3. Furthermore, the electronic device 100 combines the two positioning results (i.e., the sound source position B2 and the obstacle position B3) to finally determine the sound source position B4 where the user is located (the sound source position B4 and the sound source position B2 or the obstacle position B3 may be the same or different). In this way, the electronic device 100 can correct the sound source position B2 through the obstacle position B3, so that the sound source position B4 determined by the electronic device 100 is closer to the sound source position B1 where the user is actually located.

[0112] In this way, the electronic device can subsequently use the direction from the sound source position B4 as the sound pickup direction to identify whether the detected sound wave signal contains the wake-up word. Since the deviation between the sound source position B4 determined by the electronic device and the sound source position B1 actually corresponding to the user is small, the electronic device can more accurately determine whether the wake-up word is contained according to the sound wave signal component in the direction of the sound source position B4, thereby improving the accuracy of the electronic device's wake-up, reducing the probability of the electronic device's false wake-up, and improving the user experience.

[0113] Exemplarily, the electronic device 100 may include N (N is a positive integer greater than 1) speakers and L (L is a positive integer greater than or equal to 1) microphone arrays. Each microphone array includes M (M is a positive integer greater than 1) microphones. The N speakers and the L microphone arrays are arranged at different positions of the electronic device 100. The distance between any two of the N speakers and the distance between any two of the M microphones are fixed (they may be equal or unequal, but they are fixed). The sound pickup entrances of the M microphones or the sound pickup entrances of the L microphone arrays are located on the same surface of the electronic device 100, such as the upper surface.

[0114] Alternatively, the electronic device 100 may include N (N is a positive integer greater than 1) speakers and M (M is a positive integer greater than 1) microphones. The N speakers and the M microphones are arranged at different positions of the electronic device 100. The distance between any two of the N speakers and the distance between any two of the M microphones are fixed. The sound pickup entrances of the M microphones are located on the same surface of the electronic device 100, such as the upper surface.

[0115] For the convenience of explanation, the following description uses M microphones in a microphone array as an example. Those skilled in the art should understand that M separate microphones that are not in a microphone array are also within the protection scope of this application.

[0116] Among them, each of the N speakers can be used as an ultrasonic transmitter to transmit ultrasonic signals (sound wave signals higher than 20000Hz). In addition, each of the N speakers can also play sound wave signals that can be perceived by the human ear (sound wave signals of 20Hz to 20000Hz). Each of the M microphones can be used as an ultrasonic receiver to receive ultrasonic signals. In addition, each of the M microphones can also collect sound wave signals that can be perceived by the human ear. In this way, the electronic device 100 can use speakers and microphones to achieve ultrasonic positioning, without the need for additional ultrasonic transmitters and ultrasonic receivers, thereby reducing the cost of ultrasonic positioning in voice interaction scenarios.

[0117] Alternatively, each of the N speakers can only play sound wave signals that can be perceived by the human ear (sound wave signals of 20 Hz to 20,000 Hz). Each of the M microphones can only collect sound wave signals that can be perceived by the human ear. The electronic device 100 is further provided with P ultrasonic transmitters and Q ultrasonic receivers. Wherein P is a positive integer greater than or equal to 1, and Q is a positive integer greater than 1. The distance between any two of the Q ultrasonic receivers is fixed. When P is a positive integer greater than 1, the distance between any two of the P ultrasonic transmitters is fixed.

[0118] In some embodiments, the electronic device 100 may set the M microphones in the microphone array to a normally open state, so that the sound wave signals are collected in real time through the M microphones. At this time, if there is an ultrasonic signal in the environment where the electronic device 100 is located, the ultrasonic signal as a high-frequency sound wave signal may also be collected by each microphone. When only the sound wave signal is needed, each microphone can input the collected sound wave signal into the corresponding low-pass filter to filter out the ultrasonic signal greater than 20000Hz in the sound wave signal. In this way, the electronic device can obtain the sound wave signal component in the pickup direction based on the filtered sound wave signal and the sound pickup direction from the sound source position, so as to determine whether the sound wave signal component in the pickup direction contains a preset wake-up word. When only the ultrasonic signal is needed, each microphone can input the collected sound wave signal into the corresponding high-pass filter to filter out the signal less than 20000Hz in the sound wave signal. Furthermore, the electronic device can perform ultrasonic positioning based on the filtered sound wave signal to locate the obstacle position B3.

[0119] For example, Figure 4-Figure 7This is a schematic diagram of the process of processing the sound wave signal in the wake-up method provided in the embodiment of the present application. Figure 4 As shown, the M microphones in the microphone array collect sound wave signal A (assuming that the sound wave signal A does not include ultrasonic signals, even if it does, it can be filtered out by a low-pass filter). Due to the different positions of the M microphones, the waveforms of the sound wave signal A collected by different microphones among the M microphones may be different (the difference is small or even no difference), and the time points of the sound wave signal A collected by different microphones may also be different. Therefore, Figure 4 As shown, the electronic device 100 can obtain corresponding M sound wave signals A through the M microphones.

[0120] After the electronic device 100 obtains the M sound wave signals A, it can also locate the sound source position according to the M sound wave signals A. Exemplarily, since each of the M sound wave signals A arrives at the corresponding microphone at a different time point, the electronic device can calculate the corresponding sound source position B2 using the TOA algorithm or the TDOA algorithm according to the above time point.

[0121] like Figure 5 As shown, after the electronic device 100 calculates the sound source position B2, the direction from the sound source position B2 can be determined as the first sound pickup direction. Each sound wave signal A in the M sound wave signals A is aligned in time (i.e., the starting time point of each sound wave signal A is aligned). After alignment in time, the component of each sound wave signal A in the M sound wave signals A in the first sound pickup direction is obtained, i.e., the M sound wave signal A component 501. The M sound wave signal A components 501 are merged into one sound wave signal, i.e., the sound wave signal A'.

[0122] In addition, you can Figure 6 As shown, after calculating the sound source position B2, the electronic device 100 can determine the direction from the sound source position B2 as the first sound pickup direction. Obtain the component of each sound wave signal A in the M sound wave signals A in the first sound pickup direction, that is, the M sound wave signal A component 501. Then, align in time (that is, align the starting time points of each sound wave signal A). After aligning in time, merge the M sound wave signal A components 501 into one sound wave signal, that is, the sound wave signal A'.

[0123] The above fusion may be performed by directly superimposing the A components 501 of the M-path sound wave signals, or by weighted averaging the A components 501 of the M-path sound wave signals, or by other methods, which are not limited in the present application.

[0124] like Figure 7As shown, after the electronic device 100 obtains the sound wave signal A', the sound wave signal A' can be input into the preset wake-up word model. The wake-up word model stores the sound wave feature 701 of the preset wake-up word. Afterwards, in the wake-up word model, the sound wave feature 702 of the sound wave signal A' is extracted using a preset algorithm, and the proposed sound wave feature 702 is compared with the sound wave feature 701 corresponding to the preset wake-up word to obtain the similarity between the two (also called confidence). The final similarity between the two is similarity 1 (also called the first similarity). Among them, the sound wave feature 702 and the sound wave feature 701 can be represented by relevant codes, functions, matrices or spectrograms, and this application is not limited to this.

[0125] Figure 8 A partial flow chart of a wake-up method provided in an embodiment of the present application. Figure 8 As shown, according to Figure 4-Figure 7 After the similarity 1 is obtained by the processing flow shown, if the similarity 1 is greater than a first threshold (e.g., 90%, 90 points, etc.), it indicates that the sound wave signal A detected by the electronic device 100 is relatively close to the preset wake-up word, and the electronic device 100 can determine that the sound wave signal A contains the preset wake-up word. Then, the electronic device 100 wakes up. Exemplarily, the electronic device 100 calls a voice assistant, and the voice assistant interacts with the user's voice.

[0126] If the similarity 1 is less than the second threshold (for example, 60%, 60 points, etc.), it indicates that the sound wave signal A detected by the electronic device 100 is significantly different from the preset wake-up word, and the electronic device 100 can determine that the sound wave signal A does not contain the preset wake-up word. Then, the electronic device 100 continues to remain in the non-awakened state. Among them, the second threshold is less than the first threshold. In addition, both the second threshold and the first threshold can be adjusted, and are not limited to the thresholds exemplified above.

[0127] If similarity 1 is between the second threshold and the first threshold, indicating that the sound wave signal A detected by the electronic device 100 may contain the preset wake-up word, the electronic device 100 can further determine whether the sound wave signal A contains the preset wake-up word through ultrasonic positioning according to S801-S805, thereby further determining whether the electronic device 100 is awakened.

[0128] S801. The electronic device 100 obtains an obstacle position according to the time between the transmission and reception of the ultrasonic signal, the transmission speed of the ultrasonic wave in the air, and even the sound source position obtained by using the TOA algorithm or the TDOA algorithm.

[0129] Before describing S801 in detail, the principle of ultrasonic positioning is introduced first. Fig. 9A schematic diagram of the principle of locating obstacles using ultrasonic signals in a wake-up method provided in an embodiment of the present application. The electronic device 100 is provided with P ultrasonic transmitters and Q ultrasonic receivers. The P ultrasonic transmitters and the Q ultrasonic receivers face different directions on the electronic device 100. That is, the P ultrasonic transmitters transmit ultrasonic waves in the K direction, and the Q ultrasonic receivers are not located in the K direction of the P ultrasonic transmitters. In other words, the Q ultrasonic receivers cannot receive ultrasonic signals directly emitted by the P ultrasonic transmitters, but can only receive ultrasonic signals emitted by the P ultrasonic transmitters and ultrasonic signals reflected by obstacles. P is a positive integer greater than or equal to 1, and Q is a positive integer greater than 1.

[0130] like Fig. 9 As shown, take P ultrasonic transmitters including speakers 1001, 1002 and 1003, and Q microphones including microphones 1011, 1012 and 1013 as an example. Speaker 1001 can transmit ultrasonic signal 1 within a certain angle range. Similarly, speaker 1002 can transmit ultrasonic signal 2 within a certain angle range ( Fig. 9 (not shown), the speaker 1003 can emit ultrasonic signals 3 within a certain angle range ( Fig. 9 (not shown). Ultrasonic signal 1, ultrasonic signal 2, and ultrasonic signal 3 are reflected after encountering obstacles including user 200. Microphone 1011, microphone 1012, and microphone 1013 can collect the reflected ultrasonic signal 1, ultrasonic signal 2, and ultrasonic signal.

[0131] Taking ultrasonic signal 1 as an example, after passing through obstacles including user 200, ultrasonic signal 1 is emitted, and the reflected ultrasonic signal 1 reaches microphone 1011, microphone 1012, and microphone 1013 at different times and points. The electronic device 100 obtains the position of the obstacle based on the duration of both the emission and reception of ultrasonic signal 1 and the transmission speed of ultrasonic waves in the air. Of course, in this way, the position of the obstacle obtained also has a certain deviation.

[0132] For example, if the only obstacle around the electronic device 100 is the user 200, the acquired position of the obstacle may be Figure 3 Obstacle location B3 is shown.

[0133] For example, if there are many obstacles around the electronic device 100, including but not limited to the user 200, then based on the previously acquired sound source position B2, the positions of obstacles that are greatly different from the sound source position B2 can be eliminated, and the positions of obstacles that are within a certain range of the sound source position B2 can be retained. Fig.10A schematic diagram of an ultrasonic signal locating an obstacle in a wake-up method provided in an embodiment of the present application. Fig.10 As shown, through ultrasonic positioning, two obstacle positions are obtained, namely obstacle position B3 and obstacle position B5. Since obstacle position B5 is significantly different from sound source position B2, and is outside the above-mentioned certain range, obstacle position B5 is excluded; since obstacle position B3 is different from sound source position B2 within the above-mentioned certain range, obstacle position B3 is retained. According to the above method, the obstacle position retained can be one or more than one.

[0134] Exemplarily, the retained obstacle position may be recorded as positioning result 1 .

[0135] Exemplarily, when there are multiple obstacle positions retained, the multiple obstacle positions retained may be superimposed and averaged to obtain one obstacle position.

[0136] For example, the above-mentioned certain range may be a range that differs from the direction from the sound source position B2 by a certain angle. The above-mentioned certain angle may be a preset angle.

[0137] Optionally, the ultrasonic signal 2 may also be transmitted separately. Furthermore, according to the above method, a positioning result 2 obtained based on the transmission and reflection of the ultrasonic signal 2 may also be obtained. The positioning result 2 may include one or more obstacle positions.

[0138] Optionally, the ultrasonic signal 3 may also be transmitted separately. Furthermore, according to the above method, a positioning result 3 obtained based on the transmission and reflection of the ultrasonic signal 3 may also be obtained. The positioning result 3 may include one or more obstacle positions.

[0139] Afterwards, the electronic device 100 may use a preset clustering algorithm to perform cluster analysis on the positioning result 1, positioning result 2, and positioning result 3. For example, the clustering algorithm may include a K-means clustering algorithm (k-means clustering algorithm, also known as a k-means clustering algorithm) or a self-organizing map neural network (self-organizing maps, SOM) clustering algorithm. The electronic device 100 may cluster obstacle positions with high similarity in multiple positioning results into one obstacle position (for example, Figure 3 At this time, the electronic device 100 may determine the aggregated obstacle position as an available obstacle position.

[0140] Optionally, the electronic device 100 may also only use the ultrasonic signal 1 to determine the position of an obstacle.

[0141] It should be noted that the sound wave signals collected by each microphone may include ultrasonic signals or sound wave signals that can be recognized by the human ear. In S801, each microphone may first input the collected sound wave signals into the corresponding high-pass filter, filter out the sound wave signals less than 20000 Hz in the sound wave signals, and obtain the corresponding ultrasonic signal. Then, the electronic device 100 may determine the position of an obstacle according to the above method.

[0142] S802: The electronic device 100 takes the direction from the obstacle position as a second sound pickup direction, and obtains a sound wave signal A component of the sound wave signal A in the second sound pickup direction, namely, a sound wave signal A".

[0143] Can be combined Fig.11 S802 is further clarified. Fig.11 This is a schematic diagram of the process of processing sound wave signals in a wake-up method provided in an embodiment of the present application. Fig.11 As shown, the electronic device 100 can use the direction from the obstacle position as the second sound pickup direction. After the M sound wave signals A collected by the electronic device 100 are aligned in time, the components of the M sound wave signals A in the second sound pickup direction are extracted to obtain the M sound wave signal A components 1101. Afterwards, the electronic device 100 can fuse the above-mentioned M sound wave signal A components 1101 to obtain the sound wave signal A". Of course, it can also be similar to Figure 6 As shown, the components of the M-way sound wave signal A in the second sound pickup direction are first extracted, and then fused after time alignment; the specific process is not repeated here.

[0144] S803. The electronic device 100 may input the sound wave signal A" into a preset wake-up word model, and calculate a similarity 2 (also referred to as a second similarity) between the sound wave signal A" and the wake-up word.

[0145] The calculation process of similarity 2 is similar to that of similarity 1 and will not be described in detail here.

[0146] If the similarity 2 is greater than the third threshold, it indicates that the component sound wave signal A" of the sound wave signal A in the second sound pickup direction is close to the preset wake-up word, and the electronic device 100 can determine that the sound wave signal A contains the preset wake-up word. At this time, the electronic device 100 can execute step S804. The third threshold can be greater than the first threshold or less than the first threshold. For example, the third threshold can be 95% or 95 points, or 80% or 80 points, etc.

[0147] If the similarity 2 is less than the third threshold, it indicates that the component sound wave signal A" of the sound wave signal A in the second sound pickup direction is significantly different from the preset wake-up word, and the electronic device 100 can determine that the sound wave signal A does not contain the preset wake-up word. At this time, the electronic device 100 can execute step S805.

[0148] S804: The electronic device 100 wakes up.

[0149] Exemplarily, the electronic device 100 may call a voice assistant, or activate a function of the voice assistant.

[0150] S805: The electronic device 100 remains in a non-awakened state.

[0151] Exemplarily, the electronic device 100 continues to remain in a non-awakened state (eg, a standby state, etc.).

[0152] It can be seen that the wake-up method provided in this application can be divided into two stages. In the first stage, the electronic device can first identify the similarity 1 between the detected sound wave signal and the preset wake-up word according to the sound wake-up process. When the similarity 1 is greater than the first threshold, the electronic device wakes up; when the similarity 1 is less than the second threshold, the electronic device continues to remain in the non-awakened state; when the similarity 1 is between the first threshold and the second threshold, the wake-up method can enter the second stage.

[0153] In the second stage, the electronic device can use the ultrasonic signal to locate the obstacle, and through the sound source position identified in the first stage, screen and calculate the obstacle position, and finally obtain an obstacle position. The electronic device calculates the similarity 2 between the sound wave signal component in the direction of the obstacle position and the preset wake-up word. After the similarity 2 meets the corresponding threshold condition, the electronic device wakes up; otherwise, the electronic device continues to remain in the non-awakened state.

[0154] It should be noted that those skilled in the art can set the above-mentioned third threshold value according to actual experience or actual application scenarios. Exemplarily, when the first threshold value is set higher, the third threshold value can be set to a value less than the first threshold value. For example, the first threshold value can be set to 95, and the third threshold value can be set to a value less than 95 (for example, 70 or 80, etc.). That is to say, when the first stage detects that the similarity 1 is greater than the first threshold value (for example, 95), the electronic device will determine that the sound wave signal contains a preset wake-up word. Otherwise, entering the second stage, the electronic device calculates the similarity 2 through ultrasonic positioning. When the similarity 2 is greater than the third threshold value (for example, 70 or 80), the electronic device wakes up.

[0155] Alternatively, when the first threshold is set relatively low, the third threshold may be set to a value greater than the first threshold. For example, the first threshold may be set to 75, and the third threshold may be set to a value greater than 75 (e.g., 85 or 95, etc.). That is, when the first stage detects that the similarity 1 is less than the first threshold (e.g., 75), the second stage is entered; the electronic device calculates the similarity 2 through ultrasonic positioning. When the similarity 2 is greater than the third threshold (e.g., 70 or 80), the electronic device wakes up.

[0156] In addition, the present application also provides another embodiment of a wake-up method. Compared with the wake-up method described above, the other wake-up method includes the same first stage, but the second stage is different. The content of the first stage is not repeated here.

[0157] Combination Fig.12 Introducing the second stage of another awakening method. Fig.12 A partial flow chart of another wake-up method provided in an embodiment of the present application. Fig.12 As shown, according to Figure 4-Figure 7 After the similarity 1 is obtained according to the processing flow shown, the second sound pickup direction is determined through ultrasonic positioning, and the third sound pickup direction is further determined based on the first sound pickup direction and the second sound pickup direction, and then the component of the sound wave signal A in the third sound pickup direction, that is, the sound wave signal A'', is obtained, and then it is determined whether the sound wave signal A''' contains a preset wake-up word to determine whether the electronic device 100 is awakened.

[0158] Specifically, according to Figure 4-Figure 7 After the similarity 1 is obtained by the processing flow shown, if the similarity 1 is greater than a first threshold (e.g., 90%, 90 points, etc.), it indicates that the sound wave signal A detected by the electronic device 100 is relatively close to the preset wake-up word, and the electronic device 100 can determine that the sound wave signal A contains the preset wake-up word. Then, the electronic device 100 wakes up. Exemplarily, the electronic device 100 calls a voice assistant, and the voice assistant interacts with the user's voice.

[0159] If the similarity 1 is less than the second threshold (for example, 60%, 60 points, etc.), it indicates that the sound wave signal A detected by the electronic device 100 is significantly different from the preset wake-up word, and the electronic device 100 can determine that the sound wave signal A does not contain the preset wake-up word. Then, the electronic device 100 continues to remain in the non-awakened state. Among them, the second threshold is less than the first threshold. In addition, both the second threshold and the first threshold can be adjusted, and are not limited to the thresholds exemplified above.

[0160] If the similarity 1 is between the second threshold and the first threshold, it indicates that the sound wave signal A detected by the electronic device 100 may contain the preset wake-up word, and the electronic device 100 can further determine whether the sound wave signal A contains the preset wake-up word through ultrasonic positioning according to S1201-S1205, thereby further determining whether the electronic device 100 is awakened. Specifically, part of the process of another wake-up method includes:

[0161] S1201: The electronic device 100 obtains an obstacle position according to the time between the transmission and reception of the ultrasonic signal, the transmission speed of the ultrasonic wave in the air, and even the sound source position obtained by the TOA algorithm or the TDOA algorithm.

[0162] Among them, the relevant content of S1201 can refer to the relevant content of S801, so it will not be repeated here.

[0163] S1202: The electronic device 100 takes the direction from the obstacle position as a second sound pickup direction, and determines a third sound pickup direction according to the second sound pickup direction and the first sound pickup direction.

[0164] Considering that both the sound source position B2 and the obstacle position B3 may have errors, in order to more accurately determine the sound source position, the electronic device can also combine the sound source position B2 and the obstacle position B3 to re-determine the sound source position where the user is located.

[0165] Combine the following Fig.13 , to further clarify S1202. Fig.13 A schematic diagram of the location of a sound source in another wake-up method provided in an embodiment of the present application. For example, Fig.13 As shown, the upper surface of the electronic device 100 is an XY axis plane, and the center point of the upper surface is point O. The X axis and the Y axis are two mutually perpendicular coordinate axes passing through point O. The XY axis coordinate system is the same as the previous Figure 1B , Figure 1C The coordinate system is the same. The sound source position B2 is the sound source position located by the electronic device 100 in the first stage through the TOA algorithm or the TDOA algorithm; the obstacle position B3 is an obstacle position finally located by the electronic device according to S1201 using the ultrasonic signal; it is assumed that the sound source position B4 is the sound source position that is finally calculated and is closer to the user. By connecting B2, B3, B4 and point O respectively, the angle α between the line segment B2O and the X-axis, the angle β between the line segment B3O and the X-axis, and the angle γ between the line segment B4O and the X-axis can be obtained. α reflects the relative direction between the sound source position B2 and the electronic device; β reflects the relative direction between the obstacle position B3 and the electronic device; γ reflects the relative direction between the sound source position B4 and the electronic device. Both α and β can be calculated according to the above method; and γ is unknown. Assume that the absolute value of the difference between α and β Δ=|α-β|. Furthermore, the electronic device 100 can calculate γ according to the following formula (1).

[0166]

[0167] Wherein, k is a preset proportionality coefficient, 0≤k≤1; θ1 is a preset value 1 (for example, 5°, etc.), and θ2 is a preset value 2 (for example, 10°, etc.). When α is less than β, ± in formula (1) is +; when α is greater than β, ± in formula (1) is -.

[0168] That is to say, when Δ is small or large, it indicates that the error of the obstacle position B3 obtained by ultrasonic positioning and calculation may be large, then the electronic device 100 can determine the above-mentioned sound source position B2 as the sound source position corresponding to the end user; at this time, the angle γ between the determined sound source position B4 of the user and the X-axis is α.

[0169] When Δ is within a preset range (i.e., the interval defined by θ1 and θ2), the electronic device can adjust the weight of Δ by the proportional coefficient k, and finally determine γ, i.e., the relative direction between the sound source position B4 and the electronic device 100. In other words, the electronic device can correct the sound source position B2 based on the first located sound source position B2 and the obstacle position B3 obtained by ultrasonic positioning to obtain a sound source position B4 closer to the user's position. In this way, when the located sound source position B2 deviates greatly from the user's position due to factors such as noise, the electronic device 100 can obtain a sound source position B1 closer to the user's position through the above method.

[0170] Optionally, θ1 may also be a negative value.

[0171] It should be noted that the above formula (1) is only an illustrative example; γ may also be calculated according to other formulas.

[0172] Of course, those skilled in the art may also set other coordinate systems (such as a three-dimensional coordinate system) according to the above principles, and this application does not impose any limitation on this.

[0173] S1203: The electronic device 100 obtains a sound wave signal A component of the sound wave signal A in the third sound pickup direction, namely, a sound wave signal A'''.

[0174] Similar to step S802 in the above embodiment, the electronic device 100 may use the direction indicated by γ as the third sound pickup direction. Fig.14 Schematic diagram of the sound wave signal processing in the wake-up method provided in the embodiment of the present application. Fig.14 As shown, the electronic device 100 can extract the sound wave signal A component 1401 of the M sound wave signals in the third sound pickup direction, and merge the extracted M sound wave signal A components 1401 into a sound wave signal A'', thereby obtaining the sound wave signal in the third sound pickup direction.

[0175] S1204: The electronic device 100 may input the sound wave signal A''' into a preset wake-up word model, and calculate a similarity 3 (also referred to as a third similarity) between the sound wave signal A''' and the wake-up word.

[0176] Similar to step S803 in the above embodiment, the electronic device 100 obtains the similarity between the sound wave signal A'' and the preset wake-up word, that is, similarity 3 (also called the third similarity). The process of fusion and subsequent processing is similar to the fusion and subsequent processing process in the first sound pickup direction and the second sound pickup direction. Please refer to the above content; it will not be repeated here.

[0177] If the similarity 3 is greater than the third threshold, it indicates that the component sound wave signal A'' of the sound wave signal A in the third sound pickup direction is close to the preset wake-up word, and the electronic device 100 can determine that the sound wave signal A contains the preset wake-up word. At this time, the electronic device 100 can execute step S1205. The third threshold can be greater than the first threshold or less than the first threshold. For example, the third threshold can be 95% or 95 points, or 80% or 80 points, etc.

[0178] If the similarity 3 is less than the third threshold, indicating that the component sound wave signal A'' of the sound wave signal A in the third sound pickup direction is significantly different from the preset wake-up word, the electronic device 100 may determine that the sound wave signal A does not contain the preset wake-up word. At this time, the electronic device 100 may execute step S1206.

[0179] S1205: The electronic device 100 wakes up.

[0180] Exemplarily, the electronic device 100 may call a voice assistant, or activate a function of the voice assistant.

[0181] S1206: The electronic device 100 remains in a non-awakened state.

[0182] Exemplarily, the electronic device 100 continues to remain in a non-awakened state (eg, a standby state, etc.).

[0183] Since the third sound pickup direction is closer to the direction indicated by the sound source position corresponding to the user, the electronic device 100 inputs the wake-up word model with the above-mentioned sound wave signal A"', and the calculated similarity 3 is more accurate, so that the accuracy of the electronic device 100 waking up is higher, and the probability of the electronic device 100 waking up by mistake is lower. The inventor has verified through experiments that in a noisy scene, the electronic device 100 using the wake-up method provided in the embodiment of the present application can improve the accuracy of wake-up and reduce the probability of false wake-up.

[0184] In other embodiments, when the electronic device 100 detects whether the sound wave signal A contains a wake-up word according to the above method, it can obtain the first pickup direction and the second pickup direction, and obtain the third pickup direction according to the first pickup direction and the second pickup direction, and determine whether to wake up the electronic device according to the similarity between the sound wave signal component of the sound wave signal A in the third pickup direction and the wake-up word. After the similarity between the two is greater than a preset threshold, the electronic device is woken up. Otherwise, the electronic device continues to remain in an unawakened state. Among them, the similarity between the sound wave signal component of the sound wave signal A in the third pickup direction and the wake-up word is the similarity between the sound wave signal component of the sound wave signal A in the third pickup direction input into the wake-up word model, the sound wave features extracted according to the preset algorithm, and the sound wave features corresponding to the preset wake-up word. Please refer to the above description for details.

[0185] In other embodiments, when the electronic device 100 detects whether the sound wave signal A contains the wake-up word according to the above method, it can obtain the similarity 1 between the sound wave signal A' (that is, the sound wave signal component of the sound wave signal A in the first sound pickup direction) and the wake-up word, and can also obtain the similarity 2 between the sound wave signal A" (that is, the sound wave signal component of the sound wave signal A in the second sound pickup direction) and the wake-up word, and can also obtain the similarity 3 between the sound wave signal A"' (that is, the sound wave signal component of the sound wave signal A in the third sound pickup direction) and the wake-up word.

[0186] That is to say, when the electronic device 100 detects whether the sound wave signal A contains the wake-up word, it can obtain three of the above-mentioned similarities 1 to 3. At this time, it is assumed that similarity 3 is the highest value among similarities 1 to 3; it indicates that the third sound pickup direction corresponding to similarity 3 is closer to the direction indicated by the sound source position corresponding to the user. Then, the electronic device 100 can use the sound wave signal corresponding to similarity 3 as the basis for identifying the wake-up word this time, and compare it with the preset threshold. If it is greater than the preset threshold, the electronic device wakes up; after that, the third sound pickup direction is used to extract the sound wave signal detected by the subsequent electronic device to execute further voice commands.

[0187] In some other embodiments, when the electronic device 100 detects whether the sound wave signal A contains the wake-up word according to the above method, it can obtain the similarity 1 between the sound wave signal A' (that is, the sound wave signal component of the sound wave signal A in the first sound pickup direction) and the wake-up word, and can also obtain the similarity 2 between the sound wave signal A" (that is, the sound wave signal component of the sound wave signal A in the second sound pickup direction) and the wake-up word.

[0188] That is to say, when the electronic device 100 detects whether the sound wave signal A contains the wake-up word, it can obtain two of the above-mentioned similarities 1 to 2. At this time, it is assumed that similarity 2 is the highest value among similarities 1 to 2; it indicates that the second sound pickup direction corresponding to similarity 2 is closer to the direction indicated by the sound source position corresponding to the user. Then, the electronic device 100 can use the sound wave signal corresponding to similarity 2 as the basis for identifying the wake-up word this time, and compare it with the preset threshold. If it is greater than the preset threshold, the electronic device wakes up; after that, the second sound pickup direction is used to extract the sound wave signal detected by the subsequent electronic device to execute further voice commands.

[0189] In some other embodiments, after the electronic device 100 calculates similarity 1 according to the above method, if similarity 1 is between the first threshold and the second threshold, the electronic device 100 may calculate similarity 2 and / or similarity 3 according to the above method. That is, when the electronic device 100 detects whether the sound wave signal A contains the wake-up word, when the above similarity 1 satisfies a certain threshold condition, at least one of the above similarity 2 and similarity 3 can also be obtained. At this time, the electronic device 100 can determine the maximum value of all the similarities obtained (for example, similarity 1, similarity 2, and similarity 3). For example, if similarity 1 is the maximum value, it indicates that the sound wave signal A' detected by the electronic device 100 is closer to the preset wake-up word, and the first sound pickup direction is also closer to the direction indicated by the sound source position corresponding to the user. Then, the electronic device 100 can use the sound wave signal A' as the basis for identifying the wake-up word this time, and determine whether to wake up according to the similarity 1 between the sound wave signal A' and the wake-up word.

[0190] Still taking similarity 1 as the maximum value among similarity 1, similarity 2 and similarity 3 as an example, after the electronic device 100 wakes up, it can continue to detect the sound wave signal according to the first sound pickup direction corresponding to similarity 1, so as to recognize the user's voice command. For example, after the electronic device 100 wakes up, the voice assistant can be used to further collect the sound wave signal. Then, the electronic device can obtain the sound wave signal component of the sound wave signal in the first sound pickup direction, and recognize and execute the corresponding voice command according to the sound wave signal component in the first sound pickup direction. In this scenario, since the first sound pickup direction is closer to the direction indicated by the sound source position corresponding to the user than the second sound pickup direction or the third sound pickup direction, the sound wave signal in the first sound pickup direction more realistically restores the user's actual voice. In this way, the accuracy of the subsequent speech recognition of the electronic device 100 will also increase accordingly. Taking the noise scene as an example, the accuracy of speech recognition by the electronic device 100 according to the above method can be improved by 4% or even higher.

[0191] It should be noted that the electronic device that executes the wake-up method in the above embodiment is an electronic device with an ultrasonic positioning function, and the embodiment of the present application does not limit this.

[0192] Fig.15 Schematic diagram of the hardware structure of the electronic device provided in the embodiment of the present application. The electronic device may specifically include: multiple ultrasonic transmitters 1501 (ultrasonic transmitter 1501 may specifically be a speaker); multiple ultrasonic receivers 1502 (ultrasonic receiver 1502 may specifically be a microphone); one or more processors 1503; memory 1504; one or more application programs (not shown); and one or more computer programs 1505, and the above-mentioned devices may be connected via one or more communication buses 1506. Among them, the one or more computer programs 1505 are stored in the memory 1504 and are configured to be executed by the one or more processors 1503; the one or more computer programs 1505 include instructions, which can be used to execute the relevant steps performed by the electronic device in the above-mentioned embodiment. Of course, the electronic device may also include a touch screen (for example, the touch screen may include a touch sensor and a display screen), a mouse and other input devices.

[0193] It should be noted that Fig.15 The hardware structure shown is only exemplary and is not intended to limit the scope of the present application. The electronic device provided in the present application may also have other hardware structures.

[0194] Through the description of the above implementation methods, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above functional modules is used as an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. The specific working process of the above-described system, device and unit can refer to the corresponding process in the aforementioned method embodiment, and will not be repeated here.

[0195] Each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of software functional units.

[0196] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.

[0197] The above is only a specific implementation of the embodiment of the present application, but the protection scope of the embodiment of the present application is not limited thereto, and any changes or replacements within the technical scope disclosed in the embodiment of the present application should be included in the protection scope of the embodiment of the present application. Therefore, the protection scope of the embodiment of the present application should be based on the protection scope of the claims.

Claims

1. An electronic device, in an unawakened state, characterized in that: The electronic device comprises: processor; Memory; M microphones, each microphone corresponding to a sound pickup inlet; the M sound pickup inlets of the M microphones are located on a first surface of the electronic device, and the first surface is on a plane; the distance between any two microphones among the M microphones is fixed; M is a positive integer greater than 1; P ultrasonic transmitters, each of which corresponds to an ultrasonic transmitting port; the P ultrasonic transmitting ports of the P ultrasonic transmitters are located on the second surface; P is a positive integer greater than or equal to 1; the second surface is different from the first surface; Q ultrasonic receivers, each ultrasonic receiver corresponds to an ultrasonic receiving port; the Q ultrasonic receiving ports of the Q ultrasonic receivers are located on the third surface of the electronic device, and the third surface is on a plane; the distance between any two ultrasonic receivers among the Q ultrasonic receivers is fixed; Q is a positive integer greater than 1; the Q ultrasonic receiving ports and the P ultrasonic transmitting ports face different directions; the third surface is different from the first surface; and a computer program, wherein the computer program is stored in the memory and when the computer program is executed by the processor, causes the electronic device to perform the following steps: Detecting a first sound wave signal through the M microphones; In response to the first sound wave signal, a first sound pickup direction is acquired according to the arrival time difference of the first sound wave signal at at least two of the M microphones and the distance between some or all of the at least two microphones; the first sound pickup direction is used to indicate the direction of a first projection point of a first sound source position on the plane where the first surface is located relative to a fixed point on the plane where the first surface is located; the fixed point is different from the first projection point; Acquiring a first sound wave signal component of the first sound wave signal in the first sound pickup direction; After the similarity between the first sound wave signal component and the preset wake-up word is less than a preset first threshold and greater than or equal to a preset second threshold, Transmitting a second sound wave signal through the P ultrasonic transmitters, wherein the second sound wave signal is an ultrasonic signal; receiving the second sound wave signal through the Q ultrasonic receivers; In response to the second sound wave signal, a second sound pickup direction is acquired according to the arrival time difference of the second sound wave signal at at least two of the Q ultrasonic receivers, and the distance between the first sound source position and some or all of the at least two ultrasonic receivers; the second sound pickup direction is used to indicate the direction of a second projection point of the second sound source position on the plane where the first surface is located relative to the fixed point; the fixed point is different from the second projection point; Acquiring a second sound wave signal component of the first sound wave signal in the second sound pickup direction; After the similarity between the second sound wave signal component and the preset wake-up word is greater than a preset third threshold, the electronic device wakes up.

2. The electronic device according to claim 1, characterized in that: The electronic device further performs: After the similarity between the first sound wave signal component and the preset wake-up word is greater than the first threshold, the electronic device wakes up.

3. The electronic device according to claim 1 or 2, characterized in that: The electronic device further performs: After the similarity between the first sound wave signal component and the preset wake-up word is less than the second threshold, the electronic device remains in a non-awakened state.

4. The electronic device according to claim 3, characterized in that: The electronic device further performs: After the similarity between the second sound wave signal component and the preset wake-up word is less than or equal to the third threshold, the electronic device remains in a non-awakened state.

5. The electronic device according to claim 4, characterized in that: The Q ultrasonic receivers are part or all of the M microphones; wherein Q is less than or equal to M; the ultrasonic receiving port is the sound pickup port; and the third surface is the same as the first surface.

6. The electronic device according to claim 4, characterized in that: The Q ultrasonic receivers are different from some or all of the M microphones.

7. The electronic device according to any one of claims 1-2 and 4-6, characterized in that: The electronic device further comprises: N loudspeakers, wherein the N sound wave emitting ports of the N loudspeakers are located on a fourth surface; N is a positive integer greater than or equal to 1; and the fourth surface is different from the first surface.

8. The electronic device according to claim 7, characterized in that: The electronic device further comprises: The P ultrasonic transmitters are part or all of the N speakers; wherein P is less than or equal to N; the ultrasonic transmitting port is the sound wave transmitting port; and the fourth surface is the same as the second surface.

9. The electronic device according to claim 7, characterized in that: The P ultrasonic transmitters are different from some or all of the N speakers.

10. The electronic device according to any one of claims 1-2, 4-6, 8-9, characterized in that: The second surface is parallel to the first surface.

11. An electronic device, in an unawakened state, characterized in that: The electronic device comprises: processor; Memory; M microphones, each microphone corresponding to a sound pickup inlet; the M sound pickup inlets of the M microphones are located on a first surface of the electronic device, and the first surface is on a plane; the distance between any two microphones among the M microphones is fixed; M is a positive integer greater than 1; P ultrasonic transmitters, wherein the P ultrasonic transmitting ports of the P ultrasonic transmitters are located on the second surface; P is a positive integer greater than or equal to 1; the second surface is different from the first surface; Q ultrasonic receivers, each ultrasonic receiver corresponds to an ultrasonic receiving port; the Q ultrasonic receiving ports of the Q ultrasonic receivers are located on the third surface of the electronic device, and the third surface is on a plane; the distance between any two ultrasonic receivers among the Q ultrasonic receivers is fixed; Q is a positive integer greater than 1; the Q ultrasonic receiving ports and the P ultrasonic transmitting ports face different directions; the third surface is different from the first surface; and a computer program, wherein the computer program is stored in the memory and when the computer program is executed by the processor, causes the electronic device to perform the following steps: Detecting a first sound wave signal through the M microphones; In response to the first sound wave signal, a first sound pickup direction is acquired according to the arrival time difference of the first sound wave signal at at least two of the M microphones and the distance between some or all of the at least two microphones; the first sound pickup direction is used to indicate the direction of a first projection point of a first sound source position on the plane where the first surface is located relative to a fixed point on the plane where the first surface is located; the fixed point is different from the first projection point; Acquiring a first sound wave signal component of the first sound wave signal in the first sound pickup direction; After the similarity between the first sound wave signal component and the preset wake-up word is less than a preset first threshold and greater than or equal to a preset second threshold, Transmitting a second sound wave signal through the P ultrasonic transmitters, wherein the second sound wave signal is an ultrasonic signal; receiving the second sound wave signal through the Q ultrasonic receivers; In response to the second sound wave signal, a second sound pickup direction is acquired according to the arrival time difference of the second sound wave signal at at least two of the Q ultrasonic receivers, and the distance between the first sound source position and some or all of the at least two ultrasonic receivers; the second sound pickup direction is used to indicate the direction of a second projection point of the second sound source position on the plane where the first surface is located relative to the fixed point; the fixed point is different from the second projection point; Performing sound pickup direction correction according to the first sound pickup direction and the second sound pickup direction to determine a third sound pickup direction, wherein the third sound pickup direction is used to indicate a direction of a third projection point of a third sound source position on the plane where the first surface is located relative to the fixed point; Acquire a third sound wave signal component of the first sound wave signal in the third sound pickup direction; After the similarity between the third sound wave signal component and the preset wake-up word is greater than a preset third threshold, the electronic device wakes up.

12. The electronic device according to claim 11, characterized in that: The electronic device further performs: After the similarity between the first sound wave signal component and the preset wake-up word is greater than the first threshold, the electronic device wakes up.

13. The electronic device according to claim 11 or 12, characterized in that: The electronic device further performs: After the similarity between the first sound wave signal component and the preset wake-up word is less than the second threshold, the electronic device remains in a non-awakened state.

14. The electronic device according to claim 13, characterized in that: The electronic device further performs: After the similarity between the third sound wave signal component and the preset wake-up word is less than or equal to the third threshold, the electronic device remains in a non-awakened state.

15. The electronic device according to any one of claims 11 to 12 and 14, characterized in that: The method of determining a third sound pickup direction according to the first sound pickup direction and the second sound pickup direction comprises: When the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction is less than a preset fourth threshold, or the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction is greater than a preset fifth threshold, the third sound pickup direction is the same as the first sound pickup direction.

16. The electronic device according to any one of claims 11 to 12 and 14, characterized in that: The method of determining a third sound pickup direction according to the first sound pickup direction and the second sound pickup direction comprises: After the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction is greater than a preset fourth threshold and less than a fifth threshold, the third sound pickup direction is the product of the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction and a preset proportional coefficient in the first sound pickup direction.

17. The electronic device according to any one of claims 11 to 12 and 14, characterized in that: The Q ultrasonic receivers are part or all of the M microphones; wherein Q is less than or equal to M; the ultrasonic receiving port is the sound pickup port; and the third surface is the same as the first surface.

18. The electronic device according to any one of claims 11 to 12 and 14, characterized in that: The Q ultrasonic receivers are different from some or all of the M microphones.

19. The electronic device according to any one of claims 11 to 12 and 14, characterized in that: The electronic device further comprises: N loudspeakers, wherein the N sound wave emitting ports of the N loudspeakers are located on a fourth surface; N is a positive integer greater than or equal to 1; and the fourth surface is different from the first surface.

20. The electronic device according to claim 19, characterized in that: The P ultrasonic transmitters are part or all of the N speakers; wherein P is less than or equal to N; the ultrasonic transmitting port is the sound wave transmitting port; and the fourth surface is the same as the second surface.

21. The electronic device according to claim 19, characterized in that: The P ultrasonic transmitters are different from some or all of the N speakers.

22. The electronic device according to any one of claims 11-12, 14, 20-21, characterized in that: The second surface is parallel to the first surface.

23. A wake-up method, applied to an electronic device; The electronic device is in an unawakened state, characterized in that: The electronic device comprises: a processor; a memory; M microphones, each microphone corresponding to a sound pickup inlet; the M sound pickup inlets of the M microphones are located on the first surface of the electronic device, and the first surface is on a plane; the distance between any two of the M microphones is fixed; M is a positive integer greater than 1; P ultrasonic transmitters, and the P ultrasonic transmission ports of the P ultrasonic transmitters are located on the second surface; P is a positive integer greater than or equal to 1; the second surface is different from the first surface; Q ultrasonic receivers, each ultrasonic receiver corresponds to an ultrasonic receiving port; the Q ultrasonic receiving ports of the Q ultrasonic receivers are located on the third surface of the electronic device, and the third surface is on a plane; the distance between any two of the Q ultrasonic receivers is fixed; Q is a positive integer greater than 1; the Q ultrasonic receiving ports and the P ultrasonic transmission ports face different directions; the third surface is different from the first surface; the method comprises: Detecting a first sound wave signal through the M microphones; In response to the first sound wave signal, a first sound pickup direction is acquired according to the arrival time difference of the first sound wave signal at at least two of the M microphones and the distance between some or all of the at least two microphones; the first sound pickup direction is used to indicate the direction of a first projection point of a first sound source position on the plane where the first surface is located relative to a fixed point on the plane where the first surface is located; the fixed point is different from the first projection point; Acquiring a first sound wave signal component of the first sound wave signal in the first sound pickup direction; After the similarity between the first sound wave signal component and the preset wake-up word is less than a preset first threshold and greater than or equal to a preset second threshold, Transmitting a second sound wave signal through the P ultrasonic transmitters, wherein the second sound wave signal is an ultrasonic signal; receiving the second sound wave signal through the Q ultrasonic receivers; In response to the second sound wave signal, a second sound pickup direction is acquired according to the arrival time difference of the second sound wave signal at at least two of the Q ultrasonic receivers, and the distance between the first sound source position and some or all of the at least two ultrasonic receivers; the second sound pickup direction is used to indicate the direction of a second projection point of the second sound source position on the plane where the first surface is located relative to the fixed point; the fixed point is different from the second projection point; Acquiring a second sound wave signal component of the first sound wave signal in the second sound pickup direction; After the similarity between the second sound wave signal component and the preset wake-up word is greater than a preset third threshold, the electronic device wakes up.

24. The method according to claim 23, characterized in that The method further comprises: After the similarity between the first sound wave signal component and the preset wake-up word is greater than the first threshold, the electronic device wakes up.

25. The method according to claim 23 or 24, characterized in that The method further comprises: After the similarity between the first sound wave signal component and the preset wake-up word is less than the second threshold, the electronic device remains in a non-awakened state.

26. The method according to claim 25, characterized in that The method further comprises: After the similarity between the second sound wave signal component and the preset wake-up word is less than or equal to the third threshold, the electronic device remains in a non-awakened state.

27. A wake-up method, applied to an electronic device; The electronic device is in an unawakened state, characterized in that: The electronic device comprises: a processor; a memory; M microphones, each microphone corresponding to a sound pickup inlet; the M sound pickup inlets of the M microphones are located on the first surface of the electronic device, and the first surface is on a plane; the distance between any two of the M microphones is fixed; M is a positive integer greater than 1; P ultrasonic transmitters, and the P ultrasonic transmission ports of the P ultrasonic transmitters are located on the second surface; P is a positive integer greater than or equal to 1; the second surface is different from the first surface; Q ultrasonic receivers, each ultrasonic receiver corresponds to an ultrasonic receiving port; the Q ultrasonic receiving ports of the Q ultrasonic receivers are located on the third surface of the electronic device, and the third surface is on a plane; the distance between any two of the Q ultrasonic receivers is fixed; Q is a positive integer greater than 1; the Q ultrasonic receiving ports and the P ultrasonic transmission ports face different directions; the third surface is different from the first surface; the method comprises: Detecting a first sound wave signal through the M microphones; In response to the first sound wave signal, a first sound pickup direction is acquired according to the arrival time difference of the first sound wave signal at at least two of the M microphones and the distance between some or all of the at least two microphones; the first sound pickup direction is used to indicate the direction of a first projection point of a first sound source position on the plane where the first surface is located relative to a fixed point on the plane where the first surface is located; the fixed point is different from the first projection point; Acquiring a first sound wave signal component of the first sound wave signal in the first sound pickup direction; After the similarity between the first sound wave signal component and the preset wake-up word is less than a preset first threshold and greater than or equal to a preset second threshold, Transmitting a second sound wave signal through the P ultrasonic transmitters, wherein the second sound wave signal is an ultrasonic signal; receiving the second sound wave signal through the Q ultrasonic receivers; In response to the second sound wave signal, a second sound pickup direction is acquired according to the arrival time difference of the second sound wave signal at at least two of the Q ultrasonic receivers, and the distance between the first sound source position and some or all of the at least two ultrasonic receivers; the second sound pickup direction is used to indicate the direction of a second projection point of the second sound source position on the plane where the first surface is located relative to the fixed point; the fixed point is different from the second projection point; Performing sound pickup direction correction according to the first sound pickup direction and the second sound pickup direction to determine a third sound pickup direction, wherein the third sound pickup direction is used to indicate a direction of a third projection point of a third sound source position on the plane where the first surface is located relative to the fixed point; Acquire a third sound wave signal component of the first sound wave signal in the third sound pickup direction; After the similarity between the third sound wave signal component and the preset wake-up word is greater than a preset third threshold, the electronic device wakes up.

28. The method according to claim 27, characterized in that The method further comprises: After the similarity between the first sound wave signal component and the preset wake-up word is greater than the first threshold, the electronic device wakes up.

29. The method according to claim 27 or 28, characterized in that The method further comprises: After the similarity between the first sound wave signal component and the preset wake-up word is less than the second threshold, the electronic device remains in a non-awakened state.

30. The method according to claim 29, characterized in that The method further comprises: After the similarity between the third sound wave signal component and the preset wake-up word is less than or equal to the third threshold, the electronic device remains in a non-awakened state.

31. The method according to any one of claims 27-28 and 30, characterized in that: The method of determining a third sound pickup direction according to the first sound pickup direction and the second sound pickup direction comprises: When the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction is less than a preset fourth threshold, or the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction is greater than a preset fifth threshold, the third sound pickup direction is the same as the first sound pickup direction.

32. The method according to any one of claims 27-28 and 30, characterized in that: The method of determining a third sound pickup direction according to the first sound pickup direction and the second sound pickup direction comprises: After the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction is greater than a preset fourth threshold and less than a fifth threshold, the third sound pickup direction is the product of the absolute value of the direction deviation between the first sound pickup direction and the second sound pickup direction and a preset proportional coefficient in the first sound pickup direction.

33. A computer-readable storage medium, characterized in that: The computer-readable storage medium comprises a computer program, and when the computer program is executed on an electronic device, the electronic device is enabled to execute the method according to any one of claims 23 to 32.

34. A computer program product, characterized in that When the computer program product is run on a computer, the computer is caused to execute the method according to any one of claims 23 to 32.

Images