Three-microphone positioning method based on intelligent glasses, intelligent glasses and related device
By setting up three microphones on smart glasses and combining noise reduction processing and spatial sound field technology, the problem that smart glasses cannot achieve accurate voice positioning, realizing accurate positioning and 3D sound effects, and improving user experience.
Patent Information
- Application Number
- CN202411583596.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-11-07
- Publication Date
- 2025-03-04
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
Smart glasses cannot achieve accurate voice positioning, resulting in poor user experience.
The three-mill positioning method based on smart glasses is adopted. By setting up three microphones on the smart glasses, located at different locations, the audio signals of the sound source are collected, and the target position of the sound source is determined through noise reduction processing and spatial sound field technology.
It realizes accurate positioning of voice, improves user experience, and uses sound to realize spatial sound field technology and 3D audio technology algorithms, and automatically converts the heard sound into corresponding orientations and approximate distances.
Smart Images

Figure CN119556235A_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of smart glasses technology, or the field of wearable device technology, and specifically to a three-microphone positioning method based on smart glasses, smart glasses, and related devices. Background Art
[0002] With the rapid development of science and technology, smart glasses are becoming more and more popular. Smart glasses can also be called smart mirrors or AI glasses. Similar to smartphones, they also have independent operating systems. Users can install various application software to realize various software functions. At present, audio processing is usually a simple planar sound, which makes it impossible to realize the positioning function. Therefore, how to achieve accurate voice positioning to improve user experience needs to be solved urgently. Summary of the invention
[0003] The embodiments of the present application provide a three-microphone positioning method based on smart glasses, smart glasses and related devices, which can achieve precise voice positioning to improve user experience.
[0004] In a first aspect, an embodiment of the present application provides a three-microphone positioning method based on smart glasses, which is applied to the smart glasses, wherein the smart glasses include a first glasses leg, a second glasses leg and a glasses frame, a first microphone is arranged at a first position of the first glasses leg, a second microphone is arranged at a second position of the second glasses leg, and a third microphone is arranged at a third position of the glasses frame, and the method includes:
[0005] Determine a first audio signal of a target sound source by using the first microphone;
[0006] determining a second audio signal of the target sound source by using the second microphone;
[0007] Determine a third audio signal of the target sound source by using the third microphone;
[0008] Performing a first noise reduction process on the first audio signal to obtain a target first audio signal;
[0009] Performing a second noise reduction process on the second audio signal to obtain a target second audio signal;
[0010] Performing a third noise reduction process on the third audio signal to obtain a target third audio signal;
[0011] A target position of the target sound source is determined according to the target first audio signal, the target second audio signal, and the target third audio signal.
[0012] In a second aspect, an embodiment of the present application provides a three-microphone positioning device based on smart glasses, which is applied to smart glasses, wherein the smart glasses include a first glasses leg, a second glasses leg and a glasses frame, a first microphone is set at a first position of the first glasses leg, a second microphone is set at a second position of the second glasses leg, and a third microphone is set at a third position of the glasses frame, and the device includes: a determination unit, a noise reduction unit and a positioning unit, wherein:
[0013] The determining unit is configured to determine a first audio signal of a target sound source through the first microphone; determine a second audio signal of the target sound source through the second microphone; and determine a third audio signal of the target sound source through the third microphone;
[0014] The noise reduction unit is used to perform a first noise reduction process on the first audio signal to obtain a target first audio signal; perform a second noise reduction process on the second audio signal to obtain a target second audio signal; and perform a third noise reduction process on the third audio signal to obtain a target third audio signal;
[0015] The positioning unit is used to determine a target position of the target sound source according to the target first audio signal, the target second audio signal and the target third audio signal.
[0016] In a third aspect, an embodiment of the present application provides a pair of smart glasses, comprising a processor, a memory, a communication interface, and one or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the processor, and the program includes instructions for executing the steps in the first aspect of the embodiment of the present application.
[0017] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium stores a computer program for electronic data exchange, wherein the computer program enables a computer to execute part or all of the steps described in the first aspect of the embodiment of the present application.
[0018] In a fifth aspect, an embodiment of the present application provides a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute some or all of the steps described in the first aspect of the embodiment of the present application. The computer program product may be a software installation package.
[0019] The implementation of the embodiments of the present application has the following beneficial effects:
[0020] It can be seen that the three-microphone positioning method based on smart glasses, smart glasses and related devices described in the embodiments of the present application are applied to smart glasses, wherein the smart glasses include a first glasses leg, a second glasses leg and a glasses frame, a first microphone is set at the first position of the first glasses leg, a second microphone is set at the second position of the second glasses leg, and a third microphone is set at the third position of the glasses frame, and a first audio signal of a target sound source is determined by the first microphone; a second audio signal of the target sound source is determined by the second microphone; a third audio signal of the target sound source is determined by the third microphone; the first audio signal is subjected to a first noise reduction process to obtain a target first audio signal; the second audio signal is subjected to a second noise reduction process to obtain a target second audio signal; the third audio signal is subjected to a third noise reduction process to obtain a target third audio signal; the target position of the target sound source is determined according to the target first audio signal, the target second audio signal and the target third audio signal, and further, since the three microphones are located at different positions, further, positioning can be achieved by sound, that is, the algorithm of spatial sound field technology and 3D audio technology is used to automatically convert the received sound into a corresponding direction and approximate distance, thereby achieving precise positioning to improve user experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0021] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0022] Figure 1 It is a flowchart of a three-microphone positioning method based on smart glasses provided in an embodiment of the present application;
[0023] Figure 2 is a schematic diagram of the structure of a pair of smart glasses provided in an embodiment of the present application;
[0024] Figure 3 This is a block diagram of the functional units of a three-microphone positioning device based on smart glasses provided in an embodiment of the present application. DETAILED DESCRIPTION
[0025] In order to enable those skilled in the art to better understand the solution of the present application, the technical solution in the embodiments of the present application will be clearly and completely described below in conjunction with the drawings in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.
[0026] The terms "first", "second", etc. in the specification and claims of this application and the above-mentioned drawings are used to distinguish different objects, rather than to describe a specific order. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device that includes a series of steps or units is not limited to the listed steps or units, but optionally includes steps or units that are not listed, or optionally includes other steps or units inherent to these processes, methods, products or devices.
[0027] Reference to "embodiments" herein means that a particular feature, structure, or characteristic described in conjunction with the embodiments may be included in at least one embodiment of the present application. The appearance of the phrase in various locations in the specification does not necessarily refer to the same embodiment, nor is it an independent or alternative embodiment that is mutually exclusive with other embodiments. It is explicitly and implicitly understood by those skilled in the art that the embodiments described herein may be combined with other embodiments.
[0028] The embodiments of the present application are described in detail below.
[0029] See also Figure 1 , Figure 1 : is a flow chart of a three-microphone positioning method based on smart glasses provided by an embodiment of the present application, which is applied to smart glasses, wherein the smart glasses include a first glasses leg, a second glasses leg and a glasses frame, a first microphone is arranged at a first position of the first glasses leg, a second microphone is arranged at a second position of the second glasses leg, and a third microphone is arranged at a third position of the glasses frame. As shown in the figure, the three-microphone positioning method based on smart glasses includes:
[0030] 101. Determine a first audio signal of a target sound source by using the first microphone.
[0031] In an embodiment of the present application, the smart glasses may include a first glasses leg, a second glasses leg and a glasses frame. A first microphone is set at the first position of the first glasses leg, a second microphone is set at the second position of the second glasses leg, and a third microphone is set at the third position of the glasses frame. The first position, the second position and the third position may be preset or set by the system by default. The first position and the second position may be any position of the front end, the middle end and the rear end of the glasses leg. In a specific implementation, the first audio signal of the target sound source may be determined by the first microphone.
[0032] 102. Determine a second audio signal of the target sound source by using the second microphone.
[0033] In the embodiment of the present application, the second audio signal of the target sound source can be determined by the second microphone, and the first microphone and the second microphone can work in conjunction with each other.
[0034] 103. Determine a third audio signal of the target sound source by using the third microphone.
[0035] In the embodiment of the present application, the third audio signal of the target sound source can be determined by the third microphone, and the first microphone, the second microphone, and the third microphone can work in conjunction with each other.
[0036] 104. Perform a first noise reduction process on the first audio signal to obtain a target first audio signal.
[0037] In the embodiment of the present application, the first audio signal may be subjected to a first noise reduction process to obtain a target first audio signal, thereby improving the signal quality.
[0038] 105. Perform a second noise reduction process on the second audio signal to obtain a target second audio signal.
[0039] In the embodiment of the present application, the second audio signal may be subjected to a second noise reduction process to obtain a target second audio signal, thereby improving the signal quality.
[0040] 106. Perform a third noise reduction process on the third audio signal to obtain a target third audio signal.
[0041] In the embodiment of the present application, the third audio signal may be subjected to a third noise reduction process to obtain a target third audio signal, thereby improving the signal quality.
[0042] 107. Determine a target position of the target sound source according to the target first audio signal, the target second audio signal, and the target third audio signal.
[0043] In a specific implementation, the target position of the target sound source can be determined based on the target first audio signal, the target second audio signal and the target third audio signal. That is, the algorithms of spatial sound field technology and 3D audio technology are used to automatically convert the received sound into the corresponding direction and approximate distance. Since the three microphones are located at different positions, positioning can be achieved by sound.
[0044] Optionally, the above step 107, determining the target position of the target sound source according to the target first audio signal, the target second audio signal and the target third audio signal, may further include the following steps:
[0045] Determine a first positioning parameter of the target sound source according to the target first audio signal, wherein the first positioning parameter includes at least one of the following: a first phase parameter and a first distance parameter;
[0046] Determine a second positioning parameter of the target sound source according to the target second audio signal, wherein the second positioning parameter includes at least one of the following: a second phase parameter and a second distance parameter;
[0047] Determine a third positioning parameter of the target sound source according to the target third audio signal, wherein the third positioning parameter includes at least one of the following: a third phase parameter and a third distance parameter;
[0048] The target position is determined according to the first positioning parameter, the second positioning parameter and the third positioning parameter.
[0049] The first positioning parameter may include at least one of the following: a first phase parameter, a first distance parameter, etc., which are not limited here. For example, the first positioning parameter includes a first phase parameter and a first distance parameter.
[0050] The second positioning parameter may include at least one of the following: a second phase parameter, a second distance parameter, etc., which are not limited here. For example, the second positioning parameter includes a second phase parameter and a second distance parameter.
[0051] The third positioning parameter may include at least one of the following: a third phase parameter, a third distance parameter, etc., which are not limited here. For example, the third positioning parameter includes a third phase parameter and a third distance parameter.
[0052] In an embodiment of the present application, the first positioning parameter of the target sound source can be determined according to the target first audio signal, that is, the algorithm of spatial sound field technology and 3D audio technology can be used to automatically convert the heard sound into the corresponding direction and approximate distance. Accordingly, the second positioning parameter of the target sound source can also be determined according to the target second audio signal, and the algorithm of spatial sound field technology and 3D audio technology can also be used to automatically convert the heard sound into the corresponding direction and approximate distance. Accordingly, the third positioning parameter of the target sound source can also be determined according to the target third audio signal, and the algorithm of spatial sound field technology and 3D audio technology can be used to automatically convert the heard sound into the corresponding direction and approximate distance. Since the three positioning parameters all include phase and distance, the target position can be determined according to the first positioning parameter, the second positioning parameter and the third positioning parameter. In this way, the sound heard can be automatically converted into the corresponding direction and approximate distance according to the time difference and volume of the three microphones receiving the volume, using the algorithm, spatial sound field technology and 3D audio technology. In this way, accurate positioning can be achieved to improve user experience.
[0053] In a specific implementation, the first direction of the first position pointing to the target sound source can be determined according to the target first audio signal. Secondly, the second direction of the second position pointing to the target sound source can be determined according to the target second audio signal. Then, the third direction of the third position pointing to the target sound source can be determined according to the target third audio signal. The target position of the target sound source is then determined according to the first position, the second position, the third position, the first direction, the second direction, and the third direction. That is, the first position and the first direction correspond to the first ray, the second position and the second direction correspond to the second ray, and the third position and the third direction correspond to the third ray. The intersection of the three rays is the target position.
[0054] Optionally, the following steps may also be included:
[0055] A target 3D audio signal is determined according to the target first audio signal, the target second audio signal, and the target third audio signal.
[0056] In a specific implementation, the target 3D audio signal can be determined based on the target first audio signal, the target second audio signal and the target third audio signal, and the algorithm of the spatial sound field technology and the 3D audio technology can be used to automatically convert the received sound into the corresponding direction and approximate distance. Since the three microphones are located at different positions, positioning can be achieved by sound, and 3D sound effects can also be achieved.
[0057] In the embodiment of the present application, the smart glasses can filter the audio data (sound emitted by the sound source) using a head related transfer function (HRTF) filter to obtain virtual surround sound, also known as surround sound, or panoramic sound, to achieve a three-dimensional stereo sound effect, that is, the algorithm of spatial sound field technology and 3D audio technology can be used to automatically convert the sound heard into the corresponding direction and approximate distance.
[0058] The embodiments of the present application can be applied to voice guidance for the blind, allowing users to experience the ambient sound field more realistically.
[0059] For example, in the embodiment of the present application, a microphone can be set at the top of the frame of the smart glasses and at the front end of the two glasses legs. When the three microphones record the conversation content, intelligent noise reduction can be performed first, and then, according to the time difference and volume difference of the three microphones receiving the volume, the algorithm, spatial sound field technology and 3D audio technology are used to automatically convert the received sound into an audio effect of the corresponding direction and distance, and output it through the audio of the glasses. In this way, the pure planar sound is innovatively improved into spatial sound, and the sound can realize the positioning function.
[0060] To further illustrate, when hearing audio effects from different directions, people will instinctively turn their heads to find the direction of the sound source, and then feel the distance based on the volume. When facing the direction of the sound source, you can receive the best sound effect, and then you can actively adjust the distance from the sound source, not only can you accurately locate the sound source, but you can also achieve 3D sound effects, thereby improving the user experience.
[0061] Optionally, the first positioning parameter includes a first distance parameter and a first phase parameter between the first position and the target position; the second positioning parameter includes a second distance parameter and a second phase parameter between the second position and the target position; the third positioning parameter includes a third distance parameter and a third phase parameter between the third position and the target position;
[0062] The step of performing a first noise reduction process on the first audio signal to obtain a target first audio signal includes:
[0063] Performing the first noise reduction processing on the first audio signal according to the first positioning parameter to obtain the target first audio signal;
[0064] The step of performing a second noise reduction process on the second audio signal to obtain a target second audio signal includes:
[0065] Performing the second noise reduction processing on the second audio signal according to the second positioning parameter to obtain the target second audio signal;
[0066] The step of performing a third noise reduction process on the third audio signal to obtain a target third audio signal includes:
[0067] The third audio signal is subjected to the third noise reduction process according to the third positioning parameter to obtain the target third audio signal.
[0068] In a specific implementation, the first audio signal can be subjected to a first noise reduction process according to a first positioning parameter to obtain a target first audio signal, the second audio signal can be subjected to a second noise reduction process according to a second positioning parameter to obtain a target second audio signal, and the third audio signal can be subjected to a third noise reduction process according to a third positioning parameter to obtain a target third audio signal. Dynamic noise reduction can be performed based on the relative position relationship between the sound and the microphone, thereby improving the quality of the third audio signal, and thus helping to deeply realize a 3D audio effect to enhance the user experience.
[0069] For example, a first distance between the first position and the target position can be determined, as can a second distance between the second position and the target position, and a third distance between the third position and the third position can be determined. Then, the first audio signal can be subjected to a first noise reduction process according to the first distance to obtain a target first audio signal. In this way, dynamic noise reduction can be performed based on the sound transmission distance, thereby improving the quality of the first audio signal. Then, the second audio signal can be subjected to a second noise reduction process according to the second distance to obtain a target second audio signal. In this way, dynamic noise reduction can be performed based on the sound transmission distance, thereby improving the quality of the second audio signal. Then, the third audio signal can be subjected to a third noise reduction process according to the third distance to obtain a target third audio signal. In this way, dynamic noise reduction can be performed based on the sound transmission distance, thereby improving the quality of the third audio signal.
[0070] Optionally, the above step of performing the first noise reduction processing on the first audio signal according to the first positioning parameter to obtain the target first audio signal may include the following steps:
[0071] Obtaining first device parameters of the first microphone;
[0072] Determining a first noise reduction processing algorithm corresponding to the first device parameter;
[0073] Determining a first algorithm control parameter corresponding to the first noise reduction processing algorithm;
[0074] Determining a first optimization parameter corresponding to the first positioning parameter;
[0075] Optimizing the first algorithm control parameter according to the first optimization parameter to obtain a target first algorithm control parameter;
[0076] The first noise reduction processing is performed on the first audio signal according to the target first algorithm control parameter and the first noise reduction processing algorithm to obtain the target first audio signal.
[0077] The first device parameter may include at least one of the following: device model, working mode, working current, working voltage, working power, etc., which are not limited here.
[0078] In a specific implementation, the first device parameters of the first microphone can be obtained, and the mapping relationship between the preset device parameters and the noise reduction processing algorithm can be pre-stored. Then, the first noise reduction processing algorithm corresponding to the first device parameters can be determined based on the mapping relationship, and the first algorithm control parameters corresponding to the first noise reduction processing algorithm can also be determined.
[0079] The first algorithm control parameter may be understood as a default algorithm control parameter of the first noise reduction processing algorithm, which may be used to control algorithm speed, noise reduction capability, noise reduction frequency band, and the like.
[0080] Next, the mapping relationship between the preset positioning parameters and the optimization parameters can be pre-stored, and then, based on the mapping relationship, the first optimization parameter corresponding to the first positioning parameter can be determined, and then the first algorithm control parameter can be optimized according to the first optimization parameter to obtain the target first algorithm control parameter, that is, the target first algorithm control parameter = (1 + first optimization parameter) * first algorithm control parameter, and then the first noise reduction processing is performed on the first audio signal according to the target first algorithm control parameter and the first noise reduction processing algorithm to obtain the target first audio signal. In this way, on the one hand, the corresponding noise reduction processing algorithm can be selected based on the device parameters of the microphone, and on the other hand, the algorithm control parameters of the noise reduction processing algorithm can be dynamically optimized based on the positioning parameters, so that the noise reduction effect is deeply in line with the actual environment, and then, the noise reduction effect can be deeply improved, which is helpful to improve the user experience.
[0081] Optionally, the above step of performing the second noise reduction processing on the second audio signal according to the second positioning parameter to obtain the target second audio signal includes:
[0082] Acquire a first reference signal-to-noise ratio of the second audio signal;
[0083] determining a second noise reduction processing algorithm corresponding to the first reference signal-to-noise ratio;
[0084] Determining a second algorithm control parameter corresponding to the second noise reduction processing algorithm;
[0085] determining a second optimization parameter corresponding to the second positioning parameter;
[0086] Optimizing the second algorithm control parameter according to the second optimization parameter to obtain a target second algorithm control parameter;
[0087] The second noise reduction processing is performed on the second audio signal according to the target second algorithm control parameter and the second noise reduction processing algorithm to obtain the target second audio signal.
[0088] In a specific implementation, a first reference signal-to-noise ratio of the second audio signal can be obtained, and a mapping relationship between a preset signal-to-noise ratio and a noise reduction processing algorithm can be pre-stored. Then, a second noise reduction processing algorithm corresponding to the first reference signal-to-noise ratio can be determined based on the mapping relationship, and a second algorithm control parameter corresponding to the second noise reduction processing algorithm can also be determined.
[0089] Among them, the second algorithm control parameter can be understood as the default algorithm control parameter of the second noise reduction processing algorithm, which can be used to control the algorithm speed, noise reduction capability, noise reduction frequency band, etc.
[0090] Next, the mapping relationship between the preset positioning parameters and the optimization parameters can be pre-stored, and then, the second optimization parameter corresponding to the second positioning parameter can be determined based on the mapping relationship, and then the second algorithm control parameter can be optimized according to the second optimization parameter to obtain the target second algorithm control parameter, that is, the target second algorithm control parameter = (1 + second optimization parameter) * second algorithm control parameter, and then the second noise reduction processing is performed on the second audio signal according to the target second algorithm control parameter and the second noise reduction processing algorithm to obtain the target second audio signal. In this way, on the one hand, the corresponding noise reduction processing algorithm can be selected based on the signal characteristics (signal-to-noise ratio), and on the other hand, the algorithm control parameters of the noise reduction processing algorithm can be dynamically optimized based on the positioning parameters, so that the noise reduction effect depth conforms to the actual environment, and then, the noise reduction effect can be deeply improved, which helps to improve the user experience.
[0091] Optionally, the above step of performing the third noise reduction processing on the third audio signal according to the third positioning parameter to obtain the target third audio signal includes:
[0092] Acquire a second reference signal-to-noise ratio of the third audio signal;
[0093] determining an absolute value of a difference between the first reference signal-to-noise ratio and the second reference signal-to-noise ratio;
[0094] When the absolute value is less than a preset threshold, determining a target fine-tuning parameter according to the third positioning parameter and the second positioning parameter;
[0095] Fine-tune the second optimization parameter according to the target fine-tuning parameter to obtain a third optimization parameter;
[0096] Optimizing the second algorithm control parameter according to the third optimization parameter to obtain a reference second algorithm control parameter;
[0097] The third noise reduction processing is performed on the third audio signal according to the reference second algorithm control parameter and the second noise reduction processing algorithm to obtain the target third audio signal.
[0098] The preset threshold value may be preset or set by system default.
[0099] In the embodiment of the present application, a second reference signal-to-noise ratio of the third audio signal can be obtained, and an absolute value of a difference between the first reference signal-to-noise ratio and the second reference signal-to-noise ratio can be determined, where the absolute value=|first reference signal-to-noise ratio-second reference signal-to-noise ratio|. When the absolute value is less than a preset threshold, it indicates that the signal-to-noise ratios of the second audio signal and the third audio signal are similar. The target fine-tuning parameter can be determined according to the third positioning parameter and the second positioning parameter. Specifically, the target fine-tuning parameter=1+(third positioning parameter-second positioning parameter) / second positioning parameter. Furthermore, the second optimization parameter can be fine-tuned according to the target fine-tuning parameter to obtain the third optimization parameter, that is, the third optimization parameter=(1+target fine-tuning parameter)* The second optimization parameter is then used, and the second algorithm control parameter is optimized according to the third optimization parameter to obtain a reference second algorithm control parameter, that is, the reference second algorithm control parameter = (1 + the third optimization parameter) * the second algorithm control parameter, and then the third audio signal is subjected to a third noise reduction processing according to the reference second algorithm control parameter and the second noise reduction processing algorithm to obtain a target third audio signal. In this way, when the signal-to-noise ratios of the second audio signal and the third audio signal are similar, the relationship between the second positioning parameter and the third positioning parameter can be used to dynamically fine-tune the algorithm control parameter, thereby not only making the noise reduction effect deeply consistent with the actual environment, but also improving the noise reduction speed, and deeply improving the noise reduction effect, which helps to improve the user experience.
[0100] Optionally, the following steps may also be included:
[0101] When the absolute value is greater than the preset threshold, determining a third noise reduction processing algorithm corresponding to the second reference signal-to-noise ratio;
[0102] Determining a third algorithm control parameter corresponding to the third noise reduction processing algorithm;
[0103] Determining a fourth optimization parameter corresponding to the third positioning parameter;
[0104] Optimizing the third algorithm control parameter according to the fourth optimization parameter to obtain a target third algorithm control parameter;
[0105] The third noise reduction processing is performed on the third audio signal according to the target third algorithm control parameter and the third noise reduction processing algorithm to obtain the target third audio signal.
[0106] In the embodiment of the present application, when the absolute value is greater than the preset threshold, it means that the difference in signal-to-noise ratio between the second audio signal and the third audio signal is large. Based on the pre-stored mapping relationship between the preset signal-to-noise ratio and the noise reduction processing algorithm, a third noise reduction processing algorithm corresponding to the second reference signal-to-noise ratio can be determined, and a third algorithm control parameter corresponding to the third noise reduction processing algorithm can also be determined.
[0107] Among them, the third algorithm control parameter can be understood as the default algorithm control parameter of the third noise reduction processing algorithm, which can be used to control the algorithm speed, noise reduction capability, noise reduction frequency band, etc.
[0108] Furthermore, a fourth optimization parameter corresponding to the third positioning parameter can be determined based on a mapping relationship between a pre-stored preset positioning parameter and an optimization parameter, and then the third algorithm control parameter can be optimized according to the fourth optimization parameter to obtain a target third algorithm control parameter, the target third algorithm control parameter = (1 + fourth optimization parameter) * third algorithm control parameter, and then a third noise reduction processing is performed on the third audio signal according to the target third algorithm control parameter and a third noise reduction processing algorithm to obtain a target third audio signal. In this way, on the one hand, a corresponding noise reduction processing algorithm can be selected based on signal characteristics (signal-to-noise ratio), and on the other hand, the algorithm control parameters of the noise reduction processing algorithm can be dynamically optimized based on the positioning parameters, so that the noise reduction effect is deeply consistent with the actual environment, and thus, the noise reduction effect can be deeply improved, which helps to improve the user experience.
[0109] Optionally, the above step 107, determining the target 3D audio signal according to the target first audio signal, the target second audio signal and the target third audio signal, may include the following steps:
[0110] Determining a first signal-to-noise ratio of the target first audio signal;
[0111] determining a second signal-to-noise ratio of the target second audio signal;
[0112] determining a third signal-to-noise ratio of the target third audio signal;
[0113] When at least two first target signal-noise ratios greater than a first preset signal-noise ratio exist among the first signal-noise ratio, the second signal-noise ratio, and the third signal-noise ratio, the 3D audio signal is determined according to an audio signal corresponding to the first target signal-noise ratio.
[0114] In the embodiment of the present application, a first signal-to-noise ratio of a target first audio signal can be determined, a second signal-to-noise ratio of a target second audio signal can be determined, and a third signal-to-noise ratio of a target third audio signal can be determined. When at least two of the first signal-to-noise ratios, the first signal-to-noise ratio, and the third signal-to-noise ratio are greater than the first preset signal-to-noise ratio, a 3D audio signal is determined based on an audio signal corresponding to the first target signal-to-noise ratio. In this way, the algorithm of the spatial sound field technology and the 3D audio technology can be used to automatically convert the received sound into a corresponding direction and approximate distance.
[0115] Among them, when only one second target signal-to-noise ratio greater than the first preset signal-to-noise ratio exists among the first signal-to-noise ratio, the second signal-to-noise ratio, and the third signal-to-noise ratio, the 3D audio signal can be determined according to the audio signal corresponding to the second target signal-to-noise ratio, and the 3D audio signal can be determined by the audio signal. In this way, the algorithm of the spatial sound field technology and the 3D audio technology can be used to automatically convert the heard sound into the corresponding direction and approximate distance.
[0116] When there is no signal-to-noise ratio greater than the first preset signal-to-noise ratio among the first signal-to-noise ratio, the first signal-to-noise ratio, and the third signal-to-noise ratio, a maximum value among the first signal-to-noise ratio, the first signal-to-noise ratio, and the third signal-to-noise ratio is selected, and a 3D audio signal is determined based on an audio signal corresponding to the maximum value. In this way, the algorithm of the spatial sound field technology and the 3D audio technology can be used to automatically convert the received sound into a corresponding direction and an approximate distance.
[0117] It can be seen that the three-microphone positioning method based on smart glasses described in the embodiment of the present application is applied to smart glasses, wherein the smart glasses include a first glasses leg, a second glasses leg and a glasses frame, a first microphone is set at the first position of the first glasses leg, a second microphone is set at the second position of the second glasses leg, and a third microphone is set at the third position of the glasses frame, and the first audio signal of the target sound source is determined by the first microphone; the second audio signal of the target sound source is determined by the second microphone; the third audio signal of the target sound source is determined by the third microphone; the first audio signal is subjected to a first noise reduction process to obtain a target first audio signal; the second audio signal is subjected to a second noise reduction process to obtain a target second audio signal; the third audio signal is subjected to a third noise reduction process to obtain a target third audio signal; the target position of the target sound source is determined according to the target first audio signal, the target second audio signal and the target third audio signal, and further, since the three microphones are located at different positions, further, positioning can be achieved by sound, that is, the algorithm of spatial sound field technology and 3D audio technology is used to automatically convert the received sound into the corresponding direction and approximate distance, thereby achieving precise positioning to improve user experience.
[0118] In accordance with the above embodiment, please refer to Figure 2 , Figure 2: is a structural schematic diagram of a smart glasses provided by an embodiment of the present application. As shown in the figure, the smart glasses include a processor, a memory, a communication interface and one or more programs. The one or more programs are stored in the memory and are configured to be executed by the processor. In the embodiment of the present application, the smart glasses include a first glasses leg, a second glasses leg and a glasses frame. A first microphone is set at a first position of the first glasses leg, a second microphone is set at a second position of the second glasses leg, and a third microphone is set at a third position of the glasses frame. The program includes instructions for executing the following steps:
[0119] Determine a first audio signal of a target sound source by using the first microphone;
[0120] determining a second audio signal of the target sound source by using the second microphone;
[0121] Determine a third audio signal of the target sound source by using the third microphone;
[0122] Performing a first noise reduction process on the first audio signal to obtain a target first audio signal;
[0123] Performing a second noise reduction process on the second audio signal to obtain a target second audio signal;
[0124] Performing a third noise reduction process on the third audio signal to obtain a target third audio signal;
[0125] A target position of the target sound source is determined according to the target first audio signal, the target second audio signal, and the target third audio signal.
[0126] Optionally, in determining the target position of the target sound source according to the target first audio signal, the target second audio signal and the target third audio signal, the program includes instructions for performing the following steps:
[0127] Determine a first positioning parameter of the target sound source according to the target first audio signal, wherein the first positioning parameter includes at least one of the following: a first phase parameter and a first distance parameter;
[0128] Determine a second positioning parameter of the target sound source according to the target second audio signal, wherein the second positioning parameter includes at least one of the following: a second phase parameter and a second distance parameter;
[0129] Determine a third positioning parameter of the target sound source according to the target third audio signal, wherein the third positioning parameter includes at least one of the following: a third phase parameter and a third distance parameter;
[0130] The target position is determined according to the first positioning parameter, the second positioning parameter and the third positioning parameter.
[0131] Optionally, the first positioning parameter includes a first distance parameter and a first phase parameter between the first position and the target position; the second positioning parameter includes a second distance parameter and a second phase parameter between the second position and the target position; the third positioning parameter includes a third distance parameter and a third phase parameter between the third position and the target position; and the above program also includes instructions for executing the following steps:
[0132] In the aspect of performing the first noise reduction process on the first audio signal to obtain the target first audio signal, the program includes instructions for executing the following steps:
[0133] Performing the first noise reduction processing on the first audio signal according to the first positioning parameter to obtain the target first audio signal;
[0134] In the aspect of performing a second noise reduction process on the second audio signal to obtain a target second audio signal, the program includes instructions for executing the following steps:
[0135] Performing the second noise reduction processing on the second audio signal according to the second positioning parameter to obtain the target second audio signal;
[0136] Wherein, in the aspect of performing a third noise reduction process on the third audio signal to obtain a target third audio signal, the program includes instructions for executing the following steps:
[0137] The third audio signal is subjected to the third noise reduction process according to the third positioning parameter to obtain the target third audio signal.
[0138] Optionally, in the aspect of performing the first noise reduction processing on the first audio signal according to the first positioning parameter to obtain the target first audio signal, the program includes instructions for executing the following steps:
[0139] Obtaining first device parameters of the first microphone;
[0140] Determining a first noise reduction processing algorithm corresponding to the first device parameter;
[0141] Determining a first algorithm control parameter corresponding to the first noise reduction processing algorithm;
[0142] Determining a first optimization parameter corresponding to the first positioning parameter;
[0143] Optimizing the first algorithm control parameter according to the first optimization parameter to obtain a target first algorithm control parameter;
[0144] The first noise reduction processing is performed on the first audio signal according to the target first algorithm control parameter and the first noise reduction processing algorithm to obtain the target first audio signal.
[0145] Optionally, in the aspect of performing the second noise reduction processing on the second audio signal according to the second positioning parameter to obtain the target second audio signal, the program includes instructions for executing the following steps:
[0146] Acquire a first reference signal-to-noise ratio of the second audio signal;
[0147] determining a second noise reduction processing algorithm corresponding to the first reference signal-to-noise ratio;
[0148] Determining a second algorithm control parameter corresponding to the second noise reduction processing algorithm;
[0149] determining a second optimization parameter corresponding to the second positioning parameter;
[0150] Optimizing the second algorithm control parameter according to the second optimization parameter to obtain a target second algorithm control parameter;
[0151] The second noise reduction processing is performed on the second audio signal according to the target second algorithm control parameter and the second noise reduction processing algorithm to obtain the target second audio signal.
[0152] Optionally, in the aspect of performing the third noise reduction processing on the third audio signal according to the third positioning parameter to obtain the target third audio signal, the program includes instructions for executing the following steps:
[0153] Acquire a second reference signal-to-noise ratio of the third audio signal;
[0154] determining an absolute value of a difference between the first reference signal-to-noise ratio and the second reference signal-to-noise ratio;
[0155] When the absolute value is less than a preset threshold, determining a target fine-tuning parameter according to the third positioning parameter and the second positioning parameter;
[0156] Fine-tune the second optimization parameter according to the target fine-tuning parameter to obtain a third optimization parameter;
[0157] Optimizing the second algorithm control parameter according to the third optimization parameter to obtain a reference second algorithm control parameter;
[0158] The third noise reduction processing is performed on the third audio signal according to the reference second algorithm control parameter and the second noise reduction processing algorithm to obtain the target third audio signal.
[0159] Optionally, the program further includes instructions for executing the following steps:
[0160] When the absolute value is greater than the preset threshold, determining a third noise reduction processing algorithm corresponding to the second reference signal-to-noise ratio;
[0161] Determining a third algorithm control parameter corresponding to the third noise reduction processing algorithm;
[0162] Determining a fourth optimization parameter corresponding to the third positioning parameter;
[0163] Optimizing the third algorithm control parameter according to the fourth optimization parameter to obtain a target third algorithm control parameter;
[0164] The third noise reduction processing is performed on the third audio signal according to the target third algorithm control parameter and the third noise reduction processing algorithm to obtain the target third audio signal.
[0165] Optionally, in the aspect of determining the target 3D audio signal according to the target first audio signal, the target second audio signal and the target third audio signal, the program includes instructions for performing the following steps:
[0166] Determining a first signal-to-noise ratio of the target first audio signal;
[0167] determining a second signal-to-noise ratio of the target second audio signal;
[0168] determining a third signal-to-noise ratio of the target third audio signal;
[0169] When at least two first target signal-noise ratios greater than a first preset signal-noise ratio exist among the first signal-noise ratio, the second signal-noise ratio, and the third signal-noise ratio, the 3D audio signal is determined according to an audio signal corresponding to the first target signal-noise ratio.
[0170] It can be seen that the smart glasses described in the embodiment of the present application include a first temple, a second temple and a glasses frame, a first microphone is set at the first position of the first temple, a second microphone is set at the second position of the second temple, and a third microphone is set at the third position of the glasses frame, the first microphone is used to determine the first audio signal of the target sound source; the second microphone is used to determine the second audio signal of the target sound source; the third microphone is used to determine the third audio signal of the target sound source; the first audio signal is subjected to a first noise reduction process to obtain a target first audio signal; the second audio signal is subjected to a second noise reduction process to obtain a target second audio signal; the third audio signal is subjected to a third noise reduction process to obtain a target third audio signal; the target position of the target sound source is determined according to the target first audio signal, the target second audio signal and the target third audio signal, and further, since the three microphones are located at different positions, further, positioning can be achieved by using sound, that is, the algorithm of spatial sound field technology and 3D audio technology is used to automatically convert the received sound into the corresponding direction and approximate distance, thereby achieving precise positioning to improve user experience.
[0171] Figure 3 This is a functional unit block diagram of a three-microphone positioning device 300 based on smart glasses involved in an embodiment of the present application. The three-microphone positioning device 300 based on smart glasses is applied to smart glasses, and the smart glasses include a first temple, a second temple, and a glasses frame. A first microphone is set at a first position of the first temple, a second microphone is set at a second position of the second temple, and a third microphone is set at a third position of the glasses frame. The three-microphone positioning device 300 based on smart glasses includes: a determination unit 301, a noise reduction unit 302, and a positioning unit 303, wherein:
[0172] The determining unit 301 is configured to determine a first audio signal of a target sound source through the first microphone; determine a second audio signal of the target sound source through the second microphone; and determine a third audio signal of the target sound source through the third microphone;
[0173] The noise reduction unit 302 is used to perform a first noise reduction process on the first audio signal to obtain a target first audio signal; perform a second noise reduction process on the second audio signal to obtain a target second audio signal; and perform a third noise reduction process on the third audio signal to obtain a target third audio signal;
[0174] The positioning unit 303 is configured to determine a target position of the target sound source according to the target first audio signal, the target second audio signal, and the target third audio signal.
[0175] Optionally, in determining the target position of the target sound source according to the target first audio signal, the target second audio signal, and the target third audio signal, the positioning unit 303 is specifically configured to:
[0176] Determine a first positioning parameter of the target sound source according to the target first audio signal, wherein the first positioning parameter includes at least one of the following: a first phase parameter and a first distance parameter;
[0177] Determine a second positioning parameter of the target sound source according to the target second audio signal, wherein the second positioning parameter includes at least one of the following: a second phase parameter and a second distance parameter;
[0178] Determine a third positioning parameter of the target sound source according to the target third audio signal, wherein the third positioning parameter includes at least one of the following: a third phase parameter and a third distance parameter;
[0179] The target position is determined according to the first positioning parameter, the second positioning parameter and the third positioning parameter.
[0180] Optionally, the first positioning parameter includes a first distance parameter and a first phase parameter between the first position and the target position; the second positioning parameter includes a second distance parameter and a second phase parameter between the second position and the target position; the third positioning parameter includes a third distance parameter and a third phase parameter between the third position and the target position;
[0181] In the aspect of performing the first noise reduction process on the first audio signal to obtain the target first audio signal, the noise reduction unit 302 is specifically used for:
[0182] Performing the first noise reduction processing on the first audio signal according to the first positioning parameter to obtain the target first audio signal;
[0183] In the aspect of performing the second noise reduction process on the second audio signal to obtain the target second audio signal, the noise reduction unit 302 is specifically used for:
[0184] Performing the second noise reduction processing on the second audio signal according to the second positioning parameter to obtain the target second audio signal;
[0185] In the aspect of performing the third noise reduction process on the third audio signal to obtain the target third audio signal, the noise reduction unit 302 is specifically used for:
[0186] The third audio signal is subjected to the third noise reduction process according to the third positioning parameter to obtain the target third audio signal.
[0187] Optionally, in the aspect of performing the first noise reduction processing on the first audio signal according to the first positioning parameter to obtain the target first audio signal, the noise reduction unit 302 is specifically configured to:
[0188] Obtaining first device parameters of the first microphone;
[0189] Determining a first noise reduction processing algorithm corresponding to the first device parameter;
[0190] Determining a first algorithm control parameter corresponding to the first noise reduction processing algorithm;
[0191] Determining a first optimization parameter corresponding to the first positioning parameter;
[0192] Optimizing the first algorithm control parameter according to the first optimization parameter to obtain a target first algorithm control parameter;
[0193] The first noise reduction processing is performed on the first audio signal according to the target first algorithm control parameter and the first noise reduction processing algorithm to obtain the target first audio signal.
[0194] Optionally, in the aspect of performing the second noise reduction processing on the second audio signal according to the second positioning parameter to obtain the target second audio signal, the noise reduction unit 302 is specifically configured to:
[0195] Acquire a first reference signal-to-noise ratio of the second audio signal;
[0196] determining a second noise reduction processing algorithm corresponding to the first reference signal-to-noise ratio;
[0197] Determining a second algorithm control parameter corresponding to the second noise reduction processing algorithm;
[0198] determining a second optimization parameter corresponding to the second positioning parameter;
[0199] Optimizing the second algorithm control parameter according to the second optimization parameter to obtain a target second algorithm control parameter;
[0200] The second noise reduction processing is performed on the second audio signal according to the target second algorithm control parameter and the second noise reduction processing algorithm to obtain the target second audio signal.
[0201] Optionally, in the aspect of performing the third noise reduction processing on the third audio signal according to the third positioning parameter to obtain the target third audio signal, the noise reduction unit 302 is specifically configured to:
[0202] Acquire a second reference signal-to-noise ratio of the third audio signal;
[0203] determining an absolute value of a difference between the first reference signal-to-noise ratio and the second reference signal-to-noise ratio;
[0204] When the absolute value is less than a preset threshold, determining a target fine-tuning parameter according to the third positioning parameter and the second positioning parameter;
[0205] Fine-tune the second optimization parameter according to the target fine-tuning parameter to obtain a third optimization parameter;
[0206] Optimizing the second algorithm control parameter according to the third optimization parameter to obtain a reference second algorithm control parameter;
[0207] The third noise reduction processing is performed on the third audio signal according to the reference second algorithm control parameter and the second noise reduction processing algorithm to obtain the target third audio signal.
[0208] Optionally, the three-microphone positioning device 300 based on smart glasses is further specifically used for:
[0209] When the absolute value is greater than the preset threshold, determining a third noise reduction processing algorithm corresponding to the second reference signal-to-noise ratio;
[0210] Determining a third algorithm control parameter corresponding to the third noise reduction processing algorithm;
[0211] Determining a fourth optimization parameter corresponding to the third positioning parameter;
[0212] Optimizing the third algorithm control parameter according to the fourth optimization parameter to obtain a target third algorithm control parameter;
[0213] The third noise reduction processing is performed on the third audio signal according to the target third algorithm control parameter and the third noise reduction processing algorithm to obtain the target third audio signal.
[0214] Optionally, in determining the target 3D audio signal according to the target first audio signal, the target second audio signal and the target third audio signal, the determining unit 303 is specifically configured to:
[0215] Determining a first signal-to-noise ratio of the target first audio signal;
[0216] determining a second signal-to-noise ratio of the target second audio signal;
[0217] determining a third signal-to-noise ratio of the target third audio signal;
[0218] When at least two first target signal-noise ratios greater than a first preset signal-noise ratio exist among the first signal-noise ratio, the second signal-noise ratio, and the third signal-noise ratio, the 3D audio signal is determined according to an audio signal corresponding to the first target signal-noise ratio.
[0219] It can be seen that the three-microphone positioning device based on smart glasses described in the embodiment of the present application is applied to smart glasses, and the smart glasses include a first glasses leg, a second glasses leg and a glasses frame. A first microphone is set at the first position of the first glasses leg, a second microphone is set at the second position of the second glasses leg, and a third microphone is set at the third position of the glasses frame. The first microphone is used to determine the first audio signal of the target sound source; the second microphone is used to determine the second audio signal of the target sound source; the third microphone is used to determine the third audio signal of the target sound source; the first audio signal is subjected to a first noise reduction process to obtain a target first audio signal; the second audio signal is subjected to a second noise reduction process to obtain a target second audio signal; the third audio signal is subjected to a third noise reduction process to obtain a target third audio signal; the target position of the target sound source is determined according to the target first audio signal, the target second audio signal and the target third audio signal. Furthermore, since the three microphones are located at different positions, positioning can be achieved by using sound, that is, the algorithm of spatial sound field technology and 3D audio technology is used to automatically convert the received sound into the corresponding direction and approximate distance, thereby achieving precise positioning to improve user experience.
[0220] It can be understood that the functions of each program module of the three-microphone positioning device based on smart glasses in this embodiment can be specifically implemented according to the method in the above method embodiment, and its specific implementation process can refer to the relevant description of the above method embodiment, which will not be repeated here.
[0221] An embodiment of the present application also provides a computer storage medium, wherein the computer storage medium stores a computer program for electronic data exchange, and the computer program enables a computer to execute part or all of the steps of any method recorded in the above method embodiments.
[0222] The present application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program, and the computer program is operable to cause a computer to execute some or all of the steps of any method described in the above method embodiment. The computer program product may be a software installation package.
[0223] It should be noted that, for the aforementioned method embodiments, for the sake of simplicity, they are all expressed as a series of action combinations, but those skilled in the art should be aware that the present application is not limited by the described order of actions, because according to the present application, certain steps can be performed in other orders or simultaneously. Secondly, those skilled in the art should also be aware that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present application.
[0224] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.
[0225] In the several embodiments provided in the present application, it should be understood that the disclosed device can be implemented in other ways. For example, the device embodiments described above are only schematic, such as the division of the above-mentioned units, which is only a logical function division. There may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, and the indirect coupling or communication connection of devices or units can be electrical or other forms.
[0226] The units described above as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
[0227] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.
[0228] If the above-mentioned integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable memory. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a memory, including a number of instructions to enable a computer device (which can be a personal computer, server or network device, etc.) to perform all or part of the steps of the above-mentioned methods of each embodiment of the present application. The aforementioned memory includes: U disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), mobile hard disk, disk or CD-ROM and other media that can store program codes.
[0229] A person skilled in the art can understand that all or part of the steps in the various methods of the above embodiments can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable memory, and the memory can include: a flash drive, a read-only memory (English: Read-Only Memory, abbreviated as: ROM), a random access memory (English: Random Access Memory, abbreviated as: RAM), a magnetic disk or an optical disk, etc.
[0230] The embodiments of the present application are introduced in detail above. Specific examples are used in this article to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method and core idea of the present application. At the same time, for general technical personnel in this field, according to the idea of the present application, there will be changes in the specific implementation method and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.
Claims
1. A three-microphone positioning method based on smart glasses, characterized in that: Applied to smart glasses, the smart glasses include a first glasses leg, a second glasses leg and a glasses frame, a first microphone is arranged at a first position of the first glasses leg, a second microphone is arranged at a second position of the second glasses leg, and a third microphone is arranged at a third position of the glasses frame, the method includes: Determine a first audio signal of a target sound source by using the first microphone; determining a second audio signal of the target sound source by using the second microphone; Determine a third audio signal of the target sound source by using the third microphone; Performing a first noise reduction process on the first audio signal to obtain a target first audio signal; Performing a second noise reduction process on the second audio signal to obtain a target second audio signal; Performing a third noise reduction process on the third audio signal to obtain a target third audio signal; A target position of the target sound source is determined according to the target first audio signal, the target second audio signal, and the target third audio signal.
2. The method according to claim 1, characterized in that The determining the target position of the target sound source according to the target first audio signal, the target second audio signal, and the target third audio signal comprises: Determine a first positioning parameter of the target sound source according to the target first audio signal, wherein the first positioning parameter includes at least one of the following: a first phase parameter and a first distance parameter; Determine a second positioning parameter of the target sound source according to the target second audio signal, wherein the second positioning parameter includes at least one of the following: a second phase parameter and a second distance parameter; Determine a third positioning parameter of the target sound source according to the target third audio signal, wherein the third positioning parameter includes at least one of the following: a third phase parameter and a third distance parameter; The target position is determined according to the first positioning parameter, the second positioning parameter and the third positioning parameter.
3. The method according to claim 2, characterized in that The first positioning parameter includes a first distance parameter and a first phase parameter between the first position and the target position; the second positioning parameter includes a second distance parameter and a second phase parameter between the second position and the target position; the third positioning parameter includes a third distance parameter and a third phase parameter between the third position and the target position; The step of performing a first noise reduction process on the first audio signal to obtain a target first audio signal includes: Performing the first noise reduction processing on the first audio signal according to the first positioning parameter to obtain the target first audio signal; The step of performing a second noise reduction process on the second audio signal to obtain a target second audio signal includes: Performing the second noise reduction processing on the second audio signal according to the second positioning parameter to obtain the target second audio signal; The step of performing a third noise reduction process on the third audio signal to obtain a target third audio signal includes: The third audio signal is subjected to the third noise reduction process according to the third positioning parameter to obtain the target third audio signal.
4. The method according to claim 3, characterized in that The performing the first noise reduction processing on the first audio signal according to the first positioning parameter to obtain the target first audio signal includes: Obtaining first device parameters of the first microphone; Determining a first noise reduction processing algorithm corresponding to the first device parameter; Determining a first algorithm control parameter corresponding to the first noise reduction processing algorithm; Determining a first optimization parameter corresponding to the first positioning parameter; Optimizing the first algorithm control parameter according to the first optimization parameter to obtain a target first algorithm control parameter; The first noise reduction processing is performed on the first audio signal according to the target first algorithm control parameter and the first noise reduction processing algorithm to obtain the target first audio signal.
5. The method according to claim 3, characterized in that: The performing the second noise reduction processing on the second audio signal according to the second positioning parameter to obtain the target second audio signal includes: Acquire a first reference signal-to-noise ratio of the second audio signal; determining a second noise reduction processing algorithm corresponding to the first reference signal-to-noise ratio; Determining a second algorithm control parameter corresponding to the second noise reduction processing algorithm; determining a second optimization parameter corresponding to the second positioning parameter; Optimizing the second algorithm control parameter according to the second optimization parameter to obtain a target second algorithm control parameter; The second noise reduction processing is performed on the second audio signal according to the target second algorithm control parameter and the second noise reduction processing algorithm to obtain the target second audio signal.
6. The method according to claim 5, characterized in that The performing the third noise reduction processing on the third audio signal according to the third positioning parameter to obtain the target third audio signal includes: Acquire a second reference signal-to-noise ratio of the third audio signal; determining an absolute value of a difference between the first reference signal-to-noise ratio and the second reference signal-to-noise ratio; When the absolute value is less than a preset threshold, determining a target fine-tuning parameter according to the third positioning parameter and the second positioning parameter; Fine-tune the second optimization parameter according to the target fine-tuning parameter to obtain a third optimization parameter; Optimizing the second algorithm control parameter according to the third optimization parameter to obtain a reference second algorithm control parameter; The third noise reduction process is performed on the third audio signal according to the reference second algorithm control parameter and the second noise reduction process algorithm to obtain the target third audio signal.
7. The method according to claim 6, characterized in that The method further comprises: When the absolute value is greater than the preset threshold, determining a third noise reduction processing algorithm corresponding to the second reference signal-to-noise ratio; Determining a third algorithm control parameter corresponding to the third noise reduction processing algorithm; Determining a fourth optimization parameter corresponding to the third positioning parameter; Optimizing the third algorithm control parameter according to the fourth optimization parameter to obtain a target third algorithm control parameter; The third noise reduction processing is performed on the third audio signal according to the target third algorithm control parameter and the third noise reduction processing algorithm to obtain the target third audio signal.
8. A three-microphone positioning device based on smart glasses, characterized in that: Applied to smart glasses, the smart glasses include a first glasses leg, a second glasses leg and a glasses frame, a first microphone is arranged at a first position of the first glasses leg, a second microphone is arranged at a second position of the second glasses leg, and a third microphone is arranged at a third position of the glasses frame, the device includes: a determination unit, a noise reduction unit and a positioning unit, wherein: The determining unit is configured to determine a first audio signal of a target sound source through the first microphone; determine a second audio signal of the target sound source through the second microphone; and determine a third audio signal of the target sound source through the third microphone; The noise reduction unit is used to perform a first noise reduction process on the first audio signal to obtain a target first audio signal; perform a second noise reduction process on the second audio signal to obtain a target second audio signal; and perform a third noise reduction process on the third audio signal to obtain a target third audio signal; The positioning unit is used to determine a target position of the target sound source according to the target first audio signal, the target second audio signal and the target third audio signal.
9. A smart glasses, characterized in that: The method comprises a processor and a memory, wherein the memory is used to store one or more programs and is configured to be executed by the processor, wherein the programs include instructions for executing the steps in the method according to any one of claims 1 to 7.
10. A computer-readable storage medium, characterized in that: A computer program for electronic data exchange is stored, wherein the computer program enables a computer to execute the method according to any one of claims 1 to 7.
Citation Information
Patent Citations
Directional eyeglasses with sound source
CN102116941A
Audio processing method and device, storage medium and intelligent glasses
CN115775564A
AR glasses and audio enhancement method and device thereof, and readable storage medium
CN116126132A
Microphone noise reduction processing method and computer storage medium
CN116634332A
AR glasses, pickup noise reduction method and device and readable storage medium
CN117153177A
Cited By
Intelligent glasses
CN120871437A