Methods, systems, devices, headphone equipment and media for enhancing sound directionality

Abstract

This invention discloses a method, system, device, headphone device, and computer-readable storage medium for enhancing sound directionality. The method includes: controlling a microphone array configured within the headphone device to receive ambient sound signals from the wearer's surroundings; wherein the microphone array comprises multiple microphones; determining the signal weight corresponding to each microphone based on the ambient sound signals, and determining a target receiving direction based on the signal weights; generating a target sound signal with enhanced directionality corresponding to the ambient sound signals based on the target receiving direction, and outputting the target sound signal through a sound output module configured within the headphone device. This invention enables the headphone device to process received ambient sound signals from different directions to generate a target sound signal with enhanced directionality, thereby allowing the wearer to obtain useful information through the sound signal output by the headphone device.

Description

Technical Field

[0001] This invention relates to the field of headphone technology, and more particularly to a method, system, device, headphone equipment, and computer-readable storage medium for enhancing sound directionality. Background Technology

[0002] With the development of the Bluetooth headset industry, in order to provide wearers with a better wearing experience, more and more technicians are beginning to add transparency mode to headset devices. In transparency mode, wearers can still hear the sounds of the outside environment very naturally while wearing the headset. For example, when wearers need to make near-field calls with others or need to hear external prompts or other sound information, transparency mode allows wearers to obtain external sound signals without removing the headset.

[0003] Currently, the transparency mode function mainly uses a microphone element inside the earphone shell to collect external sound signals. Then, a designed filter circuit inside the earphone device processes the sound signals, and finally, the speaker element inside the earphone device outputs the processed sound signals to complete the sound signal transmission. Ultimately, it allows the wearer to obtain external sound signals without removing the earphones. However, this method has a drawback when the wearer is in noisy environments such as urban roads, intersections, restaurants, commercial areas, and industrial areas. In these environments, there are both useful sound signals that the wearer needs and high-amplitude noise signals. This results in the wearer's perception of sound signals coming from different directions being limited, and the wearer may have difficulty identifying the sound information they need from the external sound environment. Summary of the Invention

[0004] The main objective of this invention is to provide a method, system, device, headphone device, and computer-readable storage medium for enhancing the directionality of sound. The aim is to enable the headphone device to process ambient sound signals received from different directions to generate a target sound signal with enhanced directionality, thereby allowing the wearer to obtain useful information through the sound signal output by the headphone device and improving the wearer's user experience.

[0005] To achieve the above objectives, the present invention provides a sound directionality enhancement method, the sound directionality enhancement method comprising the following steps:

[0006] The microphone array configured within the headphone device is controlled to receive ambient sound signals from the wearer's surroundings; wherein the microphone array consists of multiple microphones;

[0007] The signal weights of each microphone are determined based on the ambient sound signals, and the target receiving direction is determined based on the signal weights.

[0008] A target sound signal with enhanced target directionality corresponding to the ambient sound signal is generated according to the target receiving direction, and the target sound signal is output through the sound output module configured in the headphone device.

[0009] Further, the step of determining the signal weight corresponding to each of the microphones based on the ambient sound signal includes:

[0010] Obtain the preset adaptive algorithms;

[0011] The signal weights corresponding to each microphone are determined based on the adaptive algorithms and the ambient sound signals.

[0012] Further, the step of determining the target receiving direction based on each of the signal weights includes:

[0013] Determine the reception time of each microphone receiving the ambient sound signal, and determine the reception delay between each microphone based on the reception time;

[0014] The receiving delay is adjusted according to the signal weights to determine the target receiving direction.

[0015] Further, the step of adjusting the reception delay according to the signal weights to determine the target reception direction includes:

[0016] The target reception delay corresponding to each microphone is determined based on the signal weights described above.

[0017] The receiving delay of each microphone is adjusted to the target receiving delay, and the target receiving direction is determined based on the target receiving delay.

[0018] Further, the step of determining the target reception direction based on each of the target reception delays includes:

[0019] The directional characteristics of the environmental sound signal are determined based on the reception delay of each target.

[0020] An array pattern corresponding to the ambient sound signal is generated based on each of the directional features, and the target receiving direction is determined based on the array pattern.

[0021] Further, the step of generating an array pattern corresponding to the ambient sound signal based on each of the directional features, and determining the target receiving direction based on the array pattern, includes:

[0022] Based on the aforementioned directional characteristics, determine the signal enhancement direction and signal suppression direction corresponding to the environmental sound signal;

[0023] An array pattern is generated based on the signal enhancement direction and the signal suppression direction, and the target receiving direction is determined based on the main lobe of the array pattern.

[0024] Further, the step of generating a target sound signal with target directionality enhancement corresponding to the ambient sound signal based on the target receiving direction includes:

[0025] An initial sound signal corresponding to the ambient sound signal is generated according to the target receiving direction;

[0026] The target sound signal is obtained by frequency domain filtering of the initial sound signal through the transparency filter device configured inside the headphone device.

[0027] In addition, to achieve the above objectives, the present invention also provides a sound directionality enhancement system, the system comprising: a speaker, a feedforward microphone, a call microphone, an analog-to-digital converter and preamplifier module, an algorithm processor, a transparency filter circuit, and a digital-to-analog converter and power amplifier module;

[0028] The feedforward microphone and the call microphone are connected to the analog-to-digital converter and preamplifier module to input the collected ambient sound signals to the analog-to-digital converter and preamplifier module;

[0029] The analog-to-digital conversion and preamplifier module is connected to the algorithm processor and is used to amplify the acquired ambient sound signal and convert it into a digital signal, and input the digital signal to the algorithm processor.

[0030] The algorithm processor is connected to the pass-through filter circuit and is used to calculate the digital signal to determine the signal weights corresponding to the feedforward microphone and the call microphone, and input each of the signal weights to the pass-through filter circuit.

[0031] The transparent filtering circuit is connected to the digital-to-analog converter and power amplifier module, and is used to generate transparent information according to the acquired signal weights, and input the transparent signal to the digital-to-analog converter and power amplifier module.

[0032] The digital-to-analog converter and power amplifier module is connected to the speaker and is used to perform digital-to-analog conversion and power amplification on the acquired transparent signal, and input the processed transparent signal to the speaker for output.

[0033] Furthermore, the algorithm processor includes an algorithm solver and an adder, wherein the algorithm solver is connected to the adder;

[0034] The algorithm solver is used to calculate the weights of each signal from the acquired digital signal and input each signal weight into the adder;

[0035] The adder is used to determine the signal receiving direction based on the weights of each signal.

[0036] Furthermore, to achieve the above objectives, the present invention also provides a sound directionality enhancement device, the device comprising:

[0037] A signal receiving module is used to control a microphone array configured within the headphone device to receive ambient sound signals from the wearer's surroundings; wherein the microphone array consists of multiple microphones;

[0038] The signal analysis module is used to determine the signal weight of each microphone based on the ambient sound signal, and to determine the target receiving direction based on the signal weight.

[0039] The signal output module is used to generate a target sound signal with target directionality enhancement corresponding to the ambient sound signal according to the target receiving direction, and to output the target sound signal through the sound output module configured in the headphone device.

[0040] In addition, to achieve the above objectives, the present invention also provides an earphone device, the earphone device comprising: a memory, a processor, and a sound directionality enhancement program stored in the memory and executable on the processor, wherein the sound directionality enhancement program, when executed by the processor, implements the steps of the sound directionality enhancement method as described above.

[0041] In addition, to achieve the above objectives, the present invention also provides a computer-readable storage medium storing a sound directionality enhancement program, which, when executed by a processor, implements the steps of the sound directionality enhancement method as described above.

[0042] The present invention provides a sound directionality enhancement method, apparatus, headphone device, and computer-readable storage medium, which receive ambient sound signals around the wearer by controlling a microphone array configured in the headphone device; wherein the microphone array consists of multiple microphones; a signal weight corresponding to each microphone is determined according to the ambient sound signal, and a target receiving direction is determined according to the signal weight; a target sound signal with target directionality enhancement corresponding to the ambient sound signal is generated according to the target receiving direction, and the target sound signal is output through a sound output module configured in the headphone device.

[0043] In this embodiment, when the headphone device is running, it first controls each microphone in the microphone array configured on the headphone device to receive ambient sound signals generated in the wearer's surrounding environment, and inputs the acquired ambient sound signals into the algorithm processor configured in the headphone device. Then, the algorithm processor identifies the ambient sound signals and determines the signal weight corresponding to each microphone according to a variety of preset adaptive algorithms and the ambient sound signals. At the same time, the algorithm processor determines the reception delay between each microphone according to the reception time of each microphone receiving the ambient sound signals. The algorithm processor then adjusts each reception delay according to each signal weight to determine the target reception direction. After that, the algorithm processor inputs the acquired target reception direction into the transparency filter circuit configured in the headphone device. The transparency filter circuit generates an initial sound signal with target directionality enhancement corresponding to the ambient sound signals according to the target reception direction. The transparency filter circuit then filters the initial sound signal to generate the target sound signal. The transparency filter circuit then inputs the generated target sound signal into the sound output module configured in the headphone device, and the speaker in the sound output module plays the target sound signal with target directionality enhancement.

[0044] Thus, this invention employs a method that controls a microphone array deployed on a headphone device to receive ambient sound signals. It utilizes multiple adaptive algorithms to calculate the weight values ​​for each microphone based on the identified ambient sound signals. Then, based on these weight values, the signal weights of each microphone are adjusted to determine the target reception direction. Subsequently, a target sound signal with enhanced directionality corresponding to the ambient sound signal is generated based on this target reception direction. Finally, the target sound signal is filtered and output through a sound output module. In other words, this invention solves the problem of headphone devices... Current transparency modes can only process sound signals from different directions in a single way, resulting in a limited perception of sound signals from different directions for the wearer. This invention addresses this by filtering the generated target sound signal with enhanced directionality. This overcomes the physical obstruction caused by the headphones, preventing the wearer from identifying the desired sound information from the surrounding environment. This allows the headphones to process ambient sound signals from different directions to generate a target sound signal with enhanced directionality, enabling the wearer to obtain useful information from the sound signal output by the headphones, thus improving the user experience. Attached Figure Description

[0045] Figure 1 This is a schematic diagram of the headphone device structure in the hardware operating environment involved in the embodiments of the present invention;

[0046] Figure 2 This is a flowchart illustrating the first embodiment of the sound directionality enhancement method of the present invention;

[0047] Figure 3 This is a detailed structural diagram of an embodiment of the sound directionality enhancement method of the present invention;

[0048] Figure 4 This is a schematic diagram of the algorithm processor module involved in an embodiment of the sound directionality enhancement method of the present invention;

[0049] Figure 5 This is a schematic diagram of the functional modules involved in an embodiment of the sound directionality enhancement method of the present invention.

[0050] The realization of the objective, functional features and advantages of the present invention will be further explained in conjunction with the embodiments and with reference to the accompanying drawings. Detailed Implementation

[0051] It should be understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

[0052] Please refer to Figure 1 , Figure 1 This is a schematic diagram of the headphone device structure in the hardware operating environment involved in the embodiments of the present invention.

[0053] It should be noted that, Figure 1 This can be seen as a structural diagram of the hardware operating environment of the headphone device. In this embodiment of the invention, the headphone device can be a headphone device equipped with a feedforward microphone and a transparency filter circuit. Of course, the headphone device can also be a Bluetooth headset, Bluetooth microphone, or other mobile headphone device.

[0054] like Figure 1As shown, the headphone device may include: a processor 1001, such as a central processing unit (CPU), a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. The communication bus 1002 is used to enable communication between these components. The user interface 1003 may include a display screen and an input unit such as a keyboard; optionally, the user interface 1003 may also include a standard wired interface or a wireless interface. The network interface 1004 may optionally include a standard wired interface or a wireless interface (such as a Wi-Fi interface). The memory 1005 may be a high-speed random access memory (RAM) or a stable non-volatile memory (NVM), such as a disk drive. The memory 1005 may also optionally be a storage device independent of the aforementioned processor 1001.

[0055] Those skilled in the art will understand that Figure 1 The structure shown does not constitute a limitation on the headphone device and may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0056] like Figure 1 As shown, the memory 1005, which serves as a storage medium, may include an operating system, a data storage module, a network communication module, a user interface module, and a sound directionality enhancement program.

[0057] exist Figure 1 In the illustrated headphone device, the network interface 1004 is mainly used for data communication with other devices; the user interface 1003 is mainly used for data interaction with the user; the processor 1001 and memory 1005 in the headphone device of the present invention can be set in the headphone device, and the headphone device calls the sound directionality enhancement program stored in the memory 1005 through the processor 1001 and performs the following operations:

[0058] The microphone array configured within the headphone device is controlled to receive ambient sound signals from the wearer's surroundings; wherein the microphone array consists of multiple microphones;

[0059] The signal weights of each microphone are determined based on the ambient sound signals, and the target receiving direction is determined based on the signal weights.

[0060] A target sound signal with enhanced target directionality corresponding to the ambient sound signal is generated according to the target receiving direction, and the target sound signal is output through the sound output module configured in the headphone device.

[0061] Furthermore, the processor 1001 calls the sound directionality enhancement program stored in the memory 1005 and performs the following operations:

[0062] Obtain the preset adaptive algorithms;

[0063] The signal weights corresponding to each microphone are determined based on the adaptive algorithms and the ambient sound signals.

[0064] Furthermore, the processor 1001 calls the sound directionality enhancement program stored in the memory 1005 and performs the following operations:

[0065] Determine the reception time of each microphone receiving the ambient sound signal, and determine the reception delay between each microphone based on the reception time;

[0066] The receiving delay is adjusted according to the signal weights to determine the target receiving direction.

[0067] Furthermore, the processor 1001 calls the sound directionality enhancement program stored in the memory 1005 and performs the following operations:

[0068] The target reception delay corresponding to each microphone is determined based on the signal weights described above.

[0069] The receiving delay of each microphone is adjusted to the target receiving delay, and the target receiving direction is determined based on the target receiving delay.

[0070] Furthermore, the directional characteristics include the signal enhancement direction and the signal suppression direction. The processor 1001 calls the sound directional enhancement program stored in the memory 1005 and performs the following operations:

[0071] The directional characteristics of the environmental sound signal are determined based on the reception delay of each target.

[0072] An array pattern corresponding to the ambient sound signal is generated based on each of the directional features, and the target receiving direction is determined based on the array pattern.

[0073] Furthermore, the processor 1001 calls the sound directionality enhancement program stored in the memory 1005 and performs the following operations:

[0074] Based on the aforementioned directional characteristics, determine the signal enhancement direction and signal suppression direction corresponding to the environmental sound signal;

[0075] An array pattern is generated based on the signal enhancement direction and the signal suppression direction, and the target receiving direction is determined based on the main lobe of the array pattern.

[0076] Furthermore, the processor 1001 calls the sound directionality enhancement program stored in the memory 1005 and performs the following operations:

[0077] An initial sound signal corresponding to the ambient sound signal is generated according to the target receiving direction;

[0078] The target sound signal is obtained by frequency domain filtering of the initial sound signal through the transparency filter device configured inside the headphone device.

[0079] Based on the aforementioned headphone device, various embodiments of the sound directionality enhancement method of the present invention are provided.

[0080] Please refer to Figure 2 , Figure 2 This is a flowchart illustrating the first embodiment of the sound directionality enhancement method of the present invention.

[0081] It should be understood that although the logical order is shown in the flowchart, in some cases the sound directionality enhancement method of the present invention may of course perform the steps shown or described in a different order than that shown here.

[0082] It is understood that the sound directionality enhancement method of the present invention is applied to headphone devices equipped with a feedforward microphone and a transparency filter circuit. When the headphone device includes two headphones, the sound directionality enhancement method can be applied to either one of the headphones or to both headphones simultaneously. In this embodiment, the sound directionality enhancement method may include the following steps:

[0083] Step S10: Control the microphone array configured in the headphone device to receive ambient sound signals around the wearer; wherein, the microphone array consists of multiple microphones;

[0084] A feedforward microphone is a microphone mounted on the outer shell of a headphone device to receive noise signals generated in the wearer's surrounding environment. The feedforward microphone can be deployed at any position on the outer shell of the headphone device. Of course, the specific deployment position of the feedforward microphone can also refer to the deployment position of the feedforward microphone in similar Bluetooth headphone devices with active noise cancellation or transparency mode functions. This invention does not limit this.

[0085] Furthermore, there can be multiple feedforward microphones, or technicians can choose to combine the feedforward microphones and call microphones deployed in the headset device to obtain a microphone array. It is understood that the array shape of the microphone array and the number of feedforward microphones constituting the microphone array can also be adjusted by technicians according to the actual situation, and the present invention does not limit this.

[0086] In this embodiment, when the headphone device is running, it first controls each microphone in the microphone array deployed in the headphone device to receive ambient sound signals in the environment around the wearer, and then inputs the acquired ambient sound signals to the algorithm processor configured in the headphone device.

[0087] For example, please refer to Figure 3 , Figure 3 This is a detailed structural diagram of an embodiment of the sound directionality enhancement method of the present invention. The headphone device controls the sound directionality enhancement method through an internally configured main control chip. Figure 3 The microphone array shown, consisting of a feedforward microphone 1 and a call microphone 4, configured on the outer shell of the headset device, receives ambient sound signals generated by the wearer's surroundings. Then, the headset device transmits signals via... Figure 3 As shown, the digital-to-analog converter and preamplifier module 5, configured inside the headphone device, amplifies and converts the ambient sound signals received by the feedforward microphone 1 and the call microphone 4 into digital signals. The headphone device then inputs the digital signal corresponding to the acquired ambient sound signal into the... Figure 3 As shown, the algorithm processor 6 is configured within the headphone device.

[0088] It should be noted that the digital-to-analog converter and preamplifier module 5 is mainly used to amplify the sound signals collected by each microphone. At the same time, it converts the sound signals collected by each microphone into digital signals. It can be understood that in another embodiment, when the microphone types corresponding to the feedforward microphone 1 and the call microphone 4 configured in the headset device are digital microphones, the headset device does not need to be configured with the digital-to-analog converter and preamplifier module 5.

[0089] Step S20: Determine the signal weight corresponding to each microphone based on the ambient sound signal, and determine the target receiving direction based on each signal weight;

[0090] In this embodiment, when the algorithm processor receives the ambient sound signal, it calculates the signal weight of each microphone based on the preset adaptive algorithm and the identified ambient sound signal. The algorithm processor then determines the target receiving direction of the ambient sound signal according to the signal weight and inputs the target receiving direction to the transparency filter circuit configured in the headphone device.

[0091] For example, when the algorithm processor 6 receives the digital signal corresponding to the ambient sound signal, it first calculates each digital signal according to the adaptive beamforming algorithm preset by the technician, thereby determining the signal weights corresponding to the feedforward microphone 1 and the intercom microphone 4 respectively. Then, the algorithm processes...

[0092] The processor determines the target reception direction of the ambient sound signal based on the weights of the signals 5 corresponding to microphone 1 and microphone 4 through the internally configured addition unit, and then inputs the target reception direction to the transparency filter circuit configured in the headset device.

[0093] It should be noted that, please refer to Figure 4 , Figure 4 This is a schematic diagram of the algorithm processor module involved in an embodiment of the sound directionality enhancement method of the present invention, as shown below. Figure 4 As shown, in algorithm processor 6, 6-1 represents the weights.

[0094] Vectors W1 to W4 are defined in section 6-2 as the algorithm solver and section 6-3 as the adder. Specifically, W1 to W4 in section 6-1 are primarily used to adjust the signal weights corresponding to each microphone; the algorithm solver in section 6-2 runs an adaptive algorithm.

[0095] The signal weights of each microphone are solved in real time using adaptive methods; the 6-3 adder is mainly used to determine the target receiving direction of the ambient sound signal based on the signal weights of each microphone.

[0096] Furthermore, in a feasible embodiment, the step of "determining the signal weight corresponding to each of the microphones according to the ambient sound signal" in step S20 above may specifically include: step S201: obtaining preset adaptive algorithms;

[0097] Step S202: Determine the signal weight corresponding to each microphone according to each of the adaptive algorithms and the ambient sound signal;

[0098] For example, the headphone device first reads its internally configured storage to obtain information from the technical user.

[0099] The LMS (Least Mean Square) algorithm is pre-stored by the staff and input into the algorithm processor. The processor determines the signal weights of the feedforward microphone 1 and the call microphone 4 based on the LMS algorithm and the recognized ambient sound signal.

[0100] It should be noted that, in this embodiment, in addition to storing the LMS algorithm as an adaptive algorithm, the storage device may also store other algorithms such as MVDR (Minimum Variance Distortionless Response), LCMV (Linearly Constrained Minimum Variance Beamforming), GSC (General Sidelobe Canceler) algorithm, and multi-stage Wiener filters. It is understood that these various adaptive algorithms can be input into the storage device by technicians before the headphone device leaves the factory, so that the headphone device can directly read and retrieve them from the storage device when needed. This allows for storage by technicians.

[0101] The device is stored on a server so that headphone devices can remotely download and obtain the device via a link to the server when needed; however, this invention does not impose any limitations on this.

[0102] Furthermore, in a feasible embodiment, the step of "determining the target receiving direction according to each of the signal weights" in step S20 above may specifically include:

[0103] Step S203: Determine the reception time of each microphone receiving the ambient sound signal, and determine the reception delay between each microphone based on the reception time;

[0104] In this embodiment, the headphone device uses an internally configured detection device to detect each microphone to obtain the reception time of each microphone receiving the ambient sound signal. The headphone device then determines the reception delay between each microphone based on the reception time.

[0105] Step S204: Adjust the receiving delay according to the signal weights to determine the target receiving direction;

[0106] In this embodiment, the headphone device inputs the obtained reception delays to the algorithm processor, which then adjusts the reception delay of each microphone according to the signal weights of each microphone to determine the target reception direction corresponding to the ambient sound signal.

[0107] For example, the headphone device detects the feedforward microphone 1 and the call microphone 4 through an internally configured detection device to obtain the reception time of the ambient sound signal received by the feedforward microphone 1 and the call microphone 4 respectively. Then, the headphone device determines the reception delay between the feedforward microphone 1 and the call microphone 4 based on the reception time. The headphone device then inputs the obtained reception delay to the algorithm processor, which adjusts the reception delay of the feedforward microphone 1 and the call microphone 4 according to the signal weights corresponding to the feedforward microphone 1 and the call microphone 4 respectively to determine the target reception direction corresponding to the ambient sound signal.

[0108] Furthermore, in a feasible embodiment, step S204 above may specifically include:

[0109] Step S2041: Determine the target reception delay corresponding to each microphone according to the signal weights;

[0110] Step S2042: Adjust the receiving delay of each microphone to the target receiving delay, and determine the target receiving direction based on the target receiving delay;

[0111] For example, after calculating the weights of each signal, the algorithm processor calculates the target reception delays of each of the feedforward microphone 1 and the talk microphone 4 according to their respective signal weights. Then, the algorithm processor compensates the received delays of each of the feedforward microphone 1 and the talk microphone 4 to the target reception delay, thereby determining the target reception direction based on each target reception delay.

[0112] Furthermore, in a feasible embodiment, the step of "determining the target reception direction based on the target reception delay" in step S2042 above may specifically include:

[0113] Step A10: Determine the directional characteristics of the ambient sound signal based on the reception delay of each target;

[0114] Step A20: Generate an array pattern corresponding to the ambient sound signal based on each of the directional features, and determine the target receiving direction based on the array pattern;

[0115] For example, the algorithm processor determines the directional features corresponding to the ambient sound signal based on the target reception delay generated between the feedforward microphone 1 and the call microphone 4. Then, the algorithm processor generates an array pattern based on the directional features and determines the target reception direction corresponding to the ambient sound signal based on the array pattern.

[0116] Furthermore, in a feasible embodiment, step A20 above may specifically include:

[0117] Step A201: Determine the signal enhancement direction and signal suppression direction corresponding to the ambient sound signal based on each of the directional characteristics;

[0118] Step A202: Generate an array pattern based on the signal enhancement direction and the signal suppression direction, and determine the target receiving direction based on the main lobe of the array pattern.

[0119] For example, the algorithm processor determines the signal enhancement direction and signal suppression direction corresponding to the ambient sound signal based on the acquired directional features, and generates an array pattern based on the signal enhancement direction and signal suppression direction. Then, the algorithm processor determines the direction corresponding to the main lobe of the pattern contained in the array pattern as the target receiving direction.

[0120] Step S30: Generate a target sound signal with enhanced target directionality corresponding to the ambient sound signal according to the target receiving direction, and output the target sound signal through the sound output module configured in the headphone device;

[0121] In this embodiment, the pass-through filter circuit generates a target sound signal with enhanced target directionality corresponding to the ambient sound signal based on the acquired target weight value. The pass-through filter circuit then inputs the generated target sound signal to the sound output module configured in the headphone device, and the sound output module outputs the target sound signal.

[0122] For example, the transparency filter circuit generates a transparency signal corresponding to the ambient sound signal based on the acquired target weight value. Then, the transparency filter circuit inputs the generated transparency signal to the digital-to-analog converter and power amplifier module 8 configured in the headphone device. The digital-to-analog converter and power amplifier module 8 converts the generated transparency signal into a target sound signal, and the target sound signal is output by the speaker device configured in the headphone device.

[0123] It should be noted that in this embodiment, the analog-to-analog converter and power amplifier module 8 performs digital-to-analog conversion on the generated transparent signal to generate a sound signal. At the same time, the analog-to-analog converter and power amplifier module 8 amplifies the generated sound signal so that the speaker device configured in the headphone device can output the sound signal.

[0124] Furthermore, in a feasible embodiment, the step S30 above, "generating a target sound signal with target directionality enhancement corresponding to the ambient sound signal according to the target receiving direction," may specifically include:

[0125] Step S301: Generate an initial sound signal corresponding to the ambient sound signal according to the target receiving direction;

[0126] Step S302: The initial sound signal is subjected to frequency domain filtering processing by the transparency filter device configured inside the headphone device to obtain the target sound signal;

[0127] For example, the transparency filter circuit adjusts the digital signal corresponding to the ambient sound signal according to the acquired target weight value to generate an initial transparency signal with enhanced target directionality. Then, the transparency filter circuit further performs frequency domain filtering on the initial transparency signal using a Fourier transform formula preset by the technician to generate a target transparency signal. After that, the transparency filter circuit inputs the generated target transparency signal to the digital-to-analog converter and power amplifier module 8, which converts the generated target transparency signal into a target sound signal and inputs it to the sound output module configured in the headphone device. The speaker configured in the sound output module plays the target sound signal.

[0128] In this embodiment, when the headphone device is running, it first controls each microphone in the microphone array deployed within the headphone device to receive ambient sound signals from the wearer's surroundings. The acquired ambient sound signals are then input to an algorithm processor configured within the headphone device. Upon receiving the ambient sound signals, the algorithm processor calculates the signal weights corresponding to each microphone using a preset adaptive algorithm and the identified ambient sound signals. The algorithm processor then determines the target reception direction corresponding to the ambient sound signals based on these signal weights and inputs the target reception direction to a transparency filter circuit configured within the headphone device. Subsequently, the transparency filter circuit generates a target sound signal with enhanced target directionality corresponding to the ambient sound signals based on the acquired target weight values. The transparency filter circuit then inputs the generated target sound signal to a sound output module configured within the headphone device, which outputs the target sound signal.

[0129] Thus, this invention employs a method that controls a microphone array deployed on a headphone device to receive ambient sound signals. It utilizes multiple adaptive algorithms to calculate the weight values ​​for each microphone based on the identified ambient sound signals. Then, based on these weight values, the signal weights of each microphone are adjusted to determine the target reception direction. Subsequently, a target sound signal with enhanced directionality corresponding to the ambient sound signal is generated based on this target reception direction. Finally, the target sound signal is filtered and output through a sound output module. In other words, this invention solves the problem of headphone devices... Current transparency modes can only process sound signals from different directions in a single way, resulting in a limited perception of sound signals from different directions for the wearer. This invention addresses this by filtering the generated target sound signal with enhanced directionality. This overcomes the physical obstruction caused by the headphones, preventing the wearer from identifying the desired sound information from the surrounding environment. This allows the headphones to process ambient sound signals from different directions to generate a target sound signal with enhanced directionality, enabling the wearer to obtain useful information from the sound signal output by the headphones, thus improving the user experience.

[0130] In addition, the present invention also provides a sound directionality enhancement system, please refer to... Figure 3 and Figure 4 The sound directionality enhancement system of the present invention includes: a loudspeaker, a feedforward microphone, a call microphone, an analog-to-digital converter and preamplifier module, an algorithm processor, a transparency filter circuit, and a digital-to-analog converter and power amplifier module;

[0131] The feedforward microphone and the call microphone are connected to the analog-to-digital converter and preamplifier module to input the collected ambient sound signals to the analog-to-digital converter and preamplifier module;

[0132] The analog-to-digital conversion and preamplifier module is connected to the algorithm processor and is used to amplify the acquired ambient sound signal and convert it into a digital signal, and input the digital signal to the algorithm processor.

[0133] The algorithm processor is connected to the pass-through filter circuit and is used to calculate the digital signal to determine the signal weights corresponding to the feedforward microphone and the call microphone, and input each of the signal weights to the pass-through filter circuit.

[0134] The transparent filtering circuit is connected to the digital-to-analog converter and power amplifier module, and is used to generate transparent information according to the acquired signal weights, and input the transparent signal to the digital-to-analog converter and power amplifier module.

[0135] The digital-to-analog converter and power amplifier module is connected to the speaker and is used to perform digital-to-analog conversion and power amplification on the acquired transparent signal, and input the processed transparent signal to the speaker for output.

[0136] Specifically, such as Figure 3 As shown, the sound directionality enhancement system of the present invention includes: an earphone shell 1, a speaker 2, a feedforward microphone 3, a call microphone 4, an analog-to-digital converter & preamplifier module 5, an algorithm processor 6, a transparency filter circuit 7, and a digital-to-analog converter & power amplifier module 8.

[0137] The speaker 2 is deployed inside the headphone device. Meanwhile, the feedforward microphone 3 and the call microphone 4 can form a microphone array to collect ambient sound signals. The headphone shell 1 has corresponding sound inlets for the feedforward microphone 3 and the call microphone 4.

[0138] The feedforward microphone 3 and the call microphone 4 are respectively connected to the analog-to-digital converter & preamplifier module 5, so that the analog-to-digital converter & preamplifier module 5 amplifies the sound signals collected by the feedforward microphone 3 and the call microphone 4 and converts them into digital signals, which are then input to the algorithm processor 6 connected to the analog-to-digital converter & preamplifier module 5. Then, the algorithm processor 6 collects the digital signals converted by the analog-to-digital converter & preamplifier module 5, and runs various adaptive algorithms to calculate the signal weights corresponding to the feedforward microphone 3 and the call microphone 4, thereby determining the signal receiving direction according to the signal weights, and inputting the signal receiving direction to the transparency filter circuit 7 connected to the algorithm processor 6. The transparency filter circuit 7 filters the signal output by the algorithm processor 6 to generate a transparency signal, and inputs the transparency signal to the digital-to-analog converter & power amplifier module 8 connected to the transparency filter circuit 7. The digital-to-analog converter & power amplifier module 8 converts the transparency signal into digital signal and amplifies it, and then inputs it to the speaker 2, so that the speaker 2 plays the processed target sound signal.

[0139] Furthermore, the algorithm processor includes an algorithm solver and an adder, wherein the algorithm solver is connected to the adder;

[0140] The algorithm solver is used to calculate the weights of each signal from the acquired digital signal and input each signal weight into the adder;

[0141] The adder is used to determine the signal receiving direction based on the weights of each signal.

[0142] Specifically, such as Figure 4 As shown, the algorithm processor 6 includes an algorithm solver 6-2 and an adder 6-3. The algorithm solver 6-2 runs various adaptive algorithms to calculate the signal weights (i.e.,...) of the acquired digital signals. Figure 4 The signal weights W1 to W4 in 6-1 are used by adder 6-3 to sum the weighted signals to determine the signal receiving direction, and the result is input into the pass-through filter circuit 7 connected to the algorithm processor 6.

[0143] In addition, the present invention also provides a sound directionality enhancement device, please refer to Figure 5 , Figure 5 This is a schematic diagram of the functional modules involved in an embodiment of the sound directionality enhancement method of the present invention, as shown below. Figure 5 As shown, the sound directionality enhancement device of the present invention includes:

[0144] The signal receiving module 10 is used to control the microphone array configured in the headphone device to receive ambient sound signals around the wearer; wherein, the microphone array consists of multiple microphones;

[0145] The signal analysis module 20 is used to determine the signal weight of each microphone according to the ambient sound signal, and to determine the target receiving direction according to the signal weight.

[0146] The signal output module 30 is used to generate a target sound signal with target directionality enhancement corresponding to the ambient sound signal according to the target receiving direction, and output the target sound signal through the sound output module configured in the headphone device.

[0147] Furthermore, the signal analysis module 20 includes:

[0148] The algorithm acquisition unit is used to acquire preset adaptive algorithms;

[0149] The weight calculation unit is used to determine the signal weight corresponding to each microphone based on the adaptive algorithm and the ambient sound signal.

[0150] Furthermore, the signal analysis module 20 also includes:

[0151] The delay determination unit is used to determine the reception time of each of the microphones receiving the ambient sound signal, and to determine the reception delay between each microphone based on the reception time.

[0152] A direction determination unit is used to adjust the reception delay according to the signal weights to determine the target reception direction.

[0153] Furthermore, the signal analysis module 20 also includes:

[0154] A delay calculation unit is used to determine the target reception delay corresponding to each of the microphones based on the weights of the signals.

[0155] The delay adjustment unit is used to adjust the receiving delay of each microphone to the target receiving delay, and to determine the target receiving direction based on the target receiving delay.

[0156] Furthermore, the signal analysis module 20 also includes:

[0157] A feature determination unit is used to determine the directional features corresponding to the environmental sound signal based on the reception delay of each target.

[0158] An array generation unit is used to generate an array pattern corresponding to the ambient sound signal based on each of the directional features, and to determine the target receiving direction based on the array pattern.

[0159] Furthermore, the signal analysis module 20 also includes:

[0160] The first determining unit is configured to determine the signal enhancement direction and signal suppression direction corresponding to the ambient sound signal based on each of the directional features;

[0161] The second determining unit is used to generate an array pattern based on the signal enhancement direction and the signal suppression direction, and to determine the target receiving direction based on the main lobe of the array pattern.

[0162] Furthermore, the signal output module 30 includes:

[0163] A signal generation unit is used to generate an initial sound signal corresponding to the ambient sound signal according to the target receiving direction;

[0164] The signal filtering unit is used to perform frequency domain filtering on the initial sound signal through a transparency filter device configured inside the headphone device to obtain the target sound signal.

[0165] Furthermore, the present invention also provides an earphone device having a sound directionality enhancement program that can run on a processor, wherein when the earphone device executes the sound directionality enhancement program, it implements the steps of the sound directionality enhancement method as described in any of the above embodiments.

[0166] The specific embodiments of the headphone device of the present invention are basically the same as the embodiments of the sound directionality enhancement method described above, and will not be repeated here.

[0167] Furthermore, the present invention also provides a computer-readable storage medium storing a sound directionality enhancement program, which, when executed by a processor, implements the steps of the sound directionality enhancement method as described in any of the above embodiments.

[0168] The specific embodiments of the computer-readable storage medium of this invention are basically the same as the embodiments of the sound directionality enhancement method described above, and will not be repeated here.

[0169] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or system that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or system. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or system that includes that element.

[0170] The sequence numbers of the above embodiments of the present invention are for descriptive purposes only and do not represent the superiority or inferiority of the embodiments.

[0171] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, can be embodied in the form of a software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) as described above, and includes several instructions to cause a terminal device (which can be a headphone device equipped with a feedforward microphone and a transparency filter circuit; of course, the headphone device can also be a Bluetooth headset, Bluetooth microphone, or other mobile headphone device) to execute the methods described in the various embodiments of the present invention.

[0172] The above are merely preferred embodiments of the present invention and do not limit the scope of the patent. Any equivalent structural or procedural transformations made based on the description and drawings of the present invention, or direct or indirect applications in other related technical fields, are similarly included within the scope of patent protection of the present invention.

Claims

1. A method for enhancing the directionality of sound, characterized in that, The sound directionality enhancement method includes the following steps: The microphone array configured within the headphone device is controlled to receive ambient sound signals from the wearer's surroundings; wherein the microphone array consists of multiple microphones; The signal weights of each microphone are determined based on the ambient sound signals, and the target receiving direction is determined based on the signal weights. Generate a target sound signal with enhanced target directionality corresponding to the ambient sound signal according to the target receiving direction, and output the target sound signal through the sound output module configured in the headphone device; The step of determining the target receiving direction based on each of the signal weights includes: Determine the reception time of each microphone receiving the ambient sound signal, and determine the reception delay between each microphone based on the reception time; The target reception delay corresponding to each microphone is determined based on the signal weights described above. The receiving delay of each microphone is adjusted to the target receiving delay, and the directional features of the ambient sound signal are determined based on the target receiving delay. An array pattern corresponding to the ambient sound signal is generated based on each of the directional features, and the target receiving direction is determined based on the array pattern.

2. The sound directionality enhancement method as described in claim 1, characterized in that, The step of determining the signal weight corresponding to each microphone based on the ambient sound signal includes: Obtain the preset adaptive algorithms; The signal weights corresponding to each microphone are determined based on the adaptive algorithms and the ambient sound signals.

3. The sound directionality enhancement method as described in claim 1, characterized in that, The step of generating an array pattern corresponding to the ambient sound signal based on each of the directional features, and determining the target receiving direction based on the array pattern, includes: Based on the aforementioned directional characteristics, determine the signal enhancement direction and signal suppression direction corresponding to the environmental sound signal; An array pattern is generated based on the signal enhancement direction and the signal suppression direction, and the target receiving direction is determined based on the main lobe of the array pattern.

4. The sound directionality enhancement method as described in claim 1, characterized in that, The step of generating a target sound signal with enhanced target directionality corresponding to the ambient sound signal based on the target receiving direction includes: An initial sound signal corresponding to the ambient sound signal is generated according to the target receiving direction; The target sound signal is obtained by frequency domain filtering of the initial sound signal through the transparency filter device configured inside the headphone device.

5. A sound directionality enhancement system, characterized in that, The system includes: a speaker, a feedforward microphone, a call microphone, an analog-to-digital converter and preamplifier module, an algorithm processor, a pass-through filter circuit, and a digital-to-analog converter and power amplifier module. The algorithm processor includes an algorithm solver and an adder, and the algorithm solver is connected to the adder. The feedforward microphone and the call microphone are connected to the analog-to-digital converter and preamplifier module to input the collected ambient sound signals to the analog-to-digital converter and preamplifier module; The analog-to-digital conversion and preamplifier module is connected to the algorithm processor and is used to amplify the acquired ambient sound signal and convert it into a digital signal, and input the digital signal to the algorithm processor. The algorithm processor is connected to the pass-through filter circuit and is used to calculate the digital signal to determine the signal weights corresponding to the feedforward microphone and the call microphone, and input each of the signal weights to the pass-through filter circuit. The transparent filtering circuit is connected to the digital-to-analog converter and power amplifier module, and is used to generate a transparent signal according to the acquired signal weight, and input the transparent signal to the digital-to-analog converter and power amplifier module; The digital-to-analog converter and power amplifier module is connected to the speaker and is used to perform digital-to-analog conversion and power amplification on the acquired transparent signal, and input the processed transparent signal to the speaker for output; The algorithm solver is used to calculate the weights of each signal from the acquired digital signal and input each signal weight into the adder; The adder is used to determine the signal reception direction according to the signal weights. Specifically, the adder is used to determine the reception time of the ambient sound signal received by each microphone, and to determine the reception delay between each microphone according to the reception time; to determine the target reception delay corresponding to each microphone according to the signal weights; to adjust the reception delay corresponding to each microphone to the target reception delay, and to determine the directional features corresponding to the ambient sound signal according to the target reception delay; to generate an array pattern corresponding to the ambient sound signal according to the directional features, and to determine the signal reception direction according to the array pattern.

6. A sound directionality enhancement device, characterized in that, The device includes: A signal receiving module is used to control a microphone array configured within the headphone device to receive ambient sound signals from the wearer's surroundings; wherein the microphone array consists of multiple microphones; The signal analysis module is used to determine the signal weight of each microphone based on the ambient sound signal, and to determine the target receiving direction based on the signal weight. The signal output module is used to generate a target sound signal with target directionality enhancement corresponding to the ambient sound signal according to the target receiving direction, and to output the target sound signal through the sound output module configured in the headphone device; The signal analysis module further includes: The delay determination unit is used to determine the reception time of each of the microphones receiving the ambient sound signal, and to determine the reception delay between each microphone based on the reception time. A direction determination unit is used to adjust the reception delay according to the signal weights to determine the target reception direction; A delay calculation unit is used to determine the target reception delay corresponding to each of the microphones based on the weights of the signals. The delay adjustment unit is used to adjust the receiving delay of each microphone to the target receiving delay, and to determine the target receiving direction based on the target receiving delay. A feature determination unit is used to determine the directional features corresponding to the environmental sound signal based on the reception delay of each target. An array generation unit is used to generate an array pattern corresponding to the ambient sound signal based on each of the directional features, and to determine the target receiving direction based on the array pattern.

7. A headphone device, characterized in that, The headphone device includes: a memory, a processor, and a sound directionality enhancement program stored in the memory and executable on the processor, wherein the sound directionality enhancement program, when executed by the processor, implements the steps of the sound directionality enhancement method as described in any one of claims 1 to 4.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a sound directionality enhancement program, which, when executed by a processor, implements the steps of the sound directionality enhancement method as described in any one of claims 1 to 4.

Images