Headset with loudspeaker and signal processing method thereof

Abstract

The application discloses a headset with a loudspeaker and a signal processing method thereof. The headset with the loudspeaker comprises a combination of a loudspeaker assembly and a first sound collecting assembly, and provides a noise reduction effect for a surrounding environment through the signal processing method of the headset with the loudspeaker. The loudspeaker assembly is provided with a signal processing module. The signal processing module is calibrated by a sound transmission function to solve the playing influence between the loudspeaker assembly and human ears caused by a sound transmission distance, that is, the signal emitted by the loudspeaker assembly for canceling environmental noise is calibrated. Therefore, the attenuation problem that the sound effect received by human ears is affected due to the sound transmission distance of the open loudspeaker can be effectively solved.

Description

Technical Field

[0001] This application relates to the technical field of loudspeakers, and more particularly to a head-mounted device with a loudspeaker and a signal processing method thereof. Background Technology

[0002] Currently, most in-ear or over-ear headphones feature active noise cancellation, which automatically activates when the device is worn. External feedback and inner ear pickups capture ambient and in-ear noise, using a speaker to emit an inverse sound signal to cancel out the audible noise. These devices create a near-sealed space between the speaker and the ear, with a sound field resembling a pressure field. However, open-back headphones (not worn directly on the ear like in-ear or over-ear headphones) do not have a sealed sound field between the speaker and ear. Therefore, the sound input from the speaker to the ear changes due to the distance between them. Furthermore, unlike in-ear or over-ear headphones, they cannot physically isolate external noise, making the noise impact on the ear and speaker more significant. This explains why the noise cancellation function of existing open-back headphones is affected by external factors. Summary of the Invention

[0003] This application provides a head-mounted device with a speaker and a signal processing method thereof, which can solve the problem that the noise reduction function of existing open speakers is affected by external factors.

[0004] To solve the above-mentioned technical problems, this application is implemented as follows:

[0005] A head-mounted device with a speaker is provided, comprising: a head-mounted assembly, a first sound-receiving assembly, and a speaker assembly. The first sound-receiving assembly is disposed on the head-mounted assembly and located adjacent to a human ear; and the speaker assembly is disposed on the head-mounted assembly and located to one side of the first sound-receiving assembly; wherein the first sound-receiving assembly is used to collect ambient sound near the human ear, provide the ambient sound to the speaker assembly for signal processing, and output the signal-processed ambient sound to the human ear by the speaker assembly.

[0006] In one embodiment, the speaker component further includes a signal processing module and an output module. The first receiver component is connected to the signal processing module, and the signal processing module is connected to the output module. The first receiver component collects the ambient sound and converts it into a captured signal. The signal processing module processes the captured signal, and the processed captured signal is played out by the output module.

[0007] In one embodiment, the signal processing module includes a cancellation unit, a calibration unit, and an inverting unit. The captured signal is processed by the cancellation unit to cancel the signal, the captured signal after cancellation is processed by the calibration unit to calibrate the signal, the captured signal after calibration is processed by the inverting unit to invert the signal, and the captured signal after inversion is output to the human ear by the output module.

[0008] In one embodiment, an audio module and a noise cancellation module are further included. One end of the audio module is connected to the output module, and one end of the noise cancellation module is connected to the audio module. The other end of the noise cancellation module is connected between the first sound receiving component and the signal processing module. The audio module transmits an audio signal to the output module, and the output module outputs audio sound in the direction of the human ear. The first sound receiving component receives the ambient sound and generates the captured signal. After the noise cancellation module eliminates the audio signal in the captured signal, the captured signal with the audio signal eliminated is transmitted to the signal processing module.

[0009] In one embodiment, the signal processing module includes a cancellation unit, a calibration unit, and an inverting unit. The captured signal that cancels the audio signal is processed by the cancellation unit, the captured signal after cancellation is processed by the calibration unit, the captured signal after calibration is processed by the inverting unit, and the captured signal after inverting is processed by the inverting unit. The captured signal after inverting and the audio signal emitted by the audio module are output to the human ear by the output module.

[0010] In one embodiment, the signal processing module further includes a gain adjustment unit for adjusting the gain coefficient of the captured signal after the inverted signal to adjust the noise reduction level.

[0011] In one embodiment, the speaker assembly further includes a control module that controls the cancellation unit, the calibration unit, and / or the gain adjustment unit within the signal processing module.

[0012] In one embodiment, the ambient sound includes a first ambient sound or a combination of a first ambient sound and an audio sound.

[0013] In one embodiment, a second sound-receiving component is further included, which is disposed on the head-mounted component and located on the side of the first sound-receiving component away from the human ear. The second sound-receiving component is used to collect a second ambient sound away from the human ear.

[0014] A signal processing method for a head-mounted device with a speaker is provided, comprising the steps of: collecting a first ambient sound near the ear through a first sound-receiving component, and converting the first ambient sound into a first captured signal through the first sound-receiving component; transmitting the first captured signal to a signal processing module within the speaker component; sequentially performing transfer function calibration signal processing and phase inversion signal processing on the first captured signal through the signal processing module; and providing the processed first captured signal to the output module of the speaker component for output in the direction of the ear.

[0015] In one embodiment, before the step of transmitting the first captured signal to the signal processing module within the speaker assembly, a second sound receiving component is further included. The second sound receiving component collects a second ambient sound that is far from the human ear, and the second sound receiving component converts the second ambient sound into a second captured signal, and transmits the second captured signal to the signal processing module within the speaker assembly.

[0016] In one embodiment, in the step of sequentially performing transfer function calibration signal processing and inversion signal processing on the first captured signal by the signal processing module, the transfer function calibration signal processing includes time-domain signal processing, wherein the transfer function in the frequency domain is inversely Fourier transformed into the transfer function in the time domain, the first captured signal in the time domain is convolved with the transfer function in the time domain to obtain the first captured signal in the time domain after calibration signal processing, and then the first captured signal in the time domain after calibration signal processing is inverted signal processing.

[0017] In one embodiment, in the step of sequentially performing transfer function calibration signal processing and inversion signal processing on the first captured signal through the signal processing module, the transfer function calibration signal processing includes frequency domain signal processing, wherein the first captured signal in the time domain is Fourier transformed into the first captured signal in the frequency domain, the first captured signal in the frequency domain is multiplied by the transfer function in the frequency domain to obtain the first captured signal after calibration signal processing in the frequency domain, the first captured signal after calibration signal processing in the frequency domain is then inversely Fourier transformed into the first captured signal after calibration signal processing in the time domain, and the first captured signal after calibration signal processing in the time domain is then inverted.

[0018] In one embodiment, the formula for the inverse Fourier transform is:

[0019]

[0020] In one embodiment, the formula for the Fourier transform is:

[0021] In one embodiment, the step of sequentially performing transfer function calibration signal processing and inversion signal processing on the first captured signal through the signal processing module further includes adjusting the gain coefficient to adjust the noise reduction level. The gain coefficient is a linear amplification or linear reduction factor, which linearly amplifies or reduces the first captured signal after inversion.

[0022] A signal processing method for a head-mounted device with a speaker is provided, comprising the steps of: emitting an audio sound to a human ear through the output module of the speaker assembly; collecting the audio sound and a first ambient sound near the human ear through a first sound receiving component, and converting the audio sound and the first ambient sound into a first captured signal through the first sound receiving component; eliminating the audio signal in the first captured signal; sending the first captured signal with the audio signal eliminated to a signal processing module within the speaker assembly; sequentially performing elimination signal processing, transfer function calibration signal processing, and phase inversion signal processing on the first captured signal with the audio signal eliminated through the signal processing module; and providing the processed first captured signal to the output module of the speaker assembly for output in the direction of the human ear.

[0023] In one embodiment, before the step of transmitting the first captured signal to the signal processing module within the speaker assembly, a second sound receiving component is further included. The second sound receiving component collects a second ambient sound that is far from the human ear, and the second sound receiving component converts the second ambient sound into a second captured signal, and transmits the second captured signal to the signal processing module within the speaker assembly.

[0024] In one embodiment, in the step of sequentially performing signal elimination processing, transfer function calibration processing, and phase inversion processing on the first captured signal by the signal processing module, the transfer function calibration processing includes time-domain signal processing, wherein the transfer function in the frequency domain is inversely Fourier transformed into the transfer function in the time domain, the first captured signal in the time domain is convolved with the transfer function in the time domain to obtain the first captured signal in the time domain after calibration signal processing, and then the first captured signal in the time domain after calibration signal processing is subjected to phase inversion processing.

[0025] In one embodiment, in the step of sequentially performing signal elimination processing, transfer function calibration processing, and phase inversion processing on the first captured signal through the signal processing module, the transfer function calibration processing includes frequency domain signal processing, wherein the first captured signal in the time domain is Fourier transformed into the first captured signal in the frequency domain, the first captured signal in the frequency domain is multiplied by the transfer function in the frequency domain to obtain the first captured signal after calibration processing in the frequency domain, the first captured signal after calibration processing in the frequency domain is then inversely Fourier transformed into the first captured signal after calibration processing in the time domain, and the first captured signal after calibration processing in the time domain is then phase inverted.

[0026] In one embodiment, the formula for the inverse Fourier transform is:

[0027]

[0028] In one embodiment, the formula for the Fourier transform is:

[0029] In one embodiment, the step of sequentially performing signal elimination processing, transfer function calibration processing, and phase inversion processing on the first captured signal through the signal processing module further includes adjusting the gain coefficient to adjust the noise reduction level. The gain coefficient is a linear amplification or linear reduction factor, which linearly amplifies or reduces the first captured signal after phase inversion processing.

[0030] An analysis system for a head-mounted device with a speaker is provided, comprising: a measurement component having an artificial head and a sound receiver disposed on the artificial head, the head-mounted device with a speaker assembled on the artificial head, and a speaker assembly corresponding to the sound receiver; a sound output module electrically connected to the speaker assembly; a sound receiving module electrically connected to the sound receiver; and a detection component electrically connected to the sound output module and the sound receiving module, respectively; wherein the detection component emits a first sound signal, the first sound signal is transmitted to the speaker assembly through the sound output module, the speaker assembly emits a first sound, the first sound is transmitted through the air and becomes a second sound, the sound receiver receives the first sound and converts it into a second sound signal, the second sound signal is transmitted to the detection component through the sound receiving module, and the detection component calculates the transfer function relationship between the first sound signal and the second sound signal.

[0031] In one embodiment, the speaker assembly emits the first sound at a frequency of 20 Hz to 20 kHz.

[0032] In one embodiment, the sound output module further includes a sound output unit and a power amplification unit, the sound output unit being connected to the power amplification unit, and the first sound signal being transmitted to the speaker assembly sequentially through the sound output unit and the power amplification unit.

[0033] In one embodiment, the detection component includes testing software, audio editing software, or audio analysis program.

[0034] This application provides a head-mounted device with a speaker and its signal processing method and analysis system. The head-mounted device with a speaker includes a combination of a speaker component and a first receiver component. The signal processing method of the head-mounted device with a speaker provides noise reduction for the surrounding environment. The speaker component has a signal processing module that uses a sound transfer function to calibrate and resolve the playback effects caused by the sound transmission distance between the speaker component and the human ear. Specifically, it calibrates the signal emitted by the speaker component to cancel out environmental noise, thus effectively solving the attenuation problem of the sound quality received by the human ear due to the sound transmission distance of open speakers. Furthermore, the analysis system of the head-mounted device with a speaker measures the actual change in sound from the output sound of the speaker component to the received sound of the first receiver component to calculate the value of the speaker-to-ear transfer function. Attached Figure Description

[0035] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0036] Figure 1 This is a perspective view of the head-mounted device with a speaker according to this application.

[0037] Figure 2 This is a diagram illustrating the usage state of the head-mounted device with a speaker according to this application.

[0038] Figure 3 This is a structural connection diagram of a head-mounted device with a speaker according to the first embodiment of this application.

[0039] Figure 4 This is a schematic diagram of the signal processing module in the first embodiment of this application.

[0040] Figure 5 This is a structural connection diagram of a head-mounted device with a speaker according to the second embodiment of this application.

[0041] Figure 6 This is a schematic diagram of the signal processing module according to the second embodiment of this application.

[0042] Figure 7 This is a structural connection diagram of a head-mounted device with a speaker according to the third embodiment of this application.

[0043] Figure 8 This is a schematic diagram of the signal processing module according to the third embodiment of this application.

[0044] Figure 9 This is a step diagram of the signal processing method of a head-mounted device with a speaker according to the first embodiment of this application.

[0045] Figure 10 This is a step diagram of the signal processing method of a head-mounted device with a speaker according to the second embodiment of this application.

[0046] Figure 11 This is a schematic diagram of the analysis system of the head-mounted device with a speaker according to this application.

[0047] The following explanation is based on the accompanying diagram:

[0048] 1: Headset with loudspeaker; 11: Headset assembly; 13: Speaker assembly; 131: Signal processing module; 1311: Cancellation unit; 1312: Calibration unit; 1313: Phase inversion unit; 1314: Gain adjustment unit; 133: Audio module; 135: Output module; 137: Control module; 139: Noise cancellation module; 15: First sound receiving assembly; 17: Second sound receiving assembly; 2: Human ear; 31: Measurement assembly; 311: Artificial head; 312: Sound receiver; 32: Sound output module; 321: Sound output unit; 322: Power amplification unit; 33: Sound receiving module; 34: Detection assembly; A: Ambient sound; A1: First ambient sound; A2: Audio sound; A3: Second ambient sound. Detailed Implementation

[0049] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0050] Please see Figure 1 and Figure 2 , Figure 1 This is a perspective view of the head-mounted device with a speaker according to this application. Figure 2The diagram shows the usage status of the device. As shown in the figure, this embodiment provides a head-mounted device 1 with a speaker, including: a head-mounted component 11, a speaker component 13, and a first sound receiving component 15. The first sound receiving component 15 is disposed on the head-mounted component 11 and is located near the ear 2, that is, the sound receiving port of the first sound receiving component 15 is arranged facing the ear 2. The speaker component 13 is disposed on the head-mounted component 11 and is located to one side of the first sound receiving component 15, with the sound output port of the speaker component 13 facing the ear 2. The first sound receiving component 15 is used to collect ambient sound A near the ear 2, provide ambient sound A to the speaker component 13 for signal processing, and output the signal-processed ambient sound A to the ear 2 by the speaker component 13. The ambient sound A includes a first ambient sound A1 or a combination of the first ambient sound A1 and an audio sound A2.

[0051] Please refer to the following: Figure 3 and Figure 4 , Figure 3 This is a structural connection diagram of a head-mounted device with a speaker according to the first embodiment of this application. Figure 4 This is a schematic diagram of the signal processing module steps according to the first embodiment of this application. As shown in the figure, in this embodiment, the speaker assembly 13 further includes a signal processing module 131 and an output module 135. The first receiver assembly 15 is connected to the signal processing module 131, and the signal processing module 131 is connected to the output module 135. The first receiver assembly 15 collects ambient sound A and converts it into an acquired signal. The signal processing module 131 processes the acquired signal, and the processed acquired signal is played and output by the output module 135.

[0052] In this embodiment, the signal processing module 131 includes a cancellation unit 1311, a calibration unit 1312, and an inverting unit 1313. The signal processing module 131 corrects the captured signal of the ambient sound A collected by the first sound receiving component 15 through the aforementioned units. Furthermore, the captured signal can be processed by the cancellation unit 1311 to cancel specific sounds in the ambient sound A, such as car sounds, human voices, rain sounds, or conversation sounds, etc., eliminating different specific sound signals. The specific sound signals to be canceled are the captured signals that the user needs to retain. This embodiment allows the user to choose whether or not to use the cancellation unit 1311 according to their needs.

[0053] As described above, the acquired signal after signal cancellation undergoes calibration signal processing by calibration unit 1312. Calibration unit 1312 calibrates the acquired sound signal using a transfer function to determine the transmission distance of the sound output from speaker assembly 13 to human ear 2. In other words, the sound emitted by speaker assembly 13 may become less focused and weakened after traveling a certain distance. Therefore, calibration unit 1312 needs to calculate the change in the sound received by human ear 2 from the sound emitted by speaker assembly 13 (i.e., the sound received by the first receiving component 15) and make adjustments and compensations to ensure that the sound received by human ear 2 after the transmission distance changes closely matches the user's expectation.

[0054] The acquired signal after calibration is processed by the inverting unit 1313, which inverts the sound wave fluctuations of the acquired signal to provide a completely opposite waveform. In other words, if the sound wave of the acquired signal before inversion is combined with the sound wave of the acquired signal after inversion, they can cancel each other out to achieve noise reduction. Finally, the acquired signal after inversion is output to the human ear 2 through the output module 135.

[0055] Furthermore, the speaker assembly 13 includes an audio module 133 and a noise-canceling module 139. One end of the audio module 133 is connected to the output module 135, and one end of the noise-canceling module 139 is connected to the audio module 133. The other end of the noise-canceling module 139 is connected between the first receiver assembly 15 and the signal processing module 131. The audio module 133 transmits an audio signal to the output module 135, which then outputs the audio sound towards the ear 2. The first receiver assembly 15 receives ambient sound and generates a capture signal, where the ambient sound is a mixture of audio sound and surrounding sounds. Simultaneously, the audio module 133 also cancels the audio signal through the noise-canceling module 139. When the first receiver assembly 15 transmits the captured signal to the signal processing module 131, the noise-canceling module 139 first cancels the audio signal in the captured signal before transmitting the audio-canceling captured signal to the signal processing module 131. In addition, the captured signal that cancels the audio signal can also be processed by the signal processing module 131 in sequence to cancel the signal, calibrate the signal, and invert the signal. Finally, the captured signal after inverting the signal and the audio signal emitted by the audio module 133 are output to the human ear 2 by the output module 135.

[0056] Please refer to the following: Figure 5 and Figure 6 , Figure 5 This is a structural connection diagram of a head-mounted device with a speaker according to the second embodiment of this application. Figure 6This is a schematic diagram of the signal processing module in the second embodiment. As shown in the figure, this embodiment further includes a second sound receiving component 17 compared to the first embodiment. In this embodiment, the second sound receiving component 17 is disposed on the head-mounted component 11, and the second sound receiving component 17 is located on the side of the first sound receiving component 15 away from the ear 2. The second sound receiving component 17 is used to collect a second ambient sound A3 that is away from the ear 2. The second ambient sound A3 refers to an ambient sound that is relatively large in the surrounding area away from the ear 2. Therefore, the signal processing module 131 will process the captured signals received by the first sound receiving component 15 and / or the second sound receiving component 17, and perform the same steps as in the first embodiment. Therefore, it will not be described again. In this way, when the speaker component 13 plays the sound over a wide area of ​​the surrounding environment, it can also produce a certain degree of noise reduction effect on the sound played in the surrounding area.

[0057] Please refer to the following: Figure 7 and Figure 8 , Figure 7 This is a structural connection diagram of a head-mounted device with a speaker according to the third embodiment of this application. Figure 8 This is a schematic diagram of the signal processing module in the third embodiment. As shown in the figure, this embodiment, compared to the first embodiment, further includes a control module 137 and a gain adjustment unit 1314 of the signal processing module 131. The control module 137 controls the cancellation unit 1311, the calibration unit 1312, and / or the gain adjustment unit 1314 within the signal processing module 131. The control module 137 can select various cancellation methods, such as selecting the sound to be cancelled by the cancellation unit 1311, selecting all sound cancellation, or selecting no sound cancellation. Furthermore, the control module 137 controls the gain adjustment unit 1314 to adjust the gain coefficient of the acquired signal after the inverted signal, adjusting the noise reduction level by using a linear amplification or linear reduction factor for the gain coefficient.

[0058] Please refer to the following: Figure 9 This is a step diagram of a signal processing method for a head-mounted device with a speaker according to the first embodiment of this application. As shown in the figure, this embodiment provides a signal processing method for a head-mounted device 1 with a speaker, the steps of which include:

[0059] Step S11: Collect the first ambient sound A1 near the human ear 2 through the first sound receiving component 15, and convert the first ambient sound A1 into a first acquisition signal through the first sound receiving component 15.

[0060] Step S12: Send the first acquired signal to the signal processing module 131 in the speaker assembly 13.

[0061] Step S13: The first acquired signal is sequentially processed by the signal processing module 131 to perform transfer function calibration signal processing and phase inversion signal processing. The transfer function calibration signal processing by the signal processing module 131 includes both time-domain and frequency-domain signal processing.

[0062] When the transfer function calibration signal processing is performed through time-domain signal processing, the transfer function in the frequency domain is transformed into the transfer function in the time domain by inverse Fourier transform. The first captured signal in the time domain is then convolved with the transfer function in the time domain to obtain the first captured signal in the time domain after calibration signal processing.

[0063] When the transfer function calibration signal processing is performed through time-domain signal processing, the first captured signal in the time domain is Fourier transformed into the first captured signal in the frequency domain. The first captured signal in the frequency domain is multiplied by the transfer function in the frequency domain to obtain the first captured signal after calibration signal processing in the frequency domain. Then, the first captured signal after calibration signal processing in the frequency domain is inversely Fourier transformed into the first captured signal after calibration signal processing in the time domain.

[0064] The formula for the inverse Fourier transform is:

[0065] The formula for the Fourier transform is:

[0066] Regardless of whether the above-described time-domain or frequency-domain signal processing is performed, the first captured signal in the time domain after calibration signal processing is then subjected to phase inversion signal processing. Furthermore, the transfer function in this embodiment is a value calculated by the analysis system after detection; the transfer function is a correction value for the decrease in sound at the human ear 2 (i.e., the first receiver component 15) from the sound emitted by the speaker assembly 13. Please refer to the description of the subsequent embodiments.

[0067] Step S14: Provide the processed first captured signal to the output module 135 of the speaker assembly 13 for output in the direction of human ear 2.

[0068] Please refer to the following: Figure 2In this embodiment, the user wears a head-mounted device 1 equipped with a speaker. When the head-mounted device 1 is operated for noise reduction, the first sound receiving component 15 receives ambient sounds near the human ear 2, i.e., the human ear 2 can receive ambient noise. The ambient sounds of the first sound receiving component 15 are converted into a first captured signal and sent to the signal processing module 131 of the speaker component 13. The signal processing module 131 processes the first captured signal and performs transfer function calibration signal processing on the first captured signal so that the sound output from the output module 135 of the speaker component 13 and reaching the human ear 2 is approximately the same. The first captured signal after the transfer function calibration signal processing is then inverted. The sound waves of the inverted first captured signal output from the output module 135 of the speaker component 13 and reaching the human ear 2 are completely opposite. In this way, the ambient sounds cancel each other out, forming a noise reduction effect on the ambient sounds that the human ear 2 can receive.

[0069] Furthermore, before the step of transmitting the first acquired signal to the signal processing module 131 within the speaker assembly 13, a second receiver assembly 17 is included. The second receiver assembly 17 collects a second ambient sound A3 that is far from the human ear 2, and converts the second ambient sound A3 into a second acquired signal, which is then transmitted to the signal processing module 131 within the speaker assembly 13. The signal processing module 131 processes the sound in the same way, so that when the speaker assembly 13 plays the sound over a wide area, the sound played by the speaker assembly 13 can also produce a certain degree of noise reduction effect in the surrounding space.

[0070] Furthermore, in the step of sequentially performing transfer function calibration signal processing and phase inversion signal processing on the first acquired signal through the signal processing module 131, the control module 137 further adjusts the gain coefficient of the gain adjustment unit 1314 to further adjust the noise reduction level. The gain coefficient is a linear amplification or linear reduction factor, which linearly amplifies or reduces the first acquired signal after phase inversion. Adjusting the amplification and noise reduction effect in this way reduces the ambient sound received by the human ear 2. Adjusting the reduction and noise reduction effect amplifies the ambient sound received by the human ear 2. The above can be adjusted according to the user's needs.

[0071] Please refer to the following: Figure 10 This is a step diagram of a signal processing method for a head-mounted device with a speaker according to the second embodiment of this application. As shown in the figure, this embodiment provides a signal processing method for a head-mounted device 1 with a speaker, the steps of which include:

[0072] Step S21: The speaker assembly 13 outputs an audio signal to the human ear. The audio signal is the sound emitted by the audio module 133 to the output module 135.

[0073] Step S22: The first sound receiving component 15 collects the audio sound A2 and the first ambient sound A1 from the nearby human ear 2, and the first sound receiving component 15 converts the audio sound A2 and the first ambient sound A1 into a first acquisition signal.

[0074] Step S23: Eliminate the audio signal in the first captured signal. Simultaneously, the audio module 133 sends an audio signal to the mute module 139, causing the mute module 139 to perform mute processing on the first captured signal.

[0075] Step S24: Send the first acquisition signal for canceling the audio signal to the signal processing module 131 in the speaker assembly 13.

[0076] Step S25: The signal processing module 131 sequentially performs specific sound elimination processing, transfer function calibration signal processing, and phase inversion signal processing on the first captured signal of the audio signal to be eliminated. First, the elimination unit 1311 of the signal processing module 131 eliminates the sound signal to be retained, i.e., eliminates specific sound signals, such as car sounds, human voices, rain sounds, or conversation sounds, etc. The specific sound signal to be eliminated is the captured signal of the first ambient sound A1 that the user needs to retain. Next, the transfer function calibration signal processing of the calibration unit 1312 of the signal processing module 131 includes both time-domain and frequency-domain signal processing methods, which are the same as in the first embodiment and will not be described again. Finally, phase inversion signal processing is performed by the phase inversion unit 1313 of the signal processing module 131.

[0077] Step S26: Provide the processed first captured signal to the output module 135 of the speaker assembly 13 for output.

[0078] Furthermore, the signal processing method of the head-mounted device with a speaker in this embodiment also includes the processing method of the control module 137 of the second sound receiving component 17 and the sound-speaking component 13 in the first embodiment, so it will not be described again here.

[0079] Please refer to the following: Figure 11This is a schematic diagram of the analysis system for a head-mounted device with a speaker according to this application. As shown in the figure, this embodiment provides an analysis system for a head-mounted device with a speaker, including: a measurement component 31, a sound output module 32, a sound receiving module 33, and a detection component 34. The measurement component 31 has an artificial head 311 and a sound receiver 312, the sound receiver 312 being disposed on the artificial head 311 (i.e., at the corresponding position of the human ear), the head-mounted device 1 with a speaker is assembled on the artificial head 311, and the speaker component 13 corresponds to the sound receiver 312. The sound output module 32 is electrically connected to the speaker component 13. The sound receiving module 33 is electrically connected to the sound receiver 312. The detection component 34 is electrically connected to the sound output module 32 and the sound receiving module 33 respectively. The detection component 34 emits a first sound signal, which is transmitted to the speaker component 13 via the sound output module 32. The speaker component 13 emits the first sound, which is transmitted towards the sound receiver 312. The first sound is transmitted through the air and becomes a second sound. The sound receiver 312 receives the second sound and converts it into a second sound signal. The second sound signal is transmitted to the detection component 34 via the sound receiving module 33. The detection component 34 calculates the transfer function relationship between the first and second sound signals. That is, the second sound signal can be obtained from the first sound signal through a simple calculation of the transfer function. The sound output module 32 further includes a sound output unit 321 and a power amplification unit 322. The sound output unit 321 is connected to the power amplification unit 322. The first sound signal is transmitted to the speaker component 13 sequentially through the sound output unit 321 and the power amplification unit 322.

[0080] The transfer function value is calculated using the above method and applied to the transfer function calibration signal processing module 131. The transfer function value is calculated using both time-domain and frequency-domain signal processing. In this embodiment, the transfer function value may be adjusted due to changes in the position or direction of the speaker assembly 13, the first receiver assembly 15, or the second receiver assembly 17. The transfer function value can be calculated and adjusted according to the user's needs. In the detection and analysis method of the above analysis system, the speaker assembly 13 emits a detection sound from 20Hz to 20kHz. The detection component 34 includes testing software, audio editing software, or audio analysis programs for signal transmission and analysis. Testing software may include SoundCheck or APx555; audio editing software may include Audition or Cooledit; and audio analysis programs may include Matlab or C++.

[0081] In summary, this application provides a head-mounted device with a speaker and its signal processing method and analysis system. The head-mounted device with a speaker includes a combination of a speaker component and a first receiver component. The signal processing method of the head-mounted device with a speaker provides noise reduction for the surrounding environment. The speaker component has a signal processing module that uses a sound transfer function to calibrate and resolve the playback effects caused by the sound transmission distance between the speaker component and the human ear. Specifically, it calibrates the signal emitted by the speaker component to cancel out environmental noise, thus effectively solving the attenuation problem of the sound quality received by the human ear due to the sound transmission distance of open speakers. Furthermore, the analysis system of the head-mounted device with a speaker measures the actual change in sound from the output sound of the speaker component to the received sound of the first receiver component to calculate the value of the speaker-to-ear transfer function.

[0082] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element.

[0083] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms fall within the scope of protection of this application.

Claims

1. A head-mounted device with a speaker, characterized in that, include: Headset components; A first microphone is disposed on the headband assembly, and the first microphone is located near the ear; as well as A speaker assembly is disposed on the head-mounted assembly, and the speaker assembly is located on one side of the first receiver assembly; The first sound receiving component collects ambient sounds near the human ear. It converts these ambient sounds into a captured signal and provides this captured signal to the speaker component for signal processing. The processed captured signal is then output to the human ear by the speaker component. The sound output from the speaker component travels a distance to the human ear, and this distance affects the sound's variation. The speaker component processes these sound variations using a transfer function calibration. This transfer function calibration includes time-domain signal processing or frequency-domain signal processing. The time-domain signal processing involves transforming the frequency-domain transfer function into a time-domain transfer function using an inverse Fourier transform. The frequency domain signal processing involves convolving the acquired signal in the time domain with the transfer function in the time domain to obtain the acquired signal in the time domain after calibration signal processing, and then performing inversion signal processing on the acquired signal in the time domain after calibration signal processing. The frequency domain signal processing involves Fourier transforming the acquired signal in the time domain into the acquired signal in the frequency domain, multiplying the acquired signal in the frequency domain with the transfer function in the frequency domain to obtain the acquired signal in the frequency domain after calibration signal processing, then performing inverse Fourier transform on the acquired signal in the frequency domain into the acquired signal in the time domain after calibration signal processing, and finally performing inversion signal processing on the acquired signal in the time domain after calibration signal processing.

2. The head-mounted device with a speaker as described in claim 1, characterized in that, The speaker assembly further includes a signal processing module and an output module. The first receiver assembly is connected to the signal processing module, and the signal processing module is connected to the output module. The signal processing module processes the captured signal, and the processed captured signal is played and output by the output module.

3. The head-mounted device with a speaker as described in claim 2, characterized in that, The signal processing module includes a cancellation unit, a calibration unit, and an inversion unit. The captured signal undergoes cancellation signal processing through the cancellation unit. The captured signal after cancellation signal processing undergoes calibration signal processing through the calibration unit. The captured signal after calibration signal processing undergoes inversion signal processing through the inversion unit. The captured signal after inversion signal processing is output to the human ear by the output module.

4. The head-mounted device with a speaker as described in claim 2, characterized in that, It further includes an audio module and a noise reduction module. One end of the audio module is connected to the output module, and one end of the noise reduction module is connected to the audio module. The other end of the noise reduction module is connected between the first sound receiving component and the signal processing module. The audio module transmits an audio signal to the output module, and the output module outputs audio sound in the direction of the human ear. The first sound receiving component receives the ambient sound and generates the captured signal. After the noise reduction module eliminates the audio signal in the captured signal, the captured signal with the audio signal eliminated is transmitted to the signal processing module.

5. The head-mounted device with a speaker as described in claim 4, characterized in that, The signal processing module includes a cancellation unit, a calibration unit, and an inversion unit. The captured signal that cancels the audio signal is processed by the cancellation unit. The captured signal after cancellation is processed by the calibration unit. The captured signal after calibration is processed by the inversion unit. The captured signal after inversion is processed by the inversion unit. The captured signal after inversion and the audio signal emitted by the audio module are output to the human ear by the output module.

6. The head-mounted device with a speaker as described in claim 3 or 5, characterized in that, The signal processing module further includes a gain adjustment unit, which is used to adjust the gain coefficient of the captured signal after inverted signal processing to adjust the noise reduction level.

7. The head-mounted device with a speaker as claimed in claim 6, characterized in that, The speaker assembly further includes a control module, which controls the cancellation unit, the calibration unit, and / or the gain adjustment unit within the signal processing module.

8. The head-mounted device with a speaker as claimed in claim 1, characterized in that, The ambient sound includes a first ambient sound or a combination of the first ambient sound and audio sound.

9. The head-mounted device with a speaker as claimed in claim 1, characterized in that, It also includes a second sound-receiving component, which is disposed on the head-mounted component and located on the side of the first sound-receiving component away from the human ear. The second sound-receiving component is used to collect second ambient sounds that are away from the human ear.

10. The head-mounted device with a speaker as claimed in claim 1, characterized in that, The formula for the inverse Fourier transform is:

11. The head-mounted device with a speaker as claimed in claim 1, characterized in that, The formula for Fourier transform is:

12. A signal processing method for a head-mounted device with a speaker as described in claim 1, characterized in that, The steps include: The first sound receiving component collects a first ambient sound near the human ear, and the first sound receiving component converts the first ambient sound into a first acquisition signal; The first captured signal is transmitted to the signal processing module within the speaker assembly; The signal processing module sequentially performs transfer function calibration signal processing and phase inversion signal processing on the first captured signal. The transfer function calibration signal processing involves the following steps: the sound output from the speaker component travels a distance to the human ear, and this distance affects the sound change. The speaker component calibrates the sound change using a transfer function. This transfer function calibration signal processing includes time-domain signal processing or frequency-domain signal processing. The time-domain signal processing involves inverse Fourier transforming the transfer function in the frequency domain into the transfer function in the time domain, and convolving the first captured signal in the time domain with the transfer function in the time domain to obtain the calibration signal. The first captured signal in the time domain after processing is then inverted; the frequency domain signal processing involves Fourier transforming the first captured signal in the time domain into the first captured signal in the frequency domain, multiplying the first captured signal in the frequency domain with the transfer function in the frequency domain to obtain the first captured signal after calibration signal processing in the frequency domain, then inversely transforming the first captured signal after calibration signal processing in the frequency domain into the first captured signal after calibration signal processing in the time domain, and finally inverting the first captured signal after calibration signal processing in the time domain; and... The processed first captured signal is provided to the output module of the speaker component to output the signal in the direction of the human ear.

13. The signal processing method as described in claim 12, characterized in that, Before the step of transmitting the first captured signal to the signal processing module within the speaker assembly, the system further includes a second sound receiving component. The second sound receiving component collects a second ambient sound that is far from the human ear. The second sound receiving component converts the second ambient sound into a second captured signal and transmits the second captured signal to the signal processing module within the speaker assembly.

14. The signal processing method as described in claim 12, characterized in that, The formula for the inverse Fourier transform is:

15. The signal processing method as described in claim 12, characterized in that, The formula for Fourier transform is:

16. The signal processing method as described in claim 12, characterized in that, After performing transfer function calibration signal processing and phase inversion signal processing sequentially on the first captured signal through the signal processing module, the method further includes adjusting the gain coefficient to adjust the noise reduction level. The gain coefficient is a linear amplification or linear reduction factor, which linearly amplifies or reduces the first captured signal after phase inversion processing.

17. A signal processing method for a head-mounted device with a speaker as described in claim 1, characterized in that, The steps include: The speaker assembly outputs audio sound to the human ear; The first sound receiving component collects the audio sound and the first ambient sound near the human ear, and the first sound receiving component converts the audio sound and the first ambient sound into a first acquisition signal. Eliminate the audio signal within the first captured signal; The first captured signal, which eliminates the audio signal, is sent to the signal processing module within the speaker assembly; The signal processing module sequentially performs cancellation signal processing, transfer function calibration signal processing, and phase inversion signal processing on the first captured signal used to eliminate the audio signal. The transfer function calibration signal processing involves the following steps: the sound output from the speaker component travels a distance to the human ear, and this distance affects the sound change. The speaker component calibrates the sound change using a transfer function. This transfer function calibration signal processing includes time-domain signal processing or frequency-domain signal processing. The time-domain signal processing involves inverse Fourier transforming the transfer function in the frequency domain into the transfer function in the time domain, and then performing a time-domain comparison between the first captured signal and the time-domain transfer function. The first extracted signal in the time domain after calibration signal processing is obtained by convolution, and then the first extracted signal in the time domain after calibration signal processing is inverted; the frequency domain signal processing involves transforming the first extracted signal in the time domain into the first extracted signal in the frequency domain via Fourier transform, multiplying the first extracted signal in the frequency domain with the transfer function in the frequency domain to obtain the first extracted signal after calibration signal processing in the frequency domain, then performing an inverse Fourier transform on the first extracted signal in the frequency domain to obtain the first extracted signal after calibration signal processing in the time domain, and finally inverting the first extracted signal in the time domain after calibration signal processing; and The processed first captured signal is provided to the output module of the speaker assembly for output in the direction of the human ear.

18. The signal processing method as described in claim 17, characterized in that, Before the step of transmitting the first captured signal to the signal processing module within the speaker assembly, the system further includes a second sound receiving component. The second sound receiving component collects a second ambient sound that is far from the human ear. The second sound receiving component converts the second ambient sound into a second captured signal and transmits the second captured signal to the signal processing module within the speaker assembly.

19. The signal processing method as described in claim 17, characterized in that, The formula for the inverse Fourier transform is:

20. The signal processing method as described in claim 17, characterized in that, The formula for Fourier transform is:

21. The signal processing method as described in claim 17, characterized in that, The step of sequentially performing signal cancellation processing, transfer function calibration processing, and phase inversion processing on the first captured signal through the signal processing module further includes adjusting the gain coefficient to adjust the noise reduction level. The gain coefficient is a linear amplification or linear reduction factor, which linearly amplifies or reduces the first captured signal after phase inversion processing.

Images