Sound signal processing method, apparatus, device, and storage medium

Abstract

Embodiments of the present application provide a sound signal processing method, device and equipment and a storage medium, wherein the method comprises: obtaining an ambient noise signal in an ambient sound signal collected by a microphone in a current gain control period; determining a first gain of a first sound signal played by a loudspeaker in the current gain control period according to the ambient noise signal, wherein the first gain is used to control the in-ear frequency response of the first sound signal to be greater than the frequency response of the ambient noise signal, and the leakage frequency response of the first sound signal to be less than the frequency response of the ambient noise signal; and performing gain control on the first sound signal played by the loudspeaker in the current gain control period according to the first gain. Thus, acoustic privacy can be ensured not to be leaked, and the wearer can also clearly hear the sound signal played by the loudspeaker.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of signal processing, in particular to a sound signal processing method and device, equipment and a storage medium. BACKGROUND

[0002] With the rapid development of artificial intelligence, sound signal processing technology has been widely applied in multiple scenarios, such as smart glasses, vehicle-mounted intelligent terminals, etc., providing a more convenient human-computer interaction mode for users and improving the user experience.

[0003] At present, the main way to give the wearer audio experience is by air conduction. The sound propagation path is in turn loudspeaker-air-human ear, and sound leakage problem will inevitably occur when propagating to the air. The existing scheme mostly adopts the acoustic design scheme of acoustic dipole, but still cannot well solve the problem of acoustic privacy leakage. SUMMARY

[0004] The embodiments of the present application provide a sound signal processing method, device, equipment and storage medium, which are used to solve the problem of acoustic privacy leakage.

[0005] In a first aspect, the embodiments of the present application provide a sound signal processing method, comprising:

[0006] obtaining an ambient noise signal in an ambient sound signal collected by a microphone in a current gain control period;

[0007] determining a first gain of a first sound signal played by a loudspeaker in the current gain control period according to the ambient noise signal, wherein the first gain is used to control the in-ear frequency response of the first sound signal to be greater than the frequency response of the ambient noise signal, and the leakage frequency response of the first sound signal is less than the frequency response of the ambient noise signal;

[0008] controlling the gain of the first sound signal played by the loudspeaker in the current gain control period according to the first gain.

[0009] In some embodiments, the determination of the first gain of the first sound signal played by the loudspeaker in the current gain control period according to the ambient noise signal comprises:

[0010] obtaining the sound isolation degree and the leakage frequency response of the first sound signal in the current gain control period;

[0011] determining the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal and the ambient noise signal.

[0012] In some embodiments, the determining the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal, and the ambient noise signal comprises:

[0013] determining a noise energy of the ambient noise signal in the current gain control period;

[0014] determining the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal, and the noise energy.

[0015] In some embodiments, the determining the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal, and the ambient noise signal comprises:

[0016] frequency-dividing the ambient noise signal to obtain target ambient noise signals of a plurality of preset frequency bands;

[0017] determining a target sound isolation degree of each of the preset frequency bands and a target leakage frequency response of the first sound signal of each of the preset frequency bands;

[0018] determining the first gain of the first sound signal of each of the preset frequency bands in the current gain control period according to the target ambient noise signal, the target sound isolation degree, and the target leakage frequency response of each of the preset frequency bands.

[0019] In some embodiments, before the determining the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal, and the ambient noise signal, the method further comprises:

[0020] determining a scenario mode of the first sound signal in the current gain control period;

[0021] band-pass filtering the ambient noise signal according to the scenario mode.

[0022] In some embodiments, the ambient noise signal is obtained by performing echo cancellation on the ambient sound signal according to the first sound signal played by the loudspeaker in the current gain control period.

[0023] In some embodiments, the performing gain control on the sound signal played by the loudspeaker in the current gain control period according to the first gain comprises:

[0024] determining a second gain of a previous gain control period;

[0025] smoothing the first gain according to the second gain to obtain a third gain;

[0026] The gain of the sound signal played by the speaker during the current gain control period is adjusted according to the third gain.

[0027] Secondly, embodiments of this application also provide a sound signal processing apparatus, comprising:

[0028] The acquisition unit is used to acquire the ambient noise floor signal in the ambient sound signal collected by the microphone during the current gain adjustment cycle;

[0029] A gain unit is used to determine a first gain of a first sound signal played by a speaker within the current gain control cycle based on the ambient noise floor signal, wherein the first gain is used to control the in-ear frequency response of the first sound signal to be greater than the frequency response of the ambient noise floor signal, and the leakage frequency response of the first sound signal to be less than the frequency response of the ambient noise floor signal.

[0030] The control unit is used to control the gain of the first sound signal played by the speaker during the current gain control period according to the first gain.

[0031] Thirdly, embodiments of this application provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the sound signal processing method as described above.

[0032] Fourthly, embodiments of this application provide a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the sound signal processing method as described above.

[0033] Fifthly, embodiments of this application provide a computer program product, including a computer program that, when executed by a processor, implements the sound signal processing method as described above. Attached Figure Description

[0034] To more clearly illustrate the technical solutions in this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0035] Figure 1 This is a schematic diagram of the structure of a smart wearable device provided in one embodiment of this application;

[0036] Figure 2 This is a schematic diagram of the frequency response curve of a smart wearable device provided in one embodiment of this application;

[0037] Figure 3 is a flowchart of a sound signal processing method provided by an embodiment of the present application;

[0038] Figure 4 is a schematic diagram of sound isolation degree of an application scenario of a sound signal processing method provided by an embodiment of the present application;

[0039] Figure 5 is a structural schematic diagram of a sound signal processing device provided by an embodiment of the present application;

[0040] Figure 6 is a structural schematic diagram of an electronic device provided by an embodiment of the present application. DETAILED DESCRIPTION

[0041] In order to make the objectives, technical solutions and advantages of the present application clearer, the technical solutions of the present application will be described clearly and completely below with reference to the drawings in the present application. Obviously, the described embodiments are some but not all of the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the scope of the present application.

[0042] The terms "first", "second", and the like in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchanged under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than that illustrated or described herein, and the objects distinguished by "first", "second" are generally of a kind and do not limit the number of objects, for example, the first object can be one or more. In addition, "and / or" in the specification and claims means at least one of the connected objects, and the character " / " generally represents an "or" relationship between the front and rear associated objects. The sound signal processing method provided by the embodiments of the present application can be applied to smart wearable devices, or can be applied to terminal devices for controlling smart wearable devices.

[0043] In some embodiments, smart wearable devices are a general term of devices that can be designed and developed by applying wearable technology to daily wear, such as glasses, gloves, watches, clothing, and shoes, etc. Broadly, smart wearable devices include devices with full functions, which can realize complete or partial functions independently of smart phones, such as smart watches or smart glasses (such as augmented reality (AR) glasses), etc., and devices that focus on only one type of application function and need to be used in cooperation with other terminal devices, such as smart phones, for example, various types of smart wristbands, smart jewelry, etc. With the progress of technology and the change of user needs, the form and application of smart wearable devices are also constantly changing.

[0044] In some embodiments, the terminal device (terminal) includes various handheld devices, vehicle-mounted devices, wearable devices, computing devices or other processing devices connected to wireless modems with wireless communication functions, such as mobile phones, tablets, desktop notebooks, and smart devices that can run applications, including central control consoles of smart cars, etc. Specifically, it can refer to user equipment (UE), access terminal, user unit, user station, mobile station, mobile station, remote station, remote terminal, mobile device, user terminal, terminal, wireless communication device, user agent or user device. The terminal device can also be a satellite phone, a cellular phone, a smart phone, a wireless data card, a wireless modem, a machine type communication device, a cordless phone, a session initiation protocol (SIP) phone, a wireless local loop (WLL) station, a personal digital assistant (PDA), a handheld device with wireless communication function, a computing device or other processing device connected to a wireless modem, a vehicle-mounted device or a wearable device, a virtual reality (VR) terminal device, an augmented reality (AR) terminal device, a wireless terminal in industrial control, a wireless terminal in self-driving, a wireless terminal in remote medical, a wireless terminal in smart grid, a wireless terminal in transportation safety, a wireless terminal in smart city, a wireless terminal in smart home, a terminal device in 5G network or future communication network, etc. The terminal can be powered by a battery, and can also be attached to a power supply system of a vehicle or a ship and powered by the power supply system of the vehicle or the ship. The power supply system of the vehicle or the ship can also charge the battery of the terminal to prolong the communication time of the terminal.

[0045] Figure 1 The structural schematic diagram of the smart wearable device provided for an embodiment of the present application is shown in the figure.

[0046] As shown in Figure 1 The smart wearable device 100 includes a microphone 110, an echo cancellation module 120, a noise estimation module 130, a gain control module 140 and a loudspeaker 150.

[0047] The microphone 110 is configured to collect an ambient sound signal, which includes an acoustic echo signal of the sound signal played by the loudspeaker 150 in the current environment space and an ambient noise signal in the current environment space.

[0048] The echo cancellation module 120 is configured to perform echo cancellation on the ambient sound signal transmitted by the microphone 110, so as to eliminate the acoustic echo signal in the current environment space and obtain the required ambient noise signal. As an implementable manner, the sound signal played by the loudspeaker 160 can be taken as a reference signal in the echo cancellation.

[0049] The noise estimation module 130 is configured to perform noise estimation on the ambient noise signal, i.e., to estimate the noise energy of the ambient noise signal, and then estimate the gain required by the loudspeaker 160 according to the noise energy.

[0050] As an implementable manner, the reference Figure 2 , Figure 2 is a schematic diagram of a frequency response curve measured when the smart wearable device is controlled to play audio at a specific volume in a standard environment space.

[0051] In the diagram, Figure 2 The horizontal coordinate represents the frequency of a signal sampling point, and the vertical coordinate represents the amplitude (level) of the signal sampling point. The dashed line represents the in-ear frequency response, i.e., the frequency response of the sound signal actually audible to the wearer, which can be obtained by a head and torso simulator test. The solid line represents the leakage frequency response, i.e., the frequency response of the sound signal audible to the surrounding pedestrians, which can be obtained by a standard microphone test.

[0052] In this embodiment, the noise estimation module 130 is configured to determine the gain required by the sound signal played by the loudspeaker 160 according to the frequency response curve measured by the smart wearable device in the standard environment space, the volume set by the smart wearable device in the current environment space, and the noise energy in the current environment space.

[0053] The gain control module 140 is configured to perform gain control on the sound signal played by the loudspeaker 160, so that the in-ear frequency response of the sound signal after the gain control is greater than the frequency response of the ambient noise signal in the current environment space, and the leakage frequency response of the sound signal after the gain control is less than the frequency response of the ambient noise signal in the current environment space.

[0054] The loudspeaker 160 is configured to play the sound signal after the gain control by the gain control module 140. As a result, the in-ear frequency response of the played sound signal is greater than the frequency response of the ambient noise signal in the current environment space, and the leakage frequency response is less than the frequency response of the ambient noise signal in the current environment space, thereby ensuring that the acoustic privacy is not leaked, and the wearer can also clearly hear the sound signal played by the loudspeaker 160.

[0055] At present, the solution to the privacy of smart wearable devices mostly adopts a pure acoustic structure scheme, for example, an acoustic design scheme of acoustic dipoles. Although the acoustic design scheme of acoustic dipoles can provide certain acoustic privacy guarantee, due to the design principle of acoustic dipoles, two sound holes are designed, one of which is a main sound source and emits sound outward, and the other is an auxiliary sound source and eliminates sound leakage. The phase difference of the sound waves radiated outward by the two sound holes is 180°, and they are very close to each other, have the same (or similar) frequency and vibration amplitude, and synthesize the final sound source, so that people around the wearer can hardly hear the sound, but it cannot be ensured whether the acoustic privacy is leaked.

[0056] Therefore, an embodiment of the present application provides a sound signal processing method applied to the above smart wearable device, which can ensure that the acoustic privacy is not leaked, and the wearer can also clearly hear the sound signal played by the loudspeaker.

[0057] It can be understood that the signals in the embodiments of the present application all refer to data domain signals, which will not be described in detail here.

[0058] Figure 3 The flowchart of the sound signal processing method provided for an embodiment of the present application is shown in FIG. 1. Figure 3 As shown in FIG. 1, the method includes the following steps: step 301, step 302 and step 303. The method flow steps are only used as one possible implementation of the present application.

[0059] Step 301, obtaining an ambient noise signal in an ambient sound signal collected by a microphone in a current gain control period;

[0060] The ambient sound signal refers to the sound signal collected by the microphone of the smart wearable device in the current environment space, and the ambient sound signal includes the acoustic echo signal in the current environment space and the ambient noise signal in the current environment space.

[0061] In the present embodiment, the ambient sound signal can be collected by one microphone, or can be collected by two or more microphones, which is not limited.

[0062] In the embodiment of the present application, the period length of the gain control period can be determined according to the playing time length of the audio frame of the smart wearable device. For example, the time length of one frame of audio frame played by the smart wearable device is m, and the period length in the gain control period is m*n, wherein n can be a positive integer.

[0063] In one example, when the loudspeaker starts playing the first frame of audio, the microphone synchronously collects the ambient sound signal, when the loudspeaker starts playing the second frame of audio, the smart wearable device enters the first gain control period, and the ambient sound signal collected by the microphone during the playing of the first frame of audio by the loudspeaker is taken as the ambient sound signal in the first gain control period, then when the loudspeaker starts playing the third frame of audio, the smart wearable device enters the second gain control period, and the ambient sound signal collected by the microphone during the playing of the second frame of audio by the loudspeaker is taken as the ambient sound signal in the second gain control period, and so on.

[0064] In one example, when the loudspeaker starts playing the first frame of audio, the smart wearable device synchronously enters the first gain control period, the microphone synchronously collects the ambient sound signal, and the microphone stops collecting the ambient sound signal after collecting the ambient sound signal for a preset time length, until the loudspeaker starts playing the second frame of audio, and so on.

[0065] In some embodiments, the ambient sound signal can be subjected to echo cancellation according to the first sound signal played by the loudspeaker in the current gain control period to obtain the ambient noise signal.

[0066] For example, the reference signal of the adaptive filter is set as the first sound signal played by the loudspeaker, and then the ambient sound signal is input into the adaptive filter, and the adaptive filter can output the ambient noise signal.

[0067] In the embodiment, the first sound signal can be a sound signal generated in real time, such as a sound signal generated in a voice call process, or a sound signal recorded in advance, such as music, and the like, and no limitation is made thereto.

[0068] In step 302, the first gain of the first sound signal played by the loudspeaker in the current gain control period is determined according to the ambient noise signal.

[0069] The first gain is used to control the in-ear frequency response of the first sound signal to be greater than the frequency response of the ambient noise signal, and the leakage frequency response of the first sound signal to be less than the frequency response of the ambient noise signal.

[0070] In the embodiment, the first gain refers to the gain of the amplitude of the first sound signal in the current gain control period.

[0071] After obtaining the ambient noise signal, the amplitude of the ambient noise signal can be detected, and thus the gain of the amplitude of the first sound signal can be determined according to the amplitude of the ambient noise signal.

[0072] In one example, the first gain of the first sound signal corresponding to the amplitude range of each ambient noise signal can be preset, for example, the greater the amplitude of the ambient noise signal, the greater the value of the first gain.

[0073] Step 303, gain control of the first sound signal played by the loudspeaker in the current gain control period according to the first gain;

[0074] In this embodiment, the amplitude of the first sound signal played by the loudspeaker in the current gain control period is gain controlled according to the first gain, and the volume of the first sound signal played by the loudspeaker is adjusted, so that the in-ear frequency response of the first sound signal played by the loudspeaker is greater than the frequency response of the ambient noise signal, and the leakage frequency response of the first sound signal is less than the frequency response of the ambient noise signal.

[0075] Wherein, when gain control is performed, the gain of the first sound signal can be adjusted to the first gain at one time, and the gain of the first sound signal can also be adjusted to the first gain gently and multiple times, which is not limited.

[0076] The sound signal processing method provided by the embodiment of the application acquires the ambient noise signal in the ambient sound signal collected by the microphone in the current gain control period; then determines the first gain that makes the in-ear frequency response of the first sound signal greater than the frequency response of the ambient noise signal and the leakage frequency response of the first sound signal less than the frequency response of the ambient noise signal according to the ambient noise signal, and then realizes gain control of the first sound signal played by the loudspeaker according to the first gain, which can ensure that the acoustic privacy is not leaked, and the wearer can also hear the sound signal played by the loudspeaker clearly.

[0077] In some embodiments, the gain control of the sound signal played by the loudspeaker in the current gain control period according to the first gain comprises:

[0078] Determine the second gain of the last gain control period;

[0079] Smooth the first gain according to the second gain to obtain the third gain;

[0080] Gain control of the sound signal played by the loudspeaker in the current gain control period according to the third gain.

[0081] It should be noted that the first gain and the second gain in the embodiment are fixed values, and the third gain is a time-dependent variable value. For example, at the 0th moment to the 2nd moment (previous gain control period), the corresponding second gain is 10dB, at the 2nd moment to the 4th moment (current gain control period), the corresponding first gain is 20dB, and at the 2nd moment, the third gain is 10dB, at the (2+T1)th moment, the third gain is (10+a)dB, at the (2+T1+T2)th moment, the third gain is (10+a+b)dB, and so on, until at the 4th moment, the third gain is 20dB, where T1 and T2 can be the same or different, and a and b can be the same or different.

[0082] In the embodiment, the exponential smoothing method can be used to determine the third gain. For example, according to the gain difference between the first gain and the second gain, the exponential smoothing coefficient of the current gain control period is determined, where the greater the gain difference, the greater the exponential smoothing coefficient.

[0083] The sound signal processing method provided in the embodiment can determine the second gain of the previous gain control period, smooth the first gain according to the second gain to obtain the third gain, and control the gain of the sound signal played by the loudspeaker in the current gain control period according to the third gain, so that the first sound signal played by the loudspeaker can be smoothly transitioned, and the experience of the wearer is improved.

[0084] In some embodiments, the first gain of the first sound signal played by the loudspeaker in the current gain control period is determined according to the ambient noise signal, including:

[0085] The sound isolation degree and the leakage frequency response of the first sound signal in the current gain control period are obtained.

[0086] The first gain of the first sound signal in the current gain control period is determined according to the sound isolation degree, the leakage frequency response of the first sound signal, and the ambient noise signal.

[0087] The sound isolation degree in the embodiment refers to the difference between the in-ear frequency response and the leakage frequency response of the sound signal when the smart wearable device plays the sound signal.

[0088] It should be noted that the sound isolation degree in the embodiment is a fixed value related to the physical acoustic structure design of the smart wearable device, for example, referring to Figure 4 , Figure 4 The schematic diagram of the sound isolation degree of a certain specific physical acoustic structure smart wearable device.

[0089] In one example, a reference leakage frequency response is set, i.e., a leakage frequency response measured when the smart wearable device plays audio at a reference volume in a standard ambient space.

[0090] In this embodiment, the leakage frequency response of the first sound signal is determined according to the volume of the first sound signal and the preset reference leakage frequency response, and then the in-ear frequency response of the first sound signal is determined according to the sound isolation degree, so as to determine the first gain of the first sound signal according to the leakage frequency response of the first sound signal, the in-ear frequency response of the first sound signal, and the ambient noise signal.

[0091] The sound signal processing method provided in this application can obtain the sound isolation degree and the leakage frequency response of the first sound signal in the current gain control period, and then determine the first gain of the first sound signal according to the sound isolation degree, the leakage frequency response of the first sound signal, and the ambient noise signal.

[0092] In some embodiments, the determination of the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal, and the ambient noise signal comprises:

[0093] determining the noise energy of the ambient noise signal in the current gain control period;

[0094] determining the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal, and the noise energy.

[0095] In one example, the ambient noise signal can be processed by RMS (root mean square) to obtain the noise energy (i.e., effective noise) of the ambient noise signal. The RMS processing step is consistent with the prior art, and will not be repeated here.

[0096] In this embodiment, after the RMS processing of the ambient noise signal, the effective amplitude of the ambient noise signal can be obtained according to the noise energy, wherein the effective amplitude is a fixed amplitude independent of the noise frequency.

[0097] In one example, the leakage frequency response curve of the first sound signal, the in-ear frequency response curve of the first sound signal and the frequency response curve of the ambient noise signal can be determined in the same frequency response coordinate system, where the amplitude corresponding to each frequency in the frequency response curve of the ambient noise signal is equal (i.e., equal to the amplitude of the effective noise). Then, the leakage frequency response curve and the in-ear frequency response curve are adjusted up and down along the vertical axis of the frequency response coordinate system until the frequency response curve of the ambient noise signal is approximately located between the leakage frequency response curve and the in-ear frequency response curve of the first sound signal. Then, the amplitude difference between the leakage frequency response curve (in-ear frequency response curve) under this condition and the original leakage frequency response curve (in-ear frequency response curve) is the first gain of the first sound signal.

[0098] The sound signal processing method provided in the application can convert the ambient noise signal into a signal that can be used for measurement by obtaining the noise energy of the ambient noise signal, thereby ensuring that the first gain of the first sound signal can be accurately determined according to the sound isolation degree, the leakage frequency response and the noise energy.

[0099] In some embodiments, the first gain of the first sound signal in the current gain control period is determined according to the sound isolation degree, the leakage frequency response of the first sound signal and the ambient noise signal, including:

[0100] The ambient noise signal is frequency-divided to obtain target ambient noise signals of a plurality of preset frequency bands;

[0101] The target sound isolation degree of each preset frequency band and the target leakage frequency response of the first sound signal of each preset frequency band are determined.

[0102] The first gain of the first sound signal of each preset frequency band in the current gain control period is determined according to the target ambient noise signal, the target sound isolation degree and the target leakage frequency response of each preset frequency band.

[0103] In one example, the ambient noise signal can be analyzed by a frequency divider, and the ambient noise signal is divided into target ambient noise signals of a plurality of preset frequency bands by pre-setting the frequency division points of the frequency divider.

[0104] It should be noted that the noise components in different environmental scenarios are quite different, and therefore, by dividing the ambient noise signal into target ambient noise signals of a plurality of preset frequency bands for gain control, the acoustic privacy of the intelligent wearable device can be improved.

[0105] In the embodiment, the target sound isolation degree, the target leakage frequency response and the target ambient noise signal of each preset frequency band are processed respectively to determine the first gain matched with each preset frequency band, and then the first sound signal is gain-regulated by combining with an EQ (Audio equalizer filter) filter, wherein the frequency division points of the EQ filter are the same as the frequency division points of the frequency divider.

[0106] In the embodiment, the first gain of the first sound signal of each preset frequency band is acquired in the same way as in the above embodiment, and thus the description is omitted here.

[0107] The sound signal processing method provided in the application regulates the first sound signal of each preset frequency band by the first gain of each preset frequency band, thereby ensuring that the in-ear frequency response of the first sound signal of each preset frequency band is greater than the frequency response of the ambient noise signal of the corresponding frequency band, and the leakage frequency response is less than the frequency response of the ambient noise signal of the corresponding frequency band, thereby improving the adaptability of the smart wearable device in different noise scenes and making the sound privacy of the smart wearable device higher.

[0108] In some embodiments, before determining the first gain of the first sound signal in the current gain regulation period according to the sound isolation degree, the leakage frequency response of the first sound signal and the ambient noise signal, the method further comprises:

[0109] determining the scene mode of the first sound signal in the current gain regulation period;

[0110] bandpass filtering the ambient noise signal according to the scene mode.

[0111] In the embodiment, the scene mode refers to the application scene of the sound signal, such as whether the sound signal is used for voice call (i.e. voice call scene mode) or used for transmitting music data (music scene mode).

[0112] In one example, a plurality of scene modes and filter bandwidths in each scene mode are preset, thereby bandpass filtering the ambient noise signal in each scene mode according to the preset filter bandwidths in each scene mode.

[0113] For example, the filter bandwidth in the voice call scene mode is set to 300-4000 Hz, and the filter bandwidth in the music scene mode is set to 80-1000 Hz, then the ambient noise signal is bandpass filtered at 300-4000 Hz in the voice call scene mode to retain the ambient noise signal at 300-4000 Hz, and the ambient noise signal is bandpass filtered at 80-1000 Hz in the music scene mode to retain the ambient noise signal at 80-1000 Hz.

[0114] The sound signal processing method provided in the embodiment determines the scene mode of the first sound signal in the current gain control period, and performs band-pass filtering on the ambient noise signal according to the scene mode, so as to avoid the interference of ambient noise signals in other frequency ranges on the result of the first gain, thereby improving the accuracy of the result of the first gain.

[0115] The sound signal processing device provided in the embodiments of the present application is described below. The sound signal processing device described below can be correspondingly referred to the sound signal processing method described above.

[0116] Figure 5 The structural schematic diagram of the sound signal processing device provided in an embodiment of the present application is shown in Figure 5 The sound signal processing device 500 includes:

[0117] The acquisition unit 510 is configured to acquire an ambient noise signal in the ambient sound signal collected by the microphone in the current gain control period.

[0118] The gain unit 520 is configured to determine a first gain of a first sound signal played by a loudspeaker in the current gain control period according to the ambient noise signal, wherein the first gain is used to control the in-ear frequency response of the first sound signal to be greater than the frequency response of the ambient noise signal, and the leakage frequency response of the first sound signal to be less than the frequency response of the ambient noise signal.

[0119] The control unit 530 is configured to control the gain of the first sound signal played by the loudspeaker in the current gain control period according to the first gain.

[0120] In some embodiments, the gain unit 520 is further configured to acquire the sound isolation degree and the leakage frequency response of the first sound signal in the current gain control period, and determine the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal, and the ambient noise signal.

[0121] In some embodiments, the gain unit 520 is further configured to determine the noise energy of the ambient noise signal in the current gain control period, and determine the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal, and the noise energy.

[0122] In some embodiments, the gain unit 520 is further configured to divide the ambient noise signal into multiple preset frequency bands to obtain target ambient noise signals; determine the target acoustic isolation of each preset frequency band and the target leakage frequency response of the first sound signal of each preset frequency band; and determine the first gain of the first sound signal of each preset frequency band within the current gain control period based on the target ambient noise signal, the target acoustic isolation, and the target leakage frequency response of each preset frequency band.

[0123] In some embodiments, the gain unit 520 is further configured to determine the scene mode of the first sound signal within the current gain control period; and to perform bandpass filtering on the ambient noise signal according to the scene mode.

[0124] In some embodiments, the acquisition unit 510 is further configured to perform echo cancellation on the ambient sound signal based on the first sound signal played by the speaker during the current gain control cycle to obtain an ambient noise floor signal.

[0125] In some embodiments, the control unit 530 is further configured to determine a second gain in the previous gain control cycle; smooth the first gain according to the second gain to obtain a third gain; and perform gain control on the sound signal played by the speaker in the current gain control cycle according to the third gain.

[0126] It should be noted that the sound signal processing apparatus provided in this application embodiment can implement all the method steps implemented in the above sound signal processing method embodiment and can achieve the same technical effect. Here, the parts that are the same as those in the method embodiment and the beneficial effects will not be described in detail.

[0127] Figure 6 A schematic diagram of the structure of the electronic device provided in this application, such as Figure 6 As shown, the electronic device may include a processor 610, a communications interface 620, a memory 630, and a communications bus 640, wherein the processor 610, communications interface 620, and memory 630 communicate with each other via the communications bus 640. The processor 610 can call logical commands in the memory 630 to execute the following methods:

[0128] Acquire an ambient noise signal in an ambient sound signal collected by a microphone in a current gain control period; determine a first gain of a first sound signal played by a loudspeaker in the current gain control period according to the ambient noise signal, wherein the first gain is used to control an in-ear frequency response of the first sound signal to be greater than a frequency response of the ambient noise signal, and a leakage frequency response of the first sound signal to be less than the frequency response of the ambient noise signal; and perform gain control on the first sound signal played by the loudspeaker in the current gain control period according to the first gain.

[0129] In addition, the logic commands in the memory 630 described above can be implemented in the form of a software function unit and sold or used as a separate product, and can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application essentially or the parts that contribute to the prior art or parts of the technical solutions can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a plurality of commands to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute all or part of the steps of the methods described in various embodiments of the present application. The aforementioned storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM, Read-Only Memory), a random access memory (RAM, Random Access Memory), a magnetic disk or an optical disk, and various media that can store program codes.

[0130] The processor in the electronic device provided by the embodiments of the present application can call the logic instructions in the memory to implement the above-mentioned method, and the specific implementation manners are consistent with the above-mentioned method implementation manners, and the same beneficial effects can be achieved, which will not be described here.

[0131] The embodiments of the present application further provide a computer readable storage medium, which stores a computer program, and the computer program is executed by a processor to implement the method provided by each of the above embodiments.

[0132] The specific implementation manners are consistent with the above-mentioned method implementation manners, and the same beneficial effects can be achieved, which will not be described here.

[0133] The embodiments of the present application provide a computer program product, which includes a computer program, and the computer program is executed by a processor to implement the above-mentioned method.

[0134] The device embodiments described above are merely illustrative, wherein the units described as separate components can or can not be physically separate, and the components displayed as units can or can not be physical units, i.e., can be located in one place, or can be distributed to multiple network units. Part or all of the modules can be selected to achieve the purposes of the embodiments according to actual needs. Those skilled in the art can understand and implement without creative labor.

[0135] Through the description of the above embodiments, those skilled in the art can clearly understand that the embodiments can be realized by means of software and necessary general hardware platforms, and of course can also be realized by hardware. Based on such understanding, the above technical solutions can be embodied in the form of software products, and the computer software products can be stored in a computer readable storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and include a plurality of instructions to make a computer device (which can be a personal computer, a server, or a network device, etc.) execute the methods described in each embodiment or some parts of the embodiments.

[0136] Finally, it should be noted that: the above embodiments are only used to illustrate the technical solutions of the present application, and not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that: it can still modify the technical solutions recorded in the foregoing embodiments, or make equivalent replacement for part of the technical features; and these modifications or replacements do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method of processing a sound signal, characterized by, The method comprises: acquiring an ambient noise signal in an ambient sound signal collected by a microphone in a current gain control period; determining a first gain of a first sound signal played by a loudspeaker in the current gain control period according to the ambient noise signal, wherein the first gain is used to control an in-ear frequency response of the first sound signal to be greater than a frequency response of the ambient noise signal, and a leakage frequency response of the first sound signal to be less than the frequency response of the ambient noise signal; controlling the first sound signal played by the loudspeaker in the current gain control period according to the first gain.

2. The sound signal processing method of claim 1, characterized by, The method of determining the first gain of the first sound signal played by the loudspeaker in the current gain control period according to the ambient noise signal comprises: acquiring a sound isolation degree and a leakage frequency response of the first sound signal in the current gain control period; determining the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal and the ambient noise signal.

3. The sound signal processing method of claim 2, characterized by, The method of determining the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal and the ambient noise signal comprises: determining a noise energy of the ambient noise signal in the current gain control period; determining the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal and the noise energy.

4. The sound signal processing method of claim 2, characterized by, The method of determining the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal and the ambient noise signal comprises: frequency-dividing the ambient noise signal to obtain target ambient noise signals of a plurality of preset frequency bands; determining a target sound isolation degree of each preset frequency band and a target leakage frequency response of the first sound signal of each preset frequency band; determining the first gain of the first sound signal of each preset frequency band in the current gain control period according to the target ambient noise signal, the target sound isolation degree and the target leakage frequency response of each preset frequency band.

5. The sound signal processing method of claim 2, wherein, The method further comprises, before the step of determining the first gain of the first sound signal in the current gain control period according to the sound isolation degree, the leakage frequency response of the first sound signal and the ambient noise signal: determining a scenario mode of the first sound signal in the current gain control period; band-pass filtering the ambient noise signal according to the scenario mode.

6. The method of processing a sound signal according to any one of claims 1 to 5, wherein The method of acquiring the ambient noise signal in the ambient sound signal in the current gain control period further comprises: performing echo cancellation on the ambient sound signal according to the first sound signal played by the loudspeaker in the current gain control period to obtain the ambient noise signal.

7. The method of processing a sound signal according to any one of claims 1 to 5, wherein The method of controlling the sound signal played by the loudspeaker in the current gain control period according to the first gain comprises: determining a second gain of a previous gain control period; smoothing the first gain according to the second gain to obtain a third gain; controlling the sound signal played by the loudspeaker in the current gain control period according to the third gain.

8. A sound signal processing apparatus characterized by comprising: The method comprises: An acquisition unit is configured to acquire an ambient noise signal in an ambient sound signal collected by a microphone in a current gain control period. A gain unit is configured to determine a first gain of a first sound signal played by a loudspeaker in the current gain control period according to the ambient noise signal, wherein the first gain is used to control an in-ear frequency response of the first sound signal to be greater than a frequency response of the ambient noise signal, and a leakage frequency response of the first sound signal to be less than the frequency response of the ambient noise signal. A control unit is configured to control the first sound signal played by the loudspeaker in the current gain control period according to the first gain.

9. An electronic device comprising a memory, a processor, and a computer program stored on the memory and executable on the processor, characterized in that, The processor implements the sound signal processing method in any one of claims 1-7 when executing the program.

10. A non-transitory computer-readable storage medium having stored thereon a computer program, characterized in that, The computer program implements the sound signal processing method in any one of claims 1-7 when executed by the processor.

Images