Audio pickup method and device, electronic equipment, chip and medium

Abstract

The invention provides an audio pickup method and device, electronic equipment, a chip and a medium, and relates to the field of digital audio processing, and the method comprises the steps: obtaining an audio signal through audio collection equipment; performing at least two times of enhancement processing on the audio signal to obtain at least two processed signals, enhancement parameters of the at least two times of enhancement processing being different; and comparing whether the at least two processing signals are similar or not, and outputting a first processing signal in the at least two processing signals based on a first comparison result, thereby realizing simultaneous different audio enhancement processing on the audio signals acquired by a single audio acquisition device, reducing hardware cost, improving the intensity range of the audio signals, and improving the audio enhancement efficiency. Therefore, the dynamic range performance of microphone pickup is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of digital audio processing, and in particular to an audio pickup method, device, electronic equipment, chip and medium. Background Art

[0002] Audio pickup refers to the process of capturing and recording sound signals from the environment using technical means. In audio pickup, microphones or similar devices are usually used to collect sound and convert it into electrical signals for further processing, storage or transmission. In the process of audio pickup, many factors need to be considered, such as the type and position of the microphone and environmental noise, which may interfere with the audio pickup process. Therefore, it is necessary to configure gain and noise reduction processing to reduce the impact of these factors on the audio pickup process.

[0003] In the related art, the audio pickup technology mainly adopts dual dynamic audio pickup realized by analog circuits. In the audio pickup process, more hardware components and circuit designs are required to support at least two programmable gain amplifiers (PGA) and two analog-to-digital converters (ADC), and the hardware cost is relatively high. Summary of the invention

[0004] The present disclosure provides an audio pickup method, device, electronic device, chip and medium to solve the problem of high hardware cost in related technologies, realize different audio enhancement processing on audio signals collected by a single audio collection device at the same time, reduce hardware costs, increase the intensity range of audio signals, and improve the dynamic range performance of audio pickup.

[0005] A first aspect embodiment of the present disclosure proposes an audio pickup method, the method comprising: acquiring an audio signal through an audio acquisition device; performing at least two enhancement processes on the audio signal to acquire at least two processed signals, wherein the enhancement parameters of the at least two enhancement processes are different; comparing whether the at least two processed signals are similar, and outputting a first processed signal of the at least two processed signals based on a first comparison result.

[0006] In some embodiments of the present disclosure, the enhancement parameters include a gain parameter and a noise parameter, and the audio signal is enhanced at least twice, and obtaining at least two processed signals includes: performing gain processing on the audio signal at least twice based on the at least two enhancement parameters to obtain at least two gain signals; determining the strength of the at least two gain signals, and if the strength of the at least two gain signals is greater than the at least two noise parameters, determining the at least two gain signals to be at least two processed signals.

[0007] In some embodiments of the present disclosure, comparing whether at least two processed signals are similar, and based on a first comparison result, outputting a first processed signal among the at least two processed signals includes: determining energy values ​​of the at least two processed signals, the energy values ​​representing amplitudes of the at least two processed signals; based on the energy values, comparing whether the at least two processed signals are similar, and obtaining a first comparison result; and based on the first comparison result, outputting the first processed signal among the at least two processed signals.

[0008] In some embodiments of the present disclosure, comparing whether at least two processed signals are similar, obtaining a first comparison result includes: if the difference in energy values ​​of at least two processed signals is less than or equal to a preset threshold, determining that the at least two processed signals are similar; if the difference in energy values ​​of at least two processed signals is greater than the preset threshold, determining that the at least two processed signals are not similar.

[0009] In some embodiments of the present disclosure, based on the first comparison result, outputting the first processed signal or the second processed signal includes: comparing the strengths of at least two processed signals, obtaining the second processed signal, the second processed signal having the largest strength among the at least two processed signals; if at least two processed signals are similar, using the second processed signal as the first processed signal; if at least two processed signals are not similar, determining a third processed signal among the at least two processed signals, and using the third processed signal as the first processed signal, the third processed signal being smaller than the second processed signal.

[0010] The second aspect embodiment of the present disclosure proposes an audio pickup device, which includes: an acquisition unit, used to acquire an audio signal through an audio acquisition device; a processing unit, used to perform at least two enhancement processes on the audio signal to obtain at least two processed signals, and the enhancement parameters of the at least two enhancement processes are different; an output unit, used to compare whether the at least two processed signals are similar, and based on a first comparison result, output a first processed signal of the at least two processed signals.

[0011] In some embodiments of the present disclosure, the enhancement parameters include a gain parameter and a noise parameter, and the processing unit is used to: perform gain processing on the audio signal at least twice based on at least two enhancement parameters to obtain at least two gain signals; determine the strength of the at least two gain signals, and if the strength of the at least two gain signals is greater than the at least two noise parameters, determine that the at least two gain signals are at least two processed signals.

[0012] In some embodiments of the present disclosure, the output unit is used to: determine the energy value of at least two processed signals, the energy value characterizing the amplitude of the at least two processed signals; based on the energy value, compare whether the at least two processed signals are similar to obtain a first comparison result; based on the first comparison result, output the first processed signal of the at least two processed signals.

[0013] In some embodiments of the present disclosure, the output unit is used to: if the difference in energy values ​​of at least two processed signals is less than or equal to a preset threshold, determine that at least two processed signals are similar; if the difference in energy values ​​of at least two processed signals is greater than the preset threshold, determine that at least two processed signals are dissimilar.

[0014] In some embodiments of the present disclosure, the output unit is used to: compare the strengths of at least two processed signals to obtain a second processed signal, the second processed signal having the highest strength among the at least two processed signals; if at least two processed signals are similar, use the second processed signal as the first processed signal; if at least two processed signals are not similar, determine a third processed signal among the at least two processed signals, and use the third processed signal as the first processed signal, the third processed signal being smaller than the second processed signal.

[0015] The third aspect embodiment of the present disclosure proposes an electronic device, comprising: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor so that the at least one processor can execute the method described in the first aspect embodiment of the present disclosure.

[0016] The fourth aspect embodiment of the present disclosure proposes a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable a computer to execute the method described in the first aspect embodiment of the present disclosure.

[0017] The fifth aspect embodiment of the present disclosure proposes a chip, which includes one or more interface circuits and one or more processors; the interface circuit is used to receive signals and send signals to the processor, the signals include computer instructions stored in the memory, and when the processor executes the computer instructions, the chip executes the method described in the first aspect embodiment of the present disclosure.

[0018] In summary, according to the audio pickup method proposed in the present invention, an audio signal is acquired through an audio acquisition device; the audio signal is enhanced at least twice to obtain at least two processed signals, and the enhancement parameters of at least two enhancement processes are different; at least two processed signals are compared to see whether they are similar, and based on the first comparison result, a first processed signal of at least two processed signals is output, so as to realize different audio enhancement processing on the audio signal collected by a single audio acquisition device at the same time, reduce hardware costs, and increase the intensity range of audio signals, so as to improve the dynamic range performance of microphone pickup.

[0019] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0020] The drawings herein are incorporated into and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the description are used to explain the principles of the present disclosure, and do not constitute improper limitations on the present disclosure.

[0021] Figure 1 A flowchart of an audio pickup method provided by an embodiment of the present disclosure;

[0022] Figure 2 A flowchart of an audio pickup method provided by an embodiment of the present disclosure;

[0023] Figure 3 A schematic diagram of a specific gain processing provided by an embodiment of the present disclosure;

[0024] Figure 4 A schematic diagram of a specific noise suppression provided by an embodiment of the present disclosure;

[0025] Figure 5 A schematic diagram of a specific audio pickup method provided by an embodiment of the present disclosure;

[0026] Figure 6 A schematic diagram of the structure of an audio pickup device provided by an embodiment of the present disclosure;

[0027] Figure 7 A schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure;

[0028] Figure 8 A schematic diagram of the structure of a chip provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0029] The embodiments of the present disclosure are described in detail below, and examples of the embodiments are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions.

[0030] Audio pickup refers to the process of capturing and recording sound signals from the environment using technical means. In audio pickup, microphones or similar devices are usually used to collect sound and convert it into electrical signals for further processing, storage or transmission. In the process of audio pickup, many factors need to be considered, such as the type and position of the microphone and environmental noise, which may interfere with the audio pickup process. Therefore, it is necessary to configure gain and noise reduction processing to reduce the impact of these factors on the audio pickup process.

[0031] In the related art, the audio pickup technology mainly adopts dual dynamic audio pickup realized by analog circuits. In the audio pickup process, more hardware components and circuit designs are required to support at least two programmable gain amplifiers (PGA) and two analog-to-digital converters (ADC), and the hardware cost is relatively high.

[0032] In order to solve the problems existing in the related art, the present disclosure proposes an audio pickup method, which realizes multi-dynamic audio pickup based on digital method. After the audio signal is digitally processed, it is input into the multi-dynamic processing module. The processing module copies the input audio signal to multiple dynamic processing units. Each processing unit configures the parameters in the digital gain and noise processing module through a computer. After the multi-channel audio signals are processed, they are fused and output through a certain computer algorithm, so as to realize different audio enhancement processing for the audio signals picked up by a single audio acquisition device, so as to improve the dynamic range performance of the audio acquisition device and reduce the hardware cost.

[0033] The audio pickup method proposed in the present disclosure can be applied to fields that require audio pickup, such as speech recognition, audio recording, and sound monitoring. For example, in speech recognition, audio pickup is to convert human speech into electrical signals, which are then processed and recognized by a computer. In audio recording, audio pickup is to record the sounds in the environment for subsequent analysis and playback. In sound monitoring, audio pickup is to convert the sounds in the environment into electrical signals, which are then analyzed and monitored by electronic devices.

[0034] The audio pickup method provided by the present application is described in detail below with reference to the accompanying drawings.

[0035] Figure 1 Flow chart of an audio pickup method provided by an embodiment of the present disclosure. Figure 1 As shown, the audio pickup method includes steps 101-103.

[0036] Step 101: Acquire an audio signal through an audio acquisition device.

[0037] In the embodiments of the present disclosure, audio can be collected by one or more audio collection devices. An audio collection device is a device for capturing and recording sound, which can convert the collected audio into an electrical signal, i.e., an audio signal, and record the audio signal. An audio collection device may include a microphone, a recording device, an audio processor, etc. Different collection devices have different characteristics and applicable scenarios, and can be selected according to actual needs. In the present disclosure, a microphone is mainly used.

[0038] Step 102: Perform enhancement processing on the audio signal at least twice to obtain at least two processed signals, wherein enhancement parameters of the at least two enhancement processings are different.

[0039] In the embodiment of the present disclosure, at least two enhancement processes are performed on the audio signal at least twice according to the enhancement parameters. The at least two processed signals are output signals after each enhancement process.

[0040] Each enhancement process includes digital gain (DG) and noise suppression (NS). Digital gain and noise suppression are implemented through corresponding digital hardware circuits. Under high process technology, the cost of this circuit is lower than that of the corresponding circuits of programmable gain amplifier (PGA) and analog-to-digital converter (ADC).

[0041] Among them, digital gain and noise suppression are important means to improve the quality of audio signals, and the size of the enhancement parameters can be set according to actual needs.

[0042] Step 103 : comparing whether the at least two processed signals are similar, and outputting a first processed signal of the at least two processed signals based on a first comparison result.

[0043] In an embodiment of the present disclosure, for comparison of at least two processed signals, it is necessary to determine the energy value of each processed signal, and determine whether the at least two processed signals are similar by the difference in energy values ​​between the processed signals. Specifically, it is possible to determine whether the at least two processed signals are similar by setting a preset threshold to obtain a first comparison result.

[0044] According to the first comparison result, a first processed signal to be outputted from the at least two processed signals is determined, wherein the first processed signal is determined according to the strength of the at least two processed signals under the condition of the first comparison result.

[0045] In summary, according to the audio pickup method proposed in the present invention, an audio signal is acquired through an audio acquisition device; the audio signal is enhanced at least twice to obtain at least two processed signals, and the enhancement parameters of at least two enhancement processes are different; at least two processed signals are compared to see whether they are similar, and based on the first comparison result, the first processed signal of at least two processed signals is output, so as to realize different audio enhancement processing on the audio signal collected by a single microphone at the same time, reduce hardware costs, and increase the intensity range of audio signals, so as to improve the dynamic range performance of microphone pickup.

[0046] based on Figure 1 The embodiment shown, Figure 2 The following further shows a flow chart of an audio pickup method proposed by the present disclosure. Figure 2 based on Figure 1 In the embodiment shown, step 102 and step 103 are further defined. Figure 2In the embodiment shown, step 102 includes step 202, step 203 and step 204, and step 103 includes step 205, step 206 and step 207. Figure 2 As shown, the method comprises the following steps:

[0047] Step 201: Acquire an audio signal through an audio acquisition device.

[0048] In the embodiments of the present disclosure, audio signals are acquired through a single audio acquisition device, wherein the single audio acquisition device may be a single microphone for sound pickup, that is, all audio signals are picked up by one microphone or one point in the sound field.

[0049] Step 201 has the same or similar function as the above-mentioned step 101, and its implementation method can be performed with reference to the above-mentioned embodiment, which will not be described in detail here.

[0050] Step 202: Perform gain processing on the audio signal at least twice based on at least two enhancement parameters to obtain at least two gain signals.

[0051] In an embodiment of the present disclosure, at least two enhancement parameters are required for at least two gain processings, such as gain 1 and gain 2. The audio signal is subjected to a first gain processing, and gain 1 is used as a gain value to obtain a first gain signal. The audio signal is subjected to a second gain processing, and gain 2 is used as a gain value to obtain a second gain signal. The above gain processing steps are repeated until all gain processings are performed on the audio signal to obtain all gain signals, such as a first gain signal, a second gain signal, and the like.

[0052] In this way, the audio signal can be subjected to multiple gain processing to obtain different gain signals. These gain signals can be used in different audio processing applications, such as audio enhancement, audio restoration, audio noise reduction, etc. Among them, the enhancement parameters are pre-set based on the usage scenario and product requirements, and the specific values ​​are not limited in the embodiments of the present disclosure.

[0053] In the present disclosure, the specific gain processing method is as follows: Figure 3 In the figure, X represents the multiplication operation step, >> represents the shift operation, i.e., the division operation step. DG represents the digital gain, i.e., an 8-bit array. Gi represents the range of the gain parameter, G[Gi] represents the gain value within the gain range, and M represents the array value, i.e., a shift operation, for example, M=0 means a 4-bit shift to the right.

[0054] Step 203: Determine the strength of at least two gain signals.

[0055] In the embodiment of the present disclosure, the at least two gain signals refer to audio signals that have been subjected to gain processing.

[0056] To determine the strength of at least two gain signals, the energy or amplitude of each gain signal may be calculated. Specifically, the energy may be calculated using the square value of the signal, or the amplitude may be calculated using the absolute value of the signal. The gain signal strength may be determined by the energy or amplitude of each gain signal.

[0057] Step 204: If the strength of the at least two gain signals is greater than the at least two noise parameters, determine that the at least two gain signals are at least two processed signals.

[0058] In an embodiment of the present disclosure, at least two noise parameters are required, such as noise 1 and noise 2, and noise suppression is performed on the gain signal obtained after the first gain processing. If the first gain signal is greater than noise 1, the first gain signal is determined as the first processing signal output by the enhanced processing circuit. Noise suppression is performed on the gain signal obtained after the second gain processing. If the second gain signal is greater than noise 2, the second gain signal is determined as the second processing signal output by the enhanced processing circuit. Repeat the above noise suppression steps until all line processing is performed on the audio signal to obtain all processing signals, such as the first processing signal, the second processing signal, etc.

[0059] In addition, if the strength of at least two gain signals is less than or equal to at least two noise parameters, the output is 0, or it is determined that the current gain signal is distorted and no processed signal is output.

[0060] Among them, the suppression parameters are pre-set based on the usage scenario and product requirements, and the specific values ​​are not limited in the embodiments of the present disclosure.

[0061] In the present disclosure, the specific noise suppression method is achieved by Figure 4 Implementation, in the figure represents the input gain signal, Threshold noise parameter, that is, the noise threshold value.

[0062] Step 205: determine energy values ​​of at least two processed signals, where the energy values ​​represent amplitudes of the at least two processed signals.

[0063] In the embodiment of the present disclosure, the energy value of each processed signal is calculated by an energy calculation method based on the amplitude of the processed signal. By comparing the energy values ​​of two processed signals, the amplitude relationship between them can be obtained.

[0064] Step 206: Compare at least two processed signals based on the energy values ​​to see whether they are similar, and obtain a first comparison result.

[0065] In an embodiment of the present disclosure, if the difference in energy values ​​of at least two processed signals is less than or equal to a preset threshold, it is determined that the at least two processed signals are similar; if the difference in energy values ​​of at least two processed signals is greater than the preset threshold, it is determined that the at least two processed signals are dissimilar.

[0066] The comparison of whether at least two processed signals are similar is performed by comparing the two processed signals, and the comparison process is to compare the processed signal with the largest energy value among the at least two processed signals with the other processed signals. The value of the preset threshold is set according to actual needs and is not limited in the embodiment of the present disclosure.

[0067] Step 207: output a first processed signal of at least two processed signals based on the first comparison result.

[0068] In an embodiment of the present disclosure, based on the first comparison result and the strength of the two processed signals, a first processed signal is output. The strengths of at least two processed signals are compared to obtain a second processed signal, the second processed signal having the largest strength among the at least two processed signals; if at least two processed signals are similar, the second processed signal is used as the first processed signal; if at least two processed signals are not similar, a third processed signal among the at least two processed signals is determined, and the third processed signal is used as the first processed signal, the third processed signal being smaller than the second processed signal.

[0069] In the present disclosure, the strengths of the two processed signals are compared, and the processed signal with the largest strength of the current processed signal is determined. If the two processed signals are similar, the processed signal with the largest strength is determined to be normal, and the processed signal with the largest strength is output as the first processed signal. If the two processed signals are not similar, the processed signal with the largest strength is determined to be distorted, and the first processed signal with the strength second only to the maximum strength among at least two processed signals is determined, and the processed signal is output.

[0070] In summary, through the method provided by the present invention, an audio signal is acquired through an audio acquisition device, and gain processing is performed on the audio signal at least twice based on at least two enhancement parameters to acquire at least two gain signals, and the strength of the at least two gain signals is determined. If the strength of the at least two gain signals is greater than at least two noise parameters, the at least two gain signals are determined to be at least two processed signals, and the energy values ​​of the at least two processed signals are determined. The energy values ​​characterize the amplitudes of the at least two processed signals. Based on the energy values, the at least two processed signals are compared to see whether they are similar, and a first comparison result is obtained. Based on the first comparison result, a first processed signal of the at least two processed signals is output, so as to realize different audio enhancement processing on the audio signal collected by a single microphone at the same time, reduce hardware costs, and increase the strength range of the audio signal, so as to improve the dynamic range performance of the microphone pickup.

[0071] based on Figure 1 , Figure 2 The embodiment shown, as Figure 5 A schematic diagram of a specific audio pickup method is shown.

[0072] In the embodiment of the present disclosure, the gain processing and noise suppression modules are implemented by digital hardware circuits. Under high process technology, the hardware cost of this circuit is relatively low.

[0073] The audio signal (in) obtained by a single audio acquisition device, such as a microphone (MIC), is input into multiple enhanced processing circuits, and gain processing and noise suppression are performed on the audio signal respectively, and the corresponding data is output to the subsequent noise suppression algorithm for use.

[0074] For example, for the first line, Line_1 configures DG (gain parameter) = 0dB; the NS (noise parameter) threshold is -60dB, when in (audio signal) is greater than -60dB, Out1 (processed signal) output is valid; when in (audio signal) is less than -60dB, Out1 (processed signal) outputs 0.

[0075] For the second line, Line_2 is configured with DG=24dB; the NS threshold is 0dB. When in is greater than -24dB, the output of Out2 is distorted; when in is less than -24dB, the output of Out1 is valid.

[0076] For the third line, Line_3 is configured with DG=0dB and NS threshold is 0dB.

[0077] Perform similarity comparison between Out3 signal and out1 signal: Out3 signal can perform noise suppression when out1 outputs 0.

[0078] Perform similarity comparison on Out3 and Out2 signals: Out3 signal can be dynamically gain controlled when Out1 output is distorted.

[0079] Among them, the enhanced processing lines and the enhanced parameters in each line are set according to actual needs and are not shown in the embodiment of the present disclosure.

[0080] After similarity comparison processing of multiple signals, a high-intensity signal can be output, effectively improving the dynamic range and signal-to-noise ratio of the input signal.

[0081] In summary, the method disclosed in the present invention mainly improves the dynamic range of the sound pickup signal, and can be used for picking up relatively small sound signals as well as signals in high-volume scenarios, and ensures that the sound is not distorted and has noise suppression capabilities.

[0082] Figure 6FIG. 6 is a schematic diagram of the structure of an audio pickup device 600 provided in an embodiment of the present disclosure. Figure 6 As shown, the audio pickup device comprises:

[0083] An acquisition unit 610 is used to acquire an audio signal through an audio acquisition device;

[0084] A processing unit 620 is used to perform at least two enhancement processes on the audio signal to obtain at least two processed signals, wherein enhancement parameters of the at least two enhancement processes are different;

[0085] The output unit 630 is used to compare whether the at least two processed signals are similar, and output a first processed signal of the at least two processed signals based on a first comparison result.

[0086] In some embodiments, the enhancement parameters include gain parameters and noise parameters, and the processing unit 620 is used to: perform gain processing on the audio signal at least twice based on at least two enhancement parameters to obtain at least two gain signals; determine the strength of the at least two gain signals, and if the strength of the at least two gain signals is greater than the at least two noise parameters, determine that the at least two gain signals are at least two processed signals.

[0087] In some embodiments, the output unit 630 is used to: determine the energy value of at least two processed signals, the energy value characterizing the amplitude of the at least two processed signals; based on the energy value, compare whether the at least two processed signals are similar to obtain a first comparison result; based on the first comparison result, output the first processed signal of the at least two processed signals.

[0088] In some embodiments, the output unit 630 is used to: if the difference in energy values ​​of at least two processed signals is less than or equal to a preset threshold, determine that at least two processed signals are similar; if the difference in energy values ​​of at least two processed signals is greater than a preset threshold, determine that at least two processed signals are dissimilar.

[0089] In some embodiments, the output unit 630 is used to: compare the strengths of at least two processed signals to obtain a second processed signal, the second processed signal having the highest strength among the at least two processed signals; if at least two processed signals are similar, use the second processed signal as the first processed signal; if at least two processed signals are not similar, determine a third processed signal among the at least two processed signals, and use the third processed signal as the first processed signal, the third processed signal being smaller than the second processed signal.

[0090] In summary, an audio signal is acquired through an audio pickup device through an audio acquisition device; the audio signal is enhanced at least twice to obtain at least two processed signals, and the enhancement parameters of at least two enhancement processes are different; the at least two processed signals are compared to see whether they are similar, and based on the first comparison result, the first processed signal of the at least two processed signals is output, so as to achieve different audio enhancement processing on the audio signal collected by a single audio acquisition device at the same time, reduce hardware costs, and increase the intensity range of audio signals, so as to improve the dynamic range performance of microphone pickup.

[0091] Corresponding to the methods provided in the above-mentioned embodiments, the present disclosure further provides an audio pickup device. Since the device provided in the embodiment of the present disclosure corresponds to the methods provided in the above-mentioned embodiments, the implementation method of the method is also applicable to the device provided in this embodiment and will not be described in detail in this embodiment.

[0092] In the embodiments provided in the present application, the methods and devices provided in the embodiments of the present application are introduced. In order to implement the functions in the methods provided in the embodiments of the present application, the electronic device may include a hardware structure and a software module, and implement the functions in the form of a hardware structure, a software module, or a hardware structure plus a software module. A function of the functions may be executed in the form of a hardware structure, a software module, or a hardware structure plus a software module.

[0093] Figure 7 is a block diagram of an electronic device 700 for implementing the above-mentioned audio pickup method according to an exemplary embodiment. For example, the electronic device 700 may be a mobile phone, a computer, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc.

[0094] Reference Figure 7 , the electronic device 700 may include one or more of the following components: a processing component 702 , a memory 704 , a power component 706 , a multimedia component 708 , an audio component 710 , an input / output (I / O) interface 712 , a sensor component 714 , and a communication component 716 .

[0095] The processing component 702 generally controls the overall operation of the electronic device 700, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 702 may include one or more processors 720 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 702 may include one or more modules to facilitate the interaction between the processing component 702 and other components. For example, the processing component 702 may include a multimedia module to facilitate the interaction between the multimedia component 708 and the processing component 702.

[0096] The memory 704 is configured to store various types of data to support operations on the electronic device 700. Examples of such data include instructions for any application or method operating on the electronic device 700, contact data, phone book data, messages, pictures, videos, etc. The memory 704 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0097] The power supply component 706 provides power to the various components of the electronic device 700. The power supply component 706 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 700.

[0098] The multimedia component 708 includes a screen that provides an output interface between the electronic device 700 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes a touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 708 includes a front camera and / or a rear camera. When the electronic device 700 is in an operating mode, such as a shooting mode or a video mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0099] The audio component 710 is configured to output and / or input audio signals. For example, the audio component 710 includes a microphone (MIC), and when the electronic device 700 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signal can be further stored in the memory 704 or sent via the communication component 716. In some embodiments, the audio component 710 also includes a speaker for outputting audio signals.

[0100] I / O interface 712 provides an interface between processing component 702 and peripheral interface modules, such as keyboards, click wheels, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0101] The sensor assembly 714 includes one or more sensors for providing various aspects of status assessment for the electronic device 700. For example, the sensor assembly 714 can detect the open / closed state of the electronic device 700, the relative positioning of components, such as the display and keypad of the electronic device 700, and the sensor assembly 714 can also detect the position change of the electronic device 700 or a component of the electronic device 700, the presence or absence of user contact with the electronic device 700, the orientation or acceleration / deceleration of the electronic device 700, and the temperature change of the electronic device 700. The sensor assembly 714 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 714 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 714 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0102] The communication component 716 is configured to facilitate wired or wireless communication between the electronic device 700 and other devices. The electronic device 1000 can access a wireless network based on a communication standard, such as WiFi, 2G or 3G, 4G LTE, 5G NR (NewRadio) or a combination thereof. In an exemplary embodiment, the communication component 716 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 716 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0103] In an exemplary embodiment, the electronic device 700 may be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors, or other electronic components to perform the above methods.

[0104] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 704 including instructions, and the instructions can be executed by a processor 720 of an electronic device 700 to perform the above method. For example, the non-transitory computer-readable storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0105] The embodiments of the present disclosure further provide a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to enable a computer to execute the audio pickup method described in the above embodiments of the present disclosure.

[0106] The embodiments of the present disclosure further provide a computer program product, including a computer program. The computer program executes the audio pickup method described in the above embodiments of the present disclosure when a processor is used.

[0107] The embodiment of the present disclosure also provides a chip, such as Figure 8 As shown, the chip includes one or more interface circuits 801 and one or more processors 802; the interface circuit is used to receive signals and send signals to the processor, the signals include computer instructions stored in the memory, when the processor executes the computer instructions, the chip executes the audio pickup method described in the above embodiment of the present disclosure.

[0108] It should be noted that the terms "first", "second", etc. in the specification and claims of the present disclosure and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present disclosure described herein can be implemented in an order other than those illustrated or described herein. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0109] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples" or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiments or examples are included in at least one embodiment or example of the present invention. In this specification, the schematic representation of the above terms does not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner.

[0110] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a specific logical function or process, and the scope of the preferred embodiments of the present invention includes alternative implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present invention belong.

[0111] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processing module, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (control method), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or otherwise processing in a suitable manner if necessary, and then stored in a computer memory.

[0112] It should be understood that the various parts of the embodiments of the present invention can be implemented by hardware, software, firmware or a combination thereof. In the above embodiments, multiple steps or methods can be implemented by software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented by hardware, as in another embodiment, it can be implemented by any one of the following technologies known in the art or their combination: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0113] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0114] In addition, each functional unit in each embodiment of the present invention may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium. The above-mentioned storage medium may be a read-only memory, a disk or an optical disk, etc.

[0115] Although the embodiments of the present invention have been shown and described above, it is to be understood that the above embodiments are exemplary and are not to be construed as limitations of the present invention. A person skilled in the art may make changes, modifications, substitutions and variations to the above embodiments within the scope of the present invention.

Claims

1. An audio pickup method, characterized in that: The method comprises: Acquire audio signals through audio acquisition equipment; Performing enhancement processing on the audio signal at least twice to obtain at least two processed signals, wherein enhancement parameters of the at least two enhancement processings are different; The at least two processed signals are compared to determine whether they are similar, and based on a first comparison result, a first processed signal of the at least two processed signals is output.

2. The method according to claim 1, characterized in that The enhancement parameters include a gain parameter and a noise parameter, and performing enhancement processing on the audio signal at least twice to obtain at least two processed signals includes: Performing gain processing on the audio signal at least twice based on the at least two enhancement parameters to obtain at least two gain signals; determining the strengths of the at least two gain signals, If the strengths of the at least two gain signals are greater than the at least two noise parameters, the at least two gain signals are determined to be the at least two processed signals.

3. The method according to claim 2, characterized in that The comparing whether the at least two processed signals are similar and outputting a first processed signal of the at least two processed signals based on the first comparison result comprises: Determining energy values ​​of the at least two processed signals, wherein the energy values ​​represent amplitudes of the at least two processed signals; Based on the energy value, comparing whether the at least two processed signals are similar to obtain a first comparison result; Based on the first comparison result, a first processed signal of the at least two processed signals is output.

4. The method according to claim 3, characterized in that The comparing, based on the energy values, whether the at least two processed signals are similar to obtain a first comparison result comprises: If the difference between the energy values ​​of the at least two processed signals is less than or equal to a preset threshold, determining that the at least two processed signals are similar; If the difference between the energy values ​​of the at least two processed signals is greater than the preset threshold, it is determined that the at least two processed signals are not similar.

5. The method according to claim 3, characterized in that: The outputting the first processed signal or the second processed signal based on the first comparison result comprises: Comparing the strengths of the at least two processed signals to obtain a second processed signal, wherein the second processed signal has the largest strength among the at least two processed signals; If the at least two processed signals are similar, using the second processed signal as the first processed signal; If the at least two processed signals are not similar, a third processed signal among the at least two processed signals is determined, and the third processed signal is used as the first processed signal, and the third processed signal is smaller than the second processed signal.

6. An audio pickup device, characterized in that: The device comprises: An acquisition unit, used for acquiring an audio signal through an audio acquisition device; a processing unit, configured to perform at least two enhancement processes on the audio signal to obtain at least two processed signals, wherein enhancement parameters of the at least two enhancement processes are different; The output unit is used to compare whether the at least two processed signals are similar, and output a first processed signal of the at least two processed signals based on a first comparison result.

7. An electronic device, characterized in that: include: at least one processor; as well as a memory communicatively connected to the at least one processor; wherein, The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor to enable the at least one processor to perform the method according to any one of claims 1 to 5.

8. A non-transitory computer-readable storage medium storing computer instructions, characterized in that: The computer instructions are used to cause the computer to execute the method according to any one of claims 1-5.

9. A chip, characterized in that: It comprises one or more interface circuits and one or more processors; the interface circuit is used to receive a signal and send the signal to the processor, the signal includes a computer instruction stored in a memory, and when the processor executes the computer instruction, the chip executes the method described in any one of claims 1 to 5.

Images