Vehicle-mounted audio processing method based on voice microphone and handheld microphone and vehicle

Abstract

The invention discloses a vehicle-mounted audio processing method based on a voice microphone and a handheld microphone and a vehicle. The method comprises the following steps: acquiring a first audio signal acquired by a voice microphone in a vehicle and a second audio signal acquired by a handheld microphone in the vehicle; performing optimization processing and logarithmic compression processing on the first audio signal and the second audio signal to obtain a sound mixing human voice signal; and performing sound mixing processing on the sound mixing human voice signal and the accompaniment audio to obtain and play the to-be-played audio, thereby solving the problem of poor in-vehicle karaoke effect, performing optimization and logarithmic compression processing on the first audio signal and the second audio signal to obtain the sound mixing human voice signal with a better sound effect, and improving the user experience. The audio signals collected by the voice microphone and the handheld microphone are subjected to sound mixing processing, the advantages of the two kinds of audio signals are combined, the signals are subjected to sound mixing processing through logarithmic compression, noise is prevented from being too large, the sound effect quality is improved, and then the user experience is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of vehicle control, and in particular to a vehicle-mounted audio processing method based on a voice microphone and a handheld microphone and a vehicle. Background Art

[0002] In the existing in-car entertainment system, karaoke function has become one of the important entertainment methods pursued by users. However, the karaoke methods currently on the market mainly rely on handheld microphones or in-car voice microphones, both of which have certain problems or defects.

[0003] For karaoke with a voice microphone in the car, the main problems lie in the sound pickup effect and sound quality processing. The voice microphone in the car is usually designed as a far-field microphone, which is mainly used for voice interaction functions and has a wide sound pickup range. However, in the karaoke scene, this often leads to the collection of too much ambient noise, reducing the sound quality experience of karaoke. In addition, due to the limited space in the car, the layout and position of the voice microphone may also affect the uniformity and clarity of the karaoke effect. For karaoke with a handheld microphone in the car, users are required to operate it by hand, which may distract the driver's attention during driving and increase driving risks. Secondly, the scope of use of the handheld microphone is limited by the user's range of activities, and the chorus or interaction between passengers may be restricted. It can be seen from this that the karaoke method of the existing in-car entertainment system limits the user experience and interactivity of the karaoke function in the car, and it is difficult to meet the user's demand for a high-quality karaoke experience. Summary of the invention

[0004] The invention provides a vehicle-mounted audio processing method based on a voice microphone and a handheld microphone and a vehicle, so as to solve the problem of poor effect of vehicle-mounted karaoke.

[0005] According to one aspect of the present invention, a vehicle-mounted audio processing method based on a voice microphone and a handheld microphone is provided, comprising:

[0006] Acquire a first audio signal collected by a voice microphone in the vehicle and a second audio signal collected by a handheld microphone in the vehicle;

[0007] Performing optimization processing and logarithmic compression processing on the first audio signal and the second audio signal to obtain a mixed vocal signal;

[0008] The mixed vocal signal is mixed with the accompaniment audio to obtain the audio to be played and play it.

[0009] According to another aspect of the present invention, a vehicle is provided, the vehicle comprising:

[0010] At least one voice microphone, used to collect a first audio signal;

[0011] at least one handheld microphone, for collecting a second audio signal;

[0012] at least one processor, and a memory communicatively coupled to the at least one processor;

[0013] Among them, the memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the in-vehicle audio processing method based on a voice microphone and a handheld microphone described in any embodiment of the present invention.

[0014] According to another aspect of the present invention, a computer-readable storage medium is provided, wherein the computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the vehicle-mounted audio processing method based on a voice microphone and a handheld microphone as described in any embodiment of the present invention when executed.

[0015] According to another aspect of the present invention, a computer program product is provided, the computer program product comprising a computer program, and the computer program, when executed by a processor, implements the in-vehicle audio processing method based on a voice microphone and a handheld microphone as described in any embodiment of the present invention.

[0016] The technical solution of the embodiment of the present invention is to obtain a first audio signal collected by a voice microphone in a vehicle and a second audio signal collected by a handheld microphone in the vehicle; optimize and logarithmically compress the first audio signal and the second audio signal to obtain a mixed vocal signal; mix the mixed vocal signal with the accompaniment audio to obtain the audio to be played and play it, thereby solving the problem of poor karaoke effect in the car, and simultaneously installing a voice microphone and a handheld microphone in the vehicle for audio collection, and optimizing and logarithmically compressing the first audio signal and the second audio signal to obtain a mixed vocal signal with better sound effect, and mixing the audio signals collected by the voice microphone and the handheld microphone to avoid problems caused by using one microphone to collect audio signals, combining the advantages of the two audio signals, and mixing the signals through logarithmic compression to avoid excessive noise, improve the sound quality, and thus improve the user experience.

[0017] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0019] Figure 1 is a flow chart of a vehicle audio processing method based on a voice microphone and a handheld microphone provided according to Embodiment 1 of the present invention;

[0020] Figure 2 is a flow chart of a vehicle audio processing method based on a voice microphone and a handheld microphone provided according to Embodiment 2 of the present invention;

[0021] Figure 3 This is an example diagram of an implementation of audio processing provided according to Embodiment 2 of the present invention;

[0022] Figure 4 This is an example diagram of an implementation flow of audio processing provided according to Embodiment 2 of the present invention;

[0023] Figure 5 is another example diagram of implementing audio processing according to Embodiment 2 of the present invention;

[0024] Figure 6 is an example diagram of another implementation flow of audio processing provided according to Embodiment 2 of the present invention;

[0025] Figure 7 is a compression result corresponding to a different compression factor provided by the second embodiment of the present invention;

[0026] Figure 8 is a schematic block diagram of the structure of a handheld microphone implemented according to Embodiment 2 of the present invention;

[0027] Fig. 9 is a structural schematic diagram of a vehicle-mounted audio processing device based on a voice microphone and a handheld microphone provided according to Embodiment 3 of the present invention;

[0028] Fig.10 The present invention is a schematic structural diagram of a vehicle for implementing the vehicle-mounted audio processing method based on a voice microphone and a handheld microphone according to an embodiment of the present invention. DETAILED DESCRIPTION

[0029] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0030] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0031] Embodiment 1

[0032] Figure 1 This is a flow chart of a vehicle audio processing method based on a voice microphone and a handheld microphone provided in the first embodiment of the present invention. This embodiment can be applied to the case of processing the audio collected by the voice microphone and the handheld microphone in the vehicle. The method can be executed by a vehicle audio processing device based on a voice microphone and a handheld microphone. The vehicle audio processing device based on a voice microphone and a handheld microphone can be implemented in the form of hardware and / or software. The vehicle audio processing device based on a voice microphone and a handheld microphone can be configured in a vehicle. Figure 1 As shown, the method includes:

[0033] S101. Acquire a first audio signal collected by a voice microphone in a vehicle and a second audio signal collected by a handheld microphone in the vehicle.

[0034] In this embodiment, the first audio signal and the second audio signal can both be understood as a type of audio signal, wherein the first audio signal is collected by a voice microphone, and the second audio signal is collected by a handheld microphone.

[0035] The number of voice microphones and handheld microphones in the vehicle can be one or more; among them, the voice microphones can be fixedly set at different positions in the vehicle, for example, one at the main driver's position, one at the co-driver's position, and one on the left and right of the back row, to collect the sounds made by passengers in different positions in the vehicle; the handheld microphone can be communicated with the vehicle system, and the passenger needs to hold it for operation when in use.

[0036] The voice microphone and the handheld microphone can be set to different states such as on / off, working / non-working, etc. through switches. When the voice microphone and the handheld microphone are turned on or working, they collect voice signals in the vehicle. Alternatively, the voice microphone and the handheld microphone can be set to be always on or always in working state to continuously collect audio signals in the vehicle. The audio signal collected by the voice microphone is recorded as the first audio signal, and the audio signal collected by the handheld microphone is recorded as the second audio signal.

[0037] S102: Perform optimization processing and logarithmic compression processing on the first audio signal and the second audio signal to obtain a mixed vocal signal.

[0038] In this embodiment, the mixed vocal signal can be understood as a signal obtained by mixing different audio signals, which is a mixture of audio signals collected by different microphones.

[0039] The first audio signal and the second audio signal are optimized and processed respectively. The optimization processing may be noise reduction, echo cancellation, etc. The two different audio signals are mixed before, during or after the optimization processing. Since mixing may cause the total amplitude of the signal to exceed the range of the floating-point PCM value -1-1, if directly mixed without processing, it may cause clipping or distortion and even introduce a lot of noise. Therefore, the present application processes the mixed audio signal through logarithmic compression, and obtains a mixed vocal signal after the above processing.

[0040] S103: Mix the mixed vocal signal with the accompaniment audio to obtain the audio to be played and play it.

[0041] In this embodiment, the audio to be played can be understood as audio data with a playback demand. The accompaniment audio can be obtained from the music player software. When the user sings karaoke in the car, he usually opens the music player software to play music, and the played audio can be used as the accompaniment audio. The accompaniment audio is obtained, and the mixed vocal signal is mixed with the accompaniment audio to obtain the audio to be played, wherein the mixing process can be directly mixing the mixed vocal signal with the accompaniment audio, and the obtained audio is the audio to be played, or the mixed vocal signal can be mixed with the accompaniment audio and then compressed, and the obtained audio is used as the audio to be played, and so on.

[0042] The embodiment of the present invention provides a vehicle-mounted audio processing method based on a voice microphone and a handheld microphone, which obtains a first audio signal collected by a voice microphone in a vehicle and a second audio signal collected by a handheld microphone in the vehicle; optimizes and logarithmically compresses the first audio signal and the second audio signal to obtain a mixed vocal signal; mixes the mixed vocal signal with the accompaniment audio to obtain the audio to be played and plays it, thereby solving the problem of poor karaoke effect in the car, and simultaneously installing a voice microphone and a handheld microphone in the vehicle for audio collection, and optimizing and logarithmically compressing the first audio signal and the second audio signal to obtain a mixed vocal signal with better sound effect. By mixing the audio signals collected by the voice microphone and the handheld microphone, the problems caused by using one microphone to collect audio signals are avoided, the advantages of the two audio signals are combined, and the signals are mixed through logarithmic compression to avoid excessive noise, improve the sound quality, and thus improve the user experience.

[0043] Embodiment 2

[0044] Figure 2 This is a flow chart of a vehicle audio processing method based on a voice microphone and a handheld microphone provided in the second embodiment of the present invention. This embodiment is refined on the basis of the above embodiment. Figure 2 As shown, the method includes:

[0045] S201. Acquire a first audio signal collected by a voice microphone in a vehicle and a second audio signal collected by a handheld microphone in the vehicle.

[0046] Optionally, obtaining a second audio signal collected by a handheld microphone in the vehicle includes:

[0047] The second audio signal collected by the handheld microphone is obtained through the universal serial bus interface of the external recording sound card and the playback sound card authorization.

[0048] In this embodiment, the universal serial bus interface is a USB interface. The voice microphone is connected to the vehicle system through the universal serial bus, and can be recognized by the vehicle system as an external recording sound card. After the voice microphone is connected to the vehicle system through the universal serial bus, the vehicle system needs to obtain the data collection and playback processing permissions of the handheld microphone through authorization and other means, and obtain the second audio signal collected by the handheld microphone with the permission. The handheld microphone can be wirelessly connected to the receiver (sound card) through a UHF signal or a 2.4G signal, and the receiver is connected to the vehicle through a USB or Type-C interface. After the receiver and the vehicle are authorized by the protocol, the sound upload and control operation are uploaded to the vehicle system. By providing a USB interface that can be identified as an external recording sound card and a playback sound card authorization, a seamless connection between the handheld microphone and the vehicle system is achieved. Users can use a handheld microphone for karaoke at any location in the car without worrying about unstable or delayed connections. At the same time, since the use of the handheld microphone does not depend on the driver's operation, it will not affect driving safety.

[0049] In terms of hardware configuration, the accuracy and clarity of sound collection of professional handheld microphones are selected to ensure the quality of sound collection and transmission. The design of the microphone also fully considers ergonomics and comfort, which is convenient for users to use for a long time. In addition, in terms of connection methods, wireless or wired methods are used to connect to the car system to ensure the stable transmission of audio signals. At the same time, by providing a USB interface that can be identified as an external recording sound card and a playback sound card authorization, seamless docking with the car system is achieved to ensure the compatibility and ease of use of the handheld microphone in the car karaoke. In terms of sound quality processing, the handheld microphone solution also uses advanced audio processing algorithms, including noise reduction algorithms and echo cancellation algorithms, to finely process the collected sound and further improve the sound quality performance. In terms of function expansion, the handheld microphone also supports a variety of sound effects and mixing functions, and users can personalize them according to their preferences and needs to achieve a richer karaoke experience. In order to facilitate user use, the handheld microphone solution also supports a variety of operation modes and control methods, such as touch control, voice control, etc., to meet the needs of different users.

[0050] The embodiment of the present application provides two different logarithmic compression mixing modes. After S201, S202-S203 can be executed to perform logarithmic compression mixing processing, or S204-S208 can be executed to perform logarithmic compression mixing processing. After completing the logarithmic compression mixing processing, a mixed vocal signal is generated. Finally, S209 is executed to mix the mixed vocal signal with the accompaniment audio to obtain the audio to be played and play it. In the implementation process, the logarithmic compression mixing processing can be completed by selecting one of the branches to execute. Both branches can also be executed to obtain two groups of mixed vocal signals, and the two groups of mixed vocal signals are weighted to finally obtain a group of mixed vocal signals.

[0051] S202: Optimize the first audio signal to obtain a first audio signal to be mixed, and optimize the second audio signal to obtain a second audio signal to be mixed.

[0052] In this embodiment, the first audio signal to be mixed can be understood as an audio signal obtained after the first audio signal is optimized and processed, and is used for subsequent mixing processing. The second audio signal to be mixed can be understood as an audio signal obtained after the second audio signal is optimized and processed, and is used for subsequent mixing processing.

[0053] The first audio signal is subjected to optimization processing such as echo noise reduction and echo cancellation, and the algorithm and processing flow used for the optimization processing can be preset. When data processing is performed, data processing is performed according to the preset algorithm and processing flow to obtain the first audio signal to be mixed. Similarly, the second audio signal is subjected to optimization processing such as echo noise reduction and echo cancellation, and the algorithm and processing flow used for the optimization processing can also be preset. When data processing is performed, data processing is performed according to the preset algorithm and processing flow to obtain the second audio signal to be mixed. The first audio signal and the second audio signal can be processed using the same algorithm and flow, or they can be processed using different algorithms and flows.

[0054] For the first audio signal collected by the voice microphone, algorithms such as reverberation, noise reduction and anti-howling, and echo cancellation can be placed in the DSP, or deployed in the car SOC, or deployed on the application APP side. Utilizing the high-performance processing capabilities of the SOC chip or DSP chip of the car system, the above algorithms are executed to effectively reduce the impact of environmental noise and echo on the sound quality, and achieve better audio processing effects. At the same time, by optimizing the algorithm and the selection and location layout of the voice microphone in the car, the impact of the physical location on the audio processing effect is reduced, and the sound quality and listening experience of karaoke are further improved. In response to the system processing delay problem caused by the voice channel shared with the car system, low-latency transmission and processing of audio signals can be achieved by customizing exclusive audio channels and optimizing system scheduling algorithms. This ensures the real-time and smoothness of karaoke and improves the user experience. By optimizing the system architecture and algorithms, the delay and distortion of audio signals during transmission and processing are reduced, ensuring the real-time and smoothness of voice karaoke in the car. The embodiments of the present application can also achieve karaoke sound quality assurance through functions such as artificial reverberation (AR), equalizer (EQ), voice pitch variation (VC), voice enhancement (VE), and sound zone selection, ensuring that a good karaoke experience can be obtained in every position in the car.

[0055] S203 , performing logarithmic compression mixing processing on the first audio signal to be mixed and the second audio signal to be mixed to obtain a mixed vocal signal.

[0056] The first audio signal to be mixed and the second audio signal to be mixed are mixed, for example, the first audio signal to be mixed and the second audio signal to be mixed are superimposed together, it is determined whether the mixed signal needs to be compressed, and the signal to be compressed is compressed by logarithmic compression to obtain a mixed vocal signal. Logarithmic compression refers to performing logarithmic transformation on a signal to compress the signal to a value smaller than the original value.

[0057] Optionally, performing logarithmic compression mixing processing on the first audio signal to be mixed and the second audio signal to be mixed to obtain a mixed vocal signal includes:

[0058] A1. Process the first audio signal to be mixed and the second audio signal to be mixed into signals with the same sampling rate and sampling accuracy, and add the digital samples of each sampling point to obtain a corresponding mixed signal.

[0059] In this embodiment, the mixed signal can be understood as a signal obtained by mixing two audio signals. The first audio signal to be mixed and the second audio signal to be mixed are sampled, and the sampling rate and sampling accuracy can be pre-set. Sampling is performed according to the sampling rate and sampling accuracy, and the first audio signal to be mixed and the second audio signal to be mixed are processed into signals with the same sampling rate and sampling accuracy to obtain digital samples of multiple sampling points, and the number of sampling points is related to the sampling rate. The digital samples of each sampling point are added, that is, for each sampling point, the digital sample corresponding to the first audio signal to be mixed and the digital sample corresponding to the second audio signal to be mixed are added to obtain the corresponding mixed signal.

[0060] A2. For the mixed signal corresponding to each sampling point, if the absolute value of the mixed signal is greater than a preset threshold, logarithmically compress the mixed signal to obtain a compressed mixed signal.

[0061] In this embodiment, the preset threshold value can be set in advance according to the model of the microphone, the data acquisition capability, etc. For the mixed signal corresponding to each sampling point, the absolute value of the mixed signal is compared with the preset threshold value. If the absolute value of the mixed signal is greater than the preset threshold value, the mixed signal needs to be logarithmically compressed to be below the preset threshold value to obtain a compressed mixed signal; if the absolute value of the mixed signal is not greater than the preset threshold value, the mixed signal does not need to be logarithmically compressed.

[0062] A3. Generate a mixed vocal signal based on the mixed signal corresponding to each sampling point or the compressed mixed signal.

[0063] If each sampling point is compressed, the compressed mixed signal is used to replace the original mixed signal, and a mixed vocal signal is generated based on the mixed signal finally corresponding to each sampling point, wherein the mixed signal corresponding to the sampling point may be a compressed mixed signal or an unprocessed mixed signal.

[0064] For example, Figure 3 An example diagram for implementing audio processing is provided, in which a handheld microphone sound effect processing algorithm is deployed on the receiver side of the handheld microphone hardware, and a voice microphone algorithm is deployed on the middleware. The karaoke vocals are collected by a handheld microphone and a voice microphone. The first audio signal collected by the voice microphone is processed by ADC (analog to digital converter) / A2B (vehicle audio bus), and the second audio signal collected by the handheld microphone is processed by the receiver. The handheld microphone algorithm is set in the receiver to perform one or more processing such as echo cancellation, noise reduction, anti-howling, and sound effect processing on the audio. The two processed audio signals are processed by the karaoke core algorithm, which is deployed on the middleware. The first audio signal processed by ADC / A2B is further processed by one or more processing such as echo cancellation, noise reduction, anti-howling, and sound effect processing, and then the two audio signals corresponding to the handheld microphone and the voice microphone are mixed with the vocals. The mixed vocals and the karaoke accompaniment provided by the karaoke APP are mixed and played through the audio hardware. The core algorithm of the audio processing method provided in this embodiment can be deployed in the car computer HAL layer and Android application APP; the algorithm is responsible for calling the corresponding algorithm to process the human voice according to different human voice inputs, including echo cancellation, noise reduction, anti-howling, sound effect processing, etc., and then the two processed human voices are mixed on the middleware side and output; the mixed human voice is then mixed with the accompaniment of the karaoke APP, and then played through the car computer speaker.

[0065] For example, Figure 4 An example diagram of the implementation process of audio processing is provided. The first audio signal collected by the voice microphone is processed by AEC acoustic echo cancellation, ANS adaptive noise suppression, AGC automatic gain (voice), EQ equalizer, REVERB reverberator, Pitch voice changer and DRC dynamic range in sequence; the second audio signal collected by the handheld microphone is processed by AEC acoustic echo cancellation, ANS adaptive noise suppression, AGC automatic gain (voice), EQ equalizer, REVERB reverberator, Pitch voice changer and DRC dynamic range in sequence. The two audio signals corresponding to the voice microphone and the handheld microphone are mixed with human voice, mixed with karaoke accompaniment after mixing and limiting processing, and then played through audio hardware. Among them, the audio signal after mixing and limiting processing can also be used as an AEC reference signal for acoustic echo cancellation. Among them, limiting processing is logarithmic compression.

[0066] S204: Optimize the first audio signal to obtain a third audio signal to be mixed, and optimize the second audio signal to obtain a fourth audio signal to be mixed.

[0067] In this embodiment, the third audio signal to be mixed can be understood as an audio signal obtained after the first audio signal is optimized and processed, and is used for subsequent mixing processing. The fourth audio signal to be mixed can be understood as an audio signal obtained after the second audio signal is optimized and processed, and is used for subsequent mixing processing.

[0068] The first audio signal is subjected to optimization processing such as echo noise reduction and echo cancellation, and the algorithm, processing flow, etc. used in the optimization processing can be preset. When data processing is performed, data processing is performed according to the preset algorithm and processing flow to obtain a third audio signal to be mixed; wherein the third signal to be mixed is different from the first signal to be mixed, and it can be two signals obtained by processing with different algorithms or processes. The second audio signal is subjected to optimization processing such as echo noise reduction and echo cancellation, and the algorithm, processing flow, etc. used in the optimization processing can also be preset. When data processing is performed, data processing is performed according to the preset algorithm and processing flow to obtain a fourth audio signal to be mixed, wherein the fourth signal to be mixed is different from the second signal to be mixed, and it can be two signals obtained by processing with different algorithms or processes. The third audio signal and the fourth audio signal can be processed using the same algorithm and flow, or they can be processed using different algorithms and flows.

[0069] S205 : Process the third audio signal to be mixed and the fourth audio signal to be mixed into signals with the same sampling rate and sampling accuracy, and add the digital samples of each sampling point to obtain a mixed signal corresponding to each sampling point.

[0070] The third audio signal to be mixed and the fourth audio signal to be mixed are sampled, and the sampling rate and sampling accuracy can be preset. The sampling is performed according to the sampling rate and sampling accuracy, and the third audio signal to be mixed and the fourth audio signal to be mixed are processed into signals with the same sampling rate and sampling accuracy to obtain digital samples of multiple sampling points, and the number of sampling points is related to the sampling rate. The digital samples of each sampling point are added, that is, for each sampling point, the digital sample corresponding to the third audio signal to be mixed and the digital sample corresponding to the fourth audio signal to be mixed are added to obtain the mixed signal corresponding to each sampling point.

[0071] S206: Optimize the mixed signals corresponding to all sampling points to obtain the audio signal to be compressed corresponding to each sampling point.

[0072] In this embodiment, the audio signal to be compressed can be understood as an audio signal with data compression requirements. The mixed signals corresponding to all sampling points are further optimized, such as reverberation, voice change, equalization, etc., to obtain the audio signal to be compressed corresponding to each sampling point.

[0073] S207 . For the audio signal to be compressed corresponding to each sampling point, if the absolute value of the audio signal to be compressed is greater than a preset threshold, logarithmic compression is performed on the audio signal to obtain a compressed mixed signal.

[0074] For the mixed signal corresponding to each sampling point, the absolute value of the mixed signal is compared with the preset threshold. If the absolute value of the mixed signal is greater than the preset threshold, the mixed signal needs to be logarithmically compressed to be below the preset threshold to obtain a compressed mixed signal; if the absolute value of the mixed signal is not greater than the preset threshold, there is no need to logarithmically compress the mixed signal.

[0075] S208: Generate a mixed vocal signal based on the mixed signal corresponding to each sampling point or the compressed mixed signal.

[0076] If each sampling point is compressed, the compressed mixed signal is used to replace the original mixed signal, and a mixed vocal signal is generated based on the mixed signal finally corresponding to each sampling point, wherein the mixed signal corresponding to the sampling point may be a compressed mixed signal or an unprocessed mixed signal.

[0077] S209: Mix the mixed vocal signal with the accompaniment audio to obtain the audio to be played and play it.

[0078] For example, Figure 5Another example diagram of the implementation of audio processing is provided, in which the handheld microphone sound effect processing algorithm and the voice microphone algorithm are deployed in the middleware. The karaoke vocals are collected by the handheld microphone and the voice microphone. The first audio signal collected by the voice microphone is processed by ADC (analog to digital converter) / A2B (vehicle audio bus), and the second audio signal collected by the handheld microphone is transmitted to the middleware through the receiver. The two audio signals are processed by the karaoke core algorithm of the middleware, and one or more processing such as echo cancellation, noise reduction, anti-howling, and sound effect processing are performed on the first audio signal and the second audio signal. Then, the two audio signals corresponding to the handheld microphone and the voice microphone are mixed with the vocals. The mixed vocals and the karaoke accompaniment provided by the karaoke APP are mixed and played through the audio hardware. The core algorithm of the audio processing method provided in this embodiment can be deployed in the car computer HAL layer and Android application APP; the algorithm is responsible for calling the corresponding algorithm to process the human voice according to different human voice inputs, including echo cancellation, noise reduction, anti-howling, sound effect processing, etc.; the two processed human voices are mixed on the middleware side and output; the mixed human voice is mixed with the accompaniment of the karaoke APP, and then played through the car computer speaker.

[0079] For example, Figure 6 Another example diagram of the implementation process of audio processing is provided. The first audio signal collected by the voice microphone is processed by AEC acoustic echo cancellation, ANS adaptive noise suppression, and AGC automatic gain (voice) in sequence, and the second audio signal collected by the handheld microphone is processed by AEC acoustic echo cancellation, ANS adaptive noise suppression, and AGC automatic gain (voice) in sequence. Then the two audio channels are mixed, and the mixed audio is processed by EQ equalizer, REVERB reverberator, Pitch voice changer and DRC dynamic range in sequence, and then limited. The audio signal after the limiting process is mixed with the karaoke accompaniment, and then played through the audio hardware. Among them, the audio signal after mixing and limiting can also be used as an AEC reference signal for acoustic echo cancellation. Among them, the limiting process is logarithmic compression.

[0080] The following is an introduction to different audio processing methods:

[0081] a. Acoustic echo cancellation: In a karaoke system, the coupling between the microphone and the speaker may cause acoustic feedback, that is, the microphone picks up the sound played by the speaker and plays it again, forming a loop. This may cause howling and sound quality distortion. The acoustic feedback cancellation algorithm reduces or eliminates this feedback through adaptive filtering and howling detection.

[0082] b. Adaptive noise suppression: In a closed environment such as a car, various noises (such as engine sound, wind sound, etc.) may enter the system through the microphone. The ambient noise suppression algorithm is designed to reduce these noises while maintaining the sound quality of the singing voice.

[0083] c. Automatic gain: This is a sound processing that changes the loudness, sound quality and penetration of the sound by increasing the harmonic components in the audio signal, making the human voice more prominent.

[0084] d.EQ Equalizer: Graphic equalizer allows the user to boost or suppress different frequencies of the audio signal, thereby adjusting the overall characteristics of the sound. This is very useful for compensating for speaker deviations or changing the frequency balance of the audio content.

[0085] e.Pitch Voice Changer: The voice changing and pitch changing function allows users to change the pitch or speed of the voice to create different stylized voice effects, such as Minions or monster sound effects.

[0086] f.DRC dynamic range compression: Dynamic range compression is an audio processing technique used to reduce the dynamic range of an audio signal, that is, to reduce the difference between the maximum and minimum levels of the signal. This helps ensure that the sound maintains a consistent listening experience at different volumes.

[0087] h. Mixing: Mixing is the process of mixing multiple audio signals (such as accompaniment and vocals) in a certain proportion. In a karaoke system, this usually involves mixing the processed vocals with the accompaniment to ensure that they are harmoniously combined.

[0088] Optionally, logarithmically compressing the mixed signal or the audio signal to be compressed to obtain a compressed mixed signal includes:

[0089] A1. Record the mixed signal or the audio signal to be compressed as a signal to be processed.

[0090] In this embodiment, the signal to be processed can be understood as a signal that needs to be processed. When logarithmically compressing the mixed signal, the mixed signal is recorded as the signal to be processed, and when mixing the audio signal to be compressed, the audio signal to be compressed is recorded as the signal to be processed.

[0091] A2. Calculate the difference between the absolute value of the signal to be processed and the preset threshold, and record it as the first difference.

[0092] In this embodiment, the first difference is the difference between two values. The difference obtained by subtracting a preset threshold from the absolute value of the signal to be processed is recorded as the first difference.

[0093] A3. Calculate the difference between the preset parameter and the preset threshold, and record it as the second difference.

[0094] In this embodiment, the preset parameter may be preset, and is usually a fixed value, such as 1 or 2. The preset parameter is subtracted from the preset threshold, and the difference obtained is recorded as the second difference.

[0095] A4. Multiply the ratio of the first difference to the second difference by the compression factor, add 1 to the product to obtain a first sum, perform logarithmic transformation based on the first sum and a preset base, and obtain a first transformation result.

[0096] In this embodiment, the preset base may be 2, e, 10, etc.; the first transformation result may be understood as: the first difference is compared with the second difference, the obtained ratio is multiplied by the compression factor, and then the product is added by 1, and the obtained sum is recorded as the first sum value. The preset base is used as the base, and the logarithm of the first sum value is calculated to obtain the first transformation result.

[0097] For example, Among them, the preset base is e, α is the compression factor, t is the preset threshold, x is the signal to be processed, and 2 is the preset parameter.

[0098] A5. Calculate the sum of the compression factor and 1 to obtain a second sum value, perform logarithmic transformation on the second sum value and a preset base, and obtain a second transformation result.

[0099] The compression factor and 1 are added, and the sum obtained is the second sum value; the preset base is used as the base, and the logarithm of the second sum value is calculated to obtain the second transformation result.

[0100] Exemplarily, the second transformation result=ln(1+α), wherein the preset base is e and α is the compression factor.

[0101] A6. Calculate the ratio of the first transformation result to the second transformation result, and calculate the difference between 1 and a preset threshold value, which is recorded as a third difference.

[0102] The first transformation result is compared with the second transformation result to obtain a ratio; at the same time, the difference between 1 and a preset threshold is calculated, and the difference is recorded as a third difference.

[0103] A7. Multiply the ratio by the third difference, and add the product to a preset threshold to obtain a third sum.

[0104] A8. Multiply the ratio of the signal to be processed to the absolute value of the signal to be processed by the third sum value to obtain a compressed signal to be processed.

[0105] The absolute value of the signal to be processed is determined, the signal to be processed is compared with the absolute value of the signal to be processed to obtain a ratio, and the ratio is multiplied by the third sum to obtain a compressed signal to be processed.

[0106] Exemplarily, the present application embodiment provides a compression formula:

[0107]

[0108] Among them, the preset base is e, α is the compression factor, t is the preset threshold, x is the signal to be processed, and 2 is the preset parameter.

[0109] The embodiment of the present application performs logarithmic compression after mixing, and attenuates the signal only when it exceeds a specific threshold. For high-amplitude signals that exceed the threshold, logarithmic compression is used to compress the value into a value range. This method has a smoother transition effect at the threshold and conforms to the nonlinear perception of loudness by the human ear. The above formula uses floating-point PCM values, and the digital sample range of each sampling point is -1 to 1.

[0110] All signals to be processed whose absolute amplitude is less than threshold t are kept original, and the amplitude from threshold t to 2 is logarithmically compressed to fit the value range. All possible amplitudes can be within the sampling accuracy range, and the sound level from low to high can maintain a good volume. And because the compression attenuation at high amplitudes is nonlinear, and the transition at the threshold is very smooth, this compression transition is almost imperceptible to the human ear. Therefore, in the current karaoke scene, the logarithmic dynamic range compression algorithm is selected to complete the mixing.

[0111] The embodiment of the present application analyzes the values ​​of α (compression factor) and t (threshold) for logarithmic dynamic range compression. Figure 7 The compression results corresponding to different compression factors are provided, wherein the horizontal axis is the signal to be processed and the vertical axis is the compressed signal.

[0112] 1. t value selection:

[0113] like Figure 7 As shown, as the t value increases, it means that compression begins at a higher amplitude;

[0114] For application scenarios that require a larger dynamic range (such as classical music), the threshold can be set between 0.7 and 0.9. For the current karaoke scene, t=0.6 is a better choice and is suitable for most music types.

[0115] 2. α value selection:

[0116] In the logarithmic dynamic range compression algorithm, the parameter α controls the shape of the compression curve. The appropriate α value affects the smoothness of the processing of high-amplitude signals. As the α value increases, the curvature of the curve increases and the compression rate increases.

[0117] The value of α also depends on the value of t. For larger t values, a larger α value is required to produce a larger compression rate. As the value of t decreases, the value of α also needs to decrease accordingly to adapt to a smoother compression curvature. Figure 7 As shown in the figure, the curves generated using three compression factor α values ​​show that the smooth tangency effect of the curve is best when α is around 5.5.

[0118] Therefore, for the current karaoke scene t = 0.6, α is 5.5, and the compression curve has the best effect. Figure 7 Take t=0.6 as an example.

[0119] Optionally, the method further includes:

[0120] Receiving a microphone selection operation of the user, where the microphone selection operation is for the user to trigger a microphone option;

[0121] In response to the microphone selection operation, the operating states of the voice microphone and the handheld microphone are controlled.

[0122] In this embodiment, the microphone selection operation can be understood as a user operation for selecting a microphone. A microphone selection interface can be displayed on the display screen of the vehicle computer. The microphone selection interface contains at least one function item for microphone selection that can be triggered by the user. For example, there are three microphone options, one for selecting a voice microphone, one for selecting a handheld microphone, and one for selecting both a voice microphone and a handheld microphone. The user triggers one of the options according to demand to form a microphone selection operation. This execution device receives the user's microphone selection operation. In response to the microphone selection operation, the working status of the voice microphone and the handheld microphone is controlled, and the working status can be working / not working. When the user chooses to control the voice microphone and the handheld microphone at the same time, the voice microphone and the handheld microphone are controlled to enter the working state at the same time. At this time, the voice microphone and the handheld microphone collect audio signals at the same time, and the audio signals are processed and then high-quality audio signals are played to provide users with good karaoke sound effects.

[0123] In order to ensure the real-time transmission and low latency of audio signals, the car system can adopt efficient audio encoding and decoding technology and optimize the audio path. Whether it is the voice microphone in the car or the handheld karaoke microphone, its audio signal can be quickly and stably transmitted to the system side for processing through a dedicated audio path. The transmission and processing flow of audio signals reduces the delay phenomenon. Whether it is the voice microphone in the car or the handheld karaoke microphone, its audio signal can be quickly and stably transmitted to the car system to achieve a real-time karaoke experience, which allows users to feel a smoother and more natural sound when singing karaoke in the car.

[0124] The car system has an intelligent mixing function, which can automatically adjust the volume balance of the in-car voice microphone and the handheld karaoke microphone according to the user's usage and needs, achieving a harmonious mix of the two. In addition, the car system also provides a variety of sound effect adjustment options, such as reverberation, equalizer, etc. Users can adjust the sound effects according to their preferences to obtain a personalized karaoke experience.

[0125] The car system can provide sound mode selection. The system provides a variety of sound modes for users to choose from, such as KTV mode, concert mode, etc. Users can adjust the sound effects according to their preferences.

[0126] The car system can provide personalized settings, and users can also personalize parameters such as volume, equalizer, reverberation, etc. according to their needs to obtain the best karaoke effect.

[0127] The in-car voice microphone and handheld karaoke microphone are deeply integrated with the car system. The system provides a dedicated interface and protocol to enable the microphone to connect seamlessly with the car system. In addition, the system also provides a friendly user interface, and users can easily operate and manage the microphone functions and settings through the touch screen or voice control of the car system.

[0128] The car system integrates the functions of the in-car voice microphone and the handheld karaoke microphone into a unified user interface. Users can easily switch between different microphones, adjust audio settings, select sound effect modes, etc. through the display or touch panel of the car system. This integrated user interface design allows users to more conveniently manage and control the in-car karaoke experience.

[0129] At the same time, the car system also supports multiple people using the in-car voice microphone, or handheld microphone, or voice microphone + handheld microphone for chorus or interaction at the same time. On the car system side, the in-car voice microphone and the handheld karaoke microphone can be switched seamlessly. When the user switches from the in-car voice microphone to the handheld karaoke microphone, the car system can automatically adjust the audio processing parameters to ensure the continuity and stability of the sound. At the same time, the car system also supports multiple people using microphones for chorus or interaction at the same time, and through intelligent audio processing algorithms, the balanced distribution and harmonious unity of the sound are achieved.

[0130] The coordination and integration of the in-car voice microphone and the handheld karaoke microphone on the car system side realizes the complementarity and optimization of the functions of the two through the processing, transmission, mixing and sound effect adjustment of audio signals and the integration of the user interface, providing users with a more convenient, efficient and high-quality karaoke experience.

[0131] For example, Figure 8A structural schematic block diagram of a handheld microphone implementation is provided. The in-car handheld karaoke microphone includes: a microphone core, an MCU controller, a first wireless transmission module, a button control unit, and a power management module. The wireless receiver includes a DSP module, a second wireless receiving module, a first USB interface, and a first A2B interface. The cockpit vehicle computer includes a vehicle-side controller, a second USB interface, a vehicle memory, a second A2B interface, a vehicle DSP module, a vehicle amplifier module, and an in-car speaker playback module. The data signal flow of the in-car handheld microphone, the human voice passes through the microphone core of the microphone, is input to the first wireless transmission module, is wirelessly transmitted to the second wireless receiving module, and then input to the digital signal processing DSP module of the receiver. The receiver DSP module performs audio algorithm processing, including noise reduction algorithm and echo cancellation algorithm, etc., to refine the collected sound and further improve the sound quality performance. In terms of function expansion, the handheld microphone also supports a variety of sound effects and mixing functions. Users can make personalized settings according to their preferences and needs to achieve a richer karaoke experience. Sound effects: echo, professional reverb, 3D surround, virtual bass, support for electronic music / pitch change / voice change, parametric equalizer (EQ), dynamic range compression (DRC), etc.; multiple sound effect modes can be preset, support one-click switching of sound effects, KTV, original sound, concert hall, concert, super reverb, male voice, female voice, baby voice, Warcraft voice. The vocals of karaoke are processed by the receiver DSP module and input to the car DSP module or the upper application unit; mixed with the accompaniment sound in the car, or the voice of the voice microphone in the car plus the accompaniment sound in the car, and then output to the car amplifier module, and then played to the car speakers.

[0132] The embodiment of the present invention provides a vehicle-mounted audio processing method based on a voice microphone and a handheld microphone, which solves the problem of poor karaoke effect in the car. The use of a voice microphone and a handheld microphone greatly enriches the user's karaoke method, and the user can flexibly choose a microphone for karaoke according to different scenarios and needs. Whether it is a single person singing or a chorus of multiple people, good sound quality and effect can be obtained. The handheld microphone can adopt wireless connection technology, which is convenient for users to use at any time; the voice microphone in the car does not interfere with the normal driving operation of the driver, ensuring driving safety. By optimizing and logarithmically compressing the first audio signal and the second audio signal, a mixed human voice signal with good sound effect is obtained, excessive noise is avoided, and the sound effect quality is improved; by mixing the audio signals collected by the voice microphone and the handheld microphone, the problems caused by using one microphone to collect audio signals are avoided, and the advantages of the two audio signals are combined to improve the sound quality of the audio, improve the quality of in-car entertainment, and meet the user's demand for high-quality karaoke experience.

[0133] Embodiment 3

[0134] Fig. 9This is a schematic diagram of the structure of a vehicle-mounted audio processing device based on a voice microphone and a handheld microphone provided in Embodiment 3 of the present invention. Fig. 9 As shown, the device includes: an audio acquisition module 31, a logarithmic compression module 32 and a mixing module 33.

[0135] An audio acquisition module 31, used to acquire a first audio signal collected by a voice microphone in the vehicle, and a second audio signal collected by a handheld microphone in the vehicle;

[0136] A logarithmic compression module 32, configured to perform optimization processing and logarithmic compression processing on the first audio signal and the second audio signal to obtain a mixed vocal signal;

[0137] The mixing module 33 is used to mix the mixed vocal signal with the accompaniment audio to obtain the audio to be played and play it.

[0138] The embodiment of the present invention provides a vehicle-mounted audio processing device based on a voice microphone and a handheld microphone, which solves the problem of poor karaoke effect in the car. The voice microphone and the handheld microphone are installed in the vehicle at the same time for audio collection, and the first audio signal and the second audio signal are optimized and logarithmically compressed to obtain a mixed human voice signal with better sound effect. The audio signals collected by the voice microphone and the handheld microphone are mixed to avoid the problems caused by using one microphone to collect audio signals. The advantages of the two audio signals are combined, and the signals are mixed through logarithmic compression to avoid excessive noise, improve the sound quality, and thus improve the user experience.

[0139] Optionally, the logarithmic compression module 32 includes:

[0140] A first optimization processing unit, configured to perform optimization processing on the first audio signal to obtain a first audio signal to be mixed, and perform optimization processing on the second audio signal to obtain a second audio signal to be mixed;

[0141] The mixing unit is used to perform logarithmic compression mixing processing on the first audio signal to be mixed and the second audio signal to be mixed to obtain a mixed vocal signal.

[0142] Optionally, the first mixing unit is specifically used to: process the first audio signal to be mixed and the second audio signal to be mixed into signals with the same sampling rate and sampling accuracy, and add the digital samples of each sampling point to obtain a corresponding mixed signal; for the mixed signal corresponding to each sampling point, if the absolute value of the mixed signal is greater than a preset threshold, logarithmically compress the mixed signal to obtain a compressed mixed signal; and generate a mixed vocal signal based on the mixed signal corresponding to each sampling point or the compressed mixed signal.

[0143] Optionally, the logarithmic compression module 32 includes:

[0144] A second optimization processing unit is used to optimize the first audio signal to obtain a third audio signal to be mixed, and optimize the second audio signal to obtain a fourth audio signal to be mixed;

[0145] a sampling unit, configured to process the third audio signal to be mixed and the fourth audio signal to be mixed into signals with the same sampling rate and sampling accuracy, and add digital samples of each sampling point to obtain a mixed signal corresponding to each sampling point;

[0146] A third optimization processing unit is used to optimize the mixed signals corresponding to all sampling points to obtain the audio signal to be compressed corresponding to each sampling point;

[0147] A compression unit, configured to perform logarithmic compression processing on the audio signal to be compressed corresponding to each sampling point, if the absolute value of the audio signal to be compressed is greater than a preset threshold, to obtain a compressed mixed signal;

[0148] The mixed signal generating unit is used to generate a mixed vocal signal based on the mixed signal corresponding to each sampling point or the compressed mixed signal.

[0149] Optionally, logarithmically compressing the mixed signal or the audio signal to be compressed to obtain a compressed mixed signal includes:

[0150] Recording the mixed signal or the audio signal to be compressed as a signal to be processed;

[0151] Calculate the difference between the absolute value of the signal to be processed and the preset threshold, and record it as a first difference;

[0152] Calculate the difference between the preset parameter and the preset threshold, and record it as a second difference;

[0153] multiplying the ratio of the first difference to the second difference by a compression factor, adding 1 to the product to obtain a first sum, and performing a logarithmic transformation on the first sum and a preset base to obtain a first transformation result;

[0154] Calculating the sum of the compression factor and 1 to obtain a second sum value, and performing logarithmic transformation according to the second sum value and a preset base to obtain a second transformation result;

[0155] Calculate the ratio of the first transformation result to the second transformation result, and calculate the difference between 1 and the preset threshold value, which is recorded as a third difference;

[0156] multiplying the ratio by the third difference, and adding the product to the preset threshold to obtain a third sum;

[0157] The third sum is multiplied by the ratio of the signal to be processed to the absolute value of the signal to be processed to obtain a compressed signal to be processed.

[0158] Optionally, the device further comprises:

[0159] An operation receiving unit, used to receive a microphone selection operation of a user, wherein the microphone selection operation is a user triggering a microphone option;

[0160] The working state control unit is used to control the working states of the voice microphone and the handheld microphone in response to the microphone selection operation.

[0161] Optionally, the audio acquisition module 31 is specifically used to obtain the second audio signal collected by the handheld microphone through the universal serial bus interface of the external recording sound card and the playback sound card authorization.

[0162] The vehicle-mounted audio processing device based on a voice microphone and a handheld microphone provided in an embodiment of the present invention can execute the vehicle-mounted audio processing method based on a voice microphone and a handheld microphone provided in any embodiment of the present invention, and has the corresponding functional modules and beneficial effects of the execution method.

[0163] Embodiment 4

[0164] Fig.10 A schematic diagram of a vehicle structure that can be used to implement an embodiment of the present invention is shown. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present invention described and / or claimed herein.

[0165] like Fig.10 As shown, the vehicle includes at least one voice microphone 401, at least one handheld microphone 402, at least one processor 403, and a memory connected to the at least one processor 403 in communication, such as a read-only memory (ROM) 404, a random access memory (RAM) 405, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 403 can perform various appropriate actions and processes according to the computer program stored in the read-only memory (ROM) 404 or the computer program loaded from the storage unit 410 to the random access memory (RAM) 405. In RAM 405, various programs and data required for vehicle operation can also be stored. The processor 403, ROM 404 and RAM 405 are connected to each other via a bus 406. An input / output (I / O) interface 407 is also connected to the bus 406.

[0166] A number of components in the vehicle are connected to the I / O interface 407, including: an input unit 408, such as a keyboard, a mouse, etc.; an output unit 409, such as various types of displays, speakers, etc.; a storage unit 410, such as a disk, an optical disk, etc.; and a communication unit 411, such as a network card, a modem, a wireless communication transceiver, etc. The communication unit 411 allows the vehicle to exchange information / data with other devices through a computer network such as the Internet and / or various telecommunication networks.

[0167] The processor 403 may be a variety of general and / or special processing components with processing and computing capabilities. Some examples of the processor 403 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc. The processor 403 performs the various methods and processes described above, such as the in-vehicle audio processing method based on a voice microphone and a handheld microphone.

[0168] In some embodiments, the in-vehicle audio processing method based on a voice microphone and a handheld microphone can be implemented as a computer program, which is tangibly contained in a computer-readable storage medium, such as a storage unit 410. In some embodiments, part or all of the computer program can be loaded and / or installed on the vehicle via the ROM 404 and / or the communication unit 411. When the computer program is loaded into the RAM 405 and executed by the processor 403, one or more steps of the in-vehicle audio processing method based on a voice microphone and a handheld microphone described above can be performed. Alternatively, in other embodiments, the processor 403 can be configured to execute the in-vehicle audio processing method based on a voice microphone and a handheld microphone by any other appropriate means (for example, by means of firmware).

[0169] Various implementations of the systems and techniques described above herein can be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), load programmable logic devices (CPLDs), computer hardware, firmware, software, and / or combinations thereof. These various implementations can include: being implemented in one or more computer programs that can be executed and / or interpreted on a programmable system including at least one programmable processor, which can be a special purpose or general purpose programmable processor that can receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.

[0170] Computer programs for implementing the methods of the present invention may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer program is executed by the processor, the functions / operations specified in the flow chart and / or block diagram are implemented. The computer program may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.

[0171] An embodiment of the present invention provides a computer program product, which includes a computer program. When the computer program is executed by a processor, the vehicle-mounted audio processing method based on a voice microphone and a handheld microphone described in any embodiment of the present invention is implemented.

[0172] In the context of the present invention, a computer-readable storage medium may be a tangible medium that may contain or store a computer program for use by or in combination with an instruction execution system, device or equipment. A computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or equipment, or any suitable combination of the foregoing. Alternatively, a computer-readable storage medium may be a machine-readable signal medium. A more specific example of a machine-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

[0173] To provide interaction with a user, the systems and techniques described herein can be implemented on a vehicle having: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the vehicle. Other types of devices can also be used to provide interaction with the user; for example, the feedback provided to the user can be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user can be received in any form (including acoustic input, voice input, or tactile input).

[0174] The systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components. The components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: a local area network (LAN), a wide area network (WAN), a blockchain network, and the Internet.

[0175] A computing system may include a client and a server. The client and the server are generally remote from each other and usually interact through a communication network. The client and server relationship is generated by computer programs running on the corresponding computers and having a client-server relationship with each other. The server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and VPS services.

[0176] It should be understood that the various forms of processes shown above can be used to reorder, add or delete steps. For example, the steps described in the present invention can be executed in parallel, sequentially or in different orders, as long as the desired results of the technical solution of the present invention can be achieved, and this document does not limit this.

[0177] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A vehicle audio processing method based on a voice microphone and a handheld microphone, characterized in that: include: Acquire a first audio signal collected by a voice microphone in the vehicle and a second audio signal collected by a handheld microphone in the vehicle; Performing optimization processing and logarithmic compression processing on the first audio signal and the second audio signal to obtain a mixed vocal signal; The mixed vocal signal is mixed with the accompaniment audio to obtain the audio to be played and play it.

2. The method according to claim 1, characterized in that The step of performing optimization processing and logarithmic compression processing on the first audio signal and the second audio signal to obtain a mixed vocal signal includes: Optimizing the first audio signal to obtain a first audio signal to be mixed, and optimizing the second audio signal to obtain a second audio signal to be mixed; The first audio signal to be mixed and the second audio signal to be mixed are mixed by logarithmic compression to obtain a mixed vocal signal.

3. The method according to claim 2, characterized in that The method comprises: performing a mixing process of logarithmically compressing the first audio signal to be mixed and the second audio signal to be mixed to obtain a mixed vocal signal, comprising: Processing the first audio signal to be mixed and the second audio signal to be mixed into signals with the same sampling rate and sampling accuracy, and adding digital samples of each sampling point to obtain a corresponding mixed signal; For the mixed signal corresponding to each sampling point, if the absolute value of the mixed signal is greater than a preset threshold, logarithmically compress the mixed signal to obtain a compressed mixed signal; A mixed vocal signal is generated based on the mixed signal corresponding to each sampling point or the compressed mixed signal.

4. The method according to claim 1, characterized in that: The step of performing optimization processing and logarithmic compression processing on the first audio signal and the second audio signal to obtain a mixed vocal signal includes: Performing optimization processing on the first audio signal to obtain a third audio signal to be mixed, and performing optimization processing on the second audio signal to obtain a fourth audio signal to be mixed; Processing the third audio signal to be mixed and the fourth audio signal to be mixed into signals with the same sampling rate and sampling accuracy, and adding the digital samples of each sampling point to obtain a mixed signal corresponding to each sampling point; Optimizing the mixed signals corresponding to all sampling points to obtain the audio signal to be compressed corresponding to each sampling point; For the audio signal to be compressed corresponding to each sampling point, if the absolute value of the audio signal to be compressed is greater than a preset threshold, logarithmic compression processing is performed on the audio signal to be compressed to obtain a compressed mixed signal; A mixed vocal signal is generated based on the mixed signal corresponding to each sampling point or the compressed mixed signal.

5. The method according to any one of claims 3 or 4, characterized in that: Logarithmically compressing the mixed signal or the audio signal to be compressed to obtain a compressed mixed signal, including: Recording the mixed signal or the audio signal to be compressed as a signal to be processed; Calculate the difference between the absolute value of the signal to be processed and the preset threshold, and record it as a first difference; Calculate the difference between the preset parameter and the preset threshold, and record it as a second difference; multiplying the ratio of the first difference to the second difference by a compression factor, adding 1 to the product to obtain a first sum, and performing a logarithmic transformation on the first sum and a preset base to obtain a first transformation result; Calculating the sum of the compression factor and 1 to obtain a second sum value, and performing logarithmic transformation according to the second sum value and a preset base to obtain a second transformation result; Calculate the ratio of the first transformation result to the second transformation result, and calculate the difference between 1 and the preset threshold value, which is recorded as a third difference; multiplying the ratio by the third difference, and adding the product to the preset threshold to obtain a third sum; The third sum is multiplied by the ratio of the signal to be processed to the absolute value of the signal to be processed to obtain a compressed signal to be processed.

6. The method according to claim 1, characterized in that Also includes: Receiving a microphone selection operation of a user, wherein the microphone selection operation is triggering a microphone option by the user; In response to the microphone selection operation, the operating states of the voice microphone and the handheld microphone are controlled.

7. The method according to claim 1, characterized in that Acquiring a second audio signal collected by a handheld microphone in a vehicle, including: The second audio signal collected by the handheld microphone is obtained through the universal serial bus interface of the external recording sound card and the playback sound card authorization.

8. A vehicle, characterized in that: The vehicle comprises: At least one voice microphone, used to collect a first audio signal; at least one handheld microphone, for collecting a second audio signal; at least one processor, and a memory communicatively coupled to the at least one processor; Wherein, the memory stores a computer program that can be executed by the at least one processor, and the computer program is executed by the at least one processor so that the at least one processor can execute the in-vehicle audio processing method based on a voice microphone and a handheld microphone as described in any one of claims 1-7.

9. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a processor to implement the vehicle-mounted audio processing method based on a voice microphone and a handheld microphone according to any one of claims 1 to 7 when executed.

10. A computer program product, characterized in that The computer program product comprises a computer program, and when the computer program is executed by a processor, the computer program implements the vehicle-mounted audio processing method based on a voice microphone and a handheld microphone according to any one of claims 1 to 7.

Images