In-vehicle call method and device, readable storage medium, electronic equipment and vehicle

Abstract

The invention discloses an in-vehicle call method and device, a readable storage medium, electronic equipment and a vehicle, and relates to the technical field of voice processing, and the method comprises the steps: in response to a received in-vehicle call request between a first seat position and a second seat position, collecting an in-vehicle sound signal, the in-vehicle sound signals at least comprise a first voice signal uploaded at the first seat position and a second voice signal uploaded at the second seat position; analyzing the in-vehicle sound signal to obtain the first voice signal and the second voice signal; and controlling a first voice output device at the first seat position to play the second voice signal, and controlling a second voice output device at the second seat position to play the first voice signal. According to the invention, the technical problem that the communication efficiency is low and the user experience is seriously influenced because the current in-vehicle call does not support full-duplex communication can be solved.

Description

Technical Field

[0001] The present application relates to the field of voice processing technology, and in particular to an in-vehicle communication method, device, readable storage medium, electronic device and vehicle. Background Art

[0002] In-car communication (ICC) is a key technology to optimize the in-car voice interaction environment. During driving, the driver and rear passengers can communicate directly based on the ICC system without having to lean over or take their eyes off the road, thus ensuring driving safety.

[0003] Currently, the ICC system only supports one-way calls. At the same time, only one party can express and communicate, and the other party can only listen, which greatly affects the communication efficiency and will seriously affect the user experience. Summary of the invention

[0004] In view of this, the present application provides an in-car call method, device, readable storage medium, electronic device and vehicle, which can solve the technical problem that current in-car calls do not support full-duplex communication, resulting in low communication efficiency and seriously affecting user experience.

[0005] According to a first aspect of the present application, a method for in-vehicle communication is provided, comprising:

[0006] In response to receiving an in-vehicle call request between a first seat position and a second seat position, collecting an in-vehicle sound signal, the in-vehicle sound signal at least including a first voice signal uploaded at the first seat position and a second voice signal uploaded at the second seat position;

[0007] Obtaining the first voice signal and the second voice signal by analyzing the in-vehicle sound signal;

[0008] The first voice output device at the first seat position is controlled to play the second voice signal, and the second voice output device at the second seat position is controlled to play the first voice signal.

[0009] According to a second aspect of the present application, there is provided an in-vehicle communication device, comprising:

[0010] a collection module, configured to collect in-vehicle sound signals in response to receiving an in-vehicle call request between a first seat position and a second seat position, wherein the in-vehicle sound signals at least include a first voice signal uploaded at the first seat position and a second voice signal uploaded at the second seat position;

[0011] An analysis module, configured to obtain the first voice signal and the second voice signal by analyzing the in-vehicle sound signal;

[0012] The control module is used to control the first voice output device at the first seat position to play the second voice signal, and control the second voice output device at the second seat position to play the first voice signal.

[0013] According to a third aspect of the present application, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the in-vehicle call method described in the first aspect is implemented.

[0014] According to the fourth aspect of the present application, an electronic device is provided, comprising a storage medium, a processor, and a computer program stored on the storage medium and executable on the processor, wherein when the processor executes the computer program, the in-vehicle call method described in the first aspect is implemented.

[0015] According to a fifth aspect of the present application, a vehicle is provided, comprising: the electronic device as described in the fourth aspect.

[0016] By means of the above technical solution, a method, device, readable storage medium, electronic device and vehicle for in-car communication are provided. When an in-car communication request between a first seat position and a second seat position is received, in-car sound data can be collected. The in-car sound data can simultaneously include a first voice signal uploaded from the first seat position to the second seat position, and a second voice signal uploaded from the second seat position to the first seat position; further, the first voice signal and the second voice signal can be obtained by analyzing the in-car sound signal; then the first voice output device at the first seat position is controlled to play the second voice signal, and the second voice output device at the second seat position is controlled to play the first voice signal. The technical solution disclosed in the present disclosure can, on the basis of supporting full-duplex communication, analyze the voice signals uploaded by both parties at the same time, and control the voice output device to synchronously play the voice signal of the other party, so that both parties can express communication and play the other party's voice at the same time, so as to realize instant communication, thereby improving communication efficiency and providing users with a better riding experience.

[0017] The above description is only an overview of the technical solution of the present application. In order to more clearly understand the technical means of the present application, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are listed below. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0020] Figure 1 A schematic diagram of a flow chart of an in-car communication method provided by an embodiment of the present disclosure;

[0021] Figure 2 A schematic diagram of a flow chart of an in-car communication method provided by another embodiment of the present disclosure;

[0022] Figure 3 A schematic diagram of the structure of an in-car communication device provided by an embodiment of the present disclosure;

[0023] Figure 4 A schematic diagram of the structure of an in-car communication device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0024] The following is a description of exemplary embodiments of the present disclosure in conjunction with the accompanying drawings, including various details of the embodiments of the present disclosure to facilitate understanding, which should be considered as merely exemplary. Therefore, it should be recognized by those of ordinary skill in the art that various changes and modifications may be made to the embodiments described herein without departing from the scope and spirit of the present disclosure. Similarly, for the sake of clarity and conciseness, descriptions of well-known functions and structures are omitted in the following description.

[0025] In order to solve the above technical problems, the present disclosure provides an in-car call method, device, readable storage medium, electronic device and vehicle, which can solve the technical problem that current in-car calls do not support full-duplex communication, resulting in low communication efficiency and seriously affecting user experience.

[0026] like Figure 1 , an embodiment of the present disclosure provides an in-vehicle call method, comprising:

[0027] Step 101, in response to receiving an in-car call request between a first seat position and a second seat position, collecting an in-car sound signal, the in-car sound signal at least including a first voice signal uploaded at the first seat position and a second voice signal uploaded at the second seat position.

[0028] In specific application scenarios, for longer vehicles, such as three-row seat vehicles, when passengers with seats far apart (such as rear passengers and first-row passengers) want to communicate, given the long distance between them, in order to ensure that passengers can hear each other's voice information and ensure the safety of vehicle driving, an ICC system can be deployed in the car, and a sound pickup device (such as a microphone) and a sound playback device (such as a speaker) can be deployed near each passenger. Passenger A can establish a call with another passenger B by creating an in-car call request. When establishing a call, passenger A can pick up voice information through a sound pickup device (such as a microphone) deployed near the seat position, and upload the voice information to the ICC system. The ICC system can extract, denoise, and amplify the voice information, and then send the amplified voice information to a sound playback device (such as a speaker) deployed near the other passenger B, and use the sound playback device to play the voice information recorded by passenger A to passenger B; in addition, many ICC systems currently only support one-way calls and cannot provide full-duplex communication, which seriously affects the user experience. Based on this, by deploying a sound pickup device (such as a microphone) and a sound playback device (such as a speaker) near each passenger, full-duplex communication can be supported to achieve instant chat. Correspondingly, passenger B can also pick up voice information through the sound pickup device (such as a microphone) deployed near the seat position, and send the amplified voice information to the sound playback device (such as a speaker) deployed near passenger A through the ICC system, and use the sound playback device to play the voice information recorded by passenger B to passenger A.

[0029] For the disclosed embodiment, in full-duplex communication mode, when an in-car call is established between the first seat position and the second seat position, the collected in-car sound signal may simultaneously include a first voice signal transmitted from the user at the first seat position to the user at the second seat position, and a second voice signal transmitted from the user at the second seat position to the user at the first seat position. In order to avoid the echo of the first voice signal when the sound playback device at the first seat position plays the second voice signal, and to avoid the echo of the second voice signal when the sound playback device at the second seat position plays the first voice signal, the following embodiment steps 102 to 103 can be performed to process the in-car sound signal, so that when the sound playback device at the first seat position plays the second voice signal, the sound playback device at the second seat position can play the first voice signal at the same time (i.e., full-duplex communication), and the two will not have echo interference with each other.

[0030] Step 102: Analyze the in-vehicle sound signal to obtain a first voice signal and a second voice signal.

[0031] For the disclosed embodiment, the sound signal in the vehicle can be analyzed for the source location, and the first voice signal uploaded by the sound pickup device at the first seat position and the second voice signal uploaded by the sound pickup device at the second seat position can be extracted respectively, so that both parties of the call can play the voice signal uploaded by the other party at the same time, and realize the full-duplex call between the first seat position and the second seat position. The sound source location analysis of the sound signal in the vehicle can be performed based on one or more methods such as relative delay estimation method, beamforming method, signal subspace method, modal domain method, machine learning (or deep learning), etc., which are not specifically limited here.

[0032] Step 103: Control the first voice output device at the first seat position to play the second voice signal, and control the second voice output device at the second seat position to play the first voice signal.

[0033] For the disclosed embodiment, after extracting the first voice signal uploaded at the first seat position and the second voice signal uploaded at the second seat position, the first voice signal can be transmitted to the sound playback device (such as a speaker) at the second seat position, and the speaker is used to play the first voice signal to the user sitting at the second seat position. At the same time, the second voice signal can also be transmitted to the sound playback device (such as a speaker) at the first seat position, and the speaker is used to play the second voice signal to the user sitting at the first seat position. This allows both parties to express communication and play each other's voice at the same time, realizing instant communication.

[0034] In summary, according to the in-car call method provided by the present application, in-car sound data can be collected when an in-car call request between a first seat position and a second seat position is received. The in-car sound data can simultaneously include a first voice signal uploaded from the first seat position to the second seat position, and a second voice signal uploaded from the second seat position to the first seat position; further, the first voice signal and the second voice signal can be obtained by analyzing the in-car sound signal; then the first voice output device at the first seat position is controlled to play the second voice signal, and the second voice output device at the second seat position is controlled to play the first voice signal. The technical solution in the present disclosure can, on the basis of supporting full-duplex calls, analyze the voice signals uploaded by both parties at the same time, and control the voice output device to synchronously play the voice signal of the other party, so that both parties can express communication and play the other party's voice at the same time, thereby realizing instant calls, thereby improving communication efficiency and providing users with a better riding experience.

[0035] Further, as a refinement and extension of the above embodiment, in order to fully illustrate the specific implementation process of the method of this embodiment, this embodiment provides the following Figure 2 The specific method shown includes:

[0036] Step 201, in response to receiving an in-car call request between a first seat position and a second seat position, collecting an in-car sound signal, the in-car sound signal at least including a first voice signal uploaded at the first seat position and a second voice signal uploaded at the second seat position.

[0037] For the embodiment of the present disclosure, the specific implementation process can refer to the relevant description in step 101 of the embodiment, which will not be repeated here.

[0038] Step 202: Eliminate the ambient sound signal contained in the in-vehicle sound signal.

[0039] In order to prevent in-car calls from affecting the use of the in-car voice interaction system and the media entertainment system, the in-car voice interaction system and the media entertainment system may not be turned off during in-car calls. That is, communication between passengers can be established under the premise that the in-car voice interaction system and the media entertainment system are in normal use (i.e., the corresponding audio is being played). However, when the call creator picks up the call voice signal through a sound pickup device (such as a microphone) deployed near the seat position, it may also pick up an ambient sound signal, which constitutes an interference signal for the call voice signal. Among them, the ambient sound signal includes at least one of a media sound signal, a howling signal, and a noise signal. The media sound signal is the audio played by the in-car voice interaction system and the media entertainment system during the in-car call; the howling signal may be a signal sent back by passengers in other rows when playing an audio signal, such as a sound signal transmitted by terminal B played by terminal A, which is collected again by terminal B and transmitted to terminal A, and played again by terminal A; the noise signal may include in-car noise, outside car noise, etc., which are not specifically limited here.

[0040] For the embodiment of the present disclosure, in order to avoid interference of the ambient sound signal with the call voice signal, so that the call voice signal transmitted to the call recipient contains noise, after collecting the in-car sound signal, the ambient sound signal contained in the in-car sound signal can be eliminated first to obtain a pure user voice signal.

[0041] Accordingly, as a possible implementation, when the ambient sound signal includes a media sound signal, echo cancellation can be performed on the in-car sound signal to eliminate the played media entertainment sound. When performing the echo cancellation process, one or more methods such as voice adaptive echo cancellation (Acoustic Echo Cancellation, AEC) algorithm, digital signal processing (Digital Signal Processing, DSP), and machine learning (or deep learning) can be used, which are not specifically limited here.

[0042] Accordingly, as a possible implementation method, when the ambient sound signal includes a howling signal, the in-car sound signal can be subjected to a howling suppression process to eliminate the howling signal present in the in-car sound signal. Among them, when performing the howling suppression process, one or more methods such as a phase modulation method, a gain control method, and an adaptive feedback cancellation method can be used, which are not specifically limited here. In the following embodiment steps in the present disclosure, the technical solution in the present disclosure is described by taking the use of the phase modulation method for howling suppression as an example, but it does not constitute a specific limitation. Among them, the phase modulation method, in simple terms, is the frequency shift method and the phase shift method. The principle of howling suppression by the frequency shift method and the phase shift method is to move the frequency component of the input signal forward or backward, so that the superposition phenomenon between the input signal and the acoustic feedback signal frequency disappears, or the acoustic feedback phase and the input signal phase are deviated, thereby destroying the phase condition for howling formation, thereby achieving the purpose of suppressing the howling signal. Accordingly, the steps of the embodiment may include: extracting a first howling signal with a fixed frequency from the in-vehicle sound signal; performing signal inversion processing on the first howling signal to obtain a second howling signal after the first howling signal is phase-shifted by 180 degrees; adding the second howling signal to the in-vehicle sound signal, so that the first howling signal and the second howling signal cancel each other out, thereby eliminating the first howling signal contained in the in-vehicle sound signal.

[0043] Accordingly, as a possible implementation, when the ambient sound signal includes a noise signal, the in-vehicle sound signal may be subjected to denoising to eliminate the noise signal present in the in-vehicle sound signal. Among them, when performing denoising, one or more methods such as linear filtering denoising and Fourier transform denoising may be used, which are not specifically limited here. In the following embodiment steps in the present disclosure, the Fourier transform denoising method is used as an example to illustrate the technical solution in the present disclosure, but it does not constitute a specific limitation. Accordingly, the embodiment may include: identifying the noise signal contained in the in-vehicle sound signal; removing the noise signal from the in-vehicle sound signal. Among them, when identifying the noise signal contained in the in-vehicle sound signal, the embodiment steps may include: performing a fast Fourier transform on the in-vehicle sound signal to obtain an in-vehicle sound frequency domain signal; obtaining an in-vehicle sound frequency domain signal falling within a preset frequency band range as a frequency domain signal of the target noise, the preset frequency band range being a frequency band range where the signal amplitude is greater than or equal to a preset amplitude threshold; performing a fast Fourier inverse transform and smoothing process on the frequency domain signal of the target noise to obtain a noise signal.

[0044] Step 203: Analyze the in-vehicle sound signal after eliminating the ambient sound signal to obtain a first voice signal and a second voice signal.

[0045] For the disclosed embodiments, echo cancellation can be performed based on adaptive filtering. In addition, in order to ensure that the residual echo is very small, some nonlinear operations can be added, and the residual echo can be further suppressed through post-processing (processing using signal correlation) to prevent the residual echo from affecting the quality of full-duplex calls. The steps of the embodiment may include: using an adaptive filter to perform echo cancellation processing on the sound signal in the car to obtain a first residual signal corresponding to the first voice signal and a second residual signal corresponding to the second voice signal; using an echo cancellation model to perform secondary processing on the first residual signal and the second residual signal, respectively, to eliminate the nonlinear parts in the first residual signal and the second residual signal, and obtain the first voice signal and the second voice signal after echo cancellation.

[0046] Among them, the first residual signal includes not only the entire first voice signal but also a partially residual second voice signal; the second residual signal includes not only the entire second voice signal but also a partially residual first voice signal. In order to eliminate the nonlinear part in the first residual signal and the second residual signal, that is, the partially residual second voice signal and the partially residual first voice signal, the first residual signal and the second residual signal can be further processed by the echo cancellation model to obtain the first voice signal and the second voice signal which are pure after the echo cancellation. The echo cancellation model can be any computing model capable of performing signal elimination processing on the residual signal, such as a neural network model, a deep learning model, etc. Exemplarily, the echo cancellation model in the present disclosure can be selected as a hidden Markov model, a conditional random field, and a neural network model, etc., which are not specifically limited here. In a specific application scenario, before executing the steps of this embodiment, the echo cancellation model can also be trained for the task of echo cancellation based on a certain number of sample data configured with acoustic feature labels, through supervised learning, or the corresponding training method in unsupervised learning, semi-supervised learning, and reinforcement learning, until it is determined that the echo cancellation model has reached a convergence state, and it is determined that the echo cancellation model has completed the training. The trained echo cancellation model can then be directly put into a specific application of echo cancellation, that is, the first residual signal and the second residual signal are respectively input into the echo cancellation model, and the echo cancellation model is used to perform nonlinear signal elimination processing on the first residual signal and the second residual signal respectively.

[0047] Accordingly, when an adaptive filter is used to perform echo cancellation processing on an in-vehicle sound signal, the steps of the embodiment may include: determining a first acoustic feature of a first voice signal and a second acoustic feature of a second voice signal based on echo path characteristics; using an adaptive filter to filter out a sound signal in the in-vehicle sound signal whose feature similarity with the second acoustic feature is higher than a preset threshold, to obtain a first residual signal corresponding to the first voice signal; and using an adaptive filter to filter out a sound signal in the in-vehicle sound signal whose feature similarity with the first acoustic feature is higher than a preset threshold, to obtain a second residual signal corresponding to the second voice signal. The preset threshold is a value greater than 0 and less than 1, and the specific value can be set according to the actual application scenario, and is not specifically limited here.

[0048] Correspondingly, when the first residual signal and the second residual signal are respectively processed for a second time using the echo cancellation model, the implementation steps may include: inputting the first residual signal into the echo cancellation model, and performing signal elimination processing on the second speech signal in the first residual signal using the echo cancellation model, wherein the echo cancellation model is used to extract the second acoustic feature of the first residual signal, and after determining the second speech signal corresponding to the second acoustic feature, eliminate the second speech signal in the first residual signal; and inputting the second residual signal into the echo cancellation model, and performing signal elimination processing on the first speech signal in the second residual signal using the echo cancellation model, wherein the echo cancellation model is used to extract the first acoustic feature of the second residual signal, and after determining the first speech signal corresponding to the first acoustic feature, eliminate the first speech signal in the second residual signal.

[0049] Step 204: Control the first voice output device at the first seat position to play the second voice signal, and control the second voice output device at the second seat position to play the first voice signal.

[0050] In a specific application scenario, when playing the first voice signal and the second voice signal, the voice interaction system and the media entertainment system may be playing audio at the same time. In addition, they may also include environmental sound signals such as howling signals and noise signals. In order to avoid the environmental sound signal being too loud to drown out the first voice signal and the second voice signal being played, so that the call receiving user cannot hear the call content clearly, the first voice output device at the first seat position may be controlled to play the second voice signal at a preset volume; and the second voice output device at the second seat position may be controlled to play the first voice signal at a preset volume. The preset volume is greater than the environmental volume, so that the call receiving user can clearly hear the call content without being affected by noisy environmental sounds.

[0051] Accordingly, the preset volume can be first determined based on the ambient sound volume of the ambient sound signal. The implementation steps may include: comparing the volume of the first voice signal, the second voice signal and the ambient sound signal, performing volume gain processing on the first voice signal and the second voice signal, so that the preset volume that the first voice signal and the second voice signal need to reach is greater than the ambient sound volume of the ambient sound signal. Specifically, by comparing the volume of the ambient sound signal, the first voice signal and the second voice signal, when the volume of the ambient sound signal is greater than the volume of the first voice signal and the second voice signal, as a possible implementation method, the volume of the ambient sound signal can be reduced based on the attenuation coefficient, so that the ambient sound volume is lower than the original volume of the first voice signal and the second voice signal. At this time, the original volume is used as the preset volume; as a possible implementation method, the volume of the first voice signal and the second voice signal can also be increased based on the enhancement coefficient to reach a preset volume greater than the ambient sound.

[0052] In summary, according to the in-car call method provided by the present disclosure, on the basis of supporting full-duplex calls, by analyzing the voice signals uploaded by both parties at the same time, and controlling the voice output device to synchronously play the voice signals of the other party, the two parties can express and communicate at the same time and play the voice of the other party at the same time, so as to achieve instant calls, thereby improving communication efficiency and making the user's riding experience better. In addition, the ICC intercom function can still be used normally without affecting the use of the in-car voice interaction system and the media entertainment system. When the media, navigation and other functions are carried out at the same time as the in-car call, the ambient sound signal and other voice signals contained in the in-car sound signal are eliminated to avoid the presence of noise in the transmitted call signal, so as to achieve clear communication of the in-car conversation. In addition, by controlling the volume gain of the first voice signal and the second voice signal, it can be ensured that when the two parties play the call sound, the playback volume of the call sound is greater than the ambient sound volume of the ambient sound signal, avoiding the influence of noisy ambient sound, so that the two parties can clearly hear the call content.

[0053] Based on the above Figure 1 , Figure 2 The specific implementation of the method shown in the embodiment provides an in-car communication device, such as Figure 3 , the device may include: a collection module 31, an analysis module 32, and a control module 33;

[0054] The collection module 31 may be used to collect in-vehicle sound signals in response to receiving an in-vehicle call request between a first seat position and a second seat position, wherein the in-vehicle sound signals at least include a first voice signal uploaded at the first seat position and a second voice signal uploaded at the second seat position;

[0055] The analysis module 32 may be used to obtain a first voice signal and a second voice signal by analyzing the in-vehicle sound signal;

[0056] The control module 33 may be used to control the first voice output device at the first seat position to play the second voice signal, and control the second voice output device at the second seat position to play the first voice signal.

[0057] In a specific application scenario, the analysis module 32 can be specifically used to use an adaptive filter to perform echo elimination processing on the in-vehicle sound signal to obtain a first residual signal corresponding to the first voice signal and a second residual signal corresponding to the second voice signal; use the echo elimination model to perform secondary processing on the first residual signal and the second residual signal, respectively, to eliminate the nonlinear parts in the first residual signal and the second residual signal, and obtain the first voice signal and the second voice signal after echo elimination.

[0058] In a specific application scenario, the analysis module 32 can be specifically used to determine the first acoustic feature of the first speech signal and the second acoustic feature of the second speech signal based on the echo path characteristics; use an adaptive filter to filter out the sound signal in the vehicle sound signal whose feature similarity with the corresponding feature of the second acoustic feature is higher than a preset threshold, to obtain a first residual signal corresponding to the first speech signal; and use an adaptive filter to filter out the sound signal in the vehicle sound signal whose feature similarity with the corresponding feature of the first acoustic feature is higher than a preset threshold, to obtain a second residual signal corresponding to the second speech signal.

[0059] In a specific application scenario, the analysis module 32 can be specifically used to input the first residual signal into an echo cancellation model, and use the echo cancellation model to perform signal elimination processing on the second speech signal in the first residual signal, wherein the echo cancellation model is used to extract the second acoustic feature of the first residual signal, and after determining the second speech signal corresponding to the second acoustic feature, eliminate the second speech signal in the first residual signal; and input the second residual signal into the echo cancellation model, and use the echo cancellation model to perform signal elimination processing on the first speech signal in the second residual signal, wherein the echo cancellation model is used to extract the first acoustic feature of the second residual signal, and after determining the first speech signal corresponding to the first acoustic feature, eliminate the first speech signal in the second residual signal.

[0060] In a specific application scenario, the in-car sound signal also includes an ambient sound signal, which includes at least one of a media sound signal, a howling signal, and a noise signal. Figure 4 , the device further comprises: a processing module 34;

[0061] The processing module 34 may be used to eliminate the ambient sound signal contained in the in-vehicle sound signal;

[0062] The analysis module 32 may be used to analyze the in-vehicle sound signal after eliminating the ambient sound signal to obtain a first voice signal and a second voice signal.

[0063] In a specific application scenario, the control module 33 can be specifically used to control the first voice output device at the first seat position to play the second voice signal at a preset volume; and control the second voice output device at the second seat position to play the first voice signal at a preset volume.

[0064] In specific application scenarios, such as Figure 4 As shown, the device further includes: a comparison module 35;

[0065] The comparison module 35 can be used to compare the volume of the first voice signal, the second voice signal and the ambient sound signal, and perform volume gain processing on the first voice signal and the second voice signal so that the preset volume that the first voice signal and the second voice signal need to reach is greater than the ambient sound volume of the ambient sound signal.

[0066] It should be noted that for other corresponding descriptions of the functional units involved in the in-car communication device provided in this embodiment, reference can be made to Figure 1 and Figure 2 The corresponding description in will not be repeated here.

[0067] Based on the above Figure 1 and Figure 2 The method shown in the embodiment also provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the above-mentioned Figure 1 and Figure 2 The method shown.

[0068] Based on this understanding, the technical solution of the present application can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, USB flash drive, mobile hard disk, etc.), including a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute the methods of various implementation scenarios of the present application.

[0069] Based on the above Figure 1 and Figure 2 The method shown, and Figure 3 and Figure 4 In order to achieve the above-mentioned purpose, the embodiment of the present application also provides an electronic device that can be configured on the vehicle (such as an electric vehicle) side, and the device includes a storage medium and a processor; the storage medium is used to store a computer program; the processor is used to execute the computer program to achieve the above-mentioned Figure 1 and Figure 2 The method shown.

[0070] Optionally, the above-mentioned physical device may also include a user interface, a network interface, a camera, a radio frequency (RF) circuit, a sensor, an audio circuit, a WI-FI module, etc. The user interface may include a display, an input unit such as a keyboard, etc., and the optional user interface may also include a USB interface, a card reader interface, etc. The network interface may optionally include a standard wired interface, a wireless interface (such as a WI-FI interface), etc.

[0071] Those skilled in the art will appreciate that the above-mentioned physical device structure provided in this embodiment does not constitute a limitation on the physical device, and may include more or fewer components, or a combination of certain components, or different arrangements of components.

[0072] The storage medium may also include an operating system and a network communication module. The operating system is a program that manages the hardware and software resources of the above-mentioned physical device, and supports the operation of the information processing program and other software and / or programs. The network communication module is used to realize the communication between the components inside the storage medium, and the communication with other hardware and software in the information processing physical device.

[0073] Based on the above electronic device, the embodiment of the present application further provides a vehicle, which may specifically include: the above electronic device. The vehicle may specifically be an electric car, etc.

[0074] Through the description of the above implementation methods, the technical personnel in the field can clearly understand that the present application can be implemented by means of software plus the necessary general hardware platform, or by hardware. The technical solution in the present disclosure can support full-duplex calls, analyze the voice signals uploaded by both parties at the same time, and control the voice output device to synchronously play the voice signals of the other party, so that both parties can express communication and play the voice of the other party at the same time, so as to achieve instant calls, thereby improving communication efficiency and making the user's riding experience better. In addition, the ICC intercom function can still be used normally without affecting the use of the in-car voice interaction system and the media entertainment system. When the media, navigation and other functions are carried out simultaneously with the in-car call, the ambient sound signal and other voice signals contained in the in-car sound signal are eliminated to avoid the presence of noise in the transmitted call signal, so as to achieve clear communication of the in-car conversation. In addition, by controlling the volume gain of the first voice signal and the second voice signal, it can be ensured that when the two parties play the call sound, the playback volume of the call sound is greater than the ambient sound volume of the ambient sound signal, so as to avoid the influence of noisy ambient sound, so that the two parties can clearly hear the call content.

[0075] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the term "comprising" or any other variant thereof is intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprising a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0076] The above is only a specific implementation of the present application, so that those skilled in the art can understand or implement the present application. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present application. Therefore, the present application will not be limited to these embodiments herein, but will conform to the widest scope consistent with the principles and novel features applied for herein.

Claims

1. A method for in-car communication, characterized in that: include: In response to receiving an in-vehicle call request between a first seat position and a second seat position, collecting an in-vehicle sound signal, the in-vehicle sound signal at least including a first voice signal uploaded at the first seat position and a second voice signal uploaded at the second seat position; Obtaining the first voice signal and the second voice signal by analyzing the in-vehicle sound signal; The first voice output device at the first seat position is controlled to play the second voice signal, and the second voice output device at the second seat position is controlled to play the first voice signal.

2. The method according to claim 1, characterized in that The step of analyzing the in-vehicle sound signal to obtain the first voice signal and the second voice signal includes: Performing echo cancellation processing on the in-vehicle sound signal to obtain a first residual signal corresponding to the first voice signal and a second residual signal corresponding to the second voice signal; Eliminating a first nonlinear echo signal in the first residual signal to obtain a first speech signal after echo cancellation, wherein the first nonlinear echo signal is a second speech signal after nonlinear change; and A second nonlinear echo signal in the second residual signal is eliminated to obtain a second speech signal after echo cancellation, wherein the second nonlinear echo signal is the first speech signal after nonlinear change.

3. The method according to claim 2, characterized in that The performing echo cancellation processing on the in-vehicle sound signal to obtain a first residual signal corresponding to the first voice signal and a second residual signal corresponding to the second voice signal includes: Determining a first acoustic feature of the first speech signal and a second acoustic feature of the second speech signal based on an echo path characteristic; Using the adaptive filter to filter out the sound signal in the in-vehicle sound signal whose feature similarity with the second acoustic feature is higher than a preset threshold, to obtain a first residual signal corresponding to the first speech signal; and The adaptive filter is used to filter out the sound signal in the vehicle, the sound signal having a feature similarity with the first acoustic feature higher than a preset threshold, to obtain a second residual signal corresponding to the second speech signal.

4. The method according to claim 2, characterized in that: The step of eliminating the first nonlinear echo signal in the first residual signal to obtain a first speech signal after echo cancellation includes: Inputting the first residual signal into an echo cancellation model, and using the echo cancellation model to perform signal elimination processing on a first nonlinear echo signal in the first residual signal, wherein the echo cancellation model is used to extract a third acoustic feature from the first residual signal, and after determining the first nonlinear echo signal corresponding to the third acoustic feature, eliminate the first nonlinear echo signal in the first residual signal; The step of eliminating the second nonlinear echo signal in the second residual signal to obtain a second speech signal after echo cancellation includes: The second residual signal is input into an echo cancellation model, and the echo cancellation model is used to perform signal elimination processing on a second nonlinear echo signal in the second residual signal, wherein the echo cancellation model is used to extract a fourth acoustic feature from the second residual signal, and after determining the second nonlinear echo signal corresponding to the fourth acoustic feature, eliminate the second nonlinear echo signal in the second residual signal.

5. The method according to any one of claims 1 to 4, characterized in that The in-vehicle sound signal further includes an ambient sound signal, and the ambient sound signal includes at least one of a media sound signal, a howling signal, and a noise signal. Before parsing the in-vehicle sound signal to obtain the first voice signal and the second voice signal, the method further includes: Eliminating the ambient sound signal contained in the in-vehicle sound signal; The in-vehicle sound signal after the ambient sound signal is eliminated is analyzed to obtain the first voice signal and the second voice signal.

6. The method according to claim 1, characterized in that Before controlling the first voice output device at the first seat position to play the second voice signal, and controlling the second voice output device at the second seat position to play the first voice signal, the method further includes: Comparing the volume of the first voice signal, the second voice signal, and the ambient sound signal, performing volume gain processing on the first voice signal and the second voice signal so that the preset volume that the first voice signal and the second voice signal need to reach is greater than the ambient sound volume of the ambient sound signal; The first voice output device controlling the first seat position to play the second voice signal, and the second voice output device controlling the second seat position to play the first voice signal, include: Controlling the first voice output device at the first seat position to play the second voice signal at a preset volume; and The second voice output device at the second seat position is controlled to play the first voice signal at a preset volume.

7. An in-car communication device, characterized in that: include: a collection module, configured to collect in-vehicle sound signals in response to receiving an in-vehicle call request between a first seat position and a second seat position, wherein the in-vehicle sound signals at least include a first voice signal uploaded at the first seat position and a second voice signal uploaded at the second seat position; An analysis module, configured to obtain the first voice signal and the second voice signal by analyzing the in-vehicle sound signal; The control module is used to control the first voice output device at the first seat position to play the second voice signal, and control the second voice output device at the second seat position to play the first voice signal.

8. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.

9. An electronic device comprising a storage medium, a processor, and a computer program stored in the storage medium and executable on the processor, characterized in that: When the processor executes the computer program, the method according to any one of claims 1 to 6 is implemented.

10. A vehicle, characterized in that: include: The electronic device as claimed in claim 9.

Images