In-vehicle call method, device and equipment, storage medium and vehicle
By obtaining passenger positions and calculating speaker gain in the in-car call system, the problem that the existing system cannot distinguish passenger positions is solved, and communication efficiency and driving safety are improved.
Patent Information
- Application Number
- CN202311212767.6
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2023-09-19
- Publication Date
- 2025-03-21
AI Technical Summary
The existing in-car call system cannot distinguish the passenger's position, which causes the driver to be unable to determine the driver's position when communicating with the rear passengers, which affects communication efficiency and driving safety.
By obtaining the position information of the first pronunciation passenger, the distance between the target speaker and the radio passenger's binaural ears is calculated, and the speaker gain is adjusted to utilize the binaural effect to enable the radio passenger to clarify the position of the first pronunciation passenger.
It improves communication efficiency between passengers, reduces the risk of driver distraction, and improves the ride experience.
Smart Images
Figure CN119676608A_ABST
Abstract
Description
Technical Field
[0001] The present disclosure relates to the field of computer technology, and in particular to an in-vehicle communication method, device, equipment, storage medium and vehicle. Background Art
[0002] When a vehicle is driving, it will generate a variety of in-car noises, such as road traffic noise, entertainment system noise, and other passengers' talking noises. This in-car noise will affect the communication between the driver and the target passenger. The driver will usually talk to the target passenger by raising the volume or changing the posture, which will distract the driver and affect driving safety.
[0003] In the prior art, the above problem is solved by amplifying the voice signal of the speaking passenger to the corresponding speaker through the in-car communication (ICC) system. However, the ICC system cannot distinguish the direction. For example, when the front passenger speaks and emits a loud voice signal through the ICC system in the back row, the back passenger cannot determine whether the front passenger he is talking to is in the driver's seat or the co-pilot seat.
[0004] Therefore, there is an urgent need for an in-car communication method to solve the above problems. Summary of the invention
[0005] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides an in-car call method, device, equipment, storage medium and vehicle, which can adaptively adjust the target speaker gain according to the position information of the first speaking passenger and the receiving passenger in the car, so that the receiving passenger can clearly know the first position of the first speaking passenger according to the binaural effect, thereby improving the passenger's riding experience.
[0006] In a first aspect, an embodiment of the present disclosure provides a method for in-vehicle communication, comprising:
[0007] Get the first position of the first-voiced passenger;
[0008] Calculating the initial energy of the audio signal played by the target loudspeaker to the ears of the sound receiving passenger according to the distance between the target loudspeaker and the ears of the sound receiving passenger;
[0009] Based on the initial energy, the first position, and a preset energy difference threshold, the gain of the target speaker is calculated and adjusted so that the sound collecting passenger determines the first position according to the binaural effect, wherein the preset energy difference threshold refers to the energy difference threshold required for the two ears of the sound collecting passenger to determine the first position according to the binaural effect.
[0010] In a second aspect, an embodiment of the present disclosure provides an in-car communication device, comprising:
[0011] An acquisition module, used for acquiring a first position of a first speaking passenger;
[0012] A calculation module, used for calculating the initial energy of the audio signal played by the target speaker to the ears of the sound receiving passenger according to the distance between the target speaker and the ears of the sound receiving passenger;
[0013] an adjustment module, for calculating and adjusting the gain of the target loudspeaker based on the initial energy, the first position, and a preset energy difference threshold, so that the sound collecting passenger determines the first position according to a binaural effect, wherein the preset energy difference threshold refers to the energy difference threshold required for the two ears of the sound collecting passenger to determine the first position according to the binaural effect.
[0014] In a third aspect, an embodiment of the present disclosure provides an electronic device, including:
[0015] Memory;
[0016] Processor; and
[0017] Computer programs;
[0018] The computer program is stored in the memory and is configured to be executed by the processor to implement the method as described in the first aspect.
[0019] In a fourth aspect, an embodiment of the present disclosure provides a computer-readable storage medium having a computer program stored thereon, wherein the computer program is executed by a processor to implement the method described in the first aspect.
[0020] In a fifth aspect, an embodiment of the present disclosure further provides a vehicle, comprising: the in-vehicle communication device as described in the second aspect; or, the electronic device as described in the third aspect; or, the computer-readable storage medium as described in the fourth aspect.
[0021] The in-car call method, device, equipment, storage medium and vehicle provided by the embodiments of the present disclosure obtain the first position of the first speaking passenger; calculate the initial energy of the audio signal played by the target speaker to the ears of the receiving passenger according to the distance between the target speaker and the ears of the receiving passenger; calculate and adjust the gain of the target speaker based on the initial energy, the first position and a preset energy difference threshold, so that the receiving passenger determines the first position according to the binaural effect, wherein the preset energy difference threshold refers to the energy difference threshold required by the ears for the receiving passenger to determine the first position according to the binaural effect; and adaptively adjust the gain of the target speaker according to the position information of the first speaking passenger and the receiving passenger in the car, so that the receiving passenger can clearly identify the first position of the first speaking passenger according to the binaural effect, thereby improving the riding experience of the passengers. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0023] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.
[0024] Figure 1 A flow chart of the in-car communication method provided by the embodiment of the present disclosure;
[0025] Figure 2 A schematic diagram of an application scenario provided by an embodiment of the present disclosure;
[0026] Figure 3 A schematic diagram of an application scenario provided by an embodiment of the present disclosure;
[0027] Figure 4 A schematic diagram of the structure of an in-car communication system provided by an embodiment of the present disclosure;
[0028] Figure 5 A flow chart of the in-car communication method provided by the embodiment of the present disclosure;
[0029] Figure 6 A schematic diagram of the structure of an in-car communication device provided by an embodiment of the present disclosure;
[0030] Figure 7 A schematic diagram of the structure of an electronic device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION
[0031] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.
[0032] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.
[0033] The disclosed embodiment provides a method for in-vehicle communication, which is described below in conjunction with a specific embodiment.
[0034] Figure 1The flow chart of the in-car communication method provided by the embodiment of the present disclosure. The method can be executed by an in-car communication device, which can be implemented by software and / or hardware. The in-car communication device can be configured in an electronic device, such as a server or a terminal, wherein the terminal specifically includes an electric vehicle, a fuel vehicle, and a hybrid vehicle, etc. For example, the in-car communication device can specifically be a vehicle computer control system in a vehicle, referred to as a vehicle computer for short. In addition, the method can be applied to Figure 2 The application scenario shown includes a driver 21, a third row left passenger 22, a front passenger 23, a third row right passenger 24, a third row left speaker 25, and a third row right speaker 26. The third row left passenger and the third row right passenger may also be the second row left passenger and the second row right passenger, and the implementation method and implementation principle are the same. The third row left passenger and the third row right passenger will be used as an example for explanation. It is understandable that the in-car call method provided by the embodiment of the present disclosure can also be applied in other scenarios.
[0035] Combine the following Figure 2 The application scenario shown is Figure 1 The in-car calling method shown is introduced, for example, Figure 2 The terminal in can execute the method. The specific steps of the method are as follows:
[0036] S101, obtaining the first position of the first speaking passenger.
[0037] The vehicle computer receives the voice signal of the first speaking passenger and obtains the first position of the first speaking passenger.
[0038] For example, Figure 2 As shown, this embodiment is explained by taking a six-seat vehicle as an example, wherein 21 is the driver, 22 is the third row left passenger, 23 is the co-pilot passenger, 24 is the third row right passenger, 25 is the third row left speaker, and 26 is the third row right speaker. When the first voice-pronouncing passenger is the driver 21, that is, the driver 21 speaks, the voice signal of the driver 21 is received by the microphone arranged on the vehicle, and the first position of the driver 21 is obtained. The first position is the main driving position. It can be understood that the first voice-pronouncing passenger can also be the co-pilot passenger 23, the third row left passenger 22, and the third row right passenger 24. The implementation method and implementation principle are the same as when the first voice-pronouncing passenger is the driver 21, and will not be repeated later.
[0039] Specifically, each seat position in the vehicle is arranged with a corresponding microphone for detecting sounds in the vehicle, wherein the relative distance between each seat and its corresponding microphone is fixed. When the first speaking passenger is the driver 21, the driver speaks at the main driving position, and multiple microphones respectively obtain corresponding audio signals, and send the audio signals corresponding to the multiple microphones to the vehicle computer respectively. The vehicle computer compares the amplitude of the audio signal received from each microphone, and determines that the audio signal amplitude obtained from the microphone corresponding to the main driver is the strongest. The vehicle computer locates the main driver's speaking direction through the audio signals received from the multiple microphones, and finally determines the first position of the first speaking passenger according to the amplitude and direction of the audio signal.
[0040] Optionally, receiving a voice signal of a first speaking passenger and obtaining a first position of the first speaking passenger includes: receiving a voice signal of the first speaking passenger through an in-car call system; determining a first position of the first speaking passenger through image information acquired by an image sensor; and / or obtaining the first position of the first speaking passenger through a pressure sensor.
[0041] In car communication (ICC), also known as in-car intercom system, can remove noise and amplify the first-voice passenger voice signal and then play it to the target speaker. The specific principle is as follows Figure 4 As shown, when the front-row driver speaks, the driver is the first speaking passenger, and the sound signal emitted by the driver is denoised to obtain a clean audio signal, which is then modulated and equalized (EQ) before being played to the target speaker.
[0042] The vehicle computer receives the voice signal of the first speaking passenger through the in-vehicle communication system; the vehicle computer obtains the first position of the first speaking passenger by identifying the image information collected by the image sensor; or the vehicle computer obtains the first position of the first speaking passenger by identifying the pressure information collected by the pressure sensor; preferably, the vehicle computer obtains the first position of the first speaking passenger by identifying the image information collected by the image sensor and the pressure information collected by the pressure sensor, that is, combining the image information and the pressure information, thereby improving the accuracy of detecting the first position of the first speaking passenger.
[0043] Exemplarily, the image sensor may be a photographing device for acquiring image information, and specifically may be a camera, a still camera, a driving recorder, etc.
[0044] Exemplarily, the photographing device may be disposed directly in front of each row of seats, or may be disposed at other locations where the seat positions can be photographed, which is not limited in this embodiment.
[0045] Exemplarily, the pressure sensor is disposed under the seat, and the pressure sensor may also be other sensors capable of sensing the position of an object on the seat.
[0046] S102: Calculate the initial energy of the audio signal played by the target loudspeaker to the ears of the sound receiving passenger according to the distance between the target loudspeaker and the ears of the sound receiving passenger.
[0047] The vehicle computer determines the distance between the target loudspeaker and the ears of the receiving passenger.
[0048] Optionally, the target speaker includes a left speaker in the same row as the sound collecting passenger and / or a right speaker in the same row as the sound collecting passenger, and the sound collecting passenger's ears include the sound collecting passenger's left ear and the sound collecting passenger's right ear.
[0049] Specifically, when there is only one sound-collecting passenger, and the sound-collecting passenger is the third row left passenger 22, the target speakers include the third row left speakers 25 and / or the third row right speakers 26, and the sound-collecting passenger's ears include the sound-collecting passenger's left ear and the sound-collecting passenger's right ear. The distances between the target speakers and the sound-collecting passenger's ears include: a first distance between the left speaker and the sound-collecting passenger's left ear; a second distance between the left speaker and the sound-collecting passenger's right ear; a third distance between the right speaker and the sound-collecting passenger's left ear; and a fourth distance between the right speaker and the sound-collecting passenger's right ear.
[0050] Pressure Transducer is a device or apparatus that can sense pressure signals and convert them into usable output electrical signals according to certain rules. Pressure sensors are usually composed of pressure sensitive elements and signal processing units.
[0051] Specifically, the vehicle computer obtains the second position of the sound receiving passenger by identifying the image information collected by the image sensor; or the vehicle computer obtains the second position of the sound receiving passenger by identifying the pressure information collected by the pressure sensor; preferably, the vehicle computer obtains the second position of the sound receiving passenger by identifying the image information collected by the image sensor and the pressure information collected by the pressure sensor, that is, combining the image information and the pressure information, thereby improving the accuracy of the second position detection of the sound receiving passenger. Figure 3 As shown, a first distance 31 between the three-row left speaker 25 and the left ear of the sound collecting passenger 22 is determined; a second distance 32 between the three-row left speaker 25 and the right ear of the sound collecting passenger 22 is determined; a third distance 33 between the three-row right speaker 26 and the left ear of the sound collecting passenger 22 is determined; and a fourth distance 34 between the three-row right speaker 26 and the right ear of the sound collecting passenger 22 is determined.
[0052] Optionally, the image sensor may be a photographing device for acquiring image information, and specifically may be a camera, a still camera, a driving recorder, etc.
[0053] Optionally, the image sensor may be disposed directly in front of each row of seats, or may be disposed at other locations where the seat positions can be photographed, which is not limited in this embodiment.
[0054] Optionally, the pressure sensor is disposed under the seat, and the pressure sensor may also be other sensors that can sense the position of an object on the seat.
[0055] S103. Based on the initial energy, the first position, and a preset energy difference threshold, calculate and adjust the gain of the target speaker so that the sound collecting passenger determines the first position according to the binaural effect, wherein the preset energy difference threshold refers to the energy difference threshold required for the two ears of the sound collecting passenger to determine the first position according to the binaural effect.
[0056] The vehicle computer calculates and adjusts the gain of the target speaker based on the initial energy, the first position, and the preset energy difference threshold so that the sound-receiving passenger determines the first position based on the binaural effect, wherein the preset energy difference threshold refers to the energy difference threshold required for the two ears of the sound-receiving passenger to determine the first position based on the binaural effect.
[0057] The disclosed embodiment obtains the first position of the first speaking passenger; calculates the initial energy of the audio signal played by the target speaker to the ears of the receiving passenger according to the distance between the target speaker and the ears of the receiving passenger; calculates and adjusts the gain of the target speaker based on the initial energy, the first position, and a preset energy difference threshold, so that the receiving passenger determines the first position according to the binaural effect, wherein the preset energy difference threshold refers to the energy difference threshold required for the two ears when the receiving passenger determines the first position according to the binaural effect; and adaptively adjusts the gain of the target speaker according to the position information of the first speaking passenger and the receiving passenger in the vehicle, so that the receiving passenger can clearly identify the first position of the first speaking passenger according to the binaural effect, thereby improving the riding experience of the passengers.
[0058] On the basis of the above embodiment, before calculating the initial energy of the audio signal played by the target speaker to the ears of the sound collecting passenger based on the distance between the target speaker and the ears of the sound collecting passenger, the method includes: performing image recognition on the image information collected by the image sensor to obtain the second position of the sound collecting passenger; determining the left speaker in the same row as the second position and / or the right speaker in the same row as the second position as the target speaker; and calculating the distance between the target speaker and the ears of the sound collecting passenger based on the spatial coordinates of the target speaker and the spatial coordinates of the ears of the sound collecting passenger.
[0059] The vehicle computer performs image recognition on the image information collected by the image sensor to obtain the second position of the sound receiving passenger; or the vehicle computer obtains the second position of the sound receiving passenger by identifying the pressure information collected by the pressure sensor; preferably, the vehicle computer obtains the second position of the sound receiving passenger by identifying the image information collected by the image sensor and the pressure information collected by the pressure sensor, that is, combining the image information and the pressure information, thereby improving the accuracy of the detection of the second position of the sound receiving passenger. The left speaker in the same row as the second position and / or the right speaker in the same row as the second position are determined as the target speaker (that is, the speaker in the same row as the sound receiving passenger is determined as the target speaker); according to the spatial coordinates of the target speaker and the spatial coordinates of the ears of the sound receiving passenger, the distance between the target speaker and the ears of the sound receiving passenger is calculated, and the distance between the target speaker and the ears of the sound receiving passenger can also be calculated according to the distance between the target speaker and the ears of the sound receiving passenger on the image information, and the ratio of the image distance to the actual distance. The distance between the target speaker and the ears of the sound receiving passenger specifically includes: the distance between the left speaker and the left ear of the sound receiving passenger; the distance between the left speaker and the right ear of the sound receiving passenger; the distance between the right speaker and the left ear of the sound receiving passenger; the distance between the right speaker and the right ear of the sound receiving passenger.
[0060] Optionally, the image sensor may be a photographing device for acquiring image information, and specifically may be a camera, a still camera, a driving recorder, etc.
[0061] Optionally, the photographing device may be disposed directly in front of each row of seats, or may be disposed at other locations where the seat positions can be photographed, which is not limited in this embodiment.
[0062] Optionally, the pressure sensor is disposed under the seat, and the pressure sensor may also be other sensors that can sense the position of an object on the seat.
[0063] The disclosed embodiment receives the voice signal of the first speaking passenger through the in-car call system; obtains the first position of the first speaking passenger through the image sensor; and / or obtains the first position of the first speaking passenger through the pressure sensor, thereby clarifying the origin of the first position and improving the accuracy of detecting the first position of the first speaking passenger.
[0064] In some embodiments, the initial energy of the audio signal played by the target speaker to the ears of the sound receiving passenger is calculated according to the distance between the target speaker and the ears of the sound receiving passenger, including: calculating the initial energy of the audio signal played by the target speaker to the ears of the sound receiving passenger through a head-related transfer function and a sound wave attenuation model according to the default energy of the target speaker and the distance between the target speaker and the ears of the sound receiving passenger.
[0065] The head-related transfer function (HRTF) is a function used to describe the propagation of sound in the human ear. It simulates the impact of the shape of the head and ear on the acoustic characteristics of sound by measuring the time delay, frequency response, and sound intensity changes that occur when the sound reaches the human ear from the source.
[0066] According to the default energy E of the target speaker ori The initial energy of the audio signal played by the target speaker to the ears of the passenger is calculated by the head-related transfer function and the sound wave attenuation model.
[0067] Optionally, according to the distance between the target speaker and the ears of the sound receiving passenger, the initial energy of the audio signal played by the target speaker to the ears of the sound receiving passenger is calculated, including: according to a first distance between the left speaker and the left ear of the sound receiving passenger, calculating the first initial energy of the audio signal played by the left speaker to the left ear of the sound receiving passenger by using a head-related transfer function and a sound wave attenuation model; according to a second distance between the left speaker and the right ear of the sound receiving passenger, calculating the second initial energy of the audio signal played by the left speaker to the right ear of the sound receiving passenger by using a head-related transfer function and a sound wave attenuation model; according to a third distance between the right speaker and the left ear of the sound receiving passenger, calculating the second initial energy of the audio signal played by the left speaker to the right ear of the sound receiving passenger by using a head-related transfer function and a sound wave attenuation model. The subtraction model calculates the third initial energy of the audio signal played by the right speaker to the left ear of the sound receiving passenger; according to the fourth distance between the right speaker and the right ear of the sound receiving passenger, the fourth initial energy of the audio signal played by the right speaker to the right ear of the sound receiving passenger is calculated by the head related transfer function and the sound wave attenuation model; the first sum of the first initial energy and the third initial energy is calculated, and the first sum is the initial energy of the audio signal played by the target speaker to the left ear of the sound receiving passenger; the second sum of the second initial energy and the fourth initial energy is calculated, and the second sum is the initial energy of the audio signal played by the target speaker to the right ear of the sound receiving passenger.
[0068] The head-related transfer function (HRTF) is a function used to describe the propagation of sound in the human ear. It simulates the impact of the shape of the head and ear on the acoustic characteristics of sound by measuring the time delay, frequency response, and sound intensity changes that occur when the sound reaches the human ear from the source.
[0069] Specifically, according to the first distance between the left speaker and the left ear of the sound receiving passenger, the first initial energy of the audio signal played by the third row left speaker 25 to the left ear of the sound receiving passenger 22 is calculated by the head related transfer function and the sound wave attenuation model. Specifically, the first initial energy is calculated as follows:
[0070]
[0071]
[0072] Among them, tf LL is the head-related transfer function from the third row left speaker 25 to the left ear of the sound receiving passenger 22, E leftSpk is the energy of the three rows of left speakers 25, E leftEar_LL is the first initial energy, d LL The first distance is 31.
[0073] Specifically, according to the second distance between the left speaker and the right ear of the sound receiving passenger, the second initial energy of the audio signal played by the third row left speaker 25 to the right ear of the sound receiving passenger 22 is calculated by the head related transfer function and the sound wave attenuation model. Specifically, the second initial energy is calculated as follows:
[0074]
[0075]
[0076] Among them, tf LR is the head-related transfer function from the third row left speaker 25 to the right ear of the sound receiving passenger 22, E rightSpk is the energy of the three rows of right speakers 26, E rightEar_LR is the second initial energy, d RL The second distance is 32.
[0077] Specifically, according to the third distance between the right speaker and the left ear of the sound receiving passenger, the third initial energy of the audio signal played by the third row right speaker 26 to the left ear of the sound receiving passenger 22 is calculated by the head related transfer function and the sound wave attenuation model. Specifically, the third initial energy is calculated as follows:
[0078]
[0079]
[0080] Among them, tf RL is the head-related transfer function from the third row right speaker 26 to the left ear of the sound receiving passenger 22, E leftSpk is the energy of the three rows of left speakers 25, E leftEar_RL is the third initial energy, d LR The third distance is 33.
[0081] Specifically, according to the fourth distance between the right speaker and the right ear of the sound receiving passenger, the fourth initial energy of the audio signal played by the third row right speaker 26 to the right ear of the sound receiving passenger 22 is calculated by the head related transfer function and the sound wave attenuation model. Specifically, the fourth initial energy is calculated as follows:
[0082]
[0083]
[0084] Among them, tf RR is the head-related transfer function from the third row right speaker 26 to the right ear of the sound receiving passenger 22, E rightSpk is the energy of the three rows of right speakers 26, E rightEar_RR is the fourth initial energy, d RR The fourth distance is 34.
[0085] Specifically, a first sum of the first initial energy and the third initial energy is calculated, where the first sum is the initial energy of the audio signal played by the target loudspeaker to the left ear of the sound receiving passenger.
[0086] The initial energy of the audio signal played by the target speaker to the left ear of the receiving passenger is calculated as follows:
[0087] E leftEar =E leftEar_LL +E leftEar_RL ,
[0088] Right now
[0089] Specifically, a second sum of the second initial energy and the fourth initial energy is calculated, where the second sum is the initial energy of the audio signal played by the target loudspeaker to the right ear of the sound receiving passenger.
[0090] The initial energy of the audio signal played by the target speaker to the right ear of the receiving passenger is calculated as follows:
[0091] E rightEar =E rightEar_LR +E rightEar_RR ,
[0092] Right now
[0093] Optionally, based on the initial energy, the first position, and a preset energy difference threshold, the gain of the target speaker is calculated and adjusted so that the sound collecting passenger determines the first position according to the binaural effect, including: keeping the gain of the speaker on the same side of the first position unchanged; calculating the target gain of the speaker on the opposite side of the first position according to the size of the first sum and the second sum, and the preset energy difference threshold, and adjusting the gain of the speaker on the opposite side of the first position to the target gain, so that the sound collecting passenger determines the first position according to the binaural effect.
[0094] Specifically, the gain of the speaker on the same side of the first position is kept unchanged; the target gain of the speaker on the opposite side of the first position is calculated according to the size of the first sum and the second sum, the first position, and a preset energy difference threshold, and the gain of the speaker on the opposite side of the first position is adjusted to the target gain, so that the sound receiving passenger determines the first position according to the binaural effect.
[0095] Optionally, based on the initial energy, the first position, and a preset energy difference threshold, the gain of the target speaker is calculated and adjusted so that the sound collecting passenger determines the first position according to the binaural effect, including: when the first position is on the left, keeping the gain of the left speaker unchanged; based on the sizes of the first sum and the second sum, the first position, and the preset energy difference threshold, calculating the first target gain of the right speaker according to the sizes of the first sum and the second sum, and adjusting the gain of the right speaker to the first target gain, so that the sound collecting passenger determines the first position according to the binaural effect.
[0096] Specifically, when the first position is on the left side, the gain of the three rows of left speakers 25 is kept unchanged; whether |E leftEar -E rightEar |≥E thread ? Since the first position is on the left, we can determine whether |E leftEar -ErightEar≥Ethread? That is, whether EleftEar-ErightEar≥Ethread? When the first sum EleftEar and the second sum E rightEar The absolute value of the difference is greater than the preset energy difference threshold E thread , according to the first sum value E leftEar and the second sum E rightEar The first target gain of the three-row right speakers 26 is calculated based on the size of the gain, and the gain of the three-row right speakers 26 is adjusted to the first target gain so that the sound receiving passenger 22 determines the first position, that is, the position of the first speaking passenger (driver 21) according to the binaural effect.
[0097] Optionally, based on the initial energy, the first position, and a preset energy difference threshold, the gain of the target speaker is calculated and adjusted so that the sound collecting passenger determines the first position according to the binaural effect, and also includes: when the first position is on the right side, keeping the gain of the right speaker unchanged; calculating the second target gain of the left speaker according to the size of the first sum and the second sum, the first position, and the preset energy difference threshold, and adjusting the gain of the left speaker to the second target gain so that the sound collecting passenger determines the first position according to the binaural effect.
[0098] Specifically, when the first position is on the right side, that is, the first speaking passenger is the front passenger 23, the gain of the right speaker 26 in the third row is kept unchanged; whether |E leftEar -E rightEa r|≥E thread ? Since the first position is on the right, we can determine whether |E leftEar -E rightEar |≥E thread ? That is, to determine whether E rightEar -E leftEar ≥E thread ? When the first sum value E leftEar and the second sum E rightEar The absolute value of the difference is greater than the preset energy difference threshold E thread , according to the first sum value E leftEar and the second sum E rightEar The second target gain of the three-row left speakers 25 is calculated based on the size of the gain, and the gain of the three-row left speakers 25 is adjusted to the second target gain so that the sound-receiving passenger can determine the first position, that is, the position of the first speaking passenger (the co-pilot passenger 23), according to the binaural effect.
[0099] Optionally, when the sounding passenger is in the front row, the sounding passenger is the driver, and the sound receiving passengers are two persons, that is, there are passengers in both the third row left and the third row right positions, the gain of the loudspeaker 25 on the same side of the sounding passenger remains unchanged. With the third row left passenger as the target, the third row right loudspeaker 26 can be obtained to meet the maximum value of the energy difference E rightSpk1 , taking the third row of right passengers as the target, we can get the maximum value of the energy difference E that the three rows of right speakers 26 meet. rightSpk2 In summary, the three rows of right speakers 26 must simultaneously meet the above two conditions, namely ≤min(E rightSpk1 , E rightSpk2 ) so that the three rows of left sound-receiving passengers and the three rows of right sound-receiving passengers can determine the first position of the speaking passenger based on the binaural effect.
[0100] For example, by default, the gain amplitudes of the two speakers in the same row are consistent, that is, the sound volume played by the two speakers in the same row is the same, and the energy at the speaker position is marked as E ori When there are only three rows of left passengers in the back row, if the first passenger to speak is the driver, it can be calculated based on the above information that the three rows of right speakers 26 meet the maximum energy difference E rightSpk , the third row of right speakers 26 need to increase the gain from E ori Adjusted to the calculated E rightSpk When there are passengers in both the third row left and third row right positions in the back row, taking the third row left passenger as the target, the third row right speaker 26 can be obtained to meet the maximum energy difference E rightSpk1, taking the third row of right passengers as the target, we can get the maximum value of the energy difference E that the three rows of right speakers 26 meet. rightSpk2 In summary, the three rows of right speakers 26 must simultaneously meet the above two conditions, namely ≤min(E rightSpk1 , E rightSpk2 ).
[0101] It is understandable that when the driver and the front passenger speak at the same time, no directional sound processing is performed. In actual application scenarios, the probability of two people speaking at the same time in the same row is very small, and the probability of a single person speaking in the same row is higher.
[0102] The disclosed embodiment specifically describes that in a vehicle, based on the energy of the audio signal played from the target speaker to the two ears, the first position, and the absolute value of the energy difference between the two ears being greater than a preset energy difference threshold, the gain of the target speaker is calculated and adjusted so that the sound receiving passenger can determine the first position based on the binaural effect, thereby further improving the passenger's riding experience.
[0103] Figure 5 A flow chart of the in-car call method provided by the embodiment of the present disclosure, such as Figure 5 As shown, the method includes the following specific steps:
[0104] S501, obtaining the first position of the first speaking passenger.
[0105] Specifically, the implementation process and principle of S501 and S101 are the same, and will not be described in detail here.
[0106] S502: Calculate the initial energy of the audio signal played by the target loudspeaker to the ears of the sound receiving passenger according to the distance between the target loudspeaker and the ears of the sound receiving passenger.
[0107] Specifically, the implementation process and principle of S502 and S102 are the same, and will not be repeated here.
[0108] S503. Based on the initial energy, the first position, and a preset energy difference threshold, calculate and adjust the gain of the target speaker so that the sound collecting passenger determines the first position according to the binaural effect, wherein the preset energy difference threshold refers to the energy difference threshold required for the two ears of the sound collecting passenger to determine the first position according to the binaural effect.
[0109] Specifically, the implementation process and principle of S503 and S103 are the same, and will not be repeated here.
[0110] S504: Obtain the third position of the second-pronouncing passenger.
[0111] The vehicle computer receives the sound signal of the second speaking passenger, determines the third position of the second speaking passenger through image information collected by the image sensor, and / or obtains the third position of the second speaking passenger through the pressure sensor.
[0112] S505, determining whether the third position and the first position are the same position, if so, executing S506; if not, executing S507.
[0113] The vehicle computer determines whether the third position and the first position are the same position, that is, determines whether the second-speaking passenger and the first-speaking passenger are the same passenger. If so, execute S507; if not, execute S508.
[0114] S506: Based on the fact that the second position does not change, maintain the gain of the target speaker.
[0115] Based on the fact that the second position does not change, the gain of the target speaker is maintained so that the sound collecting passenger determines the third position (ie, the first position) according to the binaural effect.
[0116] Optionally, if the second position changes, the target speaker is initialized and the process returns to execute S501.
[0117] S507, initializing the target speaker, and calculating and adjusting the gain of the target speaker according to the initial energy, the third position, and a second preset energy difference threshold, so that the sound receiving passenger determines the third position according to a binaural effect.
[0118] Initialize the target speaker, initialize the energy of the target speaker to the initial energy, calculate and adjust the gain of the target speaker according to the initial energy, the third position, and the second preset energy difference threshold, so that the sound receiving passenger determines the third position according to the binaural effect.
[0119] The disclosed embodiment initializes the target speaker, calculates and adjusts the target speaker gain according to the initial energy, the third position, and the second preset energy difference threshold, so that the sound-receiving passenger can determine the third position according to the binaural effect, thereby improving the gain adjustment accuracy of the target speaker.
[0120] Figure 6 The in-car communication device provided in the embodiment of the present disclosure is a schematic diagram of the structure. The in-car communication device may be the vehicle computer as described in the above embodiment, or the in-car communication device may be a component or assembly in the vehicle computer. The in-car communication device provided in the embodiment of the present disclosure may execute the processing flow provided in the in-car communication method embodiment, such as Figure 6As shown, the in-car call device 60 includes: an acquisition module 61, a calculation module 62, and an adjustment module 63; wherein the acquisition module 61 is used to acquire the first position of the first speaking passenger; the calculation module 62 is used to calculate the initial energy of the audio signal played by the target speaker to the ears of the sound receiving passenger according to the distance between the target speaker and the ears of the sound receiving passenger; the adjustment module 63 is used to calculate and adjust the gain of the target speaker based on the initial energy, the first position, and a preset energy difference threshold, so that the sound receiving passenger determines the first position according to the binaural effect, wherein the preset energy difference threshold refers to the energy difference threshold required for the ears of the sound receiving passenger to determine the first position according to the binaural effect.
[0121] Optionally, the computing module 62 is further used to perform image recognition on the image information collected by the image sensor to obtain the second position of the sound receiving passenger; determine the left speaker in the same row as the second position and / or the right speaker in the same row as the second position as the target speaker; and calculate the distance between the target speaker and the ears of the sound receiving passenger based on the spatial coordinates of the target speaker and the spatial coordinates of the ears of the sound receiving passenger.
[0122] Optionally, the calculation module 62 is further used to calculate the initial energy of the audio signal played by the target speaker to the ears of the sound receiving passenger according to the default energy of the target speaker and the distance between the target speaker and the ears of the sound receiving passenger through the head-related transfer function and the sound wave attenuation model.
[0123] Optionally, the target speaker includes a left speaker in the same row as the second position and a right speaker in the same row as the second position; the calculation module 63 is further used to calculate a first initial energy of the audio signal played by the left speaker to the left ear of the sound receiving passenger through a head-related transfer function and a sound wave attenuation model according to a first distance between the left speaker and the left ear of the sound receiving passenger; calculate a second initial energy of the audio signal played by the left speaker to the right ear of the sound receiving passenger through a head-related transfer function and a sound wave attenuation model according to a second distance between the left speaker and the right ear of the sound receiving passenger; calculate a second initial energy of the audio signal played by the left speaker to the right ear of the sound receiving passenger through a head-related transfer function and a sound wave attenuation model according to a third distance between the right speaker and the left ear of the sound receiving passenger The model calculates the third initial energy of the audio signal played by the right speaker to the left ear of the sound receiving passenger; according to the fourth distance between the right speaker and the right ear of the sound receiving passenger, the fourth initial energy of the audio signal played by the right speaker to the right ear of the sound receiving passenger is calculated through the head-related transfer function and the sound wave attenuation model; the first sum of the first initial energy and the third initial energy is calculated, and the first sum is the initial energy of the audio signal played by the target speaker to the left ear of the sound receiving passenger; the second sum of the second initial energy and the fourth initial energy is calculated, and the second sum is the initial energy of the audio signal played by the target speaker to the right ear of the sound receiving passenger.
[0124] Optionally, the adjustment module 64 is further used to keep the gain of the speaker on the same side of the first position unchanged; calculate the target gain of the speaker on the opposite side of the first position according to the size of the first sum value and the second sum value, the first position, and the preset energy difference threshold, and adjust the gain of the speaker on the opposite side of the first position to the target gain, so that the sound receiving passenger determines the first position according to the binaural effect.
[0125] Optionally, the acquisition module 61 is also used to acquire the third position of the second speaking passenger; the in-car call device 60 also includes: a judgment module and a holding module, the judgment module is used to judge whether the third position and the first position are the same position, and the holding module is used to maintain the gain of the target speaker when the third position and the first position are the same position based on that the second position has not changed; the adjustment module 64 is also used to initialize the target speaker when the third position and the first position are not the same position, and calculate and adjust the target speaker gain according to the initial energy, the third position, and the second preset energy difference threshold, so that the sound receiving passenger determines the third position according to the binaural effect.
[0126] Figure 6 The in-car call device of the illustrated embodiment can be used to execute the technical solution of the in-car call method embodiment described above, and its implementation principle and technical effect are similar and will not be described in detail here.
[0127] Figure 7 The electronic device provided in the embodiment of the present disclosure can execute the processing flow provided in the embodiment of the in-car call method, such as Figure 7 As shown, the electronic device 70 includes: a memory 71, a processor 72, a computer program and a communication interface 73; wherein the computer program is stored in the memory 71 and is configured so that the processor 72 executes the in-vehicle call method as described above.
[0128] In addition, an embodiment of the present disclosure further provides a computer-readable storage medium on which a computer program is stored. The computer program is executed by a processor to implement the in-vehicle call method described in the above embodiment.
[0129] In addition, an embodiment of the present disclosure further provides a vehicle, which includes the in-vehicle communication device as described in the above embodiment; or the electronic device as described in the above embodiment; or the computer-readable storage medium as described in the above embodiment.
[0130] It should be noted that, in this article, relational terms such as "first" and "second" are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the sentence "comprise a ..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.
[0131] The above description is only a specific embodiment of the present disclosure, so that those skilled in the art can understand or implement the present disclosure. Various modifications to these embodiments will be apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the present disclosure. Therefore, the present disclosure will not be limited to the embodiments described herein, but will conform to the widest scope consistent with the principles and novel features disclosed herein.
Claims
1. A method for in-car communication, characterized in that: The method comprises: Get the first position of the first-voiced passenger; Calculating the initial energy of the audio signal played by the target loudspeaker to the ears of the sound receiving passenger according to the distance between the target loudspeaker and the ears of the sound receiving passenger; Based on the initial energy, the first position, and a preset energy difference threshold, the gain of the target speaker is calculated and adjusted so that the sound collecting passenger determines the first position according to the binaural effect, wherein the preset energy difference threshold refers to the energy difference threshold required for the two ears of the sound collecting passenger to determine the first position according to the binaural effect.
2. The method according to claim 1, characterized in that Before calculating the initial energy of the audio signal played by the target speaker to the ears of the sound receiving passenger according to the distance between the target speaker and the ears of the sound receiving passenger, the method includes: Performing image recognition on the image information collected by the image sensor to obtain the second position of the sound receiving passenger; Determine a left speaker in the same row as the second position and / or a right speaker in the same row as the second position as a target speaker; According to the spatial coordinates of the target loudspeaker and the spatial coordinates of the ears of the sound collecting passenger, the distance between the target loudspeaker and the ears of the sound collecting passenger is calculated.
3. The method according to claim 1, characterized in that Calculating the initial energy of the audio signal played by the target loudspeaker to the ears of the sound receiving passenger according to the distance between the target loudspeaker and the ears of the sound receiving passenger, including: According to the default energy of the target speaker and the distance between the target speaker and the ears of the sound receiving passenger, the initial energy of the audio signal played by the target speaker to the ears of the sound receiving passenger is calculated through the head-related transfer function and the sound wave attenuation model.
4. The method according to claim 2, characterized in that: The target speakers include a left speaker in the same row as the second position and a right speaker in the same row as the second position; According to the distance between the target loudspeaker and the ears of the sound receiving passenger, the initial energy of the audio signal played by the target loudspeaker to the ears of the sound receiving passenger is calculated, including: According to a first distance between the left speaker and the left ear of the sound receiving passenger, a first initial energy of the audio signal played by the left speaker to the left ear of the sound receiving passenger is calculated by using a head-related transfer function and a sound wave attenuation model; According to a second distance between the left speaker and the right ear of the sound receiving passenger, a second initial energy of the audio signal played by the left speaker to the right ear of the sound receiving passenger is calculated by using a head-related transfer function and a sound wave attenuation model; According to a third distance between the right speaker and the left ear of the sound receiving passenger, a third initial energy of the audio signal played by the right speaker to the left ear of the sound receiving passenger is calculated by using a head-related transfer function and a sound wave attenuation model; According to a fourth distance between the right speaker and the right ear of the sound receiving passenger, calculating a fourth initial energy of the audio signal played by the right speaker to the right ear of the sound receiving passenger through a head-related transfer function and a sound wave attenuation model; Calculating a first sum of the first initial energy and the third initial energy, wherein the first sum is the initial energy of the audio signal played by the target loudspeaker to the left ear of the sound receiving passenger; A second sum of the second initial energy and the fourth initial energy is calculated, where the second sum is the initial energy of the audio signal played by the target loudspeaker to the right ear of the sound receiving passenger.
5. The method according to claim 4, characterized in that Based on the initial energy, the first position, and a preset energy difference threshold, calculating and adjusting the gain of the target speaker so that the sound collecting passenger determines the first position according to the binaural effect, comprising: Keeping the gain of the speaker on the same side of the first position unchanged; According to the magnitudes of the first sum and the second sum, the first position, and the preset energy difference threshold, a target gain of the speaker on the opposite side of the first position is calculated, and the gain of the speaker on the opposite side of the first position is adjusted to the target gain so that the sound receiving passenger determines the first position according to the binaural effect.
6. The method according to claim 2, characterized in that The method further comprises: Obtaining a third position of the second-voiced passenger; Determining whether the third position and the first position are the same position; If yes, maintaining the gain of the target speaker based on that the second position has not changed; If not, the target speaker is initialized, and the gain of the target speaker is calculated and adjusted according to the initial energy, the third position, and a second preset energy difference threshold, so that the sound receiving passenger determines the third position according to the binaural effect.
7. An in-car communication device, characterized in that: The device comprises: An acquisition module, used for acquiring a first position of a first speaking passenger; A calculation module, used for calculating the initial energy of the audio signal played by the target speaker to the ears of the sound receiving passenger according to the distance between the target speaker and the ears of the sound receiving passenger; an adjustment module, for calculating and adjusting the gain of the target loudspeaker based on the initial energy, the first position, and a preset energy difference threshold, so that the sound collecting passenger determines the first position according to a binaural effect, wherein the preset energy difference threshold refers to the energy difference threshold required for the two ears of the sound collecting passenger to determine the first position according to the binaural effect.
8. An electronic device, characterized in that: include: Memory; processor; as well as Computer programs; The computer program is stored in the memory and is configured to be executed by the processor to implement the method according to any one of claims 1 to 6.
9. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the method according to any one of claims 1 to 6 is implemented.
10. A vehicle, characterized in that: include: The in-car communication device as claimed in claim 7; Or, the electronic device as claimed in claim 8; Or, the computer readable storage medium of claim 9.