Method for adjusting sound output in a vehicle and system for sound output in a vehicle

A system with multiple microphones and speakers uses speech recognition and AI to enhance speech intelligibility in vehicles by reducing noise and amplifying targeted speech, addressing noise interference and discomfort in vehicle interiors.

DE102023120130A1Pending Publication Date: 2025-01-30DR ING H C F PORSCHE AG
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
DE102023120130
Authority / Receiving Office
DE · DE
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-07-28
Publication Date
2025-01-30

AI Technical Summary

Technical Problem

Noise interference and reduced speech intelligibility in vehicle interiors, particularly between front and rear seat passengers, due to sound reflections and music playback, leading to increased volume settings and passenger discomfort during conversations.

Method used

A system utilizing multiple microphones and speakers with speech recognition and artificial intelligence to identify and localize speakers, adjusting sound output parameters like volume and spatial profiles to enhance speech intelligibility by reducing noise levels and amplifying targeted speech.

Benefits of technology

Improves speech understanding by selectively reducing ambient noise and enhancing targeted speech volume, minimizing passenger discomfort and improving conversation clarity in vehicle interiors.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

In various embodiments, a method for adjusting sound output (21, 22, 23, 24) in a vehicle (1) is provided, wherein the sound output (21, 22, 23, 24) is provided by means of several loudspeakers (31, 32, 33, 34), the method comprising: receiving sound at at least one position in an interior (6) of the vehicle (1); processing the received sound to recognize a speech (41) spoken in the interior (6); assigning the recognized spoken speech to a speaker (4) in the interior (6); identifying a receiver (5) of the spoken speech (41); adjusting at least one output parameter of the sound output (21, 22) to modify the sound output (21, 22, 23, 24) at least in a spatial area around the receiver (5) of the speech (41). Furthermore, a system for sound output in a vehicle is provided.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The present invention relates to a method for adjusting a sound output in a vehicle and a system for sound output in a vehicle which is configured to carry out the method for adjusting the sound output.

[0002] Although modern vehicles are continually optimized with regard to passenger compartment acoustics, background noise can still occur, particularly at high speeds, which can interfere with conversations held inside the vehicle. This is particularly the case when people in the front seats talk to people in the back seat but do not turn their heads but speak forward. This also propagates the sound forward, and the sound first reaches the people in the back seat via sound reflection. During a conversation, music played in the interior via the sound system is also considered a source of background noise, as it can drown out the speech of the passengers and impair understanding.

[0003] To improve speech comprehension despite background noise, the speaker usually intuitively increases the volume, which can be tedious during longer conversations and, in extreme cases, can cause temporary hoarseness. Furthermore, people sitting in the back seat tend to lean forward while speaking, and people sitting in the front seats turn or tilt their heads to the side to facilitate conversation. This can also be perceived as an inconvenience by passengers on longer journeys.

[0004] To address this problem, for example, document DE 10 2020 107 540 A1 discloses a system for transmitting speech in a vehicle, wherein the system comprises at least one microphone assigned to a first passenger position of the vehicle and at least one loudspeaker assigned to a second passenger position of the vehicle, which loudspeaker is configured to emit a sound to the second passenger position, as well as a signal processing unit configured to process an electrical microphone signal of the first passenger position and to generate therefrom an electrical loudspeaker signal of the second passenger position.The system is configured to be operated in a first mode in which a first electrical loudspeaker signal is generated, and / or to be operated in a second mode in which a second electrical loudspeaker signal is generated, wherein the first electrical loudspeaker signal differs from the second electrical loudspeaker signal.

[0005] Against this background, the object of the invention can be seen in providing a method to further facilitate conversations in the interior of a vehicle.

[0006] This object is achieved by means of the subject matter of the independent patent claims. Further preferred embodiments can be found in the dependent patent claims.

[0007] According to the invention, a method for adjusting sound output in a vehicle is provided, wherein the sound output is provided by means of a plurality of loudspeakers. The method comprises, in a first step, recording sound at at least one position in an interior of the vehicle. The sound can also be recorded using a plurality of microphones arranged in the interior of the vehicle.

[0008] In a further step, the method comprises processing the recorded sound to recognize speech spoken in the interior. Speech recognition software can be used for this purpose. The sound recorded by the at least one loudspeaker can be filtered to remove the sound reproduced systematically by the loudspeakers, such as music or instructions from a navigation system. This allows the "net sound" to be evaluated with regard to its speech content, i.e., the sound generated purely in the interior.

[0009] In a further step, the method involves assigning the recognized spoken language to a speaker in the vehicle interior. The assignment of the recognized speech can be achieved, for example, based on the sound's propagation time to at least two loudspeakers placed at different positions. Furthermore, additional data can be considered, such as images from a vehicle camera capturing the interior, including image recognition, or data from weight sensors that indicate which seats in the vehicle are occupied by passengers.

[0010] In a further step, the method comprises determining (at least) one recipient of the spoken speech. For this purpose, artificial intelligence can be used to identify the at least one person addressed in the vehicle interior. The artificial intelligence can have a speech recognition module to analyze the speech contained in the recorded sound. Furthermore, the artificial intelligence can be trained to filter out the explicit address, so that the present method only applies when a vehicle occupant actually wants to speak.

[0011] In a further step, the method comprises adjusting at least one output parameter of the sound output in order to change the sound output at least in a spatial region around the speech receiver. The change in the sound output is always aimed at improving speech intelligibility.

[0012] The output parameter of the sound output can, in particular, be a volume, whereby adjusting the at least one output parameter can result in a reduction in the sound level. Furthermore, the output parameter can be a surround sound profile, which can be switched, for example, so that the multimedia playback is turned down for the people addressed or for everyone other than the person speaking, thus making it less loud or less disturbing.

[0013] Alternatively, especially if no person being addressed can be recognized, the overall volume of the multimedia playback can be reduced for the duration of the speech being spoken in the interior in order to reduce the noise level in the interior, which can impair speech intelligibility.

[0014] The volume control according to this method is implemented through speech or voice recognition and localization using acoustic sensors in the vehicle interior. Once the speaker has been located, the volume of the multimedia playback (e.g., music playback) is reduced on the other side. Furthermore, the speaker's voice can also be additionally output (amplified) by the multimedia playback system. When the speaker has finished speaking, the volume can be automatically increased back to its original level or the system can switch back to the original surround sound profile. Ideally, the music volume can only be reduced for the other occupants in the interior if they are actually being addressed.For example, if the speaker is only speaking to the person sitting next to them, this is detected and the multimedia playback is reduced only for the conversation partners.

[0015] According to further embodiments of the method, the adjusted sound output can be a multimedia playback, in particular music, output via the loudspeakers. Local adjustment of the volume, for example in the area of ​​the addressed persons / voice receivers, can be achieved by selecting a different surround sound profile in which the sound level is reduced at the location of the (at least one) addressed person.

[0016] According to further embodiments of the method, this may further comprise playing back the speech spoken in the interior via at least one of the loudspeakers in the interior. This allows the speech to be played back with increased sound pressure, which can have a positive effect on speech comprehension for other people in the vehicle. The recorded speech can thus be amplified compared to the original speech volume and output, for example, via loudspeakers that are located closer to the speech receiver than the speaker.

[0017] According to further embodiments of the method, the speech can be output in such a way that it is maximally perceptible within the range of the speech recipient. For this purpose, the speaker's voice can, for example, be output only via the loudspeaker(s) located within the range of the person(s) being addressed.

[0018] According to further embodiments of the method, it may further comprise resetting the at least one output parameter to its original value when it is detected that the recognized spoken language has been adjusted. This may, for example, mean that the speaker is finished, and the volume of the multimedia playback is automatically increased again.

[0019] According to the invention, a system for sound output in a vehicle is further provided, comprising a number of loudspeakers, at least one microphone, and a processing unit which is configured to receive signals from the loudspeakers and from the microphone and to carry out the method described above.

[0020] In its basic form, the present method is characterized by adaptive volume control for multimedia playback, such as music playback, including detection of which inmate is currently speaking to whom. The temporary volume reduction can occur at least in the range of at least one speech receiver, i.e., the at least one other person involved in the conversation.

[0021] It is understood that the features mentioned above and those to be explained below can be used not only in the combination specified in each case, but also in other combinations or on their own, without departing from the scope of the present invention.

[0022] Further advantages and embodiments of the invention will become apparent from the description and the accompanying drawings. Fig. 1 illustrates an application scenario of the present method.

[0023] The figure shows a vehicle 1 including its interior 6 (passenger compartment). Four loudspeakers 21, 22, 23, 24 are arranged in the interior 6, with one of the loudspeakers being located closest to each of the four seating positions. Each of the loudspeakers 21, 22, 23, 24 generates a corresponding sound 31, 32, 33, 34, which is directed into the interior 6 of the vehicle 1.

[0024] In Fig.1 further identifies a driver area 4 and a passenger area 5. Within the scope of the method according to the invention, speech sound generated in the interior 6 can be assigned to a speaker. In the example shown, the driver is speaking to the passenger. By means of acoustic sensors, the speech sound 41 is consequently assigned to the driver area. Furthermore, in the example shown, the volume of the music playing in the interior 6 in the driver cockpit, which comprises the driver area 4 and the passenger area 5, is reduced. For this purpose, the volume of the first sound reproduction 31 from the first loudspeaker 21 and the second sound reproduction 32 from the second loudspeaker 22 can be reduced. The sound reproductions 33, 34 of the two rear loudspeakers 33, 34, however, can remain unchanged, since the people sitting in these seats are not involved in the conversation. QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] DE 10 2020 107 540 A1

[0004]

Claims

[1] Method for adjusting a sound output (21, 22, 23, 24) in a vehicle (1), wherein the sound output (21, 22, 23, 24) is effected by means of a plurality of loudspeakers (31, 32, 33, 34), the method comprising: Recording sound at at least one position in an interior (6) of the vehicle (1); Processing the recorded sound to recognize a speech (41) spoken in the interior (6) Assigning the recognized spoken language to a speaker (4) in the interior (6); Determining a receiver (5) of the spoken speech (41); adjusting at least one output parameter of the sound output (21, 22) in order to change the sound output (21, 22, 23, 24) at least in a spatial region around the receiver (5) of the speech (41). [2] The method of claim 1, wherein adjusting the at least one output parameter comprises reducing the sound level. [3] Method according to claim 1, wherein the adapted sound output is a multimedia playback, in particular music, output by means of the loudspeakers. [4] The method according to claim 1 or 2, further comprising: Reproducing the language spoken in the passenger compartment through at least one of the loudspeakers. [5] Method according to claim 4, wherein the speech is output in such a way that it is maximally perceptible in the area of the receiver of the speech. [6] Method according to one of claims 1 to 4, further comprising: Resetting the at least one output parameter to its original value when it is detected that the recognized spoken language has been set. [7] System for emitting sound in a vehicle, comprising: a number of loudspeakers (21, 22, 23, 24); at least one microphone; and a processing unit arranged to receive signals from the loudspeakers (21, 22, 23, 24) and from the microphone and to carry out the method according to one of the preceding claims.

Citation Information

Patent Citations

  • System and method for transmitting speech in a vehicle

    DE102020107540A1

  • Method, device and computer program for varying audio content to be output in a vehicle

    DE102017213252A1