Automatic sound optimization in a vehicle interior in real time

The sound optimization system dynamically adjusts primary sound using lidar and acoustic sensors to address inflexibility and variability in vehicle interiors, ensuring optimal sound quality.

DE102023118980A1Pending Publication Date: 2025-01-23AUDI AG
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
DE102023118980
Authority / Receiving Office
DE · DE
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-07-18
Publication Date
2025-01-23

AI Technical Summary

Technical Problem

Existing sound optimization systems in vehicle interiors are inflexible and expensive, with acoustic properties influenced by changing interior objects and occupant positions, leading to varying sound quality perceptions.

Method used

A sound optimization system using a lidar sensor and acoustic camera to dynamically adjust primary sound based on real-time sensor data, incorporating resonance spectroscopy and a database of material properties to optimize sound quality.

Benefits of technology

Ensures consistent high-quality sound perception by adapting to changes in the interior environment and occupant positions, providing flexible and dynamic sound modification.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 00000000_0000_ABST
    Figure 00000000_0000_ABST
Patent Text Reader

Abstract

Method for modifying a sound in the interior of a vehicle, wherein a loudspeaker of an infotainment system of the vehicle located in the interior of a vehicle provides a primary sound in the interior of the vehicle and an acoustic sensor continuously detects a secondary sound and provides corresponding sensor signals, as well as a sound optimization device for a vehicle and vehicle.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] The invention relates to a method for modifying sound in the interior of a vehicle, in which a loudspeaker of an infotainment system of the vehicle, arranged in the interior of a vehicle, provides a primary sound in the interior of the vehicle, and an acoustic sensor of the vehicle continuously detects a secondary sound in the interior and provides corresponding sensor signals. Furthermore, the invention relates to a sound optimization device for a vehicle and a vehicle.

[0002] Methods of the type mentioned above are known in various forms in the prior art and serve to adapt the provided primary sound to the interior. The primary sound can, for example, include music.

[0003] On the one hand, the interior provides an acoustic response to the primary sound, which overrides the primary sound. On the other hand, the primary sound can be overridden by a disturbing sound provided by the vehicle and / or a vehicle occupant. In other words, the primary sound is distorted into the secondary sound.

[0004] The acoustic sensor detects the superposition of the primary sound, the acoustic response of the interior to the primary sound, and the background noise as the secondary sound. The primary sound adjustment is intended to ensure that the vehicle occupant perceives the secondary sound as closely as possible to the unadulterated primary sound. By adjusting the primary sound provided, this distortion is compensated for as much as possible.

[0005] DE 10 2007 031 677 A1 discloses a method for acoustically measuring a general acoustic space, in which a loudspeaker arranged in the acoustic space generates a reference sound, and a microphone arranged in the acoustic space detects an acoustic response to the reference sound provided by the acoustic space. A computing device functionally connected to the loudspeaker and the microphone determines an acoustic property of the acoustic space based on the detected acoustic response.

[0006] DE 10 2014 019 108 A1 discloses a similar method, but more specifically for acoustically measuring the interior of a vehicle. The determined acoustic properties of the interior can be used to configure a hands-free system in the vehicle.

[0007] The acoustic design of the interior, i.e., the shape and surface texture of the interior, accounts for up to 80% of the audibly perceivable sound quality of the secondary sound. Firstly, the acoustic design of the interior is complex and expensive. Secondly, it is inflexible. After all, the interior includes acoustically effective occupants and / or objects that frequently change and alter the intended room acoustics in unpredictable ways.

[0008] Apart from that, the auditorily perceived sound quality of the secondary sound depends on the position of the occupant in the interior who auditorily perceives the secondary sound, ie several occupants arranged in the interior can auditorily perceive different sound qualities of the secondary sound.

[0009] It is therefore an object of the invention to propose a method for modifying sound in the interior of a vehicle that allows a vehicle occupant located in the interior to always perceive the sound audibly with optimal tonal quality. Further objects of the invention are to provide a sound optimization device for a vehicle and a vehicle.

[0010] One subject matter of the invention is a method for modifying sound in the interior of a vehicle, in which a loudspeaker of an infotainment system of the vehicle, arranged in the interior of a vehicle, provides a primary sound in the interior of the vehicle, and an acoustic sensor of the vehicle continuously detects a secondary sound in the interior and provides corresponding sensor signals. The secondary sound is a superposition of the provided primary sound, an acoustic response of the interior to the provided primary sound, and an interfering sound provided by the vehicle and / or a passenger of the vehicle. The acoustic response of the interior is a superposition of reflections, diffusions, and / or absorptions by surfaces bounding the interior.

[0011] Vehicle occupants and / or objects such as bags located within the interior are also considered boundary surfaces and contribute to the acoustic response. The noise may include vehicle noise and / or a spoken utterance from an occupant. The infotainment system may play music provided by the speaker as the primary sound.

[0012] According to the invention, an optical sensor of the vehicle continuously detects the interior and provides corresponding sensor signals, while a sound optimization device of the vehicle automatically modifies the provided primary sound in real time depending on the provided sensor signals. The sensor signals provided by the optical sensor enable the sound optimization device to detect the boundary surfaces and to consider a reflection property, a diffusion property, and / or an absorption property of each detected boundary surface. In this way, the sound optimization device is able to optimally modify the provided primary sound for different interior spaces.

[0013] In addition, the automatic modification of the primary sound provided in real time results in a continuous adaptation of the primary sound provided to changes in the interior, in particular to an occupant getting in, out or changing position, or to an object such as a bag being loaded, unloaded or moved.

[0014] As a result, the provided primary sound is modified flexibly and dynamically, which ensures that the provided primary sound always has a high quality.

[0015] Preferably, a LIDAR sensor as the optical sensor detects spatial dimensions of the interior and / or positions and / or dimensions of vehicle occupants and / or objects located in the interior. The Light Detection and Ranging (LIDAR) sensor has good spatial and depth resolution. In particular, the LIDAR sensor also detects the position of an occupant's head. The head position is the position relevant for auditory perception of the occupant.

[0016] Advantageously, an acoustic camera or microphones arranged on a roof lining of the vehicle act as the acoustic sensor to detect the acoustic response of the interior and / or background noise generated by the vehicle and / or its occupants. The acoustic camera is configured to localize sound sources and generate a color digital image with the localized sound sources. The microphones can be arranged in the vehicle's headrests and, for example, detect vocal utterances from occupants.

[0017] Modifying the sound can involve evaluating the provided sensor signals using resonance spectroscopy. Resonance spectroscopy allows for the detection of resonant absorptions in the interior.

[0018] In one embodiment, modifying the sound comprises individually optimizing it for a specific occupant of the vehicle or collectively optimizing it for a plurality of occupants of the vehicle. Based on determined head positions, the modified primary sound can exhibit optimal sound quality exclusively at a specific occupant's head position or can exhibit the highest possible sound quality at the head positions of multiple occupants simultaneously.

[0019] Modifying the sound advantageously comprises comparing the provided sensor signals with data from a database of the sound optimization device and / or determining an absorption coefficient and / or a diffusion coefficient of a surface of the interior and / or of an occupant and / or object arranged in the interior. Data records of the database can include assignments of materials, on the one hand, and acoustic properties, on the other hand, for example, respective abilities to reflect, diffuse, or absorb sound. It is understood that the acoustic properties of the materials are frequency-dependent, i.e., they are not constant across the maximum audibly perceptible frequency spectrum of 16 Hz to 20 kHz.

[0020] In particular, the sound is provided by a plurality of speakers of the infotainment system. The plurality of speakers may include a speaker front and / or at least one subwoofer.

[0021] Modifying the sound preferably involves configuring woofers. The woofers are also called subwoofers and can be installed in pairs in the vehicle. Each pair of subwoofers can be controlled such that a first subwoofer in the pair provides the primary sound, and a second subwoofer in the pair absorbs the provided primary sound. This avoids low-frequency sound enhancements.

[0022] Another subject of the invention is a sound optimization device for a vehicle. The sound optimization device is designed to modify a provided sound, i.e., to alter its tone. The sound optimization device can be integrated into the infotainment system or be a separate control unit of the vehicle. The sound optimization device comprises a computing device and can comprise software stored in the computing device. Advantageously, the sound optimization device comprises a high-performance digital sound processor (DSP).

[0023] According to the invention, the sound optimization device is configured to carry out a method according to one embodiment of the invention in cooperation with a loudspeaker of an infotainment system of the vehicle, an acoustic sensor of the vehicle, and an optical sensor of the vehicle. The sound optimization device allows the provision of sound in such a way that a passenger of the vehicle located in the interior always perceives the sound audibly with optimal sound quality, thereby increasing the passenger's satisfaction.

[0024] Another subject of the invention is a vehicle comprising an interior, an infotainment system arranged in the interior with a loudspeaker, an acoustic sensor arranged in the interior, an optical sensor arranged in the interior, and a sound control unit functionally connected to the infotainment system and the sensors. The vehicle is configured to provide the interior with sound of a controllable sound quality.

[0025] According to the invention, the sound control device is designed as a sound optimization device according to one embodiment of the invention. The vehicle always provides an audibly perceptible sound with optimal sound quality for an occupant located in the vehicle interior, thereby increasing the occupant's satisfaction.

[0026] A key advantage of the method according to the invention is that a provided primary sound in a vehicle interior is flexibly modified spatially and temporally to compensate for acoustic impairments caused by the interior. In this way, a vehicle occupant always perceives the provided primary sound with as close to the original sound quality as possible.

[0027] The invention is schematically illustrated in the drawings using an embodiment and will be further described with reference to the drawings. It shows: Fig. 1 shows a plan view of a vehicle according to an embodiment of the invention.

[0028] Fig.Figure 1 shows a plan view of a vehicle 1 according to one embodiment of the invention. The vehicle 1 comprises an interior 10, an infotainment system 11 with a loudspeaker 110, an optical sensor 120 arranged in the interior 10, an acoustic sensor 121 arranged in the interior 10, and a sound optimization device 13 functionally connected to the infotainment system 11 and the sensors 120, 121 according to one embodiment of the invention.

[0029] The sound optimization device 13 is suitable for the vehicle 1 and is configured, in cooperation with the loudspeaker 110 of the infotainment system 11 of the vehicle 1, the acoustic sensor 121 of the vehicle 1 and the optical sensor 120 of the vehicle 1 for modifying a sound in the interior 10 of the vehicle 1, to carry out a method according to an embodiment of the invention as follows.

[0030] A loudspeaker 110 of the infotainment system 11 of the vehicle 1, arranged in the interior 10 of the vehicle 1, provides a primary sound 4 in the interior 10 of the vehicle 1. The provided primary sound 4 can be provided by a plurality of loudspeakers 110 of the infotainment system 11.

[0031] An acoustic sensor 121 continuously detects a secondary sound 5 in the interior 10 and provides corresponding sensor signals. An acoustic camera or a microphone of the vehicle 1 arranged on a roof liner 14 of the vehicle 1 can act as the acoustic sensor 121 to detect the secondary sound in the interior 10.

[0032] The secondary sound 5 is a superposition of the provided primary sound 4, an acoustic response of the interior 10 to the provided primary sound 4 and a disturbing sound provided by the vehicle 1 and / or occupants 2 of the vehicle.

[0033] An optical sensor 120 of the vehicle 1 continuously detects the interior 10 and provides corresponding sensor signals. A LIDAR sensor, acting as the optical sensor 120, can detect spatial dimensions of the interior 10 and / or positions and / or dimensions of occupants 2 of the vehicle 1 and / or objects 3 arranged in the interior 10.

[0034] The sound optimization device 13 of the vehicle 1 modifies the provided primary sound 4 automatically and in real time based on the provided sensor signals. Modifying the primary sound 4 can include evaluating the provided sensor signals using resonance spectroscopy. Furthermore, modifying the primary sound 4 can include comparing the provided sensor signals with data from a database 130 of the sound optimization device 13 and / or determining an absorption coefficient and / or a diffusion coefficient of a surface of the interior 10 and / or of an occupant 2 and / or object 3 arranged in the interior 10.

[0035] In particular, modifying the primary sound 4 may include individual optimization for a specific occupant 2 of the vehicle 1, for example a driver, or collective optimization for a plurality of occupants 2 of the vehicle 1, for example the driver and a passenger.

[0036] Modifying the primary sound 4 preferably includes configuring bass speakers 111. LIST OF REFERENCE SYMBOLS: 1 vehicle 10 Interior 11 Infotainment system 110 speakers 111 bass speakers 120 optical sensor 121 acoustic sensor 13 Sound optimization device 130 database 14 headliner 2 inmates 3 Object 4 primary sound 5 secondary sound QUOTES CONTAINED IN THE DESCRIPTION

[0000] This list of documents submitted by the applicant was generated automatically and is included solely for the convenience of the reader. This list is not part of the German patent or utility model application. The DPMA assumes no liability for any errors or omissions. Cited patent literature

[0000] DE 10 2007 031 677 A1

[0005] DE 10 2014 019 108 A1

[0006]

Claims

[1] Method for modifying a sound in an interior (10) of a vehicle (1), in which - a loudspeaker (110) of an infotainment system (11) of the vehicle (1) arranged in an interior (10) of a vehicle (1) provides a primary sound (4) in the interior (10) of the vehicle (1); - an acoustic sensor (121) of the vehicle (1) continuously detects a secondary sound (5) in the interior (10) and an optical sensor (120) of the vehicle (1) continuously detects the interior (10) and each provides corresponding sensor signals; - a sound optimization device (13) of the vehicle (1) modifies the provided primary sound (4) automatically and in real time depending on the provided sensor signals. [2] Method according to claim 1, wherein a LIDAR sensor as the optical sensor (120) detects spatial dimensions of the interior (10) and / or positions and / or dimensions of occupants (2) of the vehicle (1) and / or objects (3) arranged in the interior (10). [3] Method according to claim 1 or 2, wherein an acoustic camera or a microphone arranged on a roof lining (14) of the vehicle (1) detects the secondary sound (5) as the acoustic sensor (121). [4] Method according to one of claims 1 to 3, wherein modifying the primary sound (4) comprises evaluating the provided sensor signals by means of resonance spectroscopy. [5] Method according to one of claims 1 to 4, wherein the modification of the primary sound (4) comprises an individual optimization for a specific occupant (2) of the vehicle (1) or a collective optimization for a plurality of occupants (2) of the vehicle (1). [6] Method according to one of claims 1 to 5, wherein the modification of the primary sound (4) comprises a comparison of the provided sensor signals with data from a database (130) of the sound optimization device (13) and / or a determination of an absorption level and / or a diffusion level of a surface of the interior (10) and / or of an occupant (2) and / or object (3) arranged in the interior (10). [7] Method according to one of claims 1 to 6, wherein the primary sound (4) is provided by a plurality of loudspeakers (110) of the infotainment system (11). [8] A method according to any one of claims 1 to 7, wherein modifying the primary sound (4) comprises configuring bass speakers (111). [9] Sound optimization device (13) for a vehicle (1), which is configured to carry out a method according to one of claims 1 to 8 in cooperation with a loudspeaker (110) of an infotainment system (11) of the vehicle (1), an acoustic sensor (121) of the vehicle (1) and an optical sensor (120) of the vehicle (1). [10] Vehicle (1) comprising an interior (10), an infotainment system (11) arranged in the interior with a loudspeaker (110), an acoustic sensor (121) arranged in the interior (10), an optical sensor (120) arranged in the interior (10), and a sound optimisation device (13) according to claim 9, which is functionally connected to the infotainment system (11) and the sensors (120, 121).

Citation Information

Patent Citations

  • Method and device for determining a room-acoustic impulse response in the time domain

    DE102007031677A1

  • Method for operating a loudspeaker device and motor vehicle with a loudspeaker device

    DE102014019108A1

  • system and method for selective volume adjustment in a vehicle

    DE102018114529A1

  • Speech Signal Enhancement Using Visual Information

    US20140337016A1

  • Adaptive active noise cancellation based on head movement

    US20230085506A1