A method and system for controlling multi-zone immersive sound effects in a car audio system

Abstract

This invention discloses a method and system for controlling multi-zone immersive sound effects in a vehicle audio system. The method includes: acquiring an audio source signal, vehicle status information, and in-vehicle environmental noise information; determining the audio target based on the audio source signal; calculating and determining speaker driving parameters using a vehicle cabin acoustic model based on the vehicle status information and in-vehicle environmental noise information; wherein the reflection and reverberation parameters of the sound field in the vehicle cabin acoustic model are determined based on the vehicle status information, and the frequency response and specific frequency band gain of the sound field in the vehicle cabin acoustic model are determined based on the in-vehicle environmental noise information; and controlling the speaker to play the audio target based on the determined speaker driving parameters. This improves the auditory experience of the audio.

Description

Technical Field

[0001] This invention relates to the field of vehicle audio control technology, and in particular to a method and system for controlling multi-zone immersive sound effects in vehicle audio systems. Background Technology

[0002] The statements in this section are merely background information related to the present invention and do not necessarily constitute prior art.

[0003] In related technologies, in order to meet the personalized listening needs of passengers in different seats in the car, multiple microphones are arranged in the car and acoustic analysis is performed. Beamforming or audio cancellation technology is used to directionally transmit different audio content (such as music and navigation prompts) to passengers in specific seating areas, while minimizing interference to other areas.

[0004] However, changes in vehicle speed, opening and closing of windows, and noise inside the vehicle can all alter acoustic reflection characteristics, thus affecting the listening experience of the sound system. Summary of the Invention

[0005] To address the aforementioned problems, this invention proposes a multi-zone immersive sound effect control method and system for in-vehicle audio systems. This system can adjust the driving parameters of the in-vehicle speakers in a timely manner according to the vehicle status and in-vehicle ambient noise, thereby ensuring the audio listening experience in different scenarios.

[0006] To achieve the above objectives, the present invention adopts the following technical solution: Firstly, a method for controlling multi-zone immersive sound effects in vehicle audio systems is proposed, including: Acquire audio source signals, vehicle status information, and in-vehicle environmental noise information; Identify the audio object based on the audio source signal; Based on vehicle status information and in-vehicle environmental noise information, the speaker driving parameters are calculated and determined using the vehicle cabin acoustic model. Among them, the reflection and reverberation parameters of the sound field in the vehicle cabin acoustic model are determined based on the vehicle status information, and the frequency response and specific frequency band gain of the sound field in the vehicle cabin acoustic model are determined based on the in-vehicle environmental noise information. Based on the determined speaker drive parameters, control the speaker to play audio objects.

[0007] Furthermore, it also obtains information on the distribution of occupants inside the vehicle; Based on the passenger distribution information, vehicle status information, and in-vehicle environmental noise information, the speaker driving parameters are calculated and determined using the vehicle acoustic model.

[0008] Furthermore, for each occupant, the loudspeaker driving parameters are determined with the goal of maximizing the sound field where that occupant is located and minimizing the energy transmitted from that occupant's sound field to the other occupants.

[0009] Furthermore, for each occupant in the vehicle, the speaker driving parameters are determined with the target sound field direction being directly in front of that occupant.

[0010] Furthermore, the cabin acoustic model was constructed based on the vehicle's cabin dimensions, the sound absorption coefficient of the interior materials, and the location of all speakers within the cabin.

[0011] Furthermore, a specific frequency band refers to the noise frequency band in which the in-vehicle environmental noise information is located.

[0012] Secondly, a multi-zone immersive sound effect control system for in-vehicle audio is proposed, including: The information acquisition unit is used to acquire audio source signals, vehicle status information, and in-vehicle environmental noise information. An audio signal processing unit is used to determine the audio object based on the audio source signal; The multi-zone management and control unit is used to calculate and determine the speaker driving parameters based on vehicle status information and in-vehicle environmental noise information using a vehicle acoustic model. The reflection and reverberation parameters of the sound field in the vehicle acoustic model are determined based on the vehicle status information, while the frequency response and specific frequency band gain of the sound field in the vehicle acoustic model are determined based on the in-vehicle environmental noise information. Based on the determined speaker driving parameters, the unit controls the speakers to play audio to the target audio.

[0013] Thirdly, a computer device is proposed, the device comprising: A processor, adapted to execute computer programs; A computer-readable storage medium storing a computer program, which, when executed by the processor, implements the multi-zone immersive sound effect control method for vehicle audio systems proposed in the first aspect.

[0014] Fourthly, a computer-readable storage medium is proposed, wherein the computer-readable storage medium stores a computer program adapted to be loaded and executed by a processor, the method for controlling multi-zone immersive sound effects in a vehicle audio system proposed in the first aspect.

[0015] Fifthly, a computer program product is proposed, which includes a computer program. When the computer program is executed by a processor, it implements the multi-zone immersive sound effect control method for in-vehicle audio proposed in the first aspect.

[0016] Compared with the prior art, the beneficial effects of the present invention are as follows: This invention proposes a method and system for controlling multi-zone immersive sound effects in a vehicle audio system. When playing audio through in-vehicle speakers, the method adaptively adjusts the reflection and reverberation parameters, frequency response, and specific frequency band gain of the sound field in the vehicle acoustic model based on vehicle status information and in-vehicle environmental noise information. This ensures that the determined speaker driving parameters are compatible with the current vehicle environment and status, thereby guaranteeing the listening experience of audio in different scenarios.

[0017] Advantages of additional aspects of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description

[0018] The accompanying drawings, which form part of this application, are used to provide a further understanding of this application. The illustrative embodiments of this application and their descriptions are used to explain this application and do not constitute an undue limitation of this application.

[0019] Figure 1 This is a flowchart of a multi-zone immersive sound effect control method for vehicle audio systems proposed in an embodiment of the present invention; Figure 2 This is a structural block diagram of a multi-zone immersive sound effect control system for vehicle audio systems proposed in an embodiment of the present invention. Detailed Implementation

[0020] The present invention will be further described below with reference to the accompanying drawings and embodiments.

[0021] It should be noted that the following detailed descriptions are illustrative and intended to provide further explanation of this application. Unless otherwise specified, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains.

[0022] It should be noted that the terminology used herein is for the purpose of describing particular embodiments only and is not intended to limit the exemplary embodiments according to this application. As used herein, the singular form is intended to include the plural form as well, unless the context clearly indicates otherwise. Furthermore, it should be understood that when the terms "comprising" and / or "including" are used in this specification, they indicate the presence of features, steps, operations, devices, components, and / or combinations thereof.

[0023] Where there is no conflict, the embodiments and features in the embodiments of the present invention can be combined with each other.

[0024] It should be noted that all data acquisition is conducted in accordance with laws and regulations and with user consent, and the data is used legally.

[0025] First, the application scenarios and application systems of the multi-zone immersive sound effect control method for vehicle audio proposed in the embodiments of the present invention will be described in detail.

[0026] The present invention proposes a method for controlling multi-zone immersive sound effects in a car audio system, which is applied to the specific application scenario of audio playback control in a car audio system with multiple zones.

[0027] With the rapid development of the automotive industry and consumer electronics technology, in-vehicle audio systems have become an indispensable part of modern vehicles. Their function has evolved from basic audio playback to a key device for enhancing the driving and riding experience. Currently, mainstream in-vehicle audio systems primarily employ the following technical solutions to achieve high-quality audio reproduction: (1) Multi-channel surround sound system: These systems borrow from home theater concepts, placing multiple speakers (such as front door woofers, rear door midrange speakers, A-pillar tweeters, and rear platform surround speakers) within the vehicle cabin to create a standard 5.1, 7.1, or even more-channel physical layout. Through amplifiers and audio processors, multi-channel audio signals (such as Dolby AC-3 and DTS formats) are distributed to the corresponding speakers, aiming to create a highly immersive sound field environment within the vehicle cabin.

[0028] (2) Sound field reconstruction technology: Some high-end car audio systems employ sound field reconstruction or "virtual surround sound" technology. This technology uses digital signal processing algorithms (such as HRTF) to process two-channel stereo sound sources, simulating the effect of multi-channel surround sound, attempting to create a wider sound field in front of or around the listener. This approach can provide a certain sense of space without significantly increasing the number of physical speakers.

[0029] (3) Independent register control technology: To meet the personalized listening needs of passengers in different seats, some advanced systems have introduced independent sound zone (such as driver's area, front passenger area, and rear left and right areas) control functions. This system uses multiple microphones placed in the cabin to perform acoustic analysis, and employs beamforming or audio cancellation technology to directionally deliver different audio content (such as music and navigation prompts) to passengers in specific seating areas, while minimizing interference to other areas.

[0030] While existing technologies have improved the in-car audio experience to some extent, there are still significant limitations and inherent flaws in achieving true "immersive sound," especially within the dynamically changing cabin space: (1) The sound field is fixed and lacks adaptability and personalization: Traditional multi-channel surround sound systems pre-determine a fixed "sweet spot" (usually located in the center of the car), which greatly limits the optimal listening position. Once the listener moves away from this position, the sound image localization becomes blurry and chaotic, significantly reducing the surround sound effect. More importantly, existing systems cannot dynamically adjust the sound field parameters based on the vehicle's real-time status (such as vehicle speed, window opening / closing, and changes in the number of passengers) and the different head positions and orientations of passengers, resulting in an unstable or even destroyed sense of immersion in different scenarios.

[0031] (2) The conflict between immersion and independent vocal registers: Existing independent sound zone technology primarily addresses the issue of different passengers listening to different content, but its core technology is "isolation" rather than "fusion." When it's necessary to create a unified and coherent immersive sound field for all passengers (such as watching a movie or concert together), beamforming and audio cancellation technologies interfere with each other, making it difficult to construct a seamless, precisely localized shared sound field. Conversely, when independent sound zones are enabled, the immersive surround sound experience is sacrificed.

[0032] (3) Poor sound source compatibility: Existing systems have limited processing capabilities for non-multichannel audio sources (such as the most common two-channel stereo music). While sound field reconstruction technology can simulate a sense of space, it often suffers from problems such as blurred sound images, significant head-in-the-head effect, and sound quality loss, making it difficult to achieve a realistic and natural immersive effect. The system lacks an intelligent and universal mechanism that can upmix or reproduce audio sources of various formats into immersive sound effects adapted to the unique acoustic environment of the vehicle.

[0033] (4) Ignoring the influence of dynamic environment: The passenger compartment is a complex and dynamic acoustic environment. Road noise and wind noise caused by changes in vehicle speed, as well as changes in acoustic reflection characteristics caused by opening and closing windows, can all significantly affect the listening experience of the audio system. Most existing systems lack the ability to perceive environmental noise in real time and actively compensate for the sound field, resulting in sound details being masked and the sense of immersion being severely reduced in noisy environments such as high-speed driving.

[0034] To overcome the aforementioned technical problems, this invention proposes a multi-zone immersive sound effect control method for in-vehicle audio systems, which is applied to vehicle audio systems. In this vehicle, the system includes the following core components: (1) Audio signal processing unit: This unit is based on one or more high-performance DSPs. The "Immersive Audio Rendering Engine (B1_1)" is specifically a fixed or configurable software algorithm that supports decoding and rendering of object-based audio formats such as Dolby Atmos, DTS:X, or MPEG-H. For audio that does not support such formats, such as traditional stereo music, it is handled by the "Upmixing and Remastering Module (B1_2)". This module can use a rule-based channel upmixing algorithm (such as extracting the center and surround channels from the left and right channels), or better yet, a pre-trained neural network model that can intelligently decompose the stereo mixed track into multiple independent audio objects such as vocals, drums, bass, and guitar, and assign them appropriate initial positions in three-dimensional space. It includes the following modules: Input module: Used to receive audio source signals in various formats, including multi-channel surround sound audio and two-channel stereo audio.

[0035] Immersive audio rendering engine: The core processing module, which employs object-based audio processing technology. For input audio, the engine can parse or upmix it into independent audio objects and bed channels, and combine this with the cabin acoustic model to generate independent audio signals for each speaker.

[0036] Upmix and Remaster Module: Specifically designed to decompose a two-channel stereo sound source into multiple independent audio objects using advanced algorithms (such as neural network upmixing), and assign three-dimensional spatial position information to each object, thereby generating a multi-channel signal suitable for immersive playback.

[0037] (2) Sensors and data acquisition units: Passenger perception subsystem: includes in-vehicle cameras, seat pressure sensors, infrared sensors, etc., used to detect the presence, head position and orientation of passengers in each seat in real time.

[0038] Vehicle status acquisition subsystem: Connected to the vehicle bus (CAN / LIN), it acquires information such as vehicle speed, window opening / closing status, and engine speed in real time.

[0039] Environmental noise monitoring subsystem: Multiple reference microphones are placed at key locations inside the vehicle to collect environmental noise signals in real time.

[0040] (3) Multi-zone management and control unit: Sound field modeling module: Based on the physical dimensions of the carriage, interior materials, and speaker layout, an acoustic model of the carriage is created.

[0041] Dynamic Adaptive Algorithm Module: This is the core algorithm of the system. This module receives all information from the sensors and data acquisition unit and performs the following operations: Sound field remapping: Based on the real-time location of passengers, the position of each audio object as a "virtual sound source" in three-dimensional space is dynamically calculated and adjusted. Through beamforming and crosstalk cancellation technology, a stable and optimal listening zone centered on each passenger is generated.

[0042] Noise compensation: Based on the signals collected by the environmental noise monitoring subsystem, the frequency response of the sound field in the cabin acoustic model and the gain of specific frequency bands are adjusted in real time (e.g., enhancing mid-to-high frequency details when driving at high speed) to mask noise and ensure sound clarity.

[0043] Acoustic environment compensation: Based on information such as the status of the windows, adjust the reflection and reverberation parameters of the sound field in the acoustic model of the car body to compensate for the changes in acoustic characteristics caused by the opening and closing of the windows.

[0044] Mode switching controller: Allows users or vehicle systems to switch or mix between "Global Immersive Mode" and "Independent Audio Zone Mode". In Independent Audio Zone Mode, the system uses the same beamforming technology to precisely project different audio content (such as navigation, telephone, music) to a designated area while minimizing interference with other areas.

[0045] (4) Loudspeaker array unit: An array of multiple speakers distributed in predetermined locations within the carriage (such as doors, dashboard, ceiling, headrests, etc.). This array is uniformly driven to execute control signals generated by the audio signal processing unit and optimized by the multi-zone management unit, thereby achieving precise sound wave control.

[0046] Based on the above application scenarios and systems, a multi-zone immersive sound effect control method for vehicle audio proposed in this embodiment of the invention will be described in detail.

[0047] The present invention proposes a multi-zone immersive sound effect control method for in-vehicle audio systems, aiming to solve one or more of the following core technical problems: (1) Solving the contradiction between fixed sound field and dynamic carriage environment: How to overcome the problem that the optimal listening position of traditional surround sound system is fixed and cannot adapt to changes in the real-time position of passengers and vehicle status, and realize a stable immersive sound field that follows the passengers.

[0048] (2) Unified immersive sound field and independent sound zone function: How to achieve independent audio content playback for different seating areas without sacrificing the shared immersive sound effect of the whole vehicle, so that the two modes can be seamlessly switched or coexisted to meet diverse in-vehicle listening needs.

[0049] (3) Enhance the immersive experience of ordinary sound sources: How to convert common non-multi-channel sound sources such as stereo to immersive sound effects suitable for the in-vehicle acoustic environment with high quality, and avoid sound image blurring and sound quality loss.

[0050] (4) Achieve dynamic adaptive compensation of the sound field: How to enable the system to perceive changes in in-vehicle environmental noise (such as wind noise and road noise) and acoustic characteristics in real time, and automatically compensate and optimize the sound field to ensure clear details and immersion under various driving conditions.

[0051] This invention proposes a method for controlling multi-zone immersive sound effects in vehicle audio systems, such as... Figure 1 As shown, it includes: Acquire audio source signals, vehicle status information, and in-vehicle environmental noise information; Identify the audio object based on the audio source signal; Based on vehicle status information and in-vehicle environmental noise information, the speaker driving parameters are calculated and determined using the vehicle cabin acoustic model. Among them, the reflection and reverberation parameters of the sound field in the vehicle cabin acoustic model are determined based on the vehicle status information, and the frequency response and specific frequency band gain of the sound field in the vehicle cabin acoustic model are determined based on the in-vehicle environmental noise information. Based on the determined speaker drive parameters, control the speaker to play audio objects.

[0052] This invention proposes a method and system for controlling multi-zone immersive sound effects in a vehicle audio system. When playing audio through in-vehicle speakers, the method adaptively adjusts the reflection and reverberation parameters, frequency response, and specific frequency band gain of the sound field in the vehicle acoustic model based on vehicle status information and in-vehicle environmental noise information. This ensures that the determined speaker driving parameters are compatible with the current vehicle environment and status, thereby guaranteeing the listening experience of audio in different scenarios.

[0053] In some embodiments, occupant distribution information is also acquired. Based on the occupant distribution information, vehicle status information, and in-vehicle environmental noise information, speaker driving parameters are calculated and determined using a vehicle acoustic model. In addition, for each occupant in the vehicle, the speaker driving parameters are determined with the target sound field direction being directly in front of that occupant.

[0054] Specifically: Information on the distribution of occupants inside the vehicle, including the location of each occupant, the coordinates of their head position, and the direction their head is facing.

[0055] This invention uses an infrared camera or a TOF (Time-of-Flight) camera installed in the rearview mirror, ceiling, or dashboard of the vehicle to capture the outline and position of the occupant's head; the position coordinates and orientation of the occupant's head are determined by the outline and position of the occupant's head; and pressure sensors in the seat cushions and backrests of each seat are used to confirm whether the passenger is seated, thereby determining the position of the occupant in the vehicle.

[0056] For each audio object, the location where it should be "virtually" projected is recalculated using the vehicle's acoustic model. For example, for the audio object of movie dialogue, a set of drive signals sent to each speaker is calculated so that the sound waves interfere to form a clear "sound image" from directly in front at the driver's left and right ears. At the same time, beamforming technology is used to ensure that the sound wave has the least energy when it reaches the rear left passenger, avoiding interference. This is achieved by solving a complex inverse acoustic problem, the core of which is to use techniques such as "vector basis amplitude translation" or "higher-order Ambisonics" combined with crosstalk cancellation filters to generate a stable, optimal listening zone centered on each occupant.

[0057] The minimum energy transmitted from the sound field where the occupant is located to the other occupants means that the weighted sum of the energy transmitted from the sound field where the occupant is located to all other occupants is the minimum; the coefficients used in the weighting are between 0 and 1, and the sum of all coefficients is 1.

[0058] In some embodiments, the cabin acoustic model is constructed based on the vehicle's cabin dimensions, the sound absorption coefficient of the interior materials, and the locations of all speakers within the cabin.

[0059] The vehicle cabin acoustic model is a finite element acoustic model constructed based on the vehicle cabin dimensions, the sound absorption coefficient of the interior materials, and the location of all speakers in the cabin. This model can predict the propagation, reflection, and attenuation characteristics of sound waves in the cabin, the propagation direction of the output sound field, the energy of the sound field in each passenger's location, and the energy of the sound field transmitted to the other passengers.

[0060] In some embodiments, the audio source signal is decomposed into multiple independent audio objects; each independent audio object is played in a corresponding area within the carriage, and each audio object corresponds to only one playback area. This achieves either immersive playback across the entire area or independent audio zone playback control.

[0061] It should be noted that the embodiments of the present invention do not limit the placement of the speakers for playing audio. The selection of the speaker placement position aims to ensure that the audio can be accurately transmitted to the vicinity of the passenger's ears, while reducing sound reflection and interference during sound propagation within the vehicle. By placing speakers in different locations, the system can make precise audio adjustments based on passenger distribution information, vehicle status information, and in-vehicle environmental noise information, providing passengers with a more comfortable, personalized, and intelligent audio experience.

[0062] In some embodiments, vehicle status information includes vehicle speed, window opening degree, and engine speed, and the vehicle status information is read directly through the vehicle's CAN bus interface.

[0063] When the vehicle's state changes, the acoustic characteristics inside the carriage will change. In this embodiment of the invention, the reflection and reverberation parameters of the sound field in the carriage acoustic model are adjusted by using vehicle state information to compensate for the changes in acoustic characteristics caused by the change in vehicle state. This makes the carriage acoustic model more compatible with the actual carriage acoustic characteristics, thereby ensuring the auditory effect inside the carriage.

[0064] The system continuously collects ambient noise data from inside the vehicle by embedding multiple full-band ECM microphones at four locations: the front, rear, left, and right sides of the roof, as well as within the door panels. These microphones sample the noise when the system is not playing audio, or use adaptive filtering technology to separate the noise signal when audio is playing.

[0065] In some embodiments, the noise frequency band of the in-vehicle ambient noise information (such as low-frequency road noise and mid-to-high-frequency wind noise) is identified. Then, the frequency response of the sound field and the gain of specific frequency bands in the cabin acoustic model are modified to mask the noise and ensure sound clarity. The specific frequency band refers to the noise frequency band of the in-vehicle ambient noise information. The global or seat-specific audio equalization is adjusted, and intelligent gain enhancement (following the equal loudness curve) is performed in these frequency bands, or multi-band dynamic compression is activated to ensure that the audio content can "penetrate" the noise and be clearly perceived in these frequency bands.

[0066] Generally, the greater the ambient noise information inside the vehicle, the greater the frequency band gain in the vehicle acoustic model. For example, when driving at high speed and the noise inside the vehicle is high, the mid-to-high frequency details are enhanced.

[0067] In this embodiment of the invention, a database of reflection and reverberation parameters, frequency response and frequency band gain of the sound field in the acoustic model of the carriage is pre-constructed. The database stores the reflection and reverberation parameters, frequency response and frequency band gain of the sound field when the sound field distribution requirements in the carriage are met under various vehicle states and in-vehicle environmental noise information.

[0068] In practical applications, the reflection and reverberation parameters of the sound field, as well as the frequency response and frequency band gain, corresponding to the actual vehicle status information and in-vehicle environmental noise information are directly retrieved from the database. The acoustic model of the cabin is then updated using the retrieved parameters, and the speaker driving parameters are determined using the updated cabin acoustic model.

[0069] In some embodiments, the vehicle's audio playback has two modes: immersive global mode and independent zone mode. In immersive global mode, the cabin becomes a "third space" enveloped in sound, allowing all passengers to enjoy a top-notch audio-visual experience. In independent zone mode, the audio in the cabin is controlled in separate zones. Using the same beamforming technology, different audio objects (such as navigation, phone calls, and music) are precisely projected onto designated areas. Isolation is maximized by creating "silent zones" between beams, minimizing interference with other areas and preventing mutual interference. Examples include navigation in the driver's seat, music in the passenger seat, and phone calls in the rear seats. Furthermore, the speakers in each zone can be controlled independently.

[0070] The vehicle's central control screen features a switch button for "whole-area immersion" and "independent sound zone," allowing users to select the vehicle mode via gestures, voice, or by tapping the switch button.

[0071] Taking the example of playing a stereo song in a car with a driver and a passenger on the right side of the rear seat, the following is a detailed explanation of a multi-zone immersive sound effect control method for in-vehicle audio systems proposed in this embodiment of the invention: Input and Preprocessing: The stereo music signal is input to the audio signal processing unit (B1). The upmix and remaster module (B1_2) breaks it down into four independent audio objects: "vocals", "drums", "piano", and "background pad".

[0072] Data Acquisition: Sensor unit (B2) confirms the presence of the driver and the rear right passenger and locates their head coordinates. The CAN bus reports a vehicle speed of 80 km / h. The reference microphone detects significant low-frequency road noise.

[0073] Core processing and adaptation: The dynamic adaptive algorithm module (B3_2) places four audio objects in a virtual three-dimensional space (e.g., the lead singer is directly in front, the drum kit is slightly to the left of the center, the piano is slightly to the right of the center, and the Pad is around the perimeter).

[0074] Based on the real-time locations of the two passengers, the algorithm calculates a set of independent speaker driving parameters for each of them, ensuring that they can experience the preset sound field layout from their respective positions.

[0075] Meanwhile, the algorithm identified low-frequency road noise at 80km / h and performed appropriate dynamic compression and gain enhancement on the low-frequency part of the sound field in the cabin acoustic model (especially the drum kit and pad) to ensure that the sense of rhythm was not drowned out.

[0076] Output and Experience: The optimized multi-channel signal drives the speaker array (C1). Ultimately, both the driver and rear passengers experience a stable, immersive sound field centered on themselves, with musical details remaining clear and powerful even at high speeds.

[0077] Compared with the prior art, the multi-zone immersive sound effect control method for in-vehicle audio proposed in this embodiment of the invention has the following significant technical effects: (1) Achieved a personalized and adaptive immersive sound field: By tracking the passenger position in real time and dynamically remapping the sound field, it ensures that passengers in any seat in the car can have an immersive audio experience with accurate sound image positioning centered on themselves, breaking the limitation of the "sweet seat".

[0078] (2) Perfect integration of immersive sound field and independent audio zone function: Based on the same hardware architecture and core algorithm, this invention realizes the organic unity and flexible switching of the two modes. It can allow all passengers in the car to share a unified immersive sound field, and can also provide independent audio content for different passengers without interference, thus solving the technical problem of the contradiction between the two in the traditional system.

[0079] (3) Improved the versatility and sound quality of the sound source: Through advanced upmixing and audio objectification technology, ordinary stereo sound sources can be converted into immersive sound effects with a sense of space in high quality, which greatly enriches the content of high-quality sound sources and enhances the practical value of the system.

[0080] (4) Enhanced robustness of the system in different environments: Through real-time noise perception and dynamic acoustic compensation, the system can actively counteract the impact of driving noise and environmental changes on sound quality, ensuring the stability of immersive sound effects and the clarity of sound details under various working conditions such as stationary to high-speed driving and opening and closing of car windows.

[0081] (5) Optimized the overall vehicle auditory experience and intelligence level: This system upgrades the car audio system from a passive playback device to an intelligent auditory space that can sense the environment, understand needs and actively adapt, greatly enhancing the vehicle's technological feel and driving comfort.

[0082] This invention also proposes a multi-zone immersive sound effect control system for vehicle audio systems, such as... Figure 2 As shown, it includes: The information acquisition unit is used to acquire audio source signals, vehicle status information, and in-vehicle environmental noise information. An audio signal processing unit is used to determine the audio object based on the audio source signal; The multi-zone management and control unit is used to calculate and determine the speaker driving parameters based on vehicle status information and in-vehicle environmental noise information using a vehicle acoustic model. The reflection and reverberation parameters of the sound field in the vehicle acoustic model are determined based on the vehicle status information, while the frequency response and specific frequency band gain of the sound field in the vehicle acoustic model are determined based on the in-vehicle environmental noise information. Based on the determined speaker driving parameters, the unit controls the speakers to play audio to the target audio.

[0083] The information acquisition unit includes a sensor and data acquisition unit and an audio signal acquisition unit.

[0084] The sensor and data acquisition unit includes an environmental noise monitoring subsystem, a vehicle status subsystem, and a passenger perception subsystem; An environmental noise monitoring subsystem is used to acquire in-vehicle environmental noise information; The vehicle status subsystem is used to acquire vehicle status information; The passenger perception subsystem is used to obtain information on the distribution of passengers inside the vehicle.

[0085] It should be noted that the multi-zone immersive sound control system for in-vehicle audio provided in the above embodiments is only illustrated by the division of the above functional modules when controlling audio playback in multiple zones. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the multi-zone immersive sound control system for in-vehicle audio provided in the above embodiments and the multi-zone immersive sound control method embodiment for in-vehicle audio belong to the same concept, and the specific implementation process is detailed in the method embodiment, which will not be repeated here.

[0086] The present invention also discloses a computer device, the device comprising: A processor, adapted to execute computer programs; A computer-readable storage medium storing a computer program, which, when executed by the processor, implements a multi-zone immersive sound effect control method for vehicle audio systems disclosed in this embodiment of the invention.

[0087] The computer device can be a portable mobile terminal, such as a smartphone, tablet, laptop, or desktop computer. Typically, a computer device includes a processor and memory.

[0088] A processor may include one or more processing cores, such as a core processor or a core processor. The processor may be implemented using at least one hardware form of DSP (Digital Signal Processing), FPGA (Field-Programmable Gate Array), or PLA (Programmable Logic Array). The processor may also include a main processor and coprocessors. The main processor, also known as a CPU (Central Processing Unit), is used to process data in the wake-up state; the coprocessor is a low-power processor used to process data in the standby state. In some embodiments, the processor may integrate a GPU (Graphics Processing Unit), which is responsible for rendering and drawing the content required to be displayed on the screen. In some embodiments, the processor may also include an AI (Artificial Intelligence) processor, which is used to handle computational operations related to machine learning.

[0089] The memory may include one or more computer-readable storage media, which may be non-transitory. The memory may also include high-speed random access memory and non-volatile memory, such as one or more disk storage devices or flash memory devices. In some embodiments, the non-transitory computer-readable storage media in the memory are used to store at least one computer program, which is executed by a processor to implement the intelligent vehicle control method provided in the method embodiments of this application.

[0090] In some embodiments, the computer device may also optionally include: a peripheral device interface and at least one peripheral device. The processor, memory, and peripheral device interface can be connected via a bus or signal line. Each peripheral device can be connected to the peripheral device interface via a bus, signal line, or circuit board. Specifically, the peripheral device includes at least one of: radio frequency circuitry, a display screen, a camera assembly, audio circuitry, and a power supply.

[0091] Peripheral device interfaces can be used to connect at least one I / O (Input / Output) related peripheral device to the processor and memory. In some embodiments, the processor, memory, and peripheral device interface are integrated on the same chip or circuit board; in some other embodiments, any one or two of the processor, memory, and peripheral device interface can be implemented on separate chips or circuit boards, which is not limited in this embodiment.

[0092] Radio frequency (RF) circuits are used to receive and transmit RF signals, also known as electromagnetic signals. RF circuits communicate with communication networks and other communication devices via electromagnetic signals. RF circuits convert electrical signals into electromagnetic signals for transmission, or convert received electromagnetic signals back into electrical signals. In some embodiments, the RF circuit includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a user identity module card, etc. The RF circuit can communicate with other terminals through at least one wireless communication protocol. These wireless communication protocols include, but are not limited to: the World Wide Web, metropolitan area networks, intranets, various generations of mobile communication networks (2G, 3G, 4G, and 5G), wireless local area networks, and / or WiFi (Wireless Fidelity) networks. In some embodiments, the RF circuit may also include circuitry related to NFC (Near Field Communication), which is not limited in this application.

[0093] The present invention also discloses a computer-readable storage medium storing a computer program adapted for loading and executing by a processor a method for controlling multi-zone immersive sound effects in a vehicle audio system as disclosed in the embodiments of the present invention.

[0094] The present invention also discloses a computer program product, which includes a computer program. When the computer program is executed by a processor, it implements a multi-zone immersive sound effect control method for vehicle audio disclosed in the embodiments of the present invention.

[0095] The method disclosed in this invention can be directly implemented by a hardware processor, or implemented by a combination of hardware and software modules within the processor. The software modules can reside in readily available storage media in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. This storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method. To avoid repetition, detailed descriptions are omitted here.

[0096] Those skilled in the art will recognize that the units and algorithm steps described in conjunction with the embodiments herein can be implemented in electronic hardware or a combination of computer software and electronic hardware. Whether these functions are implemented in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0097] While the specific embodiments of the present invention have been described above in conjunction with the accompanying drawings, this is not intended to limit the scope of protection of the present invention. Those skilled in the art should understand that various modifications or variations that can be made by those skilled in the art without creative effort based on the technical solutions of the present invention are still within the scope of protection of the present invention.

Claims

1. A method for controlling multi-zone immersive sound effects in a vehicle audio system, characterized in that, include: Acquire audio source signals, vehicle status information, and in-vehicle environmental noise information; Identify the audio object based on the audio source signal; Based on vehicle status information and in-vehicle environmental noise information, the speaker driving parameters are calculated and determined using the vehicle cabin acoustic model. Among them, the reflection and reverberation parameters of the sound field in the vehicle cabin acoustic model are determined based on the vehicle status information, and the frequency response and specific frequency band gain of the sound field in the vehicle cabin acoustic model are determined based on the in-vehicle environmental noise information. Based on the determined speaker drive parameters, control the speaker to play audio objects.

2. The method for controlling multi-zone immersive sound effects in a vehicle audio system as described in claim 1, characterized in that, It also obtains information on the distribution of occupants inside the vehicle; Based on the passenger distribution information, vehicle status information, and in-vehicle environmental noise information, the speaker driving parameters are calculated and determined using the vehicle acoustic model.

3. The method for controlling multi-zone immersive sound effects in a vehicle audio system as described in claim 2, characterized in that, For each occupant, the loudspeaker driving parameters are determined with the goal of maximizing the sound field where that occupant is located and minimizing the energy transmitted from that occupant's sound field to the other occupants.

4. The method for controlling multi-zone immersive sound effects in a vehicle audio system as described in claim 3, characterized in that, For each occupant in the vehicle, the speaker driving parameters are determined with the target sound field direction being directly in front of that occupant.

5. The method for controlling multi-zone immersive sound effects in a vehicle audio system as described in claim 1, characterized in that, The acoustic model of the vehicle cabin is constructed based on the dimensions of the vehicle cabin, the sound absorption coefficient of the interior materials, and the location of all speakers in the cabin.

6. The method for controlling multi-zone immersive sound effects in a vehicle audio system as described in claim 1, characterized in that, A specific frequency band refers to the noise frequency band in which the in-vehicle environmental noise information is located.

7. A multi-zone immersive sound effect control system for vehicle audio systems, characterized in that, include: The information acquisition unit is used to acquire audio source signals, vehicle status information, and in-vehicle environmental noise information. An audio signal processing unit is used to determine the audio object based on the audio source signal; The multi-zone management and control unit is used to calculate and determine the speaker driving parameters based on vehicle status information and in-vehicle environmental noise information using a vehicle acoustic model. The reflection and reverberation parameters of the sound field in the vehicle acoustic model are determined based on the vehicle status information, while the frequency response and specific frequency band gain of the sound field in the vehicle acoustic model are determined based on the in-vehicle environmental noise information. Based on the determined speaker driving parameters, the unit controls the speakers to play audio to the target audio.

8. An electronic device, characterized in that, The device includes: A processor, adapted to execute computer programs; A computer-readable storage medium storing a computer program, which, when executed by the processor, implements the multi-zone immersive sound effect control method for a vehicle audio system as described in any one of claims 1-6.

9. A computer-readable storage medium, characterized in that, The computer-readable storage medium stores a computer program adapted to be loaded by a processor and executed by the processor to provide a multi-zone immersive sound effect control method for a vehicle audio system according to any one of claims 1-6.

10. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the multi-zone immersive sound effect control method for vehicle audio systems as described in any one of claims 1-6.

Images