An audio playing management method and an audio playing system based on sound field anchoring

Abstract

The application provides an audio playing management method and an audio playing system based on a sound field anchor, and the method comprises the following steps: constructing a multi-level sound field anchor point and an acoustic mapping model; performing multi-terminal playing time sequence phase-locked synchronization on a car machine loudspeaker, a headrest loudspeaker and a Bluetooth earphone; identifying an interactive intention of a cabin space, determining a target output terminal and a priority weight of each audio; acquiring acoustic characteristic parameters of the target output terminal; and mapping multiple audio sources to the corresponding target output terminal for playing according to the target output terminal, the priority weight and the acoustic characteristic parameters of each audio; at least one of the following problems is solved: an auditory discontinuity caused by a sound image positioning mutation during audio switching; a time sequence asynchronization caused by a lack of a unified clock reference, which is prone to cause sound breaks and sound bursts; a switching strategy that cannot identify a user interactive intention, which is poor in adaptability; a weak multi-source cooperation that cannot accurately map a terminal and match a sound field according to audio attributes, which is prone to cause crosstalk and cannot meet the high-quality audio demand of a driver and a passenger.

Description

Technical Field

[0001] This invention relates to the technical field of smart cockpits, and more specifically, to an audio playback management method and audio playback system based on sound field anchoring. Background Technology

[0002] With the continuous improvement of the intelligence level of in-vehicle cockpits, in-vehicle audio output terminals are showing a diversified development trend. At present, mainstream technical solutions can support audio switching and basic collaborative functions of three types of terminals: in-vehicle speakers, headrest speakers, and Bluetooth headphones, meeting the basic audio playback needs of drivers and passengers and becoming an important part of the intelligent experience of in-vehicle cockpits.

[0003] Existing in-vehicle audio switching technologies primarily employ a combination of device status triggering and fixed-priority routing, along with an independent terminal adaptation mode. Switching methods include automatic switching based on Bluetooth headset connection / disconnection status, preemptive switching with preset fixed priorities according to audio type, and basic zone output from headrest speakers based on seat occupancy detection in some solutions. In terms of audio processing, the vehicle's speakers, headrest speakers, and Bluetooth headsets each employ independent adaptation strategies, with independent playback clocks. Switching is completed via hard switching, and multi-terminal collaboration often focuses on single-audio source switching; when multiple audio sources are in parallel, only simple volume suppression can be achieved.

[0004] However, the relevant technologies have at least one of the following problems: sudden changes in sound image localization during audio switching cause auditory silencing; the lack of a unified clock reference leads to timing asynchrony, which easily causes dropouts and pops; the switching strategy cannot recognize the user's interaction intent and has poor adaptability; the multi-source coordination is weak, and it is impossible to accurately map the terminal and match the sound field according to the audio attributes, which easily generates crosstalk and cannot meet the high-quality audio needs of drivers and passengers. Summary of the Invention

[0005] This invention solves at least one of the following problems: sudden changes in sound image localization during audio switching cause auditory tomography; lack of a unified clock reference leads to timing asynchrony, which easily causes dropouts and pops; the switching strategy cannot recognize user interaction intentions and has poor adaptability; weak multi-source coordination makes it impossible to accurately map the terminal and match the sound field according to audio attributes, which easily generates crosstalk and fails to meet the high-quality audio needs of drivers and passengers.

[0006] To address the aforementioned problems, this invention provides an audio playback management method based on sound field anchoring. This method is applied to an intelligent cockpit audio system that includes a vehicle speaker, headrest speakers, Bluetooth headset, and cockpit sensors. The audio playback management method includes: Construct a multi-level sound field anchor point and acoustic mapping model; Using the system clock of the vehicle's main controller as the reference clock, the multi-terminal playback timing of the vehicle's speakers, headrest speakers, and Bluetooth headsets is synchronized using phase-locked phase-locking. The system identifies the interaction intent of the intelligent cockpit space based on real-time data collected by cockpit sensors, and determines the target output terminal and priority weight of each audio source based on the attribute type and interaction intent of multiple audio sources. Acoustic characteristic parameters of the target output terminal are obtained through multi-level sound field anchor points and acoustic mapping models; Based on the target output terminal, priority weight, and acoustic characteristic parameters of each audio source, multiple audio sources are mapped to the corresponding target output terminal for playback.

[0007] Compared with existing technologies, the technical effects achieved by this solution are as follows: This solution constructs a multi-level sound field anchor point and acoustic mapping model, using the vehicle's main controller system clock as the reference clock to achieve phase-locked synchronization of playback timing across multiple terminals, including the vehicle's speakers, headrest speakers, and Bluetooth headphones. It accurately identifies user interaction intentions by combining real-time data from cabin sensors, and assigns corresponding target output terminals and priority weights based on the attribute types and interaction intentions of multiple audio sources. During audio switching, the switching logic is executed collaboratively with the interaction intentions using the sound field anchoring model. Simultaneously, multiple audio sources are categorized and accurately mapped to their corresponding terminals for playback. This avoids auditory gaps caused by abrupt changes in sound image positioning during audio switching, eliminates timing discrepancies, dropouts, and popping sounds caused by the lack of a unified clock reference, and thus aligns with user interaction intentions during audio switching, improving scene adaptability. It also strengthens multi-source collaboration capabilities, achieving accurate matching of target output terminals and sound fields based on audio attributes, avoiding audio crosstalk issues. Ultimately, this meets the stable, smooth, and accurately positioned audio playback needs of drivers and passengers in intelligent cockpit scenarios, enhancing their riding experience.

[0008] In one embodiment of the present invention, constructing a multi-level sound field anchor point and acoustic mapping model includes: Preset multi-level virtual sound field anchor points inside the vehicle; Based on each sound field anchor point in the multi-level virtual sound field anchor points in the vehicle, the acoustic characteristic parameters of the vehicle's speakers, headrest speakers, and Bluetooth headsets are collected. Based on acoustic characteristic parameters, a multi-level sound field anchor point and acoustic mapping model is established.

[0009] Compared with existing technologies, the technical effects achieved by this solution are as follows: This solution establishes a multi-level sound field anchor point and acoustic mapping model by pre-setting multiple virtual sound field anchor points in the vehicle and collecting acoustic characteristic parameters of the vehicle's speakers, headrest speakers, and Bluetooth headphones for each sound field anchor point. This provides a precise and unified acoustic reference benchmark for audio switching and sound field allocation, enabling a stable correspondence between the sound emitted by different output terminals and the virtual sound field anchor points. This avoids sound image positioning disorder and abrupt switching, ensuring continuous sound image positioning and stable sound field restoration in the smart cockpit, and improving the spatial consistency and auditory coherence of audio playback.

[0010] In one embodiment of the present invention, the in-vehicle multi-level virtual sound field anchor points include at least one of the following: a vehicle-wide common anchor point, a driver's private anchor point, a passenger's private anchor point, and a rear-seat zone anchor point; Acoustic characteristic parameters include at least one of the following: frequency response curve, delay characteristics, and acoustic imaging localization parameters; The multi-level sound field anchor point and acoustic mapping model includes the EQ compensation parameters, delay compensation parameters, and sound image localization calibration parameters of the target output terminal.

[0011] Compared with existing technologies, the technical effects achieved by this solution are as follows: This solution refines the multi-level virtual sound field anchor points in the vehicle into a common anchor point for the entire vehicle, a private anchor point for the driver, a private anchor point for the passenger, and a rear-seat zone anchor point. It also collects acoustic characteristic parameters such as frequency response curves, delay characteristics, and sound image positioning parameters. Then, it integrates the EQ compensation parameters, delay compensation parameters, and sound image positioning calibration parameters of the corresponding terminals into the multi-level sound field anchor point and acoustic mapping model. This achieves a refined division and precise quantitative representation of the sound field in different driving and riding areas. This ensures that the acoustic performance of each output terminal under the corresponding sound field anchor point is uniformly calibrated and compensated. It not only guarantees the integrity of the whole vehicle sound field in the public audio scenario, but also enables independent and private playback of the driver, passenger, and rear-seat zone audio, effectively avoiding zone crosstalk and sound image offset, thereby improving the sound field reproduction and positioning accuracy when multiple terminals play together.

[0012] In one embodiment of the present invention, multi-terminal playback timing phase-locked synchronization of the vehicle speaker, headrest speaker, and Bluetooth headset includes: The headrest amplifier's playback clock is phase-locked with the reference clock via the car's audio bus; The decoding and playback clock of the Bluetooth headset is phase-locked with the reference clock through the ISO synchronization channel of the LEAudio protocol, and a clock drift compensation algorithm is used for real-time calibration.

[0013] Compared with existing technologies, the technical effects achieved by this solution are as follows: This solution employs automotive audio bus phase-locked loop (PLL), LEAudio protocol's ISO synchronization channel, and clock drift compensation algorithm for the vehicle's main controller speakers, headrest speakers, and Bluetooth headsets, respectively. This achieves multi-terminal playback timing synchronization using the system clock of the vehicle's main controller as the reference clock. It eliminates timing deviations caused by independent clock sources for different audio output terminals at the playback timing level, avoiding synchronization problems such as dropped sounds, pops, and phase misalignments during playback. At the same time, it performs real-time clock drift calibration for the wireless device of the Bluetooth headset, ensuring that wired and wireless audio output terminals maintain timing consistency in high-speed dynamic in-vehicle scenarios.

[0014] In one embodiment of the present invention, the interaction intent of the intelligent cockpit space is identified based on real-time data collected by cockpit sensors, and the target output terminal and priority weight of each audio source are determined according to the attribute type and interaction intent of multiple audio sources, including: Based on the security, privacy, and sharing attributes of multiple audio sources, assign target output terminals and priority weights; The real-time data includes the driver's head posture, passenger behavior, and seat occupancy status. Interaction intents include private focus intents, space sharing intents, and partition independence intents.

[0015] Compared with existing technologies, the technical effects achieved by this solution are as follows: This solution collects real-time data on the driver's head posture, passenger behavior, and seat occupancy status through cockpit sensors, identifies interactive intentions such as private focus, space sharing, and independent zones, and assigns target output terminals and priority weights based on the audio source's security, privacy, and sharing attributes. This makes audio allocation more closely aligned with actual driving scenarios and user intentions, achieving intelligent matching of audio content with playback areas. It ensures priority output of high-safety-attribute audio, directional playback of private audio, and full coverage of shared audio, while avoiding irrelevant audio interference and zone crosstalk. This improves the scenario adaptability of audio scheduling and ensures the driver's safety and privacy.

[0016] In one embodiment of the present invention, when the vehicle-mounted unit responds to a switching command, the acoustic characteristic parameters of the target output terminal are obtained through a multi-level sound field anchor point and acoustic mapping model, including: When the vehicle-mounted unit responds to the switching command, it obtains the EQ compensation parameters and delay compensation parameters of the target output terminal through multi-level sound field anchor points and acoustic mapping model. The audio switching is performed based on the EQ compensation parameters and delay compensation parameters; When the vehicle-mounted system performs audio switching, it acquires the sound image positioning calibration parameters in real time and dynamically adjusts the sound image positioning of the target output terminal based on the sound image positioning calibration parameters. After completing the audio switching, update the audio output status and store the user preference policy.

[0017] Compared with existing technologies, the technical effects achieved by this solution are as follows: When responding to audio switching commands on the vehicle's infotainment system, this solution relies on multi-level sound field anchor points and acoustic mapping models to obtain the EQ compensation parameters, delay compensation parameters, and sound image positioning calibration parameters of the target output terminal. First, the EQ compensation parameters are used to standardize the audio output characteristics during the switching process. Then, the sound image positioning of the target output terminal is dynamically adjusted based on the sound image positioning calibration parameters. Finally, the output status is updated and the user preference strategy is stored. This solves the auditory discontinuity problem caused by abrupt changes in sound image positioning during audio switching in existing technologies, ensuring a smooth and natural transition in the switching process. At the same time, dynamic calibration further improves the accuracy of sound image positioning, conforming to the cabin sound field requirements and avoiding problems such as sound quality distortion and sound image shift during the switching process. Storing the user preference strategy makes the next audio switching more in line with the user's usage habits, further enhancing the stability and adaptability of audio switching.

[0018] In one embodiment of the present invention, audio switching includes: The volume of the original output terminal is controlled to decrease linearly, while the volume of the target output terminal is controlled to increase linearly. The transition time for linear decay and / or linear gain is 200ms to 300ms.

[0019] Compared with existing technologies, the technical effects achieved by this solution are as follows: This solution uses a transition time of 200ms to 300ms during audio switching, linearly attenuating the volume of the original output terminal and linearly gaining the volume of the target output terminal. This achieves a smooth transition between multiple audio channels and multiple output terminals, avoiding the abrupt auditory sensation caused by sudden volume changes or direct stop-start. It further eliminates auditory gaps and discomfort during audio switching, ensuring timely switching response while allowing drivers and passengers to not perceive obvious sound cuts, pops, or sound field jumps, further improving the smoothness and auditory comfort of audio switching.

[0020] In one embodiment of the present invention, the headrest speakers include a driver's headrest speaker and a passenger's headrest speaker. Mapping multiple audio sources to their corresponding target output terminals for playback, based on the target output terminal, priority weight, and acoustic characteristic parameters of each audio source, includes: Label multiple audio sources as secure audio, private audio, or shared audio; Based on the interaction intent, safety-related audio is mapped to the driver's headrest speaker, privacy-related audio is mapped to the Bluetooth headset or passenger's headrest speaker, and shared audio is mapped to the vehicle's infotainment system speaker. Safety-related audio includes navigation and vehicle alarms; privacy-related audio includes Bluetooth calls and personal audio / video; and shared audio includes in-vehicle music and voice assistants.

[0021] Compared with existing technologies, the technical effects achieved by this solution are as follows: This solution divides multiple audio sources into safety, privacy, and sharing categories, and maps them to the driver's headrest speaker, passenger's headrest speaker, Bluetooth headset, and vehicle speaker respectively according to the interaction intent. This ensures that navigation and vehicle alarms are directed to the driver's headrest speaker to ensure driving safety, while Bluetooth calls and personal audio-visual content are projected to corresponding private terminals to prevent information leakage. All in-vehicle music and voice assistants achieve full coverage through the vehicle speaker. This not only achieves precise matching of different audio attributes with each output terminal, avoiding audio crosstalk and content interference, but also ensures driving safety, passenger privacy, and space sharing.

[0022] In one embodiment of the present invention, the audio playback management method further includes: suppressing the volume of low-priority audio when a high-priority audio source is triggered, according to priority weights; The priority order for secure audio, private audio, and shared audio is: secure audio > private audio > shared audio.

[0023] Compared with existing technologies, the technical effects achieved by this solution are as follows: This solution sets the priority weights according to safety audio > private audio > shared audio. When a high-priority audio source is triggered, the volume of the corresponding terminal of the low-priority audio is suppressed. This ensures that audio related to driving safety (such as navigation and vehicle alarms) can be transmitted clearly and prioritized without interrupting the playback of multiple audio sources, preventing audio related to driving safety from being masked by other audio sources. At the same time, it ensures that private audio is not interfered with by shared audio sources, realizes orderly scheduling when multiple audio sources are running concurrently, prevents the loss of important information and audio crosstalk, and eliminates the need for drivers and passengers to frequently switch between audio sources, thus avoiding auditory gaps. This further improves the responsiveness and driving experience of the cockpit audio system.

[0024] On the other hand, the present invention also provides an audio playback system based on sound field anchoring, which is used to execute the audio playback management method based on sound field anchoring in any of the above examples. The audio playback system includes: The sound field anchoring module is used to construct a multi-level sound field anchor point and acoustic mapping model. The timing phase-locked module is used to synchronize the multi-terminal playback timing of the vehicle's main controller, headrest speakers, and Bluetooth headsets, using the system clock of the vehicle's main controller as the reference clock. The spatial intent recognition module is used to identify the interaction intent of the intelligent cockpit space based on real-time data collected by the cockpit sensors, and to determine the target output terminal and priority weight of each audio source based on the attribute type and interaction intent of multiple audio sources. The audio switching module is used to obtain the acoustic characteristic parameters of the target output terminal through multi-level sound field anchor points and acoustic mapping model. The multi-source collaborative output module is used to map multiple audio sources to the corresponding target output terminal for playback based on the target output terminal, priority weight, and acoustic characteristic parameters of each audio source. Based on real-time data collected by cockpit sensors, the system identifies the interaction intent within the intelligent cockpit space and determines the target output terminal and priority weight for each audio source based on its attribute type and interaction intent. Based on the security, privacy, and sharing attributes of multiple audio sources, assign target output terminals and priority weights; The real-time data includes the driver's head posture, passenger behavior, and seat occupancy status. Interaction intents include private focus intents, space sharing intents, and partition independence intents.

[0025] Compared with existing technologies, the technical effects achieved by adopting this technical solution are as follows: This solution can achieve the technical effects corresponding to any of the above examples, which will not be elaborated here.

[0026] By adopting the technical solution of the present invention, the following technical effects can be achieved: This invention constructs a multi-level sound field anchor point and acoustic mapping model, using the vehicle's main controller system clock as the reference clock to achieve phase-locked synchronization of playback timing across multiple terminals, including the vehicle's speakers, headrest speakers, and Bluetooth headphones. It combines real-time data from cabin sensors to accurately identify user interaction intentions and assigns corresponding target output terminals and priority weights based on the attributes and interaction intentions of multiple audio sources. During audio switching, the switching logic is executed collaboratively with the interaction intentions using the sound field anchoring model. Simultaneously, multiple audio sources are categorized, labeled, and accurately mapped to their corresponding terminals for playback. This avoids auditory gaps caused by abrupt changes in sound image localization during audio switching, eliminates timing discrepancies, dropouts, and pops caused by the lack of a unified clock reference, and improves scene adaptability by aligning with user interaction intentions during audio switching. It also enhances multi-source collaboration capabilities, achieving accurate matching of target output terminals and sound fields based on audio attributes, avoiding audio crosstalk. Ultimately, this meets the stable, smooth, and accurately positioned audio playback needs of drivers and passengers in intelligent cockpit scenarios, improving their overall driving experience. Attached Figure Description

[0027] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings to be used in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort. Figure 1 A flowchart illustrating an audio playback management method based on sound field anchoring, provided in an embodiment of the present invention; Figure 2 This is a schematic diagram of a module of an audio playback system based on sound field anchoring, provided in an embodiment of the present invention.

[0028] Explanation of reference numerals in the attached figures: 100. Sound field anchoring module; 200. Timing phase-locked loop module; 300. Spatial intent recognition module; 400. Audio switching module; 500. Multi-source collaborative output module. Detailed Implementation

[0029] To make the above-mentioned objects, features and advantages of the present invention more apparent and understandable, specific embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0030] See Figure 1 This invention provides an audio playback management method based on sound field anchoring. The method is applied to an intelligent cockpit audio system including a vehicle speaker, headrest speakers, Bluetooth headset, and cockpit sensors. The audio playback management method includes: S1. Construct a multi-level sound field anchor point and acoustic mapping model; S2. Using the system clock of the vehicle's main controller as the reference clock, the vehicle's speakers, headrest speakers, and Bluetooth headsets are synchronized with a multi-terminal playback timing lock phase. S3. Identify the interaction intent of the intelligent cockpit space based on real-time data collected by the cockpit sensors, and determine the target output terminal and priority weight of each audio source based on the attribute type and interaction intent of multiple audio sources. S4. Obtain the acoustic characteristic parameters of the target output terminal through multi-level sound field anchor points and acoustic mapping model; S5. Map multiple audio sources to their corresponding target output terminals for playback based on the target output terminal, priority weight, and acoustic characteristic parameters of each audio source.

[0031] Understandably, this solution constructs a multi-level sound field anchor point and acoustic mapping model, using the vehicle's main controller system clock as the reference clock to achieve phase-locked synchronization of playback timing across multiple terminals, including the vehicle's speakers, headrest speakers, and Bluetooth headphones. It combines real-time data from cabin sensors to accurately identify user interaction intentions and assigns corresponding target output terminals and priority weights based on the attributes and interaction intentions of multiple audio sources. During audio switching, the switching logic is executed collaboratively with the interaction intentions using the sound field anchoring model. Simultaneously, multiple audio sources are categorized and precisely mapped to their corresponding terminals for playback. This avoids auditory gaps caused by abrupt changes in sound image positioning during audio switching, eliminates timing discrepancies, audio dropouts, and popping sounds caused by the lack of a unified clock reference, and thus aligns with user interaction intentions during audio switching, improving scenario adaptability. It also strengthens multi-source collaboration capabilities, achieving precise matching of target output terminals and sound fields based on audio attributes, avoiding audio crosstalk issues. Ultimately, this meets the stable, smooth, and precisely positioned audio playback needs of drivers and passengers in intelligent cockpit scenarios, enhancing their riding experience.

[0032] In some embodiments of the present invention, constructing a multi-level sound field anchor point and acoustic mapping model includes: pre-setting multi-level virtual sound field anchor points in the vehicle; collecting acoustic characteristic parameters of the vehicle speaker, headrest speaker, and Bluetooth headset based on each sound field anchor point in the multi-level virtual sound field anchor points in the vehicle; and establishing a multi-level sound field anchor point and acoustic mapping model based on the acoustic characteristic parameters.

[0033] Understandably, this solution establishes a multi-level sound field anchor point and acoustic mapping model by pre-setting multiple virtual sound field anchor points in the vehicle and collecting acoustic characteristic parameters of the vehicle's speakers, headrest speakers, and Bluetooth headphones for each sound field anchor point. This provides a precise and unified acoustic reference benchmark for audio switching and sound field allocation, enabling a stable correspondence between the sound emitted by different output terminals and the virtual sound field anchor points. This avoids sound image positioning disorder and abrupt switching, ensuring continuous sound image positioning and stable sound field reproduction in the smart cockpit, and improving the spatial consistency and auditory coherence of audio playback.

[0034] In some embodiments of the present invention, the in-vehicle multi-level virtual sound field anchor points include at least one of the following: a vehicle-wide common anchor point, a driver's private anchor point, a passenger's private anchor point, and a rear-seat zone anchor point; the acoustic characteristic parameters include at least one of the following: frequency response curve, delay characteristics, and sound image positioning parameters; the multi-level sound field anchor point and acoustic mapping model includes the target output terminal's EQ compensation parameters, delay compensation parameters, and sound image positioning calibration parameters.

[0035] Understandably, this solution refines the multi-level virtual sound field anchor points within the vehicle into a common anchor point for the entire vehicle, a private anchor point for the driver, a private anchor point for the passenger, and a rear-seat zone anchor point. It then specifically collects acoustic characteristic parameters such as frequency response curves, delay characteristics, and sound image positioning parameters. Furthermore, it integrates the corresponding terminal's EQ compensation parameters, delay compensation parameters, and sound image positioning calibration parameters into the multi-level sound field anchor point and acoustic mapping model. This achieves refined division and precise quantitative representation of the sound field in different driving and riding areas, ensuring that the acoustic performance of each output terminal under its corresponding sound field anchor point is uniformly calibrated and compensated. This guarantees the integrity of the entire vehicle's sound field in public audio scenarios while enabling independent and private playback of audio in the driver, passenger, and rear-seat zones, effectively avoiding zone crosstalk and sound image shift. This, in turn, improves the sound field reproduction and positioning accuracy during multi-terminal collaborative playback.

[0036] In some embodiments of the present invention, multi-terminal playback timing phase-locked synchronization of the vehicle speaker, headrest speaker, and Bluetooth headset includes: phase-locking the playback clock of the headrest amplifier with a reference clock through the vehicle audio bus; phase-locking the decoding playback clock of the Bluetooth headset with the reference clock through the ISO synchronization channel of the LEAudio protocol, and calibrating in real time using a clock drift compensation algorithm.

[0037] Understandably, this solution employs automotive audio bus phase-locked loop (PLL), LEAudio protocol's ISO synchronization channel, and clock drift compensation algorithm for the car stereo speaker, headrest speaker, and Bluetooth headset, respectively. This achieves multi-terminal playback timing synchronization using the system clock of the car stereo main controller (i.e., the car stereo speaker) as the reference clock. This keeps the playback timing error of the car stereo speaker, headrest speaker, and Bluetooth headset within milliseconds, eliminating timing deviations caused by independent clock sources for different audio output terminals at the playback timing level. This avoids synchronization problems such as dropped sounds, pops, and phase misalignments during playback. At the same time, real-time clock drift calibration is performed on the wireless device of the Bluetooth headset to ensure that wired and wireless audio output terminals maintain consistent timing in high-speed dynamic in-vehicle scenarios.

[0038] In some embodiments of the present invention, the interaction intent of the intelligent cockpit space is identified based on real-time data collected by cockpit sensors, and the target output terminal and priority weight of each audio source are determined according to the attribute type and interaction intent of multiple audio sources, including: allocating target output terminals and priority weights according to the security attributes, privacy attributes, and sharing attributes of multiple audio sources; wherein, real-time data includes driver head posture, passenger behavior, and seat occupancy status; and interaction intent includes private focus intent, space sharing intent, and zone independence intent.

[0039] Understandably, this solution uses cockpit sensors to collect real-time data on the driver's head posture, passenger behavior, and seat occupancy status. It identifies interactive intentions such as private focus, space sharing, and independent zones, and assigns target output terminals and priority weights based on the audio source's security, privacy, and sharing attributes. This makes audio allocation more aligned with actual driving scenarios and user intentions, achieving intelligent matching of audio content with playback areas. It ensures priority output of high-safety audio, targeted playback of private audio, and full coverage of shared audio, while avoiding irrelevant audio interference and zone crosstalk. This improves the scenario adaptability of audio scheduling and ensures the driver's safety and privacy.

[0040] It should be noted that passenger behavior includes the head posture of the front passenger or rear passenger, their shadow movements, and their resting state. The driver's head posture and headphone wearing are identified by the DMS camera, while the front passenger's or rear passenger's head posture, shadow movements, and resting state are identified by the OMS camera. Seat occupancy is identified by seat pressure sensors. The interaction intent recognition rules are as follows: when the driver is driving alone and wearing headphones, or the driver's head is near the headrest, or the front passenger is wearing headphones and watching the cabin screen, the interaction intent is determined to be a private and focused intent. When multiple seats are occupied, all passengers in the cabin are not wearing headphones, and the user makes a sharing gesture (such as waving to indicate playback throughout the vehicle), the interaction intent is determined to be a space-sharing intent. When the driver is focused on driving, the front passenger or rear passenger's head is near the headrest, the front passenger or rear passenger is wearing headphones and watching a movie, or a passenger in the front passenger or rear passenger is resting, the interaction intent is determined to be a zone-independent intent.

[0041] In some embodiments of the present invention, when the vehicle-mounted system responds to a switching command, obtaining the acoustic characteristic parameters of the target output terminal through a multi-level sound field anchor point and acoustic mapping model includes: when the vehicle-mounted system responds to a switching command, obtaining the EQ compensation parameters and delay compensation parameters of the target output terminal through a multi-level sound field anchor point and acoustic mapping model; performing audio switching based on the EQ compensation parameters and delay compensation parameters; when the vehicle-mounted system performs audio switching, obtaining sound image positioning calibration parameters in real time, and dynamically adjusting the sound image positioning of the target output terminal based on the sound image positioning calibration parameters; after completing the audio switching, updating the audio output status and storing the user preference strategy. The switching command can be a manually issued switching command or an automatically triggered command.

[0042] Understandably, when responding to audio switching commands on the vehicle's infotainment system, this solution relies on multi-level sound field anchor points and an acoustic mapping model to obtain the EQ compensation parameters, delay compensation parameters, and sound image positioning calibration parameters of the target output terminal. First, the EQ compensation parameters are used to standardize the audio output characteristics during the switching process. Then, based on the sound image positioning calibration parameters, the sound image positioning of the target output terminal is dynamically adjusted. Finally, the output status is updated and the user preference strategy is stored. This solves the auditory discontinuity problem caused by abrupt changes in sound image positioning during audio switching in existing technologies, ensuring a smooth and natural transition between audio and sound images. Simultaneously, dynamic calibration further improves the accuracy of sound image positioning, aligning with the cabin sound field requirements and avoiding issues such as sound quality distortion and sound image shift during switching. Storing the user preference strategy makes the next audio switch more aligned with user habits, further enhancing the stability and adaptability of audio switching.

[0043] In some embodiments of the present invention, audio switching includes: controlling the volume of the original output terminal to decrease linearly, and controlling the volume of the target output terminal to increase linearly; wherein the transition time of linear decrease and / or linear increase is 200ms to 300ms.

[0044] Understandably, this solution uses a transition duration of 200ms to 300ms during audio switching, linearly attenuating (fading out) the volume of the original output terminal and linearly gaining (fading in) the volume of the target output terminal. This achieves a smooth transition between multiple audio streams and multiple output terminals, avoiding the abrupt auditory sensation caused by sudden volume changes or direct stop-start / playback. It further eliminates auditory gaps and discomfort during audio switching, ensuring timely switching response while preventing drivers and passengers from perceiving obvious audio cutoffs, pops, delays, misalignments, or sound field jumps, thus further improving the smoothness and auditory comfort of audio switching.

[0045] In some embodiments of the present invention, the headrest speakers include a driver's headrest speaker, a passenger's headrest speaker, and a rear headrest speaker. Mapping multiple audio sources to corresponding target output terminals for playback based on the target output terminal, priority weight, and acoustic characteristic parameters of each audio source includes: marking multiple audio sources as safety audio, private audio, and shared audio; according to the interaction intent, prioritizing mapping safety audio to the driver's headrest speaker, private audio to Bluetooth headsets, passenger's headrest speaker, or rear headrest speaker, and shared audio to the vehicle's infotainment system speaker; wherein, safety audio includes navigation and vehicle alarms, private audio includes Bluetooth calls and personal audio / video, and shared audio includes in-vehicle music and voice assistant.

[0046] Understandably, this solution categorizes multiple audio sources into safety, privacy, and sharing categories, and maps them to the driver's headrest speaker, passenger's headrest speaker, Bluetooth headset, and vehicle speaker respectively based on the interaction intent. This ensures that navigation and vehicle alarms are directed to the driver's headrest speaker to guarantee driving safety, while Bluetooth calls and personal audio-visual content are projected to corresponding private terminals to prevent information leakage. All in-vehicle music and voice assistants achieve full coverage through the vehicle speaker. This approach achieves precise matching of different audio attributes with various output terminals, avoiding audio crosstalk and content interference, while also ensuring driving safety, passenger privacy, and space sharing.

[0047] In some embodiments of the present invention, the audio playback management method further includes: suppressing the volume of low-priority audio at the corresponding target output terminal when a high-priority audio source is triggered, according to priority weights; wherein the priority order of security audio, private audio, and shared audio is: security audio > private audio > shared audio.

[0048] Understandably, this solution prioritizes audio sources based on the order of safety > privacy > shared audio. When a high-priority audio source is triggered, the volume of the corresponding terminal is suppressed for low-priority audio. This ensures that audio sources related to driving safety (such as navigation and vehicle alarms) are transmitted clearly and prioritized without interrupting the playback of multiple audio sources, preventing them from being masked by other audio sources. At the same time, it ensures that privacy audio is not interfered with by shared audio sources, achieving orderly scheduling when multiple audio sources are running concurrently. This prevents the loss of important information and audio crosstalk, and eliminates the need for drivers and passengers to frequently switch between audio sources, thus avoiding auditory gaps and further improving the responsiveness and driving experience of the cockpit audio system.

[0049] like Figure 2As shown, the present invention also provides an audio playback system based on sound field anchoring. The audio playback system is used to execute the audio playback management method based on sound field anchoring in any of the above embodiments. The audio playback system includes a sound field anchoring module 100, a timing phase-locked loop module 200, a spatial intent recognition module 300, an audio switching module 400, and a multi-source collaborative output module 500. Specifically, the sound field anchoring module 100 is used to construct a multi-level sound field anchor point and acoustic mapping model; the timing phase-locked module 200 is used to synchronize the multi-terminal playback timing of the vehicle's main controller speakers, headrest speakers, and Bluetooth headsets using the system clock of the vehicle's main controller as the reference clock; the spatial intent recognition module 300 is used to identify the interactive intent of the intelligent cockpit space based on real-time data collected by the cockpit sensors, and to determine the target output terminal and priority weight of each audio source based on the attribute type and interactive intent of the multiple audio sources; the audio switching module 400 is used to obtain the acoustic characteristic parameters of the target output terminal through the multi-level sound field anchor point and acoustic mapping model; and the multi-source collaborative output module 500 is used to map multiple audio sources to the corresponding target output terminal for playback based on the target output terminal, priority weight, and acoustic characteristic parameters of each audio source. Based on real-time data collected by cockpit sensors, the system identifies the interaction intent within the intelligent cockpit space and determines the target output terminal and priority weight for each audio source based on its attribute type and interaction intent. Based on the security, privacy, and sharing attributes of multiple audio sources, assign target output terminals and priority weights; The real-time data includes the driver's head posture, passenger behavior, and seat occupancy status. Interaction intents include private focus intents, space sharing intents, and partition independence intents.

[0050] While the present invention has been disclosed above, it is not limited thereto. Any person skilled in the art can make various modifications and alterations without departing from the spirit and scope of the invention; therefore, the scope of protection of the present invention should be determined by the scope defined in the claims.

Claims

1. An audio playback management method based on sound field anchoring, characterized in that, The audio playback management method is applied to an intelligent cockpit audio system that includes a vehicle speaker, headrest speakers, Bluetooth headsets, and cockpit sensors. The audio playback management method includes: Construct a multi-level sound field anchor point and acoustic mapping model; Using the system clock of the vehicle's main controller as the reference clock, the multi-terminal playback timing of the vehicle's speaker, headrest speaker, and Bluetooth headset is synchronized using phase-locked synchronization. The interaction intent of the intelligent cockpit space is identified based on the real-time data collected by the cockpit sensors, and the target output terminal and priority weight of each audio source are determined according to the attribute type of the multiple audio sources and the interaction intent. The acoustic characteristic parameters of the target output terminal are obtained by using the multi-level sound field anchor points and the acoustic mapping model. The multiple audio sources are mapped to the corresponding target output terminals for playback based on the target output terminal, priority weight, and acoustic characteristic parameters for each audio source. The system identifies the interactive intent of the intelligent cockpit space based on real-time data collected by the cockpit sensors, and determines the target output terminal and priority weight of each audio source based on the attribute types of multiple audio sources and the interactive intent, including: The target output terminal and priority weight are assigned according to the security attributes, privacy attributes, and sharing attributes of the multiple audio sources. The real-time data includes the driver's head posture, passenger behavior, and seat occupancy status. The interaction intents include privacy and focus intents, space sharing intents, and partition independence intents.

2. The audio playback management method according to claim 1, characterized in that, The construction of the multi-level sound field anchor point and acoustic mapping model includes: Preset multi-level virtual sound field anchor points inside the vehicle; Based on each sound field anchor point in the multi-level virtual sound field anchor points in the vehicle, the acoustic characteristic parameters of the vehicle speaker, the headrest speaker, and the Bluetooth headset are collected; Based on the acoustic characteristic parameters, a multi-level sound field anchor point and acoustic mapping model is established.

3. The audio playback management method according to claim 2, characterized in that, The in-vehicle multi-level virtual sound field anchor points include at least one of the following: a common anchor point for the entire vehicle, a private anchor point for the driver's seat, a private anchor point for the passenger's seat, and a rear-seat zone anchor point; The acoustic characteristic parameters include at least one of frequency response curve, delay characteristics, and acoustic image localization parameters; The multi-level sound field anchor point and acoustic mapping model includes the EQ compensation parameters, delay compensation parameters, and sound image positioning calibration parameters of the target output terminal.

4. The audio playback management method according to claim 1, characterized in that, The multi-terminal playback timing phase-locked synchronization of the vehicle speaker, the headrest speaker, and the Bluetooth headset includes: The playback clock of the headrest amplifier is phase-locked with the reference clock via the car audio bus; The decoding and playback clock of the Bluetooth headset is phase-locked with the reference clock via the ISO synchronization channel of the LEAudio protocol, and a clock drift compensation algorithm is used for real-time calibration.

5. The audio playback management method according to claim 3, characterized in that, When the vehicle-mounted system responds to a switching command, the process of obtaining the acoustic characteristic parameters of the target output terminal through the multi-level sound field anchor points and the acoustic mapping model includes: When the vehicle-mounted terminal responds to the switching command, it obtains the EQ compensation parameters and the delay compensation parameters of the target output terminal through the multi-level sound field anchor points and acoustic mapping model. The audio switching is performed based on the EQ compensation parameters and the delay compensation parameters; When the vehicle-mounted unit performs the audio switching, it acquires the sound image positioning calibration parameters in real time and dynamically adjusts the sound image positioning of the target output terminal based on the sound image positioning calibration parameters. After the audio switching is completed, the audio output status is updated and the user preference policy is stored.

6. The audio playback management method according to claim 5, characterized in that, The audio switching includes: The volume of the original output terminal is controlled to decrease linearly, and the volume of the target output terminal is controlled to increase linearly. The transition time of the linear attenuation and / or the linear gain is 200ms to 300ms.

7. The audio playback management method according to claim 6, characterized in that, The headrest speakers include a driver's headrest speaker and a passenger's headrest speaker. The step of mapping the multiple audio sources to the corresponding target output terminals for playback based on the target output terminal, the priority weight, and the acoustic characteristic parameters for each audio source includes: The multiple audio sources are labeled as secure audio, private audio, and shared audio. Based on the interaction intent, the safety-related audio is mapped to the driver's headrest speaker, the privacy-related audio is mapped to the Bluetooth headset or the passenger's headrest speaker, and the sharing-related audio is mapped to the vehicle's infotainment system speaker; The safety-related audio includes navigation and vehicle alarms; the privacy-related audio includes Bluetooth calls and personal audio / video; and the shared audio includes in-vehicle music and voice assistants.

8. The audio playback management method according to claim 7, characterized in that, The audio playback management method also includes: According to the priority weight, when a high-priority audio source is triggered, the volume of the low-priority audio source is suppressed at the corresponding target output terminal. The priority order of the secure audio, the private audio, and the shared audio is: secure audio > private audio > shared audio.

9. An audio playback system based on sound field anchoring, characterized in that, The audio playback system is used to execute the audio playback management method based on sound field anchoring as described in any one of claims 1-8, and the audio playback system includes: A sound field anchoring module (100) is used to construct a multi-level sound field anchor point and acoustic mapping model; A phase-locked loop module (200) is used to synchronize the multi-terminal playback timing of the vehicle speaker, the headrest speaker, and the Bluetooth headset with the system clock of the vehicle main controller as the reference clock. The spatial intent recognition module (300) is used to identify the interactive intent of the intelligent cockpit space based on the real-time data collected by the cockpit sensors, and to determine the target output terminal and priority weight of each audio source based on the attribute type of the multiple audio sources and the interactive intent. An audio switching module (400) is used to obtain the acoustic characteristic parameters of the target output terminal through the multi-level sound field anchor points and the acoustic mapping model; A multi-source collaborative output module (500) is used to map the multiple audio sources to the corresponding target output terminal for playback according to the target output terminal, priority weight and acoustic characteristic parameters of each audio source. The step of identifying the interactive intent of the intelligent cockpit space based on real-time data collected by the cockpit sensors, and determining the target output terminal and priority weight of each audio source based on the attribute type of multiple audio sources and the interactive intent, includes: Based on the security, privacy, and sharing attributes of the multiple audio sources, assign target output terminals and priority weights. The real-time data includes the driver's head posture, passenger behavior, and seat occupancy status. The interaction intents include privacy and focus intents, space sharing intents, and partition independence intents.

Images