Method and apparatus for processing multi-zone audio, electronic device

Abstract

The application discloses a method and device for processing multi-partition audio, and electronic equipment. The method comprises the following steps: parsing a preset global audio configuration file, distributing corresponding configuration data in the global audio configuration file to each audio area through a distributed data service; distributing an audio data packet to a corresponding audio area based on a preset dynamic audio routing strategy through a time-sensitive network; and controlling a digital signal processor to play audio of the audio area according to the configuration data of the audio area and the audio data packet. The application can reduce the audio playing delay of a vehicle-mounted multi-partition audio device.

Description

Technical Field

[0001] This invention relates to the field of multi-zone audio processing technology, and more particularly to methods, apparatus, and electronic devices for processing multi-zone audio. Background Technology

[0002] To create an immersive acoustic environment, modern intelligent vehicles typically feature 20 to 60 speakers, managed and driven collaboratively by multi-zone stereo technology. This constructs an advanced audio system that provides independent sound effects for different seating areas, such as a four-zone audio system for the driver, front passenger, and rear left and right seats. While such systems can meet passengers' personalized audio playback needs, significant technical challenges remain in practical deployment and application, with the precise control of audio latency being particularly prominent. Due to the presence of various heterogeneous communication interfaces (such as CAN, Ethernet, MIPI, etc.) and dedicated audio interfaces within intelligent vehicles, these interfaces inherently differ in transmission protocols, data bandwidth, and processing timing. However, multi-zone independent audio sources demand extremely high signal synchronization and real-time performance, making it difficult to maintain a uniform and low-latency transmission sequence for audio data streams across interfaces and nodes. This inconsistency and uncontrollability in latency can not only lead to audio-visual desynchronization but also directly affect the independence of each sound field area and the quality of audio playback. Summary of the Invention

[0003] The present invention provides a method and apparatus for processing multi-zone audio, and an electronic device that can reduce the audio playback latency of in-vehicle multi-zone audio devices.

[0004] In one aspect of the present invention, a method for processing multi-zone audio is provided. The method includes: parsing a preset global audio configuration file to distribute configuration data corresponding to each audio zone via a distributed data service; distributing audio data packets to the corresponding audio zones via a time-sensitive network based on a preset dynamic audio routing strategy; and controlling a digital signal processor to play the audio in the audio zone according to the configuration data of the audio zone and the audio data packets.

[0005] In another aspect of the invention, an apparatus for processing multi-zone audio is provided. The apparatus includes: The distributed data service module is configured to distribute the corresponding configuration data in the global audio configuration file to each audio region according to the global audio configuration file; the time-sensitive network module is configured to distribute audio data packets to the corresponding audio region based on a preset dynamic audio routing strategy; and the partitioned audio module is configured to control the digital signal processor to play the audio of the audio region according to the configuration data and the audio data packets of the audio region.

[0006] In another aspect of the invention, an electronic device is provided, comprising: a memory configured to store information associated with multi-zone audio; and a processor electrically coupled to the memory and configured to perform the method as described above.

[0007] According to the technical solution of the present invention, by parsing a preset global audio configuration file, the corresponding configuration data in the global audio configuration file is distributed to each audio region through a distributed data service to ensure that the configuration data can be accurately sent to each audio region; audio data packets are distributed to the corresponding audio regions through a time-sensitive network based on a preset dynamic audio routing strategy, and the time-sensitive network ensures that the audio data packets are transmitted to the corresponding audio regions without delay or jitter and reliably; and according to the configuration data and audio data packets of the audio regions, the digital signal processor is controlled to play the audio of the audio regions. By utilizing the real-time and highly reliable distributed data service and time-sensitive network, the multi-zone audio is managed and distributed, reducing the audio playback latency of the in-vehicle multi-zone audio device, and realizing almost zero-latency audio playback of the multi-zone audio device. Attached Figure Description

[0008] Figure 1 This is a flowchart of a method for processing multi-zone audio according to an embodiment of the present invention; Figure 2 This is an architecture diagram of a method for processing multi-zone audio according to an embodiment of the present invention; Figure 3 This is a schematic diagram of the structure of a multi-zone audio processing device according to an embodiment of the present invention; Figure 4 This is a schematic diagram of the structure of an electronic device according to an embodiment of the present invention. Detailed Implementation

[0009] To explain in detail the technical content, objectives, and effects of the present invention, the following description is provided in conjunction with the embodiments and accompanying drawings.

[0010] The abbreviations and their definitions used in this application are as follows.

[0011] DDS (Data Distribution Service) is a data-centric publish-subscribe communication middleware used for efficient and reliable data distribution in distributed systems. It allows applications to publish and subscribe to data by defining "topics" and supports configurable quality of service policies. In this application, DDS is responsible for the real-time synchronization and distribution of control information such as audio configuration, routing policies, and focus states.

[0012] Time-Sensitive Networking (TSN) is a set of IEEE 802.1 standards designed to provide Ethernet with deterministic latency, low jitter, and high reliability data transmission capabilities. It ensures the timely and error-free transmission of critical data streams (such as audio streams) through mechanisms such as time synchronization, traffic scheduling, and traffic shaping. In this invention, TSN is primarily used to transmit audio data packets, guaranteeing their real-time performance and synchronization.

[0013] A DSP (Digital Signal Processor) is a hardware chip specifically designed for audio signal processing. It typically includes high-performance ADC (Analog-to-Digital Converter) / DAC (Digital-to-Analog Converter) units, responsible for driving speakers, performing mixing, and processing audio effects. Each audio region can be handled by one or more DSPs.

[0014] An ADC (Analog-to-Digital Converter) is an electronic device that converts continuously changing analog signals into discrete digital signals.

[0015] A DAC (Digital-to-Analog Converter) is a device that converts digital signals back into analog signals, performing the opposite process to an ADC.

[0016] In related technologies, the IT (Information Technology) development trend of intelligent vehicles is accelerating, and the complexity of technological iteration and advanced audio is increasing. Intelligent vehicles typically require 20 to 60 speakers, necessitating the use of multi-zone stereo technology to manage and drive them, thereby constructing an advanced multi-zone stereo system. An advanced four-zone audio system for automobiles aims to create an independent listening space for each core passenger in the vehicle (i.e., the driver, front passenger, and the left and right rear seats). Through precise speaker layout and independent audio channel processing technology, it divides the cabin into four independent sound field zones. Under this system, each passenger can personalize their selection of favorite music, podcasts, and other audio sources via a screen or control next to them, and independently adjust the volume without interference. For example, the driver can listen to navigation prompts and news, the front passenger can enjoy a movie, and the rear passengers can immerse themselves in their own musical world. The core of this technology lies in powerful hardware support and advanced acoustic algorithms, which ensure both clarity and privacy of sound in each zone while minimizing sound crosstalk, thus providing each occupant with a personalized listening experience within the shared cabin.

[0017] However, multi-zone stereo in smart cars also has the following problems: latency sensitivity of audio devices, due to the differences between the smart interface communication interface and the audio interface, making it very difficult to manage audio latency; zone interference, with serious interference problems between adjacent zones and across zones.

[0018] To address at least the aforementioned technical problems, this disclosure provides a solution for processing multi-zone audio. According to embodiments of this disclosure, a preset global audio configuration file is parsed to distribute the corresponding configuration data in the global audio configuration file to each audio zone via a distributed data service, ensuring that the configuration data is accurately sent to each audio zone; audio data packets are distributed to the corresponding audio zones using a time-sensitive network based on a preset dynamic audio routing strategy, ensuring that the audio data packets are transmitted reliably to the corresponding audio zones without delay or jitter; and a digital signal processor is controlled to play the audio in the audio zone based on the configuration data and the audio data packets of the audio zone.

[0019] According to embodiments of this disclosure, a distributed data service and time-sensitive network with real-time performance and high reliability are used to manage and distribute multi-zone audio, reducing the audio playback latency of the in-vehicle multi-zone audio device. This achieves near-latency audio playback from the multi-zone audio device. Furthermore, based on the configuration data, audio data packets, and audio focus state of each audio zone, the in-vehicle digital signal processor is controlled to play the audio from each audio zone. The distributed data service and time-sensitive network with real-time performance and high reliability are used to manage and distribute the multi-zone audio. In this way, embodiments of this disclosure can reduce the audio playback latency of the in-vehicle multi-zone audio device, achieving near-latency audio playback.

[0020] According to embodiments of this disclosure, Distributed Data Service (DDS) is the "intelligent brain" located above the network layer, responsible for organizing and distributing data, while Time-Sensitive Network (TSN) is the "super steward" of the network layer, responsible for ensuring that data is transmitted on time and reliably over the network.

[0021] DDS is a data-centric publish / subscribe communication mechanism, corresponding to a highly intelligent data distribution bus and matching service. In a distributed system, DDS can find the right data for the right application and distribute it according to the correct Quality of Service (QoS) requirements. DDS solves the problems of "what is the data" and "who gets the data."

[0022] TSN is a highly precise and disciplined traffic control system. TSN provides a dedicated "highway" for time-sensitive critical data, ensuring it arrives at its destination reliably, without delay or fluctuation, within precisely calculated timeframes. TSN manages "how the data travels."

[0023] By combining DDS and TSN, end-to-end deterministic communication from application to network is achieved. At the application layer, the DDS API is used to define data topics and quality of service. At the application middle or lower layer, this high-priority data stream from DDS is identified by the TSN switch upon entering the network. The TSN then uses mechanisms such as TAS to schedule a transmission time window based on its priority, ensuring it is not blocked by other traffic.

[0024] In the following, the technical solutions according to this disclosure will be described with reference to specific embodiments and in conjunction with the accompanying drawings.

[0025] Figure 1 This is a flowchart illustrating a method 100 for processing multi-zone audio according to an embodiment of the present disclosure. (Refer to...) Figure 1 The method 100 includes the following steps 102 to 106.

[0026] In step 102, the preset global audio configuration file is parsed to distribute the corresponding configuration data in the global audio configuration file to each audio region through a distributed data service.

[0027] In some embodiments, the global audio configuration file is parsed to obtain configuration data for each audio region; a topic for the corresponding distributed data service is defined based on the configuration data for each audio region, and the topic is published through the distributed data service; and the digital signal processor for each audio region subscribes to the corresponding topic to receive the configuration data.

[0028] In this way, the DDS middleware is responsible for maintaining the publish-subscribe matching. Once the configuration data is updated (such as when the user adjusts the volume in the driver's area via the central control screen), the main control chip publishes the new data, and the DSP will receive the notification in real time and update its internal parameters. This eliminates the need for polling, improving efficiency and real-time performance, thereby enabling real-time distribution and updating of configuration data.

[0029] The global audio configuration file is a centrally defined configuration file, typically in XML or JSON format, describing the configuration information for all audio zones. This includes, but is not limited to, unique zone identifiers, associated speaker devices, default volume, sound effect parameters, and routing strategies. This file is parsed and distributed by the main control chip. An audio zone refers to a physical space within the vehicle divided into independent audio playback areas, such as the driver's area, passenger area, left rear seat area, and right rear seat area. Each zone can independently play different audio content and has independent volume, sound effect, and other configurations. For example, the multi-zone audio service module running on the main control chip (such as the heterogeneous multi-core processor RK3588) reads the global audio configuration file (e.g., audio_config.xml) from the storage device. This file defines the configuration of all audio zones in the vehicle in XML format. The main control chip parses this file and extracts the configuration data for each audio zone. Through the DDS middleware, a corresponding publishing topic (e.g., the topic AudioConfig / driver) is created for each zone. The main control chip, acting as the publisher, publishes this configuration data to the corresponding topic. Each audio zone's DSP acts as a subscriber, subscribing to its corresponding configuration topic at startup (e.g., the DSP responsible for driver zone audio subscribes to AudioConfig / driver).

[0030] In step 104, audio data packets are distributed to the corresponding audio regions using a time-sensitive network based on a preset dynamic audio routing strategy.

[0031] In some embodiments, the dynamic audio routing strategy is distributed through the distributed data service, and a dynamic routing table is generated and updated synchronously.

[0032] In some embodiments, distributing the dynamic audio routing policy through the distributed data service includes: determining, by an audio application, how to route an audio stream to an appropriate volume group and output device based on audio routing rules; and dynamically updating the routing decision through the distributed data service to determine the dynamic audio routing policy for the audio region, such that the audio application adjusts the routing decision according to network conditions.

[0033] In some embodiments, distributing audio data packets to the corresponding audio regions via a time-sensitive network based on a preset dynamic audio routing strategy includes: transmitting the audio data packets via the time-sensitive network using a deterministic delay guarantee mechanism; and distributing the audio data packets from the time-sensitive network to the corresponding audio regions based on the dynamic audio routing strategy.

[0034] In some embodiments, the audio routing policy corresponding to the audio region is distributed through the time-sensitive network, and the audio stream path is dynamically adjusted according to application requirements.

[0035] In some embodiments, the time-sensitive network employs appropriate buffering strategies to address network jitter or latency in order to ensure time synchronization of the audio data.

[0036] In some embodiments, the time-sensitive network is used to balance the relationship between buffer size and latency to ensure time synchronization of audio control, thereby ensuring synchronization between audio data and control commands.

[0037] In this way, by dynamically generating and managing routing tables through DDS and using the TSN network to transmit audio data, it is possible to transmit audio data to the target area accurately, with low latency and low jitter.

[0038] Dynamic audio routing strategies are sets of rules that dynamically determine which audio regions(s) an audio stream should be routed to based on real-time conditions (such as user actions, vehicle status, and network conditions). These strategies can be dynamically updated and synchronized via DDS. For example, dynamic audio routing strategies are managed by a multi-zone audio service module. The strategy rules can be dynamically adjusted based on user interaction, vehicle status (such as vehicle speed and window opening / closing), or network load. The multi-zone audio service module may have a built-in routing decision engine that generates routing strategies based on preset strategies (such as "navigation sounds are prioritized for the driver's zone") and real-time input (such as the currently active audio application). The routing strategies are published and synchronized to all relevant nodes (including the main control chip and regional DSPs) via DDS in the form of topics, forming a dynamically updated routing table. When audio data needs to be transmitted (e.g., a PCM stream generated from a media player), the main control chip packages the audio data and transmits it using the TSN network. The TSN network, through its deterministic scheduling mechanism, allocates dedicated time windows and bandwidth to the audio data stream, ensuring low-latency, low-jitter transmission. The receiving end's DSP or intermediate node identifies the target region of each audio data packet based on the latest dynamic routing table obtained through DDS synchronization, and distributes it to the corresponding audio processing pipeline based on priority.

[0039] In some embodiments, the audio focus state of each audio region is managed through a distributed data service. When a first audio application gains audio focus, a status change notification is published through the distributed data service; and based on the status change notification, a volume reduction, playback pause, or mute operation is performed on a second audio application. In this way, audio focus management is achieved through the real-time publish-subscribe mechanism of DDS, enabling rapid response to focus changes and effectively avoiding audio conflicts.

[0040] Audio focus refers to the state of which audio application (such as navigation, music playback, or call) has current playback permissions within a specific audio area. The application with focus can play normally, while applications without focus may need to lower their volume, pause, or mute to avoid conflict. For example, when an audio application (such as a music player) requests to play in a certain area, it needs to compete for focus via DDS (Distributed Audio Controller), and the focus management logic determines whether to grant or deny focus. When the first audio application (such as a call answering app) obtains exclusive audio focus in the driving area, it publishes a message to the corresponding topic via DDS. The second audio application (such as a music player) that was originally playing in the driving area has subscribed to this topic. Upon receiving the focus change notification, the music player automatically performs a preset downgrade operation based on the notification content (such as the focus type being exclusive), such as lowering the volume to 20% or pausing playback completely.

[0041] In step 106, the vehicle-mounted digital signal processor is controlled to play the audio of the audio region according to the configuration data of the audio region and the audio data packet.

[0042] In some embodiments, before controlling the vehicle-mounted digital signal processor to play the audio of each of the audio regions, the method further includes: for a specified target audio region, performing mixing processing on multiple audio sources of the target audio region by calling a preset mixing algorithm through the multi-zone audio service to generate a composite audio signal; performing sound effect processing on the composite audio signal by calling a preset sound effect algorithm through the multi-zone audio service to generate the audio data packet; and outputting the audio data packet by calling a preset driver interface through the multi-zone audio service.

[0043] In this way, by mixing and processing audio data before playback, an immersive sound field experience is provided. For example, after receiving configuration data and audio data packets, the DSP of each audio zone processes the audio data according to configuration parameters (such as volume and sound effect mode). The DSP calls its built-in audio processing pipeline, which may include steps such as decoding, sample rate conversion, mixing (if multiple sources need to be mixed), and sound effect enhancement. The processed digital audio signal is converted into an analog signal by the DSP's DAC unit, driving the corresponding speaker in that zone to play sound, thereby achieving independent and high-quality audio playback for each zone.

[0044] In some embodiments, invoking a preset mixing algorithm through the multi-zone audio service to mix multiple audio sources in the target audio region includes: dynamically adjusting the mixing algorithm based on real-time monitored in-vehicle ambient noise parameters. In this way, the mixing algorithm maintains the clarity of the primary audio source. The mixing algorithm combines signals from multiple audio sources (such as music, navigation prompts, and warning sounds) into a single composite audio signal. In an in-vehicle environment, mixing needs to consider factors such as the priority of each audio source and in-vehicle noise. For example, when the in-vehicle noise sensor detects increased wind noise, the algorithm can dynamically adjust the mixing weights of movie sound effects and warning sounds, appropriately increasing their gain to ensure clarity.

[0045] In some embodiments, processing the composite audio signal by invoking a preset sound effect algorithm through the multi-zone audio service includes: dynamically adjusting the equalization, compression, or surround sound parameters of the sound effect algorithm based on the in-vehicle acoustic characteristics of the target audio region and passenger position information. In this way, the sound effect algorithm dynamically adjusts the sound effect parameters to improve the user experience in each location. The sound effect algorithm can dynamically adjust parameters based on the in-vehicle acoustic characteristics of the target region (pre-stored or real-time measured frequency response curves) and passenger position information (from seat sensors or cameras). For example, if only a passenger is detected on the left side of the rear seat, the equalization and sound field parameters can be dynamically adjusted to concentrate sound energy more on the left rear speaker, providing the best listening experience for the individual passenger.

[0046] In some embodiments, the global clock synchronization mechanism of the Time-Sensitive Network (TSN) is utilized to schedule the transmission of audio data packets based on the global clock, and to coordinate buffering strategies to synchronize audio control commands distributed to each audio zone. In this way, the TSN's global clock synchronization mechanism ensures precise synchronization of multi-zone audio playback, providing an immersive sound field experience.

[0047] For example, the TSN network establishes and maintains a global clock with microsecond-level precision across all devices in the network (such as the main control chip, TSN switches, and DSP middleware in each area) via the IEEE 802.1AS protocol. The sending and forwarding of audio data packets are scheduled based on this global clock, ensuring all devices have synchronized clocks and thus highly synchronized sending and receiving actions. Each receiving DSP sets a precise playback buffer based on the global clock and a known fixed transmission delay. Data packets are stored in the buffer at predetermined times and retrieved for playback at the precise clock moment. This effectively offsets any remaining minor network jitter, ensuring perfectly synchronized playback of sound across all zones, such as achieving precise sound image positioning for immersive sound. Not only audio data, but also control commands (such as "mute immediately") can be transmitted via TSN scheduling or published via DDS but timestamped using a TSN-synchronized clock. The receiving end executes the command at precisely the same time based on the timestamp, ensuring consistent behavior across all zones and avoiding discrepancies in the user experience caused by asynchronous command execution.

[0048] Figure 2 This is an architectural diagram illustrating a method for processing multi-zone audio according to embodiments of the present disclosure. (Refer to...) Figure 2 This application presents an in-vehicle zone audio architecture built on Distributed Data Service (DDS) and Time-Sensitive Network (TSN). The main control chip of the intelligent vehicle carries a multi-zone audio service module and utilizes Distributed Data Service (DDS) and Time-Sensitive Network (TSN), which have real-time performance and high reliability, to manage and distribute multi-zone audio services.

[0049] The multi-zone audio service includes: DDS middleware 202 for zone audio, TSN middleware 204 for zone audio, and zone audio 206 for intelligent vehicles. The main control chip of the intelligent vehicle is responsible for the multi-zone audio control and distribution operations. The main control chip and DSP construct a multi-zone audio network through DDS and TSN. The main control chip uses the TSN network for multi-zone collaboration and synchronization. The onboard DSP chip drives the zone audio playback.

[0050] According to embodiments of this disclosure, the intelligent vehicle enables a main control chip (multi-zone audio controller) to parse the multi-zone audio configuration file, distribute the multi-zone audio configuration file via a multi-zone audio service, distribute the dynamic routing decisions for the multi-zone audio via the DDS, and distribute the audio data packets for the multi-zone audio via the TSN. Furthermore, the DDS controls the audio focus of the multi-zone audio, and the multi-zone audio controller (DSP) plays the audio.

[0051] In some embodiments, the intelligent vehicle defines and configures DDS topics for publishing and subscribing to audio zone information. Audio zone information includes elements such as device, attributes, and volume, and ensures that this information can be effectively distributed within the system via DDS. Each audio zone is described using XML or a similar format and published to relevant subscribers using DDS, so that different audio zones within the intelligent vehicle can obtain the latest audio zone configuration in real time. In this way, configuration files for multi-zone audio are distributed by DDS.

[0052] In some embodiments, audio applications determine how to route audio streams to the appropriate volume groups and output devices based on audio routing rules. Dynamic routing table updates are achieved through DDS, enabling audio applications to adjust their routing decisions in a timely manner according to network conditions. By making better routing decisions based on the global view of DDS, audio routing rules can be efficiently synchronized across different components, ensuring that audio streams are accurately sent to the correct volume groups and output devices. In this way, dynamic routing decisions for multi-zone audio are distributed by DDS.

[0053] In some embodiments, the deterministic latency guarantee provided by TSN is utilized to further optimize the transmission path of the audio stream, reducing latency and jitter. This ensures that dynamic routing capabilities can identify and prioritize data packets from TSN. In this manner, TSN distributes audio data packets for multi-zone audio.

[0054] In some embodiments, DDS is used to enhance the flexibility and responsiveness of audio focus management. For example, when an audio application gains focus, it can quickly notify other applications to lower the volume or pause playback via DDS. In this way, DDS partitions the audio focus of multiple audio zones.

[0055] According to embodiments of this disclosure, the collaborative processing flow for multi-zone audio based on DDS involves collaborative processing of audio mixing, audio effects, and audio output for multi-zone audio. The collaborative processing includes: starting the multi-zone audio service of the intelligent vehicle; the multi-zone audio service starting the DDS middleware for zone audio; the multi-zone audio service distributing audio data using DDS and TSN middleware; the multi-zone audio service performing zone mixing processing using DDS; the multi-zone audio service performing zone effects processing using DDS; and the multi-zone audio service driving zone audio output using DDS.

[0056] In some embodiments, the multi-zone audio service is responsible for audio algorithm processing, audio effects processing, audio zone management, audio routing strategies, and audio device management. In the case of multiple zones, the above audio processing and management logic becomes more complex. Assume that multiple master controllers in a smart car connect and configure all audio input / output devices in the vehicle via TCP / IP. The core master controller distributes multi-zone audio through TCP / IP enabled by TSN, while other master controllers (DSPs) drive the zone audio output.

[0057] In some embodiments, the audio stream path is dynamically adjusted according to user or system needs, and the multi-partition audio service distributes audio data using DDS and TSN middleware. DDS is used for data distribution, TSN features are utilized for precise synchronization, and appropriate buffering strategies are employed to handle network jitter.

[0058] In some embodiments, the multi-zone audio service uses DDS to mix multiple audio sources in a specified zone to generate a composite audio signal. This maintains high-quality sound reproduction while taking into account the impact of in-vehicle ambient noise.

[0059] In some embodiments, the multi-zone audio service uses DDS to perform equalization, compression, and other sound effect processing on the audio signal to enhance the listening experience. Sound effect parameters are dynamically adjusted based on the characteristics of the vehicle interior space and passenger positions.

[0060] In some embodiments, the multi-zone audio service uses a DDS to send the processed audio signal to the corresponding output device for final optimization based on device characteristics. The in-vehicle DSP chip includes a high-performance ADC / DAC unit designed specifically for audio, used to connect analog microphones, speakers, and power amplifiers.

[0061] According to embodiments of this disclosure, the synchronous processing of multi-zone audio based on TSN involves the synchronous processing of multi-zone audio routing strategies, audio data, and audio control. The synchronous processing includes: starting the multi-zone audio service of the intelligent vehicle; starting the TSN middleware for the zone audio in the multi-zone audio service; distributing the multi-zone audio routing strategy using TSN in the multi-zone audio service; synchronously processing the audio data using TSN in the multi-zone audio service; and synchronously processing the audio control using TSN in the multi-zone audio service.

[0062] In some embodiments, the Time-Sensitive Networking (TSN) protocol is carried at both the MAC and IP layers of TCP / IP.

[0063] In some embodiments, the multi-partition audio service uses TSN to dynamically adjust the audio stream path according to application requirements. TSN ensures that each partition can obtain audio routing policy information with low latency.

[0064] In some embodiments, multi-zone audio services use TSN (Time Synchronization Node) to ensure audio data time synchronization and employ appropriate buffering strategies to handle network jitter or latency. TSN achieves data synchronization by establishing a highly accurate "global clock" and scheduling data stream transmission based on this clock. Like all musicians in a symphony orchestra following the same conductor's metronome, TSN allows all devices in the network to share a metronome accurate to microseconds or even nanoseconds. TSN achieves time synchronization via IEEE 802.1AS and traffic scheduling via IEEE 802.1Qbv. TSN ensures that all audio data packets arrive at different speakers or processing units almost simultaneously, achieving perfect sound field synchronization and providing a more immersive experience for multi-zone audio systems.

[0065] In some embodiments, the multi-zone audio service uses TSN to leverage TSN features to ensure time synchronization of audio control, balance the relationship between buffer size and latency, and ensure precise synchronization between audio data and control commands.

[0066] According to another aspect of the invention, Figure 3 This is a schematic diagram illustrating the structure of a multi-zone audio processing device according to an embodiment of the present invention. (Refer to...) Figure 3 The device 300 includes a distributed data service module 302, a time-sensitive network module 304, and a zoned audio module 306.

[0067] The distributed data service module 302 is configured to distribute the corresponding configuration data in the global audio configuration file to each audio region according to the global audio configuration file.

[0068] The time-sensitive network module 304 is configured to distribute audio data packets to the corresponding audio regions based on a preset dynamic audio routing strategy.

[0069] The partitioned audio module 306 is configured to control the digital signal processor to play the audio of the audio region according to the configuration data of the audio region and the audio data packet.

[0070] It should be understood that the distributed data service module 302, the time-sensitive network module 304, and the partitioned audio module 306 can also be configured to execute the corresponding steps or actions in the methods described in the above embodiments, which will not be repeated here.

[0071] According to another aspect of the invention, Figure 4 This is a schematic diagram illustrating the structure of an electronic device 400 according to an embodiment of the present invention. (Refer to...) Figure 4The electronic device 400 includes a plurality of audio output modules 402, a memory 404, and a processor 406. The audio output modules 402 are electrically coupled to the processor 406 and configured to play audio. The memory 404 is configured to store audio-related information and executable programs. The processor 406 is electrically coupled to the memory 404 and configured to execute the programs to perform the steps of the method for processing multi-zone audio described above.

[0072] In summary, the method, apparatus, and electronic device for processing multi-zone audio provided by this invention, by parsing a preset global audio configuration file, distributes the corresponding configuration data in the global audio configuration file to each audio zone through a distributed data service. The DDS middleware is responsible for maintaining publish-subscribe matching. Once the configuration data is updated (e.g., the user adjusts the volume in the driver's area via the central control screen), the main control chip publishes new data, and the DSP receives the notification in real time and updates its internal parameters, eliminating the need for polling and improving efficiency and real-time performance, thereby achieving real-time distribution and updating of configuration data. Based on a time-sensitive network and a preset dynamic audio routing strategy, audio data packets are distributed to the corresponding audio zones. The DDS dynamically generates and manages the routing table, and the TSN network is used to transmit audio data, enabling accurate, low-latency, and low-jitter transmission of audio data to the target area. The distributed data service manages the audio focus state of each audio zone, and the real-time publish-subscribe mechanism of DDS manages the audio focus, responding quickly to changes in focus and effectively avoiding audio conflicts. A mixing algorithm maintains audio clarity, and a sound effect algorithm dynamically adjusts sound effect parameters, enhancing the user experience at various locations. Furthermore, by utilizing the global clock synchronization mechanism of the Time-Sensitive Network (TSN), the audio data packets are scheduled for transmission based on the global clock, and a buffering strategy is coordinated to synchronize the audio control commands distributed to each audio region. The TSN's global clock synchronization mechanism ensures precise synchronization of multi-zone audio playback, providing an immersive sound field experience.

[0073] The above description is merely an embodiment of the present invention and does not limit the patent scope of the present invention. Any equivalent modifications made based on the content of the present invention specification and drawings, or direct or indirect applications in related technical fields, are similarly included within the patent protection scope of the present invention.

Claims

1. A method for processing multi-zone audio, characterized by, include: The preset global audio configuration file is parsed to distribute the corresponding configuration data in the global audio configuration file to various audio regions through a distributed data service; Audio data packets are distributed to the corresponding audio regions using a time-sensitive network based on a preset dynamic audio routing strategy. as well as Based on the configuration data of the audio region and the audio data packet, the digital signal processor is controlled to play the audio of the audio region.

2. The method of claim 1, wherein, Parsing a preset global audio configuration file to distribute the corresponding configuration data in the global audio configuration file to various audio regions via a distributed data service includes: Parse the global audio configuration file to obtain the configuration data for each audio region; Define a corresponding topic for the distributed data service based on the configuration data for each audio region, and publish the topic through the distributed data service; and The digital signal processor of each audio region subscribes to the corresponding topic to receive the configuration data.

3. The method of claim 1, wherein, Also includes: The dynamic audio routing strategy is distributed through the distributed data service, and a dynamic routing table is generated and updated synchronously.

4. The method according to claim 3, characterized in that, Distributing the dynamic audio routing strategy through the distributed data service includes: The audio application makes routing decisions based on audio routing rules, determining how to route the audio stream to the appropriate volume group and output device; and The routing decision is dynamically updated by the distributed data service to determine the dynamic audio routing strategy for the audio region, so that the audio application adjusts the routing decision according to the network status.

5. The method according to claim 1, characterized in that, Distributing audio data packets to the corresponding audio regions using a time-sensitive network based on a preset dynamic audio routing strategy includes: The audio data packets are transmitted via the time-sensitive network using a deterministic delay guarantee mechanism; and The audio data packets from the time-sensitive network are distributed to the corresponding audio regions based on the dynamic audio routing strategy.

6. The method according to claim 5, characterized in that, Distributing audio data packets to the corresponding audio regions using a time-sensitive network based on a preset dynamic audio routing strategy includes: The audio routing policy corresponding to the audio region is distributed through the time-sensitive network, and the audio stream path is dynamically adjusted according to application requirements.

7. The method according to claim 5, characterized in that, Distributing audio data packets to the corresponding audio regions using a time-sensitive network based on a preset dynamic audio routing strategy includes: The time-sensitive network employs appropriate buffering strategies to address network jitter or latency, thereby ensuring the time synchronization of the audio data.

8. The method according to claim 5, characterized in that, Distributing audio data packets to the corresponding audio regions using a time-sensitive network based on a preset dynamic audio routing strategy includes: The time-sensitive network is used to balance the relationship between buffer size and latency to ensure time synchronization of audio control, thereby ensuring synchronization between audio data and control commands.

9. The method according to claim 1, characterized in that, Also includes: The audio focus status of each audio region is managed through the distributed data service.

10. The method according to claim 9, characterized in that, Managing the audio focus status of each audio region through the distributed data service includes: When the first audio application gains audio focus, a status change notification regarding the first audio application gaining audio focus is published through the distributed data service; and Based on the status change notification, perform operations such as lowering the volume, pausing playback, or muting on the second audio application.

11. The method according to claim 1, characterized in that, Before controlling the onboard digital signal processor to play the audio for each of the aforementioned audio regions, the following is also included: For a specified target audio region, the multi-partition audio service calls a preset mixing algorithm to mix multiple audio sources in the target audio region to generate a composite audio signal. The multi-zone audio service invokes a preset sound effect algorithm to process the composite audio signal, thereby generating the audio data packet; and The multi-partition audio service calls a preset driver interface to output the audio data packet.

12. The method according to claim 11, characterized in that, The multi-zone audio service calls a preset mixing algorithm to perform mixing processing on multiple audio sources in the target audio region, including: The mixing algorithm is dynamically adjusted based on real-time monitored in-vehicle ambient noise parameters.

13. The method according to claim 11, characterized in that, The sound effect processing of the composite audio signal by calling a preset sound effect algorithm through the multi-zone audio service includes: Based on the acoustic characteristics of the in-vehicle space and passenger position information of the target audio region, the equalization, compression, or surround sound parameters of the sound effect algorithm are dynamically adjusted.

14. The method according to claim 1, characterized in that, Also includes: The audio data packets are transmitted using the global clock synchronization mechanism of the time-sensitive network, and a buffering strategy is coordinated to synchronize the audio control commands distributed to each audio region.

15. An apparatus for processing multi-zone audio, characterized in that, include: The distributed data service module is configured to distribute the corresponding configuration data in the global audio configuration file to each audio region according to the global audio configuration file. The time-sensitive network module is configured to distribute audio data packets to the corresponding audio regions based on a preset dynamic audio routing strategy; as well as The zoned audio module is configured to control the digital signal processor to play the audio of the audio zone according to the configuration data of the audio zone and the audio data packet.

16. An electronic device, characterized in that, include: The memory is configured to store information associated with multi-zone audio; as well as The processor is electrically coupled to the memory and configured to perform the method according to any one of claims 1 to 14.

Images