Sound field cooperative control method, storage medium and vehicle

By identifying and adjusting sound field conflicts in in-vehicle displays, and prioritizing user intent and content importance, the problem of sound field management in multi-screen environments has been solved. This enables intelligent collaborative control of multiple movable sound sources in the vehicle, improving auditory clarity and immersive experience.

CN121832876APending Publication Date: 2026-04-10GREAT WALL MOTOR CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
GREAT WALL MOTOR CO LTD
Filing Date
2025-12-22
Publication Date
2026-04-10

AI Technical Summary

Technical Problem

In a multi-screen environment, there are conflicts in the sound field management of in-vehicle displays, which leads to a decrease in auditory clarity and immersive experience. In particular, the introduction of movable displays causes changes in the location of the sound source, resulting in a separation between the sound location and the visual image location, creating a noisy auditory environment.

Method used

By acquiring the spatial position of the display screen and the audio playback status, sound field conflicts are identified, priorities are determined based on user intent and content importance, and audio output schemes are adjusted, including sound image localization, volume and frequency band processing, and even display screen position adjustment, to achieve coordinated sound field control.

Benefits of technology

In multi-user, multi-tasking scenarios, it significantly reduces sound field conflicts, improves auditory clarity and immersive experience, and ensures audio-visual consistency and user focus.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN121832876A_ABST
    Figure CN121832876A_ABST
Patent Text Reader

Abstract

The invention provides a sound field cooperative control method, a storage medium and a vehicle, and relates to the technical field of audio processing. The sound field cooperative control method comprises the following steps: acquiring respective spatial position information and audio playing states of a plurality of display screens; determining respective audio output objects of the display screens related to the sound field conflict under the condition of determining the existence of the sound field conflict based on the respective spatial position information and the audio playing state of the plurality of display screens; and determining a sound field cooperative control strategy based on the respective audio output objects of the display screens related to the sound field conflicts so as to adjust the audio output schemes of the display screens related to the sound field conflicts.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] This disclosure relates to the field of audio processing technology, specifically to a sound field collaborative control method, a storage medium, and a vehicle. Background Technology

[0002] With the continuous development of intelligent vehicle systems, in-vehicle entertainment systems have evolved from traditional single central control screens to multi-screen interactive intelligent cockpit environments. In particular, the introduction of movable displays (such as ceiling-mounted screens) has provided passengers with a more flexible audio-visual experience. However, sound field management in multi-screen environments has become a pressing technical challenge. Summary of the Invention

[0003] In view of this, the present disclosure provides a sound field cooperative control method, a storage medium, and a vehicle.

[0004] Firstly, a sound field collaborative control method is provided, applied to multiple movable displays. The sound field collaborative control method includes: acquiring the spatial location information and audio playback status of each of the multiple displays; determining the audio output objects of each display related to the sound field conflict based on the spatial location information and audio playback status of the multiple displays; and determining a sound field collaborative control strategy based on the audio output objects of each display related to the sound field conflict, so as to adjust the audio output scheme of the displays related to the sound field conflict.

[0005] The aforementioned sound field collaborative control method, when sound field conflicts exist within a space, identifies the audio output objects of the displays involved in the conflict and executes differentiated sound field collaborative control strategies based on the similarities and differences of these audio output objects. This effectively distinguishes and handles content competition among multiple screens serving the same user or cross-interference between sound fields serving different users, thereby significantly reducing sound field conflicts among multiple displays. Overall, it achieves intelligent collaborative management of multiple independent and movable sound sources within a limited space, improving auditory clarity and immersive experience in multi-user, multi-task scenarios.

[0006] In conjunction with the first aspect, in some implementations of the first aspect, the sound field collaborative control method further includes: if the spatial distance between at least two displays is less than a first distance threshold, and at least two displays are playing audio, then a sound field conflict is determined; and / or, based on the spatial position information of each of the multiple displays, the relative distances between the multiple displays and the target user are determined respectively; if the relative distances corresponding to at least two displays are both less than a second distance threshold, and at least two displays are playing audio, then a sound field conflict is determined.

[0007] The aforementioned sound field collaborative control method uses a multi-dimensional sound field conflict judgment mechanism to determine the existence of sound field conflicts from both objective acoustic and subjective user perception perspectives. This multi-dimensional judgment mechanism ensures the comprehensiveness and reliability of sound field conflict identification, providing a foundation for accurate sound field collaborative control.

[0008] In conjunction with the first aspect, in some implementations of the first aspect, a sound field collaborative control strategy is determined based on the audio output objects of the respective displays related to sound field conflicts, including: determining the priority of the displays related to sound field conflicts when the respective audio output objects of the displays related to sound field conflicts are the same user; determining at least one display related to sound field conflicts as the target display based on the priority; and adjusting the audio output scheme of the target display.

[0009] The aforementioned sound field collaborative control method prioritizes multiple display screens serving the same user that are related to sound field conflicts based on user intent and content importance. It intelligently selects the target display screens that need to be adjusted according to the priority and performs targeted processing on the spectrum, volume, etc. of the target display screens. This actively shapes the user's auditory perception, physically weakens or isolates secondary sound sources, and psychologically strengthens the user's attention focus, thereby ensuring the clarity and immersion of the user's core content.

[0010] In conjunction with the first aspect, in some implementations of the first aspect, the target display screen includes a display screen that is not of the highest priority, and the audio output scheme of the target display screen is adjusted, including at least one of the following: adjusting the sound image of the target display screen to the spatial position of the target display screen; determining the frequency band in the audio of the target display screen that overlaps with the audio of the highest priority display screen, and adjusting the frequency or volume of the frequency band; reducing the audio volume of the target display screen.

[0011] The aforementioned sound field collaborative control method lists various ways to adjust audio output schemes, achieving comprehensive control from psychoacoustics to physical acoustics. Ultimately, it enables users to focus their auditory attention on the audio content of the highest priority display screen, obtaining a clear and distinct auditory experience in a multi-sound-source competitive environment.

[0012] In conjunction with the first aspect, in certain implementations of the first aspect, determining the priority of the display screens related to sound field conflicts includes: acquiring the target user's operation information or viewing status information, and determining the priority based on the operation information or viewing status information, wherein the operation information represents the priority order specified by the target user, and the viewing status information represents the display screen that the target user is currently focusing on; and / or, determining the relative position information between the target user and the display screens related to sound field conflicts, and determining the priority based on the relative position information; and / or, determining the priority based on the type of content played by the display screens related to sound field conflicts.

[0013] The aforementioned sound field collaborative control method, based on user-initiated designation or real-time eye-tracking, enables priority determination to directly reflect the user's immediate intent and attention, thus improving the method's flexibility. Prioritization based on objective spatial geometric relationships provides a stable and predictable objective priority determination benchmark independent of user input, enhancing the method's autonomous decision-making capability. Prioritization based on predefined content importance rules ensures that critical audio related to core functions such as driving safety is prioritized under all circumstances, improving the method's functional safety. The combination of these three elements constitutes a multi-layered priority decision-making method that considers user intent, objective scenarios, and safety regulations, thereby improving the intelligence and reliability of the sound field collaborative control strategy.

[0014] In conjunction with the first aspect, in some implementations of the first aspect, a sound field collaborative control strategy is determined based on the respective audio output objects of the displays related to the sound field conflict, including: when the respective audio output objects of the displays related to the sound field conflict are the same user, if the audio of the displays related to the sound field conflict is related, then the audio of the displays related to the sound field conflict is fused.

[0015] The aforementioned sound field collaborative control method, after determining that the audio of each display screen related to sound field conflict has a correlation, performs audio fusion processing on the correlated audio, and intelligently integrates and recreates the associated audio from multiple display screens to generate a sound field with better spatial sense, layering sense and information integrity.

[0016] In conjunction with the first aspect, in some implementations of the first aspect, a sound field collaborative control strategy is determined based on the respective audio output objects of the sound field conflict-related displays, including: adjusting the spatial position of at least one sound field conflict-related display when the respective audio output objects of the sound field conflict-related displays are different users; and / or, for a target user, suppressing audio interference from sound field conflict-related displays corresponding to other users, and enhancing the projection of audio from the sound field conflict-related displays corresponding to the target user to the target user.

[0017] The aforementioned sound field collaborative control method provides a systematic solution from physical to acoustic to address sound field conflicts serving different users, enabling adjacent users to enjoy their respective audio content without interference, and significantly improving the audiovisual experience in multi-user scenarios.

[0018] In conjunction with the first aspect, in some implementations of the first aspect, the sound field collaborative control method further includes: acquiring user state information, which includes the user's seating position and / or the user's line of sight focus; if, based on the user state information, spatial location information, and audio playback status, it is determined that the potential audio output object of at least two displays is the same user, then a sound field conflict is determined to exist.

[0019] The embodiments disclosed herein can identify the risk of sound field conflict earlier from the user's perspective, and are especially suitable for scenarios where the screen distribution is relatively scattered but the sound field coverage overlaps, or where the user's attention is attracted by multiple contents, thereby further improving the level of intelligence and user experience.

[0020] In conjunction with the first aspect, in some implementations of the first aspect, the display screen is a vehicle-mounted ceiling screen.

[0021] In related technologies, in-vehicle audio systems primarily address scenarios with fixed sound sources or moving listeners, while the mobility of in-vehicle ceiling-mounted screens increases the complexity of sound field processing. The aforementioned sound field collaborative control method focuses on the movement of the sound source itself, which can improve the audiovisual experience for in-vehicle users.

[0022] In a second aspect, a computer-readable storage medium is provided, on which a computer program is stored, wherein when the computer program is executed by a processor, the sound field cooperative control method provided in the first aspect is implemented.

[0023] Thirdly, a vehicle is provided, comprising: a movable display screen; a processor; and a memory for storing executable instructions of the processor; wherein the processor is configured to execute the sound field cooperative control method provided in the first aspect by executing the executable instructions. Attached Figure Description

[0024] To more clearly illustrate the technical solutions in this disclosure or related technologies, the accompanying drawings used in the description of the embodiments or related technologies will be briefly introduced below. Obviously, the accompanying drawings described below are only embodiments of this disclosure. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0025] Figure 1 The diagram shown illustrates a scenario applicable to an embodiment of this disclosure.

[0026] Figure 2 The diagram shown is a schematic flowchart of a sound field collaborative control method provided in an embodiment of this disclosure.

[0027] Figure 3 The diagram shown is a schematic flowchart of a sound field collaborative control method provided in another embodiment of this disclosure.

[0028] Figure 4 The diagram shown is a flowchart illustrating the steps of determining a sound field collaborative control strategy based on the respective audio output objects of the displays related to sound field conflicts, according to an embodiment of this disclosure.

[0029] Figure 5 The diagram shown is a flowchart illustrating the steps for adjusting the audio output scheme of a target display screen according to an embodiment of this disclosure.

[0030] Figure 6 The diagram shown is a flowchart illustrating the steps for determining the priority of a display screen related to sound field conflicts according to an embodiment of this disclosure.

[0031] Figure 7 The diagram shown is a flowchart illustrating the steps of determining a sound field collaborative control strategy based on the respective audio output objects of the displays related to sound field conflicts, according to another embodiment of this disclosure.

[0032] Figure 8 The diagram shown is a structural schematic of a sound field cooperative control device provided in an embodiment of this disclosure.

[0033] Figure 9 The diagram shown is a structural schematic of a vehicle provided in an exemplary embodiment of this disclosure. Detailed Implementation

[0034] The technical solutions of the embodiments of this disclosure will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this disclosure, and not all embodiments. Based on the embodiments of this disclosure, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this disclosure.

[0035] With the rapid development of the automotive industry, vehicles are no longer just a means of transportation, but also a third space in people's lives, making the comfort of the ride increasingly important. The form and layout of in-vehicle displays are becoming increasingly diverse. In addition to traditional fixed center console screens and instrument panels, flexible and movable displays are gradually becoming an important feature for enhancing the user experience.

[0036] In-vehicle portable displays, such as ceiling-mounted displays (also known as roof-mounted screens or vehicle-mounted hanging screens), are multimedia display devices installed on sliding rails in the vehicle's roof. Their position can be adjusted according to user needs, providing a flexible and independent audio-visual entertainment interface. Ceiling-mounted displays typically have built-in speakers or are bundled with an audio module that moves with them to achieve synchronized audio-visual output.

[0037] However, the introduction of movable displays also brings new acoustic challenges. For example, when the display moves, the physical location of the sound source changes. If the audio system still treats it as a fixed speaker, the sound's location will be separated from the visual image's location, causing a misalignment of audiovisual perception. Alternatively, when multiple displays in the vehicle (such as the central control screen, movable displays, etc.) play different content simultaneously, the sound fields overlap and interfere with each other, creating a noisy auditory environment that makes it difficult for users to clearly hear the content they need.

[0038] Therefore, how to achieve intelligent sound field coordination among multiple displays, ensure audio-visual consistency and avoid interference has become a key technical issue in improving the in-vehicle multi-screen experience.

[0039] Figure 1 The diagram illustrates a scenario applicable to an embodiment of this disclosure. Figure 1 As shown, the scenario includes an in-vehicle environment. The in-vehicle environment includes multiple displays 110, an audio processing module 120, and a sensing module 130. The components interact with each other and transmit commands via an in-vehicle bus or a dedicated communication link.

[0040] The display screen 110 includes a movable display screen, or a fixed central control screen, passenger screen, etc. Each display screen 110 reports its content status (whether it is playing audio) and the audio attributes of the currently playing content (such as video dialogue, music, game sound effects, navigation prompts, etc.) to the audio processing module 120.

[0041] The movable display screen has a built-in speaker, or is physically / wirelessly attached to a dedicated speaker that moves with it. Each movable display screen has a position sensor on its mounting rail to monitor its spatial position within the cabin in real time.

[0042] The audio processing module 120 is the core processing unit for in-vehicle audio. The audio processing module 120 can receive spatial position information from each display screen 110, and based on this information, dynamically calculate and adjust the sound image, delay, and gain of the audio signal from each display screen's speaker. Regardless of where the movable display screen is positioned within the vehicle cabin, the aforementioned audio processing ensures that the sound source perceived by the user remains consistent with the center position of the display screen as visually observed.

[0043] The audio processing module 120 includes a dynamic sound field modeling unit for real-time calculation of volume attenuation and potential interference area from each sound source (display screen) to each user. If multiple sound sources have sound field conflicts, the audio processing module 120 can also execute the sound field collaborative control method provided in this embodiment to avoid creating a noisy auditory environment when multiple displays 110 in the vehicle simultaneously play different content, thereby improving the user's audiovisual experience.

[0044] The perception module 130 is responsible for acquiring the status information of the user inside the vehicle, and typically includes cameras, infrared sensors, etc. deployed in the vehicle cabin. The perception module 130 can determine which display screen 110 the user is currently actively viewing by recognizing information such as the user's head position, facial orientation, and gaze focus.

[0045] After briefly introducing the exemplary application scenario of Embodiment 1 of this disclosure, the following will be combined with... Figures 2 to 7 The sound field collaborative control method provided in the embodiments of this disclosure is described in detail.

[0046] Figure 2 The diagram shown is a schematic flowchart of a sound field collaborative control method provided in an embodiment of this disclosure. The sound field collaborative control method is applied to multiple movable displays. Each display includes a screen and a speaker. The screen is used to output video content and may have touch functionality to provide a human-computer interaction interface. The speaker is used to play audio corresponding to the content on the screen. The speaker may be built into the display or bound to the display via wired / wireless means and move synchronously with it to form an integrated audio-visual output unit.

[0047] In some embodiments, the display screen is a vehicle-mounted ceiling screen. A vehicle-mounted ceiling screen refers to a suspended display device installed on the ceiling of the vehicle cabin, which can typically move along a preset sliding rail. The vehicle-mounted ceiling screen can be flexibly adjusted in position according to passenger needs, mainly providing independent audio-visual entertainment interfaces for passengers in the second and third rows.

[0048] like Figure 2 As shown in the embodiments of this disclosure, the sound field cooperative control method includes the following steps.

[0049] S210 acquires the spatial location information of each of the multiple displays and the audio playback status.

[0050] The spatial position information of the display screen represents its real-time spatial position and can be represented by three-dimensional coordinates. This spatial position information can be acquired by position sensors mounted on the display screen or its moving mechanism.

[0051] The audio playback status of the display screen refers to the current status parameters of the display screen related to audio output. It includes at least an active status flag indicating whether the display screen is playing audio, and may further include the content attribute type of the currently played audio, such as movie, music, game sound effects, navigation prompts, voice calls, etc.

[0052] S220, based on the spatial location information of each of the multiple displays and the audio playback status, determines the audio output object of each display related to the sound field conflict if a sound field conflict is determined.

[0053] When at least two displays emit sound simultaneously in a confined space (such as a car cabin), the sound waves generated by each display will overlap and interfere with each other, creating sound field conflicts, which will negatively affect the user's hearing clarity, sound positioning accuracy, or auditory comfort.

[0054] To avoid this situation, it is first necessary to determine whether a sound field conflict exists based on the sound field conflict judgment logic. Specifically, if the sound fields of at least two displays may interfere with each other, then a sound field conflict is determined to exist, and the displays whose sound fields are interfering with each other are identified as the displays related to the sound field conflict.

[0055] After determining that a conflict exists, the audio output target for each display screen associated with the sound field conflict is further determined. The audio output target refers to the specific user to whom the audio played on the display screen is intended to serve or is primarily directed. The audio output target can be determined by the perception module mentioned in the above embodiments. For example, the user's gaze focus or head orientation can be identified by sensors such as cameras and infrared sensors, and the correspondence between the user and the display screen can be determined based on the user's gaze focus or head orientation. For example, if the user continues to gaze at the display screen associated with the sound field conflict, then the audio output target of that display screen associated with the sound field conflict is determined to be that user.

[0056] Understandably, a confined space can include multiple users. Multiple users can all be the audio output target of a single display screen, or a single user can simultaneously be the audio output target of multiple displays. For example, the confined space includes display screen 1 and display screen 2, which experience sound field conflict. Additionally, the confined space includes user A and user B. In one possible scenario, display screen 1 outputs audio to user A, and display screen 2 outputs audio to user B. In this case, the sound field conflict manifests as mutual interference caused by sound sources serving different users being too close in physical space. Alternatively, in another possible scenario, both display screen 1 and display screen 2 output audio to user A. In this case, the sound field conflict manifests as mutual interference caused by the overlapping sound fields of the two displays serving the same user.

[0057] S230, a sound field coordination control strategy is determined based on the audio output objects of the displays related to sound field conflicts, so as to adjust the audio output scheme of the displays related to sound field conflicts.

[0058] The above lists two manifestations of sound field conflict. Different sound field collaborative control strategies can be formulated for different manifestations. Sound field collaborative control strategies are a series of processing rules designed to eliminate or mitigate sound field conflict.

[0059] The core of the sound field collaborative control strategy is based on the relationship between the audio output objects of the display screens related to sound field conflicts (e.g., whether they serve the same user or different users), and selects different processing modes accordingly.

[0060] When display screens with conflicting sound fields serve the same user, the fundamental contradiction lies in allocating the user's limited auditory attention among multiple competing sound sources. Therefore, by analyzing user intent and content importance, we can assist users in allocating their attention, prioritizing auditory resources towards the display screens they are most likely to focus on or that are most important to them. For example, continuing the previous example, display screen 1 is playing navigation prompts, display screen 2 is playing music, and user A is the driver. When there is a sound field conflict between display screens 1 and 2, user A should pay more attention to the navigation prompts on display screen 1. Therefore, the volume of display screen 1 can be appropriately increased while the volume of display screen 2 is decreased, so that user A's attention is directed towards the navigation prompts on display screen 1.

[0061] When sound field conflicting displays serve different users, the fundamental contradiction lies in the energy superposition and crosstalk generated by different independent sound fields within a limited physical space. Therefore, the sound field collaborative control strategy is not a strategy for allocating user attention, but rather an acoustically independent environment for each user. For example, continuing the previous example, active noise cancellation can reduce the interference of display 2's audio on user A, and the interference of display 1's audio on user B.

[0062] After determining the sound field collaborative control strategy, the audio output scheme of the display screen related to sound field conflicts is adjusted based on the sound field collaborative control strategy. The audio output scheme includes the display screen's sound image localization parameters, channel gain, equalization of specific frequency bands, dynamic range control parameters, etc.

[0063] Furthermore, due to the inherent mobility of the displays, sound field coordination control strategies for addressing sound field conflicts, in addition to the aforementioned processing of the audio signals themselves, can also directly adjust the layout of the displays involved in the sound field conflict in physical space. For example, at least one of the displays involved in the sound field conflict can be moved along its slide rail to a new position away from other displays or with less interference to the user, thereby reducing or eliminating sound field overlap at its source. Accordingly, as the displays move, their audio output scheme will also be dynamically and in real-time adjusted according to their spatial position. Specifically, when the spatial position of the displays changes, the audio processing module will generate audio output parameters that match the updated spatial position information. This process ensures that no matter where the displays move, the sound they emit can be perceived by the listener as stably originating from the visual center of the displays, i.e., maintaining high-precision audio-visual synchronization, thereby maintaining an immersive and consistent audiovisual experience in dynamic environments.

[0064] In this embodiment, when sound field conflicts exist within a space, the audio output objects of the displays related to the sound field conflict are identified, and differentiated sound field collaborative control strategies are executed based on the similarities and differences of the audio output objects. This effectively distinguishes and handles content competition among multiple screens serving the same user or cross-interference of sound fields serving different users, thereby significantly reducing sound field conflicts among multiple displays. Overall, it achieves intelligent collaborative management of multiple independent and movable sound sources within a limited space, improving auditory clarity and immersive experience in multi-user, multi-task scenarios.

[0065] The following section will introduce the specific implementation methods for determining whether there are sound field conflicts within a space.

[0066] Figure 3 The diagram shown is a schematic flowchart of a sound field cooperative control method provided in another embodiment of this disclosure. Figure 2 Extending from the illustrated embodiment Figure 3 The illustrated embodiment will be described in detail below. Figure 3 The illustrated embodiments and Figure 2 The differences between the embodiments shown are not repeated here, and the similarities are not repeated here.

[0067] like Figure 3 As shown in the embodiments of this disclosure, the sound field cooperative control method further includes the following steps.

[0068] S310, if the spatial distance between at least two displays is less than a first distance threshold, and at least two displays are playing audio, then a sound field conflict is determined to exist.

[0069] As described in the above embodiments, it is possible to determine whether there is a sound field conflict based on the spatial position information of each of the multiple displays and the audio playback status.

[0070] Specifically, based on spatial location information, the relative positional relationships between multiple displays can be determined. For any two displays, the spatial distance between them is calculated, while the audio playback status of each display is monitored. When the spatial distance between at least two displays is less than a first distance threshold, and the audio playback status of these displays is all active, it is determined that there is a sound field conflict between these displays.

[0071] The first distance threshold is set based on acoustic principles and experimental data. It is used to determine whether the sound waves emitted by the two displays are significantly superimposed and interfered due to their physical proximity, which may cause interference. The first distance threshold can be a fixed value or dynamically adjusted according to factors such as spatial models. This disclosure does not impose specific restrictions on it.

[0072] It is evident that this determination method focuses on the objective condition of the density of the physical distribution of sound sources to determine potential sound field interference problems.

[0073] S320 determines the relative distance between each display screen and the target user based on the spatial location information of each display screen.

[0074] Here, the target user refers to any user within the space, and the spatial location of the target user can be determined based on the sensing module. After determining the spatial location of the target user, the relative distances between the multiple displays and the target user are calculated based on the spatial location information of each display.

[0075] If there are multiple users in the space, the relative distance between each user and the multiple displays can be calculated separately, and the following steps can be performed for each user to determine whether sound field conflict exists.

[0076] S330, if the relative distance between at least two displays is less than the second distance threshold, and at least two displays are playing audio, then a sound field conflict is determined to exist.

[0077] If at least two displays are located at a relative distance of less than the second distance threshold from the target user, and the audio playback status of these displays is "playing audio", then a sound field conflict is determined to exist.

[0078] The second distance threshold is used to define the sound field range centered on the target user. When multiple sound sources enter this range, they are considered to compete for the target user's auditory attention or cause perceptual interference. The second distance threshold can be a fixed value or dynamically adjusted based on factors such as spatial models; this disclosure does not impose specific limitations on it.

[0079] It is evident that this judgment method focuses on the user's listening perspective to determine whether multiple sound sources simultaneously intrude into their effective auditory space, which may lead to a decrease in the user's auditory clarity.

[0080] In this embodiment, a multi-dimensional sound field conflict judgment method is used to determine whether a sound field conflict exists from both an objective acoustic level and a user's subjective perception level. This multi-dimensional judgment mechanism ensures the comprehensiveness and reliability of sound field conflict identification, providing a foundation for precise sound field collaborative control.

[0081] In some other possible implementations, the existence of sound field conflicts can also be determined based on user state information.

[0082] Specifically, in some embodiments, the sound field collaborative control method further includes: acquiring user state information; if, based on the user state information, spatial location information, and audio playback state, it is determined that the potential audio output object of at least two displays is the same user, then it is determined that there is a sound field conflict combination.

[0083] The user status information includes the user's seating position. The user's seating position includes the spatial coordinates of all users inside the vehicle. This can be achieved through visual positioning using in-vehicle cameras or by determining the specific seat assignment through seat pressure sensors, and then linking it to their preset coordinates.

[0084] If the display is determined to be playing audio based on its audio playback status, then the effective listening area of ​​that display is identified. The effective listening area is compared to the position of the user inside the vehicle. If the user's position falls within the effective listening area of ​​a certain screen, that user is identified as a potential audio output target for that display. If the potential audio output targets for the same display are the same user, then a sound field conflict is identified.

[0085] Alternatively, user status information may include the user's gaze focus. The user's gaze focus refers to the direction of the user's visual attention, which can be collected and analyzed by sensors such as in-vehicle cameras and infrared eye trackers.

[0086] If, based on the user's gaze focus, it is determined that the same user's gaze focuses on multiple displays playing audio or cannot be stably focused on a single display, it can be concluded that all of these displays are likely the objects the user intends to listen to; that is, the potential audio output targets of these displays are all the same user. In this case, a sound field conflict is determined to exist.

[0087] This means that even if the physical distance between these displays may not meet the condition of being too close, their sounds will inevitably overlap and compete with the user's because they are all directed at the same listener in terms of spatial acoustics or user attention.

[0088] The embodiments disclosed herein can identify the risk of sound field conflict earlier from the user's perspective, before the sound waves actually produce significant physical interference. This is especially suitable for scenarios where the screen is scattered but the sound field coverage overlaps, or where the user's attention is attracted by multiple contents, thereby further improving the level of intelligence and user experience.

[0089] The above describes the mechanism for determining sound field conflicts. The following section will further explain how to determine the sound field collaborative control strategy.

[0090] Figure 4 The diagram shown is a flowchart illustrating the steps of determining a sound field collaborative control strategy based on the respective audio output objects of the displays according to a sound field conflict correlation, as provided in an embodiment of this disclosure. Figure 2Extending from the illustrated embodiment Figure 4 The illustrated embodiment will be described in detail below. Figure 4 The illustrated embodiments and Figure 2 The differences between the embodiments shown are not repeated here, and the similarities are not repeated here.

[0091] like Figure 4 As shown in this embodiment, the step of determining the sound field cooperative control strategy based on the respective audio output objects of the displays related to sound field conflicts includes the following steps.

[0092] S410 determines the priority of displays involved in sound field conflicts when their respective audio output targets are the same user.

[0093] Priority represents a hierarchy of importance or resource priority for audio output content. Priority is used to arbitrate multiple competing sound sources within the same user's auditory space, determining which one or more sources should be prioritized.

[0094] When sound field conflicts exist, and it is determined that the audio output targets of the displays related to the sound field conflicts are the same user, a priority level is calculated and assigned to each display related to the sound field conflicts according to one or more preset, configurable priority rules. For example, the priority rules can be determined based on the location of the display, the type of content being played on the display, the user's level of attention, user preference settings, etc., and this disclosure does not impose specific limitations in this regard.

[0095] S420, based on priority, identifies at least one display screen related to sound field conflict as the target display screen.

[0096] After obtaining the priority ranking of each display screen, one or more display screens among those involved in the sound field conflict are identified as target display screens based on the control objectives of the collaborative control strategy. The selection of target display screens is related to the control objectives.

[0097] For example, the control objective is to ensure that the content displayed on the highest priority display screen is clearly understandable. Under this control objective, all other relevant displays besides the highest priority display screen can be identified as target displays.

[0098] Alternatively, the control objective is to mitigate sound field conflicts while minimizing the impact on the overall user experience. Under this objective, the display screen with the highest perceived loudness (excluding the highest priority display screen) can be identified as the target display screen. This allows for the precise location of the sound source that most interferes with the highest priority display screen, thus mitigating sound field conflicts with minimal adjustments.

[0099] S430 adjusts the audio output scheme for the target display screen.

[0100] After determining the target display screen, the audio output scheme of the target display screen is adjusted accordingly based on the control objective of the collaborative control strategy to ensure that the user can clearly listen to the audio content of the high-priority display screen, thereby improving the user's listening clarity and auditory comfort.

[0101] In this embodiment of the disclosure, for multiple display screens serving the same user with sound field conflicting related, priority is determined based on user intent and content importance. The target display screen that needs to be adjusted is intelligently selected according to the priority, and the spectrum, volume, etc. of the target display screen are processed in a targeted manner. This actively shapes the user's auditory perception, physically weakens or isolates secondary sound sources, and psychologically strengthens the user's attention focus, thereby ensuring the clarity and immersion of the user's core content.

[0102] The following section details the adjustment scheme for the audio output of the target display screen.

[0103] Figure 5 The diagram shown illustrates the steps for adjusting the audio output scheme of a target display screen according to an embodiment of this disclosure. Figure 4 Extending from the illustrated embodiment Figure 5 The illustrated embodiment will be described in detail below. Figure 5 The illustrated embodiments and Figure 4 The differences between the embodiments shown are not repeated here, and the similarities are not repeated here.

[0104] like Figure 5 As shown in this embodiment of the disclosure, the target display screen includes a display screen that is not the highest priority, and the audio output scheme of the target display screen is adjusted, including at least one of the following.

[0105] S510 adjusts the audio-visual image of the target display screen to the spatial position of the target display screen.

[0106] Sound image refers to the location or spatial position of the sound source as subjectively perceived by the user. It is the virtual sound source localization created by a stereo or surround sound audio system by controlling parameters such as the signal strength difference and time difference between different speakers.

[0107] By adjusting the acoustic image of the target display screen to its spatial location, the user's auditory perception locates the sound source of the target display screen to its own physical location. Utilizing the cocktail party effect of the human ear, when two competing sound sources are significantly separated in spatial orientation, the user's brain can more easily selectively focus on the sound from the display screen that has the highest priority, while secondary sounds from other directions are perceived as background, thus improving the differentiation between primary and secondary sound sources at the psychoacoustic level.

[0108] S520 identifies the frequency band in the target display's audio that overlaps with the audio of the highest priority display, and adjusts the frequency or volume of the frequency band.

[0109] By performing real-time or near-real-time frequency domain analysis on the audio signals of the highest priority display screen and the target display screen, key overlapping frequency bands that may mask each other's energy are identified as the audio overlap frequency bands.

[0110] Subsequently, processing instructions for the audio signal targeting the display screen are generated. A dynamic equalizer or multi-band compressor is used to reduce the frequency or volume of overlapping audio bands, with the attenuation amount adaptively adjusted based on the real-time energy ratio of the two signals. In the frequency dimension, spectral channels are cleared for high-priority audio content, effectively reducing spectral masking interference from secondary audio content.

[0111] S530, reduce the audio volume of the target display.

[0112] The above processing method requires first identifying overlapping audio frequency bands, which involves complex algorithms and slow response times. Therefore, directly reducing the audio volume of the target display screen can achieve a faster response. Furthermore, its effect is deterministic and predictable, independent of the instantaneous spectral characteristics of the audio content, thus exhibiting high stability and reliability.

[0113] The volume reduction can be a preset fixed value or an adaptive value dynamically calculated based on the audio loudness of the highest-priority display, ambient noise level, or user distance. This method weakens the prominence of the target display's sound overall, making it easier for the user's auditory attention to ignore, thereby ensuring the perceptual dominance of the highest-priority display.

[0114] Optionally, after adjusting the audio output scheme, a prompt message, such as "The sound has been optimized to avoid interference," can be displayed on the corresponding screen to inform the user of the current status of the screen and improve the user experience.

[0115] This disclosure describes various ways to adjust the audio output scheme, achieving comprehensive control from psychoacoustics to physical acoustics, ultimately enabling users to focus their auditory attention on the audio content of the highest priority display screen, and obtain a clear and distinct auditory experience in a multi-sound-source competitive environment.

[0116] In other embodiments, the target display screen can also be the highest priority display screen. For the highest priority display screen, it is first necessary to maintain its complete frequency response, dynamic range, and accurate sound image localization to ensure that its sound quality and sound image consistency are not affected. In this case, the current audio output scheme of the highest priority display screen is kept unchanged, and the audio output schemes of other displays are adjusted appropriately to create a cleaner acoustic environment for it. Alternatively, the audio volume of the highest priority display screen can be appropriately increased to further enhance the loudness and intelligibility of its content for the user, ensuring that key information (such as navigation instructions and emergency warnings) can be clearly perceived.

[0117] The following section will introduce the specific implementation method for determining the priority of displays related to sound field conflicts.

[0118] Figure 6 The diagram shown is a flowchart illustrating the steps for determining the priority of a display screen related to sound field conflicts according to an embodiment of this disclosure. Figure 4 Extending from the illustrated embodiment Figure 6 The illustrated embodiment will be described in detail below. Figure 6 The illustrated embodiments and Figure 4 The differences between the embodiments shown are not repeated here, and the similarities are not repeated here.

[0119] like Figure 6 As shown in this embodiment, the step of determining the priority of the display screen related to sound field conflict includes the following steps.

[0120] S610: Obtain the target user's operation information or viewing status information, and determine the priority based on the operation information or viewing status information.

[0121] The target user is the audio output object of the display screen related to the sound field conflict. The operation information represents the priority order specified by the target user. For example, the target user can actively select a display screen as the highest priority display screen through the display screen, voice commands, etc., and determine other display screens related to the sound field conflict as the non-highest priority display screens.

[0122] Viewing status information characterizes the display screen that the target user is currently focusing on. This viewing status information can be collected and analyzed by a perception module within the vehicle. For example, using eye-tracking or head pose estimation methods, the display screen corresponding to the target user's gaze focus is identified based on the viewing status information, and this display screen is designated as the highest priority display screen. Other display screens related to sound field conflicts are designated as lower priority display screens.

[0123] S620 determines the relative position information of the target user and the display screen related to the sound field conflict, and determines the priority based on the relative position information.

[0124] First, the real-time position of the target user is determined by the sensing module or seat sensor, and the relative position information between the target user and the display screens related to each sound field conflict is calculated based on the spatial position information of each display screen related to each sound field conflict.

[0125] Then, priorities are determined based on relative position information. For example, the display screen closest to the target user is given the highest priority based on relative position information. Alternatively, the display screen directly in front of the user is given the highest priority.

[0126] The S630 prioritizes content played on the display screen based on the type of content that is related to sound field conflicts.

[0127] The content type played on the display screen refers to the semantic or functional category of the audio currently being played on the display screen. As mentioned in the above embodiments, the content type may include video dialogue, music, game sound effects, navigation prompts, emergency warnings, etc.

[0128] A mapping relationship between content type and priority can be pre-set. When sound field conflicts occur, the priority of each display screen is determined based on this mapping relationship. For example, the mapping relationship between content type and priority can be set as follows: emergency warning > call > navigation prompt sound > video dialogue > game sound effects > music.

[0129] In this embodiment, prioritization based on user-initiated designation or real-time gaze attention directly reflects the user's immediate intent and attention, improving the method's flexibility. Prioritization based on objective spatial geometric relationships provides a stable and predictable objective priority determination benchmark independent of user input, enhancing the method's autonomous decision-making capability. Prioritization based on predefined content importance rules ensures that critical audio related to core functions such as driving safety is prioritized under all circumstances, improving the method's functional safety. These three elements work together to form a multi-layered priority decision-making method that considers user intent, objective scenarios, and safety regulations, thereby improving the intelligence and reliability of the sound field collaborative control strategy.

[0130] The above embodiments primarily describe how, when multiple displays with conflicting sound fields serve the same user, secondary displays are selectively adjusted according to their priorities to ensure the clarity of the highest-priority display. However, the collaborative control strategy is not limited to the above mode. For example, the content played on multiple displays may be related; for instance, multiple displays may play the images and audio of different participants in a video conference, or multiple displays may collaboratively display different perspectives of the same multimedia content. If the processing scheme provided in the above embodiments is followed, the complete auditory information may be fragmented, failing to meet the user's need for a holistic and collaborative perception of related content.

[0131] To avoid the above problems, the present disclosure provides the following solutions.

[0132] In some embodiments, determining a sound field collaborative control strategy based on the respective audio output objects of the displays with sound field conflicts further includes: if the respective audio output objects of the displays with sound field conflicts belong to the same user, and if the audio of the displays with sound field conflicts is related, then the audio of the displays with sound field conflicts is fused.

[0133] The audio content of multiple displays involved in sound field conflict is correlated, meaning that the audio content played on these displays has an inherent connection or complementarity in terms of semantics, context, or signal source, collectively forming a more complete or better auditory experience. For example, multiple displays may show the images and corresponding audio of different participants in a video conference, or multiple displays may collaboratively play different perspectives and dialogues of the same film.

[0134] After determining the correlation between the audio from each display screen involved in the sound field conflict, audio fusion processing is performed on the correlated audio. Audio fusion is a collaborative audio processing method whose purpose is not to suppress or isolate a sound source, but to intelligently integrate and recreate the associated audio from multiple displays to generate a sound field with superior spatial sense, layering, and information integrity.

[0135] The above embodiments resolve sound field conflicts caused by multiple displays serving the same user. When the displays involved in the sound field conflict serve different users, the problem transforms into crosstalk between different independent sound fields within a shared physical space. To address these different conflicts, this disclosure provides another collaborative control strategy, specifically implemented as follows.

[0136] Figure 7 The diagram shown is a flowchart illustrating the steps for determining a sound field collaborative control strategy based on the respective audio output objects of the displays related to sound field conflicts, according to another embodiment of this disclosure. Figure 2 Extending from the illustrated embodiment Figure 7 The illustrated embodiment will be described in detail below. Figure 7 The illustrated embodiments and Figure 2 The differences between the embodiments shown are not repeated here, and the similarities are not repeated here.

[0137] like Figure 7 As shown in this embodiment, the step of determining the sound field cooperative control strategy based on the respective audio output objects of the displays related to sound field conflicts includes the following steps.

[0138] When the audio output targets of the displays related to sound field conflict are different users, one of steps S710 and S720 can be executed, or steps S710 and S720 can be executed in combination, which will be described separately below.

[0139] S710, adjusts the spatial position of at least one display screen related to sound field conflict.

[0140] After determining that the sound field conflict involves different users, the feasibility and optimal path for reducing interference by moving the display screen are identified based on the calculation results of the dynamic sound field modeling unit. Based on the calculation results, the spatial position of at least one display screen related to the sound field conflict is adjusted.

[0141] For example, continuing the above example, it is calculated that moving the display screen 1 corresponding to user A 0.5 meters to the left side of the cabin can significantly reduce sound leakage to user B in the adjacent seat. At this time, control the display screen 1 to automatically move 0.5 meters to the left side of the cabin.

[0142] As one possible implementation, before controlling the movement of the display screen, a prompt message can be sent to user A via display screen 1. For example, display screen 1 could display "There is currently sound interference. Do you allow the display screen to move to another location?" If user A confirms within a preset time via touch, voice, or physical buttons, a command is sent to the drive mechanism of display screen 1 to control it to automatically move to the new physical location.

[0143] After adjusting the spatial position of the display screen, it is also necessary to dynamically calculate and adjust the audio output scheme of the displaced display screen based on the new spatial position of the display screen, so that the sound source perceived by the user coincides with the visual center of the display screen, ensuring the consistency between the sound location and the image.

[0144] S720, for the target user, suppresses audio interference from displays related to sound field conflicts of other users, and enhances the projection of audio from displays related to sound field conflicts of the target user onto the target user.

[0145] First, active noise control technology can be used to suppress interfering audio. For example, interfering audio from displays corresponding to sound field conflicts of other users is collected in the target user's listening area (such as the headrest area). A corresponding noise-reduced wave is generated based on the interfering audio and played through the headrest speaker or other speakers. The noise-reduced wave acoustically cancels out the original interfering audio in the target user's listening area, thereby significantly attenuating the interference reaching the target user's ears.

[0146] Secondly, based on successfully suppressing cross-interference, beamforming technology can be used to enhance the audio projection of the target user's corresponding display screen onto the target user, so that the target user can clearly hear the content played on the corresponding display screen.

[0147] For example, continuing the above example, the audio output target of display screen 1 is user A, and the audio output target of display screen 2 is user B. In this case, for user A, the interfering audio leaking from display screen 2 can be collected in user A's listening area, a noise-reduced wave with the opposite phase to the interfering audio can be generated, and played through user A's headrest speaker, thereby canceling the interference from display screen 2 in user A's listening area. Similarly, for user B, the interfering audio leaking from display screen 1 can be collected in user B's listening area, a noise-reduced wave with the opposite phase to the interfering audio can be generated, and played through user B's headrest speaker, thereby canceling the interference from display screen 1 in user B's listening area.

[0148] Next, based on beamforming technology, the audio from display screen 1 is projected onto the location of user A, thereby enhancing the clarity of user A's listening to the audio content on display screen 1. Correspondingly, the audio from display screen 2 is projected onto the location of user B, thereby enhancing the clarity of user B's listening to the audio content on display screen 2.

[0149] In this embodiment of the disclosure, a systematic solution from physical to acoustics is provided to address sound field conflicts serving different users, enabling adjacent users to enjoy their respective audio content without interference, and significantly improving the audiovisual experience in multi-user scenarios.

[0150] The above text combined Figures 1 to 7 The method embodiments of this disclosure have been described in detail below, in conjunction with... Figure 8 The apparatus embodiments of this disclosure are described in detail below. It should be understood that the descriptions of the method embodiments correspond to the descriptions of the apparatus embodiments; therefore, any parts not described in detail can be referred to the foregoing method embodiments.

[0151] Figure 8 The diagram shown is a structural schematic of a sound field cooperative control device according to an embodiment of this disclosure. The sound field cooperative control device is applied to multiple movable displays. Figure 8 As shown, the sound field collaborative control device 800 of this embodiment includes: an acquisition module 810, a first determination module 820 and a second determination module 830.

[0152] The acquisition module 810 is configured to acquire the spatial position information of each of the multiple displays and the audio playback status.

[0153] The first determining module 820 is configured to, based on the spatial location information of the multiple displays and the audio playback status, determine the audio output object of each display related to the sound field conflict if a sound field conflict is determined to exist.

[0154] The second determining module 830 is configured to determine a sound field collaborative control strategy based on the respective audio output objects of the displays related to sound field conflicts, so as to adjust the audio output scheme of the displays related to sound field conflicts.

[0155] In some embodiments, the sound field coordination control device 800 further includes a conflict determination module, configured to determine that a sound field conflict exists if the spatial distance between at least two displays is less than a first distance threshold and at least two displays are playing audio; and / or, determine the relative distance between the multiple displays and the target user based on the spatial location information of the multiple displays respectively; and determine that a sound field conflict exists if the relative distances corresponding to at least two displays are both less than a second distance threshold and at least two displays are playing audio.

[0156] In some embodiments, the second determining module 830 is further configured to: determine the priority of the sound field conflict-related displays when the respective audio output targets of the displays are the same user; determine at least one sound field conflict-related display as a target display based on the priority; and adjust the audio output scheme of the target display.

[0157] In some embodiments, the target display screen includes a display screen that is not the highest priority. The second determining module 830 is further configured to adjust the audio image of the target display screen to the spatial position of the target display screen; determine the frequency band in the audio of the target display screen that overlaps with the audio of the highest priority display screen, and adjust the frequency or volume of the frequency band; and reduce the audio volume of the target display screen.

[0158] In some embodiments, the second determining module 830 is further configured to: acquire operation information or viewing status information of the target user, and determine a priority based on the operation information or viewing status information, wherein the operation information represents the priority order specified by the target user, and the viewing status information represents the display screen that the target user is paying attention to; and / or, determine the relative position information of the display screen related to the sound field conflict of the target user, and determine a priority based on the relative position information; and / or, determine a priority based on the type of content played on the display screen related to the sound field conflict.

[0159] In some embodiments, the second determining module 830 is further configured to, if the audio output objects of the displays related to the sound field conflict are the same user, fuse the audio of the displays related to the sound field conflict if there is a correlation between their respective audio outputs.

[0160] In some embodiments, the second determining module 830 is further configured to, when the audio output targets of the sound field conflict-related displays are different users, adjust the spatial position of at least one display related to the sound field conflict; and / or, for the target user, suppress audio interference from the sound field conflict-related displays corresponding to other users, and enhance the projection of audio from the sound field conflict-related displays corresponding to the target user to the target user.

[0161] In some embodiments, the display screen is a vehicle-mounted ceiling screen.

[0162] Below, for reference Figure 9 To describe a vehicle according to an embodiment of this disclosure. Figure 9 The diagram shown is a structural schematic of a vehicle provided in an exemplary embodiment of this disclosure. Figure 9 As shown, the vehicle 900 includes one or more processors 910, a memory 920, and a movable display screen 930.

[0163] The processor 910 may be a central processing unit (CPU) or other form of processing unit with data processing and / or instruction execution capabilities, and may control other components in the vehicle 900 to perform desired functions.

[0164] The memory 920 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 910 may execute the program instructions to implement the sound field cooperative control methods of the various embodiments of this disclosure described above and / or other desired functions.

[0165] The movable display 930 includes a vehicle-mounted ceiling screen.

[0166] Of course, for the sake of simplicity, Figure 9 Only some of the components of the vehicle 900 relevant to this disclosure are shown in this illustration, omitting components such as buses, input / output interfaces, etc. In addition, the vehicle 900 may include any other suitable components depending on the specific application.

[0167] In addition to the methods and apparatus described above, embodiments of this disclosure may also be computer program products comprising computer program instructions that, when executed by a processor, cause the processor to perform the steps in the sound field cooperative control methods according to various embodiments of this disclosure as described above.

[0168] Computer program products can be written in any combination of one or more programming languages ​​to perform the operations of embodiments of this disclosure. The programming languages ​​include object-oriented programming languages ​​such as Java and C++, as well as conventional procedural programming languages ​​such as C or similar languages. The program code can be executed entirely on a user's computing device, partially on a user's computing device, as a standalone software package, partially on a user's computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0169] Furthermore, embodiments of this disclosure may also be computer-readable storage media storing computer program instructions that, when executed by a processor, cause the processor to perform the steps in the sound field cooperative control method according to various embodiments of this disclosure described above.

[0170] Computer-readable storage media may take the form of any combination of one or more readable media. A readable medium may be a readable signal medium or a readable storage medium. A readable storage medium may, for example, include, but is not limited to, electrical, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any combination thereof. More specific examples of readable storage media (a non-exhaustive list) include: electrical connections having one or more wires, portable disks, hard disks, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.

[0171] The basic principles of this disclosure have been described above with reference to specific embodiments. However, it should be noted that the advantages, benefits, and effects mentioned in this disclosure are merely examples and not limitations, and should not be considered as essential features of each embodiment of this disclosure. Furthermore, the specific details disclosed above are for illustrative and facilitative purposes only, and are not limitations. These details do not limit the scope of this disclosure to the necessity of employing the aforementioned specific details for implementation.

[0172] The block diagrams of devices, apparatuses, devices, and systems disclosed herein are merely illustrative examples and are not intended to require or imply that they must be connected, arranged, or configured in the manner shown in the block diagrams. As those skilled in the art will recognize, these devices, apparatuses, devices, and systems can be connected, arranged, and configured in any manner. Words such as “comprising,” “including,” “having,” etc., are open-ended terms meaning “including but not limited to,” and are used interchangeably with them. The terms “or” and “and” as used herein refer to the terms “and / or,” and are used interchangeably with them unless the context clearly indicates otherwise. The term “such as” as used herein refers to the phrase “such as but not limited to,” and is used interchangeably with it.

[0173] It should also be noted that in the systems, apparatus, and methods of this disclosure, the components or steps can be decomposed and / or recombined. These decompositions and / or recombinations should be considered as equivalent solutions to this disclosure.

[0174] The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use this disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the general principles defined herein may be applied to other aspects without departing from the scope of this disclosure. Therefore, this disclosure is not intended to be limited to the aspects shown herein, but rather to be carried out within the widest scope consistent with the principles and novel features disclosed herein.

[0175] The above description has been given for purposes of illustration and description. Furthermore, this description is not intended to limit the embodiments of this disclosure to the forms disclosed herein. Although numerous exemplary aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, alterations, additions, and sub-combinations thereof.

Claims

1. A method for coordinated sound field control, characterized in that, Applied to multiple movable displays, the method includes: Obtain the spatial position information and audio playback status of each of the multiple display screens; Based on the spatial location information of the multiple displays and the audio playback status, if a sound field conflict is determined, the audio output object of each display related to the sound field conflict is determined. Based on the respective audio output objects of the displays related to the sound field conflict, a sound field collaborative control strategy is determined to adjust the audio output scheme of the displays related to the sound field conflict.

2. The method according to claim 1, characterized in that, Also includes: If the spatial distance between at least two displays is less than a first distance threshold, and both of the at least two displays are playing audio, then a sound field conflict is determined to exist. And / or, Based on the spatial location information of each of the multiple display screens, the relative distances between the multiple display screens and the target user are determined respectively; If the relative distance between at least two displays is less than the second distance threshold, and both displays are playing audio, then a sound field conflict is determined to exist.

3. The method according to claim 1, characterized in that, The determination of a sound field collaborative control strategy based on the respective audio output objects of the displays related to the sound field conflict includes: When the audio output target of each of the displays related to the sound field conflict is the same user, the priority of the displays related to the sound field conflict is determined. Based on the priority, at least one of the sound field conflict-related displays is identified as the target display; The audio output scheme of the target display screen is adjusted.

4. The method according to claim 3, characterized in that, The target display screen includes a display screen that is not the highest priority, and the adjustment of the audio output scheme of the target display screen includes at least one of the following: Adjust the audio-visual image of the target display screen to the spatial position of the target display screen; Identify the frequency band in the audio of the target display that overlaps with the audio of the display with the highest priority, and adjust the frequency or volume of the frequency band. Lower the audio volume of the target display screen.

5. The method according to claim 3, characterized in that, Determining the priority of the display screen related to the sound field conflict includes: Obtain the target user's operation information or viewing status information, and determine the priority based on the operation information or viewing status information, wherein the operation information represents the priority order specified by the target user, and the viewing status information represents the display screen that the target user is currently focusing on; and / or, Determine the relative position information of the target user and the display screen related to the sound field conflict, and determine the priority based on the relative position information; and / or, The priority is determined based on the type of content played on the display screen related to the sound field conflict.

6. The method according to claim 1, characterized in that, The determination of a sound field collaborative control strategy based on the respective audio output objects of the displays related to the sound field conflict includes: If the audio output target of each of the display screens related to the sound field conflict is the same user, and if the audio of each of the display screens related to the sound field conflict is related, then the audio of each of the display screens related to the sound field conflict will be merged.

7. The method according to claim 1, characterized in that, The determination of a sound field collaborative control strategy based on the respective audio output objects of the displays related to the sound field conflict includes: When the audio output targets of the displays related to the sound field conflict are different users, adjust the spatial position of at least one display related to the sound field conflict; and / or, For the target user, audio interference from the sound field conflict-related display screens corresponding to other users is suppressed, and the projection of audio from the sound field conflict-related display screens corresponding to the target user is enhanced to the target user.

8. The method according to claim 1, characterized in that, Also includes: Obtain user status information, which includes the user's seating position and / or the user's line of sight focus; If, based on the user status information, the spatial location information, and the audio playback status, it is determined that the potential audio output target of at least two displays is the same user, then a sound field conflict is determined to exist.

9. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the sound field collaborative control method as described in any one of claims 1 to 8.

10. A vehicle, characterized in that, include: A movable display screen; processor; as well as Memory for storing the executable instructions of the processor; The processor is configured to execute the sound field cooperative control method according to any one of claims 1 to 9 by executing the executable instructions.