Adaptive adjustment method and adaptive adjustment system for vehicle-mounted sound effect

Abstract

The invention provides a self-adaptive adjustment method and system for a vehicle-mounted sound effect. The self-adaptive adjustment method comprises the steps that the content type of currently played content is acquired, and information of passengers in a vehicle is acquired; the passenger information at least comprises the number of passengers and riding position information; determining a target sound orientation corresponding to the target sound field of each passenger based on the content type and the passenger information; and by controlling each loudspeaker in the vehicle-mounted loudspeaking equipment to cooperatively produce sound, constructing a virtual sound source consistent with the corresponding target sound orientation for each passenger. In the mode, the sound field direction is determined based on the playing content type, and automatic adjustment of the vehicle-mounted sound effect can be realized, so that the tedious operation of manually switching the sound effect mode by a user is avoided, the immersion and the use convenience in different content scenes are improved, and the user experience is further improved.

Description

Technical Field

[0001] The present application relates to the field of vehicle control technology, and in particular to an adaptive adjustment method and adaptive adjustment system for vehicle-mounted sound effects. Background Art

[0002] As cars become an essential space for daily travel, entertainment, and leisure, users' expectations for in-car audio experience continue to rise. In different content scenarios, such as listening to music, watching movies, or playing games, users' perception of sound direction, sound field positioning, and immersion vary significantly.

[0003] In the existing technology, some methods require users to manually select sound effect modes to switch scenes. The operation is cumbersome and requires users to have certain audio knowledge, which can easily lead to improper settings and poor experience. Other methods only adjust the sound field based on the passenger's seat information. Although this improves convenience to a certain extent, it ignores the differences in the playback content itself and makes it difficult to effectively distinguish the sound field requirements of scenes such as music, videos, and games. As a result, the sound direction does not match the playback content, affecting the user's sense of immersion and resulting in a poor user experience. Summary of the Invention

[0004] In view of this, the purpose of this application is to provide an adaptive adjustment method and adaptive adjustment system for in-vehicle sound effects. By determining the sound field direction based on the type of content played, automatic adjustment of in-vehicle sound effects can be achieved, thereby avoiding the tedious operation of users manually switching sound effect modes, enhancing the immersion and ease of use in different content scenarios, and thus improving the user experience.

[0005] In a first aspect, the present invention provides a method for adaptively adjusting in-vehicle sound effects, comprising: obtaining the content type of currently playing content and obtaining in-vehicle occupant information; the occupant information includes at least the number of occupants and seating position information; based on the content type and occupant information, determining the target sound orientation corresponding to the target sound field of each occupant; and constructing a virtual sound source consistent with the corresponding target sound orientation for each occupant by controlling each speaker in the in-vehicle sound device to produce sound in coordination.

[0006] In an optional embodiment, the content type includes at least one of an audio type, a video type, and a game type.

[0007] In an optional embodiment, the step of determining the target sound direction corresponding to the target sound field of each occupant based on the content type and occupant information includes: when the content type is an audio type, determining the target sound direction of the occupant as the area directly in front of the occupant's face; when the content type is a video type or a game type, obtaining the display position information carrying the currently playing content, and based on the occupant's sitting position information and its corresponding display area, determining the target sound direction of the occupant as the position of the display area corresponding to the occupant.

[0008] In an optional embodiment, the step of obtaining information about passengers in the vehicle includes: obtaining at least one of the voltage value output by a pressure sensor located under each seat in the vehicle, the seat belt status of the seat belt in the vehicle, and image information sent by a camera in the vehicle; determining the number of passengers and seating position information based on the voltage value and / or seat belt status; determining the posture information of the passengers based on the image information; wherein the passenger information also includes posture information.

[0009] In an optional embodiment, the step of determining the target sound direction of the occupant as the position of the display area corresponding to the occupant based on the occupant's seating position information and its corresponding display area includes: when the display area serving multiple occupants is a single display area, determining the target sound directions corresponding to all occupants as the position corresponding to the single display area; when the display area serving multiple occupants is a plurality of independent or partitioned display areas, for each occupant, determining its corresponding display area according to its seating position information, and determining the target sound direction corresponding to the occupant as the position of the display area corresponding to it.

[0010] In an optional embodiment, the multiple independent or partitioned display areas include at least two of the central control main screen, the co-pilot screen and the rear screen; when the display area serving multiple occupants is a plurality of independent or partitioned display areas, for each occupant, the corresponding display area is determined according to the seating position information, and the target sound direction corresponding to the occupant is determined as the position of the corresponding display area, including: determining the target sound direction corresponding to the main driver's seat occupant as the position of the central control main screen; determining the target sound direction corresponding to the co-pilot seat occupant as the position of the co-pilot screen; and determining the target sound direction corresponding to the rear seat occupant as the position of the rear screen.

[0011] In an optional embodiment, the usage scenarios of the rear screen include a single-screen partition scenario and a dual-screen independent scenario; The step of determining the target sound direction corresponding to the rear seat occupants as the position of the rear screen includes: in a single-screen partition scenario, when the rear screen is divided into at least two display partitions, respectively determining the target sound direction of the rear seat occupants corresponding to each display partition as the position of the display partition center of the display partition; in a dual-screen independent scenario, when the rear row is equipped with two independent rear screens, respectively determining the target sound direction of the rear seat occupants corresponding to each rear screen as the position of the rear screen.

[0012] In an optional embodiment, the method also includes: obtaining the vehicle state of the vehicle; the vehicle state includes a stationary state and a driving state; when the vehicle is in the driving state and the occupant is the main driver's seat occupant, the target sound direction corresponding to the main driver's seat occupant is determined to be directly in front of the main driver's seat occupant's face.

[0013] In an optional embodiment, the step of constructing a virtual sound source for each occupant that is consistent with the target sound orientation corresponding to the occupant by controlling each speaker in the vehicle-mounted sound system to produce sound in a coordinated manner includes: calculating the output parameters corresponding to each speaker based on the target sound orientation; the output parameters include at least one of gain, sound delay, and frequency response curve; and controlling each speaker to produce sound in a coordinated manner based on the output parameters to construct the virtual sound source.

[0014] In a second aspect, the present invention provides an adaptive adjustment system for vehicle-mounted sound effects, comprising: an information acquisition module for acquiring the content type of the currently playing content and acquiring the passenger information in the vehicle; the passenger information includes at least the number of passengers and the seating position information; a target sound orientation determination module for determining the target sound orientation corresponding to the target sound field of each passenger based on the content type and the passenger information; and a virtual sound source generation module for constructing a virtual sound source for each passenger that is consistent with its corresponding target sound orientation by controlling each speaker in the vehicle-mounted sound device to produce sound in coordination.

[0015] The embodiments of the present application provide an adaptive adjustment method and an adaptive adjustment system for in-vehicle sound effects. By obtaining the type of playback content and information about the passengers in the vehicle, the target sound direction of each passenger is automatically determined, and multiple speakers are controlled to collaboratively produce sound to construct a personalized virtual sound source. This can achieve intelligent switching of sound effect modes, thereby improving the accuracy of sound field positioning in different content scenarios, and further enhancing the immersion, personalization and convenience of the in-vehicle entertainment experience. In particular, it can still dynamically adapt in multi-screen, multi-passenger and driving states, thereby achieving highly intelligent sound effect control.

[0016] Other features and advantages of the present application will be set forth in the following description, and in part will be apparent from the description, or may be understood by practicing the present application.

[0017] In order to make the above-mentioned objects, features and advantages of the present application more obvious and easy to understand, preferred embodiments are given below and described in detail with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the specific implementation methods of the present application or the technical solutions in the prior art, the following is a brief introduction to the drawings required for use in the specific implementation methods or the description of the prior art. Obviously, the drawings described below are some implementation methods of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0019] Figure 1 A flow chart of the method for adaptively adjusting vehicle sound effects provided in an embodiment of the present application; Figure 2 A schematic diagram of the target sound direction of each passenger when the content type provided in the embodiment of the present application is audio type; Figure 3 Schematic diagram of the target sound direction of each passenger when the content type provided in the embodiment of the present application is a video type or a game type and the content screen is on the central control main screen; Figure 4 A schematic diagram of the target sound direction of each passenger watching a movie on multiple screens simultaneously when the content type provided in the embodiment of the present application is a video type or a game type; Figure 5 A schematic diagram of the target sound direction in the rear single-screen split-screen mode provided in an embodiment of the present application; Figure 6 A schematic diagram of the target sound orientation in the rear multi-screen mode provided in an embodiment of the present application; Figure 7 A schematic diagram of the target sound direction when the vehicle is in a driving state provided in an embodiment of the present application; Figure 8 Schematic diagram of the adaptive adjustment system for in-vehicle sound effects provided in an embodiment of the present application.

[0020] Icon: 1-Information acquisition module; 2-Target sound direction determination module; 3-Virtual sound source generation module. DETAILED DESCRIPTION

[0021] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions of this application will be clearly and completely described below in conjunction with the accompanying drawings. Obviously, the embodiments described are part of the embodiments of this application, not all of them. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0022] In order to facilitate those skilled in the art to better understand the present application, a brief introduction to the application scenarios and design concepts of the present application is given.

[0023] As living standards improve, users are placing higher demands on the material and spiritual experience of their vehicles during daily commutes. Cars are gradually evolving from traditional modes of transportation into a third living space that integrates leisure, entertainment, and social interaction. In-car audio experience, as a crucial component in enhancing user sensory enjoyment, has become a key focus for intelligent cockpit systems.

[0024] Current in-car audio systems, depending on the configuration, typically feature 8 to 30 or more speakers, seat vibrators, microphones, and other acoustic devices. Through the combination and spatial layout of speakers across different frequency bands, they establish a rich physical acoustic foundation. This foundation, combined with customized sound algorithms and manual tuning by tuners, allows the vehicle to implement a variety of preset sound modes to meet the basic needs of users with varying listening preferences.

[0025] However, most current in-car audio mode switching still relies on manual user selection, requiring complex steps and logic. For new users lacking audio knowledge, accurately matching the most appropriate sound effect scheme is difficult, leading to poor listening experience and even a negative impact on their overall evaluation of the vehicle's audio performance. While some models have introduced automatic sound field adjustment mechanisms based on seat occupancy sensors, adjusting speaker output based on the number of passengers, this approach only considers occupant position and fails to deeply adapt to the content itself. Consequently, it exhibits significant adaptability issues for diverse scenarios such as music playback, film viewing, and interactive gaming.

[0026] For example, when listening to music, users typically prefer to position the center of the sound field directly in front of their faces to achieve a natural, focused sound experience. When watching movies or gaming, the direction of the sound field should match the displayed image, creating an immersive experience where both sound and image are co-located. Traditional methods struggle to accurately and dynamically adapt the sound field to each occupant, especially in complex environments such as multiple screens, multiple people, and dynamic vehicle conditions.

[0027] Based on this, this application proposes an adaptive adjustment method and adaptive adjustment system for in-vehicle sound effects, which can determine the target sound direction of each passenger based on the type of playback content and passenger distribution information, and through the collaborative sound of multiple speakers, build a virtual sound source consistent with the content scene for different passengers, thereby achieving a highly intelligent, highly immersive, and highly convenient in-vehicle sound experience to meet the increasingly diverse application needs of smart cockpits.

[0028] After introducing the application scenarios and design ideas of this application, the technical solutions provided by this application are described in detail below.

[0029] The embodiment of the present application provides a method for adaptively adjusting vehicle sound effects, referring to Figure 1 , the adaptive adjustment method of the vehicle sound effect includes: Step S101 , obtaining the content type of the currently playing content and obtaining the passenger information in the vehicle; the passenger information includes at least the number of passengers and seating position information.

[0030] Here, various on-board sensors and data interfaces are used to perceive the in-vehicle environment and application scenarios in real time and comprehensively.

[0031] The content type includes at least one of an audio type, a video type, and a game type.

[0032] Specifically, the content type is obtained by collecting the currently playing audio and video signals in real time through the vehicle system.

[0033] Audio type mainly refers to the music playback scene. This application can identify different music styles, such as classical music, rock music, or instrumental music.

[0034] Video type mainly refers to the scene of watching film and television clips.

[0035] The game type mainly refers to the scenario in which passengers in the car play in-car games.

[0036] At the same time, in order to provide each passenger with a personalized and optimal listening experience, it is necessary to accurately understand the passenger status in the vehicle. Passenger information includes at least the number of passengers and their seating positions. In a preferred embodiment, it can also include passenger posture information.

[0037] In one embodiment, the step of obtaining the in-vehicle occupant information includes the following steps S201 - S203 .

[0038] Step S201 , obtaining at least one of a voltage value output by a pressure sensor provided under each seat in the vehicle, a seat belt status of a seat belt in the vehicle, and image information sent by a camera in the vehicle.

[0039] Here, a pressure sensor is installed under the seat cushion of each seat in the vehicle (such as the driver's seat, front passenger seat, and rear seats). When a passenger sits down, the pressure sensor physically deforms due to the pressure and outputs an electrical signal (such as a voltage) proportional to the pressure. By collecting the voltage value in real time, the system can determine whether the seat is occupied.

[0040] Each seat is equipped with a seatbelt, and a status sensor within the buckle detects whether the seatbelt is engaged. Real-time information on each seatbelt's status (e.g., engaged or unbuckled) helps determine whether a person is actually seated. For example, if the pressure sensor detects a heavy object but the seatbelt is not engaged, it could be an object rather than a passenger.

[0041] One or more wide-angle cameras can be installed at certain preset locations in the vehicle (such as the interior rearview mirror assembly, B-pillar or ceiling) to capture real-time image information inside the cabin.

[0042] Step S202: Determine the number of passengers and seating position information based on the voltage value and / or seat belt status.

[0043] Here, a preset voltage threshold is set for each seat's pressure sensor. When the voltage output by the sensor at a particular seat consistently exceeds the threshold, the seat is marked as occupied. By counting the total number of seats marked as occupied, the total number of passengers in the vehicle can be determined.

[0044] To further improve accuracy, pressure data can be integrated with seatbelt status. For example, if the seat pressure sensor voltage is greater than a threshold and the corresponding seatbelt status is engaged, it is confirmed that there is an occupant in that seat.

[0045] Finally, a list is generated containing the total number of passengers and the specific seating position of each passenger (such as the main driver's seat, the rear right seat).

[0046] Step S203 : determining the posture information of the occupant based on the image information; wherein the occupant information also includes posture information.

[0047] Here, the image information captured by the camera is input into the built-in image recognition algorithm module. The image recognition algorithm module can perform real-time image analysis based on machine learning or deep learning models to identify the human body outline and locate key points of the head (such as the eyes, nose, and mouth).

[0048] By calculating the position and orientation of the key points of the head in three-dimensional space, the posture information of each occupant can be accurately determined, such as the pitch angle and yaw angle of the head, and the direction of the occupant's line of sight can also be determined.

[0049] Step S102 : determining the target sound direction corresponding to the target sound field of each occupant based on the content type and occupant information.

[0050] Here, based on the acquired content type and occupant information, the optimal target sound direction is determined for each occupant in the vehicle.

[0051] In one embodiment, in audio entertainment scenarios, users' listening needs differ significantly when listening to music and watching movies: when listening to music, a sound field centered directly in front of the user's face provides a more comfortable listening experience; when watching a video, spatially linking the sound direction with the video content significantly enhances immersion. Based on this, step S102 includes the following steps S301-S302.

[0052] Step S301: When the content type is audio type, the target sound direction of the occupant is determined to be the area directly in front of the occupant's face.

[0053] Here, when the content type is a video type or a game type, in order to ensure the user's auditory experience, the target sound direction is determined to be the area directly in front of the occupant's face.

[0054] The system uses the acquired occupant information and posture information captured by the in-car camera to determine the head orientation of each occupant. Based on this orientation, a spatial vector extending forward from the center of the occupant's face is calculated and set as the target sound direction in audio mode.

[0055] In a single-user scenario (such as when there is only a driver), the entire vehicle's speaker array is called upon to centrally optimize the sound field for that single seat, focusing the center of the sound field directly in front of it.

[0056] In multi-user scenarios (such as two people sitting in the front row or the entire car is full), the above positioning operation is performed independently for each passenger, creating a unique sound field from the front for each person and avoiding channel interference between different seats. Figure 2 Whether it is the driver, co-driver or rear passenger, the source of the sound they feel in listening mode is directly in front of them.

[0057] Step S302, when the content type is a video type or a game type, obtain the display position information of the currently playing content, and based on the passenger's seating position information and its corresponding display area, determine the passenger's target sound direction as the position of the display area corresponding to the passenger.

[0058] In one embodiment, when the content type is a video type or a game type, it is necessary to achieve the integration of sound and picture or the synchronization of audio and video so that the sound sounds as if it is directly emitted from the picture, thereby creating an immersive cinema-level or game-level experience.

[0059] First, the display location information of the video or game screen needs to be obtained, such as the central control screen, the passenger screen, or the rear screen. Then, the seating position information of each passenger is mapped and associated with the corresponding display area, and different display layouts are used.

[0060] In one embodiment, in step S302 , the step of determining the target sound direction of the occupant as the position of the display area corresponding to the occupant based on the occupant's seating position information and the corresponding display area includes the following steps S401 - S402 .

[0061] Step S401 : When the display area serving multiple passengers is a single display area, the target sound directions corresponding to all passengers are determined as positions corresponding to the single display area.

[0062] Here, the display area includes one of the central control main screen, the co-pilot screen and the rear screen.

[0063] This allows all passengers in the car to watch a movie together on the same screen in a home theater mode. For example, when the car is parked, the whole family can watch a movie together on the car's central control screen.

[0064] In this scenario, the need is to create a unified, shared sound field. To this end, refer to Figure 3 The target sound direction for all passengers in all seats (including the front and back rows) is uniformly determined to be the center of a single display area (i.e., the central control screen). This ensures that no matter where passengers sit, the perceived sound appears to emanate from the center of the screen, where everyone is looking, creating an immersive experience with synchronized audio and video.

[0065] Step S402, when the display area serving multiple passengers is a plurality of independent or partitioned display areas, for each passenger, the corresponding display area is determined according to the passenger's seating position information, and the target sound direction corresponding to the passenger is determined as the position of the corresponding display area.

[0066] Here, the multiple independent or partitioned display areas include at least two of the central control main screen, the co-pilot screen and the rear screen.

[0067] It is used in scenarios where multiple passengers in the car use different screens for independent entertainment at the same time, so as to achieve a parallel experience of multiple cinemas in one car and avoid cross-zone sound interference.

[0068] In this mode, a dedicated, independent sound field is created for each passenger. First, a dedicated display area is assigned to each passenger based on their seating position, and then the target sound direction of the passenger is precisely directed to this dedicated area.

[0069] In one embodiment, referring to Figure 4 , step S402 specifically includes: The target sound direction corresponding to the main driver's seat occupant is determined as the position of the central control main screen.

[0070] The target sound direction corresponding to the passenger in the front passenger seat is determined as the position of the front passenger screen.

[0071] The target sound direction corresponding to the rear seat occupants is determined as the position of the rear screen.

[0072] In one embodiment, the rear screen usage scenarios include single-screen partition scenarios and dual-screen independent scenarios. Based on this, the target sound direction corresponding to the rear seat occupant is determined as the position of the rear screen, including: First, in a single-screen partition scenario, when the rear screen is divided into at least two display partitions, the target sound direction of the rear seat occupants corresponding to each display partition is determined as the position of the display partition center of the display partition.

[0073] Here, when there is only one physical screen in the back row, its display content is virtually divided into two independent display partitions on the left and right, serving the two passengers in the back row respectively. Figure 5 The target sound direction for the left passenger is determined as the center position of the left display partition, and the target sound direction for the right passenger is determined as the center position of the right display partition.

[0074] Second, in the dual-screen independent scenario, when the rear row is equipped with two independent rear screens, the target sound direction of the rear seat occupants corresponding to each rear screen is determined as the position of the rear screen.

[0075] Here, when the rear seat of the vehicle is equipped with two independent physical screens, one for each passenger on the left and one for the right. Figure 6 , the target sound direction of the left passenger is determined as the position of the left independent rear screen, and the target sound direction of the right passenger is determined as the position of the right independent rear screen.

[0076] In one embodiment, during vehicle driving, the driver's sound field is specially processed to minimize the audio system's interference with the driver's attention. Based on this, the method for adaptively adjusting in-vehicle sound effects further includes the following steps S501-S502.

[0077] Step S501, obtaining the vehicle state of the vehicle; the vehicle state includes a stationary state and a driving state.

[0078] Here, real-time access to vehicle network data is possible through the vehicle's bus system, such as the CAN bus (Controller Area Network). Specifically, data from the vehicle speed sensor or signals from the transmission gear position sensor can be collected.

[0079] Based on the collected data, the vehicle's state is determined to be either moving or stationary. For example, a speed threshold (such as 5 km / h) can be set. When the vehicle speed remains above the threshold, the vehicle is considered moving. When the speed falls below the threshold or the gear is in P (parking), the vehicle is considered stationary.

[0080] Step S502: When the vehicle is in motion and the occupant is the main driver's seat occupant, the target sound direction corresponding to the main driver's seat occupant is determined to be directly in front of the main driver's seat occupant's face.

[0081] Here, in order to reduce the driver's visual and auditory conflicts. While driving, the driver's eyes need to be focused on the road ahead. If there is a sound (such as the dialogue of the movie being watched by the passengers) coming from the central control screen next to him, it will instinctively attract the driver's attention and create a safety hazard.

[0082] Therefore, when the vehicle is in motion and the occupant is in the main driver's seat, the sound field is adjusted only for the main driver's seat. Figure 7 Regardless of what's currently playing on the center console (even a video or game), the system ignores the existing audio-visual linkage rules and instead executes the positioning logic in audio mode, repositioning the target sound direction for the driver's seat directly in front of their face. By forcing the sound field to be fixed directly in front of the driver, a more neutral and less distracting listening environment is created, ensuring driving safety.

[0083] For passengers in other positions in the car (such as the front passenger seat and the back seats), their sound experience is not affected in any way, and they can still continue to enjoy the immersive sound field brought by the corresponding screens, ensuring the personalized entertainment needs of all passengers in the car under the premise of safety.

[0084] Step S103 , by controlling each speaker in the vehicle-mounted sound system to produce sound in coordination, a virtual sound source with the same orientation as the corresponding target sound is constructed for each passenger.

[0085] After determining the target sound orientation for each occupant, the original sound source is spatialized and the required output parameters for each speaker are calculated based on the target sound orientation and the user's ear position. The onboard amplifier uses these calculated parameters to drive multiple speakers in concert. The sound waves emitted by these speakers precisely interfere and superimpose in the air, ultimately creating a virtual sound source that perfectly aligns with the target sound orientation in the user's auditory perception, thus achieving adaptive adjustment of the in-car sound effects.

[0086] In one embodiment, step S103 includes the following steps S601 - S602 .

[0087] Step S601: Calculate the output parameters corresponding to each speaker based on the target sound direction; the output parameters include at least one of gain, sound delay, and frequency response curve.

[0088] Here, the calculation of the output parameters is performed by a digital signal processor of the vehicle audio system or a computing unit having equivalent functions.

[0089] After receiving the input data, the sound effect algorithm processing unit will run one or more head-related transfer function (HRTF) models or similar sound field positioning algorithms. The sound field positioning algorithm will independently calculate a set of optimal output parameters for each speaker that needs to participate in the sound production to ensure that the sounds emitted from these different physical locations can eventually be synthesized into a sound image from the target location in the listener's ears. The input information includes the target sound direction determined by each occupant (i.e., the target position of the virtual sound source); the vehicle acoustic model preset in the system, which contains the precise three-dimensional spatial coordinates of each physical speaker in the car; and the three-dimensional spatial coordinates of the occupant's head (both ears) obtained through the occupant information.

[0090] The output parameter includes at least one of a gain, a sounding delay, and a frequency response curve.

[0091] Delay is achieved by controlling the time difference between the sound reaching the two ears, making the user think that the sound comes from a specific direction.

[0092] Gain is used to further enhance the sense of direction by adjusting the volume of different speakers, and to adjust the sound image focus and clarity of the virtual sound source.

[0093] The frequency response curve optimizes the timbre of the virtual sound source by compensating and correcting the frequency response of different speakers, making it sound more natural and compensating for the effects of the complex acoustic environment in the car (such as reflection and sound absorption from seats and glass).

[0094] Step S602: Control each speaker to produce sound in coordination based on the output parameters to construct a virtual sound source.

[0095] Here, a microsecond-accurate delay is applied to the audio signal sent to each speaker. Typically, speakers closer to the listener receive longer delays, while speakers farther away receive shorter or no delays. This ensures that sound waves from speakers in different physical locations arrive at the listener's ears in a time-shifted order that simulates the target sound source, perceiving the sound as originating from that virtual target location.

[0096] Based on the calculated gain parameters, the output volume of each speaker is independently adjusted. For example, to enhance the localization of a virtual sound source, the gain of the speaker facing the target direction is slightly increased, while the gain of the speaker facing the target direction is slightly decreased, thereby shifting the auditory focus toward the target location. Gain adjustment is also used to balance the overall vehicle sound field, ensuring that the resulting virtual sound source has an appropriate and stable loudness that does not fluctuate with distance.

[0097] Based on the calculated frequency response curve parameters, each speaker's signal is meticulously equalized. This is based on a library of acoustic parameters derived from pre-measured and calibrated acoustic characteristics of specific vehicle models. For example, the mid- and high-frequency components of a speaker partially obscured by a seat may be boosted to compensate for its sound penetration, or the specific frequency band of a speaker prone to inducing low-frequency standing waves within the vehicle may be attenuated. Ultimately, this eliminates the negative impact of the interior environment on sound quality, ensuring that the constructed virtual sound source is not only accurately positioned but also boasts a pure, natural, and richly textured timbre.

[0098] The present application provides an adaptive adjustment method for in-vehicle sound effects. By acquiring multi-dimensional information such as the content type, display position, and position and posture of the passengers in the vehicle in real time, it can intelligently match differentiated sound field positioning strategies for different content such as audio, video, and games, thereby constructing a natural personal positive sound field for users when listening to music, and creating an immersive feeling with precise linkage between sound and picture position when watching movies and TV. While meeting the independent entertainment and non-interference needs of multiple passengers, it also takes into account driving safety during driving. Ultimately, in various complex in-vehicle scenarios, it provides each passenger with an optimized, high-fidelity personalized listening experience.

[0099] Based on the above embodiments, an embodiment of the present application provides an adaptive adjustment system for vehicle-mounted sound effects. The adaptive adjustment system for vehicle-mounted sound effects can be integrated into the vehicle's cabin domain controller or the vehicle-mounted infotainment host, and its hardware carrier supports media playback control, screen calls, and data interaction across the entire vehicle network.

[0100] Reference Figure 8 The embodiment of the present application provides an adaptive adjustment system for vehicle-mounted sound effects, including: The information acquisition module 1 is used to obtain the content type of the currently playing content and obtain the passenger information in the vehicle; the passenger information at least includes the number of passengers and seating position information.

[0101] Here, the information acquisition module 1 is the perception unit of the entire adaptive adjustment system, responsible for comprehensively and in real time collecting various input information required for decision-making.

[0102] The information acquisition module 1 collects the audio and video signals currently played by the vehicle system in real time and identifies whether the content is audio (such as music) or video (such as movies, games).

[0103] When the content is of video type, the information acquisition module 1 is responsible for locating the display position of the video screen, for example, whether it is a single screen or a combination of multiple screens (such as the central control main screen, the co-pilot screen, and the rear screen).

[0104] The information acquisition module 1 obtains the number of users in the car and the specific seat distribution data in real time through a combination of occupancy sensors, seat belt status and in-car cameras.

[0105] The information acquisition module 1 acquires the vehicle's driving or stationary state signal by collecting data from the vehicle speed sensor and the like.

[0106] The target sound direction determination module 2 is configured to determine the target sound direction corresponding to the target sound field of each occupant based on the content type and occupant information.

[0107] Here, the target sound direction determination module 2 receives the multi-dimensional data from the information acquisition module 1, and intelligently plans the optimal sound direction for each passenger in the car based on a set of preset logical rules.

[0108] When the received content type is audio, the sound orientation center is fixed in front of the user's face to match the natural listening experience when music is playing.

[0109] When the received content type is video, the sound and picture linkage logic is executed to keep the sound direction consistent with the center of the picture (for example, the main screen sound field points to the center of the screen).

[0110] In addition, when multiple contents are split-screen, the center of the sound field is independently positioned by zone. When the vehicle is in motion, the video and sound effects of the main driver's seat are automatically weakened, while the immersive feeling of other seats is enhanced.

[0111] The virtual sound source generation module 3 is used to construct a virtual sound source for each passenger that is consistent with the corresponding target sound direction by controlling each speaker in the vehicle-mounted sound device to produce sound in a coordinated manner.

[0112] Here, the virtual sound source generation module 3 is used to convert the target sound direction into an acoustic effect that the user can actually perceive, and is a combination of the sound effect algorithm processing unit and the vehicle-mounted speaker hardware system.

[0113] The sound effect algorithm processing unit in the virtual sound source generation module 3 receives parameter configuration instructions from the target sound orientation determination module. It calls upon a pre-calibrated acoustic parameter library and dynamically adjusts parameters such as gain, delay, and frequency response curve for speakers in different locations (such as front door tweeters and trunk subwoofers). Based on these adjustments, the algorithm performs spatial processing on the original sound source (such as virtual sound source localization and stereo expansion), ultimately generating an optimized sound electrical signal.

[0114] The optimized electrical sound signal is sent to the vehicle's speaker system, which features speaker array hardware that supports independent control of multiple zones (such as front door tweeters, trunk subwoofers, and headrest surround speakers). The speaker hardware adjusts its output parameters in real time based on the commands, converting the electrical signal into sound waves and delivering them to the user's ears in an optimized sound field distribution, thus achieving an immersive audio experience in various scenarios.

[0115] In an optional embodiment, the content type includes at least one of an audio type, a video type, and a game type.

[0116] In an optional embodiment, the target sound position determination module 2 is further configured to: When the content type is an audio type, the target sound direction of the occupant is determined to be the area directly in front of the occupant's face.

[0117] When the content type is a video type or a game type, the display position information of the currently playing content is obtained, and based on the passenger's seating position information and its corresponding display area, the passenger's target sound direction is determined as the position of the display area corresponding to the passenger.

[0118] In an optional embodiment, the information acquisition module 1 is further configured to: At least one of a voltage value output by a pressure sensor provided under each seat in the vehicle, a seat belt status of a seat belt in the vehicle, and image information sent by a camera in the vehicle is obtained.

[0119] The number of passengers and their seating positions are determined based on the voltage value and / or seat belt status.

[0120] The posture information of the occupant is determined based on the image information; wherein the occupant information also includes posture information.

[0121] In an optional embodiment, the target sound position determination module 2 is further configured to: When the display area serving multiple occupants is a single display area, the target sound directions corresponding to all occupants are determined as positions corresponding to the single display area.

[0122] When the display area serving multiple passengers is multiple independent or partitioned display areas, for each passenger, the corresponding display area is determined according to the passenger's seating position information, and the target sound direction corresponding to the passenger is determined as the position of the corresponding display area.

[0123] In an optional embodiment, the multiple independent or partitioned display areas include at least two of the central control main screen, the co-pilot screen and the rear screen.

[0124] When the display area serving multiple occupants is a plurality of independent or partitioned display areas, the target sound direction determination module 2 is further configured to: The target sound direction corresponding to the main driver's seat occupant is determined as the position of the central control main screen.

[0125] The target sound direction corresponding to the passenger in the front passenger seat is determined as the position of the front passenger screen.

[0126] The target sound direction corresponding to the rear seat occupants is determined as the position of the rear screen.

[0127] In an optional embodiment, the usage scenarios of the rear screen include a single-screen partition scenario and a dual-screen independent scenario.

[0128] The target sound direction determination module 2 is further used to: In a single-screen partition scenario, when the rear screen is divided into at least two display partitions, the target sound direction of the rear seat occupant corresponding to each display partition is determined as the position of the display partition center of the display partition.

[0129] In the dual-screen independent scenario, when the rear row is equipped with two independent rear screens, the target sound direction of the rear seat occupants corresponding to each rear screen is determined as the position of the rear screen.

[0130] In an optional embodiment, the information acquisition module 1 is further used to obtain the vehicle status of the vehicle; the vehicle status includes a stationary state and a driving state.

[0131] When the vehicle is in motion and the occupant is the main driver's seat occupant, the target sound direction determination module 2 is further configured to determine the target sound direction corresponding to the main driver's seat occupant as being directly in front of the main driver's seat occupant's face.

[0132] In an optional embodiment, the virtual sound source generating module 3 is further configured to: Based on the target sound direction, the output parameters corresponding to each speaker are calculated; the output parameters include at least one of gain, sound delay and frequency response curve.

[0133] Each speaker is controlled to produce sound in coordination based on the output parameters to construct a virtual sound source.

[0134] The adaptive adjustment system for in-vehicle sound effects provided in this application can automate the complex sound effect mode selection and parameter adjustment process, thereby taking into account the listening needs of different content such as music and film and television, and then providing each passenger in the car with a non-interfering, high-fidelity and deeply immersive personalized audio experience while ensuring driving safety, significantly improving the intelligence and entertainment comfort of the entire vehicle.

[0135] An embodiment of the present application also provides an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the steps of the adaptive adjustment method for vehicle sound effects provided in the above embodiment are implemented.

[0136] An embodiment of the present application also provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the steps of the adaptive adjustment method of the vehicle sound effect of the above embodiment are executed.

[0137] The computer program product provided in the embodiments of the present application includes a computer-readable storage medium storing program code. The instructions included in the program code can be used to execute the methods described in the previous method embodiments. For specific implementation, please refer to the method embodiments and will not be repeated here.

[0138] Those skilled in the art will clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described systems and devices can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.

[0139] In addition, in the description of the embodiments of this application, unless otherwise specified or limited, the terms "installed," "connected," and "connected" should be understood in a broad sense. For example, they can refer to fixed connections, detachable connections, or integral connections; they can refer to mechanical connections or electrical connections; they can refer to direct connections or indirect connections through an intermediate medium; and they can refer to internal connections between two components. Those skilled in the art will understand the specific meanings of the above terms in this application based on the specific circumstances.

[0140] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, and other media that can store program code.

[0141] In the description of this application, it should be noted that the terms "center," "upper," "lower," "left," "right," "vertical," "horizontal," "inner," and "outer," etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings and are intended solely to facilitate the description of this application and simplify the description. They do not indicate or imply that the devices or components referred to must have a specific orientation, be constructed, or operate in a specific orientation. Therefore, they should not be construed as limitations on this application. Furthermore, the terms "first," "second," and "third" are used for descriptive purposes only and should not be construed as indicating or implying relative importance.

[0142] Finally, it should be noted that the above-described embodiments are only specific implementation methods of the present application, which are used to illustrate the technical solutions of the present application rather than to limit them. The scope of protection of the present application is not limited thereto. Although the present application has been described in detail with reference to the aforementioned embodiments, ordinary technicians in this field should understand that any technician familiar with this technical field can still modify the technical solutions recorded in the aforementioned embodiments within the technical scope disclosed in the present application, or make equivalent replacements for some of the technical features therein; and these modifications, changes or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application, and should all be covered by the scope of protection of the present application.

Claims

1. A method for adaptively adjusting vehicle sound effects, characterized in that: include: Get the content type of the currently playing content and obtain the passenger information in the car; The passenger information includes at least the number of passengers and seating position information; determining a target sound direction corresponding to a target sound field for each occupant based on the content type and the occupant information; By controlling each loudspeaker in the vehicle-mounted loudspeaker device to produce sound in coordination, a virtual sound source is constructed for each passenger in the same direction as the corresponding target sound.

2. The method for adaptively adjusting vehicle sound effects according to claim 1, characterized in that: The content type includes at least one of an audio type, a video type, and a game type.

3. The method for adaptively adjusting vehicle sound effects according to claim 2, characterized in that: The step of determining a target sound direction corresponding to a target sound field for each occupant based on the content type and the occupant information includes: When the content type is the audio type, determining the target sound direction of the occupant as the area directly in front of the occupant's face; When the content type is the video type or the game type, the display position information of the currently playing content is obtained, and based on the passenger's seating position information and its corresponding display area, the target sound direction of the passenger is determined as the position of the display area corresponding to the passenger.

4. The method for adaptively adjusting vehicle sound effects according to claim 1 or 3, characterized in that: The steps for obtaining the information of the passengers in the vehicle include: obtaining at least one of a voltage value output by a pressure sensor provided under each seat in the vehicle, a seat belt status of a seat belt in the vehicle, and image information sent by a camera in the vehicle; determining the number of passengers and the seating position information according to the voltage value and / or the seat belt status; Determine the posture information of the occupant based on the image information; wherein the occupant information also includes the posture information.

5. The method for adaptively adjusting vehicle sound effects according to claim 3, characterized in that: The step of determining the target sound direction of the occupant as the position of the display area corresponding to the occupant based on the seating position information of the occupant and the corresponding display area includes: When the display area serving multiple occupants is a single display area, the target sound directions corresponding to all occupants are determined as the positions corresponding to the single display area; When the display area serving multiple passengers is multiple independent or partitioned display areas, for each passenger, the corresponding display area is determined according to the passenger's seating position information, and the target sound direction corresponding to the passenger is determined as the position of the corresponding display area.

6. The method for adaptively adjusting vehicle sound effects according to claim 5, characterized in that: The multiple independent or partitioned display areas include at least two of the central control main screen, the co-pilot screen and the rear screen; When the display area serving multiple occupants is a plurality of independent or partitioned display areas, the steps of determining, for each occupant based on the seating position information thereof, the corresponding display area, and determining the target sound direction corresponding to the occupant as the position of the corresponding display area, include: Determine the target sound direction corresponding to the main driver's seat occupant as the position of the central control main screen; Determining the target sound direction corresponding to the passenger in the co-pilot seat as the position of the co-pilot screen; The target sound direction corresponding to the rear seat occupants is determined as the position of the rear screen.

7. The method for adaptively adjusting vehicle sound effects according to claim 6, characterized in that: The usage scenarios of the rear screen include single-screen partition scenario and dual-screen independent scenario; The step of determining the target sound direction corresponding to the rear seat occupant as the position of the rear screen comprises: In the single-screen partition scenario, when the rear screen is divided into at least two display partitions, the target sound direction of the rear seat occupant corresponding to each display partition is determined as the position of the display partition center of the display partition; In the dual-screen independent scenario, when the rear row is equipped with two independent rear screens, the target sound direction of the rear seat occupants corresponding to each rear screen is determined as the position of the rear screen.

8. The method for adaptively adjusting vehicle sound effects according to claim 3, characterized in that: The method further comprises: Acquiring a vehicle state of the vehicle; the vehicle state includes a stationary state and a driving state; When the vehicle is in the driving state and the occupant is a main-driver seat occupant, the target sound direction corresponding to the main-driver seat occupant is determined to be directly in front of the main-driver seat occupant's face.

9. The method for adaptively adjusting vehicle sound effects according to claim 1, characterized in that: The step of controlling each speaker in the vehicle-mounted sound device to produce sound in coordination to construct a virtual sound source for each passenger in the same direction as the corresponding target sound comprises: Calculating an output parameter corresponding to each of the speakers based on the target sound orientation; the output parameter includes at least one of a gain, a sounding delay, and a frequency response curve; Each of the loudspeakers is controlled to produce sound in coordination based on the output parameters, so as to construct the virtual sound source.

10. An adaptive adjustment system for vehicle sound effects, characterized in that: include: An information acquisition module is used to obtain the content type of the currently playing content and obtain the passenger information in the vehicle; The passenger information includes at least the number of passengers and seating position information; a target sound direction determination module, configured to determine a target sound direction corresponding to a target sound field of each occupant based on the content type and the occupant information; The virtual sound source generation module is used to construct a virtual sound source for each passenger in the same direction as the target sound by controlling each speaker in the vehicle-mounted sound device to produce sound in a coordinated manner.

Images