A car virtual surround sound adjustment system
By designing a virtual surround sound adjustment system in the car, using audio sound detection and content classification modules to adaptively adjust the virtual surround effect, the cumbersome adjustment problems in the prior art are solved, and a more three-dimensional and full user experience is achieved.
Patent Information
- Application Number
- CN202411897405.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-12-23
- Publication Date
- 2025-04-04
- Estimated Expiration
- Not applicable · inactive patent
AI Technical Summary
The prior art is difficult to adaptively and dynamically adjust the spatial sense of virtual surround sound in the car through the content of audio, resulting in poor user experience.
A car virtual surround sound adjustment system is designed to detect audio space components through the audio sound detection module. The content classification module classifies the audio space components and inserts tags between different spatial components. The adjustment module adjusts the virtual surround effect according to the audio space components.
The virtual surround effect is adjusted adaptively through the spatial components of the audio, making the user experience more three-dimensional and full, and solving the problem of cumbersome adjustment in the prior art.
Smart Images

Figure CN119767215A_ABST
Abstract
Description
Technical Field
[0001] The invention belongs to the technical field of virtual surround sound processing, and in particular relates to an automobile virtual surround sound adjustment system. Background Art
[0002] Music has spatial attributes. From the perspective of spatial dimension, multiple sounds of different heights and colors can appear at the same time. When these sound clusters are received by the human ear, they can produce a fuller auditory effect than a single sound. This is why we think that songs with accompaniment are better than a cappella. If time is regarded as the "horizontal" direction, then this type of sound phenomenon is the "vertical" direction. This vertical combination greatly expands the performance space of music. The key to realizing virtual surround sound is the virtualization processing of sound. Based on the principles of human physiological acoustics and psychoacoustics, the surround sound channel is specially processed to create the illusion that the surround sound source comes from the back or side of the audience. Binaural effect. In 1896, British physicist Rayleigh discovered through experiments that the two ears of a person have a time difference (0.44-0.5 microseconds), sound intensity difference and phase difference for the direct sound of the same sound source, and the auditory sensitivity of the human ear can accurately judge the direction of the sound and determine the location of the sound source based on these tiny differences, but it can only be limited to determining the sound source in the horizontal direction in front, and cannot solve the positioning of the three-dimensional empty sound source. The human ear has a frequency filtering effect. The sound localization mechanism of the human ear is related to the sound frequency. The bass of 20-200 Hz is located by phase difference, the mid-range of 300-4000 Hz is located by sound intensity difference, and the high pitch is located by time difference. Based on this principle, the difference between language and music in the reproduced sound can be analyzed, and the surround feeling can be increased through different processing. The human auditory system produces different spectra for sounds in different directions, and this spectrum characteristic can be described by the head-related transfer function HRT (HeadRelated Transfer Function).
[0003] In summary, the spatial positioning of the human ear includes three directions: horizontal, vertical, and front and back. Horizontal positioning mainly relies on the ears, vertical positioning mainly relies on the ear shell, and front and back positioning and the perception of the surround sound field rely on the HRTF function. Based on these effects, virtual surround sound artificially creates the same sound wave state as the actual sound source at the human ear, so that the human brain produces corresponding sound images in the corresponding spatial orientation.
[0004] With the upgrading of automobile consumption, vehicles equipped with multiple speakers and on-board audio power amplifiers are gradually favored by users. Passengers can enjoy a feature-rich immersive sound space in this vehicle environment. The audio of movies, symphonies, etc. is more three-dimensional and full. Background sounds, voices and other sounds from various sound source directions will appear at the same time. At this time, the virtual surround effect is turned up to make the audio more three-dimensional.
[0005] When listening to music or communicating, we do not need or even want the virtual surround effect of audio. Listeners may want to turn off the virtualizer. For the audio system in the car, the existing solution is to switch it manually, but this method is cumbersome and it is difficult to dynamically adjust the spatial sense of virtual surround sound according to the audio content. Summary of the invention
[0006] In view of the problems existing in the prior art, the present invention provides a car virtual surround sound adjustment system, which has the advantage of adaptively adjusting the virtual surround effect through the spatial components of the audio, solving the problem in the prior art that it is difficult to adaptively and dynamically adjust the spatial sense of the virtual surround sound through the audio content.
[0007] The present invention is implemented as follows: a car virtual surround sound adjustment system includes a central processing module, which is used to read instructions from other modules, decode and execute the instructions; the central processing module is signal-connected to an audio sound detection module, a content classification module and an adjustment module; the audio sound detection module is used to detect the spatial components of the audio; the content classification module is used to classify the spatial components of the audio; the adjustment module is used to adjust the virtual surround effect according to the spatial components of the audio; and also includes a first information collection module, which is signal-connected to the central processing module; for general audio content, the switching time point and the switching gear are classified; the switching time point and the switching gear of each user are collected through big data, and the users are classified into the corresponding categories according to the switching time point and the switching gear; the number of users in each category is counted, and the categories are arranged in order from high to low according to the number of users, and the switching time point and the switching gear of the users in each category are weighted averaged to obtain a general tuning mode.
[0008] Preferably, it further comprises a second information collection module, wherein the second information collection module is signal-connected to the central processing module;
[0009] By collecting big data, each user can adjust the number of gears of virtual surround sound when switching music;
[0010] The degree of adjustment of the virtual surround sound by each user is counted, and the number of adjustment levels of the virtual surround sound by each user is weighted averaged to obtain several song switching tuning modes for the user to choose.
[0011] Preferably, it further comprises a third information collection module, wherein the third information collection module is signal-connected to the central processing module;
[0012] The sensors on the car seats collect the positions of the passengers in the car and divide them into multiple passenger modes;
[0013] A corresponding and adaptive virtual surround effect is set for each passenger mode;
[0014] When the position of the passengers in the car is detected, it switches to the corresponding mode.
[0015] Preferably, it is divided into the following passenger modes: the main driving mode is when there is a passenger only on the main driver's seat; the front row mode is when there are passengers on both the main driver's seat and the co-driver's seat; the left right-angle mode is when there are passengers on the main driver's seat, the co-driver's seat and the left side of the back row; the right right-angle mode is when there are passengers on the main driver's seat, the co-driver's seat and the right side of the back row; the triangle mode is when there are passengers on the main driver's seat, the co-driver's seat and the middle of the back row; the rear row mode is when there are passengers only in the back row; the left side mode is when there are passengers on the main driver's seat and the left side of the back row; and the diagonal mode is when there are passengers on the main driver's seat and the right side of the back row.
[0016] Preferably, it further comprises a fourth information collection module, wherein the fourth information collection module is signal-connected to the central processing module;
[0017] Collect the position of the seat and the tilt of the seat back to infer the position of the human ear;
[0018] Classifying each combination of seat position and seat back tilt degree, thereby obtaining a number of human ear position patterns;
[0019] The virtual surround effect suitable for the current human ear position is automatically adjusted according to the human ear position mode.
[0020] Preferably, it also includes an in-car audio sound detection module, which is signal-connected to the central processing module and is used to detect noise in the car;
[0021] It also includes a noise reduction module, which is signal-connected to the central processing module and is used to reduce the noise inside the vehicle.
[0022] Preferably, it also includes a noise reduction error reduction module, which is signal-connected to the central processing module. By establishing a connection between the position of the in-vehicle sound detection module and the position of the human ear, the sound intensity and phase of the noise detected at the position of the in-vehicle sound detection module are converted into the sound intensity and phase received at the position of the human ear, thereby reducing the noise at the position of the human ear.
[0023] Preferably, it also includes an airflow detection module, which is signal-connected to the central processing module, and reduces the noise inside the vehicle and adjusts the virtual surround effect by detecting the airflow inside and outside the vehicle.
[0024] Preferably, it also includes a time detection module, which is signal-connected to the central processing module and is used to detect the total time of playing music, thereby automatically adjusting the virtual surround effect.
[0025] Compared with the prior art, the present invention has the following beneficial effects:
[0026] In the present invention, the spatial components of the audio are detected by an audio sound detection module, the spatial components of the audio are classified by a content classification module, labels are inserted between different spatial components, and an adjustment module adjusts the virtual surround effect according to the spatial components of the audio, that is, the virtual surround effect is automatically adjusted or switched when the audio is played to the label, thereby adaptively adjusting the virtual surround effect according to the spatial components of the audio. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] Figure 1 is a structural block diagram of a car virtual surround sound adjustment system provided by Embodiment 1 of the present invention;
[0028] Figure 2 is a structural block diagram of a car virtual surround sound adjustment system provided by Embodiment 2 of the present invention;
[0029] Figure 3 is a structural block diagram of a car virtual surround sound adjustment system provided by Embodiment 3 of the present invention;
[0030] Figure 4 is a structural block diagram of a car virtual surround sound adjustment system provided by Embodiment 4 of the present invention;
[0031] Figure 5 is a structural block diagram of a car virtual surround sound adjustment system provided by Embodiment 5 of the present invention;
[0032] Figure 6 is a structural block diagram of a car virtual surround sound adjustment system provided by Embodiment 6 of the present invention;
[0033] Figure 7 is a structural block diagram of a car virtual surround sound adjustment system provided by Embodiment 7 of the present invention;
[0034] Figure 8 is a structural block diagram of a car virtual surround sound adjustment system provided by Embodiment 8 of the present invention;
[0035] Fig. 9 This is a structural block diagram of a car virtual surround sound adjustment system provided by Example 9 of the present invention. DETAILED DESCRIPTION
[0036] In order to further understand the content, features and effects of the present invention, the following embodiments are given as examples and described in detail with reference to the accompanying drawings.
[0037] The structure of the present invention is described in detail below in conjunction with the accompanying drawings.
[0038] Example 1
[0039] See also Figure 1 , an embodiment of the present invention provides a car virtual surround sound adjustment system, comprising:
[0040] The central processing module is used to read the instructions from other modules, decode the instructions and execute them;
[0041] An audio sound detection module detects the spatial components of the audio;
[0042] a content classification module to classify the spatial components of the audio;
[0043] The adjustment module adjusts the virtual surround effect according to the spatial components of the audio.
[0044] In this embodiment, music has spatial properties. From the perspective of spatial dimension, multiple sounds with different heights and timbres can appear at the same time. When these sound clusters are received by the human ear, they can produce a fuller auditory effect than a single sound. The audio of movies, symphonies, etc. is relatively three-dimensional and full, and background sounds, voices, and other sounds from various sound source directions will appear at the same time. At this time, the virtual surround effect is turned up to make the audio more three-dimensional. When listening to pure music or communicating by voice, we do not need or even want the virtual surround effect of audio. The listener may want to turn off the virtualizer because the sound and image of the virtualized music audio may be masked or blurred.
[0045] The spatial components of the audio are detected by the audio sound detection module, the content classification module classifies the spatial components of the audio, and tags are inserted between different spatial components. The adjustment module adjusts the virtual surround effect according to the spatial components of the audio, that is, the virtual surround effect is automatically adjusted or switched when the audio is played to the tag, thereby adaptively adjusting the virtual surround effect according to the spatial components of the audio.
[0046] Example 2
[0047] On the basis of the above embodiment, the following settings are also performed:
[0048] See also Figure 2 , further comprising a first information collection module, wherein the first information collection module is signal-connected to the central processing module;
[0049] For general audio content, the switching time points and switching gears are classified;
[0050] The time points and gears of each user's switching are collected through big data, and the users are classified into the corresponding categories according to the time points and gears of each user's switching.
[0051] The number of users in each category is counted, and each category is arranged in order from high to low according to the number of users. The time points and switching gears of users in each category are weighted averaged to obtain a universal tuning mode for users to choose.
[0052] Exemplarily, the general audio content is content available in the public domain, such as a piece of music or a combination of multiple pieces of music, and the gears of the virtual surround effect are divided into turning up and turning down.
[0053] It should be noted that this method is equivalent to inserting a tag into the music. When the music is played to the tag position, the virtual surround sound gear is switched. The tag position and the number of switching gears are collected through big data. The weighted average of the user switching time points and switching gears in each category can obtain a tuning mode that is more in line with the majority of people's recognition.
[0054] It should be noted that the switching behavior of each user is collected through big data with the knowledge and consent of the user or tester. Each mode includes the function of automatically switching the virtual surround effect. The user selects a mode just to choose the mode that suits his or her hearing habits, and there is no need to switch modes frequently.
[0055] Example 3
[0056] Based on the above embodiment, the following settings are also performed: Figure 3 , further comprising a second information collection module, wherein the second information collection module is signal-connected to the central processing module;
[0057] By collecting big data, each user can adjust the number of gears of virtual surround sound when switching music;
[0058] The degree of adjustment of the virtual surround sound by each user is counted, and the number of adjustment levels of the virtual surround sound by each user is weighted averaged to obtain several song switching tuning modes for the user to choose.
[0059] In this embodiment, in one embodiment, the style of music switching can be accurate. For example, rock music is currently playing, and the next one is ancient style music. Then, through big data collection, when the rock music switches to ancient style music, the number of people who turn up the virtual surround effect by one level, the number of people who turn up the virtual surround effect by two levels, the number of people who turn up the virtual surround effect by three levels, and so on... and the number of people who turn down the virtual surround effect by one level, the number of people who turn down the virtual surround effect by two levels, the number of people who turn down the virtual surround effect by three levels, and so on...; and several song switching tuning modes are obtained.
[0060] In another embodiment, it can be accurate to a specific song. For example, music A is currently playing and the next song is music B. Then, through big data collection, when music A switches to music B, the number of people who turn up the virtual surround effect by one level, the number of people who turn up the virtual surround effect by two levels, the number of people who turn up the virtual surround effect by three levels, and so on... and the number of people who turn down the virtual surround effect by one level, the number of people who turn down the virtual surround effect by two levels, the number of people who turn down the virtual surround effect by three levels, and so on...; and several song switching tuning modes are obtained.
[0061] Example 4
[0062] Based on the above embodiment, the following settings are also performed: Figure 4 , further comprising a third information collection module, wherein the third information collection module is signal-connected to the central processing module;
[0063] The sensors on the car seats collect the positions of the passengers in the car and divide them into multiple passenger modes;
[0064] A corresponding and adaptive virtual surround effect is set for each passenger mode;
[0065] When the position of the passengers in the car is detected, it switches to the corresponding mode.
[0066] Exemplarily, it can be divided into the following passenger modes: the main driving mode is when there is a passenger only on the main driver's seat; the front row mode is when there are passengers on both the main driver's seat and the front passenger's seat; the left right angle mode is when there are passengers on the main driver's seat, the front passenger's seat and the left side of the back row; the right right angle mode is when there are passengers on the main driver's seat, the front passenger's seat and the right side of the back row; the triangle mode is when there are passengers on the main driver's seat, the front passenger's seat and the middle of the back row; the rear row mode is when there are passengers only in the back row (for example, passengers only sit in the back row when resting, talking, or meeting); the left side mode is when there are passengers on the main driver's seat and the left side of the back row; the diagonal mode is when there are passengers on the main driver's seat and the right side of the back row.
[0067] Specifically, setting a corresponding and adaptive virtual surround effect for each passenger mode can be tested in the laboratory, which will not be elaborated here.
[0068] Example 5
[0069] Based on the above embodiment, the following settings are also performed: Figure 5 , further comprising a fourth information collection module, wherein the fourth information collection module is signal-connected to the central processing module;
[0070] Collect the position of the seat and the tilt of the seat back to infer the position of the human ear;
[0071] Classifying each combination of seat position and seat back tilt degree, thereby obtaining a number of human ear position patterns;
[0072] The virtual surround effect suitable for the current human ear position is automatically adjusted according to the human ear position mode.
[0073] Due to the complex space inside the car, the virtual surround sound heard at each position is different, and virtual surround sound is not a separate concept, but a virtual surround effect relative to the human ears. Therefore, it is necessary to accurately locate the position of the human ear to improve the effect of the virtual surround sound received by the human ear.
[0074] In this embodiment, the position of the seat is specifically the front and rear position of the seat. The position of the human ear can be located relatively accurately through the rearward position of the seat and the inclination of the seat back.
[0075] Example 6
[0076] Based on the above embodiment, the following settings are also performed: Figure 6 , further comprising an in-vehicle audio sound detection module, the in-vehicle audio sound detection module being signal-connected to the central processing module and being used to detect noise in the vehicle;
[0077] It also includes a noise reduction module, which is signal-connected to the central processing module and is used to reduce the noise inside the vehicle.
[0078] In this embodiment, the in-car audio sound detection module detects the noise in the car, and the noise reduction module generates sounds with the same sound intensity and opposite phase to offset the noise in the car, thereby achieving the effect of noise reduction.
[0079] Example 7
[0080] Based on the above embodiment, the following settings are also performed: Figure 7 , also includes a noise reduction error reduction module, which is signal-connected to the central processing module. By establishing a connection between the position of the in-vehicle sound detection module and the position of the human ear, the sound intensity and phase of the noise detected by the in-vehicle sound detection module position are converted into the sound intensity and phase received by the human ear position, thereby reducing the noise at the human ear position.
[0081] Due to the complex space inside the car and the different positions of the sound detection module inside the car and the human ear, the noise detected by the audio sound detection module and the noise heard by the human ear may not be the same in sound intensity and phase. At this time, the noise reduction module generates sound with the same sound intensity and opposite phase to offset the noise inside the car, which only reduces the noise at the position of the audio sound detection module. For the human ear, the noise is not reduced but increased.
[0082] Example 8
[0083] Based on the above embodiment, the following settings are also performed: Figure 8, also includes an airflow detection module, which is signal-connected to the central processing module. By detecting the airflow inside and outside the vehicle, the noise inside the vehicle is reduced, and the virtual surround effect is adjusted.
[0084] There are two types of airflow outside the car. The first is when the outside wind is strong, and the second is when the vehicle speed is high. However, no matter which one, the noise generated by the airflow outside the car becomes louder. When the airflow outside the car reaches a predetermined level, the noise reduction module is adjusted accordingly to reduce the noise inside the car. This method omits the vehicle speed detection, thereby improving the noise reduction efficiency.
[0085] The airflow inside the car is usually generated by opening the windows, so opening the windows usually generates noise. When the windows are opened, the noise reduction module is adjusted accordingly by detecting the size of the airflow inside the car to reduce the noise inside the car.
[0086] And after the window is opened, it will affect the reflection of the sound inside the car, thus affecting the virtual surround effect of the sound. And the size of the window has different effects on the reflection of the sound. By detecting the size of the airflow inside the car, it can reflect the size of the window to a certain extent, so as to adjust the virtual surround effect accordingly.
[0087] Example 9
[0088] Based on the above embodiment, the following settings are also performed: Fig. 9 , and also includes a time detection module, which is connected to the central processing module by signal, and is used to detect the total time of playing music, so as to automatically adjust the virtual surround effect. (When the human ear listens to music for a certain period of time under a virtual surround effect, auditory fatigue will occur. Therefore, the total time of playing music can be detected by the time detection module, and the virtual surround effect can be automatically switched when the predetermined time is reached)
[0089] Furthermore, the time detection module can also detect the current time point, and if it is in a time period that is prone to drowsiness (for example, 1 a.m. to 4 a.m.), the virtual surround effect is automatically adjusted to prevent drowsiness. For example, the virtual surround effect is switched regularly or irregularly, and the effect of preventing drowsiness is achieved through the change of the virtual surround effect.
[0090] Furthermore, the time detection module is also used to detect the total driving time. If the current total driving time is greater than the predetermined total driving time, the virtual surround effect is automatically adjusted to prevent sleepiness.
[0091] Furthermore, it also includes a vehicle body swing detection module for detecting the swing amplitude of the vehicle body. When the swing amplitude of the vehicle body reaches a predetermined value of the vehicle body swing amplitude, the virtual surround effect is automatically adjusted to achieve an anti-strapping effect.
[0092] In this embodiment, the vehicle body swing detection module and the time detection module can be used in combination to further improve the anti-trapping effect.
[0093] Specific:
[0094] Let S comp It represents the comprehensive value of the audio spatial component detected by the audio sound detection module. It is the result of the comprehensive quantification of multiple sub-indicators reflecting the spatial component (for example, it can comprehensively consider factors such as the height distribution range of the sound, the number of different sound source directions, etc.).
[0095] C tag Indicates the classification value corresponding to the tag inserted by the content classification module (assuming that different classification tags correspond to different values, for example, 0-9 represents different spatial feature classifications, and specific values can be assigned according to the actual classification situation).
[0096] U time Indicates the time point when the user switches the virtual surround effect under the general audio content collected by the first information collection module (recorded in seconds, for example, switching when a song is played to 30 seconds, U time Take the value 30), U gear Indicates the corresponding switching gear value (such as increasing one gear takes the value 1, decreasing one gear takes the value -1, etc.).
[0097] S song Indicates the relevant parameters of song switching collected by the second information collection module, which can be specifically divided into S song-style (related to genre switching, different genre combinations correspond to different values, for example, rock to classical music has a value of 1, pop to classical music has a value of 2, etc.) and S song-specific (Specific song switching is related, each switching combination of two different songs corresponds to a specific value, which can be coded and set by yourself), S song Indicates the virtual surround effect adjustment gear value corresponding to the song switching tuning mode (S gear The value selection rules are the same).
[0098] P mode represents the parameter corresponding to the in-vehicle passenger mode collected by the third information collection module (for example, the main driving mode takes a value of 1, the front row mode takes a value of 2, and so on, with different values corresponding to different passenger distributions), V p Indicates the basic adjustment value of the virtual surround effect set for different passenger modes (different P mode Corresponding to different V p , the specific value can be determined by experiment).
[0099] E seat represents the comprehensive parameters of the seat position and backrest tilt degree collected by the fourth information collection module (different values may be corresponding to the intervals according to the actual position and tilt degree), V EIndicates the virtual surround effect adjustment compensation value corresponding to the human ear position mode (also determined by experiments and the specific E seat The corresponding V E value).
[0100] N level Indicates the noise intensity level detected by the in-car audio sound detection module (can be divided into different levels such as 1-5, the larger the number, the stronger the noise), V N Indicates the virtual surround effect adjustment correction value corresponding to different noise levels of the noise reduction module (different N is determined according to the impact of noise reduction on the virtual surround effect). level The corresponding V N ).
[0101] F time Indicates the total duration of the music played (in minutes) detected by the time detection module and the current time point T now (value ranges from 0 to 1440 minutes, corresponding to the number of minutes in a 24-hour day), total driving time D total (unit: minutes), V F Indicates the virtual surround effect adjustment parameters corresponding to the time factor (for example, increasing or decreasing a fixed value every certain period of time, and different time intervals correspond to different adjustment strengths).
[0102] B swing It represents the body swing amplitude value detected by the body swing detection module (quantified into corresponding values after being measured by specific sensors), V B Indicates the virtual surround effect adjustment force value corresponding to different swing amplitudes (the larger the swing, the stronger the adjustment force, and the corresponding relationship is determined based on experiments, etc.).
[0103] Basic adjustment formula (considering the core factors of audio space components)
[0104] V base =k 1 ×S comp +k 2 ×C tag
[0105] where k 1 and k 2 It is a weight coefficient used to measure the importance of the comprehensive value of audio spatial components and the classification label value to the basic adjustment of the virtual surround effect. The appropriate value can be calibrated and determined through experiments and big data analysis.
[0106] Combined with user behavior adjustment (general audio and song switching)
[0107]
[0108] Here n represents the number of samples of user switching behaviors under general audio content, and m represents the number of samples of song switching. This formula is a weighted average of the behavioral data of different users when switching general audio and songs, so as to incorporate the general adjustment habits of the public to influence the virtual surround effect.
[0109] Consider the in-car environment (passenger mode, ear position, noise)
[0110] V env =V p (P mode )+V E (E seat )+V N (N level )
[0111] That is, corresponding adjustment values are obtained according to the current passenger distribution, human ear position and noise level in the car, and accumulated to comprehensively consider the impact of the car environment on the virtual surround effect.
[0112] Anti-stagnation adjustment based on time and vehicle body swing
[0113] V fatigue =V f (F time ,T now ,D total )+V B (B swing )
[0114] In this formula, V F The value of is determined comprehensively based on multiple time-related factors such as the total duration of music playback, the current time point, and the total driving duration, while V B It is determined according to the swing amplitude of the vehicle body, and the two work together to adjust the virtual surround effect to prevent being trapped.
[0115] Final virtual surround effect adjustment formula
[0116] V total =V base +V user +V env +V fatigue
[0117] By adding the adjustment values of the above-mentioned parts considering different factors, the final virtual surround effect adjustment value V is obtained. total , and then adjust the virtual surround effect according to this value, such as setting the corresponding channel parameters, sound reflection simulation parameters, etc. to achieve dynamic adjustment of the virtual surround effect.
[0118] For example:
[0119] Assume that an audio clip from a movie soundtrack is being played, and the value for adjusting the virtual surround effect is calculated based on this adaptive virtual surround sound system.
[0120] Module data acquisition
[0121] 1. Audio sound detection module and content classification module:
[0122] After analysis by the audio sound detection module, the notes of this audio clip are widely distributed in spatial height and have rich sound source directions. The comprehensive value of the audio spatial component S is quantified. comp =8 (assuming 0-10 quantization, 10 is the highest space complexity).
[0123] The content classification module determines that it belongs to the spatially rich audio of movie soundtracks, corresponding to the classification value C tag =7 (suppose 0-9 classification coding, 9 represents this type of high spatial richness audio).
[0124] 2. The first information collection module (general audio related):
[0125] Through big data, we collected the switching behaviors of users in the past 100 times when playing general audio content such as movie soundtracks. For example, 30 of them were to increase the virtual surround effect by 1 level at 20 seconds. time =20, U gear =1), 40 times is to increase by 2 levels in 35 seconds (U time =35, U gear =2), and 30 times it was adjusted down by 1 level in 50 seconds (U time =50, U gear =-1).
[0126] 3. The second information collection module (song switching related):
[0127] It is known that the style of this original soundtrack is passionate and grand. The currently playing audio is expected to switch to a soothing light music later. The corresponding style switching parameter S song-style =3 (assuming that different music style switching combination values have been set, the corresponding value of this combination is 3), and the corresponding values of these two specific song switching combinations are S song-specific =5 (switching encoding according to a specific song), based on the weighted average of big data, the virtual surround effect is usually reduced by 2 levels in this song switching scenario, that is, S song =-2,.
[0128] 4. The third information collection module (passenger mode):
[0129] The in-car sensor detects that there are passengers on both the main and co-pilot seats in the car, corresponding to the passenger mode parameter P mode=2 (set the front row mode for the front passenger and front passenger, value 2), pre-set the basic adjustment value V for the virtual surround effect in the front row mode p (2) = 5 (indicating the basic enhancement amount for the surround effect in this mode).
[0130] 5. The fourth information collection module (human ear position):
[0131] The seat position is in the middle front position, the backrest is tilted 30 degrees, and the parameter E is obtained by comprehensive quantification. seat =4 (corresponding to the value of 0-9 according to different seat positions and tilt ranges, here it is 4), corresponding to the adjustment compensation value V E (4) = 3 (the amount of additional surround effect required to optimize human hearing in this seat state after testing).
[0132] 6. In-car audio sound detection module and noise reduction module:
[0133] The in-car audio sound detection module detects that the in-car noise intensity is at a medium to low level and sets the noise level N. level =2 (1-5, 2 is medium to low), corresponding to the virtual surround effect adjustment correction value V N (2) = -1 (Since the noise is not too loud, fine-tune to reduce the surround effect to avoid too much noise).
[0134] 7. Time detection module and body swing detection module:
[0135] The music has been played for 15 minutes, and the time detection module records F time =15, the current time is 10:00 a.m. (corresponding to T now = 600 minutes, assuming that 0 o'clock is the starting time for 0 minutes), the total driving time is 45 minutes (D total =45), according to the preset rule, V F (15,600,45)=0 (indicates that no additional adjustment is required due to time factors for the current time, playback time and driving time combination).
[0136] The body swing detection module detects that the body swing amplitude is small, and the quantization value B swing =2 (assuming 0-5 quantized swing amplitude, 2 is a small amplitude), corresponding to the adjustment intensity value V B (2) = 0 (the swing is small and no additional surround effect adjustment is performed to prevent stagnation).
[0137] Calculation process
[0138] Basic adjustment formula: Let k 2 =0.6, k 2 =0.4, (weight calibrated by a large number of previous experiments and data analysis)
[0139] V base =k 1 ×S comp +k 2 ×C tag =7.6,
[0140] Combined with user behavior adjustment:
[0141]
[0142] Consider the in-car environment and adjust: V env =V p (P mode )+V E (E seat )+V N (N level )=7
[0143] Anti-sleeping adjustment based on time and vehicle body swing: V fatigue =V f (F time ,T now ,D total )+V B (B swing )=0
[0144] Final virtual surround effect adjustment value V total =V base +V user +V env +V fatigue =38.6
[0145] This V total The value will be input into the adjustment module, which will adjust parameters such as channel volume distribution, sound reflection delay and intensity based on this value to achieve precise adjustment of the virtual surround effect. For example, the volume of the rear channel may be relatively increased by a certain proportion, the strength of the sound reflection simulation algorithm may be enhanced, etc., so that passengers in the car can feel the virtual surround sound effect that is more suitable for the current audio and environment. In actual applications, the data collection accuracy, quantization range, and formula weight of each module will be continuously optimized to ensure that the sound effect adjustment always meets the user experience requirements.
[0146] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device.
[0147] Although embodiments of the present invention have been shown and described, it will be appreciated by those skilled in the art that various changes, modifications, substitutions and variations may be made to the embodiments without departing from the principles and spirit of the present invention, and that the scope of the present invention is defined by the appended claims and their equivalents.
Claims
1. A car virtual surround sound adjustment system, comprising a central processing module for reading instructions from other modules, decoding the instructions and executing the instructions; characterized in that: The central processing module is signal-connected to the audio sound detection module, the content classification module, and the adjustment module; The audio sound detection module is used to detect the spatial components of audio; The content classification module is used to classify the spatial components of the audio; The adjustment module is used to adjust the virtual surround effect according to the spatial components of the audio; It also includes a first information collection module, the signal of which is connected to the central processing module; for general audio content, the switching time points and switching gears are classified; the switching time points and switching gears of each user are collected through big data, and the users are classified into corresponding categories according to the switching time points and switching gears; the number of users in each category is counted, and the categories are arranged in order from high to low according to the number of users, and the switching time points and switching gears of users in each category are weighted averaged to obtain a general tuning mode.
2. The automobile virtual surround sound adjustment system according to claim 1, wherein: Also included is a second information collection module, wherein the second information collection module is signal-connected to the central processing module; By collecting big data, each user can adjust the number of gears of virtual surround sound when switching music; The degree of adjustment of the virtual surround sound by each user is counted, and the number of adjustment levels of the virtual surround sound by each user is weighted averaged to obtain several song switching tuning modes for the user to choose.
3. The automobile virtual surround sound adjustment system according to claim 1, wherein: Also included is a third information collection module, wherein the third information collection module is signal-connected to the central processing module; The sensors on the car seats collect the positions of the passengers in the car and divide them into multiple passenger modes; A corresponding and adaptive virtual surround effect is set for each passenger mode; When the position of the passengers in the car is detected, it switches to the corresponding mode.
4. The automobile virtual surround sound adjustment system according to claim 3, wherein: It is divided into the following passenger modes: main driving mode when there is only a passenger on the main driver's seat; front row mode when there are passengers on both the main driver's seat and the co-driver's seat; left right angle mode when there are passengers on the main driver's seat, the co-driver's seat and the left side of the back row; right right angle mode when there are passengers on the main driver's seat, the co-driver's seat and the right side of the back row; triangle mode when there are passengers on the main driver's seat, the co-driver's seat and the middle of the back row; rear row mode when there are passengers only in the back row; left side mode when there are passengers on the main driver's seat and the left side of the back row; diagonal mode when there are passengers on the main driver's seat and the right side of the back row.
5. The automobile virtual surround sound adjustment system according to claim 1, wherein: It also includes a fourth information collection module, the fourth information collection module is signal-connected to the central processing module; Collect the position of the seat and the tilt of the seat back to infer the position of the human ear; Classifying each combination of seat position and seat back tilt degree to obtain several human ear position patterns; The virtual surround effect suitable for the current human ear position is automatically adjusted according to the human ear position mode.
6. The automobile virtual surround sound adjustment system according to claim 1, wherein: It also includes an in-car audio sound detection module, which is signal-connected to the central processing module and is used to detect noise in the car; It also includes a noise reduction module, which is signal-connected to the central processing module and is used to reduce noise inside the vehicle.
7. The automobile virtual surround sound adjustment system according to claim 6, wherein: It also includes a noise reduction error reduction module, which is signal-connected to the central processing module. By establishing a connection between the position of the in-vehicle sound detection module and the position of the human ear, the sound intensity and phase of the noise detected at the position of the in-vehicle sound detection module are converted into the sound intensity and phase received at the position of the human ear, thereby reducing the noise at the position of the human ear.
8. The automobile virtual surround sound adjustment system according to claim 7, wherein: It also includes an airflow detection module, which is signal-connected to the central processing module. By detecting the airflow inside and outside the vehicle, the noise inside the vehicle is reduced and the virtual surround effect is adjusted.
9. The automobile virtual surround sound adjustment system according to claim 8, wherein: It also includes a time detection module, which is signal-connected to the central processing module. The time detection module is used to detect the total time of playing music, thereby automatically adjusting the virtual surround effect.