Audio control method and apparatus, and on-board sound system

Abstract

Provided in the present invention are an audio control method and apparatus, and an on-board sound system. The method comprises: acquiring an initial auditory model of a target user in an in-vehicle acoustic environment and an ideal auditory model of the target user in a reference acoustic environment; on the basis of preset fitting constraint conditions, fitting the ideal auditory model and the initial auditory model, so as to obtain target acoustic characteristic parameters corresponding to acoustic signals output by target loudspeakers; and on the basis of the corresponding target acoustic characteristic parameters, respectively generating target acoustic transfer functions from first loudspeaker groups to the target user, and respectively updating the target acoustic transfer functions to digital filters of the corresponding target loudspeakers. In the present application, acoustic transfer functions of loudspeakers in an on-board sound system are obtained by means of the fitting calculation of auditory models, and then the corresponding loudspeakers can be controlled by means of the acoustic transfer functions, such that audio outputted by the on-board sound system can fully conform to the listening preferences of a user, thereby realizing personalized audio customization.

Description

An audio control method, device, and vehicle audio system Technical Field

[0001] This application relates to the field of sound field control technology, and in particular to an audio control method, device, and vehicle audio system. Background Technology

[0002] As car cabins become increasingly intelligent, users are demanding more refined and comfortable environments and immersive interactive experiences. Car audio systems have become a crucial element in enhancing the driving experience, with users increasingly requesting personalized and differentiated sound experiences. However, traditional car audio system designs struggle to meet these personalized and customized needs. Firstly, there's a difference between a user's preferred listening environment and the in-car listening environment, and traditional designs fail to establish a connection between these two. Secondly, each user's physiological acoustic characteristics and subjective listening preferences differ. Designing car audio systems using standardized testing and development equipment and objective indicators can only achieve the average effect for a large segment of the population; for a specific user, neither objective indicators nor subjective listening experience can reach optimal levels. Technical issues

[0003] The purpose of this invention is to provide an audio control method, device, and vehicle audio system, which can at least solve the problem in related technologies that vehicle audio systems are difficult to output audio according to the user's personalized listening preferences. Technical solutions

[0004] The first aspect of this invention provides an audio control method for a vehicle audio system, the vehicle audio system being configured with multiple target speakers; the audio control method for the vehicle audio system includes:

[0005] Obtain the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment;

[0006] The ideal auditory model and the initial auditory model are fitted based on the preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

[0007] Based on the corresponding target acoustic characteristic parameters, the target acoustic transfer function from each first loudspeaker group to the target user is generated, and each target acoustic transfer function is updated in the digital filter of the corresponding target loudspeaker.

[0008] A second aspect of this invention provides an audio control device for a vehicle audio system, the vehicle audio system being configured with multiple target speakers; the audio control device for the vehicle audio system includes:

[0009] The acquisition module is used to acquire the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment;

[0010] The fitting module is used to fit the ideal auditory model and the initial auditory model based on preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

[0011] The generation module is used to generate the target acoustic transfer function from each first loudspeaker group to the target user based on the corresponding target acoustic characteristic parameters, and to update the digital filter of the corresponding target loudspeaker with each target acoustic transfer function.

[0012] A third aspect of the present invention provides a vehicle audio system, including: a memory, a processor, and a plurality of target speakers, wherein: each target speaker is used to emit sound based on a corresponding target acoustic transfer function; the processor is used to execute a computer program stored in the memory, and when the processor executes the computer program, it implements the steps of the audio control method of the vehicle audio system provided in the first aspect of the present application.

[0013] The fourth aspect of this application provides a computer-readable storage medium having a computer program stored thereon. When the computer program is executed by a processor, it implements the steps of the audio control method for the vehicle audio system provided in the first aspect of this application. Beneficial effects

[0014] As can be seen from the above, the audio control method, device, and vehicle audio system provided by the embodiments of the present invention obtain the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment; fit the ideal auditory model and the initial auditory model based on preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signals output by each target speaker; generate the target acoustic transfer function from each first speaker group to the target user based on the corresponding target acoustic characteristic parameters, and update the digital filter of the corresponding target speaker according to each target acoustic transfer function. The solution of this application simulates the ideal auditory model of the user in the reference acoustic environment through the fitting calculation of the auditory model, and applies it to the vehicle audio system. That is, through the fitting calculation of the auditory model, the acoustic transfer function of each speaker in the vehicle audio system is obtained, and then the corresponding speaker can be controlled through each acoustic transfer function, so that the audio emitted by the vehicle audio system can fully meet the user's listening preferences, and the user can enjoy a specific auditory experience in the in-vehicle acoustic environment, realizing personalized sound customization. Attached Figure Description

[0015] Figure 1 is a basic flowchart of an audio control method for a vehicle audio system provided in the first embodiment of the present invention;

[0016] Figure 2 is a diagram showing the relative positional relationship between the left ear of a target user and various speaker groups in a reference acoustic environment, according to the first embodiment of the present invention.

[0017] Figure 3 is a diagram showing the relative positional relationship between the right ear of a target user and various speaker groups in a reference acoustic environment, according to the first embodiment of the present invention.

[0018] Figure 4 is a diagram showing the relative positional relationship between the left ear of a target user and various speaker groups in the in-vehicle acoustic environment according to the first embodiment of the present invention;

[0019] Figure 5 is a diagram showing the relative positional relationship between the right ear of a target user and various speaker groups in the in-vehicle acoustic environment according to the first embodiment of the present invention;

[0020] Figure 6 is a comparison chart of measurement results between standardized artificial heads and real users in related technologies;

[0021] Figure 7 is a detailed flowchart of an audio control method for a vehicle audio system provided in the second embodiment of the present invention;

[0022] Figure 8 is a schematic diagram of the program module of an audio control device for a vehicle audio system according to the third embodiment of the present invention;

[0023] Figure 9 is a structural schematic diagram of a vehicle audio system provided in the fourth embodiment of the present invention. Embodiments of the present invention

[0024] To make the objectives, features, and advantages of this invention more apparent and understandable, the technical solutions of the embodiments of this invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this invention, and not all of them. All other embodiments obtained by those skilled in the art based on the embodiments of this invention without creative effort are within the scope of protection of this invention.

[0025] In the description of the embodiments of the present invention, it should be understood that the terms "length", "width", "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", "bottom", "inner", "outer", etc., indicate the orientation or positional relationship based on the orientation or positional relationship shown in the accompanying drawings. They are only for the convenience of describing the embodiments of the present invention and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, or be constructed and operated in a specific orientation. Therefore, they should not be construed as limitations on the present invention.

[0026] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of embodiments of the present invention, "a plurality of" means two or more, unless otherwise explicitly specified.

[0027] In the embodiments of the present invention, unless otherwise explicitly specified and limited, the terms "installation," "connection," "linking," "fixing," etc., should be interpreted broadly. For example, they can refer to a fixed connection, a detachable connection, or an integral part; they can refer to a mechanical connection or an electrical connection; they can refer to a direct connection or an indirect connection through an intermediate medium; they can refer to the internal communication of two components or the interaction between two components. Those skilled in the art can understand the specific meaning of the above terms in the embodiments of the present invention according to the specific circumstances.

[0028] To address the problem in related technologies that in-vehicle audio systems cannot output audio according to the user's personalized listening preferences, the first embodiment of the present invention provides an audio control method for an in-vehicle audio system. The in-vehicle audio system is equipped with multiple target speakers, which are distributed in different positions within the cabin of the target vehicle to which the in-vehicle audio system belongs.

[0029] Figure 1 shows a basic flowchart of the audio control method for the vehicle audio system provided in this embodiment. The audio control method for the vehicle audio system includes the following steps:

[0030] Step 101: Obtain the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment.

[0031] Specifically, the auditory model in this embodiment may include the acoustic signal matrix corresponding to the target user's left ear (i.e., the matrix corresponding to the acoustic signal received by the target user's left ear) and the acoustic signal matrix corresponding to the target user's right ear (i.e., the matrix corresponding to the acoustic signal received by the target user's right ear). The ideal auditory model is an auditory model that conforms to the target user's listening preferences in a reference acoustic environment. The reference acoustic environment in this embodiment may include a physical environment and a sound system environment; the physical environment may be a listening environment that meets certain acoustic characteristic requirements, including but not limited to anechoic chambers, listening rooms, reverberation chambers, or specific acoustic laboratories or environments that simulate certain preset scenarios; the sound system environment may be a stereo system, a 5.1-channel system, a 7.1-channel system, a 7.1.4-channel system, etc., and is not limited here.

[0032] For example, in this embodiment, multiple speaker groups can be set up in the reference acoustic environment. Thus, a reference acoustic environment for a 7.1-channel system as shown in Figures 2 and 3 can be constructed, where the speaker groups include speaker group 1, speaker group 2, speaker group 3, speaker group 4, speaker group 5, speaker group 6, speaker group 7, and speaker group 8. Each speaker group can be a single speaker or a module composed of multiple speakers. The target user 9 is located in a standard listening room, at the center or optimal listening position of the 7.1-channel system. By modeling the auditory characteristics of the target user 9 in the reference acoustic environment, an acoustic signal matrix corresponding to the left ear and an acoustic signal matrix corresponding to the right ear of the target user 9 are constructed, thereby obtaining an ideal auditory model in the reference acoustic environment.

[0033] For example, in this embodiment, the in-vehicle audio system can be a 16-speaker in-vehicle audio system. By reconstructing the auditory experience of the target user 9 in the in-vehicle sound field environment, the required initial auditory model can be obtained. As shown in Figures 4 and 5, the target speakers of the in-vehicle audio system may include: speaker 11 located in the center of the center console, speakers 15 and 12 located on the left and right A-pillars, speakers 16 and 17 located on the left front door; speakers 13 and 14 located on the right front door; speakers 21, 22, and 23 located on the left rear door; speakers 18, 19, and 20 located on the right rear door; speakers 25 and 24 located on the left and right C-pillars; and speaker 26 located in the trunk. By modeling the auditory characteristics of the target user 9 in the in-vehicle acoustic environment, constructing the acoustic signal matrix corresponding to the left ear and the acoustic signal matrix corresponding to the right ear of the target user 9, the auditory model of the in-vehicle acoustic environment can be obtained.

[0034] Furthermore, in some embodiments of this example, before the steps of obtaining the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment, the method further includes: obtaining the first acoustic transfer function from each target speaker to the target listening position in the in-vehicle acoustic environment, and obtaining the first electroacoustic transfer function of each target speaker; wherein, the first acoustic transfer function reflects the acoustic physiological characteristics of the target user in the in-vehicle acoustic environment, and the first electroacoustic transfer function reflects the software transfer characteristics and hardware transfer characteristics of the corresponding target speaker; based on each first acoustic transfer function and each first electroacoustic transfer function, an initial auditory model of the target user in the in-vehicle acoustic environment is constructed.

[0035] Specifically, this can be achieved through the acoustic signal matrix corresponding to the left ear of target user 9. Acoustic signal matrix corresponding to the right ear of target user 9 To describe the auditory model of target user 9 in the in-vehicle acoustic environment:

[0036] Where N represents the number of original sound source channels in the reference acoustic environment. In a 7.1 channel system, N = 8; in a stereo system, N = 2; in a 5.1 channel system, N = 6; in a 7.1.4 channel system, N = 12; and so on. They will not be listed here. This represents the acoustic signal received by the target user's left ear. This represents the acoustic signal received by the target user's right ear; for each original sound source channel in the reference acoustic environment, there exists n∈[1, N], where n is a natural number greater than or equal to 1, and correspondingly, This represents the acoustic signal received by the target user 9 in the left ear from the nth channel; This represents the acoustic signal of the nth channel received by the right ear of the target user 9; in an acoustic environment, one speaker group (speaker) corresponds to one channel.

[0037] Furthermore, the acoustic signal parameters in the initial auditory model can be refined as follows:

[0038] Where M represents the number of target channels corresponding to the target loudspeakers in the in-vehicle acoustic environment. In the in-vehicle acoustic environment, one target loudspeaker corresponds to one target channel. In this embodiment, M = 16. N represents the number of original sound source channels in the reference acoustic environment. In this embodiment, N = 8. CH(n) represents the original sound source signal of the m-th channel in the reference acoustic environment. For each target channel in the in-vehicle acoustic environment, there exists m ∈ [1, M], where m is a natural number greater than or equal to 1. This represents the first acoustic transfer function from the m-th target loudspeaker to the left ear of the target user 9. Correspondingly, The first acoustic transfer function from loudspeakers 11 to 26 to the left ear of target user 9 is represented sequentially. It is determined by the in-vehicle acoustic environment and target user 9 and can be obtained directly through measurement. This represents the first acoustic transfer function from the m-th target loudspeaker to the right ear of target user 9. Correspondingly, The first acoustic transfer function from loudspeakers 11 to 26 to the right ear of target user 9 is represented sequentially. It is determined by the in-vehicle acoustic environment and target user 9 and can be obtained directly by measurement. Let the first electroacoustic transfer function of the m-th target loudspeaker be denoted as , and correspondingly, The first electroacoustic transfer functions of loudspeakers 11 to 26 are represented sequentially. They are determined by the physical characteristics of the loudspeakers themselves and can be obtained directly through measurement. This represents the transfer function of the digital filter applied to the m-th speaker of the car audio system, used to adjust the amplitude, phase, delay, frequency, and other characteristics of the original signal. n (m) represents the speaker activation parameter, that is, it is used to determine whether the speaker corresponding to the m-th channel needs to be activated, and then to perform the reconstruction calculation of the n-th channel of the original sound source in the reference acoustic environment:

[0039] when a n When (m) = 1, it means that the speaker of the m-th channel needs to be used. When a n When (m) = 0, it means that the speaker of the m-th channel is not needed. In specific implementation, a n The value of (m) can be determined by the developers based on the actual situation, and there are no restrictions here.

[0040] In some embodiments of this example, before obtaining the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment, the method further includes: obtaining the second acoustic transfer function from each speaker group in the reference acoustic environment to the ideal listening position of the target user, and obtaining the second electroacoustic transfer function of each speaker group; wherein, the second acoustic transfer function reflects the acoustic physiological characteristics of the target user in the reference acoustic environment, and the second electroacoustic transfer function reflects the software transfer characteristics and hardware transfer characteristics of the corresponding speaker group; based on each second acoustic transfer function and each second electroacoustic transfer function, an ideal auditory model of the target user in the reference acoustic environment is constructed.

[0041] Specifically, in this embodiment, the transfer function refers to the ratio of the Laplace transform (or z-transform) of the response (i.e., output) of a linear system under zero initial conditions to the Laplace transform of the excitation (i.e., input); denoted as = / , where and are the Laplace transforms of the output and input, respectively. The ideal auditory model under a reference acoustic environment can be expressed as:

[0042] in, This represents the acoustic signal matrix corresponding to the left ear of target user 9 under the reference acoustic environment. This represents the acoustic signal matrix corresponding to the right ear of target user 9 under the reference acoustic environment; N represents the number of sound source channels in the speaker system. It can be understood that in a 7.1 channel system, N = 8; in a stereo system, N = 2; in a 5.1 channel system, N = 6; in a 7.1.4 channel system, N = 12; and so on, without further listing. In this embodiment, N = 8. n∈[1, N], This represents the acoustic signal received by the left ear of target user 9, and correspondingly, This represents the acoustic signal received by the target user 9 in the left ear from the nth channel; This represents the acoustic signal received by the right ear of target user 9, and correspondingly, CH represents the acoustic signal of the nth channel received by the right ear of the target user 9; CH() represents the original sound source signal of the reference acoustic environment, and correspondingly, CH(n) represents the original sound source signal of the nth channel of the loudspeaker system in the reference acoustic environment. This represents the second acoustic transfer function from the target loudspeaker group to the left ear of the target user 9. The second acoustic transfer function represents the transfer from the target loudspeaker group to the right ear of the target user 9. and Let represent the second acoustic transfer functions from the nth speaker group to the left and right ears of the target user 9, respectively; and Determined by the listening room 10 and the target user 9, it can be directly obtained through measurement; T ref () represents the second electroacoustic transfer function of the target loudspeaker group, and correspondingly, T ref (n) represents the second electroacoustic transfer function of the nth loudspeaker group.

[0043] Furthermore, in some embodiments of this example, the step of obtaining the second acoustic transfer function from each speaker group in the reference acoustic environment to the ideal listening position of the target user includes: after each speaker group outputs a corresponding first test signal, obtaining the sound data transmitted back by the microphone fixed at the ear position of the target user; wherein, the ear position of the target user is the ideal listening position of the target user in the reference acoustic environment; and generating the second acoustic transfer function from each speaker group to the ear position of the target user based on the sound data.

[0044] Specifically, during measurement, an in-ear microphone can be installed in the ear of the target user 9, and the measurement can be taken at the center position or the optimal hearing position, so that... and The measurement results perfectly match the acoustic physiological characteristics of target user 9. It should be noted that traditionally, obtaining the acoustic transfer function typically requires comparing measurement results between a standardized artificial head and a real user, as shown in Figure 6. Measurement modeling using a standardized artificial head cannot accurately describe the auditory characteristics of a real user, thus failing to achieve a customized effect for user hearing. In contrast, this embodiment uses an in-ear microphone for measurement, which can more accurately obtain the acoustic transfer function that matches the acoustic physiological characteristics of the target user.

[0045] In this embodiment, the electroacoustic transfer function includes the hardware transfer characteristic component and the software transfer characteristic component of the loudspeaker assembly, and the second electroacoustic transfer function T ref (n) is represented as:

[0046] in, The aforementioned hardware transmission characteristic components are determined by the physical characteristics of the speaker assembly itself and can be obtained directly through measurement. The aforementioned software-transmitted characteristic components are determined by the audio software algorithm or the digital filter of the speaker group applied to the corresponding speaker group. They are used to adjust the acoustic characteristic parameters of the original audio source signal, including but not limited to the amplitude, delay, phase, frequency, and other characteristic parameters of the original audio source signal.

[0047] Furthermore, in some embodiments of this example, the step of obtaining the second electroacoustic transfer function of each speaker group includes: after each speaker group outputs a corresponding second test signal, in response to the debugging operation completion instruction performed by the target user on the speaker group, determining the electroacoustic transfer function of all speaker groups after the debugging operation is completed as the second electroacoustic transfer function; wherein, the debugging operation is used to adjust the second electroacoustic transfer function of the target speaker group so that the sound quality of the speaker group meets the listening preferences of the target user.

[0048] Specifically, in this embodiment, the debugging operation includes hardware selection and software processing; whether... Hardware selection or The software processing should fully meet the subjective listening preferences of the target user 9; by designing the entire system and tuning the audio system, the subjective sound quality of the entire speaker system should fully match the listening style of the target user 9, so as to achieve sound customization.

[0049] In some specific implementations, since the establishment of the auditory model is independent of the input signal of the original sound source, the above ideal auditory model can be simplified to:

[0050] Among them, CH Original The original audio source signal matrix is ​​a diagonal matrix whose diagonal elements are each original audio source input channel signal, and the rest are 0. Specifically, it can be represented as:

[0051] Step 102: Fit the ideal auditory model and the initial auditory model based on the preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

[0052] Specifically, acoustic characteristic parameters include the amplitude, phase, delay, and frequency of the acoustic signal. Fitting an auditory model means ensuring that the sound received by the target user in the in-vehicle acoustic environment and the reference acoustic environment has the same physical properties; that is, enabling the target user to have the same listening experience in the in-vehicle acoustic environment as in the reference acoustic environment.

[0053] Furthermore, in some embodiments of this example, the step of fitting the ideal auditory model and the initial auditory model based on preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker includes: fitting the ideal auditory model and the initial auditory model to obtain a difference calculation model for the acoustic signals; obtaining the optimal solution of the difference calculation model based on preset fitting constraints, and determining the optimal solution as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

[0054] Specifically, the difference calculation model can be used to characterize the difference between the acoustic signal received by the target user in the reference acoustic environment and the acoustic signal received in the in-vehicle acoustic environment. In addition, the difference calculation model can also be used to evaluate the difference between the acoustic signals received by the target user's two ears in the same acoustic environment.

[0055] Furthermore, in some embodiments of this example, the difference calculation model includes a first difference calculation formula, a second difference calculation formula, and a third difference calculation formula. The first difference calculation formula is used to calculate the difference between the target acoustic characteristic parameters of the acoustic signal received by the target user in the in-vehicle acoustic environment and the reference acoustic characteristic parameters of the ideal acoustic signal received by the target user in the reference acoustic environment. The second difference calculation formula is used to calculate the binaural hearing difference index of the target user when the acoustic signal output by the same target speaker acts on the target user. The third difference calculation formula is used to calculate the difference between the same speaker group in the reference acoustic environment. When the output acoustic signal is applied to the target user, the binaural hearing difference index of the target user; correspondingly, the steps of obtaining the optimal solution of the difference calculation model based on the preset fitting constraints and determining the optimal solution as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker include: taking the result of the first difference calculation formula as zero as the first fitting constraint, taking the calculation result of the second difference calculation formula as equal to the calculation result of the third difference calculation formula as the second fitting constraint, obtaining the optimal solution of the difference calculation model; and determining the optimal solution as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

[0056] Specifically, the formula for calculating the first difference is as follows:

[0057] Where N represents the number of original sound source channels in the reference acoustic environment, and for each original sound source channel in the reference acoustic environment, there exists n∈[1,N], where n is a natural number greater than or equal to 1; ΔA L (n) represents the amplitude difference of the acoustic signal of the nth channel received by the left ear of target user 9 in the reference acoustic environment and the in-vehicle acoustic environment; ΔΦ L (n) represents the phase difference of the acoustic signal of the nth channel received by the left ear of the target user 9 in the reference acoustic environment and the in-vehicle acoustic environment; ΔA R (n) represents the amplitude difference of the acoustic signal received by the target user 9's right ear in the reference acoustic environment and the in-vehicle acoustic environment in the nth channel; ΔΦ R (n) represents the phase difference of the acoustic signal of the nth channel received by the right ear of the target user 9 in the reference acoustic environment and the in-vehicle acoustic environment; e represents the natural constant; j is an imaginary number.

[0058] In this embodiment, the binaural hearing difference indicators include binaural sound level difference, binaural time difference, etc. The binaural hearing difference of the target user in the same acoustic environment can be calculated using the second difference calculation formula and the third difference calculation formula, wherein...

[0059] The formula for calculating the second difference can be expressed as:

[0060] The formula for calculating the third difference can be expressed as:

[0061] in, This represents the binaural sound level difference of the acoustic signal of the nth channel received by the target user 9 in the reference acoustic environment. The binaural sound level difference is used to reflect the difference in sound intensity received by the two ears. This represents the binaural time difference of the acoustic signal of the nth channel received by the target user 9 in the reference acoustic environment; This represents the binaural sound level difference of the acoustic signal of the nth channel received by target user 9 in the in-vehicle acoustic environment; This represents the binaural time difference of the acoustic signal received by target user 9 in the in-vehicle acoustic environment from the nth channel.

[0062] Based on this, the above fitting constraints can be used To represent, specifically, it can be represented as:

[0063] By obtaining The optimal solution can be obtained to acquire the desired target acoustic transfer function. In this embodiment, the above fitting process can be implemented by a host-integrated computing module or a separate computing module of the audio domain controller, and there is no limitation on this.

[0064] Step 103: Generate the target acoustic transfer function from each target loudspeaker to the target user based on the corresponding target acoustic characteristic parameters, and update the digital filter of the corresponding target loudspeaker with each target acoustic transfer function.

[0065] Specifically, the acoustic transfer function describes the enhancement or attenuation characteristics of a system for sound waves of different frequencies. After updating the target acoustic transfer functions to the corresponding target speakers, each target speaker group can adjust the amplitude, phase, delay, frequency, and other parameters of its output signal based on the corresponding target acoustic transfer functions. This ensures that the audio output of the entire vehicle audio system fully matches the subjective listening preferences of the target user, achieving sound customization.

[0066] Compared with related technologies, the audio control method for a vehicle audio system provided in this embodiment obtains the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment; it fits the ideal auditory model and the initial auditory model based on preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signals output by each target speaker; it generates the target acoustic transfer function from each first speaker group to the target user based on the corresponding target acoustic characteristic parameters, and updates the digital filter of the corresponding target speaker with each target acoustic transfer function. This application's solution simulates the user's ideal auditory model in the reference acoustic environment through the fitting calculation of the auditory model and applies it to the vehicle audio system. That is, through the fitting calculation of the auditory model, the acoustic transfer function of each speaker in the vehicle audio system is obtained, and then the corresponding speaker can be controlled through each acoustic transfer function, so that the audio emitted by the vehicle audio system can fully meet the user's listening preferences, allowing the user to enjoy a specific auditory experience in the in-vehicle acoustic environment and achieve personalized sound customization.

[0067] Figure 7 shows a flowchart of a detailed audio control method provided in the second embodiment of this application, used in a vehicle audio system, which is equipped with multiple target speakers; the audio control method includes:

[0068] Step 7011: Obtain the first acoustic transfer function from each target speaker to the target listening position in the in-vehicle acoustic environment, and obtain the first electroacoustic conversion transfer function of each target speaker.

[0069] Step 7021: Based on each first acoustic transfer function and each first electroacoustic conversion transfer function, construct an initial auditory model of the target user in the in-vehicle acoustic environment.

[0070] Step 7012: Obtain the second acoustic transfer function of each loudspeaker group in the reference acoustic environment to the ideal listening position of the target user, and obtain the second electroacoustic transfer function of each loudspeaker group.

[0071] Step 7022: Based on each second acoustic transfer function and each second electroacoustic conversion transfer function, construct an ideal auditory model of the target user in the reference acoustic environment.

[0072] Step 703: Fit the ideal auditory model and the initial auditory model to obtain the acoustic signal difference calculation model.

[0073] Step 704: Based on the preset fitting constraints, obtain the optimal solution of the difference calculation model.

[0074] Step 705: Determine the optimal solution as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

[0075] It should be understood that the sequence number of each step in this embodiment does not imply an absolute order of execution. The execution order of each step should be determined by its function and internal logic, and should not constitute a unique limitation on the implementation process of this application embodiment.

[0076] Compared with related technologies, the shooting control method provided in this embodiment fully considers the differences in auditory physiology and subjective listening preferences among different users, and can provide the most suitable audio control scheme for different users, greatly improving the user experience.

[0077] Figure 8 illustrates an audio control device for a vehicle audio system according to a third embodiment of this application. The vehicle audio system is equipped with multiple target speakers. This audio control device for the vehicle audio system can be applied to the aforementioned audio control method for vehicle audio systems. As shown in Figure 8, the audio control device for the vehicle audio system mainly includes:

[0078] The acquisition module 801 is used to acquire the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment.

[0079] The fitting module 802 is used to fit the ideal auditory model and the initial auditory model based on preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

[0080] The generation module 803 is used to generate the target acoustic transfer function from each first loudspeaker group to the target user based on the corresponding target acoustic characteristic parameters, and to update the digital filter of the corresponding target loudspeaker with each target acoustic transfer function.

[0081] In some embodiments of this example, the acquisition module is further configured to: acquire the first acoustic transfer function from each target speaker to the target listening position in the in-vehicle acoustic environment, and acquire the first electroacoustic conversion transfer function of each target speaker; wherein, the first acoustic transfer function reflects the acoustic physiological characteristics of the target user in the in-vehicle acoustic environment, and the first electroacoustic conversion transfer function reflects the software transfer characteristics and hardware transfer characteristics of the corresponding target speaker; and construct an initial auditory model of the target user in the in-vehicle acoustic environment based on each first acoustic transfer function and each first electroacoustic conversion transfer function.

[0082] In some embodiments of this example, multiple speaker groups are provided in the reference acoustic environment; correspondingly, the acquisition module is further configured to: acquire the second acoustic transfer function from each speaker group in the reference acoustic environment to the ideal listening position of the target user, and acquire the second electroacoustic conversion transfer function of each speaker group; wherein, the second acoustic transfer function reflects the acoustic physiological characteristics of the target user in the reference acoustic environment, and the second electroacoustic conversion transfer function reflects the software transfer characteristics and hardware transfer characteristics of the corresponding speaker group; based on each second acoustic transfer function and each second electroacoustic conversion transfer function, an ideal auditory model of the target user in the reference acoustic environment is constructed.

[0083] Furthermore, in some embodiments of this example, when the acquisition module performs the function of acquiring the second acoustic transfer function from each speaker group in the reference acoustic environment to the ideal listening position of the target user, it is specifically used to: after each speaker group outputs a corresponding first test signal, acquire the sound data transmitted back by the microphone fixed at the ear position of the target user; wherein, the ear position of the target user is the ideal listening position of the target user in the reference acoustic environment; and generate the second acoustic transfer function from each speaker group to the ear position of the target user based on the sound data.

[0084] Furthermore, in some embodiments of this example, when the acquisition module performs the function of acquiring the second electroacoustic transfer function of each speaker group, it is specifically used to: after each speaker group outputs the corresponding second test signal, in response to the target user's instruction to complete the debugging operation of the speaker group, determine the electroacoustic transfer function of all speaker groups after the debugging operation is completed as the second electroacoustic transfer function; wherein, the debugging operation is used to adjust the electroacoustic transfer function of the target speaker group so that the sound quality of the speaker group meets the listening preferences of the target user.

[0085] In some embodiments of this example, the fitting module is used to: fit the ideal auditory model and the initial auditory model to obtain a difference calculation model of the acoustic signal; based on the preset fitting constraints, obtain the optimal solution of the difference calculation model, and determine the optimal solution as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

[0086] Furthermore, in some embodiments of this example, the difference calculation model includes a first difference calculation formula, a second difference calculation formula, and a third difference calculation formula. The first difference calculation formula is used to calculate the difference between the target acoustic characteristic parameters of the acoustic signal received by the target user in the in-vehicle acoustic environment and the reference acoustic characteristic parameters of the ideal acoustic signal received by the target user in the reference acoustic environment. The second difference calculation formula is used to calculate the binaural hearing difference index of the target user when the acoustic signal output by the same target speaker acts on the target user. The third difference calculation formula is used to calculate the acoustic signal output by the same speaker group in the reference acoustic environment. When a signal is applied to a target user, the binaural hearing difference index of the target user is calculated. Correspondingly, when the fitting module executes the above-mentioned function of obtaining the optimal solution of the difference calculation model based on preset fitting constraints, and determining the optimal solution as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker, it specifically performs the following: First, it uses the condition that the result of the first difference calculation formula is zero as the first fitting constraint; second, it uses the condition that the calculation result of the second difference calculation formula is equal to the calculation result of the third difference calculation formula as the second fitting constraint; it obtains the optimal solution of the difference calculation model; and determines the optimal solution as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

[0087] According to the audio control device of the in-vehicle audio system provided in this embodiment, an initial auditory model of the target user in the in-vehicle acoustic environment and an ideal auditory model in the reference acoustic environment are obtained; the ideal auditory model and the initial auditory model are fitted based on preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signals output by each target speaker; the target acoustic transfer function from each first speaker group to the target user is generated based on the corresponding target acoustic characteristic parameters, and each target acoustic transfer function is updated to the digital filter of the corresponding target speaker. This application's solution simulates the user's ideal auditory model in the reference acoustic environment through the fitting calculation of the auditory model and applies it to the in-vehicle audio system. That is, through the fitting calculation of the auditory model, the acoustic transfer function of each speaker in the in-vehicle audio system is obtained, and then the corresponding speaker can be controlled through each acoustic transfer function, so that the audio emitted by the in-vehicle audio system can fully meet the user's listening preferences, allowing the user to enjoy a specific auditory experience in the in-vehicle acoustic environment and achieve personalized sound customization.

[0088] Figure 9 illustrates a vehicle audio system according to a fourth embodiment of this application. This vehicle audio system can be used to implement the audio control method in the aforementioned embodiments, and mainly includes: a memory 901, a processor 902, a computer program 903 stored in the memory 901 and executable on the processor 902, and multiple target speakers 904; each target speaker 904 is communicatively connected to the processor 902, and each target speaker 904 is used to emit sound based on a corresponding target acoustic transfer function; the memory 901 and the processor 902 are communicatively connected. When the processor 902 executes the computer program 903, it implements the method in the first embodiment. The number of processors can be one or more.

[0089] The memory 901 can be a high-speed random access memory (RAM) or a non-volatile memory, such as a disk drive. The memory 901 is used to store executable program code, and the processor 902 is coupled to the memory 901.

[0090] Furthermore, this application embodiment also provides a computer-readable storage medium, which may be disposed in the above-mentioned vehicle audio system, and the computer-readable storage medium may be the memory in the embodiment shown in FIG9 above.

[0091] The computer-readable storage medium stores a computer program that, when executed by a processor, implements the audio control method described in the foregoing embodiments. Furthermore, the computer-readable storage medium can also be a USB flash drive, a portable hard drive, a read-only memory (ROM), RAM, a magnetic disk, or an optical disk, or any other medium capable of storing program code.

[0092] In the several embodiments provided by this invention, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or modules may be electrical, mechanical, or other forms.

[0093] The modules described as separate components may or may not be physically separate. Similarly, the components shown as modules may or may not be physical modules; they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0094] Furthermore, the functional modules in the various embodiments of the present invention can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0095] If the integrated module is implemented as a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this invention, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this invention. The aforementioned readable storage medium includes various media capable of storing program code, such as USB flash drives, external hard drives, ROM, RAM, magnetic disks, or optical disks.

[0096] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that the present invention is not limited to the described order of actions, because according to the present invention, some steps can be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to the present invention.

[0097] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0098] The above is a description of the audio control method, device, and vehicle audio system provided by the present invention. For those skilled in the art, based on the ideas of the embodiments of the present invention, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of the present invention.

Claims

1. An audio control method for a vehicle audio system, wherein the vehicle audio system is equipped with multiple target speakers, characterized in that, The audio control method includes: Obtain the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment; The ideal auditory model and the initial auditory model are fitted based on preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker. Based on the corresponding target acoustic characteristic parameters, a target acoustic transfer function is generated for each first loudspeaker group to the target user, and each target acoustic transfer function is updated in the digital filter of the corresponding target loudspeaker.

2. The audio control method for a vehicle audio system according to claim 1, characterized in that, Before obtaining the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment, the method further includes: The first acoustic transfer function from each target speaker to the target listening position in the in-vehicle acoustic environment is obtained, and the first electroacoustic conversion transfer function of each target speaker is obtained; wherein, the first acoustic transfer function reflects the acoustic physiological characteristics of the target user in the in-vehicle acoustic environment, and the first electroacoustic conversion transfer function reflects the software transfer characteristics and hardware transfer characteristics of the corresponding target speaker; Based on each of the first acoustic transfer functions and each of the first electroacoustic conversion transfer functions, an initial auditory model of the target user in the in-vehicle acoustic environment is constructed.

3. The audio control method for a vehicle audio system according to claim 2, characterized in that, The initial auditory model is represented as follows: in, This represents the acoustic signal matrix corresponding to the left ear of the target user in the in-vehicle acoustic environment. This represents the acoustic signal matrix corresponding to the right ear of the target user in the in-vehicle acoustic environment, where N represents the number of original sound source channels in the reference acoustic environment. This represents the acoustic signal received by the target user's left ear. This refers to the acoustic signal received by the target user's right ear.

4. The audio control method for a vehicle audio system according to claim 3, characterized in that, The expression for the acoustic signal received by the target user's left ear is: The expression for the acoustic signal received by the target user's right ear is: Where M represents the number of target channels in the in-vehicle acoustic environment, and one target speaker in the in-vehicle acoustic environment corresponds to one target channel; CH(n) represents the original sound source signal of the nth channel in the reference acoustic environment; for each target channel in the in-vehicle acoustic environment, there exists m∈[1,M], where m is a natural number greater than or equal to 1. Let m represent the first acoustic transfer function from the m-th target loudspeaker to the left ear of the target user. This represents the first acoustic transfer function from the m-th target loudspeaker to the right ear of the target user. Let represent the first electroacoustic transfer function of the m-th target loudspeaker. Let a represent the digital filter transfer function applied to the m-th target loudspeaker. n (m) represents the enable judgment parameter corresponding to the m-th target speaker.

5. The audio control method for a vehicle audio system according to claim 1, characterized in that, The reference acoustic environment is provided with multiple speaker groups, and the number of target speakers is equal to the number of speaker groups; Before obtaining the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment, the method further includes: Obtain the second acoustic transfer function from each of the loudspeaker groups in the reference acoustic environment to the ideal listening position of the target user, and obtain the second electroacoustic conversion transfer function for each of the loudspeaker groups; wherein, the second acoustic transfer function reflects the acoustic physiological characteristics of the target user in the reference acoustic environment, and the second electroacoustic conversion transfer function reflects the software transfer characteristics and hardware transfer characteristics of the corresponding loudspeaker group; Based on each of the second acoustic transfer functions and each of the second electroacoustic conversion transfer functions, an ideal auditory model of the target user in the reference acoustic environment is constructed.

6. The audio control method for a vehicle audio system according to claim 5, characterized in that, The ideal auditory model is represented as follows: in, The acoustic signal matrix corresponding to the left ear of the target user under the reference acoustic environment. This represents the acoustic signal matrix corresponding to the right ear of the target user in the reference acoustic environment, where N represents the number of original sound source channels in the reference acoustic environment. This represents the acoustic signal received by the target user's left ear. CH() represents the acoustic signal received by the right ear of the target user, and CH() represents the original sound source signal of the reference acoustic environment. The second acoustic transfer function represents the distance from the target loudspeaker group to the left ear of the target user. Indicates the target Yang The second acoustic transfer function T from the speaker group to the target user's right ear ref () represents the second electroacoustic transfer function of the target loudspeaker group.

7. The audio control method for a vehicle audio system according to claim 5, characterized in that, The acquisition of the second acoustic transfer function from each of the speaker groups in the reference acoustic environment to the ideal listening position of the target user includes: After each of the aforementioned speaker groups outputs a corresponding first test signal, sound data transmitted back from a microphone fixed at the target user's ear position is acquired; wherein, the target user's ear position is the target user's ideal listening position in the reference acoustic environment; Based on the sound data, a second acoustic transfer function is generated for each of the speaker groups to the target user's ear position.

8. The audio control method for a vehicle audio system according to claim 5, characterized in that, The step of obtaining the second electroacoustic transfer function for each of the loudspeaker groups includes: After each of the speaker groups outputs its corresponding second test signal, in response to the debugging operation completion command performed by the target user on the speaker group, the electroacoustic transfer function of all the speaker groups after the debugging operation is completed is determined as the second electroacoustic transfer function; wherein, the debugging operation is used to adjust the electroacoustic transfer function of the target speaker group so that the sound quality of the speaker group meets the listening preferences of the target user.

9. The audio control method for a vehicle audio system according to claim 1, characterized in that, The process of fitting the ideal auditory model and the initial auditory model based on preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker includes: The ideal auditory model and the initial auditory model are fitted to obtain a difference calculation model for the acoustic signal; Based on the preset fitting constraints, the optimal solution of the difference calculation model is obtained, and the optimal solution is determined as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

10. The audio control method for a vehicle audio system according to claim 9, characterized in that, The difference calculation model includes a first difference calculation formula, a second difference calculation formula, and a third difference calculation formula. The first difference calculation formula is used to calculate the difference between the target acoustic characteristic parameters of the acoustic signal received by the target user in the in-vehicle acoustic environment and the reference acoustic characteristic parameters of the ideal acoustic signal received by the target user in the reference acoustic environment. The second difference calculation formula is used to calculate the binaural hearing difference index of the target user when the acoustic signal output from the same target speaker acts on the target user. The third difference calculation formula is used to calculate the binaural hearing difference index of the target user when the acoustic signal output from the same speaker group in the reference acoustic environment acts on the target user. The optimal solution of the difference calculation model is obtained based on the preset fitting constraints, and the optimal solution is determined as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker, including: The first fitting constraint is to make the result of the first difference calculation formula zero, and the second fitting constraint is to make the calculation result of the second difference calculation formula equal to the calculation result of the third difference calculation formula, so as to obtain the optimal solution of the difference calculation model. The optimal solution is determined as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

11. The audio control method for a vehicle audio system according to claim 10, characterized in that, The formula for calculating the first difference is as follows: And / or, the formula for calculating the second difference is expressed as: And / or, the formula for calculating the third difference is expressed as: in, The acoustic signal matrix corresponding to the left ear of the target user in the reference acoustic environment; This represents the acoustic signal matrix corresponding to the right ear of the target user in the reference acoustic environment; This represents the acoustic signal matrix corresponding to the left ear of the target user in the in-vehicle acoustic environment. This represents the acoustic signal matrix corresponding to the right ear of the target user in the in-vehicle acoustic environment. N represents the number of original sound source channels in the reference acoustic environment. For each original sound source channel in the reference acoustic environment, there exists n∈[1,N], where n is a natural number greater than or equal to 1; ΔA L (n) represents the amplitude difference of the acoustic signal of the nth channel received by the left ear of the target user in the reference acoustic environment and the in-vehicle acoustic environment; ΔΦ L (n) represents the phase difference of the acoustic signal of the nth channel received by the left ear of the target user in the reference acoustic environment and the in-vehicle acoustic environment; ΔA R (n) represents the amplitude difference of the acoustic signal received by the target user's right ear in the reference acoustic environment and the in-vehicle acoustic environment in the nth channel; ΔΦ R (n) represents the target user's right ear in the reference acoustic environment and the in-vehicle acoustic environment. The phase difference of the acoustic signal of the nth channel received in the environment; e represents the natural constant; j is an imaginary number; This represents the binaural sound level difference of the acoustic signal of the nth channel received by the target user in the reference acoustic environment; This represents the binaural time difference of the acoustic signal of the nth channel received by the target user in the reference acoustic environment; This represents the binaural sound level difference of the acoustic signal of the nth channel received by the target user in the in-vehicle acoustic environment; This represents the binaural time difference of the acoustic signal of the nth channel received by the target user in the in-vehicle acoustic environment.

12. An audio control device for a vehicle audio system, wherein the vehicle audio system is equipped with multiple target speakers, characterized in that, The audio control device includes: The acquisition module is used to acquire the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment; The fitting module is used to fit the ideal auditory model and the initial auditory model based on preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker. The generation module is used to generate target acoustic transfer functions from each first loudspeaker group to the target user based on the corresponding target acoustic characteristic parameters, and to update the digital filters of the corresponding target loudspeakers with each target acoustic transfer function.

13. A vehicle audio system, characterized in that, Includes memory, processor, and multiple target speakers, among which: Each of the target loudspeakers is used to emit sound based on its corresponding target acoustic transfer function; The processor is used to execute computer programs stored in the memory; When the processor executes the computer program, it implements the steps of the method according to any one of claims 1 to 11.

Images