Audio control method, device, and vehicle audio system

Abstract

The present invention provides an audio control method, device, and vehicle-mounted audio system. The method includes: obtaining an initial auditory model of a target user in an in-vehicle acoustic environment and an ideal auditory model in a reference acoustic environment; fitting the ideal auditory model and the initial auditory model based on preset fitting constraints to obtain target acoustic characteristic parameters corresponding to the acoustic signal output by each target speaker; generating target acoustic transfer functions from each first speaker group to the target user based on the corresponding target acoustic characteristic parameters, and updating each target acoustic transfer function to the digital filter of the corresponding target speaker. The present application obtains the acoustic transfer function of each speaker in the vehicle-mounted audio system through fitting calculation of the auditory model, and then can control the corresponding speakers through each acoustic transfer function, so that the audio emitted by the vehicle-mounted audio system can fully meet the user's listening preferences and realize personalized sound customization.

Description

Technical Field

[0001] The present application relates to the technical field of sound field control, and in particular to an audio control method, device, and vehicle-mounted audio system. Background Art

[0002] As car cockpits become more and more intelligent, users are pursuing a more refined and comfortable cockpit environment and immersive interactive experience. In-car audio has also become an important part of improving the driving experience, and users are increasingly demanding personalized and differentiated sound experiences. However, the design of traditional in-car audio systems is difficult to meet the personalized and customized needs of users; on the one hand, there is a difference between the listening environment preferred by users and the listening environment in the car, and traditional design solutions do not establish a connection between the two; on the other hand, each user has different physiological acoustic characteristics and subjective listening preferences. Using standardized test development equipment and objective indicators to design in-car audio systems can only achieve the average effect of most people. For a given user, neither objective indicators nor subjective listening experience can reach the best state. Summary of the invention

[0003] The purpose of the present invention is to provide an audio control method, device, and vehicle audio system, which can at least solve the problem in the related art that the vehicle audio system is difficult to output audio according to the user's personalized listening preference.

[0004] A first aspect of an embodiment of the present invention provides an audio control method for a vehicle-mounted audio system, wherein the vehicle-mounted audio system is configured with a plurality of target speakers; the audio control method for the vehicle-mounted audio system comprises:

[0005] Obtain the target user's initial auditory model in the in-car acoustic environment and the ideal auditory model in the reference acoustic environment;

[0006] The ideal auditory model and the initial auditory model are fitted based on preset fitting constraints to obtain target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker;

[0007] Target acoustic transfer functions from each first speaker group to a target user are generated based on the corresponding target acoustic characteristic parameters, and each target acoustic transfer function is updated to a digital filter of a corresponding target speaker.

[0008] A second aspect of an embodiment of the present invention provides an audio control device for a vehicle-mounted audio system, wherein the vehicle-mounted audio system is configured with a plurality of target speakers; the audio control device for the vehicle-mounted audio system comprises:

[0009] An acquisition module, used to acquire an initial auditory model of a target user in an in-car acoustic environment and an ideal auditory model in a reference acoustic environment;

[0010] A fitting module, used to fit the ideal auditory model and the initial auditory model based on preset fitting constraints to obtain target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker;

[0011] The generating module is used to generate target acoustic transfer functions from each first speaker group to a target user based on corresponding target acoustic characteristic parameters, and update each target acoustic transfer function to a digital filter of a corresponding target speaker.

[0012] A third aspect of an embodiment of the present invention provides a vehicle-mounted audio system, comprising: a memory, a processor, and a plurality of target speakers, wherein: each target speaker is used to make a sound based on a corresponding target acoustic transfer function; the processor is used to execute a computer program stored in the memory, and when the processor executes the computer program, it implements each step of the audio control method of the vehicle-mounted audio system provided in the first aspect of the embodiment of the present application.

[0013] A fourth aspect of an embodiment of the present application provides a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, each step of the audio control method of the vehicle audio system provided in the first aspect of the embodiment of the present application is implemented.

[0014] As can be seen from the above, according to the audio control method, device, and vehicle audio system provided by the embodiments of the present invention, the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment are obtained; the ideal auditory model and the initial auditory model are fitted based on the preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signal output by each target speaker; based on the corresponding target acoustic characteristic parameters, the target acoustic transfer function from each first speaker group to the target user is generated respectively, and each target acoustic transfer function is updated to the digital filter of the corresponding target speaker respectively. The present application scheme simulates the ideal auditory model of the user in the reference acoustic environment through the fitting calculation of the auditory model, and applies it to the vehicle audio system, that is, through the fitting calculation of the auditory model, the acoustic transfer function of each speaker in the vehicle audio system is obtained, and then the corresponding speakers can be controlled through each acoustic transfer function, so that the audio emitted by the vehicle audio system can fully meet the user's listening preferences, and the user can enjoy a specific auditory experience in the in-vehicle acoustic environment to achieve personalized sound customization. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] Figure 1 A basic flow chart of an audio control method for a vehicle audio system provided by a first embodiment of the present invention;

[0016] Figure 2A relative position relationship diagram between a left ear of a target user and each speaker group in a reference acoustic environment provided by the first embodiment of the present invention;

[0017] Figure 3 A relative position relationship diagram between a right ear of a target user and each speaker group in a reference acoustic environment provided by the first embodiment of the present invention;

[0018] Figure 4 A relative position relationship diagram between a left ear of a target user and each speaker group in an acoustic environment in a car provided by the first embodiment of the present invention;

[0019] Figure 5 A relative position relationship diagram between a right ear of a target user and each speaker group in an acoustic environment in a car provided by the first embodiment of the present invention;

[0020] Figure 6 A comparison chart of measurement results between a standardized artificial head and a real user in the related art;

[0021] Figure 7 A detailed flow chart of an audio control method for a vehicle audio system provided by a second embodiment of the present invention;

[0022] Figure 8 A schematic diagram of a program module of an audio control device for a vehicle audio system provided by a third embodiment of the present invention;

[0023] Fig. 9 A schematic structural diagram of a vehicle audio system provided in accordance with a fourth embodiment of the present invention. DETAILED DESCRIPTION

[0024] In order to make the purpose, features and advantages of the present invention more obvious and easy to understand, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0025] In the description of the embodiments of the present invention, it should be understood that the terms "length", "width", "up", "down", "front", "back", "left", "right", "vertical", "horizontal", "top", "bottom", "inside" and "outside" etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the embodiments of the present invention and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present invention.

[0026] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present invention, the meaning of "plurality" is two or more, unless otherwise clearly and specifically defined.

[0027] In the embodiments of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements. For ordinary technicians in this field, the specific meanings of the above terms in the embodiments of the present invention can be understood according to specific circumstances.

[0028] In order to solve the problem in the related art that it is difficult for a vehicle audio system to output audio according to a user's personalized listening preference, a first embodiment of the present invention provides an audio control method for a vehicle audio system. The vehicle audio system is configured with multiple target speakers, and different target speakers are distributed at different positions in a cabin of a target vehicle to which the vehicle audio system belongs.

[0029] like Figure 1 FIG. 1 is a basic flow chart of the audio control method of the vehicle audio system provided by the present embodiment. The audio control method of the vehicle audio system includes the following steps:

[0030] Step 101: Obtain an initial auditory model of a target user in an in-car acoustic environment and an ideal auditory model in a reference acoustic environment.

[0031] Specifically, the auditory model in this embodiment may include an acoustic signal matrix corresponding to the left ear of the target user (that is, a matrix corresponding to the acoustic signal received by the left ear of the target user) and an acoustic signal matrix corresponding to the right ear of the target user (that is, a matrix corresponding to the acoustic signal received by the right ear of the target user). The ideal auditory model is an auditory model that meets the listening preferences of the target user in a reference acoustic environment. The reference acoustic environment in this embodiment may include a physical environment and an audio architecture environment; wherein the physical environment may be a listening environment that meets certain acoustic characteristic index requirements, including but not limited to an anechoic chamber, an audition room, a reverberation room, or a specific acoustic laboratory or environment that simulates certain preset scenes; the audio architecture environment may be a stereo system, a 5.1-channel system, a 7.1-channel system, a 7.1.4-channel system, etc., which are not limited here.

[0032] Exemplarily, in this embodiment, a plurality of speaker groups may be arranged in the reference acoustic environment. Figure 2 and 3 The reference acoustic environment of the 7.1-channel system shown in the figure, the speaker groups include speaker group 1, speaker group 2, speaker group 3, speaker group 4, speaker group 5, speaker group 6, speaker group 7 and speaker group 8. The speaker group can be a single speaker or a module composed of multiple speakers. The target user 9 is located in a standard listening room and is located at the center or the best listening position of the 7.1-channel system. By modeling the auditory characteristics of the target user 9 in the reference acoustic environment, constructing the acoustic signal matrix corresponding to the left ear of the target user 9 and the acoustic signal matrix corresponding to the right ear of the target user 9, the ideal auditory model in the reference acoustic environment can be obtained.

[0033] For example, in this embodiment, the vehicle audio system may be a vehicle audio system with 16 speakers, and the required initial auditory model can be obtained by reconstructing the auditory experience of the target user 9 in the in-vehicle sound field environment. Figure 4 and 5 As shown, the target speakers of the vehicle audio system may include: a speaker 11 located at the center of the center console, a speaker 15 and a speaker 12 located at the left and right A-pillars, a speaker 16 and a speaker 17 located at the left front door; a speaker 13 and a speaker 14 located at the right front door, a speaker 21, a speaker 22 and a speaker 23 located at the left rear door, a speaker 18, a speaker 19 and a speaker 20 located at the right rear door, a speaker 25 and a speaker 24 located at the left and right C-pillars, and a speaker 26 located in the trunk. The auditory characteristics of the target user 9 in the in-vehicle acoustic environment are modeled, and the acoustic signal matrix corresponding to the left ear of the target user 9 and the acoustic signal matrix corresponding to the right ear of the target user 9 are constructed, so that the auditory model in the in-vehicle acoustic environment can be obtained.

[0034] Furthermore, in some implementations of the present embodiment, before the above-mentioned step of obtaining the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment, it also includes: obtaining a first acoustic transfer function from each target speaker in the in-vehicle acoustic environment to the target listening position, and obtaining a first electroacoustic conversion transfer function of each target speaker; wherein the first acoustic transfer function reflects the acoustic physiological characteristics of the target user in the in-vehicle acoustic environment, and the first electroacoustic conversion transfer function reflects the software transfer characteristics and hardware transfer characteristics of the corresponding target speaker; based on each first acoustic transfer function and each first electroacoustic conversion transfer function, construct an initial auditory model of the target user in the in-vehicle acoustic environment.

[0035] Specifically, the acoustic signal matrix corresponding to the left ear of the target user 9 can be The acoustic signal matrix corresponding to the right ear of target user 9 To describe the auditory model of target user 9 in the in-car acoustic environment:

[0036]

[0037] in, Indicates the number of original sound source channels in the reference acoustic environment. In a 7.1-channel system, ; In a stereo system, ; In a 5.1 channel system, ; In a 7.1.4 channel system, ; And so on, I will not list them one by one here. represents the acoustic signal received by the left ear of the target user, represents the acoustic signal received by the right ear of the target user; for each original sound source channel in the reference acoustic environment, there is , is a natural number greater than or equal to 1, correspondingly, Indicates the first The acoustic signal of each channel; Indicates the first The acoustic signal of a channel; in an acoustic environment, one speaker group (speaker) corresponds to one channel.

[0038] Furthermore, each acoustic signal parameter in the initial auditory model can be refined as follows:

[0039]

[0040]

[0041] in, represents the number of target channels corresponding to the target loudspeaker in the in-vehicle acoustic environment. In the in-vehicle acoustic environment, one target loudspeaker corresponds to one target channel. In this embodiment, ; Indicates the number of original sound source channels in the reference acoustic environment. In this embodiment: , Indicates the reference acoustic environment The original sound source signal of each channel; for each target channel in the in-car acoustic environment, there is , is a natural number greater than or equal to 1, Indicates The first acoustic transfer function from the target loudspeaker to the left ear of the target user 9, correspondingly, ~ represents the first acoustic transfer function from the loudspeaker 11 to the loudspeaker 26 to the left ear of the target user 9, which is determined by the acoustic environment in the car and the target user 9 and can be directly obtained by measurement; Indicates The first acoustic transfer function from the target loudspeaker to the right ear of the target user 9, correspondingly, ~ represents the first acoustic transfer function from the loudspeaker 11 to the loudspeaker 26 to the right ear of the target user 9, which is determined by the acoustic environment in the car and the target user 9 and can be directly obtained by measurement; Indicates The first electroacoustic conversion transfer function of the target loudspeaker, correspondingly, ~ The first electroacoustic conversion transfer functions of the loudspeakers 11 to 26 are represented in sequence, which are determined by the physical properties of the loudspeakers themselves and can be directly obtained by measurement; Indicates the first The digital filter transfer function on each speaker is used to adjust the original signal's amplitude, phase, delay, frequency and other characteristics. Indicates the speaker activation judgment parameter, that is, it is used to judge whether the first The speakers corresponding to each channel are used to generate the original sound source in the reference acoustic environment. Reconstruction calculation of each channel:

[0042]

[0043] when , it means you need to use When the speaker of each channel , it means that you do not need to use In the specific implementation process, The value can be determined by the developer based on actual conditions and is not restricted here.

[0044] In some implementations of the present embodiment, before the step of obtaining the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment, it also includes: obtaining a second acoustic transfer function from each speaker group in the reference acoustic environment to the ideal listening position of the target user, and obtaining a second electroacoustic conversion transfer function of each speaker group; wherein the second acoustic transfer function reflects the acoustic physiological characteristics of the target user in the reference acoustic environment, and the second electroacoustic conversion transfer function reflects the software transfer characteristics and hardware transfer characteristics of the corresponding speaker group; based on each second acoustic transfer function and each second electroacoustic conversion transfer function, construct an ideal auditory model of the target user in the reference acoustic environment.

[0045] Specifically, in this embodiment, the transfer function refers to the ratio of the Laplace transform (or z transform) of the linear system response (i.e., output) to the Laplace transform of the excitation (i.e., input) under zero initial conditions; it is denoted as = / , where and are the Laplace transforms of the output and input, respectively. The ideal auditory model in the reference acoustic environment can be expressed as:

[0046]

[0047] in, represents the acoustic signal matrix corresponding to the left ear of target user 9 in the reference acoustic environment, represents the acoustic signal matrix corresponding to the right ear of the target user 9 in the reference acoustic environment; Indicates the number of sound source channels of the speaker system. It can be understood that in a 7.1 channel system, ; In a stereo system, ; In a 5.1 channel system, ; In a 7.1.4 channel system, ; And so on, no longer listed here one by one; In this embodiment, . , represents the acoustic signal received by the left ear of the target user 9, and correspondingly, Indicates the first The acoustic signal of each channel; represents the acoustic signal received by the right ear of the target user 9, and accordingly, Indicates the first The acoustic signal of each channel; represents the original sound source signal of the reference acoustic environment, and correspondingly, Represents the first The original sound source signal of each channel; represents the second acoustic transfer function from the target speaker group to the left ear of the target user 9, represents the second acoustic transfer function from the target speaker group to the right ear of the target user 9, and accordingly, and Respectively represent A second acoustic transfer function from the loudspeaker group to the left ear and the right ear of the target user 9; and It is determined by the listening room 10 and the target user 9 and can be directly obtained through measurement; represents the second electroacoustic conversion transfer function of the target speaker group, and accordingly, Indicates The second electroacoustic conversion transfer function of the speaker group.

[0048] Furthermore, in some implementations of the present embodiment, the step of obtaining the second acoustic transfer function from each speaker group to the ideal listening position of the target user in the reference acoustic environment includes: after each speaker group outputs a corresponding first test signal, obtaining sound data returned by a microphone fixed at the ear position of the target user; wherein the ear position of the target user is the ideal listening position of the target user in the reference acoustic environment; and generating a second acoustic transfer function from each speaker group to the ear position of the target user based on the sound data.

[0049] Specifically, during measurement, an in-ear microphone may be installed in the ear of the target user 9, and measurement may be performed at a center position or at an optimal listening position. and The measurement results are completely consistent with the acoustic physiological characteristics of the target user 9. It should be noted that the acquisition of the traditional acoustic transfer function usually requires comparing the measurement results between the standardized artificial head and the real user, such as Figure 6 As shown, the results of measurement and modeling using a standardized artificial head cannot fully and accurately describe the hearing characteristics of real users, and thus cannot achieve a customized effect on the user's hearing. However, this embodiment uses an in-ear microphone to perform measurements, which can more accurately obtain an acoustic transfer function that meets the acoustic and physiological characteristics of the target user.

[0050] In this embodiment, the electroacoustic conversion transfer function includes a hardware transfer characteristic component and a software transfer characteristic component of the speaker group. The second electroacoustic conversion transfer function It is expressed as:

[0051]

[0052] in, It represents the hardware transfer characteristic component mentioned above, which is determined by the physical characteristics of the speaker group itself and can be directly obtained through measurement; The software transfer characteristic component is determined by the audio software algorithm applied to the corresponding speaker group or the digital filter of the speaker group, and is used to adjust the acoustic characteristic parameters of the original sound source signal. The acoustic characteristic parameters include but are not limited to the amplitude, delay, phase, frequency and other characteristic parameters of the original sound source signal.

[0053] Further, in some implementations of the present embodiment, the above-mentioned step of obtaining the second electroacoustic conversion transfer function of each speaker group includes: after each speaker group outputs a corresponding second test signal, in response to an instruction to complete a debugging operation performed by the target user on the speaker group, the electroacoustic conversion transfer function of all speaker groups after the debugging operation is completed is determined as the second electroacoustic conversion transfer function; wherein the debugging operation is used to adjust the second electroacoustic conversion transfer function of the target speaker group so that the sound quality of the speaker group meets the listening preference of the target user.

[0054] Specifically, in this embodiment, the debugging operation includes hardware selection and software processing; whether The hardware choice is still All software processing should fully conform to the subjective listening preferences of the target user 9; by designing and debugging the entire system, the subjective sound quality of the entire speaker system should fully conform to the listening style and tonality of the target user 9 to achieve sound customization.

[0055] In some specific implementations, since the establishment of the auditory model is independent of the input signal of the original sound source, in order to facilitate the calculation of the fitting process, the above ideal auditory model can be simplified as follows:

[0056]

[0057] in, Represents the original sound source signal matrix, which is a diagonal matrix whose elements on the diagonal are the input channel signals of each original sound source and the rest are 0. It can be specifically expressed as:

[0058] .

[0059] Step 102: Fit the ideal auditory model and the initial auditory model based on preset fitting constraints to obtain target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

[0060] Specifically, the acoustic characteristic parameters include the amplitude, phase, delay, frequency, etc. of the acoustic signal. Fitting the auditory model means that the sound received by the target user in the in-car acoustic environment and the reference acoustic environment has the same physical indicators, that is, the target user can also obtain the same auditory experience in the in-car acoustic environment as in the reference acoustic environment.

[0061] Furthermore, in some implementations of the present embodiment, the step of fitting the ideal auditory model and the initial auditory model based on preset fitting constraints to obtain target acoustic characteristic parameters corresponding to the acoustic signals output by each target speaker includes: fitting the ideal auditory model and the initial auditory model to obtain a difference calculation model of the acoustic signal; based on the preset fitting constraints, obtaining the optimal solution of the difference calculation model, and determining the optimal solution as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target speaker.

[0062] Specifically, the difference calculation model can be used to characterize the difference between the acoustic signal received by the target user in a reference acoustic environment and the acoustic signal received in the in-vehicle acoustic environment. In addition, the difference calculation model can also be used to evaluate the difference in acoustic signals received by the target user's two ears in the same acoustic environment.

[0063] Furthermore, in some implementations of the present embodiment, the difference calculation model includes a first difference calculation formula, a second difference calculation formula and a third difference calculation formula, wherein the first difference calculation formula is used to calculate the difference between the target acoustic characteristic parameters of the acoustic signal received by the target user in the in-vehicle acoustic environment and the reference acoustic characteristic parameters of the ideal acoustic signal received by the target user in the reference acoustic environment; the second difference calculation formula is used to calculate the binaural hearing difference index of the target user when the acoustic signal output by the same target speaker acts on the target user; the third difference calculation formula is used to calculate the difference between the target user's binaural hearing difference index and the reference acoustic characteristic parameters of the ideal acoustic signal received by the target user in the reference acoustic environment; When the output acoustic signal acts on the target user, the binaural hearing difference index of the target user; accordingly, the above-mentioned step of obtaining the optimal solution of the difference calculation model based on the preset fitting constraint condition, and determining the optimal solution as the target acoustic characteristic parameter corresponding to the acoustic signal output by each target speaker, includes: taking the result of the first difference calculation formula to be zero as the first fitting constraint condition, and making the settlement result of the second difference calculation formula equal to the calculation result of the third difference calculation formula as the second fitting constraint condition, obtaining the optimal solution of the difference calculation model; determining the optimal solution as the target acoustic characteristic parameter corresponding to the acoustic signal output by each target speaker.

[0064] Specifically, the first difference calculation formula is expressed as:

[0065]

[0066] in, Indicates the number of original sound source channels in the reference acoustic environment. For each original sound source channel in the reference acoustic environment, there is , is a natural number greater than or equal to 1; represents the first sound received by the left ear of the target user 9 in the reference acoustic environment and the in-car acoustic environment The amplitude difference of the acoustic signals of the channels; represents the first sound received by the left ear of the target user 9 in the reference acoustic environment and the in-car acoustic environment. The phase difference of the acoustic signals of the channels; represents the first sound received by the right ear of the target user 9 in the reference acoustic environment and the in-car acoustic environment The amplitude difference of the acoustic signals of the channels; represents the first sound received by the right ear of the target user 9 in the reference acoustic environment and the in-car acoustic environment The phase difference of the acoustic signals of the channels; represents a natural constant; Is an imaginary number.

[0067] In this embodiment, binaural hearing difference indicators include binaural sound level difference, binaural time difference, etc. The binaural hearing difference of the target user in the same acoustic environment can be calculated by the second difference calculation formula and the third difference calculation formula, wherein,

[0068] The second difference calculation formula can be expressed as:

[0069]

[0070] The third difference calculation formula can be expressed as:

[0071]

[0072] in, represents the first sound received by the target user 9 in the reference acoustic environment The binaural level difference of the acoustic signal of each channel is used to reflect the difference in the sound intensity received by the two ears; represents the first sound received by the target user 9 in the reference acoustic environment The interaural time difference of the acoustic signals of the channels; represents the first sound received by the target user 9 in the acoustic environment inside the car The binaural level difference of the acoustic signals of the channels; Indicates that the target user 9 receives the first The interaural time difference of the acoustic signals of the two channels.

[0073] Based on this, the above fitting constraints can be used To express, it can be expressed as:

[0074]

[0075] By seeking The optimal solution of the desired target acoustic transfer function can be obtained. In this embodiment, the above fitting process can be implemented by a host integrated computing module or an independent audio domain controller computing module, which is not limited here.

[0076] Step 103: Generate target acoustic transfer functions from each target loudspeaker to the target user based on the corresponding target acoustic characteristic parameters, and update each target acoustic transfer function to a digital filter of the corresponding target loudspeaker.

[0077] Specifically, the acoustic transfer function can describe the system's enhancement or attenuation characteristics for sound waves of different frequencies. After updating each target acoustic transfer function to the corresponding target speaker, each target speaker group can adjust the amplitude, phase, delay, frequency and other parameters of its output signal based on the corresponding target acoustic transfer function, so that the audio output by the entire vehicle audio system fully meets the subjective listening preferences of the target user, achieving sound customization.

[0078] Compared with the related art, the audio control method of the vehicle audio system provided in this embodiment obtains the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment; fits the ideal auditory model and the initial auditory model based on the preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signal output by each target speaker; generates the target acoustic transfer function from each first speaker group to the target user based on the corresponding target acoustic characteristic parameters, and updates each target acoustic transfer function to the digital filter of the corresponding target speaker. The present application scheme simulates the ideal auditory model of the user in the reference acoustic environment through the fitting calculation of the auditory model, and applies it to the vehicle audio system, that is, through the fitting calculation of the auditory model, the acoustic transfer function of each speaker in the vehicle audio system is obtained, and then the corresponding speakers can be controlled through each acoustic transfer function, so that the audio emitted by the vehicle audio system can fully meet the user's listening preferences, and the user can enjoy a specific auditory experience in the in-vehicle acoustic environment to achieve personalized sound customization.

[0079] like Figure 7 The flowchart of a detailed audio control method provided by the second embodiment of the present application is shown, which is used in a vehicle audio system, and the vehicle audio system is configured with multiple target speakers; the audio control method includes:

[0080] Step 7011: Obtain a first acoustic transfer function from each target loudspeaker to a target listening position in the in-vehicle acoustic environment, and obtain a first electroacoustic conversion transfer function of each target loudspeaker.

[0081] Step 7021: construct an initial auditory model of the target user in the in-vehicle acoustic environment based on each first acoustic transfer function and each first electroacoustic conversion transfer function.

[0082] Step 7012: Obtain a second acoustic transfer function from each speaker group to the ideal listening position of the target user in the reference acoustic environment, and obtain a second electroacoustic conversion transfer function of each speaker group.

[0083] Step 7022: construct an ideal auditory model of the target user in a reference acoustic environment based on each second acoustic transfer function and each second electroacoustic conversion transfer function.

[0084] Step 703: Fit the ideal auditory model and the initial auditory model to obtain a difference calculation model of the acoustic signal.

[0085] Step 704: based on the preset fitting constraints, find the optimal solution of the difference calculation model.

[0086] Step 705: Determine the optimal solution as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker.

[0087] It should be understood that the size of the serial numbers of the steps in this embodiment does not mean the absolute order of execution of the steps. The execution order of each step should be determined by its function and internal logic, and should not constitute a sole limitation on the implementation process of the embodiment of the present application.

[0088] Compared with related technologies, the implementation of the shooting control method provided in this embodiment fully considers the auditory physiological differences and subjective listening preference differences between different individual users, and can provide the most suitable audio control solutions for different users, greatly improving the user experience.

[0089] Figure 8 The third embodiment of the present application provides an audio control device for a vehicle-mounted audio system, wherein the vehicle-mounted audio system is configured with a plurality of target speakers. The audio control device for the vehicle-mounted audio system can be applied to the audio control method for the vehicle-mounted audio system. Figure 8 As shown, the audio control device of the vehicle audio system mainly includes:

[0090] An acquisition module 801 is used to acquire an initial auditory model of a target user in an in-car acoustic environment and an ideal auditory model in a reference acoustic environment;

[0091] A fitting module 802 is used to fit the ideal auditory model and the initial auditory model based on preset fitting constraints to obtain target acoustic characteristic parameters corresponding to the acoustic signals output by each target loudspeaker;

[0092] The generating module 803 is used to generate target acoustic transfer functions from each first speaker group to the target user based on the corresponding target acoustic characteristic parameters, and update each target acoustic transfer function to the digital filter of the corresponding target speaker.

[0093] In some implementations of this embodiment, the acquisition module is also used to: obtain a first acoustic transfer function from each target speaker to a target listening position in the in-vehicle acoustic environment, and obtain a first electroacoustic conversion transfer function of each target speaker; wherein the first acoustic transfer function reflects the acoustic physiological characteristics of the target user in the in-vehicle acoustic environment, and the first electroacoustic conversion transfer function reflects the software transfer characteristics and hardware transfer characteristics of the corresponding target speaker; based on each first acoustic transfer function and each first electroacoustic conversion transfer function, construct an initial auditory model of the target user in the in-vehicle acoustic environment.

[0094] In some implementations of the present embodiment, a plurality of speaker groups are provided in the reference acoustic environment; accordingly, the acquisition module is further used to: obtain a second acoustic transfer function from each speaker group in the reference acoustic environment to an ideal listening position where a target user is located, and obtain a second electroacoustic conversion transfer function of each speaker group; wherein the second acoustic transfer function reflects the acoustic physiological characteristics of the target user in the reference acoustic environment, and the second electroacoustic conversion transfer function reflects the software transfer characteristics and hardware transfer characteristics of the corresponding speaker group; based on each second acoustic transfer function and each second electroacoustic conversion transfer function, an ideal auditory model of the target user in the reference acoustic environment is constructed.

[0095] Furthermore, in some implementations of the present embodiment, when the acquisition module executes the above-mentioned function of acquiring the second acoustic transfer function from each speaker group to the ideal listening position of the target user in the reference acoustic environment, it is specifically used to: acquire the sound data returned by the microphone fixed at the ear position of the target user after each speaker group outputs the corresponding first test signal; wherein the ear position of the target user is the ideal listening position of the target user in the reference acoustic environment; and generate the second acoustic transfer function from each speaker group to the ear position of the target user based on the sound data.

[0096] Further, in some implementations of the present embodiment, when the acquisition module executes the above-mentioned function of acquiring the second electroacoustic conversion transfer function of each speaker group, it is specifically used to: after each speaker group outputs a corresponding second test signal, in response to an instruction to complete a debugging operation performed by the target user on the speaker group, determine the electroacoustic conversion transfer function of all speaker groups after the debugging operation is completed as the second electroacoustic conversion transfer function; wherein the debugging operation is used to adjust the electroacoustic conversion transfer function of the target speaker group so that the sound quality of the speaker group meets the listening preference of the target user.

[0097] In some implementations of this embodiment, the fitting module is used to: fit the ideal auditory model and the initial auditory model to obtain a difference calculation model of the acoustic signal; based on preset fitting constraints, obtain the optimal solution of the difference calculation model, and determine the optimal solution as the target acoustic characteristic parameters corresponding to the acoustic signal output by each target speaker.

[0098] Furthermore, in some implementations of the present embodiment, the difference calculation model includes a first difference calculation formula, a second difference calculation formula and a third difference calculation formula, wherein the first difference calculation formula is used to calculate the difference between the target acoustic characteristic parameters of the acoustic signal received by the target user in the in-vehicle acoustic environment and the reference acoustic characteristic parameters of the ideal acoustic signal received by the target user in the reference acoustic environment; the second difference calculation formula is used to calculate the binaural hearing difference index of the target user when the acoustic signal output by the same target speaker acts on the target user; the third difference calculation formula is used to calculate the acoustic characteristic parameters of the target user output by the same speaker group in the reference acoustic environment. When the signal acts on the target user, the binaural hearing difference index of the target user; accordingly, when the fitting module executes the above-mentioned function of obtaining the optimal solution of the difference calculation model based on the preset fitting constraints, and determining the optimal solution as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target speaker, it is specifically used to: make the result of the first difference calculation formula zero as the first fitting constraint condition, and make the settlement result of the second difference calculation formula equal to the calculation result of the third difference calculation formula as the second fitting constraint condition, obtain the optimal solution of the difference calculation model; determine the optimal solution as the target acoustic characteristic parameters corresponding to the acoustic signals output by each target speaker.

[0099] According to the audio control device of the vehicle audio system provided by this embodiment, the initial auditory model of the target user in the in-vehicle acoustic environment and the ideal auditory model in the reference acoustic environment are obtained; the ideal auditory model and the initial auditory model are fitted based on the preset fitting constraints to obtain the target acoustic characteristic parameters corresponding to the acoustic signals output by each target speaker; the target acoustic transfer functions from each first speaker group to the target user are respectively generated based on the corresponding target acoustic characteristic parameters, and each target acoustic transfer function is respectively updated to the digital filter of the corresponding target speaker. The present application scheme simulates the ideal auditory model of the user in the reference acoustic environment through the fitting calculation of the auditory model, and applies it to the vehicle audio system, that is, the acoustic transfer function of each speaker in the vehicle audio system is obtained through the fitting calculation of the auditory model, and then the corresponding speakers can be controlled through each acoustic transfer function, so that the audio emitted by the vehicle audio system can fully meet the user's listening preferences, and the user can enjoy a specific auditory experience in the in-vehicle acoustic environment to achieve personalized sound customization.

[0100] Fig. 9A vehicle audio system is provided for the fourth embodiment of the present application. The vehicle audio system can be used to implement the audio control method in the aforementioned embodiment, and mainly includes: a memory 901, a processor 902, a computer program 903 stored in the memory 901 and executable on the processor 902, and a plurality of target speakers 904; each target speaker 904 is respectively connected to the processor 902 for communication, and each target speaker 904 is respectively used to make a sound based on a corresponding target acoustic transfer function; the memory 901 and the processor 902 are connected by communication. When the processor 902 executes the computer program 903, the method in the aforementioned embodiment 1 is implemented. The number of processors can be one or more.

[0101] The memory 901 may be a high-speed random access memory (RAM, n do m Access Me m ory) memory, or non-volatile memory ( n o n -volatile m e m The memory 901 is used to store executable program codes, and the processor 902 is coupled to the memory 901.

[0102] Furthermore, the embodiment of the present application also provides a computer-readable storage medium, which can be set in the above-mentioned vehicle audio system. The computer-readable storage medium can be the above-mentioned Fig. 9 Memory in the illustrated embodiment.

[0103] The computer readable storage medium stores a computer program, which, when executed by the processor, implements the audio control method in the aforementioned embodiment. Furthermore, the computer readable storage medium may also be a USB flash drive, a mobile hard disk, a read-only memory (ROM, Read-O n ly Me m ory), RAM, disk or CD-ROM, etc., which can store program code.

[0104] In the several embodiments provided by the present invention, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules is only a logical function division, and there may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

[0105] The modules described as separate components may or may not be physically separated, and the components shown as modules may or may not be physical modules, that is, they may be located in one place or distributed on multiple network modules. Some or all of the modules may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

[0106] In addition, each functional module in each embodiment of the present invention may be integrated into one processing module, or each module may exist physically separately, or two or more modules may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of software functional modules.

[0107] If the integrated module is implemented in the form of a software function module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present invention, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a readable storage medium and includes several instructions for a computer device (which can be a personal computer, server, or network device, etc.) to perform all or part of the steps of the methods of various embodiments of the present invention. The aforementioned readable storage medium includes: U disk, mobile hard disk, ROM, RAM, disk or optical disk and other media that can store program codes.

[0108] It should be noted that, for the above method embodiments, for the sake of simplicity of description, they are all described as a series of action combinations, but those skilled in the art should know that the present invention is not limited by the described action sequence, because according to the present invention, certain steps can be performed in other sequences or simultaneously. Secondly, those skilled in the art should also know that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

[0109] In the above embodiments, the description of each embodiment has its own emphasis. For parts that are not described in detail in a certain embodiment, reference can be made to the relevant descriptions of other embodiments.

[0110] The above is a description of the audio control method, device, and vehicle audio system provided by the present invention. For technicians in this field, according to the ideas of the embodiments of the present invention, there may be changes in the specific implementation methods and application scopes. In summary, the content of this specification should not be understood as limiting the present invention.

Claims

1. An audio control method for a vehicle audio system, wherein the vehicle audio system is equipped with a plurality of target speakers, characterized in that: The audio control method comprises: Obtain the target user's initial auditory model in the in-car acoustic environment and the ideal auditory model in the reference acoustic environment; Fitting the ideal auditory model and the initial auditory model to obtain a difference calculation model of the acoustic signal; Based on the preset fitting constraint condition, the optimal solution of the difference calculation model is obtained, and the optimal solution is determined as the target acoustic characteristic parameter corresponding to the acoustic signal output by each target loudspeaker; the fitting constraint condition is expressed as: in, represents the first sound received by the left ear of the target user in the reference acoustic environment and the in-car acoustic environment The amplitude difference of the acoustic signals of the channels; represents the first sound received by the left ear of the target user in the reference acoustic environment and the in-car acoustic environment The phase difference of the acoustic signals of the channels; represents the first sound received by the right ear of the target user in the reference acoustic environment and the in-car acoustic environment The amplitude difference of the acoustic signals of the channels; represents the first sound received by the right ear of the target user in the reference acoustic environment and the in-car acoustic environment The phase difference of the acoustic signals of the channels; represents the first sound received by the target user in the reference acoustic environment The binaural level difference of the acoustic signals of the channels; represents the first sound received by the target user in the reference acoustic environment The interaural time difference of the acoustic signals of the channels; Indicates the first The binaural level difference of the acoustic signals of the channels; Indicates the first The interaural time difference of the acoustic signals of the channels; The target acoustic transfer functions from each first speaker group to the target user are generated based on the corresponding target acoustic characteristic parameters, and each target acoustic transfer function is updated to the digital filter of the corresponding target speaker.

2. The audio control method of the vehicle audio system according to claim 1, characterized in that: Before obtaining the initial auditory model of the target user in the in-car acoustic environment and the ideal auditory model in the reference acoustic environment, the method further includes: Acquire a first acoustic transfer function from each of the target speakers to a target listening position in the in-vehicle acoustic environment, and acquire a first electroacoustic conversion transfer function of each of the target speakers; wherein the first acoustic transfer function reflects the acoustic physiological characteristics of the target user in the in-vehicle acoustic environment, and the first electroacoustic conversion transfer function reflects the software transfer characteristics and hardware transfer characteristics of the corresponding target speakers; An initial auditory model of the target user in the in-vehicle acoustic environment is constructed based on each of the first acoustic transfer functions and each of the first electroacoustic conversion transfer functions.

3. The audio control method of the vehicle audio system according to claim 2, characterized in that: The initial auditory model is expressed as: in, represents the acoustic signal matrix corresponding to the left ear of the target user in the in-car acoustic environment, represents the acoustic signal matrix corresponding to the right ear of the target user in the in-car acoustic environment, represents the number of original sound source channels of the reference acoustic environment, represents the acoustic signal received by the left ear of the target user, Represents the acoustic signal received by the right ear of the target user.

4. The audio control method of the vehicle audio system according to claim 3, characterized in that: The expression of the acoustic signal received by the left ear of the target user is: The expression of the acoustic signal received by the right ear of the target user is: in, represents the number of original sound source channels of the reference acoustic environment. For each original sound source channel in the reference acoustic environment, there is , is a natural number greater than or equal to 1, Indicates the reference acoustic environment The original sound source signal of each channel; represents the number of target channels of the in-vehicle acoustic environment, where one target speaker in the in-vehicle acoustic environment corresponds to one target channel; for each target channel in the in-vehicle acoustic environment, there is , is a natural number greater than or equal to 1, Indicates the first acoustic transfer function from the target loudspeaker to the left ear of the target user, Indicates a first acoustic transfer function from the target loudspeaker to the right ear of the target user, Indicates the first electroacoustic conversion transfer function of the target loudspeaker, Indicates that the The digital filter transfer function on the target loudspeaker is Represents the reference acoustic environment The channel corresponds to The activation judgment parameters of the target speaker are as follows.

5. The audio control method of the vehicle audio system according to claim 1, characterized in that: A plurality of speaker groups are arranged in the reference acoustic environment, and the number of the target speakers is equal to the number of the speaker groups; Before obtaining the initial auditory model of the target user in the in-car acoustic environment and the ideal auditory model in the reference acoustic environment, the method further includes: Acquire a second acoustic transfer function from each of the speaker groups to an ideal listening position of a target user in a reference acoustic environment, and acquire a second electroacoustic conversion transfer function of each of the speaker groups; wherein the second acoustic transfer function reflects the acoustic physiological characteristics of the target user in the reference acoustic environment, and the second electroacoustic conversion transfer function reflects the software transfer characteristics and hardware transfer characteristics of the corresponding speaker group; An ideal auditory model of the target user in the reference acoustic environment is constructed based on each of the second acoustic transfer functions and each of the second electroacoustic conversion transfer functions.

6. The audio control method of the vehicle audio system according to claim 5, characterized in that: The ideal auditory model is expressed as: in, the acoustic signal matrix corresponding to the left ear of the target user in the reference acoustic environment, represents the acoustic signal matrix corresponding to the right ear of the target user in the reference acoustic environment, represents the number of original sound source channels of the reference acoustic environment, represents the acoustic signal received by the left ear of the target user, represents the acoustic signal received by the right ear of the target user, an original sound source signal representing the reference acoustic environment, represents a second acoustic transfer function from the target speaker group to the left ear of the target user, represents a second acoustic transfer function from the target speaker group to the right ear of the target user, A second electro-acoustic conversion transfer function of the target speaker group is represented.

7. The audio control method of the vehicle audio system according to claim 5, characterized in that: The step of obtaining a second acoustic transfer function from each of the speaker groups in the reference acoustic environment to an ideal listening position where a target user is located comprises: After each of the speaker groups outputs a corresponding first test signal, the sound data returned by the microphone fixed at the ear position of the target user is obtained; wherein the ear position of the target user is the ideal listening position of the target user in the reference acoustic environment; Based on the sound data, a second acoustic transfer function from each of the speaker groups to the ear position of the target user is generated.

8. The audio control method of the vehicle audio system according to claim 5, characterized in that: The obtaining of the second electroacoustic conversion transfer function of each of the speaker groups comprises: After each of the speaker groups outputs a corresponding second test signal, in response to an instruction by the target user to complete a debugging operation on the speaker group, the electroacoustic conversion transfer function of all the speaker groups after the debugging operation is completed is determined as a second electroacoustic conversion transfer function; wherein the debugging operation is used to adjust the electroacoustic conversion transfer function of the target speaker group so that the sound quality of the speaker group meets the listening preference of the target user.

9. The audio control method of the vehicle audio system according to claim 1, characterized in that: The difference calculation model includes a first difference calculation formula, a second difference calculation formula and a third difference calculation formula, wherein the first difference calculation formula is used to calculate the difference between the target acoustic characteristic parameters of the acoustic signal received by the target user in the in-car acoustic environment and the reference acoustic characteristic parameters of the ideal acoustic signal received by the target user in the reference acoustic environment; the second difference calculation formula is used to calculate the binaural hearing difference index of the target user when the acoustic signal output by the same target loudspeaker acts on the target user; the third difference calculation formula is used to calculate the binaural hearing difference index of the target user when the acoustic signal output by the same loudspeaker group in the reference acoustic environment acts on the target user; The step of obtaining an optimal solution of the difference calculation model based on a preset fitting constraint condition, and determining the optimal solution as a target acoustic characteristic parameter corresponding to the acoustic signal output by each target loudspeaker, includes: The optimal solution of the difference calculation model is obtained by taking the result of the first difference calculation formula being zero as a first fitting constraint condition and the settlement result of the second difference calculation formula being equal to the calculation result of the third difference calculation formula as a second fitting constraint condition; The optimal solution is determined as the target acoustic characteristic parameter corresponding to the acoustic signal output by each of the target speakers.

10. The audio control method of the vehicle audio system according to claim 9, characterized in that: The first difference calculation formula is expressed as: And / or, the second difference calculation formula is expressed as: And / or, the third difference calculation formula is expressed as: in, An acoustic signal matrix corresponding to the left ear of the target user in the reference acoustic environment; represents the acoustic signal matrix corresponding to the right ear of the target user in the reference acoustic environment; An acoustic signal matrix corresponding to the left ear of the target user in the in-car acoustic environment; An acoustic signal matrix representing the right ear of the target user in the in-car acoustic environment; represents the number of original sound source channels of the reference acoustic environment. For each original sound source channel in the reference acoustic environment, there is , is a natural number greater than or equal to 1; represents a natural constant; Is an imaginary number.

11. An audio control device for a vehicle audio system, wherein the vehicle audio system is equipped with a plurality of target speakers, characterized in that: The audio control device comprises: An acquisition module, used to acquire an initial auditory model of a target user in an in-car acoustic environment and an ideal auditory model in a reference acoustic environment; A fitting module is used to fit the ideal auditory model and the initial auditory model to obtain a difference calculation model of the acoustic signal; based on a preset fitting constraint condition, an optimal solution of the difference calculation model is obtained, and the optimal solution is determined as a target acoustic characteristic parameter corresponding to the acoustic signal output by each target loudspeaker; the fitting constraint condition is expressed as: in, represents the first sound received by the left ear of the target user in the reference acoustic environment and the in-car acoustic environment The amplitude difference of the acoustic signals of the channels; represents the first sound received by the left ear of the target user in the reference acoustic environment and the in-car acoustic environment The phase difference of the acoustic signals of the channels; represents the first sound received by the right ear of the target user in the reference acoustic environment and the in-car acoustic environment The amplitude difference of the acoustic signals of the channels; represents the first sound received by the right ear of the target user in the reference acoustic environment and the in-car acoustic environment The phase difference of the acoustic signals of the channels; represents the first sound received by the target user in the reference acoustic environment The binaural level difference of the acoustic signals of the channels; represents the first sound received by the target user in the reference acoustic environment The interaural time difference of the acoustic signals of the channels; Indicates the first The binaural level difference of the acoustic signals of the channels; Indicates the first The interaural time difference of the acoustic signals of the channels; A generating module is used to generate target acoustic transfer functions from each first speaker group to the target user based on the corresponding target acoustic characteristic parameters, and update each target acoustic transfer function to a digital filter of the corresponding target speaker.

12. A vehicle audio system, characterized in that: The invention comprises a memory, a processor and a plurality of target speakers, wherein: Each of the target loudspeakers is used to produce sound based on a corresponding target acoustic transfer function; The processor is used to execute the computer program stored in the memory; When the processor executes the computer program, the steps in the method according to any one of claims 1 to 10 are implemented.

Images