Vehicle audio output method, vehicle, and storage medium

Abstract

This application provides a method for audio output in a vehicle, a vehicle, and a storage medium. The method includes: acquiring vehicle operating condition information; constructing a multi-mode control matrix based on the operating condition information, the multi-mode control matrix including a wake-up / sleep control matrix, a fade-in / fade-out control matrix, and an enhancement / decrease control matrix; determining a target preset algorithm from multiple preset algorithms based on the values ​​of parameters in each row of the wake-up / sleep control matrix, and generating an audio signal using the target preset algorithm; processing the audio signal based on the fade-in / fade-out control matrix and the enhancement / decrease control matrix; and outputting the processed audio signal. This application embodiment can process the audio signal based on the multi-mode control matrix, effectively optimizing the generated sound effects and improving the driving experience.

Description

Technical Field

[0001] This application relates to the field of audio processing technology, and more particularly to an audio output method for a vehicle, a vehicle, and a storage medium. Background Technology

[0002] With the development of vehicle technology, electric vehicles and hybrid vehicles have become the main development direction of the market. Electric vehicles and hybrid vehicles are usually driven by relatively quiet electric motors, and the start-stop strategy of hybrid vehicles under engine operation is more complex, with engine speed and vehicle speed not matching. Therefore, it is necessary to optimize the sound feedback during driving to provide the driver with necessary information prompts.

[0003] Active Sound Enhancement (ASE) technology can effectively optimize sound feedback. ASE acquires real-time vehicle operating information, uses algorithms to synthesize sound in real time, and then plays the sound through speakers. However, the sound quality synthesized using algorithms in active sound enhancement is often poor; for example, it lacks realism, fails to capture sound details, and cannot handle sudden changes in operating conditions, thus affecting the driving experience. Summary of the Invention

[0004] In view of the above, it is necessary to provide a vehicle audio output method, a vehicle, and a storage medium to solve the problem that the sound effect synthesized by the algorithm when performing active sound enhancement is poor, thereby affecting the driving experience.

[0005] In a first aspect, embodiments of this application provide an audio output method for a vehicle, applied to a vehicle, the method comprising: acquiring vehicle operating condition information; constructing a multi-mode control matrix based on the operating condition information, the multi-mode control matrix including a wake-up / sleep control matrix, a fade-in / fade-out control matrix, and an enhancement / decrease control matrix; determining a target preset algorithm from multiple preset algorithms based on the values ​​of parameters in each row of the wake-up / sleep control matrix, and generating an audio signal using the target preset algorithm; processing the audio signal based on the fade-in / fade-out control matrix and the enhancement / decrease control matrix; and outputting the processed audio signal.

[0006] In one possible implementation, the multi-mode control matrix is ​​a three-row matrix. Constructing the multi-mode control matrix based on the operating condition information includes: if the vehicle is determined to be an electric vehicle based on the operating condition information, setting the second row parameters of the wake-up / sleep control matrix to a first preset value, setting the first and third row parameters of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / weakening control matrix to second preset values, setting the second row parameters of the fade-in / fade-out control matrix to fade-in / fade-out control parameters, and setting the second row parameters of the enhancement / weakening control matrix to enhancement / weakening control parameters; if the vehicle is determined to be a gasoline vehicle based on the operating condition information, setting the first row parameters of the wake-up / sleep control matrix to the first preset value, setting the second and third row parameters of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / weakening control matrix to the second preset value, and setting the second row parameters of the fade-in / fade-out control matrix to enhancement / weakening control parameters; if the vehicle is determined to be a gasoline vehicle based on the operating condition information, setting the first row parameters of the wake-up / sleep control matrix to the first preset value, setting the second and third row parameters of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / weakening control matrix to the second preset value, and setting the second row parameters of the fade-in / fade-out control matrix to enhancement / weakening control parameters. The first row of parameters of the matrix is ​​set to the fade-in / fade-out control parameters, and the first row of parameters of the enhancement / decrease control matrix is ​​set to the enhancement / decrease control parameters; if the vehicle is determined to be a hybrid vehicle based on the operating condition information, the third row of parameters of the wake-up / sleep control matrix is ​​set to the first preset value, the first and second row parameters of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / decrease control matrix are set to the second preset value, the third row of parameters of the fade-in / fade-out control matrix is ​​set to the fade-in / fade-out control parameters, and the third row of parameters of the enhancement / decrease control matrix is ​​set to the enhancement / decrease control parameters; if it is determined based on the operating condition information that multiple preset algorithms are used to control the audio output of the vehicle, at least two rows of parameters of the wake-up / sleep control matrix are set to the first preset value, and the values ​​of each row of parameters of the fade-in / fade-out control matrix and the enhancement / decrease control matrix are set based on the audio output strategy.

[0007] In one possible implementation, each row of the wake-up / sleep control matrix corresponds to a preset algorithm. The step of determining a target preset algorithm among multiple preset algorithms based on the value of each row of the wake-up / sleep control matrix includes: if the value of the first row of the wake-up / sleep control matrix is ​​the first preset value, and the second and third row of the wake-up / sleep control matrix are the second preset values, then the target preset algorithm is determined to be an order simulation algorithm.

[0008] In one possible implementation, generating the audio signal using the target preset algorithm includes: constructing a relationship curve between the sound pressure gain of multiple orders of audio signals and the nominal engine speed; obtaining the engine speed from the operating condition information and converting the engine speed into the corresponding nominal engine speed; calculating the frequency of each order of audio signal corresponding to the nominal engine speed; calculating the audio signal of each order based on the frequency, and superimposing the audio signals of each order.

[0009] In one possible implementation, each row of parameters of the wake-up / sleep control matrix corresponds to a preset algorithm. The step of determining a target preset algorithm among multiple preset algorithms based on the value of each row of parameters of the wake-up / sleep control matrix includes: if the value of the second row of parameters of the wake-up / sleep control matrix is ​​the first preset value, and the first row of parameters and the third row of parameters of the wake-up / sleep control matrix are the second preset values, then the target preset algorithm is determined to be an audio pitch shifting algorithm.

[0010] In one possible implementation, generating the audio signal using the target preset algorithm includes: acquiring a steady-state audio signal, determining a first frequency of the steady-state audio signal before pitch shifting and a second frequency of the steady-state audio signal after pitch shifting, and calculating a pitch shifting coefficient based on the first frequency and the second frequency; calculating an audio output signal based on the first frequency, and performing pitch shifting processing on the audio output signal based on the pitch shifting coefficient.

[0011] In one possible implementation, each row of the wake-up / sleep control matrix corresponds to a preset algorithm. The step of determining a target preset algorithm among multiple preset algorithms based on the value of each row of the wake-up / sleep control matrix includes: if the value of the third row of the wake-up / sleep control matrix is ​​the first preset value, and the first row of the wake-up / sleep control matrix and the second row of the wake-up / sleep control matrix are the second preset values, then the target preset algorithm is determined to be a particle synthesis algorithm.

[0012] In one possible implementation, generating the audio signal using the target preset algorithm includes: acquiring an original sound sample, dividing the original sound sample into multiple sound particles to obtain a sound particle library; determining two sound particles corresponding to the working condition information; and splicing the two sound particles to obtain the audio signal.

[0013] In one possible implementation, processing the audio signal based on the fade-in / fade-out control matrix and the enhancement / attenuation control matrix includes: determining the fade-in / fade-out time of the audio signal based on the fade-in / fade-out control matrix; determining the gain value of the audio signal based on the enhancement / attenuation control matrix; and processing the audio signal based on the fade-in / fade-out time and the gain value.

[0014] In one possible implementation, the method further includes: determining at least one gain parameter based on the operating condition information, and processing the audio signal based on the at least one gain parameter.

[0015] Secondly, embodiments of this application provide an audio output device for a vehicle, the device comprising: an acquisition module for acquiring vehicle operating condition information; a construction module for constructing a multi-mode control matrix based on the operating condition information, the multi-mode control matrix including a wake-up / sleep control matrix, a fade-in / fade-out control matrix, and an enhancement / decrease control matrix; a generation module for determining a target preset algorithm from multiple preset algorithms based on the values ​​of parameters in each row of the wake-up / sleep control matrix, and generating an audio signal using the target preset algorithm; a processing module for processing the audio signal based on the fade-in / fade-out control matrix and the enhancement / decrease control matrix; and an output module for outputting the processed audio signal.

[0016] Thirdly, embodiments of this application provide a vehicle, the vehicle including a memory and a processor: wherein the memory is used to store program instructions; the processor is used to read and execute the program instructions stored in the memory, and when the program instructions are executed by the processor, the vehicle performs the above-described audio output method for the vehicle.

[0017] Fourthly, embodiments of this application provide a computer storage medium storing program instructions that, when executed on a vehicle, cause the vehicle's processor to perform the aforementioned vehicle audio output method.

[0018] The vehicle audio output method, device, vehicle, and storage medium provided in this application embodiment can construct a multi-mode control matrix based on the vehicle's operating condition information, determine a target preset algorithm from multiple preset algorithms based on the multi-mode control matrix, generate an audio signal using the target preset algorithm, and process the audio signal based on the multi-mode control matrix to effectively optimize the generated sound effect and improve the driving experience. Attached Figure Description

[0019] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0020] Figure 1 This is a schematic diagram illustrating an application scenario of the audio output method for a vehicle provided in one embodiment of this application.

[0021] Figure 2 This is a flowchart of a vehicle audio output method provided in an embodiment of this application.

[0022] Figure 3 This is a flowchart of generating an audio signal provided in one embodiment of this application.

[0023] Figure 4 This is another flowchart of generating an audio signal provided in one embodiment of this application.

[0024] Figure 5 This is another flowchart of generating an audio signal provided in one embodiment of this application.

[0025] Figure 6 This is a flowchart of a vehicle audio output method provided in another embodiment of this application.

[0026] Figure 7 This is a schematic diagram of an audio control interface provided in an embodiment of this application.

[0027] Figure 8 This is a schematic diagram of the structure of an audio output device provided in an embodiment of this application.

[0028] Figure 9 This is a schematic diagram of the hardware structure of a vehicle provided in one embodiment of this application. Detailed Implementation

[0029] The terms "first" and "second" used in the embodiments of this application are for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include one or more features. In the description of the embodiments of this application, words such as "exemplary" or "for example" are used to indicate examples, illustrations, or descriptions. Any embodiment or design described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present the relevant concepts in a concrete manner.

[0030] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application pertains. The terminology used in this application's specification is for the purpose of describing particular embodiments only and is not intended to limit the application. It should be understood that, unless otherwise stated, " / " in this application means "or". For example, A / B can mean A or B. "And / or" in this application is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A alone, A and B simultaneously, and B alone. "At least one" refers to one or more. "More than one" refers to two or more. For example, at least one of a, b, or c can represent: a, b, c, a and b, a and c, b and c, and a, b, and c. Where there is no conflict, the following embodiments and features described herein can be combined with each other.

[0031] With the development of vehicle technology, electric vehicles and hybrid vehicles have become the main development direction of the market. Electric vehicles and hybrid vehicles are usually driven by relatively quiet electric motors, and the start-stop strategy of hybrid vehicles under engine operation is more complex, with engine speed and vehicle speed not matching. Therefore, it is necessary to optimize the sound feedback during driving, generating and outputting simulated audio based on vehicle operating information. For example, generating and outputting simulated braking sounds when the vehicle brakes, and generating and outputting simulated engine sounds of different volumes when the vehicle accelerates or decelerates, thereby providing the driver with necessary information prompts.

[0032] Active sound enhancement technology acquires vehicle operating information in real time, synthesizes sound in real time through algorithmic strategies, and then plays the sound through speakers. However, the sound quality synthesized by algorithms in active sound enhancement is often poor, thus affecting the driving experience. For example, current active sound algorithms include three types: order simulation, audio pitch shifting, and particle synthesis, but these three algorithms differ in various aspects such as applicable scenarios, computational power consumption, and sound effect characteristics. Specifically, the order simulation algorithm achieves active sound generation by analyzing the order components of the engine, making it suitable for simulating the sound of engine characteristics. Because it uses a sine wave as the basic sound source based on the Fourier principle, it requires minimal memory and computing resources. However, the synthesized sound is difficult to make realistic and struggles to simulate sudden changes in operating conditions such as gear shifting. The audio pitch shifting algorithm uses several key sound source elements as a basis and employs frequency shifting to simulate acceleration conditions. Because the pitch shifting algorithm can achieve a large frequency change rate and uniform sound source changes, it is suitable for simulating the sound of electric drives, producing realistic and linear sound simulations. However, it struggles to represent sound details. The particle synthesis algorithm is suitable for simulating both of the above scenarios. By subdividing the sound across the entire operating condition range into particles and synthesizing them in real time, it can theoretically simulate any sound feature during the early sound design stage. However, this method consumes enormous computing resources, and synthesizing sound under transient operating conditions remains a challenge.

[0033] This application provides a method for audio output of a vehicle, which can construct a multi-mode control matrix based on the vehicle's operating condition information, determine a target preset algorithm from multiple preset algorithms based on the multi-mode control matrix to generate an audio signal, and process the audio signal based on the multi-mode control matrix to effectively optimize the generated sound effect and improve the driving experience.

[0034] See Figure 1 The diagram shown is an application environment schematic of the audio output method for a vehicle provided in an embodiment of this application. Figure 1 The audio output system 100 shown includes a control interface 10, a controller 20, and a vehicle speaker 30. In embodiments of this application, the controller 20 may deploy a computer program product (e.g., software code, computer-readable instructions, etc.) programmed according to the vehicle audio output method provided in the embodiments of this application, thereby providing audio output services for the vehicle. The control interface 10 is used for users to control the vehicle's audio output, such as setting algorithms or parameters for audio generation or processing; the controller 20 is used to execute audio generation and processing; and the vehicle speaker 30 is used to output the generated and processed audio.

[0035] See Figure 2 The diagram shown is a flowchart of a vehicle audio output method according to an embodiment of this application. The method is applied to a vehicle, and the vehicle audio output method includes:

[0036] S101, obtain vehicle operating condition information.

[0037] In one embodiment of this application, real-time operating condition information of the vehicle is acquired at preset intervals, such as 5 seconds, 8 seconds, 10 seconds, or other suitable times. The real-time operating condition information includes, but is not limited to, engine speed (engine speed or electric motor speed), vehicle speed, pedal depth, and steering wheel torque. The vehicle controller is connected to the various sensors of the vehicle via a CAN (Controller Area Network) bus, and acquires real-time operating condition information by receiving CAN signals sent by each sensor.

[0038] S102, Construct a multi-mode control matrix based on operating condition information. This multi-mode control matrix is ​​a 3×1 matrix (three rows and one column), and includes, but is not limited to, a wake-up / sleep control matrix. Fade-in / Fade-out control matrix and enhance / weaken control matrix .

[0039] In one embodiment of this application, in the above three matrices, the first row of parameters is used to control the order simulation algorithm, the second row of parameters is used to control the audio pitch shifting algorithm, and the third row of parameters is used to control the particle synthesis algorithm. Used to control the wake-up or sleep of the corresponding algorithm, where A value of 1 or 0 represents the algorithm being enabled or disabled, respectively; the matrix This is used to control the fade-in or fade-out of the synthesized sound by the corresponding algorithm. Fade-in refers to the volume gradually increasing from zero when the audio starts outputting or playing until it reaches a preset normal volume level. Fade-out refers to the volume gradually decreasing from the normal level when the audio ends playing until it disappears completely. The value range is [-100, 0], representing the proportion of the audio sequence relative to the vehicle speed sequence that the fade-in / fade-out strategy occupies. -100 means that fade-in / fade-out processing is performed throughout the entire vehicle speed sequence, and 0 means that no fade-in / fade-out processing is performed. It can take any negative integer value between -100 and 0; matrix Used to control the enhancement or reduction of the synthesized sound by the corresponding algorithm, where The value range is [-12, 12], representing the overall enhancement / reduction of the sound pressure level of the synthesized sound by the corresponding algorithm. -12 represents a reduction of -12dB, and 12 represents an enhancement of 12dB. It can take any value between -12 and 12.

[0040] In one embodiment of this application, the vehicle type or control mode is determined based on the rotational speed in the operating condition information. If the operating condition information includes the electric motor speed, the vehicle is determined to be an electric vehicle. If the operating condition information includes the engine speed, the vehicle is determined to be a gasoline-powered vehicle. If the operating condition information includes both the electric motor speed and the engine speed, the vehicle is determined to be a hybrid vehicle.

[0041] If the vehicle is determined to be an electric vehicle based on the operating condition information, the second row of parameters in the wake-up / sleep control matrix is ​​set to the first preset value; the first and third row parameters of the wake-up / sleep control matrix, fade-in / fade-out control matrix, and enhancement / decrease control matrix are set to the second preset values; the second row parameters of the fade-in / fade-out control matrix are set to fade-in / fade-out control parameters; and the second row parameters of the enhancement / decrease control matrix are set to enhancement / decrease control parameters. For example, the first preset value is 1, and the second preset value is 0.

[0042] Wake-up / Sleep Control Matrix ;

[0043] Fade-in / Fade-out Control Matrix ;

[0044] Enhance / weaken control matrix .

[0045] The above example shows that the audio pitch shifting algorithm can be activated, while the other two algorithms remain dormant without consuming computing power and memory. The fade-in / fade-out control parameter is -50, and the boost / deboost control parameter is 10, indicating a boost of 10 dB. At this time, the audio pitch shifting algorithm synthesizes sound samples whose frequency changes with the motor speed based on steady-state audio. Since the dynamic range of the sound sample frequency is wide, the dynamic range of the synthesized sound frequency in this mode is also wide, making it suitable for simulating the sci-fi style sound of electric vehicles.

[0046] If the vehicle is determined to be a gasoline vehicle based on operating condition information, the first row of parameters in the wake-up / sleep control matrix is ​​set to a first preset value; the second and third rows of parameters in the wake-up / sleep control matrix, fade-in / fade-out control matrix, and enhancement / depression control matrix are set to second preset values; the first row of parameters in the fade-in / fade-out control matrix is ​​set to fade-in / fade-out control parameters; and the first row of parameters in the enhancement / depression control matrix is ​​set to enhancement / depression control parameters. For example, the first preset value is 1, and the second preset value is 0.

[0047] Wake-up / Sleep Control Matrix ;

[0048] Fade-in / Fade-out Control Matrix ;

[0049] Enhance / weaken control matrix .

[0050] The above example shows that the order simulation algorithm can be activated, while the other two algorithms remain dormant without consuming computing power and memory. The fade-in / fade-out control parameter is -20, and the enhancement / attenuation control parameter is -8, indicating a reduction of -8dB. At this time, the order simulation algorithm synthesizes sound samples based on the order sound pressure curve with nominal engine speed. Since the order components are mainly engine order components, it is suitable for simulating a sound style with engine power.

[0051] If the vehicle is determined to be a hybrid vehicle based on operating condition information, the third row of parameters in the wake-up / sleep control matrix is ​​set to the first preset value. The first and second row parameters of the wake-up / sleep control matrix, fade-in / fade-out control matrix, and enhancement / decrease control matrix are set to the second preset values. The third row parameters of the fade-in / fade-out control matrix are set to fade-in / fade-out control parameters, and the third row parameters of the enhancement / decrease control matrix are set to enhancement / decrease control parameters. For example, the first preset value is 1, and the second preset value is 0. For example:

[0052] Wake-up / Sleep Control Matrix ;

[0053] Fade-in / Fade-out Control Matrix ;

[0054] Enhance / weaken control matrix .

[0055] The above example shows that the particle synthesis algorithm can be activated, while the other two algorithms remain dormant without consuming computing power and memory. The fade-in / fade-out control parameter is -60, and the enhancement / decrease control parameter is 6, indicating an enhancement of 6dB. At this time, the particle synthesis algorithm synthesizes sound samples based on the previous sound design samples and follows the actual vehicle conditions. Since the driving modes of hybrid vehicles are complex, there are multiple driving strategies such as electric drive, engine drive, and hybrid drive. Therefore, the particle algorithm is suitable for accurate sound matching under these modes without having to consider the sudden changes in sound caused by complex power mode switching.

[0056] If hybrid control of the vehicle is determined based on operating condition information, at least two rows of parameters in the wake-up / sleep control matrix are set to the first preset value, and the values ​​of each row of parameters in the fade-in / fade-out control matrix and the boost / decrease control matrix are set based on the audio output strategy. For example:

[0057] The wake-up / sleep control matrix is or or or .

[0058] The above example indicates that three algorithms, or two of them, are activated. , The matrix-adapted sound strategy sets corresponding parameters. Taking the case where all three algorithms are activated as an example, the audio pitch-shifting algorithm simulates the basic timbre of the sound sample by shifting the pitch of the basic steady-state sound source. The order synthesis algorithm adds some order components to enhance the sense of power in certain working conditions (such as engine starting or vehicle braking). Under strategies such as gear shifting and vehicle speed announcement, the particle synthesis algorithm plays particles of the preset sound source, ultimately achieving a multi-layered active sound control effect.

[0059] S103, based on the values ​​of the parameters in each row of the wake-up / sleep control matrix, determines the target preset algorithm from multiple preset algorithms, and uses the target preset algorithm to generate an audio signal.

[0060] In one embodiment of this application, the multiple preset algorithms include an order simulation algorithm, an audio pitch shifting algorithm, and a particle synthesis algorithm, and each row of parameters in the wake-up / sleep control matrix corresponds to one preset algorithm.

[0061] If the first row of parameters in the wake-up / sleep control matrix has a first preset value, and the other two rows have second preset values, then the target preset algorithm is determined to be an order-wise simulation algorithm. For example, if the first preset value is 1 and the second preset value is 0, that is, the first row parameter a in the wake-up / sleep control matrix A1 has a first preset value. 11 The value is 1, and the other two lines of parameters a 21 and a 31 If the value is 0, then the order simulation algorithm is executed.

[0062] See Figure 3 The diagram shown is a flowchart of generating an audio signal according to an embodiment of this application.

[0063] S201, construct the relationship curves between the sound pressure gain of multiple orders of audio signals and the corresponding nominal engine speed.

[0064] In one embodiment of this application, the order is Based on the sound pressure gain of each order Sample data and sound pressure gain of each order The sample data corresponds to the sample data of the nominal engine speed, and the sample data of each order are used to construct the sample data. Sound pressure gain The curve showing the relationship between the engine speed and the corresponding nominal engine speed (rpm).

[0065] S202, obtain the powertrain speed (RPM) from the operating condition information.

[0066] In one embodiment of this application, for an electric vehicle, the powertrain speed is the electric motor speed; for a gasoline vehicle, the powertrain speed is the engine speed; and for a hybrid vehicle, the powertrain speed includes a combined speed determined based on the electric motor speed and the engine speed.

[0067] S203 converts the powertrain speed into the corresponding nominal engine speed.

[0068] In one embodiment of this application, based on the vehicle speed matching relationship, the powertrain speed (RPM) is converted into the nominal engine speed (rpm) according to a corresponding ratio. For example, the vehicle has a preset correspondence between vehicle speed and ratio (i.e., the ratio between powertrain speed and nominal engine speed). The current vehicle speed in the operating condition information is obtained, and based on the current vehicle speed and the correspondence between vehicle speed and ratio, the ratio corresponding to the current vehicle speed is determined. Then, based on this ratio, the powertrain speed (RPM) is converted into the nominal engine speed (rpm).

[0069] S204 calculates the frequency of the audio signal at each order at the nominal engine speed.

[0070] In one embodiment of this application, the frequency f of each order at the nominal engine speed is... i The calculation formula is:

[0071] (1).

[0072] S205 calculates the audio signal of each order based on the frequency, and superimposes the audio signals of each order to obtain the audio output signal.

[0073] In one embodiment of this application, the audio signal of each order is calculated. The calculation formula is:

[0074] (2).

[0075] In the above calculation formula (2), The phase corresponding to each order of audio signal harmonics, This represents the sound pressure gain of each order of audio signal corresponding to the nominal engine speed.

[0076] Each level of audio signal The formula for superposition is:

[0077] (3).

[0078] In the above calculation formula, This is the first fitting order. This is the last fitting order.

[0079] If the value of the second row of parameters in the wake-up / sleep control matrix is ​​the first preset value, and the values ​​of the other two rows of parameters are the second preset values, then the target preset algorithm is determined to be an audio pitch-shifting algorithm. For example, if the first preset value is 1 and the second preset value is 0, that is, the second row parameter a in the wake-up / sleep control matrix A1... 21 The value is 1, and the other two lines of parameters a 11 and a 31 If the value is 0, the audio pitch shifting algorithm will be executed.

[0080] See Figure 4 The diagram shown is another flowchart of generating an audio signal according to an embodiment of this application.

[0081] S301, acquire a steady-state audio signal, determine the first frequency of the steady-state audio signal before pitch shifting and the second frequency after pitch shifting, and calculate the pitch shift coefficient based on the first frequency and the second frequency.

[0082] In one embodiment of this application, a preset steady-state audio signal is acquired. Determine the first frequency of the steady-state audio signal before pitch shifting. and the second frequency after modulation processing First frequency Second frequency All values ​​are preset values, and the modulation coefficient is calculated based on the first and second frequencies. The calculation formula is:

[0083] (4).

[0084] S302 calculates the audio output signal based on the first frequency and performs pitch shifting processing on the audio output signal based on the pitch shifting coefficient.

[0085] In one embodiment of this application, the audio signal is stretched and compressed in the time dimension to achieve a pitch shifting effect. Specifically, the audio output signal is calculated based on a first frequency. The calculation formula is:

[0086]

[0087] (5).

[0088] The formula for calculating the pitch shift of the audio output signal based on the pitch shift coefficient is as follows:

[0089] (6).

[0090] In calculation formulas (5) and (6), Indicates the audio input signal. Indicates the length of the audio frame. This represents the integer operation. Modulo operation is represented. This indicates the audio output signal. When... At that time, the audio pitch was raised. At that time, the audio pitch drops.

[0091] If the value of the third row parameter in the wake-up / sleep control matrix is ​​the first preset value, and the values ​​of the other two rows parameter are the second preset values, then the target preset algorithm is determined to be the particle synthesis algorithm. For example, if the first preset value is 1 and the second preset value is 0, that is, the third row parameter a in the wake-up / sleep control matrix A1... 31 The value is 1, and the other two lines of parameters a 11 and a 21 If the value is 0, then the particle synthesis algorithm is executed.

[0092] See Figure 5 The diagram shown is another flowchart of generating an audio signal according to an embodiment of this application.

[0093] S401, Obtain the original sound sample, divide the original sound sample into multiple sound particles, and obtain the sound particle library.

[0094] In one embodiment of this application, the original sound sample is obtained. The original sound samples were then segmented into particle libraries using a short-time strategy. ,in This refers to the particle index. The duration or length of each sound particle can be preset. Based on the duration of each sound particle, the original sound sample is divided into multiple sound particles, resulting in a sound particle library. For example, the duration or length of each sound particle is between 1 and 50 milliseconds.

[0095] S402, determine the two sound particles corresponding to the operating condition information.

[0096] In one embodiment of this application, the corresponding sound particle number is determined based on the vehicle's real-time operating condition information such as rotational speed, vehicle speed, and torque. and index the corresponding particle samples. and The vehicle has a pre-defined correspondence between operating condition information and sound particle serial numbers. Based on the real-time operating condition information and this correspondence, the sound particle serial number corresponding to the real-time operating condition information is determined. Then, the corresponding particle sample is obtained based on the sound particle serial number index. The obtained particle sample includes the particle sample corresponding to the sound particle serial number and the next particle sample of the particle sample corresponding to the sound particle serial number.

[0097] In another embodiment of this application, the vehicle has a pre-defined correspondence between vehicle status and sound particle serial numbers. The real-time vehicle status is determined based on real-time operating condition information, and the sound particle serial number corresponding to the real-time operating condition information is determined based on the real-time vehicle status and the correspondence between the vehicle status and the sound particle serial numbers. Vehicle status includes, but is not limited to: acceleration, deceleration, braking, engine start, and engine shutdown.

[0098] S403 splices two sound particles to obtain an audio signal.

[0099] In one embodiment of this application, the particle is processed based on an overlap-addition strategy. and To obtain the audio source output, the audio is spliced ​​together. In other words, .

[0100] S104 processes the audio signal based on the fade-in / fade-out control matrix and the enhancement / attenuation control matrix.

[0101] In one embodiment of this application, the fade-in and fade-out times of the audio signal are determined based on a fade-in / fade-out control matrix, the gain value of the audio signal is determined based on an enhancement / attenuation control matrix, and the audio signal is processed based on the fade-in / fade-out times and the gain value. The fade-in / fade-out processing method may include linear fade-in / fade-out, logarithmic fade-in / fade-out, half-sine fade-in / fade-out, etc.

[0102] In one embodiment of this application, a vehicle speed data sequence during driving is acquired. This sequence includes the initial speed, the final speed, and intermediate speed changes. Based on the speed data and the vehicle's travel distance, the total time corresponding to the entire speed sequence is calculated, for example, based on parameters such as speed changes and acceleration. The fade-in / fade-out time is determined based on fade-in / fade-out parameters and the total time corresponding to the entire speed sequence. For example, if the fade-in / fade-out parameter is -100, the fade-in / fade-out time can be set to be the same as the total time corresponding to the entire speed sequence. If the fade-in / fade-out parameter is -50, the fade-in / fade-out time can be set to half the total time corresponding to the entire speed sequence. If the fade-in / fade-out parameter is -20, the fade-in / fade-out time can be set to 20% of the total time corresponding to the entire speed sequence.

[0103] In one embodiment of this application, if the target preset algorithm is an order-based analog algorithm, the processed audio signal is: , The generated audio output signal; if the target preset algorithm is an audio pitch shifting algorithm, the processed audio signal is , The generated audio output signal; if the target preset algorithm is a particle synthesis algorithm, the processed audio signal is , This is the generated audio output signal.

[0104] In one embodiment of this application, in the fade-in / fade-out control matrix In the middle, a i2 This indicates the ratio between the vehicle speed at which fade-in and fade-out are applied to the audio and the total vehicle speed, denoted as 'a'. i2 The range of values ​​for a is [x, 0], where x is a negative integer, for example, -100. Therefore, a i2 It is any negative integer between -100 and 0.

[0105] In one embodiment of this application, in enhancing / weakening the control matrix In the middle, a i3 Indicates the enhancement / decrease of sound pressure level in audio, a i3 The value range is [-m, m], where m is a positive integer. -m indicates a reduction of -mdB in audio, and m indicates an enhancement of mdB in audio. For example, the value of m is 12.

[0106] S105 outputs the processed audio signal.

[0107] In one embodiment of this application, the processed audio signal is output through a vehicle speaker.

[0108] Through the above embodiments of this application, a multi-mode control matrix can be constructed based on the vehicle's operating condition information. A target preset algorithm can be determined from multiple preset algorithms based on the multi-mode control matrix. An audio signal can be generated using the target preset algorithm. The audio signal can be processed based on the multi-mode control matrix to effectively optimize the generated sound effect and improve the driving experience.

[0109] See Figure 6 The diagram shown is a flowchart of a vehicle audio output method provided in another embodiment of this application.

[0110] S501, obtain vehicle operating condition information.

[0111] S502 constructs a multi-mode control matrix based on operating condition information.

[0112] S503 determines the target preset algorithm from multiple preset algorithms based on the value of each row parameter of the wake-up / sleep control matrix, and uses the target preset algorithm to generate an audio signal.

[0113] The S504 processes audio signals based on fade-in / fade-out control matrices and boost / debuff control matrices.

[0114] S505 determines at least one gain parameter based on operating condition information and processes the audio signal based on the at least one gain parameter.

[0115] In one embodiment of this application, the vehicle further has a preset correspondence between multiple vehicle speeds and multiple vehicle speed gain parameters, as well as a correspondence between multiple pedal depths and multiple pedal gain parameters. The corresponding vehicle speed gain parameter is determined based on the vehicle speed in the real-time operating condition information, and the corresponding pedal gain parameter is determined based on the pedal depth in the real-time operating condition information. The generated audio signal is processed based on the vehicle speed gain parameter and the pedal gain parameter. For example, a target gain parameter is determined based on the vehicle speed gain parameter, the pedal gain parameter, and the enhancement / attenuation control matrix. The generated audio signal is processed based on the target gain parameter. For example, if the target gain parameter is a target sound pressure level, the target sound pressure level is converted into a target gain factor, and the target gain factor is multiplied by the generated audio signal to process the audio signal.

[0116] S506 outputs the processed audio signal.

[0117] The specific implementation methods of S501-S504 and S506 are the same as those of S101-S105, and will not be described in detail here.

[0118] Through the above embodiments of this application, gain parameters related to vehicle operating condition information, such as vehicle speed-related gain and accelerator pedal-related gain, can be obtained. The synthesized audio signal is processed using these gain parameters to finally obtain an active sound synthesized sound that varies with vehicle speed and accelerator pedal and integrates multiple sound modes. This sound is then played through in-vehicle speakers to further optimize the active sound effect and improve the driving experience.

[0119] See Figure 7 The diagram shown is a schematic of an audio control interface provided in an embodiment of this application. Figure 7 The audio control interface can be the interface of sound wave tuning software. In one embodiment of this application, the audio control interface includes an interactive interface module (corresponding to...). Figure 7 The "Communication Interface Settings" area), the ASE system control module (corresponding to) Figure 7 The "Sound Control" area), and the multi-mode sound tuning module (corresponding to) Figure 7 The “Synthesis Algorithm Parameter Debugging” area and the CAN information display module (corresponding to) Figure 7The "CAN Information Display" area is used for configuring the communication interface, enabling communication and data exchange between the sound tuning software and the controller. The ASE system control module enables real-time control of the ASE system, providing algorithm options such as GAC frequency shift, WHUT frequency shift, and harmonic synthesis, allowing selection of the sound control algorithm. The multi-mode sound tuning module controls various algorithm modes, providing parameter settings or adjustments for different algorithms. The CAN information display module displays real-time information such as the vehicle's RPM, speed, pedal depth, and torque, facilitating the acquisition of operating condition information during sound modulation.

[0120] See Figure 8 The diagram shown is a structural schematic of an audio output device according to an embodiment of this application. In one embodiment of this application, the audio output device 200 may include multiple functional modules composed of computer program segments. The computer program segments in the audio output device 200 may be stored in the vehicle's memory and executed by at least one processor to perform audio output functions.

[0121] In one embodiment of this application, the audio output device 200 can be divided into multiple functional modules according to the functions it performs. The functional modules of the audio output device 200 may include: an acquisition module 201, a construction module 202, a generation module 203, a processing module 204, and an output module 205. In this embodiment, a module refers to a series of computer program segments that can be executed by at least one processor and perform a fixed function, and which are stored in memory.

[0122] The acquisition module 201 is used to acquire the vehicle's operating condition information.

[0123] The construction module 202 is used to construct a multi-mode control matrix based on operating condition information. The multi-mode control matrix includes a wake-up / sleep control matrix, a fade-in / fade-out control matrix, and an enhancement / weakening control matrix.

[0124] The generation module 203 is used to determine a target preset algorithm from multiple preset algorithms based on the values ​​of the parameters in each row of the wake-up / sleep control matrix, and to generate an audio signal using the target preset algorithm.

[0125] The processing module 204 is used to process the audio signal based on the fade-in / fade-out control matrix and the enhancement / attenuation control matrix.

[0126] The output module 205 is used to output the processed audio signal.

[0127] This application also provides a vehicle 1, see embodiment 1. Figure 9The diagram shown is a schematic of the hardware structure of a vehicle according to an embodiment of this application. The audio output method of the vehicle provided in this embodiment is applied to vehicle 1, which includes, but is not limited to, a processor 110 and a memory 120 connected via a communication bus 130. Figure 9 This is merely an example of a vehicle and does not constitute a limitation thereof. In other embodiments, the vehicle may include more components than those shown in the figure.

[0128] The memory 120 may include one or more random access memory (RAM) and one or more non-volatile memory (NVM). The RAM can be directly read and written by the processor 110 and can be used to store executable programs (such as machine instructions) of the operating system or other running programs, as well as user and application data. The RAM may include static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), etc.

[0129] Non-volatile memory can also store executable programs and user and application data, and can be pre-loaded into random access memory for direct reading and writing by the processor 110. Non-volatile memory can include disk storage devices and flash memory.

[0130] The memory 120 is used to store one or more computer programs. The one or more computer programs are configured to be executed by the processor 110. The one or more computer programs include a plurality of instructions that, when executed by the processor 110, enable a vehicle audio output method to be performed on the vehicle 1.

[0131] In other embodiments, the vehicle 1 further includes an external memory interface for connecting to an external memory to expand the storage capacity of the vehicle 1.

[0132] Processor 110 may include one or more processing units, such as an application processor (AP), a modem processor, a graphics processing unit (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural network processing unit (NPU). These different processing units may be independent devices or integrated into one or more processors.

[0133] The processor 110 provides computing and control capabilities, for example, the processor 110 is used to execute computer programs stored in the memory 120 to implement the above-described audio output method of the vehicle.

[0134] The communication bus 130 is used at least to provide a channel for communication between the memory 120 and the processor 110 in the vehicle 1.

[0135] It is understood that the structures illustrated in the embodiments of this application do not constitute a specific limitation on vehicle 1. In other embodiments of this application, vehicle 1 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0136] This application embodiment also provides a computer storage medium storing computer instructions. When the computer instructions are executed on vehicle 1, vehicle 1 performs the aforementioned related method steps to implement the vehicle audio output method in the above embodiment.

[0137] This application also provides a computer program product that, when run on a computer, causes the computer to perform the aforementioned steps to implement the vehicle audio output method described in the above embodiments.

[0138] In addition, embodiments of this application also provide an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory; wherein, the memory is used to store computer execution instructions, and when the apparatus is running, the processor may execute the computer execution instructions stored in the memory to cause the chip to execute the vehicle audio output method in the above method embodiments.

[0139] In this application, the hardware device, computer storage medium, computer program product or chip provided in the embodiments are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0140] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0141] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the mutual coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.

[0142] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.

[0143] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.

[0144] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, or the parts or all or part of the technical solutions that contribute to the prior art, can be embodied in the form of a software product. The software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.

[0145] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application and are not intended to limit it. Although this application has been described in detail with reference to preferred embodiments, those skilled in the art should understand that modifications or equivalent substitutions can be made to the technical solutions of this application without departing from the spirit and scope of the technical solutions of this application.

Claims

1. A method for audio output in a vehicle, characterized in that, The method includes: Obtain vehicle operating condition information; A multi-mode control matrix is ​​constructed based on the operating condition information. The multi-mode control matrix is ​​a three-row matrix, including a wake-up / sleep control matrix, a fade-in / fade-out control matrix, and an enhancement / depression control matrix. The construction of the multi-mode control matrix based on the operating condition information includes: if the vehicle is determined to be a fuel vehicle based on the operating condition information, setting the first row parameters of the wake-up / sleep control matrix to a first preset value, setting the second and third row parameters of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / depression control matrix to a second preset value, setting the first row parameters of the fade-in / fade-out control matrix to fade-in / fade-out control parameters, and setting the first row parameters of the enhancement / depression control matrix to enhancement / depression control parameters. Based on the values ​​of the parameters in each row of the wake-up / sleep control matrix, a target preset algorithm is determined from multiple preset algorithms, and an audio signal is generated using the target preset algorithm. The determination of the target preset algorithm based on the values ​​of the parameters in each row of the wake-up / sleep control matrix includes: if the value of the first row of the wake-up / sleep control matrix is ​​the first preset value, and the second and third row of the wake-up / sleep control matrix are the second preset values, the target preset algorithm is determined to be an order simulation algorithm. The audio signal is processed based on the fade-in / fade-out control matrix and the enhancement / decrease control matrix. The processed audio signal is output.

2. The audio output method for a vehicle as described in claim 1, characterized in that, The construction of the multi-mode control matrix based on the operating condition information further includes: If the vehicle is determined to be an electric vehicle based on the operating condition information, the second row parameters of the wake-up / sleep control matrix are set to a first preset value, the first row parameters and the third row parameters of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / depression control matrix are set to a second preset value, the second row parameters of the fade-in / fade-out control matrix are set to fade-in / fade-out control parameters, and the second row parameters of the enhancement / depression control matrix are set to enhancement / depression control parameters. If the vehicle is determined to be a hybrid vehicle based on the operating condition information, the third row parameter of the wake-up / sleep control matrix is ​​set to the first preset value, the first row parameter and the second row parameter of the wake-up / sleep control matrix, the fade-in / fade-out control matrix and the enhancement / depression control matrix are set to the second preset value, the third row parameter of the fade-in / fade-out control matrix is ​​set to the fade-in / fade-out control parameter, and the third row parameter of the enhancement / depression control matrix is ​​set to the enhancement / depression control parameter; If, based on the operating condition information, it is determined that multiple preset algorithms are used to control the audio output of the vehicle, at least two rows of parameters of the wake-up / sleep control matrix are set to the first preset value, and the values ​​of each row of parameters of the fade-in / fade-out control matrix and the enhancement / decrease control matrix are set based on the audio output strategy.

3. The audio output method for a vehicle as described in claim 1, characterized in that, The process of generating the audio signal using the target preset algorithm includes: Construct curves showing the relationship between sound pressure gain and nominal engine speed for multiple orders of audio signals; Obtain the engine speed from the operating condition information and convert the engine speed into the corresponding nominal engine speed; Calculate the frequency of the audio signal of each order corresponding to the nominal engine speed; The audio signal of each order is calculated based on the frequency, and the audio signals of each order are superimposed.

4. The audio output method for a vehicle as described in claim 2, characterized in that, Each row of parameters in the wake-up / sleep control matrix corresponds to a preset algorithm. The step of determining a target preset algorithm from among multiple preset algorithms based on the values ​​of each row of parameters in the wake-up / sleep control matrix further includes: If the value of the second row parameter of the wake-up / sleep control matrix is ​​the first preset value, and the first row parameter and the third row parameter of the wake-up / sleep control matrix are the second preset values, then the target preset algorithm is determined to be an audio pitch shifting algorithm.

5. The audio output method for a vehicle as described in claim 4, characterized in that, The process of generating the audio signal using the target preset algorithm includes: Acquire a steady-state audio signal, determine the first frequency of the steady-state audio signal before pitch shifting and the second frequency after pitch shifting, and calculate the pitch shifting coefficient based on the first frequency and the second frequency; The audio output signal is calculated based on the first frequency, and the audio output signal is subjected to pitch shifting processing based on the pitch shifting coefficient.

6. The audio output method for a vehicle as described in claim 2, characterized in that, Each row of parameters in the wake-up / sleep control matrix corresponds to a preset algorithm. The step of determining a target preset algorithm from among multiple preset algorithms based on the values ​​of each row of parameters in the wake-up / sleep control matrix further includes: If the value of the third row parameter of the wake-up / sleep control matrix is ​​the first preset value, and the first row parameter and the second row parameter of the wake-up / sleep control matrix are the second preset values, then the target preset algorithm is determined to be a particle synthesis algorithm.

7. The audio output method for a vehicle as described in claim 6, characterized in that, The process of generating the audio signal using the target preset algorithm includes: Obtain the original sound sample, and divide the original sound sample into multiple sound particles to obtain a sound particle library; Identify the two sound particles corresponding to the aforementioned operating condition information; The two sound particles are spliced ​​together to obtain the audio signal.

8. The audio output method for a vehicle as described in any one of claims 3 to 7, characterized in that, The processing of the audio signal based on the fade-in / fade-out control matrix and the enhancement / attenuation control matrix includes: Based on the fade-in / fade-out control matrix, the fade-in and fade-out times of the audio signal are determined; Based on the enhancement / attenuation control matrix, the gain value of the audio signal is determined; The audio signal is processed based on the fade-in / fade-out time and the gain value.

9. The audio output method for a vehicle as described in claim 1, characterized in that, The method further includes: Based on the operating condition information, at least one gain parameter is determined, and the audio signal is processed based on the at least one gain parameter.

10. A vehicle, characterized in that, The vehicle includes a memory and a processor: The memory is used to store program instructions; The processor is configured to read and execute the program instructions stored in the memory, and when the program instructions are executed by the processor, cause the vehicle to perform the audio output method of the vehicle as described in any one of claims 1 to 9.

11. A computer storage medium, characterized in that, The computer storage medium stores program instructions that, when executed on the vehicle, cause the vehicle's processor to perform the audio output method of the vehicle as described in any one of claims 1 to 9.

Images