Audio output method of vehicle, vehicle and storage medium

Abstract

The embodiment of the invention provides an audio output method of a vehicle, the vehicle and a storage medium. The method comprises the steps that working condition information of the vehicle is acquired; constructing a multi-mode control matrix based on the working condition information, wherein the multi-mode control matrix comprises a wake-up / sleep control matrix, a fade-in / fade-out control matrix and an enhancement / weakening control matrix; based on the value of each row of parameters in the wake-up / sleep control matrix, determining a target preset algorithm in a plurality of preset algorithms, and generating an audio signal by using the target preset algorithm; processing the audio signal based on the fade-in / fade-out control matrix and the enhancement / weakening control matrix; and outputting the processed audio signal. According to the embodiment of the invention, the audio signal can be processed based on the multi-mode control matrix, the generated sound effect is effectively optimized, and the driving experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of audio processing, and in particular to an audio output method for a vehicle, a vehicle, and a storage medium. Background Art

[0002] With the development of vehicle technology, electric vehicles and hybrid vehicles have become the main development direction of the market. Electric vehicles and hybrid vehicles are usually driven by relatively quiet motors, and the start-stop strategy of hybrid vehicles under engine conditions is relatively complex, and the engine speed does not match the vehicle speed. Therefore, it is necessary to optimize the sound feedback during driving and provide the driver with necessary information prompts.

[0003] Active Sound Enhance (ASE) technology can effectively optimize sound feedback. Active Sound Enhancement technology obtains vehicle operating condition information in real time, realizes real-time sound synthesis through algorithm strategies, and then plays the sound through speakers. However, the sound effect of algorithm synthesis in related technologies when performing active sound enhancement is poor, for example, it is not realistic enough, cannot reflect sound details, cannot cope with sudden changes in operating conditions, etc., which affects the driving experience. Summary of the invention

[0004] In view of the above, it is necessary to provide a vehicle audio output method, a vehicle and a storage medium to solve the problem that the sound effect synthesized by the algorithm when performing active sound enhancement is poor, thereby affecting the driving experience.

[0005] In a first aspect, an embodiment of the present application provides an audio output method for a vehicle, which is applied to a vehicle, and the method includes: obtaining operating condition information of the vehicle; constructing a multi-mode control matrix based on the operating condition information, the multi-mode control matrix including a wake-up / sleep control matrix, a fade-in / fade-out control matrix, and an enhancement / weakening control matrix; determining a target preset algorithm from multiple preset algorithms based on the value of each row of parameters in the wake-up / sleep control matrix, and generating an audio signal using the target preset algorithm; processing the audio signal based on the fade-in / fade-out control matrix and the enhancement / weakening control matrix; and outputting the processed audio signal.

[0006] In a possible implementation, the multi-mode control matrix is ​​a three-row matrix, and the multi-mode control matrix is ​​constructed based on the operating condition information, including: if the vehicle is determined to be an electric vehicle based on the operating condition information, the second row parameter of the wake-up / sleep control matrix is ​​set to a first preset value, the first row parameter and the third row parameter of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / weakening control matrix are set to a second preset value, the second row parameter of the fade-in / fade-out control matrix is ​​set to a fade-in / fade-out control parameter, and the second row parameter of the enhancement / weakening control matrix is ​​set to an enhancement / weakening control parameter; if the vehicle is determined to be a fuel vehicle based on the operating condition information, the first row parameter of the wake-up / sleep control matrix is ​​set to the first preset value, the second row parameter and the third row parameter of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / weakening control matrix are set to the second preset value, and the fade-in / fade-out control matrix the first row parameters of the wake-up / sleep control matrix are set to the fade-in / fade-out control parameters, and the first row parameters of the enhancement / weakening control matrix are set to the enhancement / weakening control parameters; if it is determined based on the operating condition information that the vehicle is a hybrid vehicle, the third row parameters of the wake-up / sleep control matrix are set to the first preset value, the first row parameters and the second row parameters of the wake-up / sleep control matrix, the fade-in / fade-out control matrix and the enhancement / weakening control matrix are set to the second preset value, the third row parameters of the fade-in / fade-out control matrix are set to the fade-in / fade-out control parameters, and the third row parameters of the enhancement / weakening control matrix are set to the enhancement / weakening control parameters; if it is determined based on the operating condition information that multiple preset algorithms are used to control the audio output of the vehicle, at least two rows of parameters of the wake-up / sleep control matrix are set to the first preset value, and the values ​​of each row of parameters of the fade-in / fade-out control matrix and the enhancement / weakening control matrix are set based on the audio output strategy.

[0007] In a possible implementation, each row of parameters of the wake-up / sleep control matrix corresponds to a preset algorithm, and the target preset algorithm is determined from multiple preset algorithms based on the value of each row of parameters of the wake-up / sleep control matrix, including: if the value of the first row of parameters of the wake-up / sleep control matrix is ​​the first preset value, the second row and third row parameters of the wake-up / sleep control matrix are the second preset value, determining that the target preset algorithm is an order simulation algorithm.

[0008] In one possible implementation, the audio signal is generated using the target preset algorithm, including: constructing a relationship curve between the sound pressure gain of audio signals of multiple orders and the nominal engine speed; obtaining the speed in the operating condition information, and converting the speed into the corresponding nominal engine speed; calculating the frequency of each order of audio signal corresponding to the nominal engine speed; calculating each order of audio signal based on the frequency, and superimposing each order of audio signal.

[0009] In a possible implementation, each row of parameters of the wake-up / sleep control matrix corresponds to a preset algorithm, and the target preset algorithm is determined from multiple preset algorithms based on the value of each row of parameters of the wake-up / sleep control matrix, including: if the value of the second row of parameters of the wake-up / sleep control matrix is ​​the first preset value, the first row of parameters and the third row of parameters of the wake-up / sleep control matrix are the second preset values, determining that the target preset algorithm is an audio pitch shifting algorithm.

[0010] In one possible implementation, the audio signal is generated using the target preset algorithm, including: obtaining a steady-state audio signal, determining a first frequency of the steady-state audio signal before pitch shifting and a second frequency of the steady-state audio signal after pitch shifting, and calculating a pitch shift coefficient based on the first frequency and the second frequency; calculating an audio output signal based on the first frequency, and performing pitch shifting on the audio output signal based on the pitch shift coefficient.

[0011] In a possible implementation, each row of parameters of the wake-up / sleep control matrix corresponds to a preset algorithm, and determining a target preset algorithm from multiple preset algorithms based on the value of each row of parameters of the wake-up / sleep control matrix includes: if the value of the third row of parameters of the wake-up / sleep control matrix is ​​the first preset value, the first row of parameters and the second row of parameters of the wake-up / sleep control matrix are the second preset values, determining that the target preset algorithm is a particle synthesis algorithm.

[0012] In a possible implementation, the generating the audio signal by using the target preset algorithm includes: obtaining an original sound sample, dividing the original sound sample into multiple sound particles, and obtaining a sound particle library; determining two sound particles corresponding to the working condition information; and splicing the two sound particles to obtain the audio signal.

[0013] In a possible implementation, the processing of the audio signal based on the fade-in / fade-out control matrix and the enhancement / weakening control matrix includes: determining the fade-in and fade-out time of the audio signal based on the fade-in / fade-out control matrix; determining the gain value of the audio signal based on the enhancement / weakening control matrix; and processing the audio signal based on the fade-in and fade-out time and the gain value.

[0014] In a possible implementation manner, the method further includes: determining at least one gain parameter based on the operating condition information, and processing the audio signal based on the at least one gain parameter.

[0015] In a second aspect, an embodiment of the present application provides an audio output device for a vehicle, the device comprising: an acquisition module for acquiring operating condition information of the vehicle; a construction module for constructing a multi-mode control matrix based on the operating condition information, the multi-mode control matrix comprising a wake-up / sleep control matrix, a fade-in / fade-out control matrix and an enhancement / weakening control matrix; a generation module for determining a target preset algorithm from multiple preset algorithms based on the value of each row of parameters in the wake-up / sleep control matrix, and generating an audio signal using the target preset algorithm; a processing module for processing the audio signal based on the fade-in / fade-out control matrix and the enhancement / weakening control matrix; and an output module for outputting the processed audio signal.

[0016] In a third aspect, an embodiment of the present application provides a vehicle, comprising a memory and a processor: wherein the memory is used to store program instructions; the processor is used to read and execute the program instructions stored in the memory, and when the program instructions are executed by the processor, the vehicle executes the above-mentioned vehicle audio output method.

[0017] In a fourth aspect, an embodiment of the present application provides a computer storage medium, wherein the computer storage medium stores program instructions, and when the program instructions are executed on a vehicle, the processor of the vehicle executes the above-mentioned vehicle audio output method.

[0018] The vehicle audio output method, device, vehicle and storage medium provided in the embodiments of the present application can construct a multi-mode control matrix based on the vehicle's operating condition information, determine a target preset algorithm from multiple preset algorithms based on the multi-mode control matrix, generate an audio signal using the target preset algorithm, and process the audio signal based on the multi-mode control matrix, so as to effectively optimize the generated sound effect and enhance the driving experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without paying any creative work.

[0020] Figure 1 It is a schematic diagram of an application scenario of an audio output method for a vehicle provided in one embodiment of the present application.

[0021] Figure 2 It is a flow chart of a vehicle audio output method provided in one embodiment of the present application.

[0022] Figure 3 This is a flowchart of generating an audio signal provided by an embodiment of the present application.

[0023] Figure 4 This is another flow chart of generating an audio signal provided by an embodiment of the present application.

[0024] Figure 5 This is another flow chart of generating an audio signal provided by an embodiment of the present application.

[0025] Figure 6 This is a flow chart of a vehicle audio output method provided by another embodiment of the present application.

[0026] Figure 7 It is a schematic diagram of an audio control interface provided in an embodiment of the present application.

[0027] Figure 8 It is a structural diagram of an audio output device provided in one embodiment of the present application.

[0028] Fig. 9 It is a schematic diagram of the hardware structure of a vehicle provided in one embodiment of the present application. DETAILED DESCRIPTION

[0029] The terms "first" and "second" involved in the embodiments of the present application are only used for descriptive purposes and should not be understood as indicating or implying relative importance or implicitly indicating the number of indicated technical features. Thus, the features defined as "first" and "second" may explicitly or implicitly include one or more features. In the description of the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or designs. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way.

[0030] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those generally understood by technicians in the technical field in this application. The terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. It should be understood that, unless otherwise specified in this application, " / " means or. For example, A / B can represent A or B. "And / or" in this application is only a description of the association relationship of associated objects, indicating that three relationships can exist. For example, A and / or B can represent: A exists alone, A and B exist at the same time, and B exists alone. "At least one" refers to one or more. "Multiple" refers to two or more than two. For example, at least one of a, b or c can represent: a, b, c, a and b, a and c, b and c, a, b and c. In the absence of conflict, the following embodiments and the features in the embodiments can be combined with each other.

[0031] With the development of vehicle technology, electric vehicles and hybrid vehicles have become the main development direction of the market. Electric vehicles and hybrid vehicles are usually driven by relatively quiet motors, and the start-stop strategy of hybrid vehicles under engine conditions is relatively complex, and the engine speed does not match the vehicle speed. In this way, it is necessary to optimize the sound feedback during driving, generate and output simulated audio based on the vehicle's operating condition information, such as generating and outputting simulated braking sounds when the vehicle brakes, generating and outputting simulated engine sounds of different volumes when the vehicle accelerates or decelerates, etc., so as to provide the driver with necessary information prompts.

[0032] Active sound enhancement technology obtains vehicle operating condition information in real time, realizes real-time sound synthesis through algorithm strategies, and then plays the sound through speakers. However, the sound effect of algorithm synthesis used in related technologies when performing active sound enhancement is poor, which affects the driving experience. For example, the current active sound algorithms include order simulation, audio pitch shifting, and particle synthesis, but these three algorithms differ in various aspects such as applicable scenarios, computing power usage, and sound effect characteristics. Specifically, the order simulation algorithm realizes active sound generation through the pattern of engine order components, so it is suitable for the sound simulation of starting characteristics. Since it uses sine waves as the basic sound source based on the Fourier principle, it occupies little memory and computing resources. However, the synthesized sound is difficult to make realistic and it is difficult to simulate sudden changes such as gear shifting. The audio pitch shifting algorithm is based on several key sound source elements and uses the frequency shifting pitch shifting principle to simulate acceleration conditions. Since the pitch shifting algorithm can achieve a large frequency change rate and the entire sound source changes uniformly, it is suitable for the sound simulation of electric drive characteristics. The sound simulation is realistic and linear, but it is difficult to express the details of the sound. The particle synthesis algorithm is suitable for the simulation of the above two scenarios. By subdividing the sound of the entire operating range into particles and synthesizing it in real time, in principle, the simulation of any sound characteristics can be realized in the early sound design stage. However, this method consumes a huge amount of computing resources, and there are always difficulties in synthesizing sounds under transient conditions.

[0033] An embodiment of the present application provides a vehicle audio output method, which can construct a multi-mode control matrix based on the vehicle's operating condition information, determine a target preset algorithm from multiple preset algorithms based on the multi-mode control matrix to generate an audio signal, and process the audio signal based on the multi-mode control matrix to effectively optimize the generated sound effect and enhance the driving experience.

[0034] See also Figure 1 , which is a schematic diagram of the application environment of the vehicle audio output method provided in one embodiment of the present application. Figure 1 The audio output system 100 shown includes a control interface 10, a controller 20, and a vehicle-mounted speaker 30. In an embodiment of the present application, the controller 20 may deploy a computer program product (such as software code, computer-readable instructions, etc.) programmed and implemented according to the vehicle audio output method provided in an embodiment of the present application, thereby providing a vehicle audio output service. The control interface 10 is used for the user to control the audio output of the vehicle, such as setting an algorithm or parameter for audio generation or processing, the controller 20 is used to perform audio generation and processing, and the vehicle-mounted speaker 30 is used to output the generated and processed audio.

[0035] See also Figure 2 FIG. 1 is a flow chart of a method for outputting audio of a vehicle provided in an embodiment of the present application. The method is applied in a vehicle, and the method for outputting audio of the vehicle includes: S101, obtaining vehicle operating condition information.

[0036] In one embodiment of the present application, the real-time operating condition information of the vehicle is obtained at preset intervals, for example, the preset period is 5 seconds, 8 seconds, 10 seconds or other suitable time. The real-time operating condition information of the vehicle includes but is not limited to: speed (engine speed or motor speed), vehicle speed, pedal depth, steering wheel torque. The vehicle controller is connected to each sensor of the vehicle via a CAN (Controller Area Network) bus, and the real-time operating condition information is obtained by receiving CAN signals sent by each sensor.

[0037] S102, constructing a multi-mode control matrix based on the working condition information. The multi-mode control matrix is ​​a three-row matrix, that is, a 3×1 matrix. The multi-mode control matrix includes but is not limited to: wake-up / sleep control matrix , fade in / fade out control matrix and enhance / weaken control matrix .

[0038] In one embodiment of the present application, in the above three matrices, the first row of parameters is used to control the order simulation algorithm, the second row of parameters is used to control the audio pitch shifting algorithm, and the third row of parameters is used to control the granular synthesis algorithm. Used to control the wake-up or sleep of the corresponding algorithm, where is 1 or 0, representing the algorithm on or off. It is used to control the fade-in or fade-out of the sound synthesized by the corresponding algorithm. Fade-in means that the volume gradually increases from zero when the audio starts to be output or played until it reaches the preset normal volume level. Fade-out means that the volume gradually decreases from the normal level until it disappears completely when the audio stops playing. The value range is [-100, 0], which represents the proportion of the fade-in / fade-out strategy to the audio speed sequence. -100 means fade-in / fade-out processing is performed in the entire speed sequence, and 0 means no fade-in / fade-out processing is performed. Any negative integer between -100 and 0 can be used; the matrix It is used to control the enhancement or reduction of the sound synthesized by the corresponding algorithm. The value range is [-12, 12], which represents the overall enhancement / reduction of the sound pressure level of the corresponding algorithm synthesized sound. -12 represents reduction by -12dB, and 12 represents enhancement by 12dB. It can take any value between -12 and 12.

[0039] In one embodiment of the present application, the vehicle type or control mode is determined based on the speed in the operating condition information. If the operating condition information includes the motor speed, the vehicle is determined to be an electric vehicle. If the operating condition information includes the engine speed, the vehicle is determined to be a fuel vehicle. If the operating condition information includes the motor speed and the engine speed, the vehicle is determined to be a hybrid vehicle.

[0040] If the vehicle is determined to be an electric vehicle based on the operating condition information, the second row parameter of the wake-up / sleep control matrix is ​​set to the first preset value, the first row parameter and the third row parameter of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / weakening control matrix are set to the second preset value, the second row parameter of the fade-in / fade-out control matrix is ​​set to the fade-in / fade-out control parameter, and the second row parameter of the enhancement / weakening control matrix is ​​set to the enhancement / weakening control parameter. For example, the first preset value is 1, and the second preset value is 0. For example: Wake-up / Sleep Control Matrix ; Fade in / out control matrix ; Enhance / Degrade Control Matrix .

[0041] The above example shows that the audio pitch shifting algorithm can be awakened, while the other two algorithms are dormant without occupying computing power and memory space. The fade-in / fade-out control parameter is -50, and the enhancement / weakening control parameter is 10, which means an enhancement of 10db (decibel). At this time, the audio pitch shifting algorithm is used to synthesize sound samples whose frequency changes with the motor speed based on steady-state audio. Since the dynamic range of the sound sample frequency is wide, the dynamic range of the synthesized sound frequency in this mode is wide, which is suitable for simulating the sci-fi style sound of electric vehicles.

[0042] If the vehicle is determined to be a fuel vehicle based on the operating condition information, the first row parameter of the wake-up / sleep control matrix is ​​set to the first preset value, the second row parameter and the third row parameter of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / weakening control matrix are set to the second preset value, the first row parameter of the fade-in / fade-out control matrix is ​​set to the fade-in / fade-out control parameter, and the first row parameter of the enhancement / weakening control matrix is ​​set to the enhancement / weakening control parameter. For example, the first preset value is 1, and the second preset value is 0. For example: Wake-up / Sleep Control Matrix ; Fade in / out control matrix ; Enhance / Degrade Control Matrix .

[0043] The above example shows that the order simulation algorithm can be awakened, and the other two algorithms are dormant without occupying computing power and memory space. The fade-in / fade-out control parameter is -20, and the enhancement / weakening control parameter is -8, which means a weakening of -8db. At this time, the order simulation algorithm is used to synthesize the sound sample based on the order sound pressure versus nominal engine speed curve. Since the order components are mainly engine order components, it is suitable for simulating the sound style with an engine power feel.

[0044] If the vehicle is determined to be a hybrid vehicle based on the operating condition information, the third row parameter of the wake-up / sleep control matrix is ​​set to the first preset value, the first row parameter and the second row parameter of the wake-up / sleep control matrix, the fade-in / fade-out control matrix and the enhancement / weakening control matrix are set to the second preset value, the third row parameter of the fade-in / fade-out control matrix is ​​set to the fade-in / fade-out control parameter, and the third row parameter of the enhancement / weakening control matrix is ​​set to the enhancement / weakening control parameter. For example, the first preset value is 1 and the second preset value is 0. For example: Wake-up / Sleep Control Matrix ; Fade in / out control matrix ; Enhance / Degrade Control Matrix .

[0045] The above example shows that the particle synthesis algorithm can be awakened, while the other two algorithms are dormant without occupying computing power and memory space. The fade-in / fade-out control parameter is -60, and the enhancement / weakening control parameter is 6, which means an enhancement of 6db. At this time, the particle synthesis algorithm is used to synthesize sound samples based on the previous sound design samples following the actual vehicle working conditions. Since the driving mode of hybrid vehicles is complex, there are multiple driving strategies such as electric drive, engine drive and hybrid drive. Therefore, the particle algorithm is suitable for precise matching of sounds under these modes without considering the sudden sound changes caused by complex power mode switching.

[0046] If hybrid control of the vehicle is determined based on the operating condition information, at least two rows of parameters of the wake-up / sleep control matrix are set to the first preset value, and the values ​​of each row of parameters of the fade-in / fade-out control matrix and the enhancement / weakening control matrix are set based on the audio output strategy. For example: The wake-up / sleep control matrix is or or or .

[0047] The above example shows that three algorithms or two of them are awakened. , The matrix adapts the sound strategy to set the corresponding parameters. Taking the three algorithms as an example, the audio pitch-shifting algorithm simulates the basic timbre of the sound sample by pitch-shifting the basic steady-state sound source, and adds some order components through the order synthesis algorithm to enhance the sense of power in some working conditions (such as engine start or vehicle braking). Under strategies such as shifting and speed reporting, the particle synthesis algorithm plays the particles of the preset sound source, and finally achieves a multi-level active sound control effect.

[0048] S103, determining a target preset algorithm from a plurality of preset algorithms based on the value of each row parameter of the wake-up / sleep control matrix, and generating an audio signal by using the target preset algorithm.

[0049] In one embodiment of the present application, the plurality of preset algorithms include an order simulation algorithm, an audio pitch shifting algorithm, and a granular synthesis algorithm, and each row of parameters in the wake-up / sleep control matrix corresponds to a preset algorithm.

[0050] If the value of the first row parameter of the wake-up / sleep control matrix is ​​the first preset value, and the values ​​of the other two rows of parameters are the second preset values, the target preset algorithm is determined to be the order simulation algorithm. For example, the first preset value is 1, and the second preset value is 0, that is, the first row parameter a in the wake-up / sleep control matrix A1 is 11 is 1, and the other two lines have parameter a 21 and a 31 If it is 0, the order simulation algorithm is executed.

[0051] See also Figure 3 As shown, it is a flowchart of generating an audio signal provided by an embodiment of the present application.

[0052] S201, constructing a relationship curve between sound pressure gains of audio signals of multiple orders and corresponding nominal engine speeds.

[0053] In one embodiment of the present application, the order is , based on the sound pressure gain of each order Sample data and sound pressure gain of each order The sample data of the nominal engine speed corresponding to the sample data of Sound pressure gain The relationship curve with the corresponding nominal engine speed (rpm).

[0054] S202, obtaining the powertrain speed RPM in the operating condition information.

[0055] In one embodiment of the present application, for electric vehicles, the powertrain speed is the motor speed; for fuel vehicles, the powertrain speed is the engine speed; for hybrid vehicles, the powertrain speed includes a comprehensive speed determined based on the motor speed and the engine speed.

[0056] S203: Convert the powertrain speed into a corresponding nominal engine speed.

[0057] In one embodiment of the present application, based on the vehicle speed matching relationship, the powertrain speed RPM is converted into the nominal engine speed rpm according to the corresponding ratio. For example, the vehicle is preset with a corresponding relationship between the vehicle speed and the ratio (i.e., the ratio between the powertrain speed and the nominal engine speed), the current vehicle speed in the operating condition information is obtained, based on the current vehicle speed and the corresponding relationship between the vehicle speed and the ratio, the ratio corresponding to the current vehicle speed is determined, and then the powertrain speed RPM is converted into the nominal engine speed rpm based on the ratio.

[0058] S204, calculating the frequency of each order of audio signals at the nominal engine speed.

[0059] In one embodiment of the present application, the frequency f of each order at the nominal engine speed is i The calculation formula is: (1).

[0060] S205 , calculating the audio signal of each order based on the frequency, and superimposing the audio signal of each order to obtain an audio output signal.

[0061] In one embodiment of the present application, the audio signal of each order is calculated The calculation formula is: (2).

[0062] In the above calculation formula (2), is the phase corresponding to the harmonics of each order of audio signal, is the sound pressure gain of each order audio signal corresponding to the nominal engine speed.

[0063] The audio signal of each order The calculation formula for superposition is: (3).

[0064] In the above calculation formula, is the first fitting order, is the last fitting order.

[0065] If the value of the second row parameter of the wake-up / sleep control matrix is ​​the first preset value, and the values ​​of the other two rows of parameters are the second preset values, the target preset algorithm is determined to be the audio pitch shifting algorithm. For example, the first preset value is 1, and the second preset value is 0, that is, the second row parameter a in the wake-up / sleep control matrix A1 is 21is 1, and the other two lines have parameter a 11 and a 31 If it is 0, the audio pitch shifting algorithm is executed.

[0066] See also Figure 4 As shown, it is another flow chart of generating an audio signal provided by an embodiment of the present application.

[0067] S301, acquiring a steady-state audio signal, determining a first frequency of the steady-state audio signal before pitch shifting and a second frequency of the steady-state audio signal after pitch shifting, and calculating a pitch shift coefficient based on the first frequency and the second frequency.

[0068] In one embodiment of the present application, a preset steady-state audio signal is obtained. , determine the first frequency of the steady-state audio signal before pitch shifting and the second frequency after pitch shifting , the first frequency and the second frequency These are preset values. The modulation coefficient is calculated based on the first frequency and the second frequency. The calculation formula is: (4).

[0069] S302: Calculate an audio output signal based on the first frequency, and perform modulation processing on the audio output signal based on the modulation coefficient.

[0070] In one embodiment of the present application, the audio signal is stretched and compressed in the time dimension to achieve a pitch change effect. The audio output signal is calculated based on the first frequency. The calculation formula is: (5).

[0071] The calculation formula for pitch-shifting the audio output signal based on the pitch-shifting coefficient is: (6).

[0072] In calculation formulas (5) and (6), Represents the audio input signal, Indicates the audio frame length, Indicates rounding operation. represents the modulo operation, Indicates the audio output signal. When the audio is pitched up, , the audio pitch is down-tuned.

[0073] If the value of the third row parameter of the wake-up / sleep control matrix is ​​the first preset value, and the values ​​of the other two rows of parameters are the second preset values, the target preset algorithm is determined to be the particle synthesis algorithm. For example, the first preset value is 1, and the second preset value is 0, that is, the third row parameter a in the wake-up / sleep control matrix A1 is 31 is 1, and the other two lines have parameter a 11 and a 21 If it is 0, the particle synthesis algorithm is executed.

[0074] See also Figure 5 As shown, it is another flow chart of generating an audio signal provided by an embodiment of the present application.

[0075] S401, obtaining an original sound sample, dividing the original sound sample into a plurality of sound particles, and obtaining a sound particle library.

[0076] In one embodiment of the present application, the original sound sample is obtained. , and divide the original sound sample into particle libraries according to the short-term strategy ,in The duration or length of each sound particle can be preset, and the original sound sample can be divided into multiple sound particles based on the duration of each sound particle to obtain a sound particle library. For example, the duration or length of each sound particle is between 1 and 50 milliseconds.

[0077] S402, determining two sound particles corresponding to the working condition information.

[0078] In one embodiment of the present application, the corresponding sound particle number is determined based on the vehicle's real-time speed, vehicle speed, torque and other operating information. , and index the corresponding particle sample and Among them, the vehicle presets a correspondence between the working condition information and the sound particle serial number. Based on the real-time working condition information and the correspondence, the sound particle serial number corresponding to the real-time working condition information is determined, and then the corresponding particle sample is obtained based on the sound particle serial number index. The obtained particle sample includes the particle sample corresponding to the sound particle serial number and the next particle sample of the particle sample corresponding to the sound particle serial number.

[0079] In another embodiment of the present application, the vehicle is preset with a correspondence between the vehicle state and the sound particle number, the real-time vehicle state is determined based on the real-time working condition information, and the sound particle number corresponding to the real-time working condition information is determined based on the real-time vehicle state and the correspondence between the vehicle state and the sound particle number. The vehicle state includes but is not limited to: acceleration, deceleration, braking, engine start, and engine shutdown.

[0080] S403, concatenate the two sound particles to obtain an audio signal.

[0081] In one embodiment of the present application, based on the overlap-add strategy, the particles are and Splice to get the sound source output , that is to say, .

[0082] S104, processing the audio signal based on the fade-in / fade-out control matrix and the enhancement / weakening control matrix.

[0083] In one embodiment of the present application, based on the fade-in / fade-out control matrix, the fade-in / fade-out time of the audio signal is determined, based on the enhancement / weakening control matrix, the gain value of the audio signal is determined, and the audio signal is processed based on the fade-in / fade-out time and the gain value. The fade-in / fade-out processing method may include linear fade-in / fade-out, logarithmic fade-in / fade-out, half-sine fade-in / fade-out, etc.

[0084] In one embodiment of the present application, a vehicle speed data sequence of a vehicle during driving is obtained, and the vehicle speed data sequence includes a starting speed, an ending speed, and a speed change in the middle. Based on the speed data and the driving distance of the vehicle, the total time corresponding to the entire speed sequence is calculated, for example, based on parameters such as speed change and acceleration. The fade-in and fade-out time is determined based on the fade-in and fade-out parameter and the total time corresponding to the entire speed sequence. For example, if the fade-in and fade-out parameter is -100, a fade-in and fade-out process is performed within the entire speed sequence, and the fade-in and fade-out time can be set to be the same as the total time corresponding to the entire speed sequence. If the fade-in and fade-out parameter is -50, the fade-in and fade-out time can be set to half of the total time corresponding to the entire speed sequence. If the fade-in and fade-out parameter is -20, the fade-in and fade-out time can be set to 20% of the total time corresponding to the entire speed sequence.

[0085] In one embodiment of the present application, if the target preset algorithm is an order simulation algorithm, the processed audio signal is , is the generated audio output signal; if the target preset algorithm is the audio pitch shifting algorithm, the processed audio signal is , is the generated audio output signal; if the target preset algorithm is the granular synthesis algorithm, the processed audio signal is , The generated audio output signal.

[0086] In one embodiment of the present application, in the fade-in / fade-out control matrix In, a i2 Indicates the ratio between the vehicle speed for which the audio needs to be faded in and out and the total vehicle speed.i2 The value range of is [x, 0], x is a negative integer, for example -100, so a i2 Any negative integer between -100 and 0.

[0087] In one embodiment of the present application, in the enhancement / weakening control matrix In, a i3 Indicates the enhancement / reduction of the audio sound pressure level, a i3 The value range is [-m, m], where m is a positive integer. -m means attenuating the audio by -mdB, and m means enhancing the audio by mdB. For example, the value of m is 12.

[0088] S105: output the processed audio signal.

[0089] In one embodiment of the present application, the processed audio signal is output through a vehicle-mounted speaker.

[0090] Through the above-mentioned embodiments of the present application, a multi-mode control matrix can be constructed based on the vehicle's operating condition information, a target preset algorithm can be determined from multiple preset algorithms based on the multi-mode control matrix, an audio signal can be generated using the target preset algorithm, and the audio signal can be processed based on the multi-mode control matrix to effectively optimize the generated sound effects and enhance the driving experience.

[0091] See also Figure 6 As shown, it is a flow chart of an audio output method for a vehicle provided in another embodiment of the present application.

[0092] S501, obtaining vehicle operating condition information.

[0093] S502, constructing a multi-mode control matrix based on the operating condition information.

[0094] S503 , based on the value of each row parameter of the wake-up / sleep control matrix, determine a target preset algorithm from a plurality of preset algorithms, and use the target preset algorithm to generate an audio signal.

[0095] S504: Process the audio signal based on the fade-in / fade-out control matrix and the enhancement / weakening control matrix.

[0096] S505: Determine at least one gain parameter based on the operating condition information, and process the audio signal based on the at least one gain parameter.

[0097] In one embodiment of the present application, the vehicle is also preset with a correspondence between multiple vehicle speeds and multiple vehicle speed gain parameters, and a correspondence between multiple pedal depths and multiple pedal gain parameters. The corresponding vehicle speed gain parameter is determined based on the vehicle speed in the real-time operating condition information, and the corresponding pedal gain parameter is determined based on the pedal depth in the real-time operating condition information. The generated audio signal is processed based on the vehicle speed gain parameter and the pedal gain parameter. For example, a target gain parameter is determined based on the vehicle speed gain parameter, the pedal gain parameter, and the enhancement / weakening control matrix. The generated audio signal is processed based on the target gain parameter. For example, the target gain parameter is a target sound pressure level. The target sound pressure level is converted into a target gain factor. The target gain factor is multiplied by the generated audio signal to process the audio signal.

[0098] S506: output the processed audio signal.

[0099] The specific implementations of S501-S504 and S506 are the same as those of S101-S105, and are not elaborated here.

[0100] Through the above-mentioned embodiments of the present application, gain parameters related to vehicle operating condition information, such as vehicle speed-related gain and accelerator pedal-related gain, can be obtained. The synthesized audio signal is processed using the gain parameters, and finally an active sound synthesized sound that changes with the vehicle speed and accelerator pedal and integrates multiple sound modes is obtained for playback on the vehicle speakers, thereby further optimizing the active sound effect and improving the driving experience.

[0101] See also Figure 7 , which is a schematic diagram of an audio control interface provided in one embodiment of the present application. Figure 7 The audio control interface may be an interface of a sound wave debugging software. In one embodiment of the present application, the audio control interface includes an interactive interface module (corresponding to Figure 7 "Communication Interface Settings" area in the ASE system control module (corresponding to Figure 7 "Sound Control" area in the Figure 7 "Synthesis Algorithm Parameter Debug" area) and CAN information display module (corresponding to Figure 7The interactive interface module is used to configure the communication interface to achieve communication and data interaction between the sound wave debugging software and the controller; the ASE system control module can realize real-time control of the ASE system, such as providing GAC frequency shift, WHUT frequency shift, harmonic synthesis and other algorithm options to select the control algorithm for the sound wave; the multi-mode sound wave debugging module is used to realize the control of multiple algorithm modes, for example, providing parameter settings or debugging corresponding to various algorithms; the CAN information display module can display the real vehicle's speed, speed, pedal depth, torque and other information in real time, which is convenient for obtaining working condition information during sound modulation.

[0102] See also Figure 8 , which is a schematic diagram of the structure of an audio output device provided in one embodiment of the present application. In one embodiment of the present application, the audio output device 200 may include a plurality of functional modules composed of computer program segments. The computer program segments in the audio output device 200 may be stored in a memory of the vehicle and executed by at least one processor to perform the audio output function.

[0103] In one embodiment of the present application, the audio output device 200 can be divided into multiple functional modules according to the functions it performs. The functional modules of the audio output device 200 may include: an acquisition module 201, a construction module 202, a generation module 203, a processing module 204, and an output module 205. The module in the embodiment of the present application refers to a series of computer program segments that can be executed by at least one processor and can complete fixed functions, which are stored in a memory.

[0104] The acquisition module 201 is used to acquire the operating condition information of the vehicle.

[0105] The construction module 202 is used to construct a multi-mode control matrix based on the operating condition information. The multi-mode control matrix includes a wake-up / sleep control matrix, a fade-in / fade-out control matrix, and an enhancement / weakening control matrix.

[0106] The generating module 203 is used to determine a target preset algorithm from a plurality of preset algorithms based on the value of each row parameter of the wake-up / sleep control matrix, and generate an audio signal using the target preset algorithm.

[0107] The processing module 204 is used to process the audio signal based on the fade-in / fade-out control matrix and the boost / weaken control matrix.

[0108] The output module 205 is used to output the processed audio signal.

[0109] The present application also provides a vehicle 1, referring to Fig. 9The vehicle audio output method provided in the embodiment of the present application is applied to a vehicle 1 , which includes, but is not limited to, a processor 110 and a memory 120 connected via a communication bus 130 . Fig. 9 This is merely an example of a vehicle and does not constitute a corresponding limitation. In other embodiments, the vehicle may include more components than those shown in the figure.

[0110] The memory 120 may include one or more random access memories (RAM) and one or more non-volatile memories (NVM). The random access memory can be directly read and written by the processor 110, and can be used to store executable programs (such as machine instructions) of the operating system or other running programs, and can also be used to store user and application data. The random access memory may include static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), etc.

[0111] The non-volatile memory may also store executable programs and user and application data, etc., and may be pre-loaded into the random access memory for direct reading and writing by the processor 110. The non-volatile memory may include a disk storage device and a flash memory.

[0112] The memory 120 is used to store one or more computer programs. The one or more computer programs are configured to be executed by the processor 110. The one or more computer programs include a plurality of instructions, and when the plurality of instructions are executed by the processor 110, the vehicle audio output method executed on the vehicle 1 can be implemented.

[0113] In other embodiments, the vehicle 1 further includes an external memory interface for connecting to an external memory to expand the storage capacity of the vehicle 1 .

[0114] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Different processing units may be independent devices or integrated into one or more processors.

[0115] The processor 110 provides computing and control capabilities. For example, the processor 110 is used to execute a computer program stored in the memory 120 to implement the above-mentioned vehicle audio output method.

[0116] The communication bus 130 is at least used to provide a channel for the memory 120 and the processor 110 in the vehicle 1 to communicate with each other.

[0117] It is understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the vehicle 1. In other embodiments of the present application, the vehicle 1 may include more or fewer components than shown in the figure, or combine some components, or split some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0118] The embodiment of the present application also provides a computer storage medium, in which computer instructions are stored. When the computer instructions are executed on the vehicle 1, the vehicle 1 executes the above-mentioned related method steps to implement the audio output method of the vehicle in the above-mentioned embodiment.

[0119] The embodiment of the present application also provides a computer program product. When the computer program product is run on a computer, the computer executes the above-mentioned related steps to implement the audio output method of the vehicle in the above-mentioned embodiment.

[0120] In addition, an embodiment of the present application also provides a device, which can specifically be a chip, component or module, and the device may include a connected processor and memory; wherein the memory is used to store computer-executable instructions, and when the device is running, the processor can execute the computer-executable instructions stored in the memory so that the chip executes the vehicle audio output method in the above-mentioned method embodiments.

[0121] Among them, the hardware device, computer storage medium, computer program product or chip provided in the embodiments of the present application are all used to execute the corresponding methods provided above. Therefore, the beneficial effects that can be achieved can refer to the beneficial effects in the corresponding methods provided above, and will not be repeated here.

[0122] Through the description of the above implementation methods, technical personnel in the relevant field can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.

[0123] In the several embodiments provided in the present application, it should be understood that the disclosed devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic, for example, the division of modules or units is only a logical function division, and there may be other division methods in actual implementation, such as multiple units or components can be combined or integrated into another device, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or units, which can be electrical, mechanical or other forms.

[0124] The units described as separate components may or may not be physically separated, and the components shown as units may be one physical unit or multiple physical units, that is, they may be located in one place or distributed in multiple different places. Some or all of the units may be selected according to actual needs to achieve the purpose of the present embodiment.

[0125] In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above-mentioned integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0126] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application, or the part that contributes to the prior art, or all or part of the technical solution can be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for a device (which can be a single-chip microcomputer, chip, etc.) or a processor (processor) to execute all or part of the steps of the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk, etc., various media that can store program code.

[0127] Finally, it should be noted that the above embodiments are only used to illustrate the technical solution of the present application and are not intended to limit it. Although the present application has been described in detail with reference to the preferred embodiments, a person of ordinary skill in the art should understand that the technical solution of the present application may be modified or replaced by equivalents without departing from the spirit and scope of the technical solution of the present application.

Claims

1. A vehicle audio output method, characterized in that: The method comprises: Obtain vehicle operating condition information; Constructing a multi-mode control matrix based on the operating condition information, wherein the multi-mode control matrix includes a wake-up / sleep control matrix, a fade-in / fade-out control matrix, and an enhancement / weakening control matrix; Determining a target preset algorithm from a plurality of preset algorithms based on the value of each row of parameters in the wake-up / sleep control matrix, and generating an audio signal using the target preset algorithm; Processing the audio signal based on the fade-in / fade-out control matrix and the enhancement / weakening control matrix; The processed audio signal is output.

2. The vehicle audio output method according to claim 1, characterized in that: The multi-mode control matrix is ​​a three-row and three-column matrix. The multi-mode control matrix is ​​constructed based on the operating condition information, including: If it is determined based on the operating condition information that the vehicle is an electric vehicle, setting the second row parameters of the wake-up / sleep control matrix to a first preset value, setting the first row parameters and the third row parameters of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / weakening control matrix to a second preset value, setting the second row parameters of the fade-in / fade-out control matrix to a fade-in / fade-out control parameter, and setting the second row parameters of the enhancement / weakening control matrix to an enhancement / weakening control parameter; If it is determined based on the operating condition information that the vehicle is a fuel vehicle, setting the first row parameters of the wake-up / sleep control matrix to the first preset values, setting the second row parameters and the third row parameters of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / weakening control matrix to the second preset values, setting the first row parameters of the fade-in / fade-out control matrix to the fade-in / fade-out control parameters, and setting the first row parameters of the enhancement / weakening control matrix to the enhancement / weakening control parameters; If it is determined based on the operating condition information that the vehicle is a hybrid vehicle, setting the third row parameters of the wake-up / sleep control matrix to the first preset values, setting the first row parameters and the second row parameters of the wake-up / sleep control matrix, the fade-in / fade-out control matrix, and the enhancement / weakening control matrix to the second preset values, setting the third row parameters of the fade-in / fade-out control matrix to the fade-in / fade-out control parameters, and setting the third row parameters of the enhancement / weakening control matrix to the enhancement / weakening control parameters; If it is determined based on the operating condition information to use multiple preset algorithms to control the audio output of the vehicle, at least two rows of parameters of the wake-up / sleep control matrix are set to the first preset values, and the values ​​of each row of parameters of the fade-in / fade-out control matrix and the enhancement / weakening control matrix are set based on the audio output strategy.

3. The vehicle audio output method according to claim 2, characterized in that: Each row parameter of the wake-up / sleep control matrix corresponds to a preset algorithm, and determining a target preset algorithm from a plurality of preset algorithms based on the value of each row parameter of the wake-up / sleep control matrix includes: If the values ​​of the first row parameters of the wake-up / sleep control matrix are the first preset values, and the second row parameters and the third row parameters of the wake-up / sleep control matrix are the second preset values, it is determined that the target preset algorithm is an order simulation algorithm.

4. The vehicle audio output method according to claim 3, characterized in that: The step of generating the audio signal by using the target preset algorithm includes: Constructing relationship curves between sound pressure gain and nominal engine speed of audio signals of multiple orders; Obtaining the rotation speed in the operating condition information, and converting the rotation speed into a corresponding nominal engine speed; Calculating the frequency of each order of the audio signal corresponding to the nominal engine speed; An audio signal of each order is calculated based on the frequency, and the audio signal of each order is superimposed.

5. The vehicle audio output method according to claim 2, characterized in that: Each row parameter of the wake-up / sleep control matrix corresponds to a preset algorithm, and determining a target preset algorithm from a plurality of preset algorithms based on the value of each row parameter of the wake-up / sleep control matrix includes: If the value of the second row parameter of the wake-up / sleep control matrix is ​​the first preset value, and the first row parameter and the third row parameter of the wake-up / sleep control matrix are the second preset value, it is determined that the target preset algorithm is an audio pitch shifting algorithm.

6. The vehicle audio output method according to claim 5, characterized in that: The step of generating the audio signal by using the target preset algorithm includes: Acquire a steady-state audio signal, determine a first frequency of the steady-state audio signal before pitch shifting and a second frequency of the steady-state audio signal after pitch shifting, and calculate a pitch shift coefficient based on the first frequency and the second frequency; An audio output signal is calculated based on the first frequency, and a pitch shift process is performed on the audio output signal based on the pitch shift coefficient.

7. The vehicle audio output method according to claim 2, characterized in that: Each row parameter of the wake-up / sleep control matrix corresponds to a preset algorithm, and determining a target preset algorithm from a plurality of preset algorithms based on the value of each row parameter of the wake-up / sleep control matrix includes: If the value of the third row parameter of the wake-up / sleep control matrix is ​​the first preset value, and the first row parameter and the second row parameter of the wake-up / sleep control matrix are the second preset value, it is determined that the target preset algorithm is a particle synthesis algorithm.

8. The vehicle audio output method according to claim 7, characterized in that: The step of generating the audio signal by using the target preset algorithm includes: Acquire an original sound sample, and divide the original sound sample into a plurality of sound particles to obtain a sound particle library; Determine two sound particles corresponding to the working condition information; The two sound particles are spliced ​​to obtain the audio signal.

9. The vehicle audio output method according to any one of claims 3 to 8, characterized in that: The processing of the audio signal based on the fade-in / fade-out control matrix and the enhancement / weakening control matrix comprises: Determining a fade-in / fade-out time of the audio signal based on the fade-in / fade-out control matrix; Determining a gain value of the audio signal based on the enhancement / attenuation control matrix; The audio signal is processed based on the fade time and the gain value.

10. The vehicle audio output method according to claim 1, characterized in that: The method further comprises: At least one gain parameter is determined based on the operating condition information, and the audio signal is processed based on the at least one gain parameter.

11. A vehicle, characterized in that: The vehicle comprises a memory and a processor: Wherein, the memory is used to store program instructions; The processor is used to read and execute the program instructions stored in the memory. When the program instructions are executed by the processor, the vehicle executes the audio output method for a vehicle as described in any one of claims 1 to 10.

12. A computer storage medium, characterized in that: The computer storage medium stores program instructions, and when the program instructions are executed on a vehicle, a processor of the vehicle is caused to execute the audio output method for a vehicle according to any one of claims 1 to 10.

Images