Vehicle audio signal determination method and device, vehicle and storage medium

Abstract

The invention relates to a vehicle audio signal determination method and device, a vehicle and a storage medium, and relates to the technical field of intelligent cabins, the method comprises the steps that driving parameter information and driving road condition information related to the vehicle are determined, and the driving parameter information describes control parameters of a user for the vehicle and / or operation parameters of the vehicle under the control parameters; according to the driving parameter information and the driving road condition information, whether the vehicle is switched to a reference operation mode at the first time is predicted; and generating a first stage audio signal if it is predicted that the vehicle switches to the reference operating mode at the first time. According to the invention, the audio signal of the vehicle can be generated in time, and the driving experience of the vehicle is effectively improved.

Description

TECHNICAL FIELD

[0001] The present disclosure relates to the technical field of intelligent cockpit, and particularly relates to a vehicle audio signal determination method and device, a vehicle and a storage medium. BACKGROUND

[0002] If a vehicle (for example, an electric vehicle) is too quiet during driving, the driving feeling is lacking, and driving danger can be caused. In the related art, sound waves (the sound waves can also be referred to as vehicle audio signals) can be synthesized according to an operation of an accelerator pedal of a driver.

[0003] In this way, generation of the vehicle audio signals is not timely, and the driving experience of the vehicle is affected. SUMMARY

[0004] To overcome the problems in the related art, the present disclosure provides a vehicle audio signal determination method and device, a vehicle and a non-transitory computer readable storage medium, which can timely generate vehicle audio signals and effectively improve the driving experience of the vehicle.

[0005] According to a first aspect of an embodiment of the present disclosure, a vehicle audio signal determination method is provided, including: determining driving parameter information and driving road condition information related to a vehicle, wherein the driving parameter information describes a control parameter of the vehicle by a user and / or a running parameter of the vehicle under the control parameter; predicting whether the vehicle switches to a reference running mode at a first time according to the driving parameter information and the driving road condition information; and generating a first-stage audio signal in a case where it is predicted that the vehicle switches to the reference running mode at the first time.

[0006] According to a second aspect of an embodiment of the present disclosure, a vehicle audio signal determination device is provided, including: a determination unit configured to determine driving parameter information and driving road condition information related to a vehicle, wherein the driving parameter information describes a control parameter of the vehicle by a user and / or a running parameter of the vehicle under the control parameter; a prediction unit configured to predict whether the vehicle switches to a reference running mode at a first time according to the driving parameter information and the driving road condition information; and a generation unit configured to generate a first-stage audio signal in a case where it is predicted that the vehicle switches to the reference running mode at the first time.

[0007] According to a third aspect of an embodiment of the present disclosure, a vehicle is provided, including: a processor; a memory for storing processor-executable instructions; and wherein the processor is configured to implement the steps of a vehicle audio signal determination method provided by the first aspect of the present disclosure.

[0008] According to a fourth aspect of the embodiments of the present disclosure, a non-transitory computer-readable storage medium is provided, which, when instructions in the storage medium are executed by a processor of a mobile terminal, enables the mobile terminal to perform a vehicle audio signal determination method, the method comprising: determining driving parameter information and driving road condition information related to a vehicle, wherein the driving parameter information describes a control parameter of the vehicle by a user and / or an operating parameter of the vehicle under the control parameter; predicting whether the vehicle switches to a reference operating mode at a first time according to the driving parameter information and the driving road condition information; and generating a first-stage audio signal in a case where it is predicted that the vehicle switches to the reference operating mode at the first time.

[0009] The technical solutions provided by the embodiments of the present disclosure can have the following beneficial effects:

[0010] By determining driving parameter information and driving road condition information related to a vehicle, wherein the driving parameter information describes a control parameter of the vehicle by a user and / or an operating parameter of the vehicle under the control parameter, and predicting whether the vehicle switches to a reference operating mode at a first time according to the driving parameter information and the driving road condition information, and generating a first-stage audio signal in a case where it is predicted that the vehicle switches to the reference operating mode at the first time, the audio signal of the vehicle can be generated in time, and the driving experience of the vehicle is effectively improved.

[0011] It should be understood that the foregoing general description and the following detailed description are only exemplary and explanatory, and are not limiting to the present disclosure. BRIEF DESCRIPTION OF DRAWINGS

[0012] The accompanying drawings, which are incorporated in and constitute a part of the specification, illustrate embodiments consistent with the present disclosure and serve to explain the principles of the present disclosure together with the specification.

[0013] Figure 1 is a flowchart of a vehicle audio signal determination method according to some embodiments of the present disclosure;

[0014] Figure 2 is a flowchart of a vehicle audio signal determination method according to some other embodiments of the present disclosure;

[0015] Figure 3 is a flowchart of a vehicle audio signal determination method according to some other embodiments of the present disclosure;

[0016] Figure 4 is a flowchart of a vehicle audio signal determination method according to some other embodiments of the present disclosure;

[0017] Figure 5 is a schematic diagram of two-stage audio signals generated in the embodiments of the present disclosure;

[0018] Figure 6 is a structural diagram of a vehicle audio signal determination apparatus according to some embodiments of the present disclosure;

[0019] Figure 7 is a functional block diagram of a vehicle according to an example embodiment. DETAILED DESCRIPTION

[0020] Some embodiments of the present disclosure will be described in detail with reference to the drawings, wherein the same reference numerals represent the same elements throughout the several views. The following description is made in conjunction with the drawings. The order in which the operations are described is not intended to be construed as a limitation, unless otherwise explicitly stated. Furthermore, the described operations do not have to be performed in the recited order. Moreover, some of the described operations can be optional. Additionally, some of the described operations can be performed simultaneously. The following description is made with reference to the accompanying drawings, in which:

[0021] The implementations described in some embodiments of the present disclosure are not meant to represent all implementations consistent with the present disclosure. Rather, they are examples of apparatuses and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0022] Figure 1 is a flowchart of a vehicle audio signal determination method according to some embodiments of the present disclosure, as Figure 1 The vehicle audio signal determination method can be applied in an electronic device, and includes the following steps:

[0023] Step S101: determining driving parameter information and driving road condition information related to a vehicle, wherein the driving parameter information describes a control parameter of the vehicle by a user and / or a running parameter of the vehicle under the control parameter.

[0024] The driving parameter information describes a control parameter of the vehicle by a user and / or a running parameter of the vehicle under the control parameter. That is, the driving parameter information can describe a control parameter of the vehicle by a driver of the vehicle when driving the vehicle and / or a running parameter of the vehicle under the control parameter.

[0025] For example, the driving parameter information can reflect whether the driver pursues to drive the vehicle in a stimulating manner, whether the driver pursues to drive the vehicle in a normal manner, whether the driver pursues to drive the vehicle in a gentle manner, and the like, without limitation.

[0026] For example, user control parameters for the vehicle could include the duration and force of pressing the accelerator pedal. Under these control parameters, the vehicle's operating parameters could include, for example, acceleration and speed during acceleration, without any restrictions.

[0027] Driving traffic information describes road conditions encountered while the vehicle is in motion. Examples of driving traffic information include the distance between the vehicle and the vehicle in front, relative speed, etc., without limitation.

[0028] In some embodiments, vehicle-related driving parameter information and road condition information can be determined in any possible way. This includes methods such as modeling, data acquisition via camera devices, and configuration based on driver selection commands; there are no limitations on these methods.

[0029] In some embodiments, a driving parameter selection instruction can be received, and the candidate parameter information selected by the driving parameter selection instruction can be used as the driving parameter information, thereby enabling flexible selection of driving parameter information.

[0030] The candidate parameter information can be pre-configured. A selection interface for driving parameter information can be provided on the selection interface, and several candidate parameter information can be provided. Then, it is monitored whether a driving parameter selection command is received. If a driving parameter selection command is received, the candidate parameter information selected by the driving parameter selection command can be used as the driving parameter information.

[0031] In some embodiments, historical driving behavior information related to the vehicle can be determined, and driving parameter information can be determined based on the historical driving behavior information. This enables the accurate and flexible determination of driving parameter information.

[0032] In some embodiments, determining vehicle-related road condition information may involve determining the relative distance between the vehicle and other vehicles, determining traffic flow data on the road the vehicle is traveling on, and combining the relative distance and traffic flow data as driving road condition information. This allows for a comprehensive determination of vehicle-related driving road condition information.

[0033] For example, drivers can input driving parameter information while driving. This could include allowing drivers to manually select driving modes (e.g., a more exciting driving style, a more normal driving style, a smoother driving style, etc.). The control parameters corresponding to the manually selected driving mode, and / or the vehicle's operating parameters under those control parameters, can then be used as driving parameter information. Alternatively, the driver's historical driving behavior can be analyzed and learned to determine driving parameter information. In determining road condition information, when the vehicle is traveling at low speed or stationary, radar monitors the distance between the vehicle and the vehicle ahead in the same lane. Current traffic flow data (mostly empty, smooth, normal, congested, etc.) is then obtained from the navigation system, and the distance and traffic flow data are used as driving road condition information.

[0034] Step S102: Based on driving parameter information and road condition information, predict whether the vehicle will switch to the reference operating mode immediately.

[0035] The first time can be a future time, or it can be obtained by adding a certain amount of time to the current time. For example, adding 3 seconds to the current time will give you the first time.

[0036] The reference operating mode could be, for example, an acceleration mode. Predicting whether the vehicle will switch to the reference operating mode immediately could be, for example, predicting whether the vehicle will switch to acceleration mode immediately. If the vehicle switches to acceleration mode, a corresponding audio signal can be generated to prevent the vehicle from being too quiet in acceleration mode, thus reducing dizziness for drivers and passengers and improving their driving experience. Of course, the reference operating mode can also be any other possible operating mode; there are no restrictions on this.

[0037] After determining the driving parameters and road conditions related to the vehicle, it is possible to predict whether the vehicle will switch to the reference operating mode immediately based on these parameters and road conditions.

[0038] In this embodiment of the disclosure, it is possible to predict whether the vehicle will switch to a reference operating mode at the first moment based on driving parameter information and road condition information. For example, the driving parameter information and road condition information can be dynamically analyzed to predict whether the vehicle will switch to the reference operating mode at the first moment; or artificial intelligence can be used to analyze the driving parameter information and road condition information to predict whether the vehicle will switch to the reference operating mode at the first moment; of course, driving parameter information and road condition information can also be processed in any other possible way to predict whether the vehicle will switch to the reference operating mode at the first moment, and there is no limitation thereto.

[0039] In some embodiments of this disclosure, in the process of predicting whether a vehicle will switch to a reference operating mode immediately based on driving parameter information and road condition information, the driving parameter information and road condition information can be input into a prediction model to obtain the prediction result output by the prediction model. The prediction model has modeled and learned the mapping relationship between the driving parameter information, road condition information, and prediction result, and predicts whether the vehicle will switch to the reference operating mode immediately based on the prediction result. This effectively improves the accuracy of the prediction and enables rapid and efficient prediction of whether the vehicle will switch to the reference operating mode immediately.

[0040] The predictive model can be trained using neural network models or machine learning models from artificial intelligence (AI). This predictive model has the ability to predict whether the vehicle will switch to a reference operating mode immediately, based on driving parameter information and road condition information. Alternatively, driving parameter information and road condition information can be input into the predictive model, which will output a prediction result. This prediction result can instruct the vehicle to switch to the reference operating mode immediately, or indicate that the vehicle will not switch to the reference operating mode immediately. Therefore, the decision to switch to the reference operating mode immediately can be based on the prediction result.

[0041] Step S103: If it is predicted that the vehicle will switch to the reference operating mode in the first instant, generate the first stage audio signal.

[0042] The first-stage audio signal can refer to the audio signal generated between the prediction that the vehicle will switch to the reference operating mode at the first moment and the actual switch to the reference operating mode. The vehicle audio signal generated after the actual switch to the reference operating mode can be referred to as the second-stage audio signal.

[0043] The aforementioned scenario, where the vehicle is predicted to switch to the reference operating mode immediately, allows for the generation of a first-stage audio signal. This enables the generation of the first-stage audio signal before the actual switch to the reference operating mode, improving the timeliness of vehicle audio signal generation.

[0044] In this embodiment, by determining driving parameter information and road condition information related to the vehicle, wherein the driving parameter information describes the user's control parameters of the vehicle and / or the vehicle's operating parameters under the control parameters, and based on the driving parameter information and road condition information, it is predicted whether the vehicle will switch to the reference operating mode in the first time, and if it is predicted that the vehicle will switch to the reference operating mode in the first time, a first-stage audio signal is generated, which can generate the vehicle's audio signal in a timely manner and effectively improve the driving experience.

[0045] Figure 2This is a flowchart illustrating a method for determining vehicle audio signals according to other embodiments of this disclosure, such as... Figure 2 As shown, the method for determining vehicle audio signals can be applied to electronic devices and includes the following steps:

[0046] Step S201: Determine the driving parameter information and driving road condition information related to the vehicle, wherein the driving parameter information describes the user's control parameters of the vehicle and / or the vehicle's operating parameters under the control parameters.

[0047] Step S202: Based on driving parameter information and road condition information, predict whether the vehicle will switch to the reference operating mode immediately.

[0048] Step S203: If it is predicted that the vehicle will switch to the reference operating mode in the first instant, generate the first stage audio signal.

[0049] For a detailed description of steps S201-S203, please refer to the above embodiments, which will not be repeated here.

[0050] Step S204: If it is determined that the vehicle has switched to the reference operating mode, generate the second stage audio signal.

[0051] In some embodiments, a second-stage audio signal can be generated if it is determined that the vehicle has switched to a reference operating mode.

[0052] In some embodiments, the process of determining whether a vehicle is switching to a reference operating mode can be achieved by determining that a driving control command to switch the vehicle to the reference operating mode has been received (e.g., the driver presses the accelerator pedal), thereby enabling the timely generation of a second-stage audio signal.

[0053] For example, by anticipating potential future acceleration of the vehicle, an audio signal can be synthesized to eliminate passenger dizziness while providing an immersive driving experience. When the vehicle is on the road, the system can predict whether the driver will accelerate rapidly based on driver parameters and road conditions (such as traffic congestion ahead and distance from the vehicle in front). When acceleration is predicted, the system begins synthesizing the first-stage audio signal. When the driver depresses the accelerator pedal (another example of switching to the reference operating mode), a second-stage audio signal is synthesized based on pedal engagement and vehicle speed. The first and second-stage audio signals can overlap for a smooth transition.

[0054] In this embodiment, by determining vehicle-related driving parameter information and road condition information, where the driving parameter information describes the user's control parameters of the vehicle and / or the vehicle's operating parameters under those control parameters, and based on the driving parameter information and road condition information, it predicts whether the vehicle will switch to a reference operating mode immediately. If the vehicle is predicted to switch to the reference operating mode immediately, a first-stage audio signal is generated. This timely generation of the vehicle's audio signal effectively improves the driving experience. Furthermore, it enables a smooth transition between different stages of audio signals, significantly enhancing the driving experience.

[0055] In some embodiments of this disclosure, after generating the first-stage audio signal, if it is determined that the current time has reached the first time and the vehicle has not switched to the reference operating mode, the first-stage audio signal is discarded. This can be effectively applied to personalized application scenarios and improve practicality.

[0056] In other words, if it is predicted that the vehicle will switch to the reference operating mode at the first moment, but the vehicle does not actually switch to the reference operating mode, the first stage audio signal can be discarded, and the prediction model can be re-modeled and learned to improve the modeling accuracy of the prediction model.

[0057] Figure 3 This is a flowchart illustrating a method for determining vehicle audio signals according to other embodiments of this disclosure, such as... Figure 3 As shown, the method for determining vehicle audio signals can be applied to electronic devices and includes the following steps:

[0058] Step S301: Determine the driving parameter information and driving road condition information related to the vehicle, wherein the driving parameter information describes the user's control parameters of the vehicle and / or the vehicle's operating parameters under the control parameters.

[0059] Step S302: Based on driving parameter information and road condition information, predict whether the vehicle will switch to the reference operating mode immediately.

[0060] For a detailed description of steps S301-S302, please refer to the above embodiments, which will not be repeated here.

[0061] Step S303: If it is predicted that the vehicle will switch to the reference operating mode at the first time, acquire the first initial audio signal, the initial magnification and the first initial frame shift.

[0062] In some embodiments, a frequency shifting algorithm can be used when generating the first-stage audio signal. A frequency shifting algorithm expands an audio segment by different magnifications to synthesize sounds at different frequencies.

[0063] The initial audio signal used to generate the first-stage audio signal can be referred to as the first initial audio signal. The initial scaling factor used to generate the first-stage audio signal can be referred to as the initial scaling factor ratio0. The initial frame shift used to generate the first-stage audio signal can be referred to as the first initial frame shift hop. in .

[0064] Step S304: Determine the amplitude and phase of the first initial audio signal at each frequency point.

[0065] In some embodiments, a selected audio segment (which may be referred to as the first initial audio signal) can be framed, and the first initial frame is shifted by hop. in The frame length can be selected based on experience, generally between 25% and 50%. After segmenting the first initial audio signal into frames, the segmented data is obtained. Then, a Fast Fourier Transform (FFT) can be performed on the segmented data to obtain the amplitude and phase of the first initial audio signal at each frequency point.

[0066] Step S305: Determine the first-stage multiplier based on the initial multiplier.

[0067] The first-stage ratio refers to the actual ratio required to generate the corresponding audio signal at each time point in the first stage (the audio signals at multiple time points in the first stage together constitute the first-stage audio signal). The first-stage ratio may be different at different time points. The first-stage ratio can be represented by the ratio.

[0068] After obtaining the initial magnification, the first-stage magnification can be determined based on it. In other words, the required first-stage magnification during the generation of the audio signal at each time point in the first stage can be obtained by accumulating the initial magnification, thereby improving the accuracy of the first-stage magnification generation.

[0069] Optionally, in some embodiments, the process of determining the first-stage magnification based on the initial magnification may involve determining a reference magnification, determining the acceleration slope based on the reference magnification and the initial magnification, determining a first time difference between the current time and the time of acquiring the first initial audio signal, and determining the first-stage magnification based on the initial magnification, the first time difference, and the acceleration slope. This allows for accurate determination of the first-stage magnification, supporting improvements in the accuracy of generating the first-stage audio signal.

[0070] For example, let's take the first stage audio signal as an example of the first stage acceleration sound wave. Starting with the current initial magnification, the acceleration sound wave at subsequent time points can be achieved by accumulating the magnification based on the initial magnification. Considering the final road speed limit, such as some roads only allowing acceleration to 100 km / s, the acceleration slope α (an optional example of the first stage magnification) can be determined based on the initial magnification. The formula is as follows:

[0071] ratio=ratio0+α·Δ t ;

[0072] Wherein, the growth rate slope α = (ratio MAX -ratio0) / 1000, ratio MAX For scalable maximum scaling (an optional example of the reference scaling), Δ t Indicates the first time difference.

[0073] Step S306: Determine the first stage frame shift based on the first stage scaling factor and the first initial frame shift.

[0074] The first-stage frame shift can refer to the actual frame shift required to generate the corresponding audio signal at each time point in the first stage (the audio signals at multiple time points in the first stage together constitute the first-stage audio signal).

[0075] In some embodiments, in the process of determining the first stage frame shift based on the first stage scaling factor and the first initial frame shift, the first stage scaling factor and the first initial frame shift may be multiplied, and the result of the product may be used as the first stage frame shift.

[0076] For example, the first-stage frame shift hop is obtained by processing the first-stage scaling factor and the first initial frame shift based on the following formula. out .

[0077] hop out =ratio*hop in ;

[0078] Where ratio is the multiplier for the first stage, hop in It is the first initial frame shift.

[0079] Step S307: Based on the first stage frame shift, process the amplitude and phase of the first initial audio signal at each frequency point to obtain the first stage audio signal.

[0080] After determining the first-stage frame shift, the amplitude and phase of the first initial audio signal at each frequency point can be processed according to the first-stage frame shift to obtain the first-stage audio signal.

[0081] In some embodiments, in the process of processing the amplitude and phase of the first initial audio signal at various frequency points according to the first-stage frame shift to obtain the first-stage audio signal, a second time difference can be determined based on the first-stage frame shift and the sampling rate associated with the first initial audio signal, and an inverse Fourier transform can be performed on the amplitude and phase of the first initial audio signal at various frequency points according to the second time difference to obtain the first-stage audio signal. This enables the rapid and accurate generation of the first-stage audio signal.

[0082] For example, the amplitude of the first-stage audio signal and the first initial audio signal can be the same, but their phases can be different. The first-stage audio signal can then be generated based on the following method:

[0083] The phase of the i-th frame of the first-stage audio signal is:

[0084] φ(k) i =φ(k) i-1 +Δ t '×ω(k) i ;

[0085] Where k represents the frequency point, i represents the current frame (the i-th frame), i-1 represents the previous frame (the (i-1)-th frame), and φ(k) i Let φ(k) represent the phase of the i-th frame. i-1 Δ represents the phase of the (i-1)th frame. t 'Indicates the second time difference, Δ t '=hop out ÷Fs, where Fs is the sampling rate, ω(k) i This represents the frequency value corresponding to the k-th frequency point of the i-th frame. Then, combining the amplitude and phase of the initial audio signal at each frequency point, an inverse Fourier transform is performed to obtain the time-domain audio signal of the i-th frame. The time-domain audio signals of multiple frames together constitute the first-stage audio signal. The formula for solving the time-domain audio signal of the i-th frame is as follows:

[0086] x i =IFFT(X(k)) k＝0,1,...,N-1 |∠φ(k) k＝0,1,...,N-1 );

[0087] Where, |X(k) k＝0,1,...,N-1 | represents the amplitude of each frequency point, N represents the Nth frequency point, N is a positive integer greater than 1, and the amplitude is the amplitude of the first initial audio signal.

[0088] In this embodiment, by determining vehicle-related driving parameter information and driving road condition information, wherein the driving parameter information describes the user's control parameters of the vehicle and / or the vehicle's operating parameters under the control parameters, and based on the driving parameter information and driving road condition information, it is predicted whether the vehicle will switch to a reference operating mode in the first instance, and if it is predicted that the vehicle will switch to the reference operating mode in the first instance, a first initial audio signal, an initial magnification, and a first initial frame shift are obtained, the amplitude and phase of the first initial audio signal at each frequency point are determined, a first stage magnification is determined based on the initial magnification, a first stage frame shift is determined based on the first stage magnification and the first initial frame shift, and the amplitude and phase of the first initial audio signal at each frequency point are processed based on the first stage frame shift to obtain a first stage audio signal. This enables timely generation of the vehicle's audio signal, effectively improving the driving experience and significantly enhancing the accuracy of the first stage audio signal generation.

[0089] Figure 4 This is a flowchart illustrating a method for determining vehicle audio signals according to other embodiments of this disclosure, such as... Figure 4 As shown, the method for determining vehicle audio signals can be applied to electronic devices and includes the following steps:

[0090] Step S401: Determine the driving parameter information and driving road condition information related to the vehicle, wherein the driving parameter information describes the user's control parameters of the vehicle and / or the vehicle's operating parameters under the control parameters.

[0091] Step S402: Based on driving parameter information and road condition information, predict whether the vehicle will switch to the reference operating mode immediately.

[0092] Step S403: If it is predicted that the vehicle will switch to the reference operating mode in the first instant, generate the first stage audio signal.

[0093] For a detailed description of steps S401-S403, please refer to the above embodiments, which will not be repeated here.

[0094] Step S404: If it is determined that the vehicle has switched to the reference operating mode, an intermediate audio signal is generated.

[0095] In this embodiment of the disclosure, in order to achieve a smooth transition between the first-stage audio signal and the second-stage audio signal, an intermediate processing stage audio signal can be generated when the vehicle is determined to switch to the reference operating mode. This audio signal can be referred to as the intermediate audio signal. Subsequently, the intermediate audio signal and the first-stage audio signal can be directly synthesized, without any limitation.

[0096] In some embodiments, during the generation of the intermediate audio signal, a second initial audio signal can be acquired, wherein the second initial audio signal has corresponding reference operating condition information and a second initial frame shift, and the amplitude and phase of the second initial audio signal at each frequency point are determined. Based on the current operating condition information and the reference operating condition information, a second stage multiplier is determined. Based on the second stage multiplier and the second initial frame shift, a second stage frame shift is determined. Based on the second stage frame shift, the amplitude and phase of the second initial audio signal at each frequency point are processed to obtain the intermediate audio signal, thereby effectively improving the accuracy of intermediate audio signal processing.

[0097] The initial audio signal used to generate the intermediate audio signal can be referred to as the second initial audio signal. The initial frame shift used to generate the intermediate audio signal can be referred to as the second initial frame shift hop. in '.

[0098] Among them, reference operating condition information refers to information related to the vehicle's operating conditions as a reference. For example, a reference operating condition information setting of 2000 RPM; correspondingly, the second initial audio signal is the audio signal at the selected 2000 RPM. Current operating condition information refers to information related to the vehicle's current operating conditions. For example, a current operating condition information setting of 3000 RPM.

[0099] In some embodiments, the difference between the current operating condition information and the reference operating condition information can be analyzed, and the difference can be used to determine the second-stage rate.

[0100] The second-stage ratio refers to the actual ratio required to generate the corresponding audio signal at various time points in the second stage (the audio signals at multiple time points in the second stage together form the intermediate audio signal). The second-stage ratio may be different at different time points. The second-stage ratio can be represented by ratio'.

[0101] For example, if the selected audio is at 2000 RPM, and the current RPM is 3000, then the second-stage ratio' would be 1.5.

[0102] In some embodiments, the second-stage frame shift hop is determined based on the second-stage scaling factor and the second initial frame shift. out The process can be determined based on the following formula:

[0103] hop out '=ratio'*hop in ';

[0104] Where 'ratio' represents the second-stage multiplier, hop in ' indicates the second initial frame shift.

[0105] In some embodiments, the above describes the determination of the second-stage frame shift hop. out After that, the amplitude and phase of the second initial audio signal at each frequency point can be processed according to the second-stage frame shift to obtain the intermediate audio signal.

[0106] In some embodiments, in the process of processing the amplitude and phase of the second initial audio signal at various frequency points according to the second-stage frame shift to obtain the intermediate audio signal, a third time difference can be determined based on the second-stage frame shift and the sampling rate associated with the second initial audio signal. Then, an inverse Fourier transform is performed on the amplitude and phase of the second initial audio signal at various frequency points based on the third time difference to obtain the intermediate audio signal. This enables the rapid and accurate generation of the intermediate audio signal.

[0107] For the implementation method of processing the amplitude and phase of the second initial audio signal at each frequency point according to the second stage frame shift to obtain the intermediate audio signal, please refer to the above-described process of processing the amplitude and phase of the first initial audio signal at each frequency point according to the first stage frame shift to obtain the first stage audio signal, which will not be repeated here.

[0108] Step S405: Reduce the amplitude of the first-stage audio signal to obtain the target audio signal.

[0109] In some embodiments, the amplitude of the first-stage audio signal can be gradually reduced based on a set step size to obtain the target audio signal.

[0110] Step S406: Synthesize the second-stage audio signal based on the intermediate audio signal and the target audio signal.

[0111] In some embodiments, a second-stage audio signal can be synthesized based on the intermediate audio signal and the target audio signal. This effectively achieves a smooth transition between the first-stage and second-stage audio signals.

[0112] In some embodiments, the intermediate audio signal and the target audio signal can be directly mixed, and the resulting audio signal can be used as the second-stage audio signal.

[0113] like Figure 5 As shown, Figure 5 This is a schematic diagram of the two-stage audio signals generated in this embodiment of the disclosure. It can be seen that by anticipating the driver's behavior in advance, passengers can be given more reaction time, providing an immersive driving experience while reducing dizziness. Figure 5 The diagram includes lines 51 and 52. Line 51 shows a vehicle audio signal generated using the vehicle audio signal generation method provided in the embodiments of this disclosure, and line 52 shows a vehicle audio signal generated by a method in the related art.Figure 5 The example used here is the driver pressing the accelerator pedal, which triggers a switch to acceleration mode. There are no restrictions on this.

[0114] In this embodiment, by determining vehicle-related driving parameter information and road condition information, where the driving parameter information describes the user's control parameters of the vehicle and / or the vehicle's operating parameters under those control parameters, and based on the driving parameter information and road condition information, it is predicted whether the vehicle will switch to a reference operating mode immediately. If the vehicle is predicted to switch to the reference operating mode immediately, a first-stage audio signal is generated, enabling timely generation of the vehicle's audio signal and effectively improving the driving experience. By generating an intermediate audio signal when the vehicle is determined to have switched to the reference operating mode, reducing the amplitude of the first-stage audio signal to obtain the target audio signal, and synthesizing a second-stage audio signal based on the intermediate and target audio signals, a smooth transition between different stages of audio signals can be achieved, significantly improving the driving experience.

[0115] Figure 6 This is a structural diagram of a vehicle audio signal determination device according to some embodiments of the present disclosure.

[0116] like Figure 6 As shown, the vehicle audio signal determining device 60 includes:

[0117] The determining unit 601 is used to determine driving parameter information and driving road condition information related to the vehicle, wherein the driving parameter information describes the user's control parameters of the vehicle and / or the vehicle's operating parameters under the control parameters.

[0118] The prediction unit 602 is used to predict whether the vehicle will switch to the reference operating mode at the first time based on driving parameter information and driving road condition information.

[0119] The generation unit 603 is used to generate a first-stage audio signal when the vehicle is predicted to switch to the reference operating mode in the first instant.

[0120] Regarding the apparatus in the above embodiments, the specific manner in which each unit performs its operation has been described in detail in the embodiments related to the method, and will not be elaborated upon here.

[0121] In this embodiment, by determining driving parameter information and road condition information related to the vehicle, wherein the driving parameter information describes the user's control parameters of the vehicle and / or the vehicle's operating parameters under the control parameters, and based on the driving parameter information and road condition information, it is predicted whether the vehicle will switch to the reference operating mode in the first time, and if it is predicted that the vehicle will switch to the reference operating mode in the first time, a first-stage audio signal is generated, which can generate the vehicle's audio signal in a timely manner and effectively improve the driving experience.

[0122] Figure 7 This is a functional block diagram illustrating an exemplary embodiment of a vehicle. For example, vehicle 700 can be a hybrid vehicle, a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicles. Vehicle 700 can be an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous vehicle.

[0123] Reference Figure 7 The vehicle 700 may include various subsystems, such as an infotainment system 710, a perception system 720, a decision control system 730, a drive system 740, and a computing platform 750. The vehicle 700 may also include more or fewer subsystems, and each subsystem may include multiple components. Furthermore, each subsystem and each component of the vehicle 700 can be interconnected via wired or wireless means.

[0124] In some embodiments, the infotainment system 710 may include a communication system, an entertainment system, and a navigation system, etc.

[0125] The perception system 720 may include several sensors for sensing information about the environment surrounding the vehicle 700. For example, the perception system 720 may include a global positioning system (which may be GPS, BeiDou, or other positioning systems), an inertial measurement unit (IMU), lidar, millimeter-wave radar, ultrasonic radar, and a camera device.

[0126] The decision control system 730 may include a computing system, a vehicle controller, a steering system, a throttle, and a braking system.

[0127] The drive system 740 may include components that provide powered motion to the vehicle 700. In one embodiment, the drive system 740 may include an engine, an energy source, a transmission system, and wheels. The engine may be one or a combination of internal combustion engines, electric motors, and compressed air engines. The engine is capable of converting energy provided by the energy source into mechanical energy.

[0128] Some or all of the functions of vehicle 700 are controlled by computing platform 750. Computing platform 750 may include at least one processor 751 and memory 752, and processor 751 may execute instructions 753 stored in memory 752.

[0129] Processor 751 can be any conventional processor, such as a commercially available CPU. The processor may also include, for example, a Graphics Processing Unit (GPU), a Field Programmable Gate Array (FPGA), a System on Chip (SOC), an Application Specific Integrated Circuit (ASIC), or a combination thereof.

[0130] The memory 752 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic storage, flash memory, magnetic disk or optical disk.

[0131] In addition to instruction 753, memory 752 can also store data, such as road maps, route information, vehicle position, direction, speed, and other data. The data stored in memory 752 can be used by computing platform 750.

[0132] In this embodiment of the disclosure, processor 751 may execute instruction 753 to complete all or part of the steps of the above-described vehicle audio signal determination method.

[0133] This disclosure also provides a computer-readable storage medium having stored thereon computer program instructions that, when executed by a processor, implement the steps of the vehicle audio signal determination method provided in this disclosure.

[0134] Furthermore, the term “exemplary” is used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as “exemplary” is not necessarily to be construed as advantageous compared to other aspects or designs. Rather, the use of the term “exemplary” is intended to present the concept in a concrete manner. As used herein, the term “or” is intended to mean an inclusive “or” rather than an exclusive “or.” That is, unless otherwise specified or clear from the context, “X applies A or B” is intended to mean any of the natural inclusive arrangements. That is, “X applies A or B” satisfies any of the foregoing instances if X applies A; X applies B; or both X applies A and B. Additionally, unless otherwise specified or clear from the context to refer to the singular form, the articles “a” and “an” as used in this application and the appended claims are generally understood to mean “one or more.”

[0135] Similarly, although this disclosure has been shown and described with respect to one or more implementations, equivalent variations and modifications will occur to those skilled in the art upon reading and understanding the specification and drawings. This disclosure includes all such modifications and variations and is limited only by the scope of the claims. In particular, with respect to the various functions performed by the components described above (e.g., elements, resources, etc.), unless otherwise indicated, the terminology used to describe such components is intended to correspond to any component (functionally equivalent) that performs the specific function of the described component, even if structurally not equivalent to the disclosed structure. Furthermore, although specific features of this disclosure may have been disclosed with respect to only one of several implementations, such features may be combined with one or more other features of other implementations, as may be desired and advantageous to any given or particular application. Moreover, with regard to the terms “comprising,” “owning,” “having,” “having,” or variations thereof as used in the detailed description or claims, such terms are intended to be inclusive in a manner similar to the term “including.”

[0136] Other embodiments of this disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the invention disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of this disclosure that follow the general principles of this disclosure and include common knowledge or customary techniques in the art not disclosed herein. The specification and examples are to be considered exemplary only, and the true scope and spirit of this disclosure are indicated by the following claims.

[0137] It should be understood that this disclosure is not limited to the precise structures described above and shown in the accompanying drawings, and various modifications and changes can be made without departing from its scope. The scope of this disclosure is limited only by the appended claims.

[0138] It should be understood that, unless otherwise specifically indicated, features of various embodiments of this disclosure described herein can be combined with each other. As used herein, the term "and / or" includes any one of the relevant listed items and any combination of any two or more; similarly, "at least one of..." includes any one of the relevant listed items and any combination of any two or more. Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description herein, "a plurality of" means at least two, such as two, three, etc., unless otherwise expressly specified.

Claims

1. A method for determining vehicle audio signals, characterized in that, include: Determine vehicle-related driving parameter information and driving road condition information, wherein the driving parameter information describes the user's control parameters for the vehicle and / or the vehicle's operating parameters under the control parameters; Based on the driving parameter information and the driving road condition information, predict whether the vehicle will switch to the reference operating mode immediately; and A first-stage audio signal is generated if it is predicted that the vehicle will switch to the reference operating mode in the first instance.

2. The method according to claim 1, characterized in that, After generating the first-stage audio signal, the method further includes: Upon determining that the vehicle has switched to the reference operating mode, a second-stage audio signal is generated.

3. The method according to claim 1, characterized in that, After generating the first-stage audio signal, the method further includes: If it is determined that the current time has reached the first time and the vehicle has not switched to the reference operating mode, the first stage audio signal is discarded.

4. The method according to claim 1, characterized in that, The determination of vehicle-related driving parameter information includes at least one of the following: Receive a driving parameter selection instruction, and use the candidate parameter information selected by the driving parameter selection instruction as the driving parameter information; Determine the historical driving behavior information related to the vehicle, and determine the driving parameter information based on the historical driving behavior information.

5. The method according to claim 1, characterized in that, Determine driving information related to the vehicle, including: Determine the relative distance between the vehicle and other vehicles; Determine the traffic flow data of the road on which the vehicle is traveling; The relative distance and the traffic flow data are used together as the driving road condition information.

6. The method according to claim 1, characterized in that, The step of predicting whether the vehicle should switch to a reference operating mode immediately based on the driving parameter information and the driving road condition information includes: The driving parameter information and the driving road condition information are input into the prediction model to obtain the prediction result output by the prediction model. The prediction model has modeled and learned the mapping relationship between the driving parameter information, the driving road condition information and the prediction result. Based on the prediction results, it is predicted whether the vehicle will switch to the reference operating mode at the first moment.

7. The method according to claim 1, characterized in that, The generation of the first-stage audio signal includes: Acquire the first initial audio signal, the initial magnification, and the first initial frame shift; Determine the amplitude and phase of the first initial audio signal at each frequency point; Based on the initial multiplier, determine the multiplier for the first stage; The first stage frame shift is determined based on the first stage scaling factor and the first initial frame shift. Based on the first stage frame shift, the amplitude and phase of the first initial audio signal at each frequency point are processed to obtain the first stage audio signal.

8. The method according to claim 7, characterized in that, The step of determining the first-stage multiplier based on the initial multiplier includes: Determine the reference leverage ratio; The growth rate slope is determined based on the reference ratio and the initial ratio; Determine the first time difference between the current time and the time when the first initial audio signal is acquired; The first stage multiplier is determined based on the initial multiplier, the first time difference, and the growth rate slope.

9. The method according to claim 7, characterized in that, The step of processing the amplitude and phase of the first initial audio signal at various frequency points according to the first stage frame shift to obtain the first stage audio signal includes: The second time difference is determined based on the first-stage frame shift and the sampling rate associated with the first initial audio signal; Based on the second time difference, the amplitude and phase of the first initial audio signal at each frequency point are subjected to inverse Fourier transform to obtain the first stage audio signal.

10. The method according to claim 2, characterized in that, The generation of the second-stage audio signal includes: Generate intermediate audio signals; Reduce the amplitude of the audio signal in the first stage to obtain the target audio signal; The second stage audio signal is synthesized based on the intermediate audio signal and the target audio signal.

11. The method according to claim 10, characterized in that, The generation of the intermediate audio signal includes: Acquire a second initial audio signal, wherein the second initial audio signal has corresponding reference operating condition information and a second initial frame shift; Determine the amplitude and phase of the second initial audio signal at each frequency point; Based on the current operating condition information and the aforementioned reference operating condition information, determine the second-stage scaling factor; The second-stage frame shift is determined based on the second-stage scaling factor and the second initial frame shift; Based on the second stage frame shift, the amplitude and phase of the second initial audio signal at each frequency point are processed to obtain the intermediate audio signal.

12. The method according to claim 11, characterized in that, The step of processing the amplitude and phase of the second initial audio signal at various frequency points according to the second stage frame shift to obtain the intermediate audio signal includes: The third time difference is determined based on the second-stage frame shift and the sampling rate associated with the second initial audio signal; The intermediate audio signal is obtained by performing an inverse Fourier transform on the amplitude and phase of the second initial audio signal at each frequency point based on the third time difference.

13. A vehicle audio signal determining device, characterized in that, include: A determining unit is used to determine driving parameter information and driving road condition information related to the vehicle, wherein the driving parameter information describes the user's control parameters of the vehicle and / or the vehicle's operating parameters under the control parameters; The prediction unit is used to predict whether the vehicle will switch to the reference operating mode at the first time based on the driving parameter information and the driving road condition information. The generation unit is used to generate a first-stage audio signal when it is predicted that the vehicle will switch to the reference operating mode at the first moment.

14. A vehicle, characterized in that, include: processor; Memory used to store processor-executable instructions; The processor is configured as follows: The steps for implementing the method according to any one of claims 1 to 12.

15. A non-transitory computer-readable storage medium, wherein instructions in the storage medium, when executed by a processor of a mobile terminal, enable the mobile terminal to perform a method comprising: Determine vehicle-related driving parameter information and driving road condition information, wherein the driving parameter information describes the user's control parameters for the vehicle and / or the vehicle's operating parameters under the control parameters; Based on the driving parameter information and the driving road condition information, predict whether the vehicle will switch to the reference operating mode immediately; and A first-stage audio signal is generated if it is predicted that the vehicle will switch to the reference operating mode in the first instance.

Images