Sound wave generation method, device and system

Abstract

The invention provides a sound wave generation method, device and system. In the method, after a user instruction is obtained, to-be-simulated sound wave information in the user instruction is determined, then a reference audio signal corresponding to the to-be-simulated sound wave information is determined, and after current driving state information of a vehicle is determined, the reference audio signal is processed based on the driving state information, so that the current driving state information of the vehicle is obtained. The to-be-played simulated sound corresponding to the to-be-simulated sound information is obtained, so that the vehicle plays the to-be-played simulated sound, and the sound playing effect of the vehicle is achieved. According to the scheme of the invention, the corresponding reference audio signal is determined based on the user instruction, and the to-be-played simulated sound is obtained in a mode of processing the reference audio signal by using the driving state information. Therefore, when the sound wave is generated through the scheme of the invention, the audio frequency as the sound wave does not need to be stored in the memory space of the vehicle, so that the occupation of the memory space of the vehicle can be reduced.

Description

Technical Field

[0001] The present disclosure relates to the field of intelligent driving technology, and in particular to a method, device and system for generating sound waves. Background Art

[0002] Some vehicles (such as some electric vehicles) are usually quiet when driving, which may cause pedestrians or users of other vehicles on the road where the vehicle is driving to fail to notice the vehicle in time, causing safety hazards. In addition, it may also result in a poor driving experience of the vehicle.

[0003] To address this problem, audio is currently usually stored in the vehicle's memory space, such as the engine audio of a fuel vehicle. During the driving of the vehicle, the audio is extracted from the memory space and played to achieve the effect of playing sound waves while the vehicle is driving.

[0004] However, since this method requires the storage of audio, and the volume of audio data is usually large, it will occupy a large amount of memory space in the vehicle. Summary of the invention

[0005] In order to solve the above technical problems, the present disclosure provides a sound generation method, device and system to solve the problem in the prior art that in order for a vehicle to play sound, it is necessary to store audio in the vehicle's memory space, resulting in a large amount of vehicle memory space being occupied.

[0006] A first aspect of the present disclosure provides a method for generating sound waves, comprising:

[0007] Get user instructions;

[0008] Based on the user instruction, determining the sound wave information to be simulated in the user instruction;

[0009] Based on the sound wave information to be simulated, determining a reference audio signal corresponding to the sound wave information to be simulated;

[0010] Determine the current driving status information of the vehicle;

[0011] The reference audio signal is processed based on the driving state information to obtain a simulated sound to be played corresponding to the sound information to be simulated.

[0012] A second aspect of the present disclosure provides a device for generating sound waves, comprising:

[0013] An instruction acquisition module, used to acquire user instructions;

[0014] a sound wave information determination module, configured to determine the sound wave information to be simulated in the user instruction based on the user instruction acquired by the instruction acquisition module;

[0015] A reference audio determination module, configured to determine a reference audio signal corresponding to the sound information to be simulated based on the sound information to be simulated determined by the sound information determination module;

[0016] A state information determination module, used to determine the current driving state information of the vehicle;

[0017] The audio adjustment module is used to adjust the reference audio signal determined by the reference audio determination module based on the driving state information determined by the state information determination module to obtain the simulated sound to be played corresponding to the sound information to be simulated.

[0018] According to a third aspect of the present disclosure, a computer-readable storage medium is provided, wherein the storage medium stores a computer program, and the computer program is used to execute the method for generating sound waves according to the first aspect.

[0019] According to a fourth aspect of the present disclosure, an electronic device is provided, the electronic device comprising:

[0020] processor;

[0021] a memory for storing instructions executable by the processor;

[0022] The processor is used to read the executable instructions from the memory and execute the instructions to implement the sound wave generation method described in the first aspect above.

[0023] The fifth aspect of the present disclosure provides a computer program product. When an instruction processor in the computer program product executes, the method for generating sound waves provided in the first aspect of the present disclosure is executed.

[0024] The embodiments of the present disclosure provide a method, device and system for generating sound waves. In the method, after obtaining a user instruction, the sound wave information to be simulated in the user instruction is determined, and then a reference audio signal corresponding to the sound wave information to be simulated is determined. Moreover, after determining the current driving state information of the vehicle, the reference audio signal is processed based on the driving state information to obtain a simulated sound wave to be played corresponding to the sound wave information to be simulated, so that the vehicle plays the simulated sound wave to be played, thereby achieving the effect of the vehicle playing the sound wave.

[0025] The solution disclosed in the present invention determines a corresponding reference audio signal based on a user instruction, and obtains a simulated sound wave to be played by processing the reference audio signal using driving state information. Therefore, the solution disclosed in the present invention enables the vehicle to play the simulated sound wave to be played, thereby increasing driving pleasure. Moreover, when the solution generates the sound wave, it is not necessary to store the audio as the sound wave in the vehicle's memory space, thereby reducing the occupation of the vehicle's memory space.

[0026] In addition, the solution provided by the embodiment of the present disclosure generates a corresponding reference audio signal according to the user's instruction, and then processes the reference audio signal according to the current driving state information of the vehicle to obtain the simulated sound to be played. Therefore, if the user's instruction is different, different simulated sound waves to be played can be obtained through the solution of the embodiment of the present disclosure, that is, the solution provided by the embodiment of the present disclosure can obtain diversified simulated sound waves to be played, so as to achieve the effect of making the vehicle play a variety of sound waves, thereby further increasing the fun of driving the vehicle. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 It is a schematic diagram of a vehicle architecture to which the present disclosure is applicable.

[0028] Figure 2 It is a flowchart of a method for generating sound waves provided by an exemplary embodiment of the present disclosure.

[0029] Figure 3 It is a flowchart of a method for generating sound waves provided by another exemplary embodiment of the present disclosure.

[0030] Figure 4 It is a flowchart of a method for generating sound waves provided by another exemplary embodiment of the present disclosure.

[0031] Figure 5 It is a flowchart of a method for generating sound waves provided by another exemplary embodiment of the present disclosure.

[0032] Figure 6 It is a flowchart of a method for generating sound waves provided by another exemplary embodiment of the present disclosure.

[0033] Figure 7 It is a flowchart of a method for generating sound waves provided by another exemplary embodiment of the present disclosure.

[0034] Figure 8 It is a schematic structural diagram of a sound wave generating device provided by an exemplary embodiment of the present disclosure.

[0035] Fig. 9 It is a schematic structural diagram of a sound wave generating device provided by another exemplary embodiment of the present disclosure.

[0036] Fig.10 is a structural diagram of an electronic device provided by an exemplary embodiment of the present disclosure. DETAILED DESCRIPTION

[0037] To explain the present disclosure, example embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present disclosure, rather than all the embodiments. It should be understood that the present disclosure is not limited to the example embodiments.

[0038] It should be noted that the relative arrangement of components and steps, the numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

[0039] Application Overview

[0040] The sound of a vehicle usually refers to the sound produced by the vehicle engine when it is working. This sound is produced by the combined effects of multiple factors such as the mechanical movement inside the engine, the exhaust system, and air flow. The sound played by the vehicle during driving can not only reflect the vehicle's power performance, but also help improve the driver's driving experience.

[0041] However, some vehicles are relatively quiet during driving and do not make any sound. For example, with the rise of new energy vehicles, electric vehicles have emerged. The engine of an electric vehicle has been replaced by an electric motor engine instead of a traditional fuel engine. The electric motor engine drives the vehicle by driving the rotor in a magnetic field through the mutual repulsion between the magnetic poles and the permanent magnets. During this process, the electric motor engine does not generate vibration. Therefore, electric vehicles do not make any sound during driving.

[0042] However, since these vehicles do not play sound waves when driving, the driving process is relatively quiet, which may cause pedestrians or users of other vehicles on the road where the vehicle is driving to fail to detect the vehicle in time, resulting in delayed avoidance and causing safety hazards. In addition, it will also reduce the driver's driving experience.

[0043] In order to enable these vehicles to play sounds, audio is usually stored in the vehicle's memory space, for example, the engine audio of a fuel vehicle is stored. During the driving of the vehicle, the audio is extracted from the memory space and played to achieve the effect of the vehicle playing sounds while driving.

[0044] However, this method requires that the audio be stored in the vehicle's memory space in advance, and the volume of audio data is usually large, thus occupying a large amount of the vehicle's memory space.

[0045] In particular, if a vehicle user wants the vehicle to be able to play a variety of sounds, multiple audios need to be stored in the vehicle's memory space in advance, resulting in more memory space being occupied.

[0046] Furthermore, in this method, the number of pre-stored audios is limited, and the vehicle user can only select the sound waves he wants to play each time from the limited audios, resulting in a limited number of types of sound waves that can be played by the vehicle.

[0047] In addition, if multiple audios are stored in the vehicle's memory space, when the vehicle needs to play sound, the driver needs to operate the vehicle so that the vehicle can retrieve the audio that it wants to play this time from the multiple audios according to the received operation, so the operation is relatively cumbersome.

[0048] In order to solve the problem that a large amount of memory space of the vehicle is occupied by storing audio in the memory space of the vehicle, the embodiment of the present disclosure provides a method for generating sound waves to generate sound waves so that the vehicle can play the sound waves. In addition, the embodiment of the present disclosure does not need to store audio in advance, so the occupation of the vehicle's memory space can be reduced.

[0049] Furthermore, the solution provided by the embodiment of the present disclosure generates a corresponding reference audio signal according to the user's instruction, and then processes the reference audio signal according to the current driving state information of the vehicle to obtain the simulated sound to be played. Therefore, if the user's instruction is different, through the solution of the embodiment of the present disclosure, different simulated sound waves to be played can be generated, that is, a variety of simulated sound waves to be played can be obtained, so as to achieve the effect of making the vehicle play a variety of sound waves.

[0050] Moreover, the solution provided by the embodiment of the present disclosure can obtain the simulated sound to be played based on the acquired user instructions. In the process of generating the simulated sound to be played, the user is not required to operate the vehicle, thereby reducing user operations and the implementation method is relatively simple.

[0051] Exemplary Systems

[0052] The embodiments of the present disclosure provide a method, device and system for generating sound waves, so as to generate sound waves and enable a vehicle to play the sound waves.

[0053] In a feasible implementation, the method provided by the embodiment of the present disclosure may be applied by a vehicle. Figure 1 As shown in the schematic diagram of the vehicle architecture, the vehicle may include an input device 10 , a processor 20 and a playback device 30 .

[0054] The input device 10 is used to receive user instructions. In the present disclosure, user instructions may include instructions in the form of voice, and accordingly, the input device 10 includes a device capable of collecting user voice, such as a microphone. Alternatively, user instructions may also include instructions in the form of text, and accordingly, the input device 10 includes a device capable of receiving text input by the user, such as a touch screen capable of receiving user touch operations.

[0055] After receiving the user instruction, the input device 10 transmits the user instruction to the processor 20 .

[0056] After obtaining the user's instruction, the processor 20 can determine the current driving state information of the vehicle. A bus is provided in the vehicle, and the bus usually includes a controller area network (CAN) bus. Various control units in the vehicle (such as the engine control unit, the transmission control unit, the brake system control unit, etc.) communicate through the CAN bus to realize various functions of the vehicle, such as engine starting, transmission shifting, braking, etc. The processor 20 can determine the current driving state information of the vehicle by interacting with the bus.

[0057] In addition, the processor 20 may also determine the current driving state information of the vehicle by interacting with various components in the vehicle. For example, the processor 20 may interact with the motor of the vehicle to determine the vehicle speed in the driving state information, or the processor 20 may interact with the throttle of the vehicle to determine the throttle depth in the driving state information.

[0058] Of course, the processor 20 may also interact with other devices in the vehicle to determine other driving status information, which is not limited in the present disclosure.

[0059] After acquiring the user instruction, the processor 20 may determine a corresponding reference audio signal based on the user instruction.

[0060] In a feasible implementation, the processor 20 may run an audio generation model to generate a reference audio signal through the audio generation model.

[0061] Of course, the processor 20 may also generate the reference audio signal in other ways, which is not limited in the present disclosure.

[0062] Furthermore, after determining the reference audio signal, the processor 20 may process the reference audio signal according to the current driving state information of the vehicle to obtain the simulated sound to be played.

[0063] After obtaining the simulated sound to be played, the processor 20 may transmit the simulated sound to be played to the playing device 30 so that the playing device 30 plays the simulated sound to be played, thereby achieving the effect of the vehicle playing the sound.

[0064] The playback device 30 is a device with an audio playback function, for example, it may include a speaker, a microphone array, etc. Of course, the playback device 30 may also include other devices, which is not limited in the present disclosure.

[0065] Through the solution provided by the embodiment of the present disclosure, it is possible to generate simulated sound waves to be played, so that the vehicle can play the simulated sound waves to be played while driving. In addition, the solution does not need to store audio in the memory space of the vehicle in advance, thereby reducing the memory space occupied by the vehicle.

[0066] Exemplary Methods

[0067] Figure 2 FIG. 1 is a flow chart of a method for generating sound waves provided by an exemplary embodiment of the present disclosure. This embodiment can be applied to electronic devices, such as Figure 2 As shown, the following steps are included:

[0068] Step 201, obtaining user instructions.

[0069] The disclosed embodiment supports multiple forms of user instructions. For example, the user instruction may include an instruction in the form of voice and / or a voice instruction in the form of text.

[0070] In the embodiment of the present disclosure, the user instruction is used to indicate that the user wishes to obtain relevant information of the simulated sound wave to be played, so as to generate a corresponding reference audio signal according to the user instruction.

[0071] In a feasible implementation, the user instruction may include the type of the simulated sound to be played, such as the sound of a vehicle engine, a cat's meow, an airplane taking off, a cicada's chirping, rain, or white noise.

[0072] Alternatively, in another feasible implementation, the user instruction may include the style of the simulated sound to be played, such as country music, electronic music, or rock music.

[0073] In another feasible implementation, the user instruction may include a description of the emotions contained in the simulated sound waves to be played, such as warmth, relaxation, high pitch or passion.

[0074] Alternatively, in another feasible implementation, the user instruction may also include at least two of the descriptions of the type, style, and emotion of the simulated sound to be played, which is not limited in the present disclosure.

[0075] Of course, the above-mentioned implementation methods are only examples provided by the present disclosure, and the user instruction may also include other information that can be used to generate a reference audio signal, which is not limited by the present disclosure.

[0076] Step 202: based on the user instruction, determine the sound wave information to be simulated in the user instruction.

[0077] In the embodiment of the present disclosure, the sound wave information to be simulated includes audio features that can be used to generate an audio signal.

[0078] Exemplarily, the sound wave information to be simulated may include latent space features of the audio signal, wherein the latent space features of the audio signal are a low-dimensional representation that can be obtained through a deep learning model and can describe the audio signal, and these features include the core features of the audio signal.

[0079] Of course, the sound wave information to be simulated may also include other types of audio features that can be used to generate audio signals, and the present disclosure is not limited to this.

[0080] Step 203: determining a reference audio signal corresponding to the sound wave information to be simulated based on the sound wave information to be simulated.

[0081] In a feasible implementation of the present disclosure, the electronic device can run an audio generation model. After receiving a user instruction, the audio generation model can determine the sound wave information to be simulated corresponding to the user instruction, and further determine the reference audio signal corresponding to the sound wave information to be simulated based on the sound wave information to be simulated, that is, the electronic device can generate the reference audio signal through the audio generation model.

[0082] Of course, in the present disclosure, the sound wave information to be simulated and the reference audio signal corresponding to the sound wave information to be simulated may also be determined by other methods, and the present disclosure does not limit this.

[0083] Step 204, determining the current driving state information of the vehicle.

[0084] The current driving state information of the vehicle may include parameters used to characterize the vehicle speed and / or the vehicle power.

[0085] The power parameters of a vehicle are used to characterize the power of the vehicle during driving. For example, the power parameters of the vehicle may include any one of the following: the throttle depth of the vehicle, the vibration of the engine in the vehicle, the engine sound of the engine in the vehicle and the acceleration of the vehicle; or, in the case where the vehicle is an electric vehicle, the power parameters of the vehicle may include the click output power of the electric vehicle; or, in the case where the vehicle is a gasoline vehicle, the power parameters of the vehicle may include the opening and closing angle of the intake valve of the cylinder of the gasoline vehicle.

[0086] In a feasible implementation, the current driving status information of the vehicle can be determined through the interaction between the electronic device and the bus (eg, CAN bus) of the vehicle.

[0087] Alternatively, in another feasible implementation, the electronic device may determine the current driving status information of the vehicle by interacting with corresponding components of the vehicle.

[0088] Exemplarily, a Hall sensor may be provided in the vehicle, and the Hall sensor may collect magnetic field information of the vehicle's motor. When the vehicle's current driving status information includes the vehicle speed, the electronic device may obtain the magnetic field information by interacting with the vehicle's Hall sensor, and further determine the vehicle speed based on the magnetic field information; alternatively, a speed sensor may be provided in the vehicle, and the electronic device may determine the vehicle speed by interacting with the speed sensor; alternatively, the electronic device may determine the rotation speed of the wheel collected by the wheel speed sensor through interaction with the vehicle's wheel speed sensor, and further determine the vehicle speed based on the rotation speed of the wheel.

[0089] In another example, when the current driving state information of the vehicle includes the power parameters of the vehicle, the electronic device may determine the throttle depth in the power parameters by interacting with the throttle of the vehicle; the electronic device may determine the vibration magnitude of the engine in the power parameters by interacting with a vibration sensor that collects the vibration magnitude of the engine; the electronic device may determine the engine sound magnitude of the engine in the power parameters by interacting with a sound sensor that collects the engine sound magnitude of the engine in the vehicle; the electronic device may determine the acceleration in the power parameters by interacting with an accelerometer in the vehicle; the electronic device may determine the click output power of the electric vehicle in the power parameters by interacting with a power meter that measures the click output power of the electric vehicle; the electronic device may determine the opening and closing angle of the intake valve of the cylinder of the oil vehicle in the power parameters by interacting with a protractor that measures the opening and closing angle of the intake valve of the cylinder of the oil vehicle.

[0090] Of course, in the embodiments of the present disclosure, the electronic device may also determine the driving status information in other ways, and the present disclosure does not limit this.

[0091] Step 205: Process the reference audio signal based on the driving state information to obtain a simulated sound to be played corresponding to the sound information to be simulated.

[0092] After obtaining the simulated sound wave to be played, the electronic device can also transmit it to the playback device of the vehicle, and the playback device plays the simulated sound wave to be played, so that the vehicle achieves the effect of playing the sound wave.

[0093] The disclosed embodiment provides a method for generating a sound wave. In the method, after obtaining a user instruction, the sound wave information to be simulated in the user instruction is determined, and then a reference audio signal corresponding to the sound wave information to be simulated is determined. Moreover, after determining the current driving state information of the vehicle, the reference audio signal is processed based on the driving state information to obtain a simulated sound wave to be played corresponding to the sound wave information to be simulated, so that the vehicle plays the simulated sound wave to be played, thereby achieving the effect of the vehicle playing the sound wave.

[0094] The solution disclosed in the present invention determines a corresponding reference audio signal based on a user instruction, and obtains a simulated sound wave to be played by processing the reference audio signal using driving state information. Therefore, the solution disclosed in the present invention enables the vehicle to play the simulated sound wave to be played, thereby increasing driving pleasure. Moreover, when the solution generates the sound wave, it is not necessary to store the audio as the sound wave in the vehicle's memory space, thereby reducing the occupation of the vehicle's memory space.

[0095] Furthermore, since in the scheme of the embodiment of the present disclosure, the corresponding reference audio signal is determined by the sound information to be simulated in the user command, therefore, through different user commands, the scheme can determine different reference audio signals, and then obtain different simulated sounds to be played. Therefore, the scheme of the embodiment of the present disclosure can also obtain diversified simulated sounds to be played while reducing the occupation of the vehicle's memory space, meet the user's demand for the vehicle to play diversified sounds, and enable the vehicle to play personalized sounds, thereby further increasing the pleasure of driving the vehicle.

[0096] In addition, in the process of determining the simulated sound wave to be played, the solution of the embodiment of the present disclosure only requires the user to issue a user instruction. After receiving the user instruction, the electronic device can obtain the simulated sound wave to be played through the solution of the embodiment of the present disclosure, which simplifies the user operation and has a high degree of automation.

[0097] In step S205, the reference audio signal is processed based on the driving state information to obtain the simulated sound to be played corresponding to the simulated sound information, such as Figure 3 As shown in the above Figure 2 Based on the illustrated embodiment, step 203 may include the following steps:

[0098] Step 2051, based on the vehicle speed in the driving state information, the sampling frequency of the reference audio signal is adjusted to obtain an intermediate simulated sound wave. In other words, the intermediate simulated sound wave is a sound wave obtained by adjusting the sampling frequency of the reference audio signal according to the vehicle speed.

[0099] Step 2052: Based on the power parameters in the driving state information, the amplitude of the intermediate simulated sound wave is adjusted to obtain the simulated sound wave to be played corresponding to the sound wave information to be simulated.

[0100] In the disclosed embodiment, the reference audio signal can be determined based on the user's instruction, and the driving state information of the vehicle is not taken into account during the determination of the reference audio signal. In order to make the sound waves played by the vehicle more consistent with the driving state of the vehicle, in this embodiment, the sampling frequency of the reference audio signal can be adjusted based on the current driving state information of the vehicle, and the sound waves obtained after the adjustment are the intermediate simulated sound waves. In this case, the pitch of the intermediate simulated sound waves is adapted to the vehicle speed and can change according to the change of the vehicle speed.

[0101] In addition, after obtaining the intermediate simulated sound wave, the amplitude of the intermediate simulated sound wave is adjusted based on the power parameter in the driving state information, and the sound wave obtained after the adjustment is the simulated sound wave to be played. Since the simulated sound wave to be played is obtained by adjusting the intermediate simulated sound wave using the power parameter, the simulated sound wave to be played not only has a tone adapted to the vehicle speed, but also has a volume adapted to the power parameter, and the volume can change with the change of the power parameter of the vehicle.

[0102] That is to say, in the embodiment of the present disclosure, after determining the reference audio signal based on the sound information to be simulated in the user command, the sampling frequency of the reference audio signal can be adjusted based on the vehicle speed in the current driving state information of the vehicle, and the sound obtained after the adjustment is the intermediate simulated sound; then, based on the power parameters in the driving state information, the amplitude of the intermediate simulated sound is adjusted, and the sound obtained after the adjustment is the simulated sound to be played.

[0103] In the disclosed embodiment, the sampling frequency of the reference audio signal is adjusted using the vehicle speed in the driving status information. By adjusting the sampling frequency, the pitch of the reference audio signal can be adjusted so that the pitch of the intermediate simulated sound wave is adapted to the vehicle speed, that is, the pitch can change with the change of the vehicle speed, thereby improving the experience of the driver and passengers during the process of the vehicle playing the simulated sound wave to be played.

[0104] In addition, in this embodiment, the amplitude of the intermediate simulated sound wave is adjusted based on the power parameters in the driving status information. By adjusting the amplitude, the volume of the intermediate simulated sound wave can be achieved, so that the volume of the simulated sound wave to be played can change with the change of the power parameters of the vehicle, thereby improving the experience of the driver and passengers during the process of the vehicle playing the simulated sound wave to be played.

[0105] In step 2031, the sampling frequency is re-determined according to the vehicle speed, and the operation of determining the intermediate simulated sound wave is determined according to the re-determined sampling frequency. Figure 3 Based on the embodiment shown, the following steps can be used to adjust the sampling frequency of the reference audio signal based on the vehicle speed in the driving state information to obtain the intermediate simulated sound wave:

[0106] First, based on the vehicle speed in the driving state information, a first corresponding relationship between the pre-set vehicle speed and the sampling frequency, a sampling frequency corresponding to the vehicle speed is determined.

[0107] Then, based on the sampling frequency corresponding to the vehicle speed, the reference audio is resampled to obtain the intermediate simulated sound.

[0108] Generally, in the first correspondence, the higher the vehicle speed, the lower the sampling frequency corresponding to the vehicle speed. Accordingly, after the reference audio is resampled based on the sampling frequency determined by the first correspondence, the pitch of the intermediate simulated sound wave obtained is higher, that is, the higher the vehicle speed, the higher the pitch of the intermediate simulated sound wave, which can provide the driver and passengers with the feeling of high-speed driving of the vehicle.

[0109] Exemplarily, the first corresponding relationship can be expressed as the following formula:

[0110] f=s 0 / s;

[0111] Wherein, f represents the sampling frequency, s represents the speed of the vehicle, and s 0 Indicates the preset nominal speed. In some cases, the 0 Can be set to 1000RPM (revolutions per minute, the number of revolutions per minute of the vehicle's engine crankshaft).

[0112] Of course, the above formula is only an example of a first corresponding relationship, and the first corresponding relationship can also be expressed as other formulas, which is not limited in the present disclosure.

[0113] Through this implementation method, the pitch of the intermediate simulated sound wave can change with the change of vehicle speed, and the faster the vehicle speed, the higher the pitch of the intermediate simulated sound wave, so that the pitch of the intermediate simulated sound wave fits the actual driving scene, increases the driver's driving experience, and improves the driver and passengers' perception of vehicle speed.

[0114] In step S2032, the amplitude of the intermediate simulated sound wave is adjusted based on the power parameter in the driving state information to obtain the simulated sound wave to be played corresponding to the simulated sound wave information. Figure 3 Based on the embodiment shown, this operation can be achieved by the following steps:

[0115] Firstly, based on the power parameter in the driving state information, the audio amplitude gain corresponding to the power parameter is determined.

[0116] Then, based on the audio amplitude gain parameter, the amplitude of the intermediate simulated sound wave is gain-adjusted to obtain the simulated sound wave to be played corresponding to the sound wave information to be simulated.

[0117] In this implementation, generally, the larger the power parameter, the larger the audio amplitude gain parameter, the larger the amplitude of the simulated sound wave to be played after the gain, and the correspondingly larger the volume of the simulated sound wave to be played. That is, the larger the power parameter of the vehicle, the larger the volume of the simulated sound wave to be played, so that the volume of the simulated sound wave to be played fits the actual driving scene, can give the driver and passengers better feedback, and provide the driver and passengers with a sense of power.

[0118] In a feasible implementation, based on the power parameter in the driving state information, determining the audio amplitude gain parameter corresponding to the power parameter can be achieved by the following steps:

[0119] First, based on the power parameter in the driving state information and the preset maximum power parameter, a target adjustment ratio is determined.

[0120] In this step, the ratio of the power parameter in the driving state information to the preset maximum power parameter is usually used as the target adjustment ratio.

[0121] Then, based on the target adjustment ratio and the preset adjustment parameters, the audio amplitude gain parameters corresponding to the vehicle power parameters are determined.

[0122] In this step, the preset adjustment parameters may include a preset first coefficient and a second coefficient. In this step, the product of the target adjustment ratio and the first coefficient may be calculated, and then the sum of the product and the second coefficient may be calculated to determine the sum of the product and the second coefficient as the audio amplitude gain parameter.

[0123] Exemplarily, when the power parameter in the driving state information includes the throttle depth of the vehicle, the preset maximum power parameter includes the maximum throttle depth of the vehicle, and the audio amplitude gain parameter can be determined by the following formula:

[0124] a=1+b*d / d 0 ;

[0125] Where a represents the audio amplitude gain parameter, b represents the preset first coefficient, 1 represents the preset second coefficient, and d 0 Indicates the maximum throttle depth of the vehicle, and d indicates the throttle depth information in the driving state information. In some cases, b may also be set to 1. Of course, b may also be set to other values, which are not limited in the present disclosure.

[0126] Of course, the above formula is only an example of determining the audio amplitude gain parameter. In the present disclosure, the audio amplitude gain parameter may also be determined by other methods, and the present disclosure does not limit this.

[0127] Through this implementation method, the audio amplitude gain parameter can be changed with the change of the vehicle's power parameters, and the larger the power parameter, the larger the audio amplitude gain parameter, and the corresponding volume of the simulated sound to be played is larger, so that the volume of the simulated sound to be played fits the actual driving scene and improves the experience of the driver and passengers.

[0128] In the above embodiment, the reference audio signal is processed based on the vehicle speed and power parameters in the driving state information to obtain the operation of the simulated sound to be played. In another embodiment of the present disclosure, the reference audio signal can be processed only based on the vehicle speed or only based on the power parameters.

[0129] In a feasible implementation of the embodiment of the present disclosure, the reference audio signal is processed only based on the vehicle speed in the driving state information. The implementation may include the following steps:

[0130] Based on the vehicle speed in the driving state information, the sampling frequency of the reference audio signal is adjusted to obtain the simulated sound wave to be played corresponding to the sound wave information to be simulated.

[0131] The specific method of adjusting the sampling frequency of the reference audio signal according to the vehicle speed can refer to the above embodiment and will not be described in detail here.

[0132] Through this implementation method, the pitch of the simulated sound to be played can be changed with the change of the vehicle speed, so that the pitch of the simulated sound to be played fits the actual driving scene.

[0133] In another feasible implementation, the reference audio signal is processed only based on the power parameter in the driving state information. The implementation may include the following steps:

[0134] Based on the power parameters in the driving state information, the reference audio signal is adjusted in amplitude to obtain the simulated sound wave to be played corresponding to the sound wave information to be simulated.

[0135] Through this implementation method, the volume of the simulated sound to be played can be changed with the change of the power parameters, so that the volume of the simulated sound to be played fits the actual driving scene.

[0136] In step 202, an operation of determining the sound wave information to be simulated in the user instruction is provided based on the user instruction. In the present disclosure, the user instruction may include an instruction in the form of voice and / or an instruction in the form of text. In the case where the user instruction includes an instruction in the form of voice, see Figure 4 As shown in the schematic diagram, based on the user instruction, the operation of determining the sound wave information to be simulated in the user instruction can be achieved by the following steps:

[0137] Step 2021, determining the voice information in the user instruction.

[0138] Step 2022: Determine text information corresponding to the voice information based on the voice recognition model.

[0139] In the disclosed embodiment, the electronic device may run a speech recognition model, which has the function of converting speech information into corresponding text information. In this step, the speech information may be converted into corresponding text information through the conversion function of the speech recognition model.

[0140] Step 2023: Encode the text information to obtain audio feature information in the text information.

[0141] Exemplarily, the audio feature information may include latent space features of text information. Of course, the audio feature information may also include other features, which is not limited in the present disclosure.

[0142] Step 2024: Determine the sound wave information to be simulated based on the audio feature information.

[0143] In this step, the audio feature information in the text information can be converted into acoustic audio feature information, and the sound wave information to be simulated includes the acoustic audio feature information. Exemplarily, if the audio feature in the text information is a latent space feature of the text, the sound wave information to be simulated can include the acoustic latent space feature corresponding to the latent space feature of the text.

[0144] Through the operations of step 2021 to step 2024, the sound wave information to be simulated in the user instruction can be determined, so that the reference audio signal determined according to the sound wave information to be simulated meets the user instruction.

[0145] In the above embodiment, when the user instruction includes voice information, a scheme for determining the sound wave information to be simulated based on the user instruction is provided. In addition, if the user instruction includes text information, steps 2023 and 2024 may be performed on the text information to obtain the sound wave information to be simulated corresponding to the text information.

[0146] like Figure 5 As shown in the above Figure 4 On the basis of the illustrated embodiment, based on the sound wave information to be simulated, the operation of determining the reference audio signal corresponding to the sound wave information to be simulated may include the following steps:

[0147] Step 2031, decoding the audio feature information in the simulated sound wave information to determine the frequency spectrum of the audio feature information.

[0148] Step 2032: Based on the frequency spectrum, determine a reference audio signal corresponding to the sound wave information to be simulated.

[0149] The spectrum is a representation of an audio signal in the frequency domain, and therefore, based on the spectrum, a corresponding reference audio signal can be determined.

[0150] Through the operations of step 2031 to step 2032, the reference audio signal can be determined, and since the reference audio signal is determined based on the sound information to be simulated in the user command, the reference audio signal complies with the user command, and the user command can be a variety of commands. Accordingly, for different user commands, the embodiment of the present disclosure can obtain different reference audio signals, thereby enabling the vehicle to play a variety of sounds.

[0151] In a feasible implementation of the embodiment of the present disclosure, the electronic device may run an audio generation model, determine audio feature information through the audio generation model, and determine a reference audio signal. Exemplarily, the audio generation model may include a text encoder, a diffusion module, a decoder, and a vocoder. The text encoder may encode the text information to obtain the audio feature information in the text information; the diffusion module may convert the audio feature information of the text information to convert it into acoustic audio feature information to obtain the sound wave information to be simulated; the decoder may decode the audio feature information in the sound wave information to be simulated to determine the frequency spectrum of the audio feature information; the vocoder may convert the frequency spectrum into a corresponding reference audio signal.

[0152] Of course, the above audio generation model is only an example, and the audio generation model can also be composed of other modules, which is not limited in the present disclosure.

[0153] like Figure 6 As shown in the above Figure 2 Based on the illustrated embodiment, before the reference audio signal is processed based on the driving state information, the following steps are also included:

[0154] Step 206: Determine the target duration based on the received user operation or based on the pre-set settings.

[0155] Step 207: copy and splice the reference audio signal to obtain a reference audio signal that meets the target duration.

[0156] In this step, the reference audio signal may be copied and spliced ​​by waveform similarity overlap-add (WSOLA) method.

[0157] Through the solution provided by the embodiment of the present disclosure, a reference audio signal that meets the target duration can be obtained, so that the reference audio signal that meets the target duration can be subsequently processed based on driving status information, thereby ensuring the playback duration of the simulated sound to be played.

[0158] like Figure 7 As shown in the above Figure 2 Based on the illustrated embodiment, before the reference audio signal is processed based on the driving state information, the following steps are also included:

[0159] Step 208: Determine the ratio of the signal amplitude of the reference audio signal to the maximum absolute value of the signal amplitude of the reference audio signal.

[0160] Step 209 , determining the product of the ratio and a preset proportionality coefficient, and adjusting the signal amplitude of the reference audio signal based on the product, so that in subsequent steps, the reference audio signal with the adjusted signal amplitude is processed based on the driving state information.

[0161] For example, the signal amplitude of the reference audio signal may be adjusted by the following formula:

[0162]

[0163] x 1 (n) = x(n) / x max *0.7079.

[0164] In the above formula, N is the signal length of the reference audio signal, x(n) is the signal amplitude of the reference audio signal before adjustment, and x max is the maximum absolute value of the signal amplitude of the reference audio signal before adjustment, x 1 (n) is the signal amplitude obtained after adjusting the signal amplitude of x(n), and 0.7079 is the preset proportional coefficient.

[0165] In the above formula, the proportional coefficient is set to 0.7079. Of course, the proportional coefficient may also be other values, and the present disclosure does not limit this.

[0166] Through the operation of the embodiments of the present disclosure, the signal amplitude of the reference audio signal can be adjusted to ensure the rationality of the reference audio signal.

[0167] Exemplary Devices

[0168] The following are device embodiments of the present disclosure, which can be used to execute the method embodiments of the present disclosure. For details not disclosed in the device embodiments of the present disclosure, please refer to the method embodiments of the present disclosure.

[0169] Figure 8 is a schematic diagram of the structure of a sound wave generating device provided by an exemplary embodiment of the present disclosure. Figure 8 The sound wave generating device includes: an instruction acquisition module 201, a sound wave information determination module 202, a reference audio determination module 203, a state information determination module 204 and an audio adjustment module 205.

[0170] The instruction acquisition module 201 is used to acquire user instructions;

[0171] The sound wave information determination module 202 is used to determine the sound wave information to be simulated in the user instruction based on the user instruction obtained by the instruction acquisition module 201;

[0172] A reference audio determination module 203, configured to determine a reference audio signal corresponding to the sound information to be simulated based on the sound information to be simulated determined by the sound information determination module 202;

[0173] A state information determination module 204, used to determine the current driving state information of the vehicle;

[0174] The audio adjustment module 205 is used to adjust the reference audio signal determined by the reference audio determination module 203 based on the driving state information determined by the state information determination module 204, so as to obtain the simulated sound to be played corresponding to the sound information to be simulated.

[0175] In one possible implementation, see Fig. 9 The audio adjustment module 205 includes a first adjustment unit 2051 and a second adjustment unit 2052 .

[0176] The first adjustment unit 2051 is used to adjust the sampling frequency of the reference audio signal based on the vehicle speed in the driving state information to obtain an intermediate simulated sound wave;

[0177] The second adjustment unit 2052 is used to adjust the amplitude of the intermediate simulated sound wave obtained by the first adjustment unit 2051 based on the power parameters in the driving state information, so as to obtain the simulated sound wave to be played corresponding to the sound wave information to be simulated.

[0178] The first adjustment unit 2051 may perform the following operations:

[0179] Determine the sampling frequency corresponding to the vehicle speed based on the vehicle speed in the driving state information, a first corresponding relationship between the preset vehicle speed and the sampling frequency;

[0180] Based on the sampling frequency, the reference audio is resampled to obtain an intermediate simulated sound wave.

[0181] In addition, the second adjustment unit 2052 may perform the following operations:

[0182] Based on the power parameter in the driving state information, determine the audio amplitude gain parameter corresponding to the power parameter;

[0183] Based on the audio amplitude gain parameter, the amplitude of the intermediate simulated sound wave is gain-adjusted to obtain the simulated sound wave to be played corresponding to the sound wave information to be simulated.

[0184] The second adjustment unit 2052 may determine the audio amplitude gain parameter corresponding to the dynamic parameter by the following operations:

[0185] Determining a target adjustment ratio based on a power parameter in the driving state information and a preset maximum power parameter;

[0186] Based on the target adjustment ratio and the preset adjustment parameters, an audio amplitude gain parameter corresponding to the vehicle power parameter is determined.

[0187] In a feasible implementation of the present disclosure, the sound information determination module 202 includes: a first determination unit 2021 , a second determination unit 2022 , a coding processing unit 2023 and a third determination unit 2024 .

[0188] The first determining unit 2021 is used to determine the voice information in the user instruction;

[0189] The second determining unit 2022 is used to determine the text information corresponding to the voice information determined by the first determining unit 2021 based on the voice recognition model;

[0190] The encoding processing unit 2023 is used to encode the text information determined by the second determining unit 2022 to obtain audio feature information in the text information;

[0191] The second determination unit 2022 is used to determine the sound wave information to be simulated based on the audio feature information determined by the encoding processing unit 2023.

[0192] In a feasible implementation manner, the reference audio determination module 203 includes: a spectrum determination unit 2031 and an audio determination unit 2032 .

[0193] The frequency spectrum determination unit 2031 is used to decode the audio feature information in the simulated sound wave information to determine the frequency spectrum of the audio feature information;

[0194] The audio determination unit 2032 is used to determine a reference audio signal corresponding to the sound wave information to be simulated based on the frequency spectrum determined by the frequency spectrum determination unit 2031 .

[0195] In a feasible implementation, the vehicle sound generation device provided in the embodiment of the present disclosure further includes a first processing module. The first processing module includes: a duration determination unit and a splicing unit.

[0196] The duration determination unit is used to determine the target duration based on the received user operation or based on the pre-setting;

[0197] The splicing unit is used to copy and splice the reference audio signal to obtain a reference audio signal that meets the target duration determined by the duration determination unit.

[0198] In another feasible implementation, the vehicle sound generation device provided in the embodiment of the present disclosure further includes a second processing module. The second processing module includes: a ratio determination unit and an amplitude adjustment unit.

[0199] Wherein, the ratio determination unit is used to determine the ratio of the signal amplitude of the reference audio signal to the maximum value of the absolute value of the signal amplitude of the reference audio signal;

[0200] The amplitude adjustment unit is used to determine the product of the ratio determined by the ratio determination unit and a preset proportionality coefficient, and adjust the signal amplitude of the reference audio signal based on the product.

[0201] The sound generation device provided by the embodiment of the present disclosure determines the corresponding reference audio signal based on the user instruction, and obtains the simulated sound to be played by processing the reference audio signal using the driving state information. Therefore, when the sound is generated by the device of the present disclosure, it is not necessary to store the audio as the sound in the memory space of the vehicle, thereby reducing the occupation of the memory space of the vehicle.

[0202] Furthermore, through different user instructions, the device provided by the embodiment of the present disclosure can obtain different simulated sounds to be played. Therefore, the device of the embodiment of the present disclosure can also obtain diversified simulated sounds to be played while reducing the occupation of the vehicle's memory space, meet the user's demand for the vehicle to play diversified sounds, and enable the vehicle to play personalized sounds.

[0203] In addition, in the process of determining the simulated sound wave to be played, the device of the embodiment of the present disclosure only needs the user to issue a user instruction. After receiving the user instruction, the device can obtain the simulated sound wave to be played through the solution of the embodiment of the present disclosure, which simplifies the user operation and has a high degree of automation.

[0204] Exemplary Electronic Devices

[0205] Fig.10 A structural diagram of an electronic device provided in an embodiment of the present disclosure includes at least one processor 111 and a memory 112.

[0206] The processor 111 may be a central processing unit (CPU) or other forms of processing units having data processing capabilities and / or instruction execution capabilities, and may control other components in the electronic device 100 to perform desired functions.

[0207] The memory 112 may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and / or non-volatile memory. Volatile memory may include, for example, random access memory (RAM) and / or cache memory (cache), etc. Non-volatile memory may include, for example, read-only memory (ROM), hard disk, flash memory, etc. One or more computer program instructions may be stored on the computer-readable storage medium, and the processor 111 may execute one or more computer program instructions to implement the sound wave generation method and / or other desired functions of the various embodiments of the present disclosure described above.

[0208] In one example, the electronic device 100 may further include: an input device 113 and an output device 114 , and these components are interconnected via a bus system and / or other forms of connection mechanisms (not shown).

[0209] The input device 113 may also include, for example, a keyboard, a mouse, a touch screen, etc., to receive user instructions in text form. The input device 113 may also include a device for collecting voice signals, such as a speaker and / or a microphone array, etc., to collect user instructions in voice form.

[0210] The output device 114 can output various information to the outside, which may include, for example, a display, a speaker, a printer, a communication network and a remote output device connected thereto, etc. After determining the simulated sound wave to be played, the simulated sound wave to be played can be played through the speaker to achieve the effect of playing the sound wave.

[0211] Of course, to simplify, Fig.10 Only some of the components related to the present disclosure in the electronic device 100 are shown, and components such as a bus, an input / output interface, etc. are omitted. In addition, according to specific application situations, the electronic device 100 may also include any other appropriate components.

[0212] Exemplary computer program products and computer-readable storage media

[0213] In addition to the above-mentioned methods and devices, embodiments of the present disclosure may also provide a computer program product, including computer program instructions, which, when executed by a processor, enable the processor to execute the steps of the sound wave generation method of various embodiments of the present disclosure described in the above-mentioned "Exemplary Method" section.

[0214] The computer program product may be written in any combination of one or more programming languages ​​to write program code for performing the operations of the disclosed embodiments, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server.

[0215] In addition, the embodiments of the present disclosure may also be a computer-readable storage medium having computer program instructions stored thereon. When the computer program instructions are executed by a processor, the processor executes the steps in the method for generating sound waves of various embodiments of the present disclosure described in the above “Exemplary Method” section.

[0216] Computer readable storage media can adopt any combination of one or more readable media. The readable medium can be a readable signal medium or a readable storage medium. The readable storage medium is, for example, but not limited to, a system, device or device including electricity, magnetism, light, electromagnetic, infrared, or semiconductor, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0217] The basic principles of the present disclosure are described above in conjunction with specific embodiments. However, the advantages, strengths, effects, etc. mentioned in the present disclosure are only examples and not limitations, and cannot be considered as necessary for each embodiment of the present disclosure. In addition, the specific details disclosed above are only for the purpose of illustration and ease of understanding, rather than limitation, and the above details do not limit the present disclosure to being implemented by adopting the above specific details.

[0218] Those skilled in the art may make various changes and modifications to the present disclosure without departing from the spirit and scope of the present application. Thus, if these modifications and variations of the present application fall within the scope of the present disclosure claims and their equivalents, the present disclosure is also intended to include these modifications and variations.

Claims

1. A method for generating sound waves, comprising: Get user instructions; Based on the user instruction, determining the sound wave information to be simulated in the user instruction; Based on the sound wave information to be simulated, determining a reference audio signal corresponding to the sound wave information to be simulated; Determine the current driving status information of the vehicle; The reference audio signal is processed based on the driving state information to obtain a simulated sound to be played corresponding to the sound information to be simulated.

2. The method according to claim 1, wherein: The step of processing the reference audio signal based on the driving state information to obtain a simulated sound wave to be played corresponding to the sound wave information to be simulated includes: Based on the vehicle speed in the driving state information, the sampling frequency of the reference audio signal is adjusted to obtain an intermediate simulated sound wave; Based on the power parameters in the driving state information, the amplitude of the intermediate simulated sound wave is adjusted to obtain the simulated sound wave to be played corresponding to the sound wave information to be simulated.

3. The method according to claim 2, wherein: The step of adjusting the sampling frequency of the reference audio signal based on the vehicle speed in the driving state information to obtain an intermediate simulated sound wave includes: Determine the sampling frequency corresponding to the vehicle speed based on the vehicle speed in the driving state information, a first corresponding relationship between the preset vehicle speed and the sampling frequency; Based on the sampling frequency, the reference audio is resampled to obtain an intermediate simulated sound wave.

4. The method according to claim 2, wherein: The step of adjusting the amplitude of the intermediate simulated sound wave based on the power parameter in the driving state information to obtain the simulated sound wave to be played corresponding to the sound wave information to be simulated includes: Based on the power parameter in the driving state information, determining an audio amplitude gain parameter corresponding to the power parameter; Based on the audio amplitude gain parameter, the amplitude of the intermediate simulated sound wave is gain-adjusted to obtain the simulated sound wave to be played corresponding to the sound wave information to be simulated.

5. The method according to claim 4, wherein: The determining, based on the power parameter in the driving state information, the audio amplitude gain parameter corresponding to the power parameter comprises: Determining a target adjustment ratio based on a power parameter in the driving state information and a preset maximum power parameter; Based on the target adjustment ratio and the preset adjustment parameter, an audio amplitude gain parameter corresponding to the vehicle power parameter is determined.

6. The method according to claim 1, wherein: The determining, based on the user instruction, the sound wave information to be simulated in the user instruction includes: Determining voice information in the user instruction; Determining text information corresponding to the voice information based on a voice recognition model; Encoding the text information to obtain audio feature information in the text information; Based on the audio feature information, the sound wave information to be simulated is determined.

7. The method according to claim 6, wherein: The step of determining a reference audio signal corresponding to the sound wave information to be simulated based on the sound wave information to be simulated includes: Decoding the audio feature information in the sound wave information to be simulated to determine the frequency spectrum of the audio feature information; Based on the frequency spectrum, a reference audio signal corresponding to the sound wave information to be simulated is determined.

8. The method according to claim 1, wherein: Before the reference audio signal is processed based on the driving state information, the method further includes: Determine a target duration based on a received user operation or based on a pre-set setting; The reference audio signal is copied and spliced ​​to obtain the reference audio signal that meets the target duration.

9. The method according to claim 1, wherein: Before the reference audio signal is processed based on the driving state information, the method further includes: determining a ratio of a signal amplitude of the reference audio signal to a maximum value of an absolute value of the signal amplitude of the reference audio signal; A product of the ratio and a preset proportionality coefficient is determined, and a signal amplitude of the reference audio signal is adjusted based on the product.

10. A device for generating sound waves, comprising: An instruction acquisition module, used to acquire user instructions; a sound wave information determination module, configured to determine the sound wave information to be simulated in the user instruction based on the user instruction acquired by the instruction acquisition module; A reference audio determination module, configured to determine a reference audio signal corresponding to the sound information to be simulated based on the sound information to be simulated determined by the sound information determination module; A state information determination module, used to determine the current driving state information of the vehicle; The audio adjustment module is used to adjust the reference audio signal determined by the reference audio determination module based on the driving state information determined by the state information determination module to obtain the simulated sound to be played corresponding to the sound information to be simulated.

11. A computer-readable storage medium storing a computer program, wherein the computer program is used to execute the method for generating sound waves according to any one of claims 1 to 9.

12. An electronic device, comprising: processor; a memory for storing instructions executable by the processor; The processor is used to read the executable instructions from the memory and execute the instructions to implement the sound wave generation method according to any one of claims 1 to 9.

Images