Vehicle sound wave synthesis method, apparatus, device, and readable storage medium

Abstract

The present application provides a vehicle sound wave synthesis method, an apparatus, a device, and a readable storage medium, and relates to the technical field of voice processing. A specific implementation solution comprises: acquiring a sound wave audio sample corresponding to a current traveling speed of a vehicle, and performing frequency division processing and frequency conversion processing, to obtain processed audio samples of different frequency bands; on the basis of the current traveling speed of the vehicle, determining sample proportion information and overall loudness information of different frequency bands; combining the processed audio samples of different frequency bands, the sample proportion information, and the overall loudness information, and generating sound wave audio to be outputted; and, on the basis of the sound wave audio to be outputted, generating a synthetic sound wave output instruction and sending the synthetic sound wave output instruction to an in-vehicle speaker. According to the implementation of the present application, the sound wave audio samples are correspondingly obtained based on the vehicle speed and frequency division, frequency conversion, and loudness change are performed, and then the in-vehicle speaker is controlled to output the simulated sound wave audio. Thus enhancing the capability of the driver to perceive real-time power of the vehicle, improving driving safety, and improving in-vehicle sound quality.

Description

A method, apparatus, device, and readable storage medium for synthesizing vehicle sound waves. Technical Field

[0001] This application relates to the field of speech processing technology and can be applied to virtual sound output scenarios for new energy vehicles. Specifically, this application relates to a method, apparatus, device, and readable storage medium for synthesizing vehicle sound. Background Technology

[0002] With the continuous development of the automotive industry, the trend of new energy vehicles replacing traditional fuel vehicles is irreversible. New energy vehicles do not rely on traditional internal combustion engines for power, and therefore do not produce the engine noise of traditional vehicles during operation. Consequently, drivers lack perceptible feedback signals related to the real-time power output level of the vehicle, which has a certain impact on driving safety and cannot meet the needs of drivers and passengers for in-vehicle sound quality.

[0003] It is important to note that the techniques described in this section are not necessarily those previously conceived or adopted. Unless otherwise specified, no technique described in this section should be assumed to be prior art simply because it is included in this section. Similarly, unless otherwise specified, the issues mentioned in this section should not be considered to be recognized in any prior art. Technical issues

[0004] This application provides a method, apparatus, device, and readable storage medium for synthesizing vehicle sound waves, aiming to at least partially solve one of the problems in the related art. Technical solutions

[0005] To address the aforementioned technical problems, the first aspect of this application provides a method for synthesizing vehicle sound waves, comprising:

[0006] The first sound wave audio sample corresponding to the current driving speed of the vehicle is obtained and processed by frequency division to obtain multiple second sound wave audio samples of different frequency bands.

[0007] Multiple second sound wave audio samples were frequency-converted to obtain processed audio samples in different frequency bands;

[0008] The sample proportion information of different frequency bands is determined based on the current vehicle speed, and the overall loudness information is determined based on the current vehicle speed.

[0009] By combining the processed audio samples from different frequency bands, the sample ratio information, and the overall loudness information, an audio signal to be output is generated.

[0010] A synthesized sound output command is generated based on the audio of the sound wave to be output, and the synthesized sound output command is sent to the in-vehicle speaker; wherein, the synthesized sound output command is used to instruct the in-vehicle speaker to play the audio of the sound wave to be output.

[0011] A second aspect of this application provides a vehicle sound synthesis device, comprising:

[0012] The sample acquisition module is used to acquire the first sound wave audio sample corresponding to the current driving speed of the vehicle, perform frequency division processing, and obtain multiple second sound wave audio samples of different frequency bands.

[0013] The frequency conversion processing module is used to perform frequency conversion processing on multiple second sound wave audio samples to obtain processed audio samples of different frequency bands.

[0014] The information determination module is used to determine the sample proportion information of different frequency bands based on the current driving speed of the vehicle, and to determine the overall loudness information based on the current driving speed of the vehicle.

[0015] The audio generation module is used to combine the processed audio samples of different frequency bands, the sample ratio information, and the overall loudness information to generate the sound wave audio to be output.

[0016] An output control module is used to generate a synthesized sound wave output command based on the sound wave audio to be output, and send the synthesized sound wave output command to the in-vehicle speaker; wherein the synthesized sound wave output command is used to instruct the in-vehicle speaker to play the sound wave audio to be output.

[0017] A third aspect of this application provides an electronic device, including a memory and a processor, wherein the processor is configured to execute a computer program stored in the memory; when the processor executes the computer program, it implements the steps of the vehicle sound synthesis method provided in the first aspect of this application.

[0018] The fourth aspect of this application provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the vehicle sound synthesis method provided in the first aspect of this application. Beneficial effects

[0019] As can be seen from the above, according to the vehicle sound wave synthesis method, apparatus, device, and readable storage medium provided in this application, a first sound wave audio sample corresponding to the current driving speed of the vehicle is obtained and subjected to frequency division processing to obtain multiple second sound wave audio samples of different frequency bands; the multiple second sound wave audio samples are subjected to frequency conversion processing to obtain processed audio samples of different frequency bands; the sample ratio information of different frequency bands is determined according to the current driving speed of the vehicle, and the overall loudness information is determined according to the current driving speed of the vehicle; the processed audio samples of different frequency bands, the sample ratio information, and the overall loudness information are combined to generate the sound wave audio to be output; a synthesized sound wave output command is generated based on the sound wave audio to be output, and the synthesized sound wave output command is sent to the in-vehicle speakers. Through the implementation of this application, the sound wave audio samples are obtained according to the vehicle speed, and after frequency division, frequency conversion, and loudness conversion, the in-vehicle speakers are controlled to output simulated sound wave audio, which enhances the driver's perception of the vehicle's real-time power, improves driving safety, and also improves the in-vehicle sound quality.

[0020] It should be understood that the description in this section is not intended to identify key or important features of this application, nor is it intended to limit the scope of this application. Other features of this application will become readily apparent from the following description. Attached Figure Description

[0021] The accompanying drawings exemplify embodiments and form part of the specification, working together with the textual description to explain exemplary implementations of the embodiments. The drawings shown are for illustrative purposes only and do not limit the scope of the claims. Throughout the drawings, the same reference numerals refer to similar but not necessarily identical elements.

[0022] Figure 1 is a schematic diagram of the basic process of a vehicle sound synthesis method provided in an embodiment of this application;

[0023] Figure 2 is a schematic diagram of pitch interpolation at different vehicle speeds provided in an embodiment of this application;

[0024] Figure 3 is a schematic diagram illustrating the relationship between vehicle speed and loudness according to an embodiment of this application;

[0025] Figure 4 is a schematic diagram illustrating the relationship between torque and loudness according to an embodiment of this application;

[0026] Figure 5 is a schematic diagram illustrating the principle of an audio fade-in / fade-out processing method provided in an embodiment of this application;

[0027] Figure 6 is a detailed flowchart of a vehicle sound synthesis method provided in an embodiment of this application;

[0028] Figure 7 is a schematic diagram of the functional modules of a vehicle sound synthesis device provided in an embodiment of this application;

[0029] Figure 8 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of this application. Embodiments of the present invention

[0030] To make the inventive objectives, features, and advantages of this application more apparent and understandable, the technical solutions in the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0031] In the description of the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. The term "multiple" means two or more, unless otherwise explicitly specified. The term "comprising" indicates the presence of the described feature, whole, step, operation, element, and / or component, but does not exclude the presence or addition of one or more other features, wholes, steps, operations, elements, components, and / or sets thereof. The term "and / or" describes the relationship between related objects, indicating that three relationships may exist. For example, A and / or B may include three cases: A existing alone, A and B existing simultaneously, and B existing alone. The character " / " generally indicates that the preceding and following related objects belong to an "or" relationship.

[0032] To address the issues of reduced driving safety and in-vehicle sound quality caused by the lack of perceptible signals related to the real-time power output level of new energy vehicles in related technologies, this application provides a vehicle sound synthesis method in one embodiment. This method can be applied to the in-vehicle terminal or driver's mobile terminal of a new energy vehicle. Figure 1 shows a basic flowchart of the vehicle sound synthesis method provided in this embodiment. The vehicle sound synthesis method includes the following steps:

[0033] Step 101: Obtain the first sound wave audio sample corresponding to the current driving speed of the vehicle and perform frequency division processing to obtain multiple second sound wave audio samples of different frequency bands.

[0034] Specifically, in this embodiment, sound samples of a traditional gasoline-powered vehicle at different speeds can be pre-recorded. For example, the in-vehicle sound of a gasoline-powered vehicle at idle, 10km / h, 20km / h, 30km / h, ..., 90km / h can be recorded to obtain the corresponding sound sample X. The in-vehicle sound of a gasoline-powered vehicle during slow, uniform acceleration can also be recorded to obtain the corresponding sound sample X1. When recording the actual sound samples, the recording location can be the engine of the gasoline-powered vehicle. In this embodiment, the corresponding sound sample is obtained based on the vehicle's current actual driving speed. Then, the sound sample is divided into multiple frequency bands to obtain multiple sound samples of different frequency ranges. These multiple frequency bands are divided according to different frequency levels, and can, for example, include ultra-low frequency band (0 to 300Hz), low frequency band (300 to 2500 Hz), mid frequency band (2500 to 5000 Hz), and high frequency band (5000 to 10000 Hz).

[0035] In some embodiments of this example, the above-mentioned acquisition of the first sound wave audio sample corresponding to the current driving speed of the vehicle and the frequency division processing includes: acquiring the first sound wave audio sample corresponding to the current driving speed of the vehicle; calculating the major order frequency of the first sound wave audio sample; and performing frequency division processing on the first sound wave audio sample based on the major order frequency.

[0036] Step 102: Perform frequency conversion processing on multiple second sound wave audio samples to obtain processed audio samples of different frequency bands.

[0037] Optionally, in this embodiment, the target pitch information corresponding to the current driving speed is first determined according to a preset first proportional function, and then the multiple second sound wave audio samples are frequency-converted based on the target pitch information to obtain processed audio samples of different frequency bands.

[0038] Figure 2 shows a schematic diagram of pitch interpolation at different vehicle speeds provided in this embodiment. The frequencies of the principal order (2nd order) of the sound at each speed within sample X are calculated and recorded as F0-F9. It is assumed that F0 corresponds to pitch = 1.0, and pitch(i) = Fi / F0. The pitch at each speed is a linear interpolation between pitch(i) and pitch(i+1), which maintains frequency continuity and avoids popping sounds caused by frequency discontinuities. In this embodiment, the index is calculated as index = floor(v / 10), and pitch = pitch(index) * (index+1-v / 10) + pitch(index+1)*(v / 10-index). Finally, the calculated pitch is used to perform frequency conversion processing on the sound waves in each frequency band.

[0039] In some embodiments of this example, before performing frequency conversion processing on the multiple second sound wave audio samples to obtain processed audio samples of different frequency bands, the method further includes: performing amplitude normalization processing on the multiple second sound wave audio samples respectively; and performing fade-in and fade-out processing on the beginning and end portions of the multiple normalized second sound wave audio samples respectively.

[0040] Specifically, in practical applications, the beginning and end of each sound wave audio sample can be faded in and out to ensure the continuity of the sound at the beginning and end of each sample, thus avoiding popping sounds caused by discontinuity in the time domain.

[0041] Step 103: Determine the sample proportion information of different frequency bands based on the current vehicle speed, and determine the overall loudness information based on the current vehicle speed.

[0042] Specifically, this embodiment pre-records the proportional relationship of samples of different frequency bands at different speeds within a specific speed range. In practical applications, this proportional relationship can be queried based on the vehicle's current speed to obtain the sample proportion information of different frequency bands at that speed. In addition, this embodiment also pre-configures the correlation relationship between loudness and speed. Based on this correlation relationship, the current vehicle speed can be used as the independent variable to determine the corresponding overall loudness information.

[0043] In some embodiments of this example, determining the overall loudness information based on the current vehicle speed includes: determining the first loudness information corresponding to the current driving speed according to a preset second proportional function; if the current driving speed is greater than a preset speed threshold, then adjusting the information by combining the torque information and the first loudness information to obtain the overall loudness information.

[0044] It is worth mentioning that the speed threshold in this embodiment can be 0. That is, in practical applications, as long as the vehicle has speed and is in a driving state, the corresponding overall loudness information is determined by combining torque and speed. Preferably, in this embodiment, the speed threshold is a specific value greater than 0. Accordingly, if the current driving speed is less than or equal to the speed threshold, the first loudness information is directly determined as the overall loudness information.

[0045] Figure 3 shows a schematic diagram illustrating the relationship between vehicle speed and loudness provided in this embodiment. It can be seen that within a certain speed range, the loudness generally increases with speed, meaning that speed and loudness are directly proportional. Therefore, within a specific speed range, the current speed can be used as the independent variable of a preset proportional function. Substituting this into the proportional function yields the loudness as the dependent variable. Furthermore, considering that excessively loud sound can negatively interfere with passengers when the vehicle is traveling at a high, constant speed, this embodiment adjusts the speed-related loudness based on torque information when the current speed exceeds a specific speed threshold value greater than 0.

[0046] In some embodiments of this example, the above-mentioned determination of overall loudness information by combining torque information and the first loudness information includes: determining the second loudness information corresponding to the torque information according to a preset third proportional function; and summing the first loudness information and the second loudness information to obtain the overall loudness information.

[0047] Figure 4 shows a schematic diagram of the relationship between torque and loudness provided in this embodiment. The diagram shows a positive proportional function relationship between torque and loudness. The second loudness information, which is the dependent variable, is less than or equal to 0. As the torque increases, the value of the calculated second loudness information gradually approaches 0 from a specific negative value. Finally, by adding the second loudness information to the first loudness information, the overall loudness information that takes into account both torque and speed can be obtained.

[0048] Step 104: Combine the processed audio samples from different frequency bands, sample ratio information, and overall loudness information to generate the sound wave audio to be output.

[0049] Specifically, in this embodiment, the proportion of samples in each frequency band is adjusted according to the sample ratio information, so that the resulting timbre is no longer subject to the samples. In addition, based on the previously calculated loudness corresponding to the current driving speed of the vehicle, the frequency-converted samples of each frequency band are synthesized to generate the sound wave audio to be output.

[0050] Optionally, in this embodiment, when continuously outputting sound wave audio at different driving speeds, considering that a brief popping sound will appear in the sound effect when the speed is at a certain critical value, resulting in poor sound quality, this embodiment can further process the connected sound wave audio to be output. Specifically, the preceding sound wave audio at the speed critical value is faded out, and the following sound wave audio is faded in. That is, during the continuous output of the synthesized sound wave audio, cross-fade-out and fade-in processing is performed. Figure 5 shows a schematic diagram of the principle of audio fade-in and fade-out processing provided in this embodiment. For samples 1 and 2 that have a connection relationship, the tail of the preceding sample after fade-out processing is connected to the head of the following sample after fade-in processing, ensuring the continuity of the audio signal in the time domain after mixing. For example, as the vehicle speed increases from 9.5 km / h to 10.5 km / h, the output sound audio at idle speed can be faded out, while the output sound audio at 10 km / h can be faded in. The samples of different speeds are connected, and the cross-fade-in and fade-out switching avoids the pop sound caused by discontinuity in the time domain.

[0051] In some embodiments of this example, the above-mentioned generation of the sound wave audio to be output by combining processed audio samples of different frequency bands, sample proportion information and overall loudness information includes: determining the single-band loudness information corresponding to each processed audio sample according to the corresponding sample proportion information and overall loudness information of different frequency bands; and generating the sound wave audio to be output according to all processed audio samples that satisfy the sample proportion information and the corresponding single-band loudness information.

[0052] Specifically, in this embodiment, the sample proportion information of different frequency bands at different driving speeds is pre-calibrated. For example, the proportions of ultra-low frequency band, low frequency band, mid frequency band, and high frequency band are coe1, coe2, coe3, and coe4, respectively, and coe1+coe2+coe3+coe4 = 1.0. If the overall loudness information is represented as Amp, then the loudness information of each single frequency band is Amp1 = Amp * coe1, Amp3 = Amp * coe2, Amp3 = Amp * coe3, and Amp4 = Amp * coe4. Finally, based on the processed audio samples of different frequency bands that conform to the specific sample proportion relationship and their respective single frequency band loudness information, the output sound wave audio that conforms to the current driving speed of the vehicle can be synthesized.

[0053] Step 105: Generate a synthesized sound output command based on the audio of the sound wave to be output, and send the synthesized sound output command to the in-vehicle speaker.

[0054] The synthesized sound output command is used to instruct the in-vehicle speakers to play the sound audio to be output, thereby realizing the output of the simulated engine sound of a traditional fuel vehicle in the driving and riding space of a new energy vehicle. It is worth mentioning that the in-vehicle speakers in this embodiment are the speakers that are already installed in the vehicle. These speakers can be some of the speakers reused in the in-vehicle audio system, or they can be dedicated speakers that are additionally installed in the vehicle. In addition, the number and placement of the in-vehicle speakers can be flexibly set according to the actual application scenario or usage requirements.

[0055] In some embodiments of this example, the above-mentioned method of generating a synthesized sound wave output command based on the sound wave audio to be output and sending the synthesized sound wave output command to the in-vehicle speakers includes: according to the frequency response characteristic information of each of the multiple in-vehicle speakers, reconfiguring the proportion of processed audio samples of different frequency bands in the sound wave audio to be output to obtain multiple single-speaker sound wave audios; generating a synthesized sound wave output command based on each single-speaker sound wave audio; and simultaneously sending the corresponding synthesized sound wave output command to different in-vehicle speakers.

[0056] To further improve the sound quality inside the vehicle, this embodiment can use a multi-speaker output method to output the synthesized sound waves. That is, by referring to the frequency response characteristics of each speaker, the proportion of audio samples of different frequency bands of each speaker is redistributed, and the sound wave audio output of each speaker in the vehicle is controlled accordingly.

[0057] To better illustrate the implementation scheme of this application, this embodiment also provides a refined method for synthesizing vehicle sound waves. Figure 6 shows a detailed flowchart of a vehicle sound wave synthesis method provided in an embodiment of this application, which specifically includes the following steps:

[0058] Step 601: Obtain the first sound wave audio sample corresponding to the current driving speed of the vehicle, and calculate the major order frequency of the first sound wave audio sample.

[0059] Step 602: Perform frequency division processing on the first sound wave audio sample based on the main order frequency to obtain multiple second sound wave audio samples with different frequency bands;

[0060] Step 603: Determine the target pitch information corresponding to the current driving speed according to the preset first direct proportional function;

[0061] Step 604: Based on the target pitch information, perform frequency conversion processing on multiple second sound wave audio samples to obtain processed audio samples in different frequency bands;

[0062] Step 605: Determine the sample proportion information of different frequency bands based on the current vehicle speed, and determine the overall loudness information based on the current vehicle speed;

[0063] Step 606: Determine the single-band loudness information corresponding to each processed audio sample based on the sample proportion information of different frequency bands and the overall loudness information.

[0064] Step 607: Generate the sound wave audio to be output based on all processed audio samples that meet the sample proportion information and the corresponding single-band loudness information;

[0065] Step 608: Based on the frequency response characteristics of each of the multiple in-vehicle speakers, the proportion of processed audio samples of different frequency bands in the output sound wave audio is reconfigured accordingly to obtain multiple single-speaker sound wave audios.

[0066] Step 609: Generate synthesized sound output commands based on the sound audio of each individual speaker, and send the corresponding synthesized sound output commands to different in-vehicle speakers simultaneously.

[0067] It should be understood that the sequence number of each step in this embodiment does not imply the order in which the steps are executed. The execution order of each step should be determined by its function and internal logic, and should not constitute a unique limitation on the implementation process of this application embodiment.

[0068] Figure 7 illustrates a vehicle sound synthesis device according to an embodiment of this application. This vehicle sound synthesis device can be used to implement the vehicle sound synthesis method in the aforementioned embodiments, mainly including:

[0069] The sample acquisition module 701 is used to acquire the first sound wave audio sample corresponding to the current driving speed of the vehicle and perform frequency division processing to obtain multiple second sound wave audio samples of different frequency bands.

[0070] The frequency conversion processing module 702 is used to perform frequency conversion processing on multiple second sound wave audio samples to obtain processed audio samples of different frequency bands.

[0071] The information determination module 703 is used to determine the sample proportion information of different frequency bands based on the current vehicle speed, and to determine the overall loudness information based on the current vehicle speed.

[0072] The audio generation module 704 is used to combine processed audio samples from different frequency bands, sample ratio information, and overall loudness information to generate the sound wave audio to be output.

[0073] The output control module 705 is used to generate a synthesized sound wave output command based on the sound wave audio to be output, and send the synthesized sound wave output command to the in-vehicle speakers; wherein, the synthesized sound wave output command is used to instruct the in-vehicle speakers to play the sound wave audio to be output.

[0074] In one optional embodiment of this invention, the vehicle sound synthesis device further includes: a sample processing module, used to perform amplitude normalization processing on multiple second sound audio samples respectively; and to perform fade-in and fade-out processing on the beginning and end portions of the multiple normalized second sound audio samples respectively.

[0075] It should be noted that the vehicle sound synthesis methods in the foregoing method embodiments can all be implemented based on the vehicle sound synthesis device provided in this embodiment. Those skilled in the art can clearly understand that, for the sake of convenience and brevity, the specific working process of the vehicle sound synthesis device described in this embodiment can be implemented by referring to the corresponding working process in the foregoing method embodiments, and will not be repeated here.

[0076] Based on the technical solution of the above-described embodiments of this application, a first sound wave audio sample corresponding to the current driving speed of the vehicle is obtained and subjected to frequency division processing to obtain multiple second sound wave audio samples of different frequency bands; the multiple second sound wave audio samples are subjected to frequency conversion processing to obtain processed audio samples of different frequency bands; the sample ratio information of different frequency bands is determined according to the current driving speed of the vehicle, and the overall loudness information is determined according to the current driving speed of the vehicle; the processed audio samples of different frequency bands, the sample ratio information, and the overall loudness information are combined to generate the sound wave audio to be output; a synthesized sound wave output command is generated based on the sound wave audio to be output, and the synthesized sound wave output command is sent to the in-vehicle speakers. Through the implementation of this application, the sound wave audio samples are obtained according to the vehicle speed, and after frequency division, frequency conversion, and loudness conversion, the in-vehicle speakers are controlled to output simulated sound wave audio, which enhances the driver's perception of the vehicle's real-time power and improves driving safety. Furthermore, the solution of this application can ensure the continuity of the output audio, eliminate the plasticity of the sound, and the timbre is not limited by the samples, significantly improving the in-vehicle sound quality.

[0077] Please refer to Figure 8, which illustrates an electronic device according to an embodiment of this application. This electronic device can be used to implement the vehicle sound synthesis method described in the foregoing embodiments. As shown in Figure 8, the electronic device mainly includes:

[0078] The system includes a memory 801, a processor 802, and a bus 803, with the memory 801 and processor 802 connected via the bus 803. The memory 801 stores a computer program that can run on the processor 802. When the processor 802 executes the computer program, it implements the vehicle sound synthesis method described in the preceding embodiments. The number of processors can be one or more.

[0079] The memory 801 can be a high-speed random access memory (RAM) or a non-volatile memory, such as a disk storage device. The memory 801 is used to store executable program code, and the processor 802 is coupled to the memory 801.

[0080] Furthermore, embodiments of this application also provide a computer-readable storage medium, which may be disposed in the electronic device in the above embodiments, and the computer-readable storage medium may be the memory in the embodiment shown in FIG8 above.

[0081] The computer-readable storage medium stores a computer program that, when executed by a processor, implements the vehicle sound synthesis method described in the foregoing embodiments. Furthermore, the computer-readable storage medium can also be a USB flash drive, portable hard drive, read-only memory (ROM), RAM, magnetic disk, or optical disk, or any other medium capable of storing program code.

[0082] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of modules is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple modules or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between apparatuses or modules may be electrical, mechanical, or other forms.

[0083] The modules described as separate components may or may not be physically separate. Similarly, the components shown as modules may or may not be physical modules; they may be located in one place or distributed across multiple network modules. Some or all of the modules can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0084] Furthermore, the functional modules in the various embodiments of this application can be integrated into one processing module, or each module can exist physically separately, or two or more modules can be integrated into one module. The integrated modules described above can be implemented in hardware or as software functional modules.

[0085] If the integrated module is implemented as a software functional module and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a readable storage medium and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned readable storage medium includes various media capable of storing program code, such as USB flash drives, external hard drives, ROM, RAM, magnetic disks, or optical disks.

[0086] It should be noted that, for the sake of simplicity, the foregoing method embodiments are all described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously according to this application. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are preferred embodiments, and the actions and modules involved are not necessarily essential to this application.

[0087] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions in other embodiments.

[0088] The above is a description of the vehicle sound synthesis method, apparatus, device, and readable storage medium provided in this application. For those skilled in the art, based on the ideas of the embodiments of this application, there will be changes in the specific implementation methods and application scope. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A method for synthesizing vehicle sound waves, characterized in that, include: The first sound wave audio sample corresponding to the current driving speed of the vehicle is obtained and processed by frequency division to obtain multiple second sound wave audio samples of different frequency bands. Multiple second sound wave audio samples were frequency-converted to obtain processed audio samples in different frequency bands; The sample proportion information of different frequency bands is determined based on the current vehicle speed, and the overall loudness information is determined based on the current vehicle speed. By combining the processed audio samples from different frequency bands, the sample ratio information, and the overall loudness information, an audio signal to be output is generated. A synthesized sound output command is generated based on the audio of the sound wave to be output, and the synthesized sound output command is sent to the in-vehicle speaker; wherein, the synthesized sound output command is used to instruct the in-vehicle speaker to play the audio of the sound wave to be output.

2. The vehicle sound synthesis method according to claim 1, characterized in that, The step of acquiring the first sound wave audio sample corresponding to the vehicle's current driving speed and performing frequency division processing includes: Obtain the first sound sample corresponding to the vehicle's current speed; Calculate the major order frequency of the first sound wave audio sample; The first sound wave audio sample is frequency-divided based on the major order frequency.

3. The vehicle sound synthesis method according to claim 1, characterized in that, The step of performing frequency conversion processing on multiple second sound wave audio samples to obtain processed audio samples in different frequency bands includes: The target pitch information corresponding to the current driving speed is determined according to a preset first proportional function; Based on the target pitch information, multiple second sound wave audio samples are frequency-converted to obtain processed audio samples in different frequency bands.

4. The vehicle sound synthesis method according to claim 1, characterized in that, Before performing frequency conversion processing on multiple second sound wave audio samples to obtain processed audio samples of different frequency bands, the method further includes: Amplitude normalization was performed on multiple second sound wave audio samples respectively; The beginning and end portions of the normalized second sound wave audio samples are faded in and faded out respectively.

5. The vehicle sound synthesis method according to claim 1, characterized in that, The step of determining the overall loudness information based on the current vehicle speed includes: The first loudness information corresponding to the current driving speed is determined according to a preset second proportional function; If the current driving speed is greater than a preset speed threshold, the overall loudness information is determined by combining the torque information and the first loudness information.

6. The vehicle sound synthesis method according to claim 5, characterized in that, Also includes: If the current driving speed is less than or equal to the speed threshold, then the first loudness information is determined as the overall loudness information.

7. The vehicle sound synthesis method according to claim 5, characterized in that, The process of determining the overall loudness information by combining the torque information and the first loudness information includes: The second loudness information corresponding to the torque information is determined according to a preset third proportional function; wherein the second loudness information is less than or equal to 0; The first loudness information and the second loudness information are summed to obtain the overall loudness information.

8. The vehicle sound synthesis method according to claim 5, characterized in that, The process of combining processed audio samples from different frequency bands, the sample proportion information, and the overall loudness information to generate the output sound wave audio includes: Based on the sample proportion information corresponding to different frequency bands and the overall loudness information, the single-band loudness information corresponding to each processed audio sample is determined. Based on all the processed audio samples that satisfy the sample proportion information and the corresponding single-band loudness information, a sound wave audio to be output is generated.

9. The vehicle sound synthesis method according to any one of claims 1 to 8, characterized in that, The step of generating a synthesized sound wave output command based on the audio of the sound wave to be output, and sending the synthesized sound wave output command to the in-vehicle speaker, includes: Based on the frequency response characteristics of each of the multiple in-vehicle speakers, the proportions of the processed audio samples of different frequency bands in the audio to be output are reconfigured accordingly to obtain multiple single-speaker audio samples. Each of the single loudspeaker sound wave audio sources generates a synthesized sound wave output command; The corresponding synthetic sound output command is simultaneously sent to different in-vehicle speakers.

10. A vehicle sound synthesis device, characterized in that, include: The sample acquisition module is used to acquire the first sound wave audio sample corresponding to the current driving speed of the vehicle, perform frequency division processing, and obtain multiple second sound wave audio samples of different frequency bands. The frequency conversion processing module is used to perform frequency conversion processing on multiple second sound wave audio samples to obtain processed audio samples of different frequency bands. The information determination module is used to determine the sample proportion information of different frequency bands based on the current driving speed of the vehicle, and to determine the overall loudness information based on the current driving speed of the vehicle. The audio generation module is used to combine the processed audio samples of different frequency bands, the sample ratio information, and the overall loudness information to generate the sound wave audio to be output. An output control module is used to generate a synthesized sound wave output command based on the sound wave audio to be output, and send the synthesized sound wave output command to the in-vehicle speaker; wherein the synthesized sound wave output command is used to instruct the in-vehicle speaker to play the sound wave audio to be output.

11. An electronic device, characterized in that, include: Memory and processor; The processor is used to execute computer programs stored in the memory; When the processor executes the computer program, it implements the steps in the vehicle sound synthesis method as described in any one of claims 1 to 9.

12. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements the steps in the vehicle sound synthesis method as described in any one of claims 1 to 9.

Images