Audio generation method and device, storage medium and electronic equipment

Abstract

The embodiment of the invention discloses an audio generation method and device, a storage medium and electronic equipment. A sound effect resource library is obtained, the sound effect resource library comprises sound effect resource files corresponding to various kinds of vehicle configuration information, the sound effect resource files are generated based on sound which is emitted by a vehicle under the vehicle configuration information and has a specific sound effect, and the sound effect resource files comprise a plurality of acoustic components and spectrum parameters corresponding to the acoustic components; determining at least two first sound effect resource files matched with the target vehicle configuration information in a sound effect resource library based on the target vehicle configuration information of the target vehicle; and based on the spectrum parameters in the at least two first sound effect resource files, mixing the acoustic components in the first sound effect resource files to obtain a second sound effect resource file, and generating a target audio with a specific sound effect corresponding to the target vehicle based on the second sound effect resource file. The reality sense of sound with a specific sound effect generated for a vehicle can be improved, and the audio generation effect is improved.

Description

Technical Field

[0001] The present application relates to the field of computer technology, and in particular to an audio generation method, device, storage medium, and electronic device. Background Art

[0002] With the rapid development of life and technology, people often use gaming applications for entertainment. In some racing games, for example, there are many types of vehicles. Specific sound effects, such as vehicle exhaust sounds, need to be differentiated and realistic. To achieve this, it is necessary to create sound effects resources that simulate the corresponding specific sound effects for each type of vehicle. Existing audio generation methods typically utilize particle synthesizer algorithms to generate the acoustic characteristics of the engine and exhaust system through mathematical models, constructing a complete vehicle sound simulation system, and then generating the sounds of multiple vehicles based on this vehicle sound simulation system.

[0003] During the research and practice of the existing technologies, it was found that the specific sound effects such as sound waves generated by the existing audio generation methods have poor realism, resulting in poor audio generation effects. Summary of the Invention

[0004] The embodiments of the present application provide an audio generation method, device, storage medium and electronic device, which can accurately generate target audio with specific sound effects corresponding to a target vehicle, improve the realism of the sound with specific sound effects generated for the vehicle, and thereby improve the vehicle audio generation effect.

[0005] The present invention provides an audio generation method, including:

[0006] Obtaining a sound effect resource library, the sound effect resource library including sound effect resource files corresponding to a plurality of vehicle configuration information, the sound effect resource files being generated based on sounds having specific sound effects emitted by vehicles corresponding to the vehicle configuration information, the sound effect resource files including a plurality of acoustic components and spectral parameters corresponding to the acoustic components;

[0007] Based on target vehicle configuration information of a target vehicle, determining at least two first sound effect resource files matching the target vehicle configuration information in the sound effect resource library;

[0008] Based on spectral parameters in at least two first sound effect resource files, acoustic components in the first sound effect resource files are mixed to obtain a second sound effect resource file, so as to generate target audio with the specific sound effect corresponding to the target vehicle based on the second sound effect resource file.

[0009] Accordingly, an embodiment of the present application provides an audio generation device, comprising:

[0010] an acquisition unit, configured to acquire a sound effect resource library, the sound effect resource library including sound effect resource files corresponding to a plurality of vehicle configuration information, the sound effect resource files being generated based on sounds having specific sound effects emitted by vehicles corresponding to the vehicle configuration information, the sound effect resource files including a plurality of acoustic components and spectral parameters corresponding to the acoustic components;

[0011] a determining unit, configured to determine, based on target vehicle configuration information of a target vehicle, at least two first sound effect resource files matching the target vehicle configuration information in the sound effect resource library;

[0012] A mixing unit is used to mix the acoustic components in the first sound effect resource files based on the spectral parameters in at least two first sound effect resource files to obtain a second sound effect resource file, so as to generate a target audio with the specific sound effect corresponding to the target vehicle based on the second sound effect resource file.

[0013] In addition, an embodiment of the present application also provides a computer-readable storage medium, which stores a computer program. The computer program is suitable for loading by a processor to execute the steps in any audio generation method provided in the embodiment of the present application.

[0014] In addition, an embodiment of the present application also provides an electronic device, including a processor and a memory, wherein the memory stores an application program, and the processor is used to run the application program in the memory to implement the audio generation method provided in the embodiment of the present application.

[0015] An embodiment of the present application also provides a computer program product, which includes a computer program, and the computer program is stored in a computer-readable storage medium; when a processor of an electronic device reads the computer program from the computer-readable storage medium, the processor executes the computer program, so that the electronic device performs the steps in the audio generation method provided in the embodiment of the present application.

[0016] The embodiment of the present application obtains a sound effect resource library, which includes sound effect resource files corresponding to multiple vehicle configuration information. The sound effect resource files are generated based on sounds with specific sound effects emitted by vehicles under the vehicle configuration information, and the sound effect resource files include multiple acoustic components and spectral parameters corresponding to the acoustic components. Based on the target vehicle configuration information of the target vehicle, at least two first sound effect resource files that match the target vehicle configuration information are determined in the sound effect resource library. Based on the spectral parameters in the at least two first sound effect resource files, the acoustic components in the first sound effect resource files are mixed to obtain a second sound effect resource file, so as to generate target audio with specific sound effects corresponding to the target vehicle based on the second sound effect resource file. In this way, by determining at least two first sound effect resource files that match the target vehicle configuration information in the sound effect resource library, the acoustic components in the first sound effect resource files are mixed according to the spectral parameters in the first sound effect resource files, so that the target audio with specific sound effects corresponding to the target vehicle can be accurately generated based on the mixed sound effect resource files, thereby improving the realism of the sound with specific sound effects generated for the vehicle, and further improving the vehicle audio generation effect. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.

[0018] Figure 1 This is a schematic diagram of an implementation scenario of an audio generation method provided in an embodiment of the present application;

[0019] Figure 2 This is a flowchart of an audio generation method provided in an embodiment of the present application;

[0020] Figure 3 This is a schematic diagram of a spectrum diagram of an audio generation method provided in an embodiment of the present application;

[0021] Figure 4a This is a schematic diagram of mixing sound effect resources in an audio generation method provided in an embodiment of the present application;

[0022] Figure 4b This is another sound effect resource mixing diagram of an audio generation method provided in an embodiment of the present application;

[0023] Figure 5 is a structural diagram of an audio generating device provided in an embodiment of the present application;

[0024] Figure 6It is a structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0025] The following will be combined with the drawings in the embodiments of this application to clearly and completely describe the technical solutions in the embodiments of this application. Obviously, the embodiments described are only part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without making creative efforts are within the scope of protection of this application.

[0026] The embodiments of the present application provide an audio generation method, device, storage medium, and electronic device. The audio generation device can be integrated into an electronic device, which can be a server, a terminal, or other device.

[0027] Among them, the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, network acceleration services (Content Delivery Network, CDN), as well as basic cloud computing services such as big data and artificial intelligence platforms. Terminals may include but are not limited to mobile phones, computers, intelligent voice interaction devices, smart home appliances, vehicle-mounted terminals, aircraft, etc. Terminals and servers can be directly or indirectly connected through wired or wireless communication, and this application does not impose any restrictions on this.

[0028] See also Figure 1 , taking the audio generating device integrated into an electronic device as an example, Figure 1 A schematic diagram of an implementation scenario of the audio generation method provided in an embodiment of the present application, wherein the electronic device can obtain a sound effect resource library, the sound effect resource library includes sound effect resource files corresponding to multiple vehicle configuration information, the sound effect resource files are generated based on sounds with specific sound effects emitted by the vehicle under the vehicle configuration information, the sound effect resource files include multiple acoustic components and spectral parameters corresponding to the acoustic components; based on the target vehicle configuration information of the target vehicle, at least two first sound effect resource files that match the target vehicle configuration information are determined in the sound effect resource library; based on the spectral parameters in the at least two first sound effect resource files, the acoustic components in the first sound effect resource files are mixed to obtain a second sound effect resource file, so as to generate a target audio with specific sound effects corresponding to the target vehicle based on the second sound effect resource file.

[0029] It should be noted that Figure 1The illustrated schematic diagram of the implementation environment scenario of the audio generation method is merely an example. The implementation environment scenario of the audio generation method described in the embodiments of this application is intended to more clearly illustrate the technical solution of the embodiments of this application and does not constitute a limitation on the technical solution provided by the embodiments of this application. Persons skilled in the art will appreciate that with the evolution of data processing and the emergence of new business scenarios, the technical solution provided in this application will also be applicable to similar technical problems.

[0030] The solutions provided in the embodiments of the present application are specifically described by the following embodiments. It should be noted that the description order of the following embodiments does not limit the preferred order of the embodiments.

[0031] This embodiment will be described from the perspective of an audio generating device. The audio generating device may be integrated into an electronic device, which may be a terminal and / or a server. This application does not impose any restrictions thereon.

[0032] See also Figure 2 , Figure 2 : is a flow chart of the audio generation method provided in an embodiment of the present application. The audio generation method includes:

[0033] In step 101, a sound effect resource library is obtained.

[0034] Among them, the sound effect resource library includes sound effect resource files corresponding to various vehicle configuration information. The sound effect resource files are generated based on the sounds with specific sound effects emitted by the vehicles under the vehicle configuration information. The sound effect resource files include multiple acoustic components and spectral parameters corresponding to the acoustic components.

[0035] Among them, the sound effect resource library can be a resource library for generating specific sound effects, and can store multiple sound effect resource files. Each sound effect resource file can be used to realize a sound with a specific sound effect under at least one vehicle configuration information. The sound effect resource file can be a file for realizing a specific sound effect of the vehicle. The specific sound effect can be a sound effect such as the sound of the vehicle, the braking sound, the horn sound, etc. The vehicle configuration information can be information indicating the configuration of the vehicle. For example, it can include configurations such as vehicle type, engine specifications, exhaust pipe specifications, and intake pipe specifications. The vehicle type can include different types of configurations such as family cars, racing cars, and buses. The engine specifications can include a variety of different configurations such as displacement, power, and number of cylinders. Different types of vehicles, different specifications of engines, different specifications of exhaust pipes, and different specifications of intake pipes will all bring different timbres, thereby obtaining different sounds. The acoustic component may be a component of a sound with a specific sound effect corresponding to a sound effect resource file. For example, when the specific sound effect is the exhaust sound of a car, since the engine sound effect may include both engine sound effects and exhaust sound effects, the sound with the specific sound effect may be the sound emitted by the vehicle's engine and exhaust pipe. The corresponding acoustic components in the sound effect resource file may include the engine sound effect upsweep and downsweep corresponding to the engine, and the exhaust sound effect upsweep and downsweep corresponding to the exhaust pipe. The spectral parameter may be information describing the spectral composition and distribution of each acoustic component, may be the result of spectral analysis of each acoustic component, and may include fundamental frequency information of each acoustic component.

[0036] An upsweep refers to a rapid change in frequency from low to high in a sound. In engine sound effects, an upsweep is often used to simulate the sound changes during engine acceleration. As a vehicle or aircraft accelerates, the engine speed increases, and the frequency of the sound produced gradually increases from a low frequency. This frequency change can enhance the player's perception of acceleration. A downsweep refers to a rapid change in frequency from high to low in a sound. In engine sound effects, a downsweep is often used to simulate the sound changes during engine deceleration. Exhaust sound effects are the sounds produced by a vehicle or aircraft's exhaust system. An upsweep in an exhaust sound effect is a rapid change in frequency from low to high. This can be used to simulate the changes in exhaust pipe sound during acceleration, enhancing the acceleration sound effect in games and giving players a more realistic acceleration experience. A downsweep in an exhaust sound effect is a rapid change in frequency from high to low. This can be used to simulate the changes in exhaust pipe sound during deceleration, enhancing the deceleration sound effect in games and giving players a more realistic deceleration experience.

[0037] Optionally, there are many ways to construct a sound effect resource library. For example, the sound with specific sound effects emitted by the vehicle under various vehicle configuration information can be recorded to obtain the vehicle audio corresponding to the vehicle under various vehicle configuration information; the vehicle audio can be processed to obtain multiple sound effect resource files of the vehicle under various vehicle configuration information.

[0038] The vehicle audio may be audio recorded from sounds with specific sound effects emitted by the vehicle under various vehicle configuration information.

[0039] There are many ways to record the sound with specific sound effects emitted by the vehicle under multiple vehicle configuration information and obtain the vehicle audio corresponding to the vehicle under multiple vehicle configuration information. For example, when the vehicle is in each vehicle configuration information, the sound emitted by the vehicle can be recorded by a recording device set at at least one position of the vehicle to obtain at least one recorded audio, and the vehicle audio corresponding to the vehicle under the vehicle configuration information can be obtained based on the at least one recorded audio; wherein the position includes at least one of the engine, exhaust pipe, and intake pipe in the vehicle.

[0040] Among them, the recording device can be a device for recording sound, for example, it can include high-precision field sound microphones, directional microphones and vehicle-mounted recording equipment, etc., which can be used to capture the all-round acoustic performance of the engine, intake, exhaust and other positions in the vehicle, so that vehicle audio with better, richer and more realistic specific sound effects can be recorded, and thus sound effect resource files with more realistic sound effects can be generated based on the vehicle audio, thereby improving the realism and diversity of sounds with specific sound effects emitted by simulated vehicles in the game, thereby improving the audio processing effect.

[0041] Optionally, there are multiple ways to record the sounds with specific sound effects emitted by the vehicle under multiple vehicle configuration information, and obtain the vehicle audio corresponding to the vehicle under multiple vehicle configuration information. For example, each vehicle configuration information can correspond to a ventilation system of a certain specification, and the ventilation system includes at least one of an exhaust system and an intake system. In this way, the vehicle can be replaced with ventilation systems of multiple specifications, and the vehicle can be controlled to emit and record sounds with specific sound effects under each replaced ventilation system, so as to complete the recording of sounds with specific sound effects emitted by the vehicle under multiple vehicle configuration information and obtain the vehicle audio corresponding to the vehicle under multiple vehicle configuration information.

[0042] The exhaust system may include an exhaust pipe, and the intake system may include an intake pipe. When a vehicle is installed with a ventilation system of a certain specification, it may be indicated that the vehicle is in the vehicle configuration information corresponding to the currently installed ventilation system.

[0043] In one embodiment, a vehicle kit hot-swap strategy may be employed to rapidly replace exhaust systems or intake systems of different specifications on the same vehicle. After each exhaust system or intake system is replaced, the vehicle's engine is controlled to operate, thereby recording the sound waves generated by the vehicle's engine operation. This allows for a single recording to capture vehicle audio under a variety of vehicle configuration information.

[0044] Specifically, taking the exhaust pipe as an example of the ventilation system, you can first record the exhaust sound generated by the vehicle under the original configuration, and then replace it with a sports exhaust pipe of other specifications for recording, and then replace it with a track exhaust pipe and other specifications for recording. The interval between each replacement can be only 15-30 minutes, so that you can record the exhaust sound generated by the vehicle under a variety of different exhaust pipes in a short time, thereby greatly improving the recording efficiency of the vehicle's exhaust sound.

[0045] Among them, there are many ways to perform audio processing on the vehicle audio of the vehicle to obtain multiple sound effect resource files of the vehicle under various vehicle configuration information. For example, the vehicle audio can be subjected to audio separation processing to obtain multiple acoustic components; spectrum analysis can be performed based on the acoustic components to obtain spectrum parameters; based on the acoustic components and spectrum parameters, multiple sound effect resource files of the vehicle under various vehicle configuration information can be generated.

[0046] Among them, there are many ways to perform audio separation processing on the vehicle audio to obtain multiple acoustic components, perform spectrum analysis based on the acoustic components, and obtain spectrum parameters. For example, an audio processing tool (SpectraLayers) can be used to perform audio separation processing on the vehicle audio and perform spectrum analysis on each acoustic component. Therefore, according to the audio processing requirements, the acoustic components and corresponding spectrum parameters of the vehicle under each vehicle configuration information can be packaged. For example, they can be packaged into an encrypted file with a suffix (.bdl), so as to obtain multiple sound effect resource files of the vehicle under multiple vehicle configuration information.

[0047] In one embodiment, the spectrum of at least one recorded sound effect resource file can be adjusted and / or mixed according to the sound effect requirements to quickly obtain a new sound effect resource file with a completely new listening experience. For example, a completely new sound performance can be created by mixing the acoustic characteristics of engines of different displacements. In this way, the sound effect resource library can be quickly expanded to avoid redundancy of sound effect resources. This method greatly shortens the production cycle of new car model sound effects from the traditional weeks to a few hours, while ensuring the professional quality and acoustic realism of the sound effects, and meeting the needs of rapid iterative development. As the sound effect resource library continues to be enriched, the creative possibilities are growing exponentially.

[0048] In a specific embodiment, a professional recording team can be used to systematically record the vehicle. In the early preparation stage, the recording location, time and weather conditions can be determined, and a low-noise environment such as a racetrack or an open field can be selected to avoid interference from environmental noise. The recording device configuration may include high-precision field sound microphones, directional microphones, and on-board recording equipment to capture the full range of acoustic performance of the engine, intake, exhaust and other positions in the vehicle. The specific recording plan can adopt a multi-point acquisition strategy, arrange microphones at key sound source locations such as the vehicle's engine compartment, air intake, and exhaust pipe outlet, and set up far-field microphones to capture the overall sound characteristics. The recording process can follow a standardized process and can include various working conditions such as idling recording, linear acceleration, constant speed cruising, and high-speed downshifting.

[0049] In one embodiment, after the vehicle audio is recorded, the vehicle audio can be subjected to post-standardization processing to obtain a sound effect resource file with better sound effects. For example, a rough cut can be performed first, and the complete recording can be divided into independent audio clips according to the working condition type, unnecessary environmental noise and recording defects can be removed, and the core acoustic characteristics can be retained to obtain the vehicle audio of each working condition under each vehicle configuration information. In the fine processing stage, professional audio software (such as Reaper) can be used for multi-track processing, including sound equalization adjustment, dynamic range compression, and stereo space optimization. Among them, it is necessary to pay attention to retaining the unique acoustic characteristics of the engine, such as the ignition order, the timbre characteristics related to the number of cylinders, etc., while optimizing the high-frequency details and low-frequency response of the vehicle audio to ensure the thickness and clarity of the sound. For example, fine processing of vehicle audio can be performed in a professional sequencer (Ableton Live) tool. Post-processing standardization refers to the process of applying unified spectrum requirements, dynamic range, and volume standards to processed audio to ensure that all sound effects have good compatibility in the subsequent synthesis process. Post-processing standardization is the key to ensuring the consistency of the sound effect resource library. All processed vehicle audio must meet the preset spectrum requirements, dynamic range, and volume standards to ensure compatibility in the subsequent synthesis process, so that it can be widely used in game engines.

[0050] The equalizer (EQ) is a key tool in shaping the engine sound. By adjusting the energy distribution in different frequency bands, specific acoustic characteristics can be optimized. For example, ultra-low frequencies (20Hz-60Hz) can be used to control the engine's undertones and sense of power, affecting the sense of pressure in large-displacement engines. Low frequencies (60Hz-200Hz) serve as the engine's fundamental resonance region, while 80-120Hz corresponds to the idle base frequency and can influence the depth of the sound. Low-mid frequencies (200Hz-500Hz) determine the warmth and fullness of the sound, with 300Hz distinguishing between different cylinder counts. Mid frequencies (500Hz-2kHz) influence presence and propulsion, while 800Hz-1.2kHz represents the exhaust system's resonance range. High-mid frequencies (2kHz-7kHz) can be used to control aggressiveness, sharpness, and mechanical texture, while 3-4kHz can reflect the characteristics of the ignition system. High frequencies (7kHz-20kHz) can enhance the sense of air and detail, affecting the characteristics of turbine whine and exhaust pop.

[0051] Dynamic compression is a core tool for shaping the sound characteristics of an engine. By controlling the dynamic range of the audio signal, it can precisely adjust dynamics, transient performance, and sonic density. Basic dynamic compression parameters include threshold, ratio, attack time, and release time. Regarding the threshold parameter, for example, a high-performance sports car can use a low threshold (-18dB to -24dB) to capture explosive details, while a family car can use a medium threshold to maintain natural dynamics. Regarding the ratio parameter, for example, a four-cylinder engine is suited to a moderate ratio (2:1 to 3:1), a high-performance engine can use a medium ratio (4:1 to 6:1) to enhance power, and a racing engine can use a high ratio (8:1 to 10:1) to create an aggressive sound. Regarding attack time, an ultra-short attack time (0.5-2ms) preserves ignition transients, a short attack time (2-5ms) preserves mechanical details, and a medium attack time (5-15ms) optimizes exhaust pop. For the release time parameter, a long release time (150-300ms) can be used under idle conditions; a short release time (40-80ms) can be used under high speed conditions to create a compact sound. The ideal solution is to dynamically adjust the release time according to the speed.

[0052] In addition, advanced compression technology can be used to dynamically compress vehicle audio. For example, multi-band compression can be used to separately process low-frequency roar, mid-frequency timbre, and high-frequency details to achieve precise adjustment and control of vehicle audio. Parallel compression can also be used to mix the original signal and the compressed signal while maintaining the impact and natural attenuation characteristics. Adaptive release can also be used to dynamically adjust the release time based on the engine load to improve sound continuity. In this way, by combining equalizer adjustment and dynamic compression processing, the vehicle's engine sound effects can be precisely shaped to make it exhibit realistic and distinctive acoustic effects in the gaming environment.

[0053] The vehicle audio that has been standardized in the later stage needs to be transferred to a special spectrum analysis audio tool (SpectraLayers) for further processing to obtain multiple sound effect resource files for the vehicle under various vehicle configuration information. For example, the processed vehicle audio of each working condition can be imported into the SpectraLayers tool according to the preset template for particle alignment and spectrum analysis. Among them, particle alignment is a technology that can accurately match acoustic particles of different audio sources in the time and frequency domains, which is the basis for achieving sound effect mixing. Then, the imported vehicle audio can be expanded in the spectrum view through the SpectraLayers tool for spectrum analysis, displaying the three-dimensional relationship of time-frequency-energy, which is convenient for identifying the vehicle's engine acoustic characteristics. In addition, through the spectral layer separation function, the system can decompose the engine sound into harmonic components, noise components and transient events, achieving precise spectrum editing, so that the vehicle audio can be optimized in a fine-grained manner. After completing the spectral analysis of the vehicle audio, you can create a multi-layer spectral structure in the SpectraLayers tool, adjust the characteristics of each frequency band according to the sound effect requirements, and export them as multi-channel audio files, i.e., sound effect resource files. These multi-channel audio files contain the separated acoustic components and the corresponding spectral parameter data. They can be called by the game audio engine to realize dynamic engine sound effects based on spectral resynthesis. Each set of processed multi-channel audio files represents a basic acoustic model for a specific vehicle configuration, which is used to realize sound with specific sound effects under a specific vehicle configuration.

[0054] Optionally, the sound effect resource file may also include vehicle audio. In some cases, the vehicle audio may be directly adjusted or mixed to obtain a new sound effect resource file.

[0055] In one embodiment, the spectrum distribution diagram of each acoustic component corresponding to the vehicle audio can be viewed based on the visualization interface provided by the SpectraLayers tool. For example, please refer to Figure 3 , Figure 3This is a spectrum diagram of an audio generation method provided in an embodiment of the present application. The figure shows the spectrum view corresponding to the frequency sweep under the engine sound effect. Relevant technicians can perform spectrum analysis and editing on the vehicle audio based on the spectrum distribution displayed in the spectrum view. They can also simulate the modification effects of different scenarios by adjusting the spectrum parameters, such as exhaust upgrades, turbocharging, etc., so as to optimize and adjust the specific sound effects achieved by the sound effect resource file, thereby achieving better sound effects.

[0056] In step 102 , based on target vehicle configuration information of a target vehicle, at least two first sound effect resource files matching the target vehicle configuration information are determined in a sound effect resource library.

[0057] The target vehicle may be a vehicle for which a specific sound effect is to be generated, or may be a virtual vehicle used to generate a game. The target vehicle configuration information may be vehicle configuration information corresponding to the target vehicle. The first sound effect resource file may be a sound effect resource file used to simulate a sound having a specific sound effect emitted by the target vehicle under the target vehicle configuration information.

[0058] There are multiple ways to determine, based on the target vehicle configuration information of the target vehicle, at least two first sound effect resource files that match the target vehicle configuration information in the sound effect resource library. For example, each sound effect resource file in the sound effect resource library can be marked with at least one vehicle configuration information, so that based on the vehicle configuration information corresponding to the sound effect resource file, at least two first sound effect resource files that match the target vehicle configuration information can be determined in the sound effect resource library. For example, each sound effect resource file can be marked with at least one vehicle configuration information such as its corresponding vehicle type, exhaust pipe specifications, intake pipe specifications, engine specifications, etc., so that based on the vehicle configuration information marked by the sound effect resource file and the various vehicle configuration information in the target vehicle configuration information, at least two first sound effect resource files that match each configuration information in the target vehicle configuration information can be determined in the sound effect resource library.

[0059] In one embodiment, relevant technical personnel may also determine a first sound effect resource file matching the target vehicle configuration information in the sound effect resource library based on the target vehicle configuration information of the target vehicle.

[0060] Optionally, the sound effect resource file can also be configured with a working condition identifier. Thus, based on the target vehicle configuration information of the target vehicle, there can be multiple ways to determine at least two first sound effect resource files that match the target vehicle configuration information in the sound effect resource library. For example, the target working condition corresponding to the target vehicle can be obtained; based on the target working condition and the target vehicle configuration information, at least two first sound effect resource files that match the target vehicle configuration information and the target working condition can be determined in the sound effect resource library.

[0061] Among them, the operating condition identifier can indicate the operating condition when the vehicle emits a sound with a specific sound effect used to generate a sound effect resource file, that is, the operating condition of the vehicle when recording the vehicle emitting a sound with a specific sound effect. The operating condition can refer to the working conditions of the vehicle under different operating conditions, including idling, linear acceleration, constant speed cruising and high-speed downshifting, etc. It is the basic unit for recording and processing vehicle sound effects.

[0062] In this way, the sound effect resource file can be marked with the corresponding vehicle configuration information and operating condition identification, so that based on the vehicle configuration information and operating condition identification marked by the sound effect resource file, as well as the target operating condition and target vehicle configuration information, at least two first sound effect resource files that match the target vehicle configuration information and target operating condition can be determined in the sound effect resource library. For example, the first sound effect resource file can include at least one sound effect resource file with the same configuration as the target vehicle configuration information, and at least one first sound effect resource file belonging to the same operating condition as the target operating condition. It can also include a first sound effect resource file that matches both the target vehicle configuration information and the target operating condition, etc.

[0063] In step 103, based on the spectrum parameters in at least two first sound effect resource files, the acoustic components in the first sound effect resource files are mixed to obtain a second sound effect resource file, so as to generate a target audio with a specific sound effect corresponding to the target vehicle based on the second sound effect resource file.

[0064] The second sound effect resource file may be obtained by mixing the first sound effect resource file, and the target audio may be audio used to simulate the target vehicle emitting a sound with a specific sound effect under the target vehicle configuration information.

[0065] Among them, there are many ways to mix the acoustic components in the first sound effect resource files based on the spectral parameters in at least two first sound effect resource files to obtain the second sound effect resource file. For example, the spectral area to be mixed and the mixing ratio of each first sound effect resource file can be determined. Based on the spectral area corresponding to each first sound effect resource file and the spectral parameters corresponding to the acoustic components, the target acoustic components to be mixed of each first sound effect resource file can be determined, and the target acoustic components can be mixed according to the mixing ratio to obtain the second sound effect resource file.

[0066] The specific ratio of the mixing ratio may be a default setting value or may be determined according to the mixing requirements, which is not limited in the embodiments of the present application. The spectral region may include a low-frequency region, a high-frequency region, a mid-frequency region, and other spectral regions, and may also include a mid-low-frequency region, a mid-high-frequency region, and other spectral regions. The target acoustic component may be an acoustic component that needs to be mixed.

[0067] For example, when mixing first sound effect resource files, if it is necessary to retain the low-frequency characteristics of a first sound effect resource file while adopting the high-frequency details of another first sound effect resource file, the spectrum area of ​​the other non-low-frequency parts of the first sound effect resource file that needs to retain the low-frequency characteristics can be removed, and the spectrum area of ​​the other non-high-frequency parts of the first sound effect resource file that needs to retain the high-frequency details can be removed, thereby mixing to obtain a second sound effect resource file that retains the desired low-frequency characteristics and high-frequency details. Based on the second sound effect resource file, the desired sound effect can be achieved. In addition, the mixing ratio of each spectrum area can be precisely controlled to achieve fine-grained mixing of the first sound effect resource files, thereby achieving more accurate, more realistic, and more fine-grained specific sound effects.

[0068] Optionally, there are multiple ways to obtain a second sound effect resource file by mixing the acoustic components in the first sound effect resource files based on the spectral parameters in at least two first sound effect resource files. For example, a spectral analysis graph of the acoustic components can be generated based on the spectral parameters corresponding to each acoustic component in each first sound effect resource file, the spectral analysis graph including multiple acoustic feature components; the target acoustic feature components to be mixed in each acoustic component are determined based on the spectral analysis graph; and the acoustic components in the first sound effect resource files are mixed based on the target acoustic feature components to obtain a second sound effect resource file.

[0069] The spectrum analysis graph can be a view showing the spectrum analysis results corresponding to each acoustic component, and can also be generated based on the corresponding vehicle audio. The acoustic feature components can be acoustic features corresponding to each acoustic component, and can include acoustic features such as harmonic components and noise components. The target acoustic feature components can be acoustic feature components to be mixed, for example, harmonics or fundamental frequencies selected for mixing from the harmonic components of an acoustic component, or noise components of an acoustic component.

[0070] There are multiple ways to determine the target acoustic characteristic components to be mixed in each acoustic component based on the spectrum analysis graph. For example, the target acoustic characteristic components to be mixed in each acoustic component can be determined based on the user's selection operation of the acoustic characteristic components displayed in the spectrum analysis graph corresponding to each acoustic component. For example, based on resource synthesis requirements, the user can select all harmonic components, or only the fundamental frequency, or the noise component in the spectrum analysis graph, so that the selected acoustic characteristic components can be determined as the target acoustic characteristic components to be mixed. The fundamental frequency in the frequency sweep can reflect the acoustic characteristics of the engine, and in the spectrum analysis graph, the fundamental frequency is the brightest harmonic in the spectrum.

[0071] For example, see Figure 4a , Figure 4aThis is a schematic diagram of sound effect resource mixing of an audio generation method provided by an embodiment of the present application. The acoustic components of the first sound effect resource file can be mixed in the Ableton Live tool. Specifically, taking the acoustic components in the sound effect resource file including engine sound effect up sweep, engine sound effect down sweep, exhaust sound effect up sweep, and exhaust sound effect down sweep as an example, assuming that the first sound effect resource file includes a first sound effect resource file A and a first sound effect resource file B, Figure 4a The left side of the interface shows the spectrograms corresponding to the engine sound effect upsweep A and exhaust sound effect upsweep A corresponding to the first sound effect resource file A, as well as the engine sound effect upsweep B and exhaust sound effect upsweep B corresponding to the first sound effect resource file B. Correspondingly, the right side of the interface shows the spectrograms corresponding to the engine sound effect downsweep and exhaust sound effect corresponding to the first sound effect resource file A, as well as the engine sound effect downsweep and exhaust sound effect downsweep corresponding to the first sound effect resource file B. In this way, based on the Ableton Live tool, you can select target acoustic feature components, mix the acoustic components of the first sound effect resource files, adjust the volume of each first sound effect resource file during mixing, and adjust the corresponding mixing ratio, etc., to achieve precise mixing of the sound effect resources.

[0072] For example, you can use the spectrum mixing function in the SpectraLayers tool to mix the first sound resource file to generate a new sound. For example, please refer to Figure 4b , Figure 4b This is another sound effect resource mixing diagram of an audio generation method provided in an embodiment of the present application. Each first sound effect resource file can be mixed in the SpectraLayers tool in the form of a layer. The upper half of the figure is a spectrum analysis diagram corresponding to a first sound effect resource file, and the lower half is a spectrum analysis diagram corresponding to another first sound effect resource file.

[0073] In this way, when it is necessary to quickly generate special sound effects for new car models, the embodiment of the present application can use the multi-layer mixing function of the SpectraLayers tool to proportionally mix the acoustic feature layers of at least two first sound effect resource files to quickly create sound effects with new characteristics. This method can greatly shorten the production cycle of new car model sound effects from the traditional weeks to hours, while ensuring the professional quality and acoustic realism of the sound effects, and meeting the needs of rapid iterative development.

[0074] In racing games, vehicle exhaust sounds need to be differentiated and realistic. There are currently three main technical approaches to vehicle sound processing: first, single-source processing, which adjusts and processes basic sound sources by applying audio effects like equalizers and distorters to alter their sound characteristics. Second, pre-recorded multi-source technology, which records a complete audio resource package for each vehicle configuration, creating a dedicated sound library to ensure maximum audio authenticity and accuracy. Third, synthesizer sound technology, which utilizes advanced granular synthesizer algorithms to generate the acoustic characteristics of the engine and exhaust system through mathematical models, creating a complete vehicle sound simulation system.

[0075] However, the vehicle exhaust sound effect achieved by the method of single material + effector has a harsh change in timbre and lacks acoustic diversity, which cannot truly reflect the unique acoustic characteristics of different models. The vehicle exhaust sound effect generated by the method of pre-recording multiple sets of materials has serious resource redundancy, storage space waste, long development cycle and high cost. At the same time, each new model needs to rebuild the recording environment and record full-speed sound effects, which greatly increases the cost of sound effect implementation. The vehicle exhaust sound effect achieved based on synthesizer sound technology has a serious lack of authenticity in the generated sound and cannot meet the requirements of high-quality projects. It can be seen that the existing audio processing methods for achieving vehicle exhaust sound effects have poor flexibility, poor realism, low adaptation efficiency, and cannot quickly generate new car model sound effects based on existing materials. It is difficult to meet the needs of rapid iterative development, resulting in low audio processing efficiency.

[0076] To this end, the present invention provides an audio processing method for generating vehicle exhaust noise based on a single recording and a sound effect library. To address the high cost of traditional vehicle sound effect recording, the present invention seeks to significantly reduce the cost of sound effect production by reusing a single recording and a library, while maintaining high-quality acoustic performance. To address the lack of realism and acoustic detail in synthesizer timbre, the present invention combines recorded material with advanced audio processing technology to achieve efficient sound effect generation while ensuring sound authenticity. To address the inefficiency of sound effect resource expansion, existing technologies struggle to quickly generate sound effect variants adapted to different vehicle models based on limited audio material, limiting the richness of game content and development efficiency. The present invention utilizes sound effect kneading technology to efficiently utilize and expand existing sound effect resources. To address the difficulty of balancing sound effect quality and production efficiency, traditional methods often face a significant trade-off between sound effect quality and production efficiency, making it difficult to simultaneously meet the dual requirements of high quality and high efficiency. The present invention utilizes standardized recording, processing, and synthesis processes to significantly improve production efficiency while ensuring sound effect quality.

[0077] The audio processing method provided in the embodiment of the present application adopts vehicle recording technology, audio post-processing technology and audio mixing generation technology in the execution process. Among them, vehicle recording technology includes microphone protection, fixation and the use of different types of microphones, audio post-processing technology includes post-standardization processing such as editing, noise reduction, and compression, and audio mixing generation technology includes particle alignment and processing flow. Specifically, the embodiment of the present application proposes a technical solution for generating sound effects for racing games. Its core process includes four key links: first, the same vehicle is modified to install exhaust pipes of different specifications, and a variety of basic tones are collected through a single recording work; second, the collected original audio material is professionally edited, noise reduced, equalized and other post-optimization processing; then, the particle alignment technology in the SpectraLayers tool is applied to scientifically mix the processed audio format (Waveform Audio File Format, abbreviated as wav) with the archived sound effect resource library to generate a synthetic sound effect with new characteristics; finally, by iteratively applying the above process, the newly synthesized sound effects are continuously added to the resource library, gradually building a richer sound effect data set. The entire technical solution constitutes a complete sound effect resource production chain. Therefore, the specific sound effects of various vehicles in the game can be realized based on the constructed sound effect resource library, which significantly reduces the cost of sound effect production. The recording of multiple modified configurations of a single vehicle replaces the traditional recording method that requires the use of multiple models, reducing vehicle rental, venue and human resources investment. At the same time, it can greatly improve production efficiency, and compress the recording work of multiple models that originally took weeks to complete to a few days. In addition, it also optimizes the utilization of storage resources. The redundant storage of a large amount of repeated or similar audio is avoided through sound mixing technology, and the flexibility of sound effect adaptation can be enhanced, allowing the development team to quickly respond to the sound effect requirements of new models without having to re-record the entire process. It can also ensure the consistency of sound effect quality. The sound effect resources processed based on standardized processes can have stable sound quality performance, ultimately achieving a balance between quality and efficiency, providing an economical and practical sound effect solution for game development.

[0078] In this way, the embodiment of the present application has built a complete and efficient vehicle sound effect production process by integrating technical links such as hot-swap recording of vehicle kits, professional audio post-processing, SpectraLayers spectrum analysis and spectrum mixing. This method has significantly changed the traditional vehicle sound effect production model, condensing the recording work that originally required multiple models and multiple cycles into an efficient acquisition process with multiple configurations for a single model, and then maximizing the utilization and expansion of materials through advanced spectrum processing technology. After many practices, it can be seen that the use of the embodiment of the present application can shorten the sound effect production cycle by more than 70% and reduce costs by about 60%, while ensuring the professional quality and realism of the sound. By continuously iterating and supplementing the sound effect resource library, it is possible to quickly respond to the acoustic requirements of new models, providing game development with both economical and high-quality sound effect solutions, especially suitable for rapidly iterative game development environments. The embodiment of the present application not only solves the current problem of efficiency and quality balance in vehicle sound effect production, but also provides a new technical path for the sustainable development of audio resources.

[0079] As can be seen from the above, the embodiment of the present application obtains a sound effect resource library, which includes sound effect resource files corresponding to multiple vehicle configuration information. The sound effect resource files are generated based on the sound with specific sound effects emitted by the vehicle under the vehicle configuration information, and the sound effect resource files include multiple acoustic components and spectral parameters corresponding to the acoustic components; based on the target vehicle configuration information of the target vehicle, at least two first sound effect resource files that match the target vehicle configuration information are determined in the sound effect resource library; based on the spectral parameters in the at least two first sound effect resource files, the acoustic components in the first sound effect resource files are mixed to obtain a second sound effect resource file, so as to generate a target audio with specific sound effects corresponding to the target vehicle based on the second sound effect resource file. In this way, by determining at least two first sound effect resource files that match the target vehicle configuration information of the target vehicle in the sound effect resource library, the acoustic components in the first sound effect resource files are mixed according to the spectral parameters in the first sound effect resource files, so that the target audio with specific sound effects corresponding to the target vehicle can be accurately generated based on the mixed sound effect resource files, thereby improving the realism of the sound with specific sound effects generated for the vehicle, and thereby improving the vehicle audio generation effect.

[0080] In order to better implement the above method, an embodiment of the present invention further provides an audio generating device, which can be integrated into an electronic device, and the electronic device can be a terminal or a server.

[0081] For example, Figure 5 , which is a schematic diagram of the structure of the audio generation device provided in an embodiment of the present application, the audio generation device may include an acquisition unit 201, a determination unit 202, and a mixing unit 203, as follows:

[0082] An acquisition unit 201 is configured to acquire a sound effect resource library, the sound effect resource library including sound effect resource files corresponding to various vehicle configuration information. The sound effect resource files are generated based on sounds having specific sound effects emitted by vehicles corresponding to the vehicle configuration information. The sound effect resource files include multiple acoustic components and spectral parameters corresponding to the acoustic components.

[0083] The determining unit 202 is configured to determine, based on the target vehicle configuration information of the target vehicle, at least two first sound effect resource files matching the target vehicle configuration information in the sound effect resource library;

[0084] The mixing unit 203 is used to mix the acoustic components in the first sound effect resource files based on the spectrum parameters in at least two first sound effect resource files to obtain a second sound effect resource file, so as to generate a target audio with a specific sound effect corresponding to the target vehicle based on the second sound effect resource file.

[0085] In some embodiments, the audio processing apparatus further includes a resource generation unit configured to:

[0086] Recording sounds with specific sound effects emitted by a vehicle under various vehicle configuration information to obtain vehicle audio corresponding to the vehicle under the various vehicle configuration information;

[0087] Audio processing is performed on the vehicle audio of the vehicle to obtain multiple sound effect resource files of the vehicle under various vehicle configuration information.

[0088] In some embodiments, the above-mentioned recording of the sound with specific sound effects emitted by the vehicle under various vehicle configuration information to obtain the vehicle audio corresponding to the vehicle under the various vehicle configuration information is specifically used to:

[0089] When the vehicle is in each vehicle configuration information, recording a sound emitted by the vehicle by a recording device provided at at least one position of the vehicle to obtain at least one recorded audio, and obtaining a vehicle audio corresponding to the vehicle in the vehicle configuration information based on the at least one recorded audio;

[0090] The location includes at least one of an engine, an exhaust pipe, and an intake pipe in a vehicle.

[0091] In some embodiments, each vehicle configuration information corresponds to a ventilation system of a certain specification, and the ventilation system includes at least one of an exhaust system and an intake system. The above-mentioned recording of the sound with a specific sound effect emitted by the vehicle under various vehicle configuration information to obtain the vehicle audio corresponding to the vehicle under various vehicle configuration information is specifically used to:

[0092] The vehicle's ventilation systems are replaced with various specifications, and the vehicle is controlled to emit and record sounds with specific sound effects under each replaced ventilation system, so as to complete the recording of sounds with specific sound effects emitted by the vehicle under various vehicle configuration information and obtain the corresponding vehicle audio under various vehicle configuration information.

[0093] In some embodiments, the above-mentioned audio processing of the vehicle audio is performed to obtain multiple sound effect resource files of the vehicle under various vehicle configuration information, which is specifically used to:

[0094] Perform audio separation processing on vehicle audio to obtain multiple acoustic components;

[0095] Perform spectrum analysis based on acoustic components to obtain spectrum parameters;

[0096] Based on acoustic components and spectral parameters, multiple sound effect resource files are generated for the vehicle under various vehicle configuration information.

[0097] In some embodiments, the sound effect resource file is further configured with an operating condition identifier, which indicates an operating condition when the vehicle emits a sound used to generate a specific sound effect of the sound effect resource file;

[0098] The determining unit 202 is configured to:

[0099] Obtain the target operating conditions corresponding to the target vehicle;

[0100] Based on the target operating condition and the target vehicle configuration information, at least two first sound effect resource files matching the target vehicle configuration information and the target operating condition are determined in the sound effect resource library.

[0101] In some embodiments, the mixing unit 203 is configured to:

[0102] Determining the frequency spectrum regions to be mixed and the mixing ratios of the first sound effect resource files;

[0103] Determining target acoustic components to be mixed for each first sound effect resource file based on the spectrum regions corresponding to each first sound effect resource file and the spectrum parameters corresponding to the acoustic components;

[0104] The target acoustic components are mixed according to the mixing ratio to obtain a second sound effect resource file.

[0105] In some embodiments, the mixing unit 203 is configured to:

[0106] generating a spectrum analysis graph of the acoustic component based on the spectrum parameters corresponding to each acoustic component in each first sound effect resource file, wherein the spectrum analysis graph includes a plurality of acoustic characteristic components;

[0107] Determining target acoustic characteristic components to be mixed among the acoustic components based on the spectrum analysis graph;

[0108] The acoustic components in the first sound effect resource file are mixed based on the target acoustic feature component to obtain a second sound effect resource file.

[0109] In specific implementation, the above units can be implemented as independent entities, or can be arbitrarily combined to be implemented as the same or several entities. The specific implementation of the above units can be found in the previous method embodiments and will not be repeated here.

[0110] From the above, it can be seen that the embodiment of the present application obtains a sound effect resource library through the acquisition unit 201, and the sound effect resource library includes sound effect resource files corresponding to multiple vehicle configuration information. The sound effect resource files are generated based on the sound with specific sound effects emitted by the vehicle under the vehicle configuration information, and the sound effect resource files include multiple acoustic components and spectral parameters corresponding to the acoustic components; the determination unit 202 determines at least two first sound effect resource files matching the target vehicle configuration information in the sound effect resource library based on the target vehicle configuration information of the target vehicle; the mixing unit 203 mixes the acoustic components in the first sound effect resource files based on the spectral parameters in the at least two first sound effect resource files to obtain a second sound effect resource file, so as to generate a target audio with specific sound effects corresponding to the target vehicle based on the second sound effect resource file. In this way, by determining at least two first sound effect resource files that match the target vehicle configuration information of the target vehicle in the sound effect resource library, the acoustic components in the first sound effect resource files are mixed according to the spectral parameters in the first sound effect resource files, so that the target audio with specific sound effects corresponding to the target vehicle can be accurately generated based on the mixed sound effect resource files, thereby improving the realism of the sound with specific sound effects generated for the vehicle, and thereby improving the vehicle audio generation effect.

[0111] The present application also provides an electronic device, such as Figure 6 , which shows a schematic diagram of the structure of an electronic device involved in an embodiment of the present application. The electronic device may be a terminal or a server. Specifically:

[0112] The electronic device 300 includes a processor 301 having one or more processing cores, a memory 302 having one or more computer-readable storage media, and a computer program stored in the memory 302 and executable on the processor. The processor 301 is electrically connected to the memory 302. Those skilled in the art will appreciate that the electronic device structure shown in the figures does not limit the electronic device and may include more or fewer components than shown, or combine certain components, or arrange the components differently.

[0113] The processor 301 is the control center of the electronic device 300. It uses various interfaces and lines to connect various parts of the entire electronic device 300. By running or loading software programs and / or modules stored in the memory 302 and calling data stored in the memory 302, it executes various functions of the electronic device 300 and processes data, thereby monitoring the electronic device 300 as a whole.

[0114] In the embodiment of the present application, the processor 301 in the electronic device 300 loads instructions corresponding to one or more application processes into the memory 302 according to the following steps, and the processor 301 runs the application stored in the memory 302 to implement various functions:

[0115] Obtaining a sound effect resource library, the sound effect resource library including sound effect resource files corresponding to various vehicle configuration information, the sound effect resource files being generated based on sounds with specific sound effects emitted by the vehicles under the vehicle configuration information, the sound effect resource files including multiple acoustic components and spectral parameters corresponding to the acoustic components;

[0116] Based on target vehicle configuration information of the target vehicle, determining at least two first sound effect resource files matching the target vehicle configuration information in a sound effect resource library;

[0117] Based on the spectrum parameters in at least two first sound effect resource files, the acoustic components in the first sound effect resource files are mixed to obtain a second sound effect resource file, so as to generate a target audio with a specific sound effect corresponding to the target vehicle based on the second sound effect resource file.

[0118] This solution can obtain a sound effect resource library, which includes sound effect resource files corresponding to multiple vehicle configuration information. The sound effect resource files are generated based on sounds with specific sound effects emitted by vehicles under the vehicle configuration information, and the sound effect resource files include multiple acoustic components and spectral parameters corresponding to the acoustic components. Based on the target vehicle configuration information of the target vehicle, at least two first sound effect resource files that match the target vehicle configuration information are determined in the sound effect resource library. Based on the spectral parameters in the at least two first sound effect resource files, the acoustic components in the first sound effect resource files are mixed to obtain a second sound effect resource file, and target audio with specific sound effects corresponding to the target vehicle is generated based on the second sound effect resource file. In this way, by determining at least two first sound effect resource files that match the target vehicle configuration information in the sound effect resource library, the acoustic components in the first sound effect resource files are mixed according to the spectral parameters in the first sound effect resource files, and the target audio with specific sound effects corresponding to the target vehicle can be accurately generated based on the mixed sound effect resource files, thereby improving the realism of the sound with specific sound effects generated for the vehicle and further improving the vehicle audio generation effect.

[0119] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0120] Optional, such as Figure 6 As shown, the electronic device 300 further includes: a touch screen 303, a radio frequency circuit 304, an audio circuit 305, an input unit 306, and a power supply 307. Among them, the processor 301 is electrically connected to the touch screen 303, the radio frequency circuit 304, the audio circuit 305, the input unit 306, and the power supply 307 respectively. Those skilled in the art will understand that Figure 6 The electronic device structure shown in the figure does not constitute a limitation to the electronic device, and may include more or fewer components than shown in the figure, or combine certain components, or arrange the components differently.

[0121] The touch display screen 303 can be used to display a graphical user interface and receive user operations generated by the graphical user interface. The touch display screen 303 may include a display panel and a touch panel. Among them, the display panel can be used to display information input by the user or information provided to the user and various graphical user interfaces of the electronic device, and these graphical user interfaces can be composed of graphics, text, icons, videos and any combination thereof. Optionally, a liquid crystal display (LCD, Liquid Crystal Display), an organic light emitting diode (OLED, Organic Light-Emitting Diode) and the like can be used to configure the display panel. The touch panel can be used to collect user touch operations on or near it (such as the user uses any suitable object or accessory such as a finger, stylus on the touch panel or near the touch panel) and generate corresponding operation instructions, and the operation instructions execute corresponding programs. Optionally, the touch panel may include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch direction, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into the touch point coordinates, and then sends it to the processor 301, and can receive the command sent by the processor 301 and execute it. The touch panel can cover the display panel. When the touch panel detects a touch operation on or near it, it is transmitted to the processor 301 to determine the type of touch event, and then the processor 301 provides a corresponding visual output on the display panel according to the type of touch event. In an embodiment of the present application, the touch panel and the display panel can be integrated into the touch display screen 303 to realize the input and output functions. However, in some embodiments, the touch panel and the touch panel can be used as two independent components to realize the input and output functions. That is, the touch display screen 303 can also be used as part of the input unit 306 to realize the input function.

[0122] The radio frequency circuit 304 may be used to transmit and receive radio frequency signals, so as to establish wireless communication with a network device or other electronic devices through wireless communication, and to transmit and receive signals with the network device or other electronic devices.

[0123] The audio circuit 305 can be used to provide an audio interface between the user and the electronic device through a speaker and microphone. The audio circuit 305 can convert the received audio data into an electrical signal and transmit it to the speaker, which then converts it into a sound signal for output. On the other hand, the microphone converts the collected sound signal into an electrical signal, which is received by the audio circuit 305 and converted into audio data. The audio data is then output to the processor 301 for processing, and then sent to another electronic device through the radio frequency circuit 304, or the audio data is output to the memory 302 for further processing. The audio circuit 305 may also include an earphone jack to provide communication between external headphones and the electronic device.

[0124] The input unit 306 may be configured to receive input digital, character information, or user feature information (such as fingerprint, iris, or facial information), and to generate keyboard, mouse, joystick, optical, or trackball signal inputs related to user settings and function control.

[0125] Power supply 307 is used to supply power to various components of electronic device 300. Optionally, power supply 307 can be logically connected to processor 301 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. Power supply 307 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.

[0126] although Figure 6 Not shown in the figure, the electronic device 300 may further include a camera, a sensor, a wireless fidelity module, a Bluetooth module, etc., which will not be described in detail here.

[0127] In the above embodiments, the descriptions of each embodiment have their own emphasis. For parts not described in detail in one embodiment, please refer to the relevant descriptions of other embodiments. It should be noted that the electronic device provided in the embodiments of this application and the audio generation method in the above embodiments are based on the same concept. The specific implementation process is detailed in the above method embodiments and will not be repeated here.

[0128] As can be seen from the above, the electronic device provided in the embodiment of the present application can obtain a sound effect resource library, the sound effect resource library includes sound effect resource files corresponding to multiple vehicle configuration information, the sound effect resource files are generated based on the sound with specific sound effects emitted by the vehicle under the vehicle configuration information, and the sound effect resource files include multiple acoustic components and spectral parameters corresponding to the acoustic components; based on the target vehicle configuration information of the target vehicle, at least two first sound effect resource files that match the target vehicle configuration information are determined in the sound effect resource library; based on the spectral parameters in the at least two first sound effect resource files, the acoustic components in the first sound effect resource files are mixed to obtain a second sound effect resource file, and the target audio with specific sound effects corresponding to the target vehicle is generated based on the second sound effect resource file. In this way, by determining at least two first sound effect resource files that match the target vehicle configuration information in the sound effect resource library, the acoustic components in the first sound effect resource files are mixed according to the spectral parameters in the first sound effect resource files, so that the target audio with specific sound effects corresponding to the target vehicle can be accurately generated based on the mixed sound effect resource files, thereby improving the realism of the sound with specific sound effects generated for the vehicle, and thereby improving the vehicle audio generation effect.

[0129] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by a computer program, or by controlling related hardware through a computer program. The computer program may be stored in a computer-readable storage medium and loaded and executed by a processor.

[0130] To this end, an embodiment of the present application provides a computer-readable storage medium storing a computer program that can be loaded by a processor to execute the steps of any of the audio generation methods provided in the embodiments of the present application. For example, the computer program can execute the following steps:

[0131] Obtaining a sound effect resource library, the sound effect resource library including sound effect resource files corresponding to various vehicle configuration information, the sound effect resource files being generated based on sounds with specific sound effects emitted by the vehicles under the vehicle configuration information, the sound effect resource files including multiple acoustic components and spectral parameters corresponding to the acoustic components;

[0132] Based on target vehicle configuration information of the target vehicle, determining at least two first sound effect resource files matching the target vehicle configuration information in a sound effect resource library;

[0133] Based on the spectrum parameters in at least two first sound effect resource files, the acoustic components in the first sound effect resource files are mixed to obtain a second sound effect resource file, so as to generate a target audio with a specific sound effect corresponding to the target vehicle based on the second sound effect resource file.

[0134] This solution can obtain a sound effect resource library, which includes sound effect resource files corresponding to multiple vehicle configuration information. The sound effect resource files are generated based on sounds with specific sound effects emitted by vehicles under the vehicle configuration information, and the sound effect resource files include multiple acoustic components and spectral parameters corresponding to the acoustic components. Based on the target vehicle configuration information of the target vehicle, at least two first sound effect resource files that match the target vehicle configuration information are determined in the sound effect resource library. Based on the spectral parameters in the at least two first sound effect resource files, the acoustic components in the first sound effect resource files are mixed to obtain a second sound effect resource file, and target audio with specific sound effects corresponding to the target vehicle is generated based on the second sound effect resource file. In this way, by determining at least two first sound effect resource files that match the target vehicle configuration information in the sound effect resource library, the acoustic components in the first sound effect resource files are mixed according to the spectral parameters in the first sound effect resource files, and the target audio with specific sound effects corresponding to the target vehicle can be accurately generated based on the mixed sound effect resource files, thereby improving the realism of the sound with specific sound effects generated for the vehicle and further improving the vehicle audio generation effect.

[0135] The specific implementation of the above operations can be found in the previous embodiments and will not be repeated here.

[0136] The computer-readable storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0137] Since the computer program stored in the computer-readable storage medium can execute the steps of any audio generation method provided in the embodiments of the present application, the beneficial effects that can be achieved by any audio generation method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.

[0138] Among them, according to one aspect of the present application, a computer program product is provided, which includes a computer program, and the computer program is stored in a computer-readable storage medium; when the processor of an electronic device reads the computer program from the computer-readable storage medium, the processor executes the computer program, so that the electronic device executes the methods provided in the various optional implementations provided in the above embodiments.

[0139] The above is a detailed introduction to an audio generation method, device, storage medium and electronic device provided in the embodiments of the present application. Specific examples are used herein to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. At the same time, for those skilled in the art, based on the ideas of the present application, there may be changes in the specific implementation methods and application scope. In summary, the content of this specification should not be understood as a limitation on the present application.

Claims

1. An audio generation method, characterized in that: include: Obtaining a sound effect resource library, the sound effect resource library including sound effect resource files corresponding to a plurality of vehicle configuration information, the sound effect resource files being generated based on sounds having specific sound effects emitted by vehicles corresponding to the vehicle configuration information, the sound effect resource files including a plurality of acoustic components and spectral parameters corresponding to the acoustic components; Based on target vehicle configuration information of a target vehicle, determining at least two first sound effect resource files matching the target vehicle configuration information in the sound effect resource library; Based on spectral parameters in at least two first sound effect resource files, acoustic components in the first sound effect resource files are mixed to obtain a second sound effect resource file, so as to generate target audio with the specific sound effect corresponding to the target vehicle based on the second sound effect resource file.

2. The audio generation method according to claim 1, wherein The method further comprises: Recording sounds with specific sound effects emitted by a vehicle under various vehicle configuration information to obtain vehicle audio corresponding to the vehicle under the various vehicle configuration information; Audio processing is performed on the vehicle audio of the vehicle to obtain multiple sound effect resource files of the vehicle under multiple vehicle configuration information.

3. The audio generation method according to claim 2, wherein: The recording of the sound with the specific sound effect emitted by the vehicle under various vehicle configuration information to obtain the vehicle audio corresponding to the vehicle under various vehicle configuration information includes: When the vehicle is in each vehicle configuration information, recording a sound emitted by the vehicle by a recording device provided at at least one position of the vehicle to obtain at least one recorded audio, and obtaining a vehicle audio corresponding to the vehicle in the vehicle configuration information based on the at least one recorded audio; The location includes at least one of an engine, an exhaust pipe, and an intake pipe in the vehicle.

4. The audio generation method according to claim 2, wherein: Each vehicle configuration information corresponds to a ventilation system of a certain specification, the ventilation system including at least one of an exhaust system and an intake system; recording sounds with specific sound effects emitted by the vehicle under the various vehicle configuration information to obtain vehicle audio corresponding to the vehicle under the various vehicle configuration information includes: The vehicle is replaced with ventilation systems of various specifications, and the vehicle is controlled to emit and record sounds with specific sound effects under each replaced ventilation system, so as to complete the recording of sounds with specific sound effects emitted by the vehicle under various vehicle configuration information and obtain the vehicle audio corresponding to the vehicle under various vehicle configuration information.

5. The audio generation method according to claim 2, wherein: The performing audio processing on the vehicle audio of the vehicle to obtain multiple sound effect resource files of the vehicle under multiple vehicle configuration information includes: performing audio separation processing on the vehicle audio to obtain multiple acoustic components; Performing spectrum analysis based on the acoustic components to obtain spectrum parameters; Based on the acoustic components and the spectrum parameters, a plurality of sound effect resource files of the vehicle under a plurality of vehicle configuration information are generated.

6. The audio generation method according to any one of claims 1 to 5, wherein: The sound effect resource file is further configured with an operating condition identifier, the operating condition identifier indicating an operating condition when the vehicle emits the sound used to generate the specific sound effect of the sound effect resource file; The determining, based on the target vehicle configuration information of the target vehicle, at least two first sound effect resource files matching the target vehicle configuration information in the sound effect resource library includes: Obtaining a target operating condition corresponding to the target vehicle; Based on the target operating condition and the target vehicle configuration information, at least two first sound effect resource files matching the target vehicle configuration information and the target operating condition are determined in the sound effect resource library.

7. The audio generation method according to any one of claims 1 to 5, characterized in that: The step of mixing the acoustic components in the at least two first sound effect resource files based on the spectrum parameters in the at least two first sound effect resource files to obtain the second sound effect resource file includes: Determining the frequency spectrum regions to be mixed and the mixing ratios of the first sound effect resource files; determining target acoustic components to be mixed for each of the first sound effect resource files based on the spectrum regions corresponding to the first sound effect resource files and the spectrum parameters corresponding to the acoustic components; The target acoustic components are mixed according to the mixing ratio to obtain a second sound effect resource file.

8. The audio generation method according to any one of claims 1 to 5, wherein: The step of mixing the acoustic components in the at least two first sound effect resource files based on the spectrum parameters in the at least two first sound effect resource files to obtain the second sound effect resource file includes: generating a spectrum analysis graph of the acoustic component based on the spectrum parameters corresponding to each acoustic component in each of the first sound effect resource files, wherein the spectrum analysis graph includes a plurality of acoustic feature components; Determining target acoustic characteristic components to be mixed in each of the acoustic components based on the spectrum analysis graph; The acoustic components in the first sound effect resource file are mixed based on the target acoustic feature component to obtain a second sound effect resource file.

9. An audio generating device, characterized in that: include: an acquisition unit, configured to acquire a sound effect resource library, the sound effect resource library including sound effect resource files corresponding to a plurality of vehicle configuration information, the sound effect resource files being generated based on sounds having specific sound effects emitted by vehicles corresponding to the vehicle configuration information, the sound effect resource files including a plurality of acoustic components and spectral parameters corresponding to the acoustic components; a determining unit, configured to determine, based on target vehicle configuration information of a target vehicle, at least two first sound effect resource files matching the target vehicle configuration information in the sound effect resource library; A mixing unit is used to mix the acoustic components in the first sound effect resource files based on the spectral parameters in at least two first sound effect resource files to obtain a second sound effect resource file, so as to generate a target audio with the specific sound effect corresponding to the target vehicle based on the second sound effect resource file.

10. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a computer program, and when the computer program is executed by the processor, the processor is enabled to perform the steps of any one of the methods of claims 1 to 8.

11. A computer-readable storage medium, characterized in that The method comprises a computer program. When the computer program is run on an electronic device, the computer program is used to enable the electronic device to execute the steps of any one of the methods of claims 1 to 8.

Images