Sound wave synthesis method and device, electronic equipment and storage medium

Abstract

The invention provides a sound synthesis method and device, electronic equipment and a storage medium. The method comprises the steps of obtaining sample audio data of a sample vehicle in different accelerator modes; according to multi-order main harmonic data corresponding to each sampling point in the sample audio data in each accelerator mode, particle extraction is carried out on the sample audio data in each accelerator mode, and a particle set in each accelerator mode is obtained; according to accelerator information of a target vehicle, particle matching is carried out in the particle set under all the accelerator modes, target particles under all the accelerator modes are obtained, and the target particles are particles matched with the accelerator information; and according to the accelerator information, performing interpolation fusion on the target particles in the plurality of accelerator modes to obtain a sound signal of the target vehicle. According to the method, sound wave synthesis is realized by carrying out particle splicing on real sound wave characteristics in different accelerator modes, and the dynamic nature and quality of sound wave synthesis are effectively improved.

Description

Technical Field

[0001] The present invention relates to the field of signal processing technology, and in particular to a sound wave synthesis method, device, electronic equipment and storage medium. Background Art

[0002] Under the current deployment of new energy strategies, new energy vehicles are gradually penetrating the existing internal combustion engine vehicle market; although, compared with internal combustion engine vehicles, new energy vehicles lack the sound signals caused by the internal combustion engine, resulting in poor accuracy of the driver's perception of vehicle speed, which in turn affects the vehicle's driving safety. Therefore, the sound synthesis of the internal combustion engine of new energy vehicles has become an important topic that urgently needs to be studied in this field.

[0003] In the related art, modeling and simulation are usually used to synthesize the sound waves of the internal combustion engine of new energy vehicles. However, this method is an approximate simulation of the real sample and has certain errors, which limits the quality of the synthesized sound wave signal. Summary of the invention

[0004] The present invention provides a sound wave synthesis method, device, electronic device and storage medium, which are used to solve the defect that the quality of the synthesized sound wave signal is limited when the sound wave synthesis of the internal combustion engine of the new energy vehicle is performed by modeling and simulation in the prior art, so as to improve the dynamics and quality of the sound wave synthesis.

[0005] The present invention provides a sound wave synthesis method, comprising: Obtain sample audio data of a sample vehicle in different throttle modes; According to the multi-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode, particle extraction is performed on the sample audio data under each throttle mode to obtain a particle set under each throttle mode; According to the throttle information of the target vehicle, particle matching is performed in the particle set under each throttle mode to obtain the target particle under each throttle mode, wherein the target particle is a particle matching the throttle information; According to the throttle information, multiple target particles in the throttle mode are interpolated and fused to obtain the sound signal of the target vehicle.

[0006] According to a sound wave synthesis method provided by the present invention, the sample audio data under each throttle mode is subjected to particle extraction according to the multi-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode to obtain a particle set under each throttle mode, including: For any of the sample audio data in the throttle mode, multi-order main harmonic data corresponding to each sampling point in the sample audio data is filtered out from the sample audio data to obtain a target signal; Determining, according to the order of the main harmonic data in the sample audio data, a segmentation code value corresponding to each signal segment in the target signal; According to the segmentation code value, performing particle extraction on each of the signal segments to obtain a particle set in the throttle mode corresponding to the sample audio data; The sample audio data under each of the throttle modes is looped to obtain a particle set under each of the throttle modes.

[0007] According to a sound wave synthesis method provided by the present invention, the particle extraction is performed on each of the signal segments according to the segmentation code value to obtain a particle set in the throttle mode corresponding to the sample audio data, including: In each of the signal segments, obtaining a target zero point whose position code value matches a segmentation code value corresponding to each of the signal segments; Taking each of the target zero points as a segmentation point, particle extraction is performed on each of the signal segments to obtain a particle set in the throttle mode corresponding to the sample audio data.

[0008] According to a sound wave synthesis method provided by the present invention, determining the segmentation code value corresponding to each signal segment according to the order of the main harmonic data in the sample audio data includes: Determining a segmentation code value corresponding to the first signal segment according to the order of the main harmonic data in the sample audio data; Determining the segmentation code value corresponding to each second signal segment according to the order of the main harmonic data in the sample audio data and the segmentation code value corresponding to the first signal segment; The first signal segment is the first signal segment among the multiple signal segments, and the second signal segment is the signal segment among the multiple signal segments except the first signal segment.

[0009] According to a sound wave synthesis method provided by the present invention, determining the segmentation code value corresponding to each second signal segment according to the order of the main harmonic data in the sample audio data and the segmentation code value corresponding to the first signal segment includes: For any of the second signal segments, determining a plurality of candidate segmentation code values ​​according to the order of the main harmonic data in the sample audio data; Acquire a first particle corresponding to each of the candidate segmentation code values; the first particle is a first particle formed by performing particle extraction on the second signal segment according to each of the candidate segmentation code values; Among the plurality of candidate segmentation code values, obtaining a target segmentation code value corresponding to a first particle having the highest correlation with a second particle; the second particle is the last particle in a signal segment previous to the second signal segment; Calculating a segmentation code value corresponding to the second signal segment according to the target segmentation code value and the segmentation code value corresponding to the first signal segment; Loop through each of the second signal segments to obtain a segmentation code value corresponding to each of the second signal segments.

[0010] According to a sound wave synthesis method provided by the present invention, according to the throttle information of the target vehicle, particle matching is performed in the particle set under each throttle mode to obtain the target particles under each throttle mode, including: Obtaining a first rotation speed corresponding to each particle in the particle set under each throttle mode according to fundamental frequency data corresponding to each sampling point in the sample audio data under each throttle mode; According to the throttle information, in a transmission simulation model, a second speed corresponding to the throttle information is simulated and obtained; In the particle set under each of the throttle modes, a particle corresponding to the first rotation speed having the highest matching degree with the second rotation speed is determined as a target particle under each of the throttle modes.

[0011] According to a sound wave synthesis method provided by the present invention, the target particles in the throttle mode are interpolated and merged according to the throttle information to obtain the sound wave signal of the target vehicle, including: According to the throttle information, in a transmission simulation model, a torque parameter corresponding to the throttle information is simulated and obtained; According to the torque parameter, interpolation processing is performed on a plurality of target particles in the throttle mode to obtain synthetic particles of a rotation speed corresponding to the torque parameter; The sound wave signal of the target vehicle is synthesized according to the synthesized particles.

[0012] According to a sound wave synthesis method provided by the present invention, the step of acquiring multi-order main harmonic data corresponding to each sampling point in the sample audio data under the throttle mode includes: Dividing each sampling point in the sample audio data in each throttle mode into a first sampling point or a second sampling point according to a preset interval; For any of the first sampling points, searching for the multi-order main harmonic data corresponding to the first sampling point in the frequency domain data sequence corresponding to the first sampling point according to the position information of the multi-order main harmonic data of the previous sampling point of the first sampling point; Traversing each of the first sampling points to obtain multi-order main harmonic data corresponding to each of the first sampling points; According to the multi-order main harmonic data corresponding to each of the first sampling points, interpolation estimation is performed on each of the second sampling points to obtain the multi-order main harmonic data corresponding to each of the second sampling points.

[0013] The present invention also provides a sound wave synthesis device, comprising: A data acquisition unit, used to acquire sample audio data of a sample vehicle in different throttle modes; a particle extraction unit, configured to perform particle extraction on the sample audio data under each throttle mode according to multi-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode, so as to obtain a particle set under each throttle mode; A particle matching unit, configured to perform particle matching in a particle set under each throttle mode according to the throttle information of the target vehicle, and obtain a target particle under each throttle mode, wherein the target particle is a particle matching the throttle information; The sound wave synthesis unit is used to interpolate and fuse the target particles in the plurality of throttle modes according to the throttle information to obtain the sound wave signal of the target vehicle.

[0014] The present invention also provides an electronic device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, any of the above-mentioned sound wave synthesis methods is implemented.

[0015] The present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the sound wave synthesis method as described above is implemented.

[0016] The present invention also provides a computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the sound wave synthesis method as described above is implemented.

[0017] The sound wave synthesis method, device, electronic device and storage medium provided by the present invention obtain real sample audio data of sample vehicles in different throttle modes, and then perform particle extraction on the sample audio data in each throttle mode to obtain more real and detailed sound wave characteristics in different throttle modes, and perform particle matching in the particle set in each throttle mode according to the throttle information of the target vehicle, and interpolate and fuse the target particles in multiple throttle modes according to the throttle information to seamlessly connect the particles in different throttle modes, thereby generating a continuous and natural sound wave signal, thereby realizing sound wave synthesis through real sound wave characteristics in different throttle modes, so that no matter how the vehicle state changes between idling, acceleration, deceleration, free sliding and other states, the synthesized sound wave signal can reflect the torque state and speed state of the internal combustion engine in real time and seamlessly, thereby effectively improving the dynamics and quality of sound wave synthesis. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions in the present invention or the prior art, the following briefly introduces the drawings required for use in the embodiments or the description of the prior art. Obviously, the drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0019] Figure 1 This is one of the flow charts of the sound wave synthesis method provided by the present invention.

[0020] Figure 2 It is a schematic diagram of the distribution of harmonic signals in the sample audio data provided by the present invention.

[0021] Figure 3 The second schematic flow chart of the sound wave synthesis method provided by the present invention.

[0022] Figure 4 It is a schematic diagram of the relative change relationship between the rotation speed and the vehicle speed under the 20% throttle state provided by the present invention.

[0023] Figure 5 It is a schematic diagram of the relative change relationship between the rotation speed and the vehicle speed under the 80% throttle state provided by the present invention.

[0024] Figure 6 It is a structural schematic diagram of the sound wave synthesis device provided by the present invention.

[0025] Figure 7 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0026] In order to make the purpose, technical solution and advantages of the present invention clearer, the technical solution of the present invention will be clearly and completely described below in conjunction with the drawings of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0027] Under the current deployment of new energy strategies, new energy vehicles are gradually penetrating the original internal combustion engine vehicle market, and many users will give priority to new energy vehicles. Compared with internal combustion engine vehicles, new energy vehicles use electric motor drive to avoid the noise introduced by the internal combustion engine. However, the noise of the internal combustion engine is also necessary. For example, new energy vehicles lack the sound wave signal caused by the internal combustion engine, which leads to the poor accuracy of the driver's perception of the vehicle speed, and it is easy to make the vehicle enter the speeding state while driving, thereby affecting the driving safety of the vehicle; for example, for professional racing drivers and drivers who want to experience the ultimate acceleration and speed of the car, the roar of the internal combustion engine can greatly enhance the driver's immersive driving experience. Therefore, the sound wave synthesis of the internal combustion engine of new energy vehicles has become an important topic that needs to be studied urgently in this field.

[0028] In common internal combustion engine sound synthesis technical solutions, modeling and simulation are usually used to synthesize the sound waves of the internal combustion engine of new energy vehicles. For example, in some technical solutions, physical model simulation is used to synthesize the sound waves of the internal combustion engine of new energy vehicles. This solution requires modeling of various components of the vehicle body, including but not limited to the internal combustion engine, exhaust pipe, transmission, etc., and debugging and optimization based on the vehicle model to ultimately achieve the synthesis of sound signals; for example, in some solutions, the order synthesis method is used to synthesize the sound waves of the internal combustion engine of new energy vehicles, specifically based on the simplified equivalent harmonic component superimposed noise engine sound modeling, and by designing multiple groups of filters to strengthen or weaken the order of harmonics in different frequency bands, so as to ultimately achieve the synthesis of sound signals.

[0029] However, this modeling and simulation method is essentially an approximate simulation of real samples (such as physical structures and engine signals), which has certain errors and limits the quality of the synthetic sound signal.

[0030] In this regard, some solutions provide a synthesis method based on splicing to synthesize the sound waves of the internal combustion engine of new energy vehicles; among them, the synthesis method based on splicing includes wavetable synthesis and particle synthesis. Both methods are based on the sound wave signal of the target vehicle model, and perform segmentation and splicing to realize the function of sound wave synthesis. Wavetable synthesis and particle synthesis are divided according to the length of segmentation and the difference in splicing method. The segmentation fragments of wavetable synthesis are generally 1~2s, and the splicing method will adopt synthesis methods such as simple vectorized interpolation and precise arithmetic interpolation. Particle synthesis fully considers the periodicity of the internal combustion engine noise signal itself, splits particles according to its own period, and each particle is generally 10~100ms. The overlap addition of the fundamental frequency synchronization with the window is used for sound wave synthesis. Although the synthesis method based on splicing has high real-time performance, this scheme needs to rely on multiple types of particles or wavetables to achieve high dynamics, and multiple types of particles or wavetables are difficult to obtain, and it is difficult to synthesize dynamic and high-quality sound wave signals.

[0031] Therefore, in response to the above problems, the present embodiment provides a sound synthesis method, which obtains the internal combustion engine control parameters through gear simulation, including but not limited to the internal combustion engine speed, throttle pedal opening, and vehicle speed, and integrates the internal combustion engine control parameter simulation and the audio particle extraction and splicing under different throttle modes to realize the real-time synthesis of the internal combustion engine sound signal, which can not only improve the synthesis efficiency, but also ensure that the output sound signal can respond quickly to changes in the throttle and brake speed, and has a smooth gear shift transition and can smoothly switch the gear shift logic in different throttle states, so that the synthesized sound signal is more dynamic and of higher quality.

[0032] Figure 1 It is one of the flow charts of the sound synthesis method provided by the present invention; the executor of the method is a sound synthesis device, which may be a vehicle-mounted controller built into the target vehicle for which sound synthesis is required, or an external control device external to the target vehicle for which sound synthesis is required, etc., and this embodiment does not make specific limitations on this.

[0033] like Figure 1 As shown, the method includes step 110 , step 120 , step 130 and step 140 .

[0034] Step 110 , obtaining sample audio data of a sample vehicle in different throttle modes.

[0035] Optionally, during the sound synthesis process, the real audio data emitted by the engine of a sample vehicle when running in different throttle modes can be recorded to obtain sample audio data under different throttle modes, so that subsequently, based on the sample audio data under different throttle modes, a very realistic engine sound can be automatically re-synthesized according to the throttle, brake and other information of the real vehicle for which sound synthesis is required, thereby reducing the complexity of sound synthesis while improving the dynamics and quality of sound synthesis.

[0036] The sample vehicles here are vehicles of various models equipped with internal combustion engines (hereinafter referred to as internal combustion engine vehicles); the throttle modes here include but are not limited to a throttle mode from stationary idling to large throttle acceleration (also called a high throttle mode) and a throttle mode for small throttle acceleration (also called a low throttle mode), which can be configured according to actual needs, and this embodiment does not specifically limit this.

[0037] Step 120 , performing particle extraction on the sample audio data under each throttle mode according to the multi-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode, to obtain a particle set under each throttle mode.

[0038] Optionally, after obtaining the sample audio data in each throttle mode, main harmonics can be extracted for each sampling point in the sample audio data in each throttle mode to obtain multi-order main harmonic data corresponding to each sampling point. The order of the main harmonic data here is the same as the number of cylinders of the sample vehicle. If the sample vehicle includes an engine with 12 cylinders, the corresponding main harmonic data order is also 12. The main harmonic data here includes but is not limited to frequency values ​​and position information, which are not specifically limited in this embodiment.

[0039] The main harmonic extraction method here includes: searching for the maximum energy value of the frequency domain data sequences corresponding to all sampling points one by one, and determining the multi-order main harmonic data corresponding to all sampling points according to the harmonic data corresponding to the maximum energy value found; or searching for the maximum energy value of the frequency domain data sequences corresponding to a part of the sampling points one by one, and determining the multi-order main harmonic data corresponding to the part of the sampling points according to the harmonic data corresponding to the maximum energy value found, and then, interpolating and acquiring the multi-order main harmonic data corresponding to other part of the sampling according to the multi-order main harmonic data corresponding to the part of the sampling points, which is not specifically limited in this embodiment.

[0040] After obtaining the multi-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode, particle extraction can be performed on the sample audio data under each throttle mode based on the multi-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode, so as to construct a particle set under each throttle mode based on the multiple particles extracted under each throttle mode.

[0041] It should be noted that if a particle contains more than two working cycles, then in the later synthesis, the problem of insufficient particle switching response and insufficient particle variability will be faced. If a particle is less than one working cycle, then in the later synthesis and splicing, the switching of particles will cause a large change in the audio base frequency, which will seriously damage the audio hearing. Therefore, in order to ensure the quality of sound wave synthesis, the particle extraction here is to split the sample audio data from the sample vehicle into multiple smaller audio clips, which are particles. In the splitting process, it is necessary to ensure that the basic period of each particle and the audio is the same, that is, the time length of each particle corresponds to a working cycle of the engine of the sample vehicle. For example, when extracting particles, multi-order main harmonic data can be filtered out from the sample audio data through a dynamic filter, and on this basis, the particle extraction is performed by finding the zero point to achieve phase alignment between particles.

[0042] After obtaining the particle set under each throttle mode, it can be stored in a particle storage module, so that when the sound wave is subsequently synthesized, the corresponding particles can be loaded and obtained in real time for the corresponding sound wave synthesis.

[0043] Step 130 , according to the throttle information of the target vehicle, particle matching is performed in the particle set under each throttle mode to obtain the target particle under each throttle mode, wherein the target particle is a particle matching the throttle information.

[0044] The throttle information here may be throttle information generated in one cycle, or may be throttle information generated in multiple cycles. To simplify the description, the throttle information generated in a single cycle is taken as an example to describe the method provided in this embodiment.

[0045] Optionally, after the particle collection in each throttle mode, the throttle information of the target vehicle may be obtained. The target vehicle here is a vehicle for which internal combustion engine sound synthesis is required, such as a new energy vehicle without an internal combustion engine. The throttle information here may be obtained by real-time perception of the target vehicle, or may be transmitted via other controls, which is not specifically limited in this embodiment; the throttle information includes but is not limited to the action parameters of the pedal, etc., which is not specifically limited in this embodiment.

[0046] After the throttle information of the target vehicle is obtained, the particle collection under each throttle mode can be loaded and obtained in the particle storage module, so as to match and obtain particles matching the throttle information of the target vehicle in the particle collection under each throttle mode as the target particles under each throttle mode. For example, the simulated speed value corresponding to the throttle information and the speed value corresponding to each particle can be calculated, so as to match the simulated speed value corresponding to the throttle information and the speed value corresponding to each particle, so as to determine the particle matching the throttle information of the target vehicle.

[0047] It should be noted that due to the different lengths of particles corresponding to different speeds, the digital signal processor (DSP) platform takes a long time to read particles from the particle storage module (such as flash). Therefore, the reading of a particle can also be divided into multiple readings, but each particle must be read out completely no matter how many times it is read, and other particles must not be switched in the middle.

[0048] Step 140: interpolate and fuse the target particles in the throttle mode according to the throttle information to obtain the sound signal of the target vehicle.

[0049] Optionally, after obtaining the target particles in each throttle mode, the target particles in multiple throttle modes can be interpolated and fused according to the throttle information to synthesize particles corresponding to the throttle information, and sound wave synthesis can be performed based on the synthesized particles to obtain a sound wave signal that dynamically matches the throttle information of the target vehicle. The sound wave signal can be a synthesized internal combustion engine sound; the sound of the exhaust pipe can also be synthesized in this way, which is not specifically described in this embodiment.

[0050] It should be noted that if it is necessary to synthesize the sound waves of the throttle information generated in multiple cycles, the synthetic particles corresponding to the throttle information generated in each cycle can be obtained in the above manner, and the synthetic particles corresponding to the throttle information generated in each cycle can be pushed into the particle queue, so as to splice the synthetic particles in the particle queue in the time domain order, and the corresponding complete synthesized sound wave signal can be obtained when the target vehicle is running in different cycles. It should be noted that after the sound wave signal playback is interrupted, the fixed-length audio output from the particle queue can be used to achieve effective playback of the sound wave signal.

[0051] The method provided in this embodiment obtains the real sample audio data of the sample vehicle under different throttle modes, and then performs particle extraction on the sample audio data under each throttle mode to obtain more realistic and detailed sound characteristics under different throttle modes, and performs particle matching in the particle set under each throttle mode according to the throttle information of the target vehicle, and interpolates and fuses the target particles under multiple throttle modes according to the throttle information to seamlessly connect the particles under different throttle modes, thereby generating a continuous and natural sound signal, thereby realizing sound synthesis through the real sound characteristics under different throttle modes, so that no matter how the vehicle state changes between idling, acceleration, deceleration, free sliding and other states, the synthesized sound signal can reflect the torque state and speed state of the internal combustion engine in real time and seamlessly, thereby effectively improving the dynamics and quality of sound synthesis.

[0052] In some embodiments, step 120 specifically includes: For any of the sample audio data in the throttle mode, multi-order main harmonic data corresponding to each sampling point in the sample audio data is filtered out from the sample audio data to obtain a target signal; Determining, according to the order of the main harmonic data in the sample audio data, a segmentation code value corresponding to each signal segment in the target signal; According to the segmentation code value, performing particle extraction on each of the signal segments to obtain a particle set in the throttle mode corresponding to the sample audio data; The sample audio data under each of the throttle modes is looped to obtain a particle set under each of the throttle modes.

[0053] Optionally, the following steps are performed for the sample audio data in any throttle mode to implement the particle set extraction in the throttle mode: In order to ensure smooth particle splicing and smooth transition, it is necessary to ensure that all particles start and end at a fixed phase of one of the cylinders' working cycles. Since the fundamental frequency of a single cylinder's vibration has been offset by multiple cylinders, assuming that the number of cylinders is N, after obtaining the Nth-order main harmonic data corresponding to each sampling point in the sample audio data in the throttle mode, the Nth-order main harmonic data can be filtered out from the sample audio data in the throttle mode according to the frequency in the Nth-order main harmonic data by applying a dynamic bandpass filter to obtain the target signal, which can be an approximate sine wave signal.

[0054] After acquiring the target signal, the amplitude value of the target signal can be detected to divide the target signal into multiple signal segments according to the amplitude of the target signal, such as discarding the weak part with an amplitude value less than the set value and acquiring the stronger part with an amplitude value greater than or equal to the set value to form multiple signal segments.

[0055] After acquiring multiple signal segments, the segmentation code value corresponding to each signal segment can be determined according to the order of the main harmonic data in the sample audio data; the segmentation code value here is used to identify the position information or characteristic information required to segment each signal segment.

[0056] The method for determining the segmentation coding values ​​corresponding to each signal segment here may be the same or different. For example, the order N of the main harmonic data in the sample audio data is multiplied by the preset variable value to obtain the segmentation coding values ​​corresponding to all signal segments. For another example, the order N of the main harmonic data in the sample audio data is multiplied by the preset variable value to obtain the segmentation coding values ​​corresponding to some signal segments. Based on the segmentation coding values ​​corresponding to the some signal segments and the order N of the main harmonic data in the sample audio data, the segmentation coding values ​​corresponding to another part of the signal segments are re-obtained. This embodiment does not specifically limit this.

[0057] The preset variable value here is a positive integer and changes adaptively within the set value range.

[0058] After obtaining the segmentation coding value corresponding to each signal segment, the particle segmentation point in each signal segment can be determined according to the segmentation coding value corresponding to each signal segment, and each signal segment can be divided into particles according to the particle segmentation point in each signal segment to obtain the particle set under the throttle mode.

[0059] For example, in some embodiments, after the segmentation code value corresponding to each signal segment is obtained, particle extraction may be performed according to the following steps: In each of the signal segments, obtaining a target zero point whose position code value matches a segmentation code value corresponding to each of the signal segments; Taking each of the target zero points as a segmentation point, particle extraction is performed on each of the signal segments to obtain a particle set in the throttle mode corresponding to the sample audio data.

[0060] Optionally, since the segmentation coding values ​​corresponding to each signal segment in the sample audio data under the throttle mode are different, when performing particle extraction, the target zero point whose position coding value matches the segmentation coding value corresponding to each signal segment can be matched in each signal segment, and the target zero point is used as the segmentation point to perform corresponding particle extraction on each signal segment, thereby obtaining particle subsets under different signal segments. The particle subsets under different signal segments are combined to obtain the particle set under the throttle mode.

[0061] For example, for the first signal segment of the sample audio data in the throttle mode, the corresponding segmentation code value is 2 N i, where , then take the second N i zero points (where i is a positive integer), these zero point positions are returned to the original audio, and the small segments divided by the zero points are the multiple particles obtained by dividing the first signal segment; for the jth signal segment except the first signal segment, its corresponding segmentation code value is 2 N i , is the target segmentation code value adaptively obtained for the jth signal segment, then the second N i Zero points are generated, and the positions of these zero points are returned to the original audio. The small segments divided by the zero points are the multiple particles obtained by dividing the jth signal segment.

[0062] According to the above particle extraction steps, the sample audio data under each throttle mode is traversed in a loop to obtain the particle set under each throttle mode.

[0063] The method provided in this embodiment can accurately segment signal segments and extract multiple phase-aligned particles by filtering out multi-order main harmonics, dividing different signal segments according to the orders of main harmonic data in different sample audio data, determining the coding values, and then taking the zero point to extract particles, thereby efficiently obtaining high-quality particle sets in each throttle mode to ensure smoothness when splicing particles, thereby improving the dynamics of sound wave synthesis.

[0064] In some embodiments, the step of determining the segmentation code value corresponding to each signal segment includes: Determining a segmentation code value corresponding to the first signal segment according to the order of the main harmonic data in the sample audio data; Determining the segmentation code value corresponding to each second signal segment according to the order of the main harmonic data in the sample audio data and the segmentation code value corresponding to the first signal segment; The first signal segment is the first signal segment among the multiple signal segments, and the second signal segment is the signal segment among the multiple signal segments except the first signal segment.

[0065] Optionally, the segmentation code values ​​corresponding to different signal segments may be determined by the following steps: For the first signal segment, i.e., the first signal segment, the segmentation code value corresponding to the first signal segment can be calculated according to the order of the main harmonic data in the sample audio data; for example, the order N of the main harmonic data in the sample audio data is multiplied by the preset variable value to obtain the segmentation code value C1 corresponding to the first signal segment, where the preset variable value is a positive integer and changes adaptively within the set value range. Accordingly, the segmentation code value C1 can be specifically expressed as C1=2 N i, where .

[0066] For the j-th signal segment after the first signal segment, that is, the second signal segment, the segmentation code value can be determined by combining the order of the main harmonic data in the sample audio data and the segmentation code value C1 corresponding to the first signal segment. For example, according to the order of the main harmonic data in the sample audio data, the corresponding target segmentation code value is adaptively determined for the j-th signal segment, and the target segmentation code value is combined with the segmentation code value C1 corresponding to the first signal segment to obtain the segmentation code value Cj corresponding to the j-th signal segment. Accordingly, the segmentation code value Cj can be specifically expressed as Cj=2 N i , is the target segmentation code value adaptively obtained for the j-th signal segment.

[0067] Exemplarily, in some embodiments, the specific acquisition of the target segmentation code value corresponding to the second signal segment includes: For any of the second signal segments, determining a plurality of candidate segmentation code values ​​according to the order of the main harmonic data in the sample audio data; Acquire a first particle corresponding to each of the candidate segmentation code values; the first particle is a first particle formed by performing particle extraction on the second signal segment according to each of the candidate segmentation code values; Among the plurality of candidate segmentation code values, obtaining a target segmentation code value corresponding to a first particle having the highest correlation with a second particle; the second particle is the last particle in a signal segment previous to the second signal segment; Calculating a segmentation code value corresponding to the second signal segment according to the target segmentation code value and the segmentation code value corresponding to the first signal segment; Loop through each of the second signal segments to obtain a segmentation code value corresponding to each of the second signal segments.

[0068] Optionally, for any second signal segment, the following steps are performed to obtain the segmentation code value: Determine multiple candidate segmentation code values ​​according to the order of the main harmonic data in the sample audio data, such as [0, (2 N-1)] as the candidate segmentation code value.

[0069] The segmentation code value is calculated according to each candidate segmentation code value, the second signal segment is subjected to particle extraction, and the first particle extracted from the second signal segment under each candidate segmentation code value is obtained as the first particle corresponding to each candidate segmentation code value.

[0070] In addition, the last particle extracted from the previous signal segment of the second signal segment is obtained as the second particle.

[0071] The first particles and the first particles corresponding to each candidate segmentation code value are cross-correlated and calculated, and the candidate segmentation code value corresponding to the first particle with the highest cross-correlation with the second particle is selected from multiple candidate segmentation code values ​​as the target segmentation code value corresponding to the second signal segment.

[0072] The target segmentation code value corresponding to the second signal segment is added to the segmentation code value corresponding to the first signal segment to obtain the segmentation code value corresponding to the second signal segment.

[0073] According to the above steps, each second signal segment is traversed and looped to obtain the segmentation code value corresponding to each second signal segment.

[0074] In summary, the method provided in this embodiment first calculates the segmentation coding value corresponding to the first signal segment according to the order of the main harmonic data in the sample audio data; then, for each second signal segment after the first signal segment, on the basis of considering the order of the main harmonic data, the segmentation coding value of the first signal segment and the mutual correlation between the segments are also combined to adaptively determine the segmentation coding value corresponding to each second signal segment, ensuring that the selected segmentation coding value is both related to the audio feature and maintains continuity, so that the signal segment can be accurately segmented and multiple phase-aligned particles can be extracted based on the segmentation coding value, thereby efficiently obtaining a high-quality particle set in each throttle mode to ensure the smoothness of the particle splicing, thereby improving the dynamics of the sound wave synthesis.

[0075] In some embodiments, step 130 specifically includes: Obtaining a first rotation speed corresponding to each particle in the particle set under each throttle mode according to fundamental frequency data corresponding to each sampling point in the sample audio data under each throttle mode; According to the throttle information, in a transmission simulation model, a second speed corresponding to the throttle information is simulated and obtained; In the particle set under each of the throttle modes, a particle corresponding to the first rotation speed having the highest matching degree with the second rotation speed is determined as a target particle under each of the throttle modes.

[0076] Figure 2 is a schematic diagram of the distribution of harmonic signals in the sample audio data provided by the present invention; Figure 3 This is the second flow chart of the sound wave synthesis method provided by the present invention.

[0077] It should be noted that, based on the superposition of mechanical vibrations of different cylinders, the main harmonic positions of the corresponding audios for different numbers and arrangements of cylinders can be obtained. If the cylinders are arranged vertically, the multi-cylinder audio is equivalent to the single-cylinder audio that is continuously shifted to the right according to the phase offset of the ignition and added to the resulting audio. Its effect is similar to a comb filter. If the cylinders are arranged in a V shape, then two components in the vertical and horizontal directions must be considered. Therefore, for multi-cylinder engines, no matter what the arrangement type is or how many cylinders the engine has, the fundamental frequency of the single-cylinder audio will basically be offset by the superposition of the audios of different cylinders, and the harmonics corresponding to the number of cylinders can basically not be offset. Figure 2 As shown, the engine of the sample vehicle is of V12 type, which includes a 12-cylinder engine, and the 12th harmonic corresponding to its sample audio data is one of the strongest harmonics.

[0078] Therefore, for a sample vehicle with N cylinders, in order to extract the fundamental frequency data corresponding to each sampling point in the sample audio data under each throttle mode and thus obtain its basic working cycle and speed, the N-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode can be first detected; then, the N-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode is divided by the number of cylinders N, so as to obtain the fundamental frequency data corresponding to each sampling point in the sample audio data under each throttle mode.

[0079] After obtaining the fundamental frequency data corresponding to each sampling point in the sample audio data under each throttle mode, the speed corresponding to each sampling point can be calculated based on the fundamental frequency data, such as by calculating the fundamental frequency data 2 Then, based on the speed corresponding to each sampling point, the first speed corresponding to each particle in the particle set under each throttle mode can be obtained.

[0080] After obtaining the first rotation speed corresponding to each particle in the particle set, the particles may be re-sorted in the order of the first rotation speeds, so as to call the subsequent sound wave information synthesis step.

[0081] In addition, if Figure 3 As shown, the throttle information of the target vehicle can also be input into the transmission simulation model, so that the transmission simulation model simulates the second speed corresponding to the throttle information. The transmission simulation model is a peripheral module that runs on a personal computer (PC) for demonstration.

[0082] The specific implementation method of simulating the second speed by the transmission simulation model includes the following: Figure 4 It is a schematic diagram of the relative change relationship between the rotation speed and the vehicle speed under the 20% throttle state provided by the present invention; Figure 5 is a schematic diagram of the relative change relationship between the rotation speed and the vehicle speed under the 80% throttle state provided by the present invention; wherein, Figure 4 and Figure 5 Where speed is the vehicle speed, rotatcSpeed ​​is the rotation speed, Gear1, Gear2, Gear3, Gear4, Gear5, and Gear6 represent different gears respectively; snowSpeedRpm, pedalMaxRpm, and minRpm represent the current speed, maximum throttle speed limit, and minimum speed limit respectively.

[0083] like Figure 4 and Figure 5 As shown in the figure, the transmission simulation model is designed entirely based on the actual vehicle transmission as the simulation object. The vehicle speed and rotation speed of each gear are completely proportional, with only a multiple difference. Therefore, the core point of the transmission simulation model lies in the shifting strategy and shifting transition. The principle of designing the shifting strategy is that the greater the throttle, the more it tends to use a low gear to obtain higher acceleration. The smaller the throttle, the more it tends to use a higher gear to make the engine run in a more economical and comfortable speed range. When the gear ratio of each gear of the transmission is known, the known gear shift is equivalent to the known speed during the gear shift, and the mapping of speed to gear can be calculated in real time at different throttles.

[0084] Therefore, if Figure 3As shown, the first implementation method of the transmission simulation model to simulate the second speed includes: the transmission simulation model has a built-in speed simulation module and a gear logic simulation module; wherein the speed simulation module is used to simulate the speed information of the target vehicle according to the throttle information; the gear logic simulation module is used to simulate the gear information of the target vehicle according to the throttle information, and the specific method is: first set a mapping method from the throttle size to the maximum speed under this throttle state, such as linear mapping. After obtaining the vehicle speed, calculate the corresponding speed values ​​when all six gears are engaged, then eliminate the gears that do not meet the maximum speed limit of the throttle, and then eliminate the gears that do not meet the minimum speed limit, and take the smallest gear among the remaining gears. In addition, the speed simulation module is also used to simulate and generate the speed of the internal combustion engine according to the vehicle speed information and the gear information, that is, the second speed.

[0085] In addition, the second implementation method of the transmission simulation model to simulate the second speed includes: the transmission simulation model can directly use the throttle size To determine the engine speed when the transmission shifts up , that is, according to the mapping relationship between throttle information and speed, the speed of the internal combustion engine is simulated. The specific calculation formula is as follows: ; Among them, the throttle size It is the data normalized to between 0 and 1. b is the basic speed of the internal combustion engine. This speed satisfies that after all gears are shifted up at this speed, the speed of the internal combustion engine at the next gear at the same speed is greater than the idle speed of the internal combustion engine, and the minimum value is taken when this condition is met. is the maximum speed of the internal combustion engine.

[0086] After obtaining the second speed corresponding to the throttle information and the first speed corresponding to each particle, the particle splicing module is called to load the particle sets under each throttle mode, and in the particle sets under each throttle mode, a particle corresponding to the first speed with the highest matching degree with the second speed corresponding to the throttle information is determined and read out as the target particle matching the throttle information under each throttle mode, so as to interpolate and fuse the target particles matching the throttle information under each throttle mode according to the specific throttle information to synthesize the corresponding sound wave signal.

[0087] The method provided in this embodiment obtains the first speed corresponding to each particle by substituting the fundamental frequency data of the sampling point in the sample audio data under each throttle mode, and then simulates the corresponding second speed in the transmission simulation model based on the throttle information. Finally, the particle corresponding to the first speed with the highest matching degree with the second speed is determined as the target particle in the particle set under each throttle mode. Through physical simulation and particle matching, it is ensured that when the throttle changes in the later splicing stage, the throttle change not only indirectly affects the speed and then affects the audio through the speed, but also can immediately experience the timbre change after the engine power changes, thereby improving the dynamics and quality of the sound wave synthesis.

[0088] In some embodiments, step 140 specifically includes: According to the throttle information, in a transmission simulation model, a torque parameter corresponding to the throttle information is simulated and obtained; According to the torque parameter, interpolation processing is performed on a plurality of target particles in the throttle mode to obtain synthetic particles of a rotation speed corresponding to the torque parameter; The sound wave signal of the target vehicle is synthesized according to the synthesized particles.

[0089] Optionally, the throttle information is input into a transmission simulation model, so that the transmission simulation model can simulate and obtain torque parameters corresponding to the throttle information.

[0090] For example, the transmission simulation model can first simulate the throttle size The relationship between the throttle information and the power P is used to obtain the power corresponding to the throttle information. Then, the power corresponding to the throttle information is divided by the speed corresponding to the throttle information to obtain the torque parameter corresponding to the throttle information. The relationship between and power P can be realized by the following formula: ; in, It is a value between 0 and 1. Its design principle is mainly to meet the principle that the throttle is proportional to the power, and the power increases faster at the initial stage of the throttle increase. That is, when n is small, the power increases faster at the initial stage of the throttle increase; when n is large, the effect of the throttle increase on the power increase is more stable.

[0091] In the process of sound wave synthesis, since the number of target particles in different throttle modes is the same, and under the same speed, the length of the target particle fragments in the two throttle modes is the same. Therefore, in the process of dynamic changes of the vehicle, the target particles in each throttle mode can be obtained from the particle set in each throttle mode according to the speed, and then according to the torque parameter, the target particles in multiple throttle modes are interpolated to obtain the synthetic particles of the speed corresponding to the torque parameter, and then the sound wave signal of the target vehicle is synthesized based on the synthetic particles, so that no matter how the vehicle state changes between idling, acceleration, deceleration, free sliding and other states, the synthesized sound wave signal can reflect the torque state and speed state of the internal combustion engine in real time and seamlessly, thereby improving the dynamics and quality of sound wave synthesis.

[0092] In some embodiments, the step of acquiring the multi-order main harmonic data corresponding to each sampling point in the sample audio data in the throttle mode includes: Dividing each sampling point in the sample audio data in each throttle mode into a first sampling point or a second sampling point according to a preset interval; For any of the first sampling points, searching for the multi-order main harmonic data corresponding to the first sampling point in the frequency domain data sequence corresponding to the first sampling point according to the position information of the multi-order main harmonic data of the previous sampling point of the first sampling point; Traversing each of the first sampling points to obtain multi-order main harmonic data corresponding to each of the first sampling points; According to the multi-order main harmonic data corresponding to each of the first sampling points, interpolation estimation is performed on each of the second sampling points to obtain the multi-order main harmonic data corresponding to each of the second sampling points.

[0093] It should be noted that, in the process of harmonic data extraction, in order to simplify the calculation amount of harmonic data extraction, each sampling point in the sample audio data under each throttle mode can be divided into a first sampling point or a second sampling point according to a preset interval. The preset interval can be set according to actual needs, such as taking every 4800 sampling points as an interval, so as to determine a first sampling point every 4800 sampling points, and extract the main harmonic data for the first sampling point once, and for other sampling points, that is, the second sampling points, the main harmonic data corresponding to each of them is estimated by interpolation calculation.

[0094] Optionally, for any first sampling point, the following steps are performed to implement harmonic data extraction: In the sample audio data, a time domain data sequence corresponding to the sampling point is obtained; a frequency domain transformation algorithm, such as a short-time Fourier transform algorithm, is used to perform a frequency domain transformation on the time domain data sequence corresponding to the first sampling point to obtain a frequency domain data sequence corresponding to the first sampling point. The parameters in the frequency domain transformation algorithm can be set according to actual needs, such as the basic audio sampling rate is 48K and the window length is 65536.

[0095] Subsequently, using the historical main harmonic results as historical prior information, the data corresponding to the new energy maximum value is obtained at a position near the energy maximum value corresponding to the historical main harmonic results in the frequency domain data sequence corresponding to the first sampling point as the multi-order main harmonic data corresponding to the first sampling point. Specifically, according to the position information of the multi-order main harmonic data of the previous sampling point of the first sampling point, the target search range is determined, and within the target search range in the frequency domain data sequence corresponding to the first sampling point, the data corresponding to the energy maximum value is searched and obtained as the multi-order main harmonic data corresponding to the first sampling point.

[0096] By traversing and looping through each first sampling point, the multi-order main harmonic data corresponding to each first sampling point can be obtained.

[0097] In addition, since the changes in main harmonic data between adjacent sampling points have certain similarities, in order to simplify the calculation, each second sampling point can be interpolated and estimated based on the multi-order main harmonic data corresponding to each first sampling point to obtain the multi-order main harmonic data corresponding to the second sampling point.

[0098] In summary, through the above steps, it is possible to efficiently and accurately obtain multi-order main harmonic data corresponding to all sampling points while reducing the amount of calculation.

[0099] The sound wave synthesis device provided by the present invention is described below. The sound wave synthesis device described below and the sound wave synthesis method described above can be referred to each other.

[0100] Figure 6 Schematic diagram of the structure of the sound wave synthesis device provided by the present invention; Figure 6 As shown, the device comprises: The data acquisition unit 610 is used to acquire sample audio data of a sample vehicle in different throttle modes; The particle extraction unit 620 is used to perform particle extraction on the sample audio data under each throttle mode according to the multi-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode, so as to obtain a particle set under each throttle mode; The particle matching unit 630 is used to perform particle matching in the particle set under each throttle mode according to the throttle information of the target vehicle, and obtain the target particle under each throttle mode, wherein the target particle is a particle matching the throttle information; The sound wave synthesis unit 640 is used to interpolate and fuse multiple target particles in the throttle mode according to the throttle information to obtain the sound wave signal of the target vehicle.

[0101] The device provided in this embodiment obtains the real sample audio data of the sample vehicle under different throttle modes, and then performs particle extraction on the sample audio data under each throttle mode to obtain more realistic and detailed sound characteristics under different throttle modes, and performs particle matching in the particle set under each throttle mode according to the throttle information of the target vehicle, and interpolates and fuses the target particles under multiple throttle modes according to the throttle information to seamlessly connect the particles under different throttle modes, thereby generating a continuous and natural sound signal, thereby realizing sound synthesis through the real sound characteristics under different throttle modes, so that no matter how the vehicle state changes between idling, acceleration, deceleration, free sliding and other states, the synthesized sound signal can reflect the torque state and speed state of the internal combustion engine in real time and seamlessly, thereby effectively improving the dynamics and quality of sound synthesis.

[0102] In some embodiments, the particle extraction unit is specifically configured to: For any of the sample audio data in the throttle mode, multi-order main harmonic data corresponding to each sampling point in the sample audio data is filtered out from the sample audio data to obtain a target signal; Determining, according to the order of the main harmonic data in the sample audio data, a segmentation code value corresponding to each signal segment in the target signal; According to the segmentation code value, performing particle extraction on each of the signal segments to obtain a particle set in the throttle mode corresponding to the sample audio data; The sample audio data under each of the throttle modes is looped to obtain a particle set under each of the throttle modes.

[0103] In some embodiments, the particle extraction unit is further configured to: In each of the signal segments, obtaining a target zero point whose position code value matches a segmentation code value corresponding to each of the signal segments; Taking each of the target zero points as a segmentation point, particle extraction is performed on each of the signal segments to obtain a particle set in the throttle mode corresponding to the sample audio data.

[0104] In some embodiments, the particle extraction unit is further configured to: Determining a segmentation code value corresponding to the first signal segment according to the order of the main harmonic data in the sample audio data; Determining the segmentation code value corresponding to each second signal segment according to the order of the main harmonic data in the sample audio data and the segmentation code value corresponding to the first signal segment; The first signal segment is the first signal segment among the multiple signal segments, and the second signal segment is the signal segment among the multiple signal segments except the first signal segment.

[0105] In some embodiments, the particle extraction unit is further configured to: For any of the second signal segments, determining a plurality of candidate segmentation code values ​​according to the order of the main harmonic data in the sample audio data; Acquire a first particle corresponding to each of the candidate segmentation code values; the first particle is a first particle formed by performing particle extraction on the second signal segment according to each of the candidate segmentation code values; Among the plurality of candidate segmentation code values, obtaining a target segmentation code value corresponding to a first particle having the highest correlation with a second particle; the second particle is the last particle in a signal segment previous to the second signal segment; Calculating a segmentation code value corresponding to the second signal segment according to the target segmentation code value and the segmentation code value corresponding to the first signal segment; Loop through each of the second signal segments to obtain a segmentation code value corresponding to each of the second signal segments.

[0106] In some embodiments, the particle matching unit is specifically used to: Obtaining a first rotation speed corresponding to each particle in the particle set under each throttle mode according to fundamental frequency data corresponding to each sampling point in the sample audio data under each throttle mode; According to the throttle information, in a transmission simulation model, a second speed corresponding to the throttle information is simulated and obtained; In the particle set under each of the throttle modes, a particle corresponding to the first rotation speed having the highest matching degree with the second rotation speed is determined as a target particle under each of the throttle modes.

[0107] In some embodiments, the sound wave synthesis unit is specifically used to: According to the throttle information, in a transmission simulation model, a torque parameter corresponding to the throttle information is simulated and obtained; According to the torque parameter, interpolation processing is performed on a plurality of target particles in the throttle mode to obtain synthetic particles of a rotation speed corresponding to the torque parameter; The sound wave signal of the target vehicle is synthesized according to the synthesized particles.

[0108] In some embodiments, the data acquisition unit is specifically configured to: Dividing each sampling point in the sample audio data in each throttle mode into a first sampling point or a second sampling point according to a preset interval; For any of the first sampling points, searching for the multi-order main harmonic data corresponding to the first sampling point in the frequency domain data sequence corresponding to the first sampling point according to the position information of the multi-order main harmonic data of the previous sampling point of the first sampling point; Traversing each of the first sampling points to obtain multi-order main harmonic data corresponding to each of the first sampling points; According to the multi-order main harmonic data corresponding to each of the first sampling points, interpolation estimation is performed on each of the second sampling points to obtain the multi-order main harmonic data corresponding to each of the second sampling points.

[0109] The device provided by the present invention is used to execute the above-mentioned method embodiments. Please refer to the above-mentioned embodiments for the specific processes and detailed contents, which will not be repeated here.

[0110] Figure 7 An example of a physical structure diagram of an electronic device is shown in FIG. Figure 7 As shown, the electronic device may include: a processor 710, a communication interface 720, a memory 730 and a communication bus 740, wherein the processor 710, the communication interface 720 and the memory 730 communicate with each other through the communication bus 740. The processor 710 may call the logic instructions in the memory 730 to execute the sound wave synthesis method, which includes: obtaining sample audio data of a sample vehicle in different throttle modes; performing particle extraction on the sample audio data in each throttle mode according to the multi-order main harmonic data corresponding to each sampling point in the sample audio data in each throttle mode to obtain a particle set in each throttle mode; performing particle matching in the particle set in each throttle mode according to the throttle information of the target vehicle to obtain a target particle in each throttle mode, wherein the target particle is a particle matching the throttle information; performing interpolation fusion on multiple target particles in the throttle mode according to the throttle information to obtain a sound wave signal of the target vehicle.

[0111] In addition, the logic instructions in the above-mentioned memory 730 can be implemented in the form of a software functional unit and can be stored in a computer-readable storage medium when it is sold or used as an independent product. Based on this understanding, the technical solution of the present invention can be essentially or partly embodied in the form of a software product that contributes to the prior art. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in each embodiment of the present invention. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM, Read-Only Memory), random access memory (RAM, Random Access Memory), disk or optical disk, etc. Various media that can store program codes.

[0112] On the other hand, the present invention also provides a computer program product, which includes a computer program. The computer program can be stored on a non-transitory computer-readable storage medium. When the computer program is executed by a processor, the computer can execute the sound synthesis method provided by the above methods, which includes: obtaining sample audio data of a sample vehicle under different throttle modes; performing particle extraction on the sample audio data under each throttle mode according to the multi-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode to obtain a particle set under each throttle mode; performing particle matching in the particle set under each throttle mode according to the throttle information of the target vehicle to obtain a target particle under each throttle mode, wherein the target particle is a particle matching the throttle information; performing interpolation fusion on multiple target particles under the throttle mode according to the throttle information to obtain the sound signal of the target vehicle.

[0113] On the other hand, the present invention also provides a non-transitory computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, is implemented to execute the sound synthesis method provided by the above-mentioned methods, the method comprising: obtaining sample audio data of a sample vehicle under different throttle modes; performing particle extraction on the sample audio data under each throttle mode according to multi-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode to obtain a particle set under each throttle mode; performing particle matching in the particle set under each throttle mode according to throttle information of a target vehicle to obtain a target particle under each throttle mode, the target particle being a particle matching the throttle information; performing interpolation fusion on a plurality of target particles under the throttle modes according to the throttle information to obtain a sound signal of the target vehicle.

[0114] The device embodiments described above are merely illustrative, wherein the units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. Ordinary technicians in this field can understand and implement it without paying creative labor.

[0115] Through the description of the above implementation methods, those skilled in the art can clearly understand that each implementation method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be implemented by hardware. Based on this understanding, the above technical solution is essentially or the part that contributes to the prior art can be embodied in the form of a software product, and the computer software product can be stored in a computer-readable storage medium, such as ROM / RAM, a disk, an optical disk, etc., including a number of instructions for a computer device (which can be a personal computer, a server, or a network device, etc.) to execute the methods described in each embodiment or some parts of the embodiments.

[0116] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it. Although the present invention has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims

1. A sound wave synthesis method, characterized in that: include: Obtain sample audio data of a sample vehicle in different throttle modes; According to the multi-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode, particle extraction is performed on the sample audio data under each throttle mode to obtain a particle set under each throttle mode; According to the throttle information of the target vehicle, particle matching is performed in the particle set under each throttle mode to obtain the target particle under each throttle mode, wherein the target particle is a particle matching the throttle information; According to the throttle information, multiple target particles in the throttle mode are interpolated and fused to obtain the sound signal of the target vehicle.

2. The sound wave synthesis method according to claim 1, characterized in that: The particle extraction is performed on the sample audio data under each throttle mode according to the multi-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode to obtain the particle set under each throttle mode, including: For any sample audio data in the throttle mode, multi-order main harmonic data corresponding to each sampling point in the sample audio data is filtered out from the sample audio data to obtain a target signal; Determining the segmentation code value corresponding to each signal segment in the target signal according to the order of the main harmonic data in the sample audio data; According to the segmentation code value, performing particle extraction on each of the signal segments to obtain a particle set in the throttle mode corresponding to the sample audio data; The sample audio data under each of the throttle modes is looped to obtain a particle set under each of the throttle modes.

3. The sound wave synthesis method according to claim 2, characterized in that: The step of performing particle extraction on each of the signal segments according to the segmentation code value to obtain a particle set in the throttle mode corresponding to the sample audio data includes: In each of the signal segments, obtaining a target zero point whose position code value matches a segmentation code value corresponding to each of the signal segments; Taking each of the target zero points as a segmentation point, particle extraction is performed on each of the signal segments to obtain a particle set in the throttle mode corresponding to the sample audio data.

4. The sound wave synthesis method according to claim 2, characterized in that: The step of determining the segmentation code value corresponding to each of the signal segments according to the order of the main harmonic data in the sample audio data comprises: Determining a segmentation code value corresponding to the first signal segment according to the order of the main harmonic data in the sample audio data; Determining the segmentation code value corresponding to each second signal segment according to the order of the main harmonic data in the sample audio data and the segmentation code value corresponding to the first signal segment; The first signal segment is the first signal segment among the multiple signal segments, and the second signal segment is the signal segment among the multiple signal segments except the first signal segment.

5. The sound wave synthesis method according to claim 4, characterized in that: The determining, according to the order of the main harmonic data in the sample audio data and the segmentation code value corresponding to the first signal segment, the segmentation code value corresponding to each second signal segment comprises: For any of the second signal segments, determining a plurality of candidate segmentation code values ​​according to the order of the main harmonic data in the sample audio data; Acquire a first particle corresponding to each of the candidate segmentation code values; the first particle is a first particle formed by performing particle extraction on the second signal segment according to each of the candidate segmentation code values; Among the plurality of candidate segmentation code values, obtaining a target segmentation code value corresponding to a first particle having the highest correlation with a second particle; the second particle is the last particle in a signal segment previous to the second signal segment; Calculating a segmentation code value corresponding to the second signal segment according to the target segmentation code value and the segmentation code value corresponding to the first signal segment; Loop through each of the second signal segments to obtain a segmentation code value corresponding to each of the second signal segments.

6. The sound wave synthesis method according to any one of claims 1 to 5, characterized in that: According to the throttle information of the target vehicle, performing particle matching in the particle set under each throttle mode to obtain the target particles under each throttle mode includes: Obtaining a first rotation speed corresponding to each particle in the particle set under each throttle mode according to fundamental frequency data corresponding to each sampling point in the sample audio data under each throttle mode; According to the throttle information, in a transmission simulation model, a second speed corresponding to the throttle information is simulated and obtained; In the particle set under each of the throttle modes, a particle corresponding to the first rotation speed having the highest matching degree with the second rotation speed is determined as a target particle under each of the throttle modes.

7. The sound wave synthesis method according to any one of claims 1 to 5, characterized in that: The interpolation and fusion of the target particles in the throttle mode are performed according to the throttle information to obtain the sound signal of the target vehicle, including: According to the throttle information, in a transmission simulation model, a torque parameter corresponding to the throttle information is simulated and obtained; According to the torque parameter, interpolation processing is performed on a plurality of target particles in the throttle mode to obtain synthetic particles of a rotation speed corresponding to the torque parameter; The sound wave signal of the target vehicle is synthesized according to the synthesized particles.

8. The sound wave synthesis method according to any one of claims 1 to 5, characterized in that: The step of acquiring the multi-order main harmonic data corresponding to each sampling point in the sample audio data under the throttle mode comprises: Dividing each sampling point in the sample audio data in each throttle mode into a first sampling point or a second sampling point according to a preset interval; For any of the first sampling points, searching for the multi-order main harmonic data corresponding to the first sampling point in the frequency domain data sequence corresponding to the first sampling point according to the position information of the multi-order main harmonic data of the previous sampling point of the first sampling point; Traversing each of the first sampling points to obtain multi-order main harmonic data corresponding to each of the first sampling points; According to the multi-order main harmonic data corresponding to each of the first sampling points, interpolation estimation is performed on each of the second sampling points to obtain the multi-order main harmonic data corresponding to each of the second sampling points.

9. A sound wave synthesis device, characterized in that: include: A data acquisition unit, used to acquire sample audio data of a sample vehicle in different throttle modes; a particle extraction unit, configured to perform particle extraction on the sample audio data under each throttle mode according to multi-order main harmonic data corresponding to each sampling point in the sample audio data under each throttle mode, so as to obtain a particle set under each throttle mode; A particle matching unit, configured to perform particle matching in a particle set under each throttle mode according to the throttle information of the target vehicle, and obtain a target particle under each throttle mode, wherein the target particle is a particle matching the throttle information; The sound wave synthesis unit is used to interpolate and fuse the target particles in the plurality of throttle modes according to the throttle information to obtain the sound wave signal of the target vehicle.

10. An electronic device comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein: When the processor executes the program, the sound wave synthesis method as claimed in any one of claims 1 to 8 is implemented.

11. A non-transitory computer-readable storage medium having a computer program stored thereon, characterized in that: When the computer program is executed by a processor, the sound wave synthesis method according to any one of claims 1 to 8 is implemented.

Images