Sound wave control method, device and system and vehicle

By obtaining the target sound source components in new energy vehicles and dynamically modulating them according to vehicle driving parameters, and generating and playing simulated engine sound wave signals, the problem of missing acoustic feedback in new energy vehicles is solved, and driving fun and driving experience are improved.

CN120287975APending Publication Date: 2025-07-11XIAOMI EV TECH CO LTD +3
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202510561016.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2025-04-29
Publication Date
2025-07-11

AI Technical Summary

Technical Problem

Because the powertrain of new energy vehicles has become a motor system with less noise, it lacks acoustic feedback on driving status during driving, which cannot meet the driver's driving pleasure and social needs.

Method used

By obtaining the target sound source component corresponding to the user's needs, dynamically modulate according to the vehicle driving parameters, a simulated engine sound wave signal is generated, and output to the speaker in the vehicle cockpit to play.

Benefits of technology

实现了根据用户需求和车辆状态动态调整的模拟声浪,增强驾驶感受,适应多样化驾驶场景,增加驾驶乐趣。

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN120287975A_ABST
    Figure CN120287975A_ABST
Patent Text Reader

Abstract

The invention relates to a sound wave control method, device and system and a vehicle, and the sound wave control method comprises the steps: obtaining a target sound source assembly corresponding to a user demand, obtaining an audio signal according to the target sound source assembly, carrying out the dynamic modulation of the audio signal according to a vehicle driving parameter, obtaining a target sound wave signal, and transmitting the target sound wave signal to the vehicle. And outputting the target sound wave signal. According to the invention, the corresponding target sound source assembly is obtained according to the user demand, free configuration of the target sound source assembly is realized, and customized sound playing by the user according to the demand is realized; besides, in the vehicle driving process, the audio signals obtained through free combination are dynamically modulated based on the user requirements and the vehicle driving parameters, so that the finally formed target sound signals are dynamically adjusted along with the vehicle driving state, the method is suitable for diversified scenes in the driving process, and the driving pleasure is increased.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the technical field of vehicles, and in particular, to a sound wave control method, device, system, and vehicle. Background Art

[0002] Compared with traditional internal combustion engine vehicles, the powertrain of new energy vehicles is an electric motor system with less noise, making the vehicle relatively quiet during driving. The lack of acoustic feedback in the driving state may not meet the driving pleasure needs and driving social needs of some drivers.

[0003] To make up for this lack, it is proposed to simulate sound waves in new energy vehicles, that is, to monitor signals such as throttle opening, engine speed, and torque in real time, and create a more pure engine noise by simulating the engine sound wave to enhance the driving experience. However, when simulating the engine sound wave, it is necessary to use pre-recorded corresponding sound wave materials, making it difficult to adapt to the diverse scenarios during vehicle driving and the changing needs of users. Summary of the Invention

[0004] To overcome the problems existing in the related art, the present disclosure provides a sound wave control method, device, system, and vehicle.

[0005] According to a first aspect of an embodiment of the present disclosure, a sound wave control method is provided, including:

[0006] Obtain a target sound source component corresponding to user needs, and obtain an audio signal according to the target sound source component;

[0007] Dynamically modulate the audio signal according to vehicle driving parameters to obtain a target sound wave signal;

[0008] Output the target sound wave signal.

[0009] In some possible implementation manners, the obtaining a target sound source component corresponding to user needs and obtaining an audio signal according to the target sound source component include:

[0010] Obtain a single target sound source component or multiple target sound source components corresponding to the user needs from a component library;

[0011] When the multiple target sound source components are obtained, combine the multiple target sound source components in series or by superposition to obtain the audio signal;

[0012] When the single target sound source component is obtained, obtain the audio signal according to the single target sound source component.

[0013] In some possible embodiments, after obtaining a target sound source component corresponding to user requirements and obtaining an audio signal according to the target sound source component, the method includes:

[0014] Based on the user requirements and the number of playback devices, determine to perform split-track processing and / or merge-track processing on the audio signal;

[0015] Call a split-track component and / or a merge-track component from the component library to perform split-track processing and / or merge-track processing on the audio signal to obtain the processed audio signal;

[0016] The performing dynamic modulation on the audio signal according to vehicle driving parameters to obtain a target sound wave signal includes:

[0017] Perform dynamic modulation on the processed audio signal according to vehicle driving parameters to obtain the target sound wave signal.

[0018] In some possible embodiments, the performing dynamic modulation on the audio signal according to vehicle driving parameters to obtain a target sound wave signal includes:

[0019] Perform amplitude modulation processing and / or frequency modulation processing on the audio signal according to the real-time vehicle driving parameters to obtain the target sound wave signal.

[0020] In some possible embodiments, performing amplitude modulation processing on the audio signal according to the real-time vehicle driving parameters includes:

[0021] According to the correspondence between preset vehicle driving parameters and amplitude curves, determine the amplitude range in the amplitude curve corresponding to the current vehicle driving parameters; wherein, each vehicle driving parameter corresponds to an amplitude range;

[0022] According to the left and right endpoint values of the amplitude range corresponding to the real-time vehicle driving parameters, determine a target loudness value, wherein the left and right endpoint values correspond to loudness values;

[0023] Perform amplitude modulation processing on the audio signal according to the target loudness value.

[0024] In some possible embodiments, performing frequency modulation processing on the audio signal according to the real-time vehicle driving parameters includes:

[0025] According to the correspondence between preset vehicle speed and loudness change speed, determine the target loudness change speed corresponding to the real-time vehicle speed;

[0026] According to the correspondence between preset vehicle motor speed and frequency change speed, determine the target frequency change speed corresponding to the real-time vehicle motor speed;

[0027] Determine the phase difference to be frequency-shifted according to the real-time frequency of the audio signal, the target frequency of the audio signal, the target loudness change speed, and the target frequency change speed;

[0028] Perform frequency modulation processing on the audio signal according to the current frequency of the audio signal and the phase difference to be frequency-shifted.

[0029] In some possible implementation manners, the calling a split-track component from the component library to perform split-track processing on the audio signal to obtain the processed audio signal includes:

[0030] Determine the amplitude of each harmonic corresponding to the real-time vehicle speed according to the mapping relationship between the preset vehicle speed and the amplitude of the harmonic;

[0031] Determine the target frequency conversion rate corresponding to the real-time motor speed according to the mapping relationship between the preset motor speed and the frequency conversion rate;

[0032] Perform split-track processing on the audio signal according to the amplitude of each harmonic and the target frequency conversion rate to obtain a plurality of single-track audio signals, where the processed audio signal includes the plurality of single-track audio signals.

[0033] In some possible implementation manners, the calling a combining-track component from the component library to perform combining-track processing on the audio signal to obtain the processed audio signal includes:

[0034] Perform combining-track processing on the plurality of single-track audio signals included in the audio signal according to the real-time vehicle driving parameters to obtain a combined-track audio signal;

[0035] Determine the processed audio signal according to the combined-track audio signal and the loudness corresponding to each single-track audio signal before combining.

[0036] In some possible implementation manners, before outputting the target sound wave signal, the method further includes:

[0037] Obtain a target sound effect component corresponding to the user's needs from the component library;

[0038] Process the target sound wave signal based on the target sound effect component to obtain the processed target sound wave signal;

[0039] The outputting the target sound wave signal includes:

[0040] Play the processed target sound wave signal through a speaker.

[0041] According to a second aspect of the embodiments of the present disclosure, there is provided a sound wave control device, including:

[0042] A processing unit, configured to obtain a target sound source component corresponding to a user requirement, and obtain an audio signal according to the target sound source component;

[0043] A modulation unit, configured to dynamically modulate the audio signal according to vehicle driving parameters to obtain a target sound wave signal;

[0044] A control unit, configured to output the target sound wave signal.

[0045] In some possible implementation manners, the processing unit includes:

[0046] An obtaining module, configured to obtain a single target sound source component or multiple target sound source components corresponding to the user requirement from a component library;

[0047] A combining module, configured to, when the multiple target sound source components are obtained, combine the multiple target sound source components in a series or superposition manner to obtain the audio signal;

[0048] A first determination module, configured to, when the single target sound source component is obtained, obtain the audio signal according to the single target sound source component.

[0049] In some possible implementation manners, the processing unit further includes:

[0050] A second determination module, configured to, after obtaining a target sound source component corresponding to a user requirement and obtaining an audio signal according to the target sound source component, determine to perform split-track processing and / or merge-track processing on the audio signal based on the user requirement and the number of playback devices;

[0051] A processing module, configured to call a split-track component and / or a merge-track component from the component library to perform split-track processing and / or merge-track processing on the target sound source component to obtain the processed audio signal;

[0052] The modulation unit is further configured to dynamically modulate the processed audio signal according to the vehicle driving parameters to obtain the target sound wave signal.

[0053] In some possible implementation manners, the modulation unit includes:

[0054] A modulation module, configured to perform amplitude modulation processing and / or frequency modulation processing on the audio signal according to real-time vehicle driving parameters to obtain the target sound wave signal.

[0055] In some possible implementation manners, the modulation module includes:

[0056] A first determination sub-module, configured to determine an amplitude range corresponding to the real-time vehicle driving parameter from an amplitude curve; wherein, each vehicle driving parameter corresponds to an amplitude range in the amplitude curve;

[0057] A second determination sub-module, configured to determine a target loudness value according to left and right endpoint values of the amplitude range corresponding to the real-time vehicle driving parameter, wherein the left and right endpoint values correspond to loudness values;

[0058] A first modulation sub-module, configured to perform amplitude modulation processing on the audio signal according to the target loudness value.

[0059] In some possible implementation manners, the modulation module includes:

[0060] A third determination sub-module, configured to determine a target loudness change speed corresponding to the real-time vehicle speed according to a corresponding relationship between a preset vehicle speed and a loudness change speed;

[0061] A fourth determination sub-module, configured to determine a target frequency change speed corresponding to the real-time vehicle motor speed according to a corresponding relationship between a preset vehicle motor speed and a frequency change speed;

[0062] A fifth determination sub-module, configured to determine a phase difference to be frequency-shifted according to the real-time frequency of the audio signal, the target frequency of the audio signal, the target loudness change speed, and the target frequency change speed;

[0063] A second modulation sub-module, configured to perform frequency modulation processing on the audio signal according to the current frequency of the audio signal and the phase difference to be frequency-shifted.

[0064] In some possible implementation manners, the processing module is further configured to:

[0065] Determine the amplitude of each harmonic corresponding to the real-time vehicle speed according to a mapping relationship between a preset vehicle speed and the amplitude of the harmonic;

[0066] Determine a target frequency conversion rate corresponding to the real-time motor speed according to a mapping relationship between a preset motor speed and a frequency conversion rate;

[0067] Perform split-track processing on the audio signal according to the amplitude of each harmonic and the target frequency conversion rate to obtain a plurality of single-track audio signals, wherein the processed audio signal includes the plurality of single-track audio signals.

[0068] In some possible implementation manners, the processing module is further configured to:

[0069] Perform combined-track processing on the plurality of single-track audio signals included in the audio signal according to the real-time vehicle driving parameter to obtain a combined-track audio signal;

[0070] Determine the processed audio signal according to the audio signal after mixing and the loudness corresponding to each individual audio signal before mixing.

[0071] In some possible implementation manners, the apparatus further includes:

[0072] An obtaining unit, configured to obtain a target sound effect component corresponding to user requirements from a component library before the control unit outputs the target sound wave signal;

[0073] A processing unit, configured to process the target sound wave signal based on the target sound effect component to obtain the processed target sound wave signal;

[0074] The control unit is further configured to play the processed target sound wave signal through a speaker.

[0075] According to the third aspect of the embodiments of the present disclosure, there is provided a sound wave control system, including:

[0076] A sound wave material module, configured to store a plurality of sound source components;

[0077] A sound wave generation module, configured to, in response to user requirements, obtain a target sound source component corresponding to the user requirements from the sound wave material module to obtain an audio signal, and dynamically modulate the audio signal according to the user requirements and vehicle driving parameters to obtain a target sound wave signal;

[0078] An output module, configured to output the target sound wave signal generated by the sound wave generation module.

[0079] In some possible implementation manners, the sound wave generation module includes: a driving parameter input layer, a sound wave generation layer, and a signal modulation layer; wherein,

[0080] The driving parameter input layer is configured to obtain real-time vehicle driving parameters;

[0081] The sound wave generation layer is configured to, in response to the user requirements, obtain a target sound source component corresponding to the user requirements from the sound wave material module, combine the target sound source components to obtain the audio signal;

[0082] The sound wave generation layer is configured to process the audio signal based on user requirements to obtain a processed audio signal;

[0083] The signal modulation layer is configured to perform amplitude modulation processing and / or frequency modulation processing on the processed audio signal according to the real-time vehicle driving parameters to obtain the target sound wave signal.

[0084] In some possible embodiments, the sound wave generation layer is further configured to determine to perform split-track processing and / or merge-track processing on the audio signal based on the user requirements and the number of playback devices;

[0085] The sound wave generation layer is further configured to call a split-track component and / or a merge-track component to perform split-track processing and / or merge-track processing on the audio signal to obtain the processed audio signal.

[0086] In some possible embodiments, the sound wave generation module further includes: a post-processing layer;

[0087] The post-processing layer is configured to receive the target sound wave signal sent by the signal modulation layer and call a target sound effect component according to the user requirements;

[0088] The post-processing layer is further configured to process the target sound wave signal based on the target sound effect component to obtain the processed target sound wave signal.

[0089] In some possible embodiments, the sound wave material module includes a component library;

[0090] The component library is configured to perform corresponding processing based on an editing instruction for each type of component in response to the editing instruction;

[0091] Wherein, the editing instruction includes at least one of addition, deletion, invocation, and modification, and each type of component adopts the same input / output interface and input / output protocol.

[0092] According to a fourth aspect of the embodiments of the present disclosure, a vehicle is provided, including:

[0093] A processor;

[0094] A memory for storing processor-executable instructions;

[0095] Wherein, the processor is configured to:

[0096] Implement the steps of the method described in any one of the second aspect.

[0097] According to a fifth aspect of the embodiments of the present disclosure, a non-transitory computer-readable storage medium is provided, which enables a mobile terminal to execute a sound wave control method when instructions in the storage medium are executed by a processor of the mobile terminal.

[0098] The technical solutions provided by the embodiments of the present disclosure may include the following beneficial effects:

[0099] Sound wave control method, device, system and vehicle. The sound wave control method includes: obtaining a target sound source component corresponding to user requirements, obtaining an audio signal according to the target sound source component, dynamically modulating the audio signal according to vehicle driving parameters to obtain a target sound wave signal, and outputting the target sound wave signal. In the present disclosure, the corresponding target sound source component is obtained according to user requirements, the free configuration of the target sound source component is realized, and the user can customize the sound wave playback according to needs; in addition, during the driving process of the vehicle, the audio signal obtained by free combination is dynamically modulated based on user requirements and vehicle driving parameters, so that the finally formed target sound wave signal is dynamically adjusted according to the vehicle driving state, adapting to the diverse scenarios during the driving process and increasing the driving pleasure.

[0100] It should be understood that the above general description and the following detailed description are only exemplary and explanatory, and cannot limit the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0101] The drawings herein are incorporated into the specification and constitute a part of this specification, showing embodiments consistent with the present disclosure and used together with the specification to explain the principles of the present disclosure.

[0102] Figure 1 is a flowchart of a sound wave control method shown according to some embodiments of the present disclosure;

[0103] Figure 2 is a flowchart of another sound wave control method shown according to some embodiments of the present disclosure;

[0104] Figure 3 is a flowchart of another sound wave control method shown according to some embodiments of the present disclosure;

[0105] Figure 4 is a schematic diagram of split-track and / or combined-track processing provided by an embodiment of the present disclosure;

[0106] Figure 5 is a flowchart of another sound wave control method shown according to some embodiments of the present disclosure;

[0107] Figure 6 is a flowchart of another sound wave control method shown according to some embodiments of the present disclosure;

[0108] Figure 7 is a flowchart of another sound wave control method shown according to some embodiments of the present disclosure;

[0109] Figure 8 is a flowchart of another sound wave control method shown according to some embodiments of the present disclosure;

[0110] Figure 9It is a flowchart of another sound wave control method shown according to some embodiments of the present disclosure;

[0111] Figure 10 It shows a schematic structural diagram of a frequency modulation processing and / or amplitude modulation processing provided by an embodiment of the present disclosure;

[0112] Figure 11 It is a flowchart of another sound wave control method shown according to some embodiments of the present disclosure;

[0113] Figure 12 It shows a schematic structural diagram of a post - processing provided by an embodiment of the present disclosure;

[0114] Figure 13 It is a schematic diagram of a sound wave control system shown according to some embodiments of the present disclosure;

[0115] Figure 14 It is a schematic diagram of a sound wave generation module shown according to some embodiments of the present disclosure;

[0116] Figure 15 It is a block diagram of a sound wave control device shown according to some embodiments of the present disclosure;

[0117] Figure 16 It is a block diagram of another sound wave control device shown according to some embodiments of the present disclosure;

[0118] Figure 17 It is a schematic diagram of a functional block of a vehicle shown according to an exemplary embodiment. Detailed implementation manners

[0119] Here, some embodiments of the present disclosure will be described in detail, and their examples are shown in the drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. Various changes, modifications, and equivalents of the methods, devices, and / or systems described herein will become apparent after understanding the present disclosure. For example, the order of the operations described herein is merely an example and is not limited to the orders set forth herein. Instead, it can be changed as will be apparent after understanding the present disclosure, except for operations that must be performed in a specific order. Additionally, for the sake of clarity and conciseness, the description of features known in the art may be omitted.

[0120] The implementation manners described in some embodiments of the present disclosure below do not represent all implementation manners consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with some aspects of the present disclosure as detailed in the appended claims.

[0121] The embodiments of the present disclosure also provide a sound wave control method, as Figure 1As shown in the figure, it includes:

[0122] Step 101, obtain a target sound source component corresponding to the user's demand, and obtain an audio signal according to the target sound source component.

[0123] In some embodiments, the user's demand can be determined according to the user's historical sound wave information, or can be determined when initializing the system, or, when the user is driving a vehicle, the user's demand input by a non-driver through an interaction interface, gesture, button, etc.; furthermore, it can also be the user's demand input by the driver or non-driver through voice input, etc. Specifically, the present disclosure embodiment does not limit the input path of the user's demand. For example, the user's demand is: the reverberation sound uses the simulated sound of vehicle model A.

[0124] Obtain the corresponding target sound source component according to the user's demand. The target sound source component may be a single target sound source component or multiple target sound source components. When it is a single target sound source component, a relatively simple and basic audio signal is generated; when there are multiple target sound source components, multiple target sound source components can be connected in series, or multiple target sound source components can be superimposed or processed sequentially to generate a more complex audio signal. Specifically, the present disclosure embodiment does not limit the number of target sound source components used for audio information and the formation method.

[0125] In the embodiments of the present disclosure, a component library is provided. The component library is classified according to different functions, and the classification includes but is not limited to sound source components, different processing components, such as: modulation components (frequency modulation components, amplitude modulation components), track combining components, track splitting components, delay components, filtering components, reverberation components, etc. Specifically, the categories of components in the component library are not limited.

[0126] In addition, all components in the component library can be called by each module in the system. Since all components in the component library have the same input interfaces (CAN signal interface and audio signal interface) and output interface (audio signal interface), and the input protocol and output protocol are unified, therefore, when performing sound wave control based on each component, it has flexibility and low coupling characteristics.

[0127] In some embodiments, when adding, deleting or using a component, it includes the following content items:

[0128] The description of the component is to describe the basic information and interface information of the component function, and it is the basis for accessing the corresponding component function in the sound wave material module 11 (the component library it contains).

[0129] The classification of the component is to establish and maintain the directory information of the component library. A reasonable and effective classification of component functions is the basis for retrieval and also facilitates the management of the component library.

[0130] The storage of components is carried out according to the identification information, feature information, and source code of the components.

[0131] The extraction of components is to analyze the retrieved components for relevance or similarity through the retrieval keywords in the user requirements, and extract one or more components. If multiple components are extracted, the component with the highest relevance or similarity is determined as the final component corresponding to the user requirements.

[0132] Exemplarily, User Requirement 1: Highlight different frequency details such as low frequency / mid frequency, high frequency, etc.; retrieve filters with a limited frequency range, and the retrieval results provide low-pass / high-pass / band-pass filter components.

[0133] User Requirement 2: Increase the ambient atmosphere in the sound wave; retrieve the sense of space effect, and the retrieval results provide components such as reverb filters / delay filters, etc.

[0134] User Requirement 3: Remove a certain frequency point that causes resonance in the sound wave; retrieve the effect of repairing audio defects, and the retrieval results provide components such as notch filters.

[0135] It should be noted that the above are only exemplary examples, rather than limitations on specific components and user requirements.

[0136] In the embodiments of the present disclosure, all operations are carried out under the authorization of the user and strictly comply with relevant laws and regulations such as privacy and security.

[0137] Step 102, dynamically modulate the audio signal according to the vehicle driving parameters to obtain a target sound wave signal.

[0138] In order to better fit the driving experience, after generating the audio signal, it is also necessary to dynamically modulate the audio signal according to the vehicle driving parameters in real time. For example, when the driver brakes suddenly, it is necessary to modulate the audio signal to adjust the loudness of the audio signal; when the driver accelerates, it is necessary to modulate the audio information to adjust the loudness, frequency change, etc. of the audio signal.

[0139] When performing modulation, components with unlimited quantity and types of modulation functions in the component library can be called at any time to realize the function of modulating the audio signal from the vehicle real-time driving parameters (including frequency modulation and / or amplitude modulation), and ultimately achieve the purpose of dynamically adjusting the frequency and loudness of the audio signal according to the vehicle driving parameters.

[0140] In some embodiments, the vehicle driving parameters include but are not limited to pedal opening, motor speed, vehicle speed, torque, etc.

[0141] In some feasible solutions, the audio signal can also be modulated according to information such as the temperature, humidity, and brightness of the vehicle cabin to obtain a target sound wave signal. The modulation method is the same as that of dynamically modulating the audio signal according to vehicle driving parameters to obtain a target sound wave signal, which will not be elaborated here.

[0142] Step 103, output the target sound wave signal.

[0143] Output the multi-channel target sound wave signal to different speakers (horns) at multiple positions in the corresponding vehicle cabin to realize the playback of the simulated sound wave.

[0144] The sound wave control method provided by the embodiments of the present disclosure obtains a target sound source component corresponding to user needs, obtains an audio signal according to the target sound source component, dynamically modulates the audio signal according to vehicle driving parameters to obtain a target sound wave signal, and outputs the target sound wave signal. Obtaining the corresponding target sound source component according to user needs realizes the free configuration of the target sound source component and realizes the user's customized sound wave playback on demand; in addition, during the vehicle driving process, the audio signal obtained by free combination is dynamically modulated based on user needs and vehicle driving parameters, so that the finally formed target sound wave signal is dynamically adjusted according to the vehicle driving state, adapts to the diverse scenarios of the driving process, and increases the driving pleasure.

[0145] Figure 2 Further shows a flowchart of a sound wave control method proposed by the present disclosure. Based on Figure 1 the embodiments shown, Figure 2 The content shown is a further explanation of step 101 (the step of obtaining a target sound source component corresponding to user needs and obtaining an audio signal according to the target sound source component). Step 101 (the step of obtaining a target sound source component corresponding to user needs and obtaining an audio signal according to the target sound source component) may include the following steps:

[0146] Step 201, obtain a single target sound source component or multiple target sound source components corresponding to the user needs from the component library.

[0147] Obtain the corresponding target sound source component based on the description of the component in the component library according to user needs. The target sound source component may be a single target sound source component or multiple target sound source components. Specifically, the embodiments of the present disclosure do not limit the number of target sound source components used for audio information and the formation method.

[0148] In some embodiments, the design of the sound source component reflects the timbre characteristics of the simulated sound wave and is the fundamental factor determining the sound wave recognition of a vehicle. The embodiments of the present disclosure design the sound source component in various ways, including but not limited to:

[0149] Harmonic synthesis method: synthesize the engine sound according to the harmonic components;

[0150] Recordings of sound wave materials in each different constant speed segment, etc.

[0151] Step 202, when the multiple target sound source components are obtained, combine the multiple target sound source components in series or by superposition to obtain the audio signal; when the single target sound source component is obtained, obtain the audio signal according to the single target sound source component.

[0152] When there are multiple target sound source components, multiple target sound source components can be connected in series, or multiple target sound source components can be superposed or processed sequentially to generate more complex audio signals.

[0153] When there is a single target sound source component, a relatively simple and basic audio signal is generated.

[0154] Obtain the corresponding single target sound source component or multiple target sound source components from the component library according to the user's needs to generate an audio signal simulating the sound wave, bringing a realistic and personalized simulated sound wave experience to the user.

[0155] Figure 3 Further shows a flowchart of a sound wave control method proposed by the present disclosure. Based on Figure 1 the embodiments shown, Figure 3 it may include the following steps:

[0156] Step 301, based on the user's needs and the number of playback devices, determine to perform split-track processing and / or merge-track processing on the audio signal.

[0157] For the audio signal, it can be synthesized according to the user's needs and the vehicle playback device (such as a speaker) through a merge-track component, integrating the audio signals generated by one or more target sound source components into one output, providing a unified input for subsequent sound wave processing; or, according to the user's needs, the audio signal can be divided into multiple tracks (multiple channels) (such as 2 channels, 5 channels, etc.) through an audio split-track component to meet the requirements of different audio signal processing paths.

[0158] Step 302, call a split-track component and / or a merge-track component from the component library to perform split-track processing and / or merge-track processing on the audio signal to obtain the processed audio signal.

[0159] When generating an audio signal, any number of various target audio components (including audio components synthesized by the order method and audio components with multi-segment uniform speed) can be mounted and arranged in combination as needed, supporting single-track or multi-track audio signals. In addition, it also includes two types of signal path processing components, namely, split-track components and merge-track components, in the component library, which are used to process the generated audio signal to obtain a new processed audio signal for subsequent modulation processing.

[0160] As Figure 4 shown, Figure 4 FIG. is a schematic diagram of split-track and / or merge-track processing provided by an embodiment of the present disclosure. An audio signal is obtained by acquiring one or more target audio components, such as unlimited sound source components and order components, from the component library. Since the source of the audio signal is multiple sound source components, the combined audio signal may include a first part of the audio signal that needs to be split-track processed. The first part is a whole-track audio signal, and it also includes a second part of the audio signal that needs to be merge-track processed. The second part is a multi-track audio signal.

[0161] For the first part of the whole-track audio signal, the audio signal needs to be split into multi-track audio signals by a split-track component according to user requirements. In some embodiments, multiple single-track audio signals are also called multi-track signals.

[0162] For the second part of the multi-track audio signal, the multi-track audio signal in the audio signal needs to be processed by a merge-track component according to user requirements and merged into a whole-track audio signal to meet different signal processing path requirements.

[0163] It should be noted that Figure 4 the description is made by taking an audio signal containing M (M>4) tracks as an example, but this description method is not a specific limitation on the number of tracks and target audio components.

[0164] In some embodiments, if it is determined based on user requirements that the whole-track audio signal in the audio signal needs to be split-track processed, the split-track component can be called to perform split-track processing on the whole-track audio signal in the audio signal. In addition, there may or may not be single-track signals in the audio signal, but since the user requirements do not mention merge-track processing of single-track signals, the existing single-track signals in the audio signal can be left unprocessed for merge-track.

[0165] In some embodiments, if it is determined based on user requirements that the single-track audio signal in the audio signal needs to be merge-track processed, the merge-track component can be called to perform merge-track processing on the single-track audio signal in the audio signal. In addition, there may or may not be whole-track audio signals in the audio signal, but since the user requirements do not mention split-track processing of whole-track audio signals, the existing whole-track audio signals in the audio signal can be left unprocessed for split-track.

[0166] In some embodiments, it is also possible to determine, based on user requirements, that the entire-track audio signal in the audio signal needs to be split into tracks, and that the single-track audio signal in the audio signal needs to be combined into a track. Then, call the track-splitting component to split the entire-track audio signal in the audio signal, and call the track-combining component to combine the single-track audio signal in the audio signal.

[0167] In some embodiments, when it is determined, based on user requirements, that the single-track audio signal (such as the audio signal of the second part) in the audio signal needs to be combined into a track, and that the entire-track audio signal (such as the audio signal of the first part) in the audio signal needs to be split into tracks, the audio signal of the first part can first be split into tracks by the track-splitting component, and then the audio signal of the second part can be combined into a track by the track-combining component; or, the audio signal of the second part can first be combined into a track by the track-combining component, and then the audio signal of the first part can be split into tracks by the track-splitting component; furthermore, the audio signal of the second part can be combined into a track by the track-combining component and the audio signal of the first part can be split into tracks by the track-splitting component in parallel. The embodiments of the present disclosure do not limit the processing sequence of the track-splitting component and the track-combining component.

[0168] When calling the track-splitting component from the component library to split the audio signal, the following methods can be used but are not limited to, such as Figure 5 as shown, including:

[0169] Step 3031: Determine the amplitude of each harmonic corresponding to the real-time vehicle speed according to the mapping relationship between the preset vehicle speed and the amplitude of the harmonic.

[0170] Before executing this step, preprocess the mapping relationship between the vehicle speed and the amplitude of the harmonic in advance to establish a unique correspondence between the vehicle speed and the amplitude of the harmonic, that is, according to the real-time vehicle speed of the vehicle, query the amplitude of each harmonic corresponding to the real-time vehicle speed in the mapping relationship between the vehicle speed and the amplitude of the harmonic. Different vehicle speeds correspond to different harmonic amplitudes. In the embodiments of the present disclosure, the frequency of the audio signal corresponds to multiple harmonics, and each harmonic corresponds to an amplitude.

[0171] Regarding the process of preprocessing the mapping relationship between the vehicle speed and the harmonic amplitude, any fitting algorithm in the related art can be referred to, and the embodiments of the present disclosure will not be described in detail.

[0172] Step 3032: Determine the target frequency conversion rate corresponding to the real-time motor speed according to the mapping relationship between the preset motor speed and the frequency conversion rate.

[0173] Preprocess the mapping relationship between the motor speed and the frequency conversion rate in advance to establish a unique correspondence between the motor speed and the frequency conversion rate, that is, according to the real-time motor speed of the vehicle, query the corresponding target frequency conversion rate in the mapping relationship between the motor speed and the frequency conversion rate. Different motor speeds correspond to different frequency conversion rates.

[0174] Step 3033: Perform track separation processing on the audio signal according to the amplitude of each harmonic and the target frequency conversion rate, where the processed audio signal includes the multiple single-track audio signals.

[0175] Among them, the order component is implemented using the harmonic algorithm, and the expression is as follows:

[0176]

[0177] Among them, Sig is the single-track audio signal, Amp n is the amplitude of each harmonic component in the single-track signal, k is the target frequency conversion rate, rpm is the motor speed, Ord n is the order of each harmonic, which is a constant. Among them, Ord n affects the distribution of the frequency components of this single track, k affects the speed of frequency change of this single track with the change of the vehicle motor speed, and Amp n affects the speed of loudness change of this single track with the change of the vehicle speed. Therefore, this parameter in the harmonic method is the acoustic parameter to be modulated.

[0178] When calling the track combination component from the component library to perform track combination processing on the target sound source component to obtain the processed audio signal, the following methods can be used but are not limited to, as Figure 6 shown, including:

[0179] Step 3034: Perform track combination processing on the multiple single-track audio signals included in the audio signal according to the real-time vehicle driving parameters to obtain the combined audio signal.

[0180] An audio signal contains multiple single-track audio signals. In response to the demand, it is necessary to combine and output the multiple single-track audios.

[0181] In some embodiments, through the user's track combination demand, calling the track combination component in the component library can complete the track combination processing of the multiple single-track audio signals to obtain the combined audio signal.

[0182] Step 3035: Determine the total-track audio signal according to the combined audio signal and the loudness corresponding to each single-track audio signal before combination.

[0183] For the track combination component, the algorithm expression is as shown in the following formula:

[0184] Sig M = ∑Gain m × Sig m

[0185] Wherein, Sig M is the audio signal of the total track, m is the number of single tracks, and Gain m is the loudness of each single track before mixing, and Sig m is the signal of each single track. Among them, Gain m affects the superimposed ratio of each single track. When producing the single-track audio signal, its corresponding relative loudness is determined and is a constant value.

[0186] Step 303: Dynamically modulate the processed audio signal according to the vehicle driving parameters to obtain the target sound wave signal.

[0187] Regarding Step 303, for the detailed description, reference can be made to Step 102, which will not be elaborated in this embodiment of the present disclosure.

[0188] Figure 7 Further shows a flowchart of a sound wave control method proposed by the present disclosure. Based on Figure 1 the embodiments shown, Figure 7 the content shown is a further explanation of Step 102 (dynamically modulating the audio signal according to the vehicle driving parameters to obtain the target sound wave signal). Step 102 (the step of dynamically modulating the audio signal according to the vehicle driving parameters to obtain the target sound wave signal) may include the following steps:

[0189] Step 401: Obtain real-time vehicle driving parameters.

[0190] During the real-time operation of the vehicle, real-time vehicle driving parameters and other multiple CAN signals provided by the cockpit are received in real time for subsequent real-time modulation of the sound wave, including but not limited to multiple CAN signals such as powertrain, chassis control, and body control.

[0191] Step 402: Perform amplitude modulation processing and / or frequency modulation processing on the audio signal according to the real-time vehicle driving parameters to obtain the target sound wave signal.

[0192] The received audio signal can be a whole-track audio signal or multiple single-track (multi-track) audio signals, which is not specifically limited.

[0193] Modulate the received audio signal in real time according to the real-time vehicle driving parameters of the vehicle. When modulating, by calling any number of components of the modulation function categories in the component library (the components of the modulation function are also called dynamic gain components), the function of frequency modulation and amplitude modulation from the real-time CAN signal of the vehicle to the audio signal is realized, and finally the purpose of dynamically adjusting the frequency and loudness of the audio signal according to the vehicle information is achieved, so that the simulated engine sound during driving is consistent with the actual vehicle driving situation.

[0194] In the embodiments of the present disclosure, when performing frequency modulation processing on the audio signal, the frequency modulation components in the component library can be called; when performing amplitude modulation processing on the audio signal, the amplitude modulation components in the component library can be called, and they are called according to user requirements.

[0195] In some embodiments, the audio signal can be amplitude-modulated only through the amplitude modulation components based on user requirements. In addition, since the user requirements do not mention frequency modulation processing of the audio signal, the audio signal can be not frequency-modulated.

[0196] In some embodiments, the audio signal can also be frequency-modulated only through the frequency modulation components based on user requirements. In addition, since the user requirements do not mention amplitude modulation processing of the audio signal, the audio signal can be not amplitude-modulated.

[0197] In some embodiments, based on user requirements, part of the signals or all of the signals in the audio signal can be frequency-modulated through the frequency modulation components, and then part of the signals or all of the signals in the audio signal can be amplitude-modulated through the amplitude modulation components.

[0198] It should be noted that when using the amplitude modulation components and the frequency modulation components to process the audio signal, the processing order can be: first process with the amplitude modulation components and then with the frequency modulation components; or, first process with the frequency modulation components and then with the amplitude modulation components; furthermore, parallel processing of the amplitude modulation components and the frequency modulation components is also supported. The embodiments of the present disclosure do not limit the processing time sequence of the amplitude modulation components and the frequency modulation components.

[0199] When performing amplitude modulation processing on the audio signal according to the real-time vehicle driving parameters, the following methods can be used but are not limited to, such as Figure 8 As shown, it includes:

[0200] Step 4021, determine the amplitude range corresponding to the real-time vehicle driving parameters from the amplitude curve; wherein, each vehicle driving parameter corresponds to an amplitude range in the amplitude curve.

[0201] Before performing this step, preprocess the mapping relationship between the vehicle driving parameter curve and the amplitude curve in advance, establish a unique correspondence between the vehicle driving parameters and each amplitude interval in the amplitude curve, that is, query and determine the corresponding amplitude interval in the amplitude curve according to the real-time vehicle driving parameters. Different vehicle driving parameters correspond to different amplitude intervals in the amplitude curve, and different amplitudes correspond to a parameter interval of the vehicle driving parameter curve.

[0202] Regarding the process of preprocessing the mapping relationship between the vehicle driving parameters and the amplitude curve, any fitting algorithm in the related art can be referred to, and the embodiments of the present disclosure will not be described in detail.

[0203] Step 4022: Determine the target loudness value according to the left and right endpoint values of the amplitude interval corresponding to the real-time vehicle driving parameters, where the left and right endpoint values correspond to the loudness values.

[0204] In the amplitude interval determined based on step 4021, the left and right endpoints of the interval and the corresponding endpoint values can be determined. The endpoint values correspond to different loudness values. The loudness values corresponding to the left and right endpoint values are determined as the loudness value of the real-time vehicle driving parameters.

[0205] Step 4023: Perform amplitude modulation processing on the audio signal according to the target loudness value.

[0206] The dynamic gain algorithm used for amplitude modulation processing is expressed as follows:

[0207]

[0208] Among them, dB is the loudness value corresponding to the real-time vehicle driving parameters. Modulating the audio with this gain can achieve the amplitude modulation effect. dB1 is the left endpoint value of the interval in the amplitude curve, dB2 is the right endpoint value of the interval in the amplitude curve, n is the real-time vehicle driving parameter (the value of the current CAN signal), and n1 and n2 are the left and right endpoint values of the interval of the vehicle driving parameter curve corresponding to the amplitude (known quantities).

[0209] When performing frequency modulation processing on the audio signal according to the real-time vehicle driving parameters, it can be implemented in, but not limited to, the following manner, such as Figure 9 shown, including:

[0210] Step 4024: Determine the target loudness change speed corresponding to the real-time vehicle speed according to the preset correspondence between the vehicle speed and the loudness change speed.

[0211] Before performing this step, preprocess the correspondence between the vehicle speed and the loudness change speed in advance to establish a unique correspondence between the vehicle speed and the loudness change speed, that is, according to the real-time vehicle speed, query the corresponding target loudness change speed in the correspondence between the vehicle speed and the loudness change speed. Different vehicle speeds correspond to different loudness change speeds.

[0212] For the process of preprocessing the correspondence between the vehicle speed and the loudness change speed, any fitting algorithm in the related art can be referred to, and the embodiments of the present disclosure will not be described in detail.

[0213] Step 4025: Determine the target frequency change speed corresponding to the real-time vehicle motor speed according to the preset correspondence between the vehicle motor speed and the frequency change speed.

[0214] Before performing this step, preprocess the correspondence between the vehicle motor speed and the frequency change speed in advance to establish a unique correspondence between the vehicle motor speed and the frequency change speed, that is, according to the real-time vehicle speed, query the corresponding target frequency change speed in the correspondence between the vehicle motor speed and the frequency change speed. Different vehicle speeds correspond to different target frequency change speeds.

[0215] For the process of preprocessing the correspondence between the vehicle speed and the loudness change speed, any fitting algorithm in the related art can be referred to, and the embodiments of the present disclosure will not be described in detail.

[0216] Step 4026: Determine the phase difference to be frequency-shifted according to the real-time frequency of the audio signal, the target frequency of the audio signal, the target loudness change speed, and the target frequency change speed.

[0217] The frequency-shifting algorithm used for frequency modulation is expressed as follows:

[0218]

[0219] Among them, Δφ is the phase difference to be frequency-shifted. Modulating the audio signal with this phase difference can achieve the frequency modulation effect. f0 is the current frequency of the signal, f r is the target frequency of the audio signal, f s is the sampling frequency of the signal, π is a constant, f r is the target frequency change speed, f r affects the speed at which the frequency of this single track changes with the vehicle motor speed, and Gain r is the target loudness change speed that affects the speed at which the loudness of this single track changes with the vehicle speed.

[0220] Step 4027: Perform frequency modulation processing on the audio signal according to the current frequency of the audio signal and the phase difference to be frequency-shifted.

[0221] Shift the frequency of the audio signal from the current frequency by the phase difference to be frequency-shifted, complete the frequency modulation of the audio signal, and meet user requirements.

[0222] Please refer to Figure 10 , Figure 10 which shows a schematic diagram of an architecture for frequency modulation processing and / or amplitude modulation processing provided by an embodiment of the present disclosure. When modulating audio information based on real-time vehicle CAN signals, the frequency modulation component can be called only to perform frequency modulation processing on the audio signal; or the amplitude modulation component can be called only to perform amplitude modulation processing on the audio signal; or, the amplitude modulation component can be called first, and then the frequency modulation component can be called to perform combined processing of amplitude modulation and frequency modulation; furthermore, the frequency modulation component can be called first, and then the amplitude modulation component can be called. Specifically, the processing of the frequency modulation component or the amplitude modulation component needs to be determined according to the real-time vehicle CAN signals. Figure 10 This is an example using the audio tracks 1, 2, 3, and N (N>3) obtained after amplitude modulation and / or frequency modulation for illustration. However, it should be clear that this illustrative example is not a limitation on the processing of audio signals.

[0223] In some embodiments, when Figure 8 performing amplitude modulation processing, all audio signals can be uniformly amplitude-modulated; or some of the audio signals can be amplitude-modulated according to vehicle driving parameters; or, some audio signals can be amplitude-modulated separately according to vehicle driving parameters, and the parameters of the multiple amplitude modulations can be the same, not completely the same, or all different.

[0224] In some embodiments, when Figure 9 performing frequency modulation processing, all audio signals can be uniformly frequency-modulated; or some of the audio signals can be frequency-modulated according to vehicle driving parameters; or, some audio signals can be frequency-modulated separately according to vehicle driving parameters, and the parameters of the multiple amplitude modulations or frequency modulations can be the same, not completely the same, or all different.

[0225] In some embodiments, when driving the amplitude modulation component and / or frequency modulation component in a dynamic processing response driven by real-time vehicle driving parameters, it is also necessary to determine the modulation loudness or the phase difference before and after the frequency through a preset algorithm to enhance the real experience of the simulated engine sound.

[0226] Figure 11 Further shows a flowchart of a sound wave control method proposed by the present disclosure, Figure 11 which may include the following steps:

[0227] Step 501: Obtain a target sound source component corresponding to the user's demand, and obtain an audio signal based on the target sound source component.

[0228] Step 502: Dynamically modulate the audio signal according to the vehicle driving parameters to obtain a target sound wave signal.

[0229] For the descriptions of Steps 501 to 502, please refer to the detailed descriptions of Steps 101 and 102, so they will not be elaborated here one by one.

[0230] Step 503: Obtain a target sound effect component corresponding to the user's demand from the component library.

[0231] The target sound effect component is used to enhance the sound effect of the target sound wave signal. Like the modulation component and the target sound source component, it is stored in the component library. All components in the component library have the same input interface and output interface, and the input protocol and output protocol are unified.

[0232] Step 504: Process the target sound wave signal based on the target sound effect component to obtain the processed target sound wave signal.

[0233] After receiving the multi-track audio signal (target sound wave signal), any number of post-processing components (also called target sound effect components) can be mounted on any track to achieve a characteristic and rich effect design. The specific categories include but are not limited to flanger components, reverb components, equalizer components, and delay components. Through further processing of the target sound wave signal, the final real-time multi-channel sound wave signal is obtained and directly pushed to different speakers at multiple positions in the corresponding car cockpit to achieve three-dimensional surround adjustment of the sound wave.

[0234] Please refer to Figure 12 , Figure 12 shows a schematic diagram of a post-processing architecture provided by an embodiment of the present disclosure. The unity of the input and output of the components in the post-processing also determines that they can be freely and unlimitedly added to the hierarchical architecture, and the post-processing hierarchical architecture diagram is similar to the modulation layer architecture diagram ( Figure 10 ). Figure 12 Taking the delay component, filter component, flanger component, and reverb component as examples, during post-processing, one target sound effect component can be selected for post-processing, or two target sound effect components with any functions can be arbitrarily selected for post-processing. When selecting the target sound effect component, it needs to be selected according to the user's demand.

[0235] Figure 12For example, the post - processing is performed on the audio track 1, audio track 2, audio track 3, and audio track L (L>3) through a delay component, a filtering component, a flanging component, and a reverberation component. However, it should be clear that this description method is only an exemplary example and does not limit the post - processing component (target sound effect component).

[0236] Step 505: Play the processed target sound wave signal through a speaker.

[0237] For the description of step 505, please refer to the detailed description of step 13, so it will not be elaborated here one by one.

[0238] Figure 13 It is a schematic diagram of a sound wave control system shown according to some embodiments of the present disclosure, as Figure 13 shown, including: a sound wave material module 11, a sound wave generation module 12, and an output module 13;

[0239] The sound wave material module 11 is configured to store various types of components; all components in the sound wave material module 11 can be called by the sound wave generation module 12 or the output module 13. All components in the sound wave material module 11 have the same input interfaces (CAN signal interface and audio signal interface) and output interfaces (audio signal interface), and the input protocol and output protocol are unified. Therefore, when performing sound wave control based on each component, it has flexibility and low - coupling characteristics.

[0240] In some embodiments, the present disclosure embodiments do not limit the input protocol and output protocol, such as a sampling rate of 48 kHz, 16 - bit quantization, etc.

[0241] The components are classified according to different functions, and the classification includes but is not limited to sound source components, different processing components, such as: modulation components (frequency - modulation component, amplitude - modulation component), track - combining components, track - splitting components, delay components, filtering components, reverberation components, etc. Specifically, the categories of components in the sound wave material module 11 are not limited.

[0242] All components in the sound wave material module 11 can be added or deleted according to requirements, realizing the on - demand retrieval and high expandability of components (or called atomic components), and also enhancing the user - defined sound wave design experience.

[0243] In practical applications, when adding, deleting, or using components, it includes the following content items:

[0244] The description of the component is to describe the basic information and interface information of the component function, which is the basis for accessing the corresponding component function in the sound wave material module 11 (the component library it contains).

[0245] The classification of components is to establish and maintain the directory information of the component library. A reasonable and effective classification of component functions is the basis for retrieval and also facilitates the management of the component library.

[0246] The storage of components is based on the identification information, characteristic information, and source code of the components.

[0247] The extraction of components is to perform a correlation analysis on the components retrieved according to the description of the components, and extract alternative components through the retrieval keywords.

[0248] The sound wave generation module 12 is configured to obtain, in response to user requirements, the target sound source component corresponding to the user requirements from the sound wave material module 11, obtain an audio signal, and dynamically modulate the audio signal according to the user requirements and vehicle driving parameters to obtain a target sound wave signal.

[0249] The user requirements can be determined according to the user's historical sound wave information, or can be determined during system initialization, or, when the user is driving the vehicle, the user requirements input by a non-driver through an interaction interface, gestures, buttons, etc.; furthermore, the user requirements input by the driver or non-driver through voice input, etc. Specifically, the embodiments of the present disclosure do not limit the input channels of user requirements. For example, the user requirement is: use the simulated sound of vehicle model A for the mixed sound.

[0250] Based on the description of the components, the corresponding target sound source components are obtained from the sound wave material module 11 according to the user requirements. The target sound source components may be a single target sound source component or multiple target sound source components. When it is a single target sound source component, a relatively simple and basic audio signal is generated; when there are multiple target sound source components, multiple target sound source components can be connected in series, or multiple target sound source components can be superimposed or processed sequentially to generate a more complex audio signal. Specifically, the embodiments of the present disclosure do not limit the number of target sound source components used for the audio information and the formation method.

[0251] In order to better fit the driving experience, after generating the audio signal, it is also necessary to perform real-time dynamic modulation on the audio signal according to the vehicle driving parameters. For example, when the driver brakes suddenly, it is necessary to modulate the audio signal to adjust the loudness of the audio signal; when the driver accelerates, it is necessary to modulate the audio information to adjust the loudness and frequency change of the audio signal.

[0252] When performing modulation, components with unlimited numbers and types of modulation functions in the sound wave material module 11 can be called at any time to implement the function of modulating the audio signal from the vehicle's real-time driving parameters (including frequency modulation and / or amplitude modulation), and ultimately achieve the purpose of dynamically adjusting the frequency and loudness of the audio signal according to the vehicle driving parameters.

[0253] In some embodiments, the vehicle driving parameters include but are not limited to pedal opening, motor rotation speed, vehicle speed, torque, and so on.

[0254] In some feasible solutions, the audio signal can also be modulated according to information such as the temperature, humidity, and brightness of the vehicle cockpit to obtain a target sound wave signal. The modulation method is the same as that of dynamically modulating the audio signal according to the vehicle driving parameters to obtain the target sound wave signal, and will not be elaborated here.

[0255] The output module 13 is configured to output the target sound wave signal generated by the sound wave generation module 12.

[0256] Output the multi-channel target sound wave signal to different speakers (horns) at multiple positions in the corresponding vehicle cockpit to realize the playback of the simulated sound wave.

[0257] In addition, when generating the audio signal, it is also possible to meet different signal processing path requirements based on user needs and the layout and number of vehicle speakers.

[0258] The sound wave control system provided by the embodiments of the present disclosure obtains the corresponding target sound source component from the sound wave material module according to user needs, realizes the free configuration of the target sound source component, and realizes user-customized sound wave playback on demand; in addition, during the vehicle driving process, the audio signal obtained by free combination is dynamically modulated based on user needs and vehicle driving parameters, so that the finally formed target sound wave signal is dynamically adjusted according to the vehicle driving state, adapts to the diverse scenarios of the driving process, and increases driving pleasure.

[0259] In some embodiments, as Figure 14 shown, the sound wave generation module 12 includes: a driving parameter input layer 121, a sound wave generation layer 122, and a signal modulation layer 123; where

[0260] The driving parameter input layer 121 is configured to obtain real-time vehicle driving parameters; during the real-time operation of the vehicle, it receives in real time multiple CAN signals such as real-time vehicle driving parameters provided by the cockpit for subsequent real-time modulation of the sound wave, including but not limited to multiple CAN signals such as powertrain, chassis control, and body control.

[0261] The sound wave generation layer 122 is configured to obtain the target sound source component corresponding to the user needs from the sound wave material module 11 in response to the user needs, and combine the target sound source components to obtain the audio signal;

[0262] The sound wave generation layer 122 is configured to process the audio signal based on user needs to obtain a processed audio signal;

[0263] The sound wave generation layer 122 is used to obtain corresponding components from the component library of the sound wave material module 11 according to user requirements, so as to generate an audio signal of simulated sound waves, bringing a realistic and personalized simulated sound wave experience to users.

[0264] The sound wave generation layer 122 can mount any number of various target audio components (including audio components synthesized by the order method and audio components with multi-segment uniform speed) and arrange and combine them as needed, supporting single-track or multi-track audio signals; in addition, the sound wave generation layer 122 also includes two types of signal path processing components, namely, the split-track component and the combined-track component in the sound wave material module 11, to process the generated audio signal and obtain a new processed audio signal for subsequent processing by the signal modulation layer 123.

[0265] The signal modulation layer 123 is configured to perform amplitude modulation processing and / or frequency modulation processing on the processed audio signal according to the real-time vehicle driving parameters to obtain the target sound wave signal. When the signal modulation layer 123 receives the audio signal sent by the sound wave generation layer 122, the audio signal can be a multi-track audio signal or a whole-track audio signal, and the specific form is not limited.

[0266] The signal modulation layer 123 performs real-time modulation on the received audio signal according to the real-time vehicle driving parameters of the vehicle. When performing modulation, by calling any number of components of the modulation function category in the sound wave material module 11 (the components of the modulation function are also called dynamic gain components), the function of frequency modulation and amplitude modulation from the real-time CAN signal of the vehicle to the audio signal is realized, and finally the purpose of dynamically adjusting the frequency and loudness of the audio signal according to the vehicle information is achieved, so that the simulated sound wave during driving is consistent with the actual vehicle driving situation.

[0267] Regarding the architecture corresponding to the signal modulation layer 123 Figure 10 As shown in the schematic diagram, when modulating the audio information based on the real-time CAN signal of the vehicle, only the frequency modulation component can be called to perform frequency modulation processing on the audio signal; or only the amplitude modulation component can be called to perform amplitude modulation processing on the audio signal; or, first call the amplitude modulation component and then call the frequency modulation component to perform combined processing of amplitude modulation and frequency modulation; furthermore, it is also possible to first call the frequency modulation component and then call the amplitude modulation component. Specifically, the processing of the frequency modulation component or the amplitude modulation component needs to be determined according to the real-time CAN signal of the vehicle.

[0268] In some embodiments, the sound wave generation layer 122 is further configured to determine to perform split-track processing and / or merge-track processing on the audio signal based on the user requirements and the number of playback devices; for the audio signal, it can be synthesized through a merge-track component according to the user requirements and vehicle playback devices (such as speakers), and integrate the audio signals generated by one or more target sound source components into one output, providing a unified input for subsequent sound wave processing; or, according to the user requirements, divide the audio signal into multiple channels (such as 2 channels, 5 channels, etc.) through an audio split-track component to meet the requirements of different audio signal processing paths.

[0269] The sound wave generation layer 122 is further configured to call the split-track component and / or the merge-track component to perform split-track processing and / or merge-track processing on the audio signal to obtain the processed audio signal. When generating an audio signal, any number of various target audio components (including audio components synthesized by the order method, audio components with multiple segments of uniform speed) can be mounted and arranged as needed, supporting single-track or multi-track audio signals; in addition, it also includes two types of signal path processing components, namely the split-track component and the merge-track component in the component library, to process the generated audio signal to obtain a new processed audio signal for subsequent modulation processing.

[0270] The schematic architecture diagram of the split-track component or the merge-track component corresponds to Figure 4 , and the unity of the input and output of the split-track component or the merge-track component also determines that the sound wave generation layer 122 can be freely and unlimitedly added to the hierarchical architecture.

[0271] In some embodiments, when modulating the amplitude component and / or the frequency modulation component in the dynamic processing response driven by real-time vehicle driving parameters, it is also necessary to determine the front and back phase differences of the modulation loudness or frequency through a preset algorithm to enhance the real experience of the simulated sound wave.

[0272] Please continue to refer to Figure 14 , the sound wave generation module 12 further includes: a post-processing layer 124;

[0273] The post-processing layer 124 is configured to receive the target sound wave signal sent by the signal modulation layer and call the target sound effect component in the sound wave material module according to the user requirements; the target sound effect component is used to enhance the sound effect of the target sound wave signal. Like the modulation component and the target sound source component, they are all stored in the sound wave material module 11. All components in the sound wave material module 11 have the same input interface and output interface, and the input protocol and output protocol are unified.

[0274] The post-processing layer 124 is further configured to process the target sound wave signal based on the target sound effect component to obtain the processed target sound wave signal.

[0275] After receiving the multi-track audio signal (target sound wave signal) processed by the front end, the post-processing layer 124 can mount any number of post-processing components (also called target sound effect components) on any track to achieve a characteristic and rich effect design. The specific categories include, but are not limited to, flanging components, reverb components, equalization components, and delay components. Through the further processing of the target sound wave signal by the post-processing layer 124, the final real-time multi-channel sound wave signal is obtained and directly pushed to different speakers at multiple positions in the corresponding vehicle cockpit to achieve three-dimensional surround adjustment of the sound wave.

[0276] The schematic diagram of the architecture of the post-processing layer 124 corresponds to Figure 12 , and the unity of the input and output of the components in the post-processing layer 124 also determines that the post-processing layer 124 can be freely and unlimitedly added to the hierarchical architecture, and the post-processing hierarchical architecture diagram is similar to the modulation layer architecture diagram ( Figure 10 ).

[0277] In some embodiments, the sound wave material module 11 includes a component library 111;

[0278] The component library 111 responds to edit instructions for various types of components and performs corresponding processing based on the edit instructions;

[0279] Among them, the edit instructions include at least any one of addition, deletion, invocation, and modification, and the various types of components adopt the same input / output interface and input / output protocol. The embodiments of the present disclosure establish an atomized architecture, which can decompose the sound wave function into low-coupling atomic component units. Users can freely mount, combine, and delete these atomic components according to their own preferences under this architecture to meet various personalized and high-efficiency sound wave development requirements.

[0280] The number and categories of components (also called atomic components) in the component library 111 are numerous, but all atomic components can be used in any level (sound wave generation layer 122, signal modulation layer 123, post-processing layer 124) in the sound wave atomic architecture. For example, track splitting components and track merging components (two types of signal path processing atomic components) can be mounted at any level to generate new audio tracks at any time; dynamic gain atomic components (amplitude modulation components and / or frequency modulation components) can be mounted at any level to dynamically adjust the audio loudness at the current moment according to the input CAN signal value. Each component in the component library 111 provided by the embodiments of the present disclosure takes into account the characteristics of low coupling. By unifying the input and output protocols of each component, the efficiency of sound wave development is greatly facilitated.

[0281] Through the atomic function design with low coupling degree, various sound wave processing algorithms can be quickly integrated into the system, solving the problems of time-consuming and high complexity in the integration of multiple algorithms during the traditional sound wave development process. At the same time, the high versatility of the component library 111 supports the rapid expansion of algorithm functions, providing convenience for the transplantation, development, and iteration of other algorithms for subsequent new sound wave technologies.

[0282] The embodiments of the present disclosure are based on the atomic design concept and have strong openness and scalability. New sound source components, sound effect components, or other various functional components can be easily added to the component library in the form of atomic components without significantly adjusting the overall architecture.

[0283] The above embodiments can achieve the following technical effects:

[0284] 1. The embodiments of the present disclosure are based on the atomic design concept and have strong openness and scalability. New sound source components, sound effect components, etc. can be easily added to the system in the form of atomic components without significantly adjusting the overall architecture. Based on the established atomic architecture, the sound wave function can be decomposed into low-coupling atomic component units, and users can freely mount, combine, and delete these atomic components according to their preferences under this architecture, meeting various personalized and high-efficiency sound wave development requirements.

[0285] 2. An atomic hierarchical architecture is established, an independent and callable atomic component library is constructed, and the characteristics of pluggable and high scalability of atomic components are realized. This method greatly enhances the efficiency and flexibility of the development of simulated sound wave functions and reduces the coupling degree of the sound wave system architecture.

[0286] 3. It has the advantages of small resource occupancy, high reuse degree, and low redundancy in algorithm utilization, and is applicable to the simulated sound wave technology of new energy vehicles with high real-time requirements and the generation of other active sound waves in the cockpit.

[0287] 4. The establishment of the atomic architecture of the sound wave algorithm and the modular configuration are realized, reducing the redundancy of algorithm functions and significantly solving the problem of waste of computing resources caused by repeated or similar functions in different modules in the simulated sound wave algorithm in the related technology.

[0288] Figure 15 A sound wave control device shown according to some embodiments of the present disclosure, the device includes:

[0289] A processing unit 61, configured to obtain a target sound source component corresponding to user requirements and obtain an audio signal according to the target sound source component;

[0290] A modulation unit 62, configured to dynamically modulate the audio signal according to vehicle driving parameters to obtain a target sound wave signal;

[0291] A control unit 63 for outputting the target sound wave signal.

[0292] A sound wave control device, system and vehicle. The sound wave control device includes: obtaining a target sound source component corresponding to user needs, obtaining an audio signal according to the target sound source component, dynamically modulating the audio signal according to vehicle driving parameters to obtain a target sound wave signal, and outputting the target sound wave signal. The present disclosure obtains a corresponding target sound source component according to user needs, realizes the free configuration of the target sound source component, and realizes user-customized sound wave playback on demand; in addition, during the vehicle driving process, the audio signal obtained by free combination is dynamically modulated based on user needs and vehicle driving parameters, so that the finally formed target sound wave signal is dynamically adjusted according to the vehicle driving state, adapts to various scenarios during the driving process, and increases driving pleasure.

[0293] Further, in a possible implementation manner of the embodiment of the present disclosure, as Figure 16 shown, the processing unit 61 includes:

[0294] An obtaining module 611 for obtaining a single target sound source component or multiple target sound source components corresponding to the user needs from a component library;

[0295] A combining module 612 for combining the multiple target sound source components in series or by superposition to obtain the audio signal when the multiple target sound source components are obtained;

[0296] A first determining module 613 for obtaining the audio signal according to the single target sound source component when the single target sound source component is obtained.

[0297] Further, in a possible implementation manner of the embodiment of the present disclosure, as Figure 16 shown, the processing unit 61 further includes:

[0298] A second determining module 614 for determining to perform split-track processing and / or merge-track processing on the audio signal based on the user needs and the number of playback devices after obtaining a target sound source component corresponding to the user needs and obtaining an audio signal according to the target sound source component;

[0299] A processing module 615 for calling a split-track component and / or a merge-track component from the component library to perform split-track processing and / or merge-track processing on the target sound source component to obtain the processed audio signal;

[0300] The modulation unit is further configured to dynamically modulate the processed audio signal according to the vehicle driving parameters to obtain the target sound wave signal.

[0301] Further, in a possible implementation manner of the embodiment of the present disclosure, as Figure 16 shown, the modulation unit 62 includes:

[0302] A receiving module 621, configured to obtain real-time vehicle driving parameters;

[0303] A modulation module 622, configured to perform amplitude modulation processing and / or frequency modulation processing on the audio signal according to the real-time vehicle driving parameters to obtain the target sound wave signal.

[0304] Further, in a possible implementation manner of the embodiment of the present disclosure, as Figure 16 shown, the modulation module 622 includes:

[0305] A first determination sub-module 6221, configured to determine an amplitude interval corresponding to the real-time vehicle driving parameters from the amplitude curve; wherein, each vehicle driving parameter corresponds to an amplitude interval in the amplitude curve;

[0306] A second determination sub-module 6222, configured to determine a target loudness value according to the left and right endpoint values of the amplitude interval corresponding to the real-time vehicle driving parameters, wherein the left and right endpoint values correspond to loudness values;

[0307] A first modulation sub-module 6223, configured to perform amplitude modulation processing on the audio signal according to the target loudness value.

[0308] Further, in a possible implementation manner of the embodiment of the present disclosure, as Figure 16 shown, the modulation module 622 includes:

[0309] A third determination sub-module 6224, configured to determine a target loudness change speed corresponding to the real-time vehicle speed according to a preset correspondence between the vehicle speed and the loudness change speed;

[0310] A fourth determination sub-module 6225, configured to determine a target frequency change speed corresponding to the real-time vehicle motor speed according to a preset correspondence between the vehicle motor speed and the frequency change speed;

[0311] A fifth determination sub-module 6226, configured to determine a phase difference to be frequency-shifted according to the real-time frequency of the audio signal, the target frequency of the audio signal, the target loudness change speed, and the target frequency change speed;

[0312] A second modulation sub-module 6227, configured to perform frequency modulation processing on the audio signal according to the current frequency of the audio signal and the phase difference to be frequency-shifted.

[0313] Further, in a possible implementation manner of the embodiment of the present disclosure, as Figure 16As shown, the processing module 615 is further configured to:

[0314] Determine the amplitude of each harmonic corresponding to the real-time vehicle speed according to the mapping relationship between the preset vehicle speed and the amplitude of the harmonic;

[0315] Determine the target frequency conversion rate corresponding to the real-time motor speed according to the mapping relationship between the preset motor speed and the frequency conversion rate;

[0316] Perform split-track processing on the audio signal according to the amplitude of each harmonic and the target frequency conversion rate to obtain a plurality of single-track audio signals, where the processed audio signal includes the plurality of single-track audio signals.

[0317] Further, in a possible implementation manner of the embodiments of the present disclosure, as Figure 16 shown, the processing module 615 is further configured to:

[0318] Perform combined-track processing on the plurality of single-track audio signals included in the audio signal according to the real-time vehicle driving parameters to obtain a combined-track audio signal;

[0319] Determine the processed audio signal according to the combined-track audio signal and the loudness corresponding to each single-track audio signal before combined-track.

[0320] Further, in a possible implementation manner of the embodiments of the present disclosure, as Figure 16 shown, the device further includes:

[0321] An acquisition unit 64, configured to acquire a target sound effect component corresponding to user requirements from a component library before the control unit outputs the target sound wave signal;

[0322] A processing unit 65, configured to process the target sound wave signal based on the target sound effect component to obtain the processed target sound wave signal;

[0323] The control unit 63 is further configured to play the processed target sound wave signal through a speaker.

[0324] Regarding the device in the above embodiments, the specific manners in which each module performs operations have been described in detail in the embodiments related to the method, and will not be elaborated herein.

[0325] Figure 17 FIG. is a block diagram of a vehicle 700 shown according to an exemplary embodiment. For example, the vehicle 700 may be a hybrid vehicle, or a non-hybrid vehicle, an electric vehicle, a fuel cell vehicle, or other types of vehicles. The vehicle 700 may be an autonomous vehicle, a semi-autonomous vehicle, or a non-autonomous vehicle.

[0326] Referring to Figure 17 , vehicle 700 may include various subsystems. For example, an infotainment system 710, a perception system 720, a decision control system 730, a drive system 740, and a computing platform 750. Among them, vehicle 700 may also include more or fewer subsystems, and each subsystem may include multiple components. In addition, each subsystem and each component of vehicle 700 may be interconnected by wired or wireless means.

[0327] In some embodiments, the infotainment system 710 may include a communication system, an entertainment system, and a navigation system, etc.

[0328] The perception system 720 may include several sensors for sensing information about the environment around vehicle 700. For example, the perception system 720 may include a global positioning system (the global positioning system may be a GPS system, a Beidou system, or other positioning systems), an inertial measurement unit (IMU), lidar, millimeter-wave radar, ultrasonic radar, and a camera device.

[0329] The decision control system 730 may include a computing system, a vehicle controller, a steering system, an accelerator, and a braking system.

[0330] The drive system 740 may include components that provide motive power for vehicle 700. In one embodiment, the drive system 740 may include an engine, an energy source, a powertrain, and wheels. The engine may be one or a combination of an internal combustion engine, an electric motor, and an air compression engine. The engine is capable of converting the energy provided by the energy source into mechanical energy.

[0331] Some or all of the functions of vehicle 700 are controlled by the computing platform 750. The computing platform 750 may include at least one processor 751 and a memory 752. The processor 751 may execute instructions 753 stored in the memory 752.

[0332] The processor 751 may be any conventional processor, such as a commercially available CPU. The processor may also include, for example, a Graphic Process Unit (GPU), a Field Programmable Gate Array (FPGA), a System on Chip (SOC), an Application Specific Integrated Circuit (ASIC), or a combination thereof.

[0333] The memory 752 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0334] In addition to the instructions 753, the memory 752 can also store data, such as road maps, route information, data on the position, direction, speed, etc. of the vehicle. The data stored in the memory 752 can be used by the computing platform 750.

[0335] In the embodiments of the present disclosure, the processor 751 can execute the instructions 753 to complete all or part of the steps of the above-mentioned sound wave control method.

[0336] The present disclosure also provides a computer-readable storage medium, on which computer program instructions are stored, and when the program instructions are executed by a processor, the steps of the sound wave control method provided by the present disclosure are implemented.

[0337] In addition, the word "exemplary" is used herein to mean serving as an example, instance, or illustration. Any aspect or design described herein as "exemplary" is not necessarily to be understood as being advantageous compared to other aspects or designs. Instead, the use of the word exemplary is intended to present concepts in a concrete manner. As used herein, the term "or" is intended to mean an inclusive "or" rather than an exclusive "or". That is, unless otherwise specified or clear from the context, "X applies A or B" is intended to mean any arrangement in a natural inclusive arrangement. That is, if X applies A; X applies B; or X applies both A and B, then "X applies A or B" is satisfied in any of the foregoing instances. Additionally, unless otherwise specified or clear from the context indicating a singular form, the articles "a" and "an" as used in this application and the appended claims are generally understood to mean "one or more".

[0338] Similarly, although the present disclosure has been shown and described with respect to one or more implementations, equivalent variations and modifications will occur to those skilled in the art upon reading and understanding this specification and the drawings. The present disclosure includes all such modifications and variations and is limited only by the scope of the claims. Specifically with respect to the various functions performed by the components described above (e.g., elements, resources, etc.), unless otherwise indicated, the terms used to describe such components are intended to correspond to any component (functionally equivalent) that performs the specific function of the described component, even if not structurally equivalent to the disclosed structure. Additionally, although certain features of the present disclosure may have been disclosed with respect to only one of several implementations, such features may, as may be desired and advantageous for any given or particular application, be combined with one or more other features of other implementations. Further, with respect to the use of "comprising," "having," "including," "with," or variants thereof in the detailed description or claims, such terms are intended to be inclusive in a manner similar to the term "including."

[0339] Other embodiments of the present disclosure will readily occur to those of ordinary skill in the art in view of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include known or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are to be considered exemplary only, and the true scope and spirit of the present disclosure are pointed out by the following claims.

[0340] It should be understood that the present disclosure is not limited to the exact structures described above and shown in the drawings, and various modifications and changes may be made without departing from its scope. The scope of the present disclosure is limited only by the appended claims.

[0341] In the foregoing detailed description, reference has been made to the accompanying drawings, which illustrate by way of illustration specific aspects in which the present disclosure may be practiced. In this regard, directional or positional relationship terms such as "center," "longitudinal," "lateral," "length," "width," "thickness," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," "outer," "clockwise," "counterclockwise," "axial," "radial," "circumferential," etc. may be used with reference to the orientation of the described figures. Since the components of the described devices may be positioned in a number of different orientations, the directional terms are used for illustrative purposes and not for purposes of limitation. It should be understood that other aspects may be utilized and structural or logical changes may be made without departing from the concepts of the present disclosure. Accordingly, the following detailed description should not be construed in a limiting sense.

[0342] It should be understood that, unless otherwise specifically stated, the features of some embodiments of the present disclosure described herein can be combined with each other. As used herein, the term "and / or" includes any one of the related listed items and any combination of any two or more of them; similarly, "at least one of..." includes any one of the related listed items and any combination of any two or more of them.

[0343] It should be understood that, unless otherwise clearly specified and limited, the terms "engage", "attach", "mount", "connect", "couple", "fix", etc. used in the embodiments of the present disclosure should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or integrated; it can be a mechanical connection, an electrical connection, or in communication with each other; it can be directly connected, or indirectly connected through an intermediate medium, and can be the communication inside two elements or the interaction relationship between two elements, unless otherwise clearly limited. For those of ordinary skill in the art, the specific meanings of the above terms in this text can be understood according to specific circumstances.

[0344] In addition, the term "above" used for a component, element, or material layer formed "above" or located "above" a surface can be used herein to mean that the component, element, or material layer is "indirectly" positioned (e.g., placed, formed, deposited, etc.) on the surface such that one or more additional components, elements, or layers are disposed between the surface and the component, element, or material layer. However, the term "above" used for a component, element, or material layer formed "above" or located "above" a surface can also optionally have a specific meaning: the component, element, or material layer is "directly" positioned (e.g., placed, formed, deposited, etc.) on the surface, e.g., in direct contact with the surface.

[0345] Although terms such as "first", "second", and "third" may be used herein to describe various components, parts, regions, layers, or sections, these components, parts, regions, layers, or sections are not limited to these terms. On the contrary, these terms are only used to distinguish one component, part, region, layer, or section from another. Therefore, without departing from the teachings of the examples, the first component, part, region, layer, or section mentioned in the examples described herein can also be referred to as the second component, part, region, layer, or section. Additionally, the terms "first" and "second" are only used for descriptive purposes and should not be construed as indicating or implying relative importance or implicitly specifying the quantity of the indicated technical features. Thus, features defined with "first" and "second" can explicitly or implicitly include at least one of the features. In the description herein, the meaning of "a plurality of" is at least two, such as two, three, etc., unless otherwise specifically and clearly defined.

[0346] It should be understood that, as used herein, spatial relative terms, such as "above", "upper", "below", and "lower", are used to describe the relationship of one element shown in the figures to another element. In addition to the orientation depicted in the figures, such spatial relative terms are also intended to encompass different orientations of the device during use or operation. For example, if the device in the figures is flipped, an element described as "above" or "upper" relative to another element will then be "below" or "lower" relative to that other element. Thus, depending on the spatial orientation of the device, the term "above" encompasses both the above and below orientations. The device may have other orientations (e.g., rotated 90 degrees or in other orientations), and the spatial relative terms used herein should be interpreted accordingly.

Claims

1. A sound wave control method, characterized in that, Including: Obtain a target sound source component corresponding to user requirements, and obtain an audio signal according to the target sound source component; Dynamically modulate the audio signal according to vehicle driving parameters to obtain a target sound wave signal; Output the target sound wave signal.

2. The method according to claim 1, wherein The obtaining a target sound source component corresponding to user requirements and obtaining an audio signal according to the target sound source component includes: Obtain a single target sound source component or multiple target sound source components corresponding to the user requirements from a component library; In the case of obtaining the multiple target sound source components, combine the multiple target sound source components in series or by superposition to obtain the audio signal; In the case of obtaining the single target sound source component, obtain the audio signal according to the single target sound source component.

3. The method according to claim 1, wherein After obtaining a target sound source component corresponding to user requirements and obtaining an audio signal according to the target sound source component, it further includes: Based on the user requirements and the number of playback devices, determine to perform split-track processing and / or merge-track processing on the audio signal; Call a split-track component and / or a merge-track component from the component library to perform split-track processing and / or merge-track processing on the audio signal to obtain the processed audio signal; The dynamically modulating the audio signal according to vehicle driving parameters to obtain a target sound wave signal includes: Dynamically modulate the processed audio signal according to the vehicle driving parameters to obtain the target sound wave signal.

4. The method according to any one of claims 1-3, characterized in that, The dynamically modulating the audio signal according to vehicle driving parameters to obtain a target sound wave signal includes: Perform amplitude modulation processing and / or frequency modulation processing on the audio signal according to real-time vehicle driving parameters to obtain the target sound wave signal.

5. The method according to claim 4, wherein Performing amplitude modulation processing on the audio signal according to real-time vehicle driving parameters includes: Determine an amplitude range corresponding to the real-time vehicle driving parameters from an amplitude curve; wherein, each vehicle driving parameter corresponds to an amplitude range in the amplitude curve; Determine a target loudness value according to the left and right endpoint values of the amplitude range corresponding to the real-time vehicle driving parameters, wherein the left and right endpoint values correspond to loudness values; Perform amplitude modulation processing on the audio signal according to the target loudness value.

6. The method according to claim 4, wherein Performing frequency modulation processing on the audio signal according to real-time vehicle driving parameters includes: Determine a target loudness change speed corresponding to the real-time vehicle speed according to a preset correspondence between vehicle speed and loudness change speed; Determine a target frequency change speed corresponding to the real-time vehicle motor speed according to a preset correspondence between vehicle motor speed and frequency change speed; Determine a phase difference to be frequency-shifted according to the real-time frequency of the audio signal, the target frequency of the audio signal, the target loudness change speed, and the target frequency change speed; Perform frequency modulation processing on the audio signal according to the current frequency of the audio signal and the phase difference to be frequency-shifted.

7. The method according to claim 3, characterized in that The calling a split-track component from the component library to perform split-track processing on the audio signal to obtain the processed audio signal includes: Determine the amplitude of each harmonic corresponding to the real-time vehicle speed according to a preset mapping relationship between vehicle speed and the amplitude of harmonics; Determine the target frequency conversion rate corresponding to the real-time motor speed according to the mapping relationship between the preset motor speed and the frequency conversion rate; Perform split-track processing on the audio signal according to the amplitude of each harmonic and the target frequency conversion rate to obtain multiple single-track audio signals, where the processed audio signal includes the multiple single-track audio signals.

8. The method according to claim 3, wherein Call the track-combining component from the component library and perform track-combining processing on the audio signal to obtain the processed audio signal, including: Perform track-combining processing on the multiple single-track audio signals included in the audio signal according to the real-time vehicle driving parameters to obtain the combined audio signal; Determine the processed audio signal according to the combined audio signal and the loudness corresponding to each single-track audio signal before track combination.

9. The method according to claim 1, characterized in that, Before outputting the target sound wave signal, the method further includes: Obtain the target sound effect component corresponding to the user's demand from the component library; Process the target sound wave signal based on the target sound effect component to obtain the processed target sound wave signal; The outputting the target sound wave signal includes: Play the processed target sound wave signal through a speaker.

10. An acoustic wave control device, characterized in that, Including: A processing unit, configured to obtain a target sound source component corresponding to the user's demand and obtain an audio signal according to the target sound source component; A modulation unit, configured to dynamically modulate the audio signal according to vehicle driving parameters to obtain a target sound wave signal; An output unit, configured to output the target sound wave signal.

11. A sound wave control system, characterized in that, Including: A sound wave material module, configured to store multiple sound source components; A sound wave generation module, configured to, in response to the user's demand, obtain the target sound source component corresponding to the user's demand from the sound wave material module, obtain an audio signal, and dynamically modulate the audio signal according to the user's demand and vehicle driving parameters to obtain a target sound wave signal; An output module, configured to output the target sound wave signal generated by the sound wave generation module.

12. The system according to claim 11, wherein The sound wave generation module includes: a driving parameter input layer, a sound wave generation layer, and a signal modulation layer; where The driving parameter input layer is configured to obtain real-time vehicle driving parameters; The sound wave generation layer is configured to, in response to the user's demand, obtain the target sound source component corresponding to the user's demand from the sound wave material module, combine the target sound source components to obtain the audio signal; The sound wave generation layer is configured to process the audio signal based on the user's demand to obtain a processed audio signal; The signal modulation layer is configured to perform amplitude modulation processing and / or frequency modulation processing on the processed audio signal according to the real-time vehicle driving parameters to obtain the target sound wave signal.

13. The system according to claim 12, wherein The sound wave generation layer is further configured to determine to perform split-track processing and / or track-combining processing on the audio signal based on the user's demand and the number of playback devices; The sound wave generation layer is further configured to call a split-track component and / or a track-combining component to perform split-track processing and / or track-combining processing on the audio signal to obtain the processed audio signal.

14. The system according to claim 12, wherein The sound wave generation module further includes: a post-processing layer; The post-processing layer is configured to receive the target sound wave signal sent by the signal modulation layer and call a target sound effect component according to the user requirement; The post-processing layer is further configured to process the target sound wave signal based on the target sound effect component to obtain the processed target sound wave signal.

15. The system according to any one of claims 11-14, characterized in that, The sound wave material module includes a component library; The component library responds to an editing instruction for each type of component and performs corresponding processing based on the editing instruction; Wherein, the editing instruction includes at least one of addition, deletion, call, and modification, and each type of component adopts the same input / output interface and input / output protocol.

16. A vehicle, characterized in that, Comprising: A processor; A memory for storing processor-executable instructions; Wherein, the processor is configured to: Implement the steps of the method according to any one of claims 1-9.

17. A non-transitory computer-readable storage medium, characterized in that, When the instructions in the storage medium are executed by the processor of the mobile terminal, the mobile terminal is enabled to execute the sound wave control method according to any one of claims 1-9.

Citation Information

Cited By

  • Vehicle sound wave debugging system and electronic equipment

    CN121397425A