Sound wave synthesis method and device, electronic equipment and storage medium

Abstract

The invention provides a sound wave synthesis method and device, electronic equipment and a storage medium, and relates to the technical field of computers. The method comprises the steps that in the vehicle driving process, current working condition parameters of a vehicle and driving environment parameters of the position where the vehicle is located are obtained; according to the working condition parameter and the driving environment parameter, the first audio signal is adjusted to obtain a second audio signal, and the first audio signal is an audio signal corresponding to the current working condition parameter of the vehicle; and synthesizing the sound wave based on the second audio signal. Therefore, the sound has a stronger warning effect, a driver can more timely and accurately avoid the collision risk in the driving process, and the driving safety and experience feeling are improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a sound wave synthesis method, device, electronic device, and storage medium. Background Art

[0002] Since electric vehicles lack engines, they lack sound feedback during driving, resulting in a weaker driving experience. This has led to a demand for synthesizing electronic sound waves to simulate engine sounds in real time, thereby enhancing the driver's driving experience. Summary of the Invention

[0003] The present disclosure aims to solve one of the technical problems in the related art at least to a certain extent.

[0004] The first embodiment of the present disclosure provides a sound wave synthesis method, comprising:

[0005] During the driving process of the vehicle, obtain the current operating parameters of the vehicle and the driving environment parameters of the location;

[0006] Adjusting the first audio signal according to the operating condition parameters and the driving environment parameters to obtain a second audio signal, wherein the first audio signal is an audio signal corresponding to the current operating condition parameters of the vehicle;

[0007] Based on the second audio signal, a sound wave is synthesized.

[0008] A second embodiment of the present disclosure provides a sound wave synthesis device, comprising:

[0009] The acquisition module is used to obtain the vehicle's current operating parameters and the driving environment parameters at its location during the vehicle's driving process;

[0010] a processing module, configured to adjust the first audio signal according to the operating condition parameters and the driving environment parameters to obtain a second audio signal, wherein the first audio signal is an audio signal corresponding to the current operating condition parameters of the vehicle;

[0011] A synthesis module is used to synthesize sound waves based on the second audio signal.

[0012] The third embodiment of the present disclosure proposes an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the sound wave synthesis method proposed in the first embodiment of the present disclosure is implemented.

[0013] The fourth embodiment of the present disclosure proposes a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the sound wave synthesis method proposed in the first embodiment of the present disclosure is implemented.

[0014] The sound wave synthesis method, device, electronic device, and storage medium provided by the present disclosure have the following beneficial effects:

[0015] In the disclosed embodiment, while the vehicle is in motion, the current operating parameters of the vehicle and the parameters of the driving environment at the vehicle's location are first obtained. Then, based on the operating parameters and the driving environment parameters, a first audio signal is adjusted to obtain a second audio signal. A sound wave is then synthesized based on the second audio signal. Thus, by adjusting the audio signal based on the vehicle's driving state and driving environment, and then synthesizing the sound wave based on the adjusted audio signal, the sound wave can have a stronger warning effect, allowing the driver to more promptly and accurately avoid collision risks while driving, thereby improving driving safety and the driving experience.

[0016] Additional aspects and advantages of the present disclosure will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] The above and / or additional aspects and advantages of the present disclosure will become apparent and readily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0018] Figure 1 A schematic diagram of a flow chart of a sound wave synthesis method provided in one embodiment of the present disclosure;

[0019] Figure 2 A schematic flow chart of a sound wave synthesis method provided in another embodiment of the present disclosure;

[0020] Figure 3 A schematic flow chart of a sound wave synthesis method provided in another embodiment of the present disclosure;

[0021] Figure 4 A schematic structural diagram of a sound wave synthesis device provided in one embodiment of the present disclosure;

[0022] Figure 5 A block diagram of an exemplary electronic device suitable for implementing embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0023] The following describes in detail embodiments of the present disclosure, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present disclosure, and should not be construed as limiting the present disclosure.

[0024] The following describes the sound wave synthesis method, device, electronic device, and storage medium according to embodiments of the present disclosure with reference to the accompanying drawings.

[0025] Current sound wave synthesis solutions are primarily based on vehicle operating conditions, without considering the safety of the driving environment. This results in a weak warning effect and may compromise driving safety. Therefore, it is necessary to synthesize sound waves incorporating safety factors to provide drivers with more comprehensive driving feedback and help them avoid risks more promptly.

[0026] This disclosure proposes a sound synthesis method that integrates the vehicle's driving environment. First, during driving, the current operating parameters of the vehicle and the driving environment parameters of the vehicle's location are obtained. Then, a first audio signal is adjusted based on the operating and driving environment parameters to generate a second audio signal. The sound is then synthesized based on the second audio signal. This method enhances the sound's warning effect, allowing drivers to more promptly and accurately avoid collision risks while driving, thereby improving driving safety and overall driving experience.

[0027] Figure 1 A flow chart of a sound wave synthesis method provided by an embodiment of the present disclosure.

[0028] The embodiment of the present disclosure uses the sound synthesis method configured in a sound synthesis device as an example. The sound synthesis device can be applied to any electronic device so that the electronic device can adjust the frame shift of the audio signal according to the risk factor corresponding to the vehicle's driving state, and then synthesize sound based on the adjusted audio signal.

[0029] like Figure 1 As shown, the sound wave synthesis method may include the following steps:

[0030] Step 101 : During the driving process of the vehicle, the current operating parameters of the vehicle and the driving environment parameters of the location are obtained.

[0031] The operating condition parameters may include at least one of the motor speed, vehicle speed, and pedal opening, etc. The driving environment parameters may include the number of vehicles or obstacles around the location, the positional relationship between the current vehicle and surrounding vehicles or obstacles, and the distance, etc.

[0032] In the disclosed embodiment, the current operating parameters of the vehicle can be obtained through the Controller Area Network (CAN) bus, and the driving environment parameters of the vehicle's location can be obtained in real time through sensors such as lidar and cameras.

[0033] Step 102: Adjust the first audio signal according to the working condition parameters and the driving environment parameters to obtain a second audio signal.

[0034] The first audio signal refers to an audio signal corresponding to the current operating parameters of the vehicle. It should be noted that the first audio signal may be an audio signal corresponding to the operating parameters directly obtained from a plurality of pre-stored audio signals based on the current operating parameters; or, if no audio signal corresponding to the current operating parameters exists in the plurality of pre-stored audio signals, an audio signal obtained by expanding any audio signal using a phase vocoder.

[0035] In embodiments of the present disclosure, operating condition parameters and driving environment parameters can be used to determine whether a vehicle, if continuing to travel with the current operating condition parameters, will collide with a vehicle or obstacle in the driving environment. The first audio signal can then be adjusted accordingly based on the urgency of the collision, so that the resulting second audio signal provides feedback to the driver regarding whether the vehicle can continue to travel with the current operating condition parameters. It should be noted that in the present disclosure, the first audio signal can be adjusted to provide feedback to the driver regarding the safety of the vehicle's current driving state by adjusting characteristics such as its speed, pitch, or volume. For example, if the vehicle, continuing to travel with the current operating condition parameters, is likely to collide with a vehicle or obstacle in the driving environment, the playback speed of the first audio signal can be increased, making the adjusted second audio signal more likely to attract the driver's attention, thereby facilitating the driver's quick acquisition of information and timely risk avoidance, resulting in a more effective warning. Alternatively, the operating condition parameters and driving environment parameters can be input into a preset network model to obtain a risk factor output by the network model, and then the first audio signal can be adjusted based on the risk factor.

[0036] The preset network model refers to a trained convolutional neural network (CNN) model, which can analyze the risk of collision between the vehicle and other vehicles or obstacles based on the vehicle's current operating parameters and the driving environment parameters at its location, and output a risk factor.

[0037] The risk factor refers to the risk of a collision with another vehicle or obstacle if the vehicle continues to operate based on the current operating parameters. A higher risk factor indicates a greater collision risk, while a lower risk factor indicates a lower collision risk.

[0038] It should be noted that the value range of the risk coefficient can be 0 to 1. When the value of the risk coefficient is 0, it means that the current driving state of the vehicle is not dangerous. When the value of the risk coefficient is 1, it means that the current driving state of the vehicle is very dangerous.

[0039] In the disclosed embodiment, the first audio signal can be adjusted based on the risk factor output by the network model. The greater the risk factor, the greater the adjustment to the first audio signal. This results in a more pronounced difference between the adjusted second audio signal and the first audio signal, allowing the driver to receive warning information directly and quickly.

[0040] Step 103: synthesize sound waves based on the second audio signal.

[0041] In the embodiment of the present disclosure, the second audio signal can be output as a time domain waveform by utilizing a phase vocoder, thereby synthesizing sound waves.

[0042] In the disclosed embodiment, while the vehicle is in motion, the current operating parameters of the vehicle and the parameters of the driving environment at the vehicle's location are first obtained. A first audio signal is then adjusted based on the operating and driving environment parameters to generate a second audio signal. A sound wave is then synthesized based on the second audio signal. Thus, by adjusting the audio signal based on the vehicle's driving state and driving environment, and then synthesizing the sound wave based on the adjusted audio signal, the sound wave can have a stronger warning effect, allowing the driver to more promptly and accurately avoid collision risks while driving, thereby improving driving safety and the driving experience.

[0043] Figure 2 A flow chart of a sound wave synthesis method provided by an embodiment of the present disclosure is shown as follows: Figure 2 As shown, the sound wave synthesis method may include the following steps:

[0044] Step 201 : During the driving process of the vehicle, the current operating parameters of the vehicle and the driving environment parameters of the location are obtained.

[0045] For a detailed description of the above step 201, please refer to other embodiments of the present disclosure and will not be repeated here.

[0046] Step 202: Based on the current operating parameters, query a preset data table.

[0047] The preset data table is used to store the corresponding relationship between a plurality of preset reference working condition parameters and reference audio signals.

[0048] It should be noted that different operating parameters should correspond to different first audio signals. However, due to limited chip space in actual vehicles, it is not possible to store the audio signals corresponding to all operating parameters for sound synthesis. Therefore, the audio signals corresponding to some parameters can be stored as reference data, and then the audio signals corresponding to other operating parameters can be expanded based on this reference data.

[0049] Step 203 : When any reference operating condition parameter in the data table matches the current operating condition parameter, a reference audio signal corresponding to the reference operating condition parameter in the data table is determined as the first audio signal.

[0050] In the embodiment of the present disclosure, the data table is then queried to see whether it contains reference operating condition parameters identical to the current operating condition parameters. If the same reference operating condition parameters are found, the reference audio signal corresponding to the reference operating condition parameters in the data table can be directly determined as the first audio signal.

[0051] Alternatively, when each reference operating condition parameter in the data table does not match the current operating condition parameter, a reference audio signal corresponding to the reference operating condition parameter having the smallest difference with the current operating condition parameter may be first obtained from the data table.

[0052] For example, let's take the example of obtaining an audio signal based on the operating condition information of the rotational speed and then synthesizing the sound waves. If the reference operating condition parameters in the data table include 2000 (in rpm) and 4000, and the corresponding reference audio signals A and B, respectively, and the current operating condition parameter is 1000, it can be seen that the current operating condition parameter is different from the value of each reference operating condition parameter. Therefore, the difference between the current operating condition parameter and each reference operating condition parameter can be calculated: 2000-1000=1000, 4000-1000=3000. Since 1000<3000, the reference audio signal A corresponding to the reference operating condition parameter of 2000 can be obtained.

[0053] It can be understood that in the above example, if the current operating condition parameter is 3000, it can be known that the difference between the current operating condition parameter and the two reference operating condition parameters (2000 and 4000) is 1000. At this time, either reference audio signal A or reference audio signal B can be obtained, and this disclosure does not limit this.

[0054] Then, the first frequency shift ratio may be determined according to the difference between the current operating condition parameters and the reference operating condition parameters.

[0055] The first frequency shift ratio refers to the ratio between the frequencies before and after frequency shifting when frequency shifting is performed based on the reference audio signal corresponding to the reference working condition parameter to obtain the first audio signal.

[0056] In the embodiment of the present disclosure, the ratio between the current operating condition parameter and the reference operating condition parameter may be calculated to obtain the first frequency shift ratio.

[0057] For example, the current operating condition parameter is 3000, and the reference operating condition parameter is 2000. Since 3000 / 2000=1.5, the first frequency shift magnification is 1.5.

[0058] Afterwards, the phase of the reference audio signal is adjusted based on the first frequency shift ratio to obtain a first audio signal.

[0059] In the disclosed embodiment, the reference audio signal can be first framed, and the frame shift between adjacent frames can be selected based on experience during the framing process, for example, the frame length can be any ratio ranging from one quarter to one half. Then, a Fast Fourier Transform (FFT) is performed on the framed audio data to obtain the amplitude and phase information of each frequency point of the reference audio signal. Therefore, when adjusting the reference audio signal, the frame shift under the current working condition parameters can be determined based on the first frequency shift ratio, as shown in the following formula (1):

[0060] hop out =ratio*hop in (1)

[0061] Among them, hop in is the frame shift selected when framing the reference audio signal, ratio is the first frequency shift ratio, hop out is the frame shift under the current working parameters.

[0062] Then, according to the phase vocoder algorithm, the audio phase under the current working parameters is obtained, and its formula is shown in the following formula (2):

[0063]

[0064] Among them, k represents the frequency point, i represents the current frame, and i-1 represents the previous frame. represents the phase, Δ t =hop out ÷Fs, Fs is the sampling rate, and ω(k) represents the frequency value corresponding to the kth frequency point.

[0065] After that, the amplitude and phase of each frequency point are combined to perform inverse Fourier transform to obtain the first audio signal in the time domain. The calculation formula is shown in the following formula (3):

[0066]

[0067] Among them, x i is the first audio signal in the i-th frame, |X k＝0,1,…,N-1 | is the amplitude of each frequency point, which is the amplitude of the reference audio signal.

[0068] It should be noted that when only one operating parameter (such as motor speed or vehicle speed) is considered when synthesizing sound waves, the first frequency shift ratio can be determined directly based on the ratio between the current parameter and the reference parameter. However, when multiple operating parameters (such as motor speed and vehicle speed) need to be considered when synthesizing sound waves, a frequency shift ratio can be determined based on each parameter separately, and then the multiple frequency shift ratios can be weighted and summed to obtain the first frequency shift ratio.

[0069] Among them, the summation weight values ​​corresponding to different parameters may be the same or different, and can be determined according to specific needs. This disclosure does not limit this.

[0070] For example, when synthesizing sound waves, it is necessary to consider both the motor speed and the vehicle speed. The frequency shift magnification corresponding to the motor speed is 1.5, the frequency shift magnification corresponding to the vehicle speed is 1.4, and the weight value corresponding to the motor speed is 0.4, and the weight value corresponding to the vehicle speed is 0.6. Since 1.5*0.4+1.4*0.6=1.44, the first frequency shift magnification can be obtained as 1.44.

[0071] Step 204 : Adjust the first audio signal according to the operating condition parameters and the driving environment parameters to obtain a second audio signal.

[0072] Step 205: synthesize sound waves based on the second audio signal.

[0073] For detailed description of the above steps 204 and 205, please refer to other embodiments of the present disclosure and will not be repeated here.

[0074] In the disclosed embodiment, a preset data table is queried based on current operating parameters. If any reference operating parameter in the data table matches the current operating parameter, the reference audio signal corresponding to the reference operating parameter in the data table is directly determined as the first audio signal. This allows the acquisition of the first audio signal to achieve sound synthesis. This improves the efficiency and reliability of acquiring the first audio signal, making the sound synthesized based on the first audio signal more accurate and consistent with the actual operating state of the vehicle.

[0075] Figure 3 A flow chart of a sound wave synthesis method provided by an embodiment of the present disclosure is shown as follows: Figure 3 As shown, the sound wave synthesis method may include the following steps:

[0076] Step 301 : During the driving process of the vehicle, the current operating parameters of the vehicle and the driving environment parameters of the location are obtained.

[0077] Step 302: Determine the risk factor based on the operating condition parameters and the driving environment parameters.

[0078] For detailed description of the above steps 301 and 302, please refer to other embodiments of the present disclosure and will not be repeated here.

[0079] Step 303: Determine a starting frequency shift ratio corresponding to the first audio signal.

[0080] The first audio signal is an audio signal corresponding to the current operating parameters of the vehicle.

[0081] It should be noted that, when the first audio signal is a reference audio signal in a preset data table, the starting frequency shift magnification can be determined to be 1. Alternatively, when the first audio signal is obtained after adjustment based on the reference audio signal in a preset data table, the first frequency shift magnification based on which the first audio signal was obtained can be determined as the starting frequency shift magnification.

[0082] Step 304: Adjust the frame shift of the first audio signal according to the starting frequency shift magnification and the risk factor to obtain a second audio signal.

[0083] The frame shift refers to the overlapping portion between adjacent frames in the audio signal. By adjusting the size of the frame shift, the playback speed of the audio signal can be adjusted.

[0084] It is understandable that audio played at a faster speed is more likely to attract the driver's attention, and helps the driver quickly obtain information and avoid risks in a timely manner, with a stronger warning effect. Therefore, when adjusting the first audio signal, the audio playback speed of the audio signal can be increased by adjusting the frame shift of the first audio signal.

[0085] In the embodiment of the present disclosure, the adjusted frame shift can be calculated according to the starting frequency shift ratio and the risk factor as shown in the following formula (4):

[0086] hop out =ratio*(1+α)*hop in (4)

[0087] Among them, ratio is the starting frequency shift ratio, α is the risk factor, hop in The frame shift of the reference audio signal used when determining the first audio signal.

[0088] It should be noted that since the phase vocoder adjusts the rising speed of the synthesized sound wave by changing the frame shift and phase of the audio signal, when adjusting the first audio signal according to the risk factor, the phase of the first audio signal can also be adjusted, as shown in the following formula (5):

[0089]

[0090] in, represents the adjusted phase of the k-th frequency point in the current frame, Fs is the sampling rate, and ω(k) represents the frequency value corresponding to the k-th frequency point.

[0091] Then, the frequency domain data can be corrected using the adjusted phase and then subjected to inverse Fourier transform, as shown in the following formula (6):

[0092]

[0093] Afterwards, a second audio signal can be obtained according to the audio signal obtained by formula (6) and the adjusted frame shift obtained by formula (4).

[0094] Step 305: synthesize sound waves based on the second audio signal.

[0095] In the embodiment of the present disclosure, the second audio signal can be output as a time domain waveform by using a phase vocoder, as shown in the following equation (7), so that the sound wave can be synthesized.

[0096]

[0097] Among them, L is the frame length, x i (ni×ratio*(1+α)*hop in ) is the second audio signal obtained after frame shift adjustment, and u(n) is the unit transition signal.

[0098] It should be noted that in the present disclosure, in order to create the driver's subjective perception experience of the continuous rise of audio, the synthesized sound waves can be replayed periodically. Therefore, when the climbing speed of the phase vocoder is adjusted, the interval of audio playback can also be adjusted accordingly according to the risk factor.

[0099] Optionally, the preset sound wave playing time interval may be updated according to the risk factor to obtain an updated time interval, and then the sound wave is played based on the updated time interval.

[0100] In the embodiment of the present disclosure, the corresponding relationship between the sound wave playback time interval and the risk factor can be expressed as the following formula (8):

[0101]

[0102] in, is the updated time interval, T s is the time interval of sound wave playback when safety factors are not considered, and T s It can be a fixed value pre-set according to actual needs, and this disclosure does not limit this value.

[0103] It is understandable that when the risk factor of the current vehicle driving environment is relatively high, by reducing the time interval between sound waves, the continuity and urgency of the sound waves can be increased, ensuring that the safety information contained in the sound waves can be obtained by the driver more quickly, so that timely measures can be taken to avoid risks and improve driving safety.

[0104] In this embodiment, after determining the risk factor corresponding to the current vehicle driving state, the initial frequency shift magnification corresponding to the first audio signal corresponding to the current operating parameters is determined. Based on the initial frequency shift magnification and the risk factor, the frame shift of the first audio signal is adjusted to generate a second audio signal. This makes the adjusted audio signal more accurate and reliable, providing a stronger warning effect, thereby improving the practicality and reliability of the synthesized sound.

[0105] In order to implement the above embodiments, the present disclosure also provides a sound wave synthesis device.

[0106] Figure 4 This is a schematic diagram of the structure of the sound wave synthesis device provided in an embodiment of the present disclosure.

[0107] like Figure 4 As shown, the sound wave synthesis device 400 may include:

[0108] The acquisition module 401 is used to obtain the vehicle's current operating parameters and the driving environment parameters at the location during the vehicle's driving process;

[0109] The processing module 402 is configured to adjust the first audio signal according to the operating condition parameters and the driving environment parameters to obtain a second audio signal, wherein the first audio signal is an audio signal corresponding to the current operating condition parameters of the vehicle;

[0110] The synthesis module 403 is configured to synthesize sound waves based on the second audio signal.

[0111] In some embodiments, the processing module 402 is specifically configured to:

[0112] Inputting the working condition parameters and driving environment parameters into the preset network model to obtain the risk coefficient output by the network model;

[0113] The first audio signal is adjusted according to the risk factor.

[0114] In some embodiments, the processing module 402 is further configured to:

[0115] Based on the current working condition parameters, query the preset data table;

[0116] In a case where any reference operating condition parameter in the data table matches the current operating condition parameter, a reference audio signal corresponding to the reference operating condition parameter in the data table is determined as the first audio signal.

[0117] In some embodiments, the processing module 402 is further configured to:

[0118] When each reference operating condition parameter in the data table does not match the current operating condition parameter, a reference audio signal corresponding to the reference operating condition parameter having the smallest difference with the current operating condition parameter is obtained from the data table;

[0119] Determining a first frequency shift magnification according to a difference between the current operating condition parameters and the reference operating condition parameters;

[0120] Based on the frequency shift magnification, the phase of the reference audio signal is adjusted to obtain a first audio signal.

[0121] In some embodiments, the processing module 402 is specifically configured to:

[0122] Determining a starting frequency shift ratio corresponding to the first audio signal;

[0123] The frame shift of the first audio signal is adjusted according to the starting frequency shift magnification and the risk factor to obtain a second audio signal.

[0124] In some embodiments, the processing module 402 is specifically configured to:

[0125] In the case where the first audio signal is a reference audio signal in a preset data table, determining the starting frequency shift magnification to be 1; or,

[0126] In a case where the first audio signal is obtained after adjustment based on a reference audio signal in a preset data table, the first frequency shift magnification based on which the first audio signal is obtained is determined as the starting frequency shift magnification.

[0127] In some embodiments, the synthesis module 403 is specifically configured to:

[0128] According to the risk factor, the preset sound wave playing time interval is updated to obtain an updated time interval;

[0129] Based on the updated time interval, the sound wave is played.

[0130] The functions and specific implementation principles of the above modules in the embodiments of the present disclosure can be referred to the above method embodiments and will not be repeated here.

[0131] The sound synthesis device of the disclosed embodiment first obtains the vehicle's current operating parameters and the driving environment parameters of its location while the vehicle is in motion. It then adjusts a first audio signal based on the operating and driving environment parameters to generate a second audio signal, and then synthesizes the sound based on the second audio signal. Thus, by adjusting the audio signal based on the vehicle's driving state and driving environment, and then synthesizing the sound based on the adjusted audio signal, the sound can have a stronger warning effect, allowing drivers to more promptly and accurately avoid collision risks while driving, thereby improving driving safety and the driving experience.

[0132] In order to implement the above embodiments, the present disclosure also proposes an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the sound wave synthesis method proposed in the above embodiments of the present disclosure is implemented.

[0133] In order to implement the above embodiments, the present disclosure further proposes a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the sound wave synthesis method proposed in the above embodiments of the present disclosure is implemented.

[0134] Figure 5 A block diagram of an exemplary electronic device suitable for implementing embodiments of the present disclosure is shown. Figure 5 The electronic device 12 shown is only an example and should not limit the functionality and scope of use of the embodiments of the present disclosure.

[0135] like Figure 5 As shown, electronic device 12 is implemented as a general-purpose computing device. Components of electronic device 12 may include, but are not limited to, one or more processors or processing units 16, system memory 28, and a bus 18 that connects various system components (including system memory 28 and processing unit 16).

[0136] Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. Examples of such architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnection (PCI) bus.

[0137] The electronic device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the electronic device 12, including volatile and non-volatile media, removable and non-removable media.

[0138] The memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. The electronic device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 34 may be configured to read and write non-removable, non-volatile magnetic media ( Figure 5 Not shown, often called a "hard drive"). Although Figure 5 Although not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a Compact Disc Read Only Memory (hereinafter referred to as: CD-ROM), a Digital Video Disc Read Only Memory (hereinafter referred to as: DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to the bus 18 via one or more data medium interfaces. The memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the various embodiments of the present disclosure.

[0139] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28. Such program modules 42 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may include an implementation of a network environment. Program modules 42 generally implement the functions and / or methods of the embodiments described herein.

[0140] The electronic device 12 can also communicate with one or more external devices 14 (e.g., a keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with the electronic device 12, and / or any device that enables the electronic device 12 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). This communication can occur via an input / output (I / O) interface 22. Furthermore, the electronic device 12 can communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via a network adapter 20. As shown, the network adapter 20 communicates with other modules of the electronic device 12 via the bus 18. It should be understood that, although not shown, other hardware and / or software modules can be used in conjunction with the electronic device 12, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0141] The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing the methods mentioned in the above embodiments.

[0142] The technical solution disclosed herein adjusts the audio signal according to the vehicle's driving status and driving environment, and then synthesizes sound waves based on the adjusted audio signal, so that the sound waves have a stronger warning effect, allowing drivers to avoid collision risks during driving more promptly and accurately, thereby improving driving safety and experience.

[0143] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments or examples described in this specification and features of different embodiments or examples, unless they are mutually inconsistent.

[0144] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. Throughout the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

[0145] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present disclosure includes additional implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present disclosure belong.

[0146] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (e.g., a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk cartridge (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and programmable read-only memory (EPROM or flash memory), fiber optic devices, and a portable compact disc read-only memory (CDROM). Furthermore, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing it in another suitable manner if necessary, and then storing it in a computer memory.

[0147] It should be understood that various parts of the present disclosure can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0148] Those skilled in the art will understand that all or part of the steps in the method of the above embodiment can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiment.

[0149] In addition, the functional units in the various embodiments of the present disclosure may be integrated into a single processing module, or each unit may exist physically separately, or two or more units may be integrated into a single module. The aforementioned integrated modules may be implemented in the form of hardware or in the form of software functional modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium.

[0150] The storage medium mentioned above may be a read-only memory, a magnetic disk, or an optical disk, etc. Although the embodiments of the present disclosure have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present disclosure. A person of ordinary skill in the art may make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present disclosure.

Claims

1. A sound wave synthesis method, characterized in that: The method comprises: During the driving process of the vehicle, obtain the current operating parameters of the vehicle and the driving environment parameters of the location; Adjusting the first audio signal according to the operating condition parameters and the driving environment parameters to obtain a second audio signal, wherein the first audio signal is an audio signal corresponding to the current operating condition parameters of the vehicle; Based on the second audio signal, a sound wave is synthesized.

2. The method according to claim 1, wherein The adjusting the first audio signal according to the operating condition parameter and the driving environment parameter includes: Inputting the operating condition parameters and driving environment parameters into a preset network model to obtain a risk coefficient output by the network model; The first audio signal is adjusted according to the risk factor.

3. The method according to claim 2, wherein Before adjusting the first audio signal according to the risk factor, the method further includes: Based on the current operating condition parameters, query a preset data table; In a case where any reference operating condition parameter in the data table matches the current operating condition parameter, a reference audio signal corresponding to the reference operating condition parameter in the data table is determined as the first audio signal.

4. The method according to claim 3, wherein After querying the preset data table, the method further includes: When each reference operating condition parameter in the data table does not match the current operating condition parameter, obtaining from the data table a reference audio signal corresponding to a reference operating condition parameter having a minimum difference with the current operating condition parameter; determining a first frequency shift magnification according to a difference between the current operating condition parameter and the reference operating condition parameter; Based on the frequency shift magnification, the phase of the reference audio signal is adjusted to obtain the first audio signal.

5. The method according to any one of claims 1 to 4, characterized in that: The adjusting the first audio signal according to the operating condition parameter and the driving environment parameter to obtain the second audio signal includes: determining a starting frequency shift ratio corresponding to the first audio signal; The frame shift of the first audio signal is adjusted according to the starting frequency shift magnification and the risk factor to obtain a second audio signal.

6. The method according to claim 5, wherein The determining of the starting frequency shift ratio corresponding to the first audio signal includes: In a case where the first audio signal is a reference audio signal in a preset data table, determining the starting frequency shift magnification to be 1; or, In a case where the first audio signal is obtained after adjustment based on a reference audio signal in a preset data table, a first frequency shift magnification based on which the first audio signal is obtained is determined as the starting frequency shift magnification.

7. The method according to any one of claims 2 to 4, characterized in that: After determining the risk factor, the method further includes: updating the preset sound wave playing time interval according to the risk factor to obtain an updated time interval; Based on the updated time interval, sound waves are played.

8. A sound wave synthesis device, characterized in that: The device comprises: The acquisition module is used to obtain the vehicle's current operating parameters and the driving environment parameters at its location during the vehicle's driving process; a processing module, configured to adjust the first audio signal according to the operating condition parameters and the driving environment parameters to obtain a second audio signal, wherein the first audio signal is an audio signal corresponding to the current operating condition parameters of the vehicle; A synthesis module is used to synthesize sound waves based on the second audio signal.

9. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the program, the method for synthesizing sound waves as claimed in any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the sound wave synthesis method according to any one of claims 1 to 7 is implemented.

Images