Sound wave synthesis method and device, electronic equipment and storage medium

Abstract

The invention provides a sound wave synthesis method and device, electronic equipment and a storage medium, and relates to the technical field of computers. The method comprises the following steps: acquiring hearing loss data of a vehicle driver; analyzing the hearing loss data to obtain an initial attenuation frequency of the driver; determining a frequency adjustment starting point according to the initial attenuation frequency; adjusting the phase of each first frequency point in the first audio signal to obtain a second audio signal, the first audio signal being an audio signal corresponding to the current working condition parameter of the vehicle, and the first frequency point being a frequency point greater than the frequency adjustment starting point; and synthesizing the sound wave based on the adjusted audio signal. Therefore, personalized hearing compensation can be carried out when the sound waves are synthesized, the hearing experience of a driver is improved, and the driving safety and experience feeling are improved.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a sound wave synthesis method, device, electronic device, and storage medium. Background Art

[0002] With the popularity of electric vehicles, people have an increasing demand for electronic sound waves to simulate the sound of engines and other components during driving to improve driving experience and provide sound warnings.

[0003] However, the current synthesis of sound waves does not take into account the differences in hearing abilities among different groups of people. The sound waves may not be fully perceived by the driver, affecting the driving experience. Summary of the Invention

[0004] The present disclosure aims to solve one of the technical problems in the related art at least to a certain extent.

[0005] The first embodiment of the present disclosure provides a sound wave synthesis method, comprising:

[0006] Obtaining hearing loss data of vehicle drivers;

[0007] Analyzing the hearing loss data to obtain the driver's starting attenuation frequency;

[0008] Determining a frequency adjustment starting point according to the starting attenuation frequency;

[0009] Adjusting the phase of each first frequency point in the first audio signal to obtain a second audio signal, wherein the first audio signal is an audio signal corresponding to a current operating parameter of the vehicle, and the first frequency point is a frequency point greater than the frequency adjustment starting point;

[0010] Based on the second audio signal, a sound wave is synthesized.

[0011] A second embodiment of the present disclosure provides a sound wave synthesis device, comprising:

[0012] An acquisition module, used for acquiring hearing loss data of a vehicle driver;

[0013] A first determination module is configured to analyze the hearing loss data to obtain the driver's starting attenuation frequency;

[0014] A second determining module is used to determine a frequency adjustment starting point according to the starting attenuation frequency;

[0015] a processing module, configured to adjust the phase of each first frequency point in the first audio signal to obtain a second audio signal, wherein the first audio signal is an audio signal corresponding to a current operating parameter of the vehicle, and the first frequency point is a frequency point greater than the frequency adjustment starting point;

[0016] A synthesis module is used to synthesize sound waves based on the second audio signal.

[0017] The third embodiment of the present disclosure proposes an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the sound wave synthesis method proposed in the first embodiment of the present disclosure is implemented.

[0018] The fourth embodiment of the present disclosure proposes a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the sound wave synthesis method proposed in the first embodiment of the present disclosure is implemented.

[0019] The sound wave synthesis method, device, electronic device, and storage medium provided by the present disclosure have the following beneficial effects:

[0020] In the disclosed embodiment, the driver's hearing loss data is first acquired and analyzed to determine the driver's starting attenuation frequency. Based on the starting attenuation frequency, a frequency adjustment starting point is determined. The phases of all first frequency points in the first audio signal that are greater than the starting frequency point are then adjusted to produce a second audio signal. Sound waves are then synthesized based on the second audio signal. Thus, by adjusting the audio signal based on the driver's hearing loss data to synthesize the sound waves, personalized hearing compensation can be achieved during the sound synthesis, improving the driver's auditory experience and enhancing driving safety and experience.

[0021] Additional aspects and advantages of the present disclosure will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The above and / or additional aspects and advantages of the present disclosure will become apparent and readily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0023] Figure 1 A schematic diagram of a flow chart of a sound wave synthesis method provided in one embodiment of the present disclosure;

[0024] Figure 2 A schematic flow chart of a sound wave synthesis method provided in another embodiment of the present disclosure;

[0025] Figure 3 A schematic structural diagram of a sound wave synthesis device provided in one embodiment of the present disclosure;

[0026] Figure 4 A block diagram of an exemplary electronic device suitable for implementing embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0027] The following describes in detail embodiments of the present disclosure, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present disclosure, and should not be construed as limiting the present disclosure.

[0028] The following describes the sound wave synthesis method, device, electronic device, and storage medium according to embodiments of the present disclosure with reference to the accompanying drawings.

[0029] Figure 1 A flow chart of a sound wave synthesis method provided in an embodiment of the present disclosure.

[0030] The embodiments of the present disclosure illustrate an example in which the sound synthesis method is configured in a sound synthesis device. The sound synthesis device can be applied to any electronic device so that the electronic device can perform the function of synthesizing sounds within the driver's audible range by combining the driver's hearing loss data.

[0031] like Figure 1 As shown, the sound wave synthesis method may include the following steps:

[0032] Step 101: Acquire hearing loss data of a vehicle driver.

[0033] Among them, hearing loss data is data that describes the degree of driver's hearing loss at different frequencies.

[0034] In the embodiments of the present disclosure, the hearing loss data of the vehicle driver can be obtained in a variety of ways. For example, the driver can first use an application software on an electronic device (such as a mobile phone, computer, etc.) to test the hearing ability, and then connect the electronic device to the vehicle computer, and send the hearing loss data obtained from the test to the sound wave synthesis system in the vehicle through the network. Alternatively, the test can be performed directly in the vehicle cabin, and the test audio can be played through the speakers in the car. The driver's hearing loss data can be obtained based on the user's feedback on whether the audio can be perceived, etc. This disclosure does not limit this.

[0035] Step 102: Analyze the hearing loss data to obtain the driver's starting attenuation frequency.

[0036] The starting attenuation frequency is used to indicate that when the audio frequency is greater than this frequency, the audio information that the driver can hear is incomplete.

[0037] In the disclosed embodiment, statistical algorithms or data analysis software can be used to analyze hearing loss data to determine the value above which the driver cannot obtain complete audio information. The frequency corresponding to this value can then be determined as the driver's starting attenuation frequency.

[0038] Step 103: Determine a frequency adjustment starting point according to the starting attenuation frequency.

[0039] It should be noted that in order to ensure the completeness of the driver's perception of sound waves, the frequency value corresponding to the frequency adjustment starting point should be smaller than the value of the starting attenuation frequency, so that the audio signal adjusted based on the frequency adjustment starting point can be heard clearly and accurately by the driver, thereby improving the driving experience and safety.

[0040] Optionally, the highest frequency of the audio signal at the current sampling frequency may be determined first, and then the frequency adjustment starting point may be determined according to the highest frequency and the starting attenuation frequency.

[0041] The highest frequency of the audio signal at the current sampling frequency refers to the highest value of the frequency corresponding to the reference audio signal stored in the sound synthesis system for generating sound, which is usually 24KHz.

[0042] In the embodiment of the present disclosure, the calculation formula of the frequency adjustment starting point can be shown as the following formula (1):

[0043] f0=2*f T -24000Hz (1)

[0044] Among them, f0 is the starting point of frequency adjustment, f T is the starting attenuation frequency.

[0045] Step 104: Adjust the phase of each first frequency point in the first audio signal to obtain a second audio signal.

[0046] The first audio signal is an audio signal corresponding to the current operating parameters of the vehicle, and the first frequency point is a frequency point greater than the frequency adjustment starting point.

[0047] In addition, the operating condition parameters may include at least one of the vehicle's current motor speed, vehicle speed, and other information, which is not limited in this disclosure.

[0048] It should be noted that different operating parameters should correspond to different audio signals. However, due to the limited space on the actual vehicle chip, the sound synthesis system cannot store the audio signals corresponding to all operating parameters. Therefore, some operating parameters and their corresponding audio signals can be stored as reference data. Then, when synthesizing the sound, the stored reference audio signals can be used to expand the audio signals corresponding to other operating parameters.

[0049] Optionally, based on the current operating condition parameters, a preset data table can be queried, and when any reference operating condition parameter in the data table matches the current operating condition parameter, a reference audio signal corresponding to any reference operating condition parameter in the data table is determined as the first audio signal.

[0050] The preset data table is a table for storing the corresponding relationship between a plurality of reference working condition parameters and reference audio signals.

[0051] In the embodiment of the present disclosure, the current operating condition parameters of the vehicle can be obtained through the Controller Area Network (CAN). Then, a query is made in the data table to determine whether the reference operating condition parameters identical to the current operating condition parameters are included. If the same reference operating condition parameters are found, the reference audio signal corresponding to the reference operating condition parameters in the data table can be directly determined as the first audio signal.

[0052] Alternatively, when each reference operating condition parameter in the data table does not match the current operating condition parameter, a reference audio signal corresponding to the reference operating condition parameter having the smallest difference with the current operating condition parameter may be first obtained from the data table.

[0053] For example, let's take the example of obtaining audio signals and synthesizing sound waves based on operating condition information of rotational speed. If the reference operating condition parameters in the data table include 2000 (in rpm) and 4000, and the corresponding reference audio signals A and B, respectively, and the current operating condition parameter is 1000, it can be seen that the current operating condition parameter is different from the value of each reference operating condition parameter. Therefore, the difference between the current operating condition parameter and each reference operating condition parameter can be calculated: 2000-1000=1000, 4000-1000=3000. Since 1000<3000, the reference audio signal A corresponding to the reference operating condition parameter of 2000 can be obtained.

[0054] It can be understood that in the above example, if the current operating condition parameter is 3000, it can be known that the difference between the current operating condition parameter and the two reference operating condition parameters (2000 and 4000) is 1000. At this time, either reference audio signal A or reference audio signal B can be obtained, and this disclosure does not limit this.

[0055] Then, the first frequency shift ratio may be determined according to the difference between the current operating condition parameters and the reference operating condition parameters.

[0056] The first frequency shift ratio refers to the ratio between the frequencies before and after the frequency shift when the first audio signal is obtained by frequency shifting based on the reference audio signal corresponding to the reference working condition parameter.

[0057] In the embodiment of the present disclosure, the ratio between the current operating condition parameter and the reference operating condition parameter may be calculated to obtain the first frequency shift ratio.

[0058] For example, the current operating condition parameter is 3000, and the reference operating condition parameter is 2000. Since 3000 / 2000=1.5, the first frequency shift magnification is 1.5.

[0059] Afterwards, the phase of the reference audio signal is adjusted based on the first frequency shift ratio to obtain a first audio signal.

[0060] In the disclosed embodiment, the reference audio signal can be first framed, and the frame shift between adjacent frames can be selected based on experience during the frame division, for example, the frame length can be any ratio ranging from one quarter to one half. Then, a Fast Fourier Transform (FFT) is performed on the framed audio data to obtain the amplitude and phase information of each frequency point of the reference audio signal. Therefore, when adjusting the reference audio signal, the frame shift under the current working condition parameters can be determined based on the first frequency shift ratio, as shown in the following formula (2):

[0061] hop out =ratio*hop in (2)

[0062] Among them, hop in is the frame shift selected when framing the reference audio signal, ratio is the first frequency shift ratio, hop out is the frame shift under the current working parameters.

[0063] Then, according to the phase vocoder algorithm, the audio phase under the current working parameters is obtained, and its formula is shown in the following formula (3):

[0064]

[0065] Among them, k represents the frequency point, i represents the current frame, and i-1 represents the previous frame. represents the phase, Δ t =hop out ÷Fs, Fs is the sampling rate, and ω(k) represents the frequency value corresponding to the kth frequency point.

[0066] After that, the amplitude and phase of each frequency point are combined to perform inverse Fourier transform to obtain the first audio signal in the time domain. The calculation formula is shown in the following formula (4):

[0067]

[0068] Among them, x i is the first audio signal in the i-th frame, |Xk＝0,1,…,N-1 | is the amplitude of each frequency point, which is the amplitude of the reference audio signal.

[0069] It should be noted that when synthesizing sound waves based on a single operating parameter (such as motor speed or vehicle speed), the first frequency shift ratio can be determined directly based on the ratio between the current operating parameter and the reference operating parameter. However, when multiple operating parameters (such as motor speed and vehicle speed) need to be considered when synthesizing sound waves, a frequency shift ratio can be determined based on each parameter separately, and then the multiple frequency shift ratios can be weighted and summed to obtain the first frequency shift ratio.

[0070] Among them, the summation weight values ​​corresponding to different parameters may be the same or different, and can be determined according to specific needs. This disclosure does not limit this.

[0071] For example, when synthesizing sound waves, it is necessary to consider both the motor speed and the vehicle speed. The frequency shift magnification corresponding to the motor speed is 1.5, the frequency shift magnification corresponding to the vehicle speed is 1.4, and the weight value corresponding to the motor speed is 0.4, and the weight value corresponding to the vehicle speed is 0.6. Since 1.5*0.4+1.4*0.6=1.44, the first frequency shift magnification can be obtained as 1.44.

[0072] In the disclosed embodiment, the phase corresponding to the frequency point in the first audio signal that is greater than the frequency adjustment starting point can be adjusted based on the first audio signal corresponding to the current operating parameters of the vehicle and the frequency adjustment starting point determined in combination with the driver's hearing loss data, thereby obtaining a second audio signal.

[0073] Step 105: synthesize sound waves based on the second audio signal.

[0074] In the disclosed embodiment, the second audio signal can be synthesized into a continuous real-time sound wave, as shown in the following formula (5). The synthesized sound wave can then be played through an audio output device such as a speaker or loudspeaker.

[0075]

[0076] Among them, x i is the audio signal used to synthesize the sound wave, that is, the second audio signal, L is the frame length, and u(n) is the unit step signal.

[0077] In the disclosed embodiment, the driver's hearing loss data is first acquired and analyzed to determine the driver's starting attenuation frequency. A frequency adjustment starting point is then determined based on the starting attenuation frequency. The phase of each first frequency point in the first audio signal that is greater than the starting frequency point is then adjusted to produce a second audio signal. Sound waves are then synthesized based on the second audio signal. Thus, by adjusting the audio signal based on the driver's hearing loss data to synthesize the sound waves, personalized hearing compensation can be achieved during the synthesized sound waves, improving the driver's auditory experience and enhancing driving safety and experience.

[0078] Figure 2 A flow chart of a sound wave synthesis method provided by an embodiment of the present disclosure is shown as follows: Figure 2 As shown, the sound wave synthesis method may include the following steps:

[0079] Step 201: Acquire hearing loss data of a vehicle driver.

[0080] Step 202: Analyze the hearing loss data to obtain the driver's starting attenuation frequency.

[0081] Step 203: Determine the frequency adjustment starting point according to the starting attenuation frequency.

[0082] For detailed description of the above steps 201 to 203, please refer to other embodiments of the present disclosure and will not be repeated here.

[0083] Step 204 : When the frequency adjustment starting point is greater than 0, the phase of each second frequency point in the first audio signal is kept unchanged, and the phase of each first frequency point is adjusted based on the second frequency shift magnification to obtain a second audio signal.

[0084] The second frequency point is a frequency point having a frequency lower than the frequency adjustment starting point.

[0085] It is understood that when the frequency adjustment starting point is greater than 0, the driver can clearly and accurately hear the complete audio information corresponding to the frequencies within the range from 0 to the frequency adjustment starting point. Therefore, the phase of each second frequency point in the first audio signal can be maintained unchanged, thereby reducing the amount of data adjusted for the first audio signal and improving adjustment efficiency. However, at first frequencies with frequencies greater than the frequency adjustment starting point, the driver's audio perception is reduced, and the acquired audio information may be inaccurate or incomplete. Therefore, by determining an appropriate frequency shift factor, the phase of each first frequency point in the first audio signal can be adjusted to enhance the audio effect.

[0086] Optionally, a reference frequency shift magnification corresponding to the frequency adjustment starting point and an initial frequency shift magnification corresponding to the first audio signal may be determined first, and then the second frequency shift magnification may be determined based on the reference frequency shift magnification, the initial frequency shift magnification and the correction factor.

[0087] Among them, the reference frequency shift ratio corresponding to the frequency adjustment starting point can be a value determined according to the ratio between the starting attenuation frequency and the frequency value of the frequency adjustment starting point, or it can be a value determined based on experience, and this disclosure does not limit this.

[0088] It should be noted that, when the first audio signal is a reference audio signal in a preset data table, the starting frequency shift magnification can be determined to be 1. Alternatively, when the first audio signal is obtained after adjustment based on the reference audio signal in a preset data table, the first frequency shift magnification based on which the first audio signal was obtained can be determined as the starting frequency shift magnification.

[0089] In the embodiment of the present disclosure, according to the reference frequency shift magnification, the initial frequency shift magnification and the correction factor, the formula for determining the second frequency shift magnification can be shown as the following formula (6):

[0090]

[0091] in, is the second frequency shift ratio, ratio0 is the reference frequency shift ratio, ratio is the starting frequency shift ratio, and μ is a correction factor, the value of which can be determined according to actual needs, for example, 0.5.

[0092] Then, the phase of each first frequency point can be adjusted based on the second frequency shift magnification, that is, the adjusted phase can be shown as the following formula (7):

[0093]

[0094] Afterwards, the second audio signal can be obtained by performing an inverse Fourier transform on the phase-adjusted first audio signal. The expression of the second audio signal in the time domain is shown in the following equation (8):

[0095]

[0096] Alternatively, when the frequency adjustment starting point is less than 0, the phase of each first frequency point may be adjusted based on the third frequency shift magnification to obtain the second audio signal.

[0097] Optionally, the starting frequency shift magnification corresponding to the first audio signal may be determined first, and then the third frequency shift magnification may be determined according to the starting frequency shift magnification, the correction factor, and the highest frequency of the audio signal.

[0098] In the embodiment of the present disclosure, the formula for determining the third frequency shift ratio according to the starting frequency shift ratio, the correction factor, and the highest frequency of the audio signal can be shown as the following formula (9):

[0099]

[0100] Then, the third frequency shift ratio obtained based on formula (9) can be substituted into formula (7) to obtain the adjusted phase, and then combined with formula (8) to obtain the second audio signal.

[0101] Step 205: synthesize sound waves based on the second audio signal.

[0102] For a detailed description of the above step 205, please refer to other embodiments of the present disclosure and will not be repeated here.

[0103] In the disclosed embodiment, when the frequency adjustment starting point is greater than 0, the phase of each second frequency point in the first audio signal is maintained unchanged, and the phase of each first frequency point is adjusted based on the second frequency shift ratio to obtain the second audio signal. Alternatively, when the frequency adjustment starting point is less than 0, the phase of each first frequency point is adjusted based on the third frequency shift ratio to obtain the second audio signal. Thus, by categorizing and discussing the frequency adjustment starting point, the phase adjustment direction of the first frequency point in different situations is determined to obtain a second audio signal that meets the driver's personalized needs, thereby improving the reliability of the audio signal.

[0104] In order to implement the above embodiments, the present disclosure also provides a sound wave synthesis device.

[0105] Figure 3 This is a schematic diagram of the structure of the sound wave synthesis device provided in an embodiment of the present disclosure.

[0106] like Figure 3 As shown, the sound wave synthesis device 300 may include:

[0107] An acquisition module 301 is used to acquire hearing loss data of a vehicle driver;

[0108] The first determination module 302 is configured to analyze the hearing loss data to obtain the driver's starting attenuation frequency;

[0109] A second determining module 303 is configured to determine a frequency adjustment starting point according to the starting attenuation frequency;

[0110] a processing module 304 configured to adjust the phase of each first frequency point in the first audio signal to obtain a second audio signal, wherein the first audio signal is an audio signal corresponding to the current operating parameters of the vehicle, and the first frequency point is a frequency point greater than a frequency adjustment starting point;

[0111] The synthesis module 305 is configured to synthesize sound waves based on the second audio signal.

[0112] In some embodiments, the second determining module 303 is specifically configured to:

[0113] Determine the highest frequency of the audio signal at the current sampling frequency;

[0114] Determine the starting point of frequency adjustment based on the highest frequency and the starting attenuation frequency.

[0115] In some embodiments, the processing module 304 is further configured to:

[0116] Based on the current working condition parameters, query the preset data table;

[0117] In a case where any reference operating condition parameter in the data table matches the current operating condition parameter, a reference audio signal corresponding to the reference operating condition parameter in the data table is determined as the first audio signal.

[0118] In some embodiments, the processing module 304 is further configured to:

[0119] When each reference operating condition parameter in the data table does not match the current operating condition parameter, a reference audio signal corresponding to the reference operating condition parameter having the smallest difference with the current operating condition parameter is obtained from the data table;

[0120] Determining a first frequency shift magnification according to a difference between the current operating condition parameters and the reference operating condition parameters;

[0121] Based on the first frequency shift magnification, the phase of the reference audio signal is adjusted to obtain a first audio signal.

[0122] In some embodiments, the second determining module 303 is specifically configured to:

[0123] When the frequency adjustment starting point is greater than 0, the phase of each second frequency point in the first audio signal is maintained unchanged, and the phase of each first frequency point is adjusted based on the second frequency shift ratio to obtain a second audio signal, wherein the second frequency point is a frequency point with a frequency less than the frequency adjustment starting point.

[0124] In some embodiments, the second determining module 303 is specifically configured to:

[0125] Determining a reference frequency shift ratio corresponding to a frequency adjustment starting point and a starting frequency shift ratio corresponding to the first audio signal;

[0126] A second frequency shift ratio is determined according to the reference frequency shift ratio, the initial frequency shift ratio and the correction factor.

[0127] In some embodiments, the second determining module 303 is specifically configured to:

[0128] When the frequency adjustment starting point is less than 0, the phase of each first frequency point is adjusted based on the third frequency shift magnification to obtain a second audio signal.

[0129] In some embodiments, the second determining module 303 is specifically configured to:

[0130] Determining a starting frequency shift ratio corresponding to the first audio signal;

[0131] A third frequency shift magnification is determined according to the initial frequency shift magnification, the correction factor, and the highest frequency of the audio signal.

[0132] In some embodiments, the second determining module 303 is specifically configured to:

[0133] In the case where the first audio signal is a reference audio signal in a preset data table, determining the starting frequency shift magnification to be 1; or,

[0134] In a case where the first audio signal is obtained after adjustment based on a reference audio signal in a preset data table, the first frequency shift magnification based on which the first audio signal is obtained is determined as the starting frequency shift magnification.

[0135] The functions and specific implementation principles of the above modules in the embodiments of the present disclosure can be referred to the above method embodiments and will not be repeated here.

[0136] The sound wave synthesis device of the disclosed embodiment first obtains the vehicle driver's hearing loss data, analyzes the hearing loss data to determine the driver's starting attenuation frequency, then determines the frequency adjustment starting point based on the starting attenuation frequency. The phase of each first frequency point in the first audio signal that is greater than the frequency starting point is then adjusted to obtain a second audio signal. The sound wave is then synthesized based on the second audio signal. Thus, by adjusting the audio signal based on the driver's hearing loss data to synthesize the sound wave, personalized hearing compensation can be achieved during the sound wave synthesis, improving the driver's auditory experience and enhancing driving safety and experience.

[0137] In order to implement the above embodiments, the present disclosure also proposes an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the sound wave synthesis method proposed in the above embodiments of the present disclosure is implemented.

[0138] In order to implement the above embodiments, the present disclosure further proposes a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, the sound wave synthesis method proposed in the above embodiments of the present disclosure is implemented.

[0139] Figure 4 A block diagram of an exemplary electronic device suitable for implementing embodiments of the present disclosure is shown. Figure 4 The electronic device 12 shown is only an example and should not limit the functionality and scope of use of the embodiments of the present disclosure.

[0140] like Figure 4 As shown, electronic device 12 is implemented as a general-purpose computing device. Components of electronic device 12 may include, but are not limited to, one or more processors or processing units 16, system memory 28, and a bus 18 that connects various system components (including system memory 28 and processing unit 16).

[0141] Bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures. Examples of such architectures include, but are not limited to, the Industry Standard Architecture (ISA) bus, the Micro Channel Architecture (MAC) bus, the Enhanced ISA bus, the Video Electronics Standards Association (VESA) local bus, and the Peripheral Component Interconnection (PCI) bus.

[0142] The electronic device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the electronic device 12, including volatile and non-volatile media, removable and non-removable media.

[0143] The memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. The electronic device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 34 may be configured to read and write non-removable, non-volatile magnetic media ( Figure 4 Not shown, often called a "hard drive"). Although Figure 4Although not shown, a disk drive for reading and writing to a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing to a removable non-volatile optical disk (e.g., a Compact Disc Read Only Memory (hereinafter referred to as: CD-ROM), a Digital Video Disc Read Only Memory (hereinafter referred to as: DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to the bus 18 via one or more data medium interfaces. The memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the various embodiments of the present disclosure.

[0144] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in memory 28. Such program modules 42 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may include an implementation of a network environment. Program modules 42 generally implement the functions and / or methods of the embodiments described herein.

[0145] The electronic device 12 can also communicate with one or more external devices 14 (e.g., a keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with the electronic device 12, and / or any device that enables the electronic device 12 to communicate with one or more other computing devices (e.g., a network card, a modem, etc.). This communication can occur via an input / output (I / O) interface 22. Furthermore, the electronic device 12 can communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network such as the Internet) via a network adapter 20. As shown, the network adapter 20 communicates with other modules of the electronic device 12 via the bus 18. It should be understood that, although not shown, other hardware and / or software modules can be used in conjunction with the electronic device 12, including but not limited to microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0146] The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing the methods mentioned in the above embodiments.

[0147] The technical solution disclosed herein adjusts the audio signal according to the driver's hearing loss data to synthesize sound waves, thereby achieving personalized hearing compensation when synthesizing sound waves, improving the driver's auditory experience, and enhancing driving safety and experience.

[0148] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine different embodiments or examples described in this specification and features of different embodiments or examples, unless they are mutually inconsistent.

[0149] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. Throughout the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

[0150] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present disclosure includes additional implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present disclosure belong.

[0151] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (e.g., a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, a "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk cartridge (magnetic device), random access memory (RAM), read-only memory (ROM), erasable and programmable read-only memory (EPROM or flash memory), fiber optic devices, and a portable compact disc read-only memory (CDROM). Furthermore, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing it in another suitable manner if necessary, and then storing it in a computer memory.

[0152] It should be understood that various parts of the present disclosure can be implemented using hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0153] Those skilled in the art will understand that all or part of the steps in the method of the above embodiment can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiment.

[0154] In addition, the functional units in the various embodiments of the present disclosure may be integrated into a single processing module, or each unit may exist physically separately, or two or more units may be integrated into a single module. The aforementioned integrated modules may be implemented in the form of hardware or in the form of software functional modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium.

[0155] The storage medium mentioned above may be a read-only memory, a magnetic disk, or an optical disk, etc. Although the embodiments of the present disclosure have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present disclosure. A person of ordinary skill in the art may make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present disclosure.

Claims

1. A sound wave synthesis method, characterized in that: The method comprises: Obtaining hearing loss data of vehicle drivers; Analyzing the hearing loss data to obtain the driver's starting attenuation frequency; Determining a frequency adjustment starting point according to the starting attenuation frequency; Adjusting the phase of each first frequency point in the first audio signal to obtain a second audio signal, wherein the first audio signal is an audio signal corresponding to a current operating parameter of the vehicle, and the first frequency point is a frequency point greater than the frequency adjustment starting point; Based on the second audio signal, a sound wave is synthesized.

2. The method according to claim 1, wherein The determining of the frequency adjustment starting point according to the starting attenuation frequency includes: Determine the highest frequency of the audio signal at the current sampling frequency; The frequency adjustment starting point is determined according to the maximum frequency and the starting attenuation frequency.

3. The method according to claim 1, wherein Before adjusting the phase of each first frequency point in the first audio signal, the method further includes: Based on the current operating condition parameters, query a preset data table; In a case where any reference operating condition parameter in the data table matches the current operating condition parameter, a reference audio signal corresponding to the reference operating condition parameter in the data table is determined as the first audio signal.

4. The method according to claim 3, wherein After querying the preset data table, the method further includes: When each reference operating condition parameter in the data table does not match the current operating condition parameter, obtaining from the data table a reference audio signal corresponding to a reference operating condition parameter having a minimum difference with the current operating condition parameter; determining a first frequency shift magnification according to a difference between the current operating condition parameter and the reference operating condition parameter; Based on the first frequency shift magnification, the phase of the reference audio signal is adjusted to obtain the first audio signal.

5. The method according to any one of claims 1 to 4, characterized in that: The step of adjusting the phase of each first frequency point in the first audio signal to obtain the second audio signal includes: When the frequency adjustment starting point is greater than 0, the phase of each second frequency point in the first audio signal is maintained unchanged, and the phase of each first frequency point is adjusted based on a second frequency shift ratio to obtain the second audio signal, wherein the second frequency point is a frequency point with a frequency less than the frequency adjustment starting point.

6. The method according to claim 5, wherein The method further comprises: Determining a reference frequency shift ratio corresponding to the frequency adjustment starting point and a starting frequency shift ratio corresponding to the first audio signal; The second frequency shift ratio is determined according to the reference frequency shift ratio, the initial frequency shift ratio and a correction factor.

7. The method according to any one of claims 1 to 4, characterized in that: The step of adjusting the phase of each first frequency point in the first audio signal to obtain the second audio signal includes: When the frequency adjustment starting point is less than 0, the phase of each first frequency point is adjusted based on the third frequency shift magnification to obtain the second audio signal.

8. The method according to claim 7, wherein The method further comprises: determining a starting frequency shift ratio corresponding to the first audio signal; The third frequency shift ratio is determined according to the starting frequency shift ratio, the correction factor, and the highest frequency of the audio signal.

9. The method according to claim 8, wherein The determining of the starting frequency shift ratio corresponding to the first audio signal includes: In a case where the first audio signal is a reference audio signal in a preset data table, determining the starting frequency shift magnification to be 1; or, In a case where the first audio signal is obtained after adjustment based on a reference audio signal in a preset data table, a first frequency shift magnification based on which the first audio signal is obtained is determined as the starting frequency shift magnification.

10. A sound wave synthesis device, characterized in that: The device comprises: An acquisition module, used for acquiring hearing loss data of a vehicle driver; A first determination module is configured to analyze the hearing loss data to obtain the driver's starting attenuation frequency; A second determining module is used to determine a frequency adjustment starting point according to the starting attenuation frequency; a processing module, configured to adjust the phase of each first frequency point in the first audio signal to obtain a second audio signal, wherein the first audio signal is an audio signal corresponding to a current operating parameter of the vehicle, and the first frequency point is a frequency point greater than the frequency adjustment starting point; A synthesis module is used to synthesize sound waves based on the second audio signal.

11. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor. When the processor executes the program, the method for synthesizing sound waves as claimed in any one of claims 1 to 9 is implemented.

12. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the sound wave synthesis method according to any one of claims 1 to 9 is implemented.

Images