Audio signal modulation method and device, equipment, storage medium and vehicle

Abstract

The invention discloses an audio signal modulation method and device, equipment, a storage medium and a vehicle. The method comprises the following steps: acquiring a fundamental frequency signal of an audio signal and an envelope signal of the fundamental frequency signal; under the condition that the frequency of the envelope signal is even times of the frequency of the fundamental frequency signal, pitch conversion is carried out on the envelope signal to obtain a conversion signal, and the frequency of the conversion signal is odd times of the frequency of the fundamental frequency signal; at least one energy value is extracted from the audio signal based on the conversion signal and the fundamental frequency signal, the audio signal comprises at least one frame of first signal, and each energy value corresponds to one frame of first signal; adjusting the amplitude of the audio signal based on each extracted energy value to obtain an output signal; wherein the output signal is obtained by scaling the amplitude of the audio signal according to a scaling coefficient, and the scaling coefficient is obtained according to the energy value. According to the embodiment of the invention, the problem that the audio signal is distorted or abnormal due to the existing signal modulation can be solved.

Description

Technical Field

[0001] The present application belongs to the field of signal processing technology, and in particular, relates to a modulation method, device, equipment, storage medium and vehicle for an audio signal. Background Art

[0002] Nowadays, in the process of dynamic range control of audio signals, the audio signals are usually converted into discrete energy values, and then the volume value of each frame is obtained based on the energy values.

[0003] However, in the process of converting the audio signal into discrete energy values, the negative half-wave of the audio signal (i.e., the part with negative amplitude) is converted into the positive half-wave (i.e., the part with positive amplitude), while the positive half-wave remains unchanged. The frequency of the signal envelope processed in this way will be twice the fundamental frequency of the original signal. If this envelope is used to modulate the audio signal, odd harmonics will be generated. These odd harmonics will change the harmonic structure and timbre characteristics of the audio signal, causing distortion or abnormality of the audio signal. Summary of the invention

[0004] The embodiments of the present application provide a method, apparatus, device, storage medium and vehicle for modulating an audio signal, which can solve the problem that existing signal modulation may cause audio signal distortion or abnormality.

[0005] In a first aspect, an embodiment of the present application provides a method for modulating an audio signal, the method comprising:

[0006] Acquire a baseband signal of an audio signal and an envelope signal of the baseband signal;

[0007] When the frequency of the envelope signal is an even multiple of the frequency of the baseband signal, pitch conversion is performed on the envelope signal to obtain a conversion signal, wherein the frequency of the conversion signal is an odd multiple of the baseband signal;

[0008] extracting at least one energy value from the audio signal based on the conversion signal and the baseband signal, wherein the audio signal includes at least one frame of the first signal, and each energy value corresponds to one frame of the first signal;

[0009] The amplitude of the audio signal is adjusted based on the extracted energy values ​​to obtain an output signal; wherein the output signal is obtained by scaling the amplitude of the audio signal according to a scaling factor, and the scaling factor is determined based on the energy value.

[0010] In some embodiments, adjusting the amplitude of the audio signal based on the extracted energy values ​​includes:

[0011] When the target energy value is greater than a preset threshold, querying an adjustment coefficient corresponding to the target energy value; wherein the target energy value is any one of the at least one energy value;

[0012] The amplitude of the first signal corresponding to the target energy value is adjusted based on the target energy value and the adjustment coefficient.

[0013] In some embodiments, adjusting the amplitude of the first signal corresponding to the target energy value based on the target energy value and the adjustment coefficient includes:

[0014] Determining a difference between the target energy value and the preset threshold value;

[0015] Multiplying the difference by the adjustment coefficient to obtain the scaling coefficient;

[0016] The amplitude of the first signal is adjusted according to the scaling factor.

[0017] In some embodiments, when the frequency of the envelope signal is an even multiple of the frequency of the baseband signal, performing pitch conversion on the envelope signal to obtain a conversion signal includes:

[0018] The frequency of the envelope signal is converted to one times the frequency of the baseband signal to obtain the converted signal.

[0019] In some embodiments, after performing pitch conversion on the envelope signal, the method further comprises:

[0020] Acquiring a time offset of the envelope signal during the pitch conversion process;

[0021] The time offset is eliminated on the conversion signal.

[0022] In some embodiments, the eliminating the time offset on the conversion signal comprises:

[0023] Determining a delay line according to the time offset; wherein the corresponding relationship between the time offset and the delay line is configured in advance;

[0024] The time offset of the conversion signal relative to the envelope signal is eliminated according to the delay line.

[0025] In a second aspect, an embodiment of the present application provides a modulation device for an audio signal, the device comprising:

[0026] An acquisition module, used to acquire a baseband signal of an audio signal and an envelope signal of the baseband signal;

[0027] a conversion unit, configured to, when the frequency of the envelope signal is an even multiple of the frequency of the baseband signal, perform pitch conversion on the envelope signal to obtain a conversion signal, wherein the frequency of the conversion signal is an odd multiple of the baseband signal;

[0028] an extraction module, configured to extract at least one energy value from the audio signal based on the conversion signal and the baseband signal, wherein the audio signal includes at least one frame of the first signal, and each energy value corresponds to one frame of the first signal;

[0029] An adjustment module is used to adjust the amplitude of the audio signal based on the extracted energy values ​​to obtain an output signal; wherein the output signal is obtained by scaling the amplitude of the audio signal according to a scaling factor, and the scaling factor is determined according to the energy value.

[0030] In a third aspect, an embodiment of the present application provides a modulation device for an audio signal, the device comprising: a processor and a memory storing computer program instructions;

[0031] When the processor executes the computer program instructions, the above audio signal modulation method is implemented.

[0032] In a fourth aspect, an embodiment of the present application provides a computer storage medium, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the above-mentioned audio signal modulation method is implemented.

[0033] In a fifth aspect, an embodiment of the present application provides a vehicle, comprising computer program instructions, which, when executed by a processor, implement the above audio signal modulation method.

[0034] In the present application, the baseband signal of the audio signal and the envelope signal of the baseband signal can be obtained, and then the envelope signal is pitch-converted when the frequency of the envelope signal is an even multiple of the frequency of the baseband signal, to obtain a conversion signal whose frequency is an odd multiple of the frequency of the baseband signal, and the baseband signal is amplitude-modulated using the conversion signal to obtain the final output signal. In this way, the even-order envelope in the amplitude modulation process is converted into an odd-order envelope, thereby avoiding the odd-order harmonic problem caused by the even-order envelope and avoiding the audio signal distortion or abnormality caused by the odd-order harmonics. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the drawings required for use in the embodiments of the present application will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0036] Figure 1 It is a flowchart of a method for modulating an audio signal provided in an embodiment of the present application;

[0037] Figure 2 is a time domain diagram of a modulation method for an audio signal provided by another embodiment of the present application;

[0038] Figure 3 is a time domain diagram of a modulation method for an audio signal provided by another embodiment of the present application;

[0039] Figure 4 is a time domain diagram of a modulation method for an audio signal provided by another embodiment of the present application;

[0040] Figure 5 It is a hardware structure diagram of an audio signal modulation device provided in an embodiment of the present application;

[0041] Figure 6 It is a structural schematic diagram of an audio signal modulation device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0042] The features and exemplary embodiments of various aspects of the present application will be described in detail below. In order to make the purpose, technical solutions and advantages of the present application clearer, the present application will be further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be understood that the specific embodiments described herein are only intended to explain the present application, rather than to limit the present application. For those skilled in the art, the present application can be implemented without the need for some of these specific details. The following description of the embodiments is only to provide a better understanding of the present application by illustrating the examples of the present application.

[0043] It should be noted that, in this article, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Moreover, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or device including a series of elements includes not only those elements, but also other elements not explicitly listed, or also includes elements inherent to such process, method, article or device. In the absence of further restrictions, the elements defined by the statement "include..." do not exclude the existence of other identical elements in the process, method, article or device including the elements.

[0044] It should be noted that, in the absence of conflict, the embodiments and features in the embodiments of the present application can be combined with each other. The embodiments will be described in detail below in conjunction with the accompanying drawings.

[0045] Specifically, in order to solve the problems of the prior art, the embodiments of the present application provide a method, device, equipment, storage medium and vehicle for modulating an audio signal. The following first introduces the method for modulating an audio signal provided in the embodiments of the present application.

[0046] Figure 1 A flow chart of a method for modulating an audio signal provided by an embodiment of the present application is shown. The method comprises the following steps:

[0047] S110, acquiring a baseband signal of an audio signal and an envelope signal of the baseband signal.

[0048] In this embodiment, the audio signal is a signal obtained by collecting sounds in the environment through an audio collection device, and the audio collection device can be a microphone or an audio sensor. The audio signal can be an electrical signal, which can be represented as a waveform that changes continuously in time on a spectrum diagram.

[0049] The fundamental frequency signal of an audio signal refers to the lowest frequency component of the audio signal in the spectrum. It represents the main tone or pitch in the audio signal and usually corresponds to the pitch perceived by the human ear.

[0050] The envelope signal of the baseband signal refers to the change pattern or profile of the baseband signal in the time domain. It describes the amplitude change of the baseband signal over a period of time, and can also be regarded as the curve of the amplitude change of the baseband signal over time.

[0051] S120, when the frequency of the envelope signal is an even multiple of the frequency of the baseband signal, performing pitch conversion on the envelope signal to obtain a conversion signal, wherein the frequency of the conversion signal is an odd multiple of the baseband signal;

[0052] In this embodiment, in the process of amplitude modulating the baseband signal by using the envelope signal, the baseband signal is used as the modulation signal and the envelope signal is used as the carrier signal. Since amplitude modulation involves the operation of multiplying the baseband signal and the envelope signal, if the frequency of the envelope signal is an even multiple of the frequency of the baseband signal, the multiplication result will cause the audio signal after amplitude modulation to generate odd harmonic components, and the generated odd harmonics may cause the audio signal to be distorted or abnormal.

[0053] Therefore, in order to avoid the generation of odd harmonics, the envelope signal needs to be pitch-shifted before amplitude modulation to change the frequency of the envelope signal. Specifically, pitch shifting is an audio processing technology that can move the pitch of the envelope signal up or down, so that the frequency of the envelope signal increases or decreases by a certain proportion, thereby changing its pitch.

[0054] The envelope signal may be pitch-converted to obtain a conversion signal, such that the frequency of the conversion signal is an odd multiple of the pitch signal.

[0055] S130, extracting at least one energy value from the audio signal based on the conversion signal and the baseband signal, wherein the audio signal includes at least one frame of the first signal, and each energy value corresponds to one frame of the first signal;

[0056] In this embodiment, after the envelope signal is pitch-converted to obtain a conversion signal, the obtained conversion signal can be used to perform amplitude modulation on the baseband signal. Since the frequency of the conversion signal is an odd multiple of the frequency of the baseband signal, the harmonics in the audio signal after amplitude modulation are basically even harmonics, thereby avoiding the odd harmonic problem caused by the even envelope and avoiding audio signal distortion or abnormality.

[0057] Specifically, an envelope follower may be used to track the amplitude change of the audio signal to obtain an energy value corresponding to the first signal of each frame, and each first signal of each frame corresponds to a continuous audio signal within a sampling period.

[0058] For example, the energy value of each frame of the first signal can be determined by the root mean square, that is, multiple sampling points are collected in each frame of the first signal, and the square of each sampling point is calculated, and then the square root of the average value of the squares of all sampling points is calculated as the energy value of the first signal of the frame.

[0059] In addition, the energy value of the first signal of each frame may be extracted by downsampling, box filter, square root taking, absolute value taking, and filter application.

[0060] S140, adjusting the amplitude of the audio signal based on the extracted energy values ​​to obtain an output signal; wherein the output signal is obtained by scaling the amplitude of the audio signal according to a scaling factor, and the scaling factor is determined according to the energy value.

[0061] In this embodiment, after obtaining at least one energy value, the original audio signal can be adjusted using the at least one energy value to obtain a final output signal. Specifically, since each energy value can represent the energy level of a frame of audio signal, a higher energy value usually corresponds to a higher volume, and a lower energy value corresponds to a lower volume. A gain coefficient or attenuation coefficient of each frame of audio signal can be determined based on the at least one energy value. Then, using a gain or attenuation algorithm determined in advance, the gain coefficient or attenuation coefficient is applied to the original audio signal to obtain an adjusted output signal.

[0062] In addition, in order to ensure that the selected gain or attenuation algorithm is suitable for the dynamic range of the audio signal, dynamic range control may sometimes be required to avoid excessive gain or attenuation of the audio signal during the adjustment process to maintain the audibility and balance of the audio.

[0063] In the present application, the baseband signal of the audio signal and the envelope signal of the baseband signal can be obtained, and then the envelope signal is pitch-converted when the frequency of the envelope signal is an even multiple of the frequency of the baseband signal, to obtain a conversion signal whose frequency is an odd multiple of the frequency of the baseband signal, and the baseband signal is amplitude-modulated using the conversion signal to obtain the final output signal. In this way, the even-order envelope in the amplitude modulation process is converted into an odd-order envelope, thereby avoiding the odd-order harmonic problem caused by the even-order envelope and avoiding the audio signal distortion or abnormality caused by the odd-order harmonics.

[0064] As an optional embodiment, the S140 includes:

[0065] When the target energy value is greater than a preset threshold, querying an adjustment coefficient corresponding to the target energy value; wherein the target energy value is any one of the at least one energy value;

[0066] The amplitude of the first signal corresponding to the target energy value is adjusted based on the target energy value and the adjustment coefficient.

[0067] In this embodiment, since the audio signal may have a problem of excessive dynamic range or peak overflow, peak overflow may cause audio distortion and clipping, making the audio sound unnatural or distorted, and excessive dynamic range may cause auditory fatigue and difficulty in hearing details. Therefore, for the part of the audio signal with excessively high peaks, it is necessary to adjust the amplitude of the audio signal to reduce the dynamic range and make the audio more balanced.

[0068] Specifically, each target energy value can be compared separately to see whether it is greater than a preset threshold. If the target energy value is greater than the preset threshold, it means that the amplitude of the first signal corresponding to the target energy value is too large and the first signal needs to be adjusted; if the target energy value is less than or equal to the preset threshold, it means that the amplitude of the first signal corresponding to the target energy value is normal and there is no need to adjust the first signal.

[0069] During the adjustment process, an adjustment coefficient corresponding to the target energy value may be queried based on the target energy value, and the amplitude of the first signal corresponding to the target energy value may be adjusted based on the target energy value and the adjustment coefficient.

[0070] In this embodiment, by adjusting the portion of the audio signal with a prominent amplitude, the dynamic range of the audio signal can be reduced, making the audio signal more balanced and avoiding excessive peaks and loss of details.

[0071] As an optional embodiment, adjusting the amplitude of the first signal corresponding to the target energy value based on the target energy value and the adjustment coefficient includes:

[0072] Determining a difference between the target energy value and the preset threshold value;

[0073] Multiplying the difference by the adjustment coefficient to obtain the scaling coefficient;

[0074] The amplitude of the first signal is adjusted according to the scaling factor.

[0075] In this embodiment, the target energy value may be a positive number between 0 and 1, and the preset threshold value may also be a positive number between 0 and 1. When the target energy value is greater than the preset threshold value, the difference between the target energy value and the preset threshold value may be calculated.

[0076] The adjustment coefficient corresponding to each target energy value is determined in advance by relevant technical personnel. The adjustment coefficient is also a positive number between 0 and 1. The scaling coefficient of the difference and the target energy value can be calculated, and the amplitude of the first signal is multiplied by the scaling coefficient to obtain the second signal after adjusting the first signal.

[0077] Since the adjustment coefficient and the difference are both positive numbers between 0 and 1, the scaling factor is also a positive number between 0 and 1. When the amplitude of the first signal is multiplied by the scaling factor, the amplitude of the second signal obtained will be smaller than the amplitude of the first signal as a whole, thereby reducing the amplitude of the first signal and achieving the effect of volume control.

[0078] As an optional embodiment, when the frequency of the envelope signal is twice the frequency of the baseband signal, S120 includes:

[0079] The frequency of the envelope signal is converted to one times the frequency of the baseband signal to obtain the converted signal.

[0080] In this embodiment, when the frequency of the envelope signal is twice that of the baseband signal, the envelope signal can be regarded as f m , considering the fundamental frequency signal as f c According to the sideband modulation principle, after the baseband signal is sideband modulated by the envelope signal, there will be two harmonics in the output signal, and the frequencies of the harmonics are f c -f m , and f c+ f m The output signal will contain Figure 2 One of the frequencies is f c The baseband signal and two frequencies are f c -f mand f c+ f m Harmonic signal. Since f m =2f c , so the frequencies of the two harmonic signals are -f c and 3f c , are all odd harmonics.

[0081] In order to avoid the modulated harmonics being all odd harmonics, the frequency of the envelope signal can be adjusted to be equal to the frequency of the baseband signal through pitch conversion to obtain a conversion signal. In this way, the baseband signal is sideband modulated by the conversion signal, and the frequencies of the two harmonic signals obtained will be 0 and 2f c , are all even harmonics.

[0082] In the above embodiment, the frequency of the envelope signal can be reduced, and the baseband signal can be sideband modulated based on the down-modulated envelope signal to avoid the odd harmonic problem caused by the even envelope generated by the sideband modulation, thereby improving the sound quality of the audio signal.

[0083] As an optional embodiment, after S120, the step further includes:

[0084] Acquiring a time offset of the envelope signal during the pitch conversion process;

[0085] The time offset is eliminated on the conversion signal.

[0086] In this embodiment, when the frequency of the envelope signal is changed by pitch conversion, the period of the waveform of the envelope signal will change accordingly. When the frequency of the envelope signal is increased, the period of the waveform will be shortened, which means that the waveform will complete more cycles in the same time period. Therefore, the conversion signal will move forward a certain time relative to the envelope signal, and this time difference is the time offset. When the frequency of the envelope signal is reduced, the period of the waveform will be extended, which means that the waveform will complete fewer cycles in the same time period. Therefore, the conversion signal will move backward a certain time relative to the envelope signal, and this time difference is also the time offset.

[0087] This time offset may cause the audio to sound unnatural to the user during playback and may also reduce the quality of the audio. Therefore, it is necessary to eliminate the time offset in the converted signal.

[0088] As an optional embodiment, the eliminating the time offset on the conversion signal includes:

[0089] Determining a delay line according to the time offset; wherein the corresponding relationship between the time offset and the delay line is configured in advance;

[0090] The time offset of the conversion signal relative to the envelope signal is eliminated according to the delay line.

[0091] In this embodiment, in order to eliminate the time offset caused by the pitch conversion, a delay line may be added to the output end of the pitch conversion, that is, the conversion signal to eliminate the time offset of the conversion signal relative to the envelope signal.

[0092] Specifically, the length of the delay line depends on the size of the time offset introduced by the pitch shift. By adjusting the length of the delay line, the time delay of the conversion signal and the time offset introduced by the pitch shift can be offset, thereby achieving time alignment between the conversion signal and the envelope signal. This can avoid time misalignment or incoherence in audio playback.

[0093] For example, if the audio signal is pitch-converted, the envelope signal is converted into a conversion signal. The waveforms of the envelope signal and the conversion signal in the time domain diagram can be shown as follows: Figure 3 As shown, it is obvious that there is a time offset between the envelope signal and the conversion signal, and the peaks and troughs of the envelope signal and the conversion signal do not correspond in time. Therefore, it is necessary to add a delay line to the conversion signal, such as Figure 4 As shown, the delay line can align the envelope signal and the conversion signal so that the peak of the envelope signal corresponds to the peak of the conversion signal in position, and the trough of the envelope signal corresponds to the trough of the conversion signal in position.

[0094] Based on the audio signal modulation method provided in the above embodiment, the present application also provides a specific implementation of an audio signal modulation device. Please refer to the following embodiment.

[0095] See first Figure 5 The audio signal modulation device 500 provided in the embodiment of the present application includes the following modules:

[0096] An acquisition module 501 is used to acquire a baseband signal of an audio signal and an envelope signal of the baseband signal;

[0097] A conversion module 502 is used for performing pitch conversion on the envelope signal to obtain a conversion signal when the frequency of the envelope signal is an even multiple of the frequency of the baseband signal, wherein the frequency of the conversion signal is an odd multiple of the baseband signal;

[0098] An extraction module 503, configured to extract at least one energy value from the audio signal based on the conversion signal and the baseband signal, wherein the audio signal includes at least one frame of the first signal, and each energy value corresponds to one frame of the first signal;

[0099] The adjustment module 504 is used to adjust the amplitude of the audio signal based on the extracted energy values ​​to obtain an output signal; wherein the output signal is obtained by scaling the amplitude of the audio signal according to a scaling factor, and the scaling factor is determined according to the energy value.

[0100] The device can obtain the baseband signal of the audio signal and the envelope signal of the baseband signal, and then, when the frequency of the envelope signal is an even multiple of the frequency of the baseband signal, perform pitch conversion on the envelope signal to obtain a conversion signal with a frequency that is an odd multiple of the frequency of the baseband signal, and use the conversion signal to perform amplitude modulation on the baseband signal to obtain the final output signal. In this way, the even-order envelope in the amplitude modulation process is converted into an odd-order envelope, thereby avoiding the odd-order harmonic problem caused by the even-order envelope and avoiding the audio signal distortion or abnormality caused by the odd-order harmonics.

[0101] As an implementation of the present application, the adjustment module 504 may include:

[0102] A query unit, configured to query an adjustment coefficient corresponding to the target energy value when the target energy value is greater than a preset threshold, wherein the target energy value is any one of the at least one energy value;

[0103] An adjustment unit is used to adjust the amplitude of the first signal corresponding to the target energy value based on the target energy value and the adjustment coefficient.

[0104] As an implementation of the present application, the above adjustment unit may also be used for:

[0105] Determining a difference between the target energy value and the preset threshold value;

[0106] Multiplying the difference by the adjustment coefficient to obtain the scaling coefficient;

[0107] The amplitude of the first signal is adjusted according to the scaling factor.

[0108] As an implementation of the present application, the above conversion module 502 may also be used for:

[0109] The frequency of the envelope signal is converted to one times the frequency of the baseband signal to obtain the converted signal.

[0110] As an implementation of the present application, the above-mentioned audio signal modulation device 500 may further include:

[0111] A time delay module is used to obtain the time offset of the envelope signal during the pitch conversion process.

[0112] The elimination module is used to eliminate the time offset on the conversion signal.

[0113] As an implementation of the present application, the above elimination module can also be used for:

[0114] Determining a delay line according to the time offset; wherein the corresponding relationship between the time offset and the delay line is configured in advance;

[0115] The time offset of the conversion signal relative to the envelope signal is eliminated according to the delay line. The audio signal modulation device provided in the embodiment of the present invention can implement each step in the above method embodiment, which will not be described here to avoid repetition.

[0116] Figure 6 A schematic diagram of the hardware structure of an audio signal modulation device provided in an embodiment of the present application is shown.

[0117] The audio signal modulation device may include a processor 601 and a memory 602 storing computer program instructions.

[0118] Specifically, the processor 601 may include a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application.

[0119] The memory 602 may include a large capacity memory for data or instructions. By way of example and not limitation, the memory 602 may include a hard disk drive (HDD), a floppy disk drive, a flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a universal serial bus (USB) drive or a combination of two or more of these. In appropriate cases, the memory 602 may include a removable or non-removable (or fixed) medium. In appropriate cases, the memory 602 may be inside or outside the integrated gateway disaster recovery device. In a specific embodiment, the memory 602 is a non-volatile solid-state memory.

[0120] The memory may include read-only memory (ROM), random access memory (RAM), magnetic disk storage media devices, optical storage media devices, flash memory devices, electrical, optical or other physical / tangible memory storage devices. Thus, typically, the memory includes one or more tangible (non-transitory) computer-readable storage media (e.g., memory devices) encoded with software including computer-executable instructions, and when the software is executed (e.g., by one or more processors), it is operable to perform the operations described with reference to the method according to an aspect of the present disclosure.

[0121] The processor 601 implements any one of the audio signal modulation methods in the above embodiments by reading and executing the computer program instructions stored in the memory 602 .

[0122] In one example, the modulation device of the audio signal may further include a communication interface 603 and a bus 610. Figure 6 As shown, the processor 601, the memory 602, and the communication interface 603 are connected via a bus 610 and communicate with each other.

[0123] The communication interface 603 is mainly used to implement communication between various modules, devices, units and / or equipment in the embodiments of the present application.

[0124] Bus 610 includes hardware, software or both, and the parts of the modulation device of audio signal are coupled to each other.For example, but not limitation, bus may include accelerated graphics port (AGP) or other graphics bus, enhanced industrial standard architecture (EISA) bus, front side bus (FSB), hypertransport (HT) interconnection, industrial standard architecture (ISA) bus, infinite bandwidth interconnection, low pin count (LPC) bus, memory bus, micro channel architecture (MCA) bus, peripheral component interconnection (PCI) bus, PCI-Express (PCI-X) bus, serial advanced technology attachment (SATA) bus, video electronics standard association local (VLB) bus or other suitable bus or two or more of these combinations. In appropriate cases, bus 610 may include one or more buses. Although the present application embodiment describes and shows a specific bus, the present application considers any suitable bus or interconnection.

[0125] The audio signal modulation device may be based on the above embodiment, thereby realizing the modulation method and apparatus combined with the above audio signal.

[0126] In addition, in combination with the audio signal modulation method in the above-mentioned embodiment, the embodiment of the present application may provide a computer storage medium for implementation. The computer storage medium stores computer program instructions; when the computer program instructions are executed by the processor, any one of the audio signal modulation methods in the above-mentioned embodiments is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here. Among them, the above-mentioned computer-readable storage medium may include a non-transitory computer-readable storage medium, such as a read-only memory (Read-Only Memory, referred to as ROM), a random access memory (Random Access Memory, referred to as RAM), a disk or an optical disk, etc., which are not limited here.

[0127] In addition, an embodiment of the present application also provides a vehicle, including computer program instructions, which, when executed by a processor, can implement the steps and corresponding contents of the aforementioned method embodiment.

[0128] It should be clear that the present application is not limited to the specific configuration and processing described above and shown in the figures. For the sake of simplicity, a detailed description of the known method is omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present application is not limited to the specific steps described and shown, and those skilled in the art can make various changes, modifications and additions, or change the order between the steps after understanding the spirit of the present application.

[0129] The functional blocks shown in the above block diagram can be implemented as hardware, software, firmware or a combination thereof. When implemented in hardware, it can be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, etc. When implemented in software, the elements of the present application are programs or code segments that are used to perform the required tasks. The program or code segment can be stored in a machine-readable medium, or transmitted on a transmission medium or a communication link by a data signal carried in a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, optical fiber media, radio frequency (RF) links, etc. The code segment can be downloaded via a computer network such as the Internet, an intranet, etc.

[0130] It should also be noted that the exemplary embodiments mentioned in this application describe some methods or systems based on a series of steps or devices. However, this application is not limited to the order of the above steps, that is, the steps can be performed in the order mentioned in the embodiment, or in a different order from the embodiment, or several steps can be performed simultaneously.

[0131] Aspects of the present disclosure are described above with reference to the flowcharts and / or block diagrams of the methods, devices and vehicles according to the embodiments of the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device to produce a machine so that these instructions executed by the processor of the computer or other programmable data processing device enable the implementation of the function / action specified in one or more boxes of the flowchart and / or block diagram. Such a processor can be, but is not limited to, a general-purpose processor, a special-purpose processor, a special application processor, or a field programmable logic circuit. It can also be understood that each box in the block diagram and / or flowchart and the combination of boxes in the block diagram and / or flowchart can also be implemented by dedicated hardware that performs a specified function or action, or can be implemented by a combination of dedicated hardware and computer instructions.

[0132] The above are only specific implementation methods of the present application. Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, modules and units described above can refer to the corresponding processes in the aforementioned method embodiments, and will not be repeated here. It should be understood that the protection scope of the present application is not limited to this. Any technician familiar with the technical field can easily think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the protection scope of this application.

Claims

1. A method for modulating an audio signal, characterized in that: The method comprises: Acquire a baseband signal of an audio signal and an envelope signal of the baseband signal; When the frequency of the envelope signal is an even multiple of the frequency of the baseband signal, pitch conversion is performed on the envelope signal to obtain a conversion signal, wherein the frequency of the conversion signal is an odd multiple of the baseband signal; extracting at least one energy value from the audio signal based on the conversion signal and the baseband signal, wherein the audio signal includes at least one frame of the first signal, and each energy value corresponds to one frame of the first signal; The amplitude of the audio signal is adjusted based on the extracted energy values ​​to obtain an output signal; wherein the output signal is obtained by scaling the amplitude of the audio signal according to a scaling factor, and the scaling factor is determined based on the energy value.

2. The method for modulating an audio signal according to claim 1, characterized in that: The adjusting the amplitude of the audio signal based on the extracted energy values ​​comprises: When the target energy value is greater than a preset threshold, querying an adjustment coefficient corresponding to the target energy value; wherein the target energy value is any one of the at least one energy value; The amplitude of the first signal corresponding to the target energy value is adjusted based on the target energy value and the adjustment coefficient.

3. The method for modulating an audio signal according to claim 2, characterized in that: The adjusting the amplitude of the first signal corresponding to the target energy value based on the target energy value and the adjustment coefficient includes: Determining a difference between the target energy value and the preset threshold value; Multiplying the difference by the adjustment coefficient to obtain the scaling coefficient; The amplitude of the first signal is adjusted according to the scaling factor.

4. The method for modulating an audio signal according to claim 1, characterized in that: When the frequency of the envelope signal is twice the frequency of the baseband signal, and when the frequency of the envelope signal is an even multiple of the frequency of the baseband signal, performing pitch conversion on the envelope signal to obtain a conversion signal comprises: The frequency of the envelope signal is converted to one times the frequency of the baseband signal to obtain the converted signal.

5. The method for modulating an audio signal according to claim 1, characterized in that: After the pitch conversion of the envelope signal, the method further comprises: Acquiring a time offset of the envelope signal during the pitch conversion process; The time offset is eliminated on the conversion signal.

6. The method for modulating an audio signal according to claim 5, characterized in that: The step of eliminating the time offset on the conversion signal comprises: Determining a delay line according to the time offset; wherein the corresponding relationship between the time offset and the delay line is configured in advance; The time offset of the conversion signal relative to the envelope signal is eliminated according to the delay line.

7. A modulation device for an audio signal, characterized in that: The device comprises: An acquisition module, used to acquire a baseband signal of an audio signal and an envelope signal of the baseband signal; A conversion module, configured to, when the frequency of the envelope signal is an even multiple of the frequency of the baseband signal, perform pitch conversion on the envelope signal to obtain a conversion signal, wherein the frequency of the conversion signal is an odd multiple of the baseband signal; an extraction module, configured to extract at least one energy value from the audio signal based on the conversion signal and the baseband signal, wherein the audio signal includes at least one frame of the first signal, and each energy value corresponds to one frame of the first signal; An adjustment module is used to adjust the amplitude of the audio signal based on the extracted energy values ​​to obtain an output signal; wherein the output signal is obtained by scaling the amplitude of the audio signal according to a scaling factor, and the scaling factor is determined according to the energy value.

8. A modulation device for an audio signal, characterized in that: The audio signal modulation device includes: a processor and a memory storing computer program instructions; When the processor executes the computer program instructions, the audio signal modulation method according to any one of claims 1 to 6 is implemented.

9. A computer storage medium, characterized in that The computer storage medium stores computer program instructions, and when the computer program instructions are executed by a processor, the audio signal modulation method according to any one of claims 1 to 6 is implemented.

10. A vehicle, characterized in that: The vehicle computer program instructions, when executed by a processor, implement the audio signal modulation method according to any one of claims 1 to 6.

Images