Signal generation method and device, equipment and storage medium

Abstract

The invention provides a signal generation method and device, equipment and a storage medium, and relates to the technical field of audio data processing, and the method comprises the steps: obtaining a to-be-processed first time domain signal, the first time domain signal comprises a plurality of frequency point groups, and each frequency point group comprises a plurality of first frequency points and a reference frequency point corresponding to the plurality of first frequency points; performing short-time Fourier transform processing on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each frequency point group; calculating an amplitude mask corresponding to each frequency point group according to the first frequency domain signal corresponding to each reference frequency point; multiplying the first frequency domain signal corresponding to each frequency point in each frequency point group by the corresponding amplitude mask to obtain a second frequency domain signal corresponding to each frequency point in each frequency point group; and processing the second frequency domain signal to obtain a second time domain signal corresponding to the first frequency domain signal. Therefore, under the condition that the auditory experience of the user is not influenced, the calculation amount is effectively reduced, and the calculation complexity is reduced.

Description

Technical Field

[0001] The present disclosure relates to the technical field of audio data processing, and in particular to a signal generation method, device, equipment and storage medium. Background Art

[0002] Surround sound extraction technology algorithms are mainly used in the field of multi-channel sound playback to create an immersive surround feeling for users. Specifically, it mainly performs short-time Fourier transform on the signals of the left and right channels to transform them into frequency domain representation, and then performs correlation analysis on the frequency domain signals of the left and right channels to calculate the frequency domain signal of the surround sound, and then transforms it into the time domain through inverse short-time Fourier transform. At this time, the output time domain signal is the surround sound signal.

[0003] In the related art, when performing calculations, it is usually necessary to analyze the frequency domain signal of each frequency point in the frequency domain, which results in a large number of complex operations and a large calculation complexity. Summary of the invention

[0004] The present disclosure aims to solve one of the technical problems in the related art at least to some extent.

[0005] The first embodiment of the present disclosure provides a signal generation method, including:

[0006] Acquire a first time domain signal to be processed, where the first time domain signal includes a plurality of frequency point groups, each frequency point group includes a plurality of first frequency points, and a reference frequency point corresponding to the plurality of first frequency points;

[0007] Performing short-time Fourier transform processing on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each of the frequency point groups;

[0008] Calculating an amplitude mask corresponding to each of the frequency point groups according to the first frequency domain signal corresponding to each of the reference frequency points;

[0009] Multiplying the first frequency domain signal corresponding to each frequency point in each of the frequency point groups by the corresponding amplitude mask to obtain a second frequency domain signal corresponding to each frequency point in each of the frequency point groups;

[0010] Perform inverse short-time Fourier transform processing on the second frequency domain signal to obtain a second time domain signal corresponding to the first frequency domain signal.

[0011] The second aspect of the present disclosure provides a signal generating device, including:

[0012] An acquisition module, used for acquiring a first time domain signal to be processed;

[0013] A first processing module, configured to perform short-time Fourier transform processing on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each of the frequency point groups;

[0014] A calculation module, used for calculating the amplitude mask corresponding to each of the frequency point groups according to the first frequency domain signal corresponding to each of the reference frequency points;

[0015] A second processing module, used for multiplying the first frequency domain signal corresponding to each frequency point in each of the frequency point groups by the corresponding amplitude mask to obtain a second frequency domain signal corresponding to each frequency point in each of the frequency point groups;

[0016] The third processing module is used to perform inverse short-time Fourier transform processing on the second frequency domain signal to obtain a second time domain signal corresponding to the first frequency domain signal.

[0017] The third aspect embodiment of the present disclosure proposes an electronic device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the signal generation method proposed in the first aspect embodiment of the present disclosure is implemented.

[0018] The fourth aspect embodiment of the present disclosure proposes a non-temporary computer-readable storage medium storing a computer program, which, when executed by a processor, implements the signal generation method proposed in the first aspect embodiment of the present disclosure.

[0019] The signal generation method, device, equipment and storage medium provided by the present disclosure have the following beneficial effects:

[0020] In the disclosed embodiment, firstly, a first time domain signal to be processed is obtained, wherein the first time domain signal includes a plurality of frequency point groups, each frequency point group includes a plurality of first frequency points, and a reference frequency point corresponding to the plurality of first frequency points, and the first time domain signal is subjected to short-time Fourier transform processing to obtain a first frequency domain signal corresponding to each frequency point in each frequency point group, and then, according to the first frequency domain signal corresponding to each reference frequency point, an amplitude mask corresponding to each frequency point group is calculated, and the first frequency domain signal corresponding to each frequency point in each frequency point group is multiplied by the corresponding amplitude mask to obtain a second frequency domain signal corresponding to each frequency point in each frequency point group, and finally, the second frequency domain signal is subjected to inverse short-time Fourier transform processing to obtain a second time domain signal corresponding to the first frequency domain signal. Thus, when processing the frequency domain signal, it is not necessary to calculate the amplitude mask corresponding to each frequency point respectively, but only to calculate the amplitude mask corresponding to each frequency point group, that is, the first frequency point can reuse the amplitude mask of the reference frequency point, thereby effectively reducing the amount of calculation and reducing the calculation complexity without affecting the user's auditory experience.

[0021] Additional aspects and advantages of the present disclosure will be given in part in the following description and in part will be obvious from the following description or learned through practice of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The above and / or additional aspects and advantages of the present disclosure will become apparent and easily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0023] Figure 1 A schematic diagram of a flow chart of a signal generating method provided by an embodiment of the present disclosure;

[0024] Figure 2 A schematic diagram of a flow chart of a signal generating method provided by an embodiment of the present disclosure;

[0025] Figure 3 A schematic diagram of a flow chart of a signal generating method provided by an embodiment of the present disclosure;

[0026] Figure 4 A structural block diagram of a signal generating device provided by an embodiment of the present disclosure;

[0027] Figure 5 A block diagram of an exemplary computer device suitable for implementing embodiments of the present disclosure is shown. DETAILED DESCRIPTION

[0028] Embodiments of the present disclosure are described in detail below, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present disclosure, and should not be construed as limiting the present disclosure.

[0029] The signal generation method, apparatus, computer device, and storage medium according to the embodiments of the present disclosure are described below with reference to the accompanying drawings.

[0030] It should be noted that the execution subject of the signal generation method in the embodiment of the present disclosure is a signal generation device, which can be implemented by software and / or hardware, and can be configured in any electronic device, such as headphones, mobile phones, computers, wearable devices, and any other device with an audio playback function. In the scenario proposed in the present disclosure, the signal generation method proposed in the embodiment of the present disclosure will be described below with the "signal generation device" as the execution subject, and no limitation is made here.

[0031] As an applicable scenario, in order to provide users with a better sense of immersion, multi-channel sound playback can be used, such as 5.1, 7.1 and other channel configurations. Therefore, in order to match the inconsistency between the number of sound source channels and the number of speakers, it is often necessary to use a surround sound extraction algorithm for up-mixing to obtain a multi-channel signal from a stereo signal. The signal generation method proposed in the embodiment of the present disclosure can be applied to the field of multi-channel sound playback to create an immersive surround feeling for users.

[0032] Figure 1 A schematic flow chart of a signal generating method provided in the first embodiment of the present disclosure.

[0033] like Figure 1 As shown, the signal generation method may include the following steps:

[0034] Step 101: Acquire a first time domain signal to be processed, where the first time domain signal includes a plurality of frequency point groups, each frequency point group includes a plurality of first frequency points, and a reference frequency point corresponding to the plurality of first frequency points.

[0035] The first time domain signal may be an audio signal input in the current frame. The time of one frame is usually in the order of 10 ms, which is not limited here.

[0036] The first time domain signal may be a stereo signal including a left channel and a right channel.

[0037] For example, if the frame length of the first time domain signal input in the current frame is N, that is, it includes the left channel stereo signal x corresponding to discrete time points such as n=0, 1, ..., N-1 L (n) and the right channel stereo signal x R (n), x L (n) and x R (n) are all first time domain signals to be processed.

[0038] The frequency point group may be a combination of multiple frequency points.

[0039] In each frequency point group, a reference frequency point may be predetermined as a reference for other frequency points (ie, first frequency points) in the frequency point group, so that subsequent processing of each first frequency point in the frequency point group may refer to processing of the reference frequency point.

[0040] After performing short-time Fourier transform processing on the first time domain signal to obtain the first frequency domain signal corresponding to each frequency point, each frequency point can be divided into each frequency range for grouping, and the first frequency point and the reference frequency point in each frequency point group can be determined.

[0041] For example, if the currently preset frequency point groups are A, B, C, and D, the frequency ranges corresponding to A, B, C, and D include (A1, A2, A3, A4, ...., An), (B1, B2, B3, B4, ...., Bn), (C1, C2, C3, C4, ..., Cn), and (D1, D2, D3, D4, ..., Dn). For example, if the reference frequency points corresponding to A, B, C, and D are A1, B1, C1, and D1, then the other frequency points in A, such as A2, A3, A4, ...., An, are the first frequency points, and the same applies to B, C, and D.

[0042] It should be noted that each frequency point obtained after short-time Fourier transform processing can be compared with the upper and lower limits of each frequency point group, so as to determine the frequency point group to which each frequency point belongs, and divide each frequency point into a first frequency point and a reference frequency point.

[0043] Step 102: Perform short-time Fourier transform processing on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each frequency point group.

[0044] The first frequency domain signal may be a frequency domain signal obtained by processing the first time domain signal. It should be noted that if the first time domain signal includes a left channel stereo signal x L (n) and the right channel stereo signal x R (n), the corresponding first frequency domain signal contains the frequency domain signal X corresponding to the left channel L (k) and the frequency domain signal X corresponding to the right channel R (k).

[0045] It should be noted that, in order to reduce spectrum leakage, optionally, the first time domain signal of the current frame input, that is, the left and right stereo signals x L (n) and x R (n) windowing,

[0046] x w，L (n) = x L (n)w(n)

[0047] x w，R (n) = x R (n)w(n)

[0048] Wherein, w(n) is a window function, such as a Hann window, a Hamming window, etc., which is not limited here. Then, the windowed signal x w，L (n), x w，R(n) Perform short-time Fourier transform (STFT) to obtain the first frequency domain signal X L (k), X R (k). Wherein, k = 1, 2, ..., N, and k is a discrete frequency point.

[0049] As a possible implementation method, the first time domain signal can be subjected to short-time Fourier transform processing to obtain a first frequency domain signal corresponding to each frequency point, and then when the frequency value corresponding to any frequency point is within the frequency range corresponding to any preset frequency point group, it can be determined that any frequency point belongs to any frequency point group.

[0050] Step 103: Calculate the amplitude mask corresponding to each frequency point group according to the first frequency domain signal corresponding to each reference frequency point.

[0051] The first frequency domain signal includes a third frequency domain signal corresponding to the left channel and a fourth frequency domain signal corresponding to the right channel.

[0052] The third frequency domain signal may be the first frequency domain signal corresponding to the left channel, and the fourth frequency domain signal may be the first frequency domain signal corresponding to the right channel.

[0053] As a possible implementation method, we can first calculate the autocorrelation of the left channel, the autocorrelation of the right channel, and the cross-correlation of the left and right channels based on the third frequency domain signal and the fourth frequency domain signal corresponding to each reference frequency point, and then calculate the energy of the current ambient sound based on the autocorrelation of the left channel, the autocorrelation of the right channel, and the cross-correlation of the left and right channels.

[0054] Specifically, the autocorrelation of the left channel, the autocorrelation of the right channel, and the cross-correlation of the left and right channels can be calculated by the following formula:

[0055]

[0056]

[0057]

[0058] Among them, r LL (k) is the autocorrelation of the left channel corresponding to the reference frequency k, r RR (k) is the autocorrelation of the right channel corresponding to the reference frequency k, r LR (k) is the cross-correlation of the left and right channels corresponding to the reference frequency k, X L (k) is the third frequency domain signal corresponding to the left channel, X R (k) is the fourth frequency domain signal corresponding to the right channel, For X L The complex conjugate of (k), For X R The complex conjugate of (k).

[0059] Furthermore, the energy of ambient sound can be calculated by the following formula:

[0060]

[0061] Furthermore, the amplitude mask of each reference frequency point can be calculated according to the third frequency domain signal and the fourth frequency domain signal corresponding to each reference frequency point, and the energy of the ambient sound, wherein the amplitude mask includes the amplitude mask of the left channel and the amplitude mask of the right channel, which can be specifically calculated by the following formula:

[0062]

[0063]

[0064] Among them, α L (k) is the amplitude mask of the left channel corresponding to the kth frequency point, a R (k) is the amplitude mask of the right channel corresponding to the kth frequency point.

[0065] Furthermore, the amplitude mask of each reference frequency point may be determined as the amplitude mask corresponding to the frequency point group where the reference frequency point is located.

[0066] It should be noted that if the reference frequency k belongs to frequency group A, the amplitude mask corresponding to the reference frequency k can be used as the amplitude mask of each frequency in frequency group A, that is, each first frequency in frequency group A can reuse the amplitude mask of the reference frequency.

[0067] Step 104: multiply the first frequency domain signal corresponding to each frequency point in each of the frequency point groups by the corresponding amplitude mask to obtain a second frequency domain signal corresponding to each frequency point in each of the frequency point groups.

[0068] The second frequency domain signal may be a frequency domain signal obtained by multiplying the first frequency domain signal by the corresponding amplitude mask.

[0069] Specifically, the first frequency domain signal of each frequency point can be directly multiplied by the amplitude mask of the corresponding frequency point group, so as to obtain the second frequency domain signal corresponding to each frequency point. For details, refer to the following formula:

[0070] S L (k) = a L (k)X L (k)

[0071] S R (k) = a R (k)XR (k)

[0072] Among them, S L (k) is the second frequency domain signal corresponding to frequency point k in the left channel, S R (k) is the second frequency domain signal corresponding to frequency point k in the right channel, a L (k) is the first frequency domain signal X of the left channel L (k) The corresponding amplitude mask, a R (k) is the first frequency domain signal X of the right channel R (k) Corresponding amplitude mask.

[0073] Specifically, we can traverse each frequency point and calculate all S L (k) and S R (k).

[0074] Step 105: Perform inverse short-time Fourier transform processing on the second frequency domain signal to obtain a second time domain signal corresponding to the first frequency domain signal.

[0075] The second time domain signal may be a surround sound signal obtained by processing the second frequency domain signal, which includes a second time domain signal corresponding to a left channel and a second time domain signal corresponding to a right channel.

[0076] Specifically, the second frequency domain signal S corresponding to each frequency point can be L (k) and S R (k) Performing an inverse short-time Fourier transform (IFFT) to obtain a second time domain signal.

[0077] Among them, s L (n) as the second time domain signal corresponding to the left channel, with s R (n) Taking the second time domain signal corresponding to the right channel as an example, after the second time domain signal is generated, it can be windowed, so as to improve the smoothness of the signal and reduce spectrum leakage. The specific formula is as follows:

[0078] s w，L (n) = s L (n)w(n)

[0079] s w，R (n) = s R (n)w(n)

[0080] Wherein, w(n) is a window function, which can be a Hanning window or a Hamming window, which is not limited here. w，L (n) may be a time domain signal obtained by windowing the second time domain signal corresponding to the left channel, s w，R(n) may be a time domain signal obtained by windowing the second time domain signal corresponding to the right channel.

[0081] In the disclosed embodiment, firstly, a first time domain signal to be processed is obtained, and a short-time Fourier transform is performed on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each frequency point group, and then, based on the first frequency domain signal corresponding to each reference frequency point, an amplitude mask corresponding to each frequency point group is calculated, and the first frequency domain signal corresponding to each frequency point in each frequency point group is multiplied by the corresponding amplitude mask to obtain a second frequency domain signal corresponding to each frequency point in each frequency point group, and finally, an inverse short-time Fourier transform is performed on the second frequency domain signal to obtain a second time domain signal corresponding to the first frequency domain signal. Thus, when processing the frequency domain signal, it is not necessary to calculate the amplitude masks corresponding to each frequency point respectively, but only to calculate the amplitude mask corresponding to each frequency point group, that is, the first frequency point can reuse the amplitude mask of the reference frequency point, thereby effectively reducing the amount of calculation and reducing the calculation complexity without affecting the user's auditory experience.

[0082] Figure 2 A schematic flow chart of a signal generating method provided in the second embodiment of the present disclosure.

[0083] like Figure 2 As shown, the signal generation method may include the following steps:

[0084] Step 201: Acquire a first time domain signal to be processed, where the first time domain signal includes a plurality of frequency point groups, each frequency point group includes a plurality of first frequency points, and a reference frequency point corresponding to the plurality of first frequency points.

[0085] It should be noted that the specific implementation of step 201 can refer to the above embodiment and will not be described in detail here.

[0086] Step 202: Obtain a first Mel frequency and a second Mel frequency corresponding to the hearing range of the human ear.

[0087] The first Mel frequency may be a Mel frequency corresponding to an upper limit frequency corresponding to a human hearing range, and the second Mel frequency may be a Mel frequency corresponding to a lower limit frequency corresponding to a human hearing range.

[0088] As an example, in the embodiment of the present disclosure, the linear frequency range corresponding to the human ear hearing range can be determined as 50 Hz and 20000 Hz, which is not limited here.

[0089] Since the unit of Hz is linear and does not conform to the auditory model of the human ear, the two upper and lower frequency limits can be converted to other frequency domains according to the auditory model of the human ear. In the embodiment of the present disclosure, the Mel frequency is taken as an example.

[0090] Specifically, it can be converted by the following formula

[0091]

[0092] Where E1 is the linear frequency. For example, if the upper and lower limits of the human hearing range are determined to be and Then you can According to the above formula, it can be converted into and in, is the first mel frequency, is the second mel frequency.

[0093] Step 203 , uniformly sampling is performed in a frequency range between the first Mel frequency and the second Mel frequency to obtain a target number of third frequency points and a third Mel frequency corresponding to each third frequency point.

[0094] The third frequency point may be each frequency point uniformly collected within a frequency range between the first Mel frequency and the second Mel frequency. The third Mel frequency may be a Mel frequency corresponding to the third frequency point.

[0095] The number of acquisitions of the third frequency point is determined, that is, the target number. The target number may be determined in advance by considering the computing power of the processor and the number of calculations of the frequency points. As an example, the target number may be 20, which is not limited here.

[0096] It should be noted that after determining the required number of frequency points, that is, the target number N, the first Mel frequency and the second Mel frequency can be used, for example and N points are uniformly sampled between, and the corresponding third Mel frequency is Among them, N points can be used as third frequency points.

[0097] Step 204: Determine the average frequency between two adjacent Mel frequencies based on the order of the first Mel frequency, the second Mel frequency, and each third Mel frequency.

[0098] Specifically, the first Mel frequency, the second Mel frequency and each third Mel frequency may be sorted in ascending order, wherein the first Mel frequency is the smallest and the second Mel frequency is the largest.

[0099] Furthermore, the average frequency between two adjacent Mel frequencies can be calculated. For example, if and is the adjacent Mel frequency, then we can calculate and The average frequency.

[0100] Step 205: convert the third Mel frequency, the first Mel frequency, the second Mel frequency and the average frequency into discrete frequencies, and sort the discrete frequencies from low to high.

[0101] Specifically, the third Mel frequency, the first Mel frequency, the second Mel frequency and the average frequency may be first converted back to the linear frequency Hz. The specific conversion formula is:

[0102]

[0103] Furthermore, each linear frequency can be converted into a discrete frequency, which can be specifically achieved through the following formula:

[0104]

[0105] Among them, "·" means rounding. is the discrete frequency, f s is the sampling frequency, is the mth discrete frequency, N is the number of discrete time points in the first time domain signal, and M is the number of discrete frequencies.

[0106] Furthermore, the discrete frequencies may be sorted from low to high.

[0107] Step 206, determining each frequency point group and a reference frequency point in each frequency point group according to the preset division rule, order and each discrete frequency.

[0108] Optionally, discrete frequency points corresponding to the third Mel frequency, the first Mel frequency, and the second Mel frequency may be used as reference frequency points.

[0109] For example, if the discrete frequencies in order are a, b, c, d, e, f, g, h, i, j, k, l, m, where a is the discrete frequency corresponding to the first Mel frequency, m is the discrete frequency corresponding to the second Mel frequency, and c, e, g, i, k are all discrete frequencies corresponding to the third Mel frequency, then a, c, e, g, i, k, m can be used as reference frequency points.

[0110] Furthermore, based on the sorting, a previous discrete frequency and a next discrete frequency adjacent to a discrete frequency corresponding to any third Mel frequency may be used as a lower limit frequency and an upper limit frequency of a frequency point group corresponding to any third Mel frequency, respectively.

[0111] In combination with the above example, since b and d are respectively the previous discrete frequency and the next discrete frequency adjacent to c, b and d can be used as the lower limit frequency and the upper limit frequency of c. Similarly, d and f can be used as the lower limit frequency and the upper limit frequency of e, f and h can be used as the lower limit frequency and the upper limit frequency of g, h and j can be used as the lower limit frequency and the upper limit frequency of i, and j and l can be used as the lower limit frequency and the upper limit frequency of k.

[0112] It can be understood that c, e, g, i, and k correspond to 5 frequency groups respectively, and the frequency ranges of these 5 frequency groups are [b, d), [d, f), [f, h), [h, j), and [j, l]. Among them, c, e, g, i, and k are the reference frequencies in [b, d), [d, f), [f, h), [h, j), and [j, l] respectively.

[0113] Furthermore, based on the sorting, the discrete frequency corresponding to the first Mel frequency and the next discrete frequency adjacent to the first Mel frequency can be used as the lower limit frequency and the upper limit frequency of the frequency point group corresponding to the first Mel frequency, respectively.

[0114] It should be noted that, in combination with the above example, [a, b) can be used as the frequency point group corresponding to the first Mel frequency. Among them, a is the discrete frequency corresponding to the first Mel frequency, b is the next discrete frequency adjacent to the first Mel frequency, and a is the reference frequency point corresponding to the [a, b) frequency point group.

[0115] Furthermore, based on the sorting, the discrete frequency corresponding to the second Mel frequency and the previous discrete frequency adjacent to the second Mel frequency may be used as the upper limit frequency and the lower limit frequency of the frequency point group corresponding to the second Mel frequency, respectively.

[0116] It should be noted that, in combination with the above example, (l, m] can be used as the frequency point group corresponding to the first Mel frequency. Among them, m is the discrete frequency corresponding to the second Mel frequency, l is the previous discrete frequency adjacent to the second Mel frequency, and m is the reference frequency point corresponding to the (l, m] frequency point group.

[0117] Step 207: Perform short-time Fourier transform processing on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each of the frequency point groups.

[0118] Step 208: Calculate the amplitude mask corresponding to each of the frequency point groups according to the first frequency domain signal corresponding to each of the reference frequency points.

[0119] Step 209: multiply the first frequency domain signal corresponding to each frequency point in each of the frequency point groups by the corresponding amplitude mask to obtain the second frequency domain signal corresponding to each frequency point in each of the frequency point groups.

[0120] Step 210: Perform inverse short-time Fourier transform processing on the second frequency domain signal to obtain a second time domain signal corresponding to the first frequency domain signal.

[0121] It should be noted that the specific implementation of steps 207 - 210 may refer to the above embodiment and will not be described in detail here.

[0122] In the disclosed embodiment, a first time domain signal to be processed is first obtained, the first time domain signal includes multiple frequency point groups, each frequency point group includes multiple first frequency points, and a reference frequency point corresponding to the multiple first frequency points, then a first Mel frequency and a second Mel frequency corresponding to the human ear hearing range are obtained, and then uniform sampling is performed in the frequency range between the first Mel frequency and the second Mel frequency to obtain a target number of third frequency points, and a third Mel frequency corresponding to each of the third frequency points, and then based on the order of the first Mel frequency, the second Mel frequency and each of the third Mel frequencies, the average frequency between two adjacent Mel frequencies is determined, and then the third Mel frequency, the first Mel frequency, the second Mel frequency and the average frequency are converted into discrete frequencies, and The discrete frequencies are sorted from low to high, and then the frequency point groups and the reference frequency points in each frequency point group are determined according to the preset division rule, the sorting and the discrete frequencies, and then the first time domain signal is short-time Fourier transform processed to obtain a first frequency domain signal corresponding to each frequency point in each frequency point group, and then the amplitude mask corresponding to each frequency point group is calculated according to the first frequency domain signal corresponding to each reference frequency point, and then the first frequency domain signal corresponding to each frequency point in each frequency point group is multiplied by the corresponding amplitude mask to obtain a second frequency domain signal corresponding to each frequency point in each frequency point group, and then the second frequency domain signal is inversely short-time Fourier transform processed to obtain a second time domain signal corresponding to the first frequency domain signal. Therefore, multiple frequency groups and the reference frequency points corresponding to each frequency group can be calculated in advance according to the hearing characteristics of the human ear, so that when the frequency group reuses the amplitude mask corresponding to the reference frequency point, no additional computing resources will be occupied. Only the amplitude mask analysis needs to be performed on the reference frequency point, and the calculation results of the reference frequency point are reused for other first frequency points, thereby reducing the amount of calculation.

[0123] Figure 3 A schematic flow chart of a signal generation method provided in an embodiment of the present disclosure.

[0124] like Figure 3 As shown, the signal generation method may include the following steps:

[0125] Step 301: Acquire a first time domain signal to be processed, where the first time domain signal includes a plurality of frequency point groups, each frequency point group includes a plurality of first frequency points, and a reference frequency point corresponding to the plurality of first frequency points.

[0126] It should be noted that the specific implementation of step 301 can refer to the above embodiment and will not be described in detail here.

[0127] Step 302: splice the first time domain signal and adjacent historical frame signals to obtain a third time domain signal.

[0128] The first time domain signal may be a sound signal of a current frame, and the connected historical frame may be a previous frame signal adjacent to the first time domain signal.

[0129] For example, if the first time domain signal is collected during the time period t1-t2, and t3-t1 is a historical time period adjacent to the time period t1-t2, the sound signal collected during t3-t1 can be used as an adjacent historical frame signal.

[0130] The third time domain signal may be a time domain signal obtained by splicing the first time domain signal and the corresponding adjacent historical frame signal.

[0131] For example, if the first time domain signal corresponding to the current frame is x1(n) and the frame length is N, and the adjacent historical frame corresponding to x1(n) is x2(n) and the frame length is also N, then x1(n) and x2(n) can be spliced ​​to obtain a third time domain signal with a frame length of 2N, which is not limited here.

[0132] Step 303: perform windowing processing and short-time Fourier transform on the third time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each frequency point group.

[0133] Step 304: Calculate the amplitude mask corresponding to each of the frequency point groups according to the first frequency domain signal corresponding to each of the reference frequency points.

[0134] Step 305: multiply the first frequency domain signal corresponding to each frequency point in each of the frequency point groups by the corresponding amplitude mask to obtain the second frequency domain signal corresponding to each frequency point in each of the frequency point groups.

[0135] Step 306: Perform inverse short-time Fourier transform processing on the second frequency domain signal to obtain a second time domain signal corresponding to the first frequency domain signal.

[0136] It should be noted that the specific implementation of steps 303 - 306 may refer to the above embodiment and will not be described in detail here.

[0137] Step 307: divide the second time domain signal into a fourth time domain signal corresponding to the time domain signal of the current frame and a fifth time domain signal corresponding to the adjacent historical frame signal.

[0138] Step 308: superimpose the fourth time domain signal and the fifth time domain signal.

[0139] It should be noted that since the second time domain signal corresponds to the third time domain signal, and the third time domain signal contains the time domain signal of the current frame and the adjacent historical frame signal, the generated second time domain signal can be divided into a fourth time domain signal corresponding to the time domain signal of the current frame, and a fifth time domain signal corresponding to the adjacent historical frame signal.

[0140] The fourth time domain signal may be a surround sound signal corresponding to the time domain signal of the current frame, and the fifth time domain signal may be a surround sound signal corresponding to the adjacent historical frame signal.

[0141] For example, the second time domain signal is composed of time domain signals corresponding to 2N discrete time points such as 0, 1, ..., 2N-1, and the time domain signal corresponding to 0, 1, ..., N-1 is the fifth time domain signal, and the time domain signal corresponding to N, N+1, N+2..., 2N-1 is the fourth time domain signal, which is not limited here.

[0142] As another possible implementation method, the time domain signal corresponding to the first half of the frame length of the time domain signal of the current frame in the third time domain signal can be used as the fourth time domain signal, and the time domain signal corresponding to the second half of the frame length of the adjacent historical frame signal in the third time domain signal can be used as the fifth time domain signal.

[0143] It should be noted that, under normal circumstances, the signal wave corresponding to a frame of time domain signal is usually a sine wave, and the waveform first rises and then falls. Therefore, the time domain signal corresponding to the first half of the frame length of the time domain signal of the current frame in the third time domain signal is usually a gradually rising sine waveform, and the time domain signal corresponding to the second half of the frame length of the adjacent historical frame signal in the third time domain signal is usually a gradually falling waveform. Therefore, when the fourth time domain signal and the fifth time domain signal are superimposed, the generated surround sound signal can be made smoother, so as to better meet the user's auditory experience.

[0144] In the disclosed embodiment, a first time domain signal to be processed is first obtained, the first time domain signal includes multiple frequency point groups, each frequency point group includes multiple first frequency points, and a reference frequency point corresponding to the multiple first frequency points, then the first time domain signal and the adjacent historical frame signal are spliced ​​to obtain a third time domain signal, then the third time domain signal is windowed and short-time Fourier transformed to obtain a first frequency domain signal corresponding to each frequency point in each frequency point group, then the amplitude mask corresponding to each frequency point group is calculated according to the first frequency domain signal corresponding to each reference frequency point, then the first frequency domain signal corresponding to each frequency point in each frequency point group is multiplied by the corresponding amplitude mask to obtain a second frequency domain signal corresponding to each frequency point in each frequency point group, then the second frequency domain signal can be inversely short-time Fourier transformed to obtain a second time domain signal corresponding to the first frequency domain signal, then the second time domain signal is divided into a fourth time domain signal corresponding to the time domain signal of the current frame, and a fifth time domain signal corresponding to the adjacent historical frame signal, and finally the fourth time domain signal and the fifth time domain signal are superimposed. In this way, the calculation complexity of the frequency domain signal can be reduced while the generated surround sound signal can be made smoother, thereby improving the user's auditory experience.

[0145] In order to implement the above embodiments, the present disclosure also proposes a signal generating device.

[0146] Figure 4 This is a structural block diagram of a signal generating device provided in the fourth embodiment of the present disclosure.

[0147] like Figure 4 As shown, the signal generating device 400 may include:

[0148] The acquisition module 410 is used to acquire a first time domain signal to be processed, where the first time domain signal includes multiple frequency point groups, each frequency point group includes multiple first frequency points and a reference frequency point corresponding to the multiple first frequency points.

[0149] The first processing module 420 is configured to perform short-time Fourier transform processing on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each of the frequency point groups.

[0150] The calculation module 430 is used to calculate the amplitude mask corresponding to each of the frequency point groups according to the first frequency domain signal corresponding to each of the reference frequency points.

[0151] The second processing module 440 is used to multiply the first frequency domain signal corresponding to each frequency point in each of the frequency point groups by the corresponding amplitude mask to obtain the second frequency domain signal corresponding to each frequency point in each of the frequency point groups.

[0152] The third processing module 450 is used to perform inverse short-time Fourier transform processing on the second frequency domain signal to obtain a second time domain signal corresponding to the first frequency domain signal.

[0153] Optionally, the first processing module is specifically used to:

[0154] splicing the first time domain signal and adjacent historical frame signals to obtain a third time domain signal;

[0155] The third time domain signal is subjected to windowing processing and short-time Fourier transform to obtain a first frequency domain signal corresponding to each frequency point in each frequency point group.

[0156] Optionally, the first processing module is specifically used to:

[0157] Performing short-time Fourier transform processing on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point;

[0158] When a frequency value corresponding to any frequency point is within a frequency range corresponding to any preset frequency point group, it is determined that the any frequency point belongs to the any frequency point group.

[0159] Optionally, the first processing module further includes:

[0160] A first acquisition unit, used to acquire a first Mel frequency and a second Mel frequency corresponding to a human hearing range;

[0161] A second acquisition unit is used to perform uniform sampling in a frequency range between the first Mel frequency and the second Mel frequency to acquire a target number of third frequency points and a third Mel frequency corresponding to each of the third frequency points;

[0162] A first determining unit, configured to determine an average frequency between two adjacent Mel frequencies based on the order of the first Mel frequency, the second Mel frequency, and each of the third Mel frequencies;

[0163] a sorting unit, configured to convert the third Mel frequency, the first Mel frequency, the second Mel frequency and the average frequency into discrete frequencies, and sort the discrete frequencies from low to high;

[0164] The second determining unit is used to determine each frequency point group and a reference frequency point in each frequency point group according to a preset division rule, the order and each discrete frequency.

[0165] Optionally, the second determining unit is specifically configured to:

[0166] Using discrete frequency points corresponding to the third Mel frequency, the first Mel frequency, and the second Mel frequency as reference frequency points;

[0167] Based on the sorting, a previous discrete frequency and a next discrete frequency adjacent to a discrete frequency corresponding to any third Mel frequency are used as a lower limit frequency and an upper limit frequency of a frequency point group corresponding to any third Mel frequency, respectively;

[0168] Based on the sorting, a discrete frequency corresponding to the first Mel frequency and a subsequent discrete frequency adjacent to the first Mel frequency are used as a lower limit frequency and an upper limit frequency of a frequency point group corresponding to the first Mel frequency, respectively;

[0169] Based on the sorting, a discrete frequency corresponding to the second Mel frequency and a previous discrete frequency adjacent to the second Mel frequency are respectively used as an upper limit frequency and a lower limit frequency of a frequency point group corresponding to the second Mel frequency.

[0170] Optionally, the first frequency domain signal includes a third frequency domain signal corresponding to a left channel and a fourth frequency domain signal corresponding to a right channel, and the calculation unit is specifically configured to:

[0171] Calculate the autocorrelation of the left channel, the autocorrelation of the right channel, and the cross-correlation of the left and right channels according to the third frequency domain signal and the fourth frequency domain signal corresponding to each reference frequency point;

[0172] Calculating the energy of the current ambient sound according to the autocorrelation of the left channel, the autocorrelation of the right channel, and the cross-correlation of the left and right channels;

[0173] Calculate the amplitude mask of each reference frequency point according to the third frequency domain signal and the fourth frequency domain signal corresponding to each reference frequency point, and the energy of the ambient sound, wherein the amplitude mask includes an amplitude mask of a left channel and an amplitude mask of a right channel;

[0174] The amplitude mask of each reference frequency point is determined as the amplitude mask corresponding to the frequency point group where the reference frequency point is located.

[0175] Optionally, the third processing module is further used for:

[0176] Dividing the second time domain signal into a fourth time domain signal corresponding to the time domain signal of the current frame and a fifth time domain signal corresponding to the adjacent historical frame signal;

[0177] The fourth time domain signal and the fifth time domain signal are superimposed.

[0178] In the disclosed embodiment, firstly, a first time domain signal to be processed is obtained, the first time domain signal includes a plurality of frequency point groups, each frequency point group includes a plurality of first frequency points, and a reference frequency point corresponding to the plurality of first frequency points, and the first time domain signal is subjected to short-time Fourier transform processing to obtain a first frequency domain signal corresponding to each frequency point in each of the frequency point groups, and then, according to the first frequency domain signal corresponding to each of the reference frequency points, an amplitude mask corresponding to each of the frequency point groups is calculated, and the first frequency domain signal corresponding to each of the frequency point groups is multiplied by the corresponding amplitude mask to obtain a second frequency domain signal corresponding to each of the frequency point groups, and finally, the second frequency domain signal is subjected to inverse short-time Fourier transform processing to obtain a second time domain signal corresponding to the first frequency domain signal. Thus, when processing the frequency domain signal, it is not necessary to calculate the amplitude mask corresponding to each frequency point respectively, but only to calculate the amplitude mask corresponding to each frequency point group, that is, the first frequency point can reuse the amplitude mask of the reference frequency point, thereby effectively reducing the amount of calculation and reducing the calculation complexity without affecting the user's auditory experience.

[0179] It should be noted that the method provided by the embodiment of the present disclosure can also be applied to other audio processing technology fields based on time-frequency Fourier analysis, such as noise reduction, time stretching, pitch shifting, etc., thereby effectively reducing the computational complexity.

[0180] In order to implement the above embodiments, the present disclosure further proposes a computer device, including: a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the program, the signal generation method proposed in the above embodiments of the present disclosure is implemented.

[0181] In order to implement the above embodiments, the present disclosure further proposes a non-temporary computer-readable storage medium storing a computer program, which, when executed by a processor, implements the signal generating method proposed in the above embodiments of the present disclosure.

[0182] In order to implement the above embodiments, the present disclosure further proposes a computer program product. When an instruction processor in the computer program product executes, the signal generating method proposed in the above embodiments of the present disclosure is executed.

[0183] Figure 5 A block diagram of an exemplary computer device suitable for implementing embodiments of the present disclosure is shown. Figure 5 The computer device 12 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present disclosure.

[0184] like Figure 5As shown, the computer device 12 is in the form of a general-purpose computing device. The components of the computer device 12 may include, but are not limited to: one or more processors or processing units 16, a system memory 28, and a bus 18 that connects various system components (including the system memory 28 and the processing unit 16).

[0185] The bus 18 represents one or more of several types of bus structures, including a memory bus or memory controller, a peripheral bus, a graphics acceleration port, a processor or a local bus using any of a variety of bus structures. For example, these architectures include but are not limited to Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MAC) bus, Enhanced ISA bus, Video Electronics Standards Association (VESA) local bus and Peripheral Component Interconnection (PCI) bus.

[0186] The computer device 12 typically includes a variety of computer system readable media. These media can be any available media that can be accessed by the computer device 12, including volatile and non-volatile media, removable and non-removable media.

[0187] The memory 28 may include computer system readable media in the form of volatile memory, such as random access memory (RAM) 30 and / or cache memory 32. The computer device 12 may further include other removable / non-removable, volatile / non-volatile computer system storage media. By way of example only, the storage system 34 may be used to read and write non-removable, non-volatile magnetic media ( Figure 5 not shown, usually called a "hard drive"). Although Figure 5Not shown in the figure, a disk drive for reading and writing a removable non-volatile disk (e.g., a "floppy disk"), and an optical disk drive for reading and writing a removable non-volatile optical disk (e.g., a compact disc read only memory (CD-ROM), a digital versatile disc read only memory (DVD-ROM), or other optical media) may be provided. In these cases, each drive may be connected to the bus 18 via one or more data medium interfaces. The memory 28 may include at least one program product having a set (e.g., at least one) of program modules configured to perform the functions of the various embodiments of the present disclosure.

[0188] A program / utility 40 having a set (at least one) of program modules 42 may be stored, for example, in the memory 28, such program modules 42 including but not limited to an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a network environment. The program modules 42 generally perform the functions and / or methods of the embodiments described in the present disclosure.

[0189] The computer device 12 may also communicate with one or more external devices 14 (e.g., keyboard, pointing device, display 24, etc.), one or more devices that enable a user to interact with the computer device 12, and / or any device that enables the computer device 12 to communicate with one or more other computing devices (e.g., network card, modem, etc.). Such communication may be performed via an input / output (I / O) interface 22. In addition, the computer device 12 may also communicate with one or more networks (e.g., a local area network (LAN), a wide area network (WAN), and / or a public network, such as the Internet) via a network adapter 20. As shown, the network adapter 20 communicates with other modules of the computer device 12 via a bus 18. It should be understood that, although not shown in the figure, other hardware and / or software modules may be used in conjunction with the computer device 12, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems.

[0190] The processing unit 16 executes various functional applications and data processing by running programs stored in the system memory 28, such as implementing the methods mentioned in the above embodiments.

[0191] In the description of this specification, the description with reference to the terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" etc. means that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, without contradiction.

[0192] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0193] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code that includes one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present disclosure includes additional implementations in which functions may not be performed in the order shown or discussed, including performing functions in a substantially simultaneous manner or in reverse order depending on the functions involved, which should be understood by technicians in the technical field to which the embodiments of the present disclosure belong.

[0194] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute the instructions), or in combination with these instruction execution systems, devices or apparatuses. For the purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate or transmit a program for use by an instruction execution system, device or apparatus, or in combination with these instruction execution systems, devices or apparatuses. More specific examples of computer-readable media (a non-exhaustive list) include the following: an electrical connection with one or more wires (electronic device), a portable computer disk box (magnetic device), a random access memory (RAM), a read-only memory (ROM), an erasable and programmable read-only memory (EPROM or flash memory), a fiber optic device, and a portable compact disk read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium and then editing, interpreting or processing in other suitable ways if necessary, and then stored in a computer memory.

[0195] It should be understood that the various parts of the present disclosure can be implemented in hardware, software, firmware or a combination thereof. In the above-mentioned embodiments, multiple steps or methods can be implemented in software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented in hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement: a discrete logic circuit having a logic gate circuit for implementing a logic function for a data signal, a dedicated integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0196] A person skilled in the art may understand that all or part of the steps in the method for implementing the above-mentioned embodiment may be completed by instructing related hardware through a program, and the program may be stored in a computer-readable storage medium, which, when executed, includes one or a combination of the steps of the method embodiment.

[0197] In addition, each functional unit in each embodiment of the present disclosure may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module. The above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.

[0198] The storage medium mentioned above may be a read-only memory, a disk or an optical disk, etc. Although the embodiments of the present disclosure have been shown and described above, it can be understood that the above embodiments are exemplary and cannot be understood as limitations of the present disclosure. A person of ordinary skill in the art may change, modify, replace and modify the above embodiments within the scope of the present disclosure.

Claims

1. A signal generation method, characterized in that: include: Acquire a first time domain signal to be processed, where the first time domain signal includes a plurality of frequency point groups, each frequency point group includes a plurality of first frequency points, and a reference frequency point corresponding to the plurality of first frequency points; Performing short-time Fourier transform processing on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each of the frequency point groups; Calculating an amplitude mask corresponding to each of the frequency point groups according to the first frequency domain signal corresponding to each of the reference frequency points; Multiplying the first frequency domain signal corresponding to each frequency point in each of the frequency point groups by the corresponding amplitude mask to obtain a second frequency domain signal corresponding to each frequency point in each of the frequency point groups; Perform inverse short-time Fourier transform processing on the second frequency domain signal to obtain a second time domain signal corresponding to the first frequency domain signal.

2. The method according to claim 1, characterized in that The first time domain signal is a time domain signal of the current frame, and the short-time Fourier transform processing is performed on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each frequency point group, including: splicing the first time domain signal and adjacent historical frame signals to obtain a third time domain signal; The third time domain signal is subjected to windowing processing and short-time Fourier transform to obtain a first frequency domain signal corresponding to each frequency point in each frequency point group.

3. The method according to claim 1, characterized in that The performing short-time Fourier transform processing on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each frequency point group includes: Performing short-time Fourier transform processing on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point; When a frequency value corresponding to any frequency point is within a frequency range corresponding to any preset frequency point group, it is determined that the any frequency point belongs to the any frequency point group.

4. The method according to claim 1, characterized in that: Before performing short-time Fourier transform processing on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each frequency point group, the method further includes: Obtain a first Mel frequency and a second Mel frequency corresponding to a human hearing range; Perform uniform sampling in a frequency range between the first Mel frequency and the second Mel frequency to obtain a target number of third frequency points and a third Mel frequency corresponding to each of the third frequency points; Determine an average frequency between two adjacent Mel frequencies based on the order of the first Mel frequency, the second Mel frequency, and each of the third Mel frequencies; Convert the third Mel frequency, the first Mel frequency, the second Mel frequency and the average frequency into discrete frequencies, and sort the discrete frequencies from low to high; According to the preset division rule, the order and each discrete frequency, each frequency point group and a reference frequency point in each frequency point group are determined.

5. The method according to claim 4, characterized in that The step of determining each frequency point group and a reference frequency point in each frequency point group according to a preset division rule, the order and each discrete frequency includes: Using discrete frequency points corresponding to the third Mel frequency, the first Mel frequency, and the second Mel frequency as reference frequency points; Based on the sorting, a previous discrete frequency and a next discrete frequency adjacent to a discrete frequency corresponding to any third Mel frequency are used as a lower limit frequency and an upper limit frequency of a frequency point group corresponding to any third Mel frequency, respectively; Based on the sorting, a discrete frequency corresponding to the first Mel frequency and a subsequent discrete frequency adjacent to the first Mel frequency are used as a lower limit frequency and an upper limit frequency of a frequency point group corresponding to the first Mel frequency, respectively; Based on the sorting, a discrete frequency corresponding to the second Mel frequency and a previous discrete frequency adjacent to the second Mel frequency are respectively used as an upper limit frequency and a lower limit frequency of a frequency point group corresponding to the second Mel frequency.

6. The method according to claim 1, characterized in that The first frequency domain signal includes a third frequency domain signal corresponding to a left channel and a fourth frequency domain signal corresponding to a right channel, and the calculating, according to the first frequency domain signal corresponding to each reference frequency point, an amplitude mask corresponding to each frequency point group includes: Calculate the autocorrelation of the left channel, the autocorrelation of the right channel, and the cross-correlation of the left and right channels according to the third frequency domain signal and the fourth frequency domain signal corresponding to each reference frequency point; Calculating the energy of the current ambient sound according to the autocorrelation of the left channel, the autocorrelation of the right channel, and the cross-correlation of the left and right channels; Calculate the amplitude mask of each reference frequency point according to the third frequency domain signal and the fourth frequency domain signal corresponding to each reference frequency point, and the energy of the ambient sound, wherein the amplitude mask includes an amplitude mask of a left channel and an amplitude mask of a right channel; The amplitude mask of each reference frequency point is determined as the amplitude mask corresponding to the frequency point group where the reference frequency point is located.

7. The method according to claim 2, characterized in that After performing inverse short-time Fourier transform processing on the second frequency domain signal to obtain a second time domain signal corresponding to the first frequency domain signal, the method further includes: Dividing the second time domain signal into a fourth time domain signal corresponding to the time domain signal of the current frame and a fifth time domain signal corresponding to the adjacent historical frame signal; The fourth time domain signal and the fifth time domain signal are superimposed.

8. A signal generating device, characterized in that: include: An acquisition module, configured to acquire a first time domain signal to be processed, wherein the first time domain signal includes a plurality of frequency point groups, each frequency point group includes a plurality of first frequency points, and a reference frequency point corresponding to the plurality of first frequency points; A first processing module, configured to perform short-time Fourier transform processing on the first time domain signal to obtain a first frequency domain signal corresponding to each frequency point in each of the frequency point groups; A calculation module, used for calculating the amplitude mask corresponding to each of the frequency point groups according to the first frequency domain signal corresponding to each of the reference frequency points; A second processing module, used for multiplying the first frequency domain signal corresponding to each frequency point in each of the frequency point groups by the corresponding amplitude mask to obtain a second frequency domain signal corresponding to each frequency point in each of the frequency point groups; The third processing module is used to perform inverse short-time Fourier transform processing on the second frequency domain signal to obtain a second time domain signal corresponding to the first frequency domain signal.

9. An electronic device, characterized in that: The method comprises a memory, a processor and a computer program stored in the memory and executable on the processor, wherein when the processor executes the program, the signal generating method as claimed in any one of claims 1 to 7 is implemented.

10. A computer-readable storage medium storing a computer program, characterized in that: When the computer program is executed by a processor, the signal generating method according to any one of claims 1 to 7 is implemented.

11. A computer program product, characterized in that The invention comprises a computer program, which, when executed by a processor, implements the signal generating method according to any one of claims 1 to 7.

Images