A sine wave audio processing method and processing terminal

By segmenting and restoring audio signals, a standard sine wave model is generated to process the top-cut audio signal, which solves the distortion and complexity of the top-cut audio signal in the existing technology, and realizes efficient automatic recovery of audio signals, maintains sound quality and saves resources .

CN118471248BActive Publication Date: 2024-11-01GUANGZHOU BAOLUN ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202410638567.5
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2024-05-22
Publication Date
2024-11-01
Estimated Expiration
2044-05-22

AI Technical Summary

Technical Problem

Existing audio signal top-cutting technology has distortion, increased hardware complexity and cost, and is unable to fully recover severely damaged audio quality.

Method used

By segmenting the audio signal, judging and determining the top-cut position, generating a standard sine wave model for restoration, and interpolation is used to process lost or damaged sample points to realize automatic processing of the audio signal.

Benefits of technology

Effectively reduce distortion, restore the original form of the audio signal, keep the sound quality pure, save hardware circuit costs and human resources, and is suitable for audio content with high-detail requirements.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118471248B_ABST
    Figure CN118471248B_ABST
Patent Text Reader

Abstract

The present invention discloses a sine wave audio processing method, comprising the following steps: step 1: splitting a received audio signal to obtain a plurality of sub-audio signals, and determining the number of sampling points of each sub-audio signal; step 2: traversing all sub-audio signals, judging whether the current sub-audio signal has clipping based on the amplitude of the sub-audio signal, and recording the audio signal with clipping as a clipping audio frame; step 3: traversing all sub-audio signals, determining the clipping start position and end position of the audio signal, thereby determining all clipping positions of the audio signal; step 4: generating a standard sine wave audio signal model, the amplitude of each clipping of the audio signal from the clipping start position to the clipping end position is the amplitude at the corresponding position of the standard sine wave audio signal model, thereby restoring the clipping of the audio signal, and completing the audio processing. The present invention can restore the original form of the audio signal, and can keep the original purity and naturalness of the sound quality as much as possible.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the field of computer technology, and in particular to a sine wave audio processing method and a processing terminal. Background Art

[0002] During the audio transmission process, the audio signal is generally pre-processed in the hardware circuit, including using circuit devices such as compressors or limiters to process the audio signal before entering the amplifier to reduce the dynamic range of the audio signal with excessive amplitude and prevent the audio signal from overloading. Such circuit devices reduce the dynamic range by reducing the peak amplitude of the audio signal, thereby avoiding audio signal clipping.

[0003] However, the existing audio signal clipping processing technology has some defects and shortcomings:

[0004] 1. Introducing additional distortion. During the compression of the compressor and the limiting process of the limiter, the dynamic range of the audio signal may be reduced and some of the original audio signal details may be lost.

[0005] 2. It is necessary to add circuit components such as compressors or limiters, which increases the complexity and cost of the hardware circuit and weakens the market competitiveness of the product.

[0006] 3. For severely clipped audio signals, hardware processing solutions based on hardware circuits may not be able to fully restore the original audio quality, especially when the audio signal has been severely damaged.

[0007] In summary, there is a need for an audio processing method that can better restore clipped audio signals. Summary of the invention

[0008] In view of the deficiencies in the prior art, an object of the present invention is to provide a sine wave audio processing method and a processing terminal, which can solve the problems described in the background technology.

[0009] The technical solution to achieve the purpose of the present invention is: a sine wave audio processing method, comprising the following steps:

[0010] Step 1: Segment the received audio signal to obtain a number of sub-audio signals, and determine the number of sampling points of each sub-audio signal;

[0011] Step 2: traverse all sub-audio signals, and determine whether the current sub-audio signal has clipping based on the amplitude of the sub-audio signal. The audio signal with clipping is recorded as a clipped audio frame;

[0012] Step 3: traverse all sub-audio signals to determine the clipping start position and end position of the audio signal, thereby determining all clipping positions of the audio signal;

[0013] Step 4: Generate a standard sine wave audio signal model, the amplitude of each clipping of the audio signal from the clipping start position to the clipping end position is the amplitude at the corresponding position of the standard sine wave audio signal model, so as to restore the clipping of the audio signal and complete the audio processing.

[0014] Furthermore, the audio signal is cut according to a preset time interval, and the number of sampling points of each sub-audio signal is determined based on the sampling frequency and the preset time interval.

[0015] Furthermore, the specific implementation process of judging whether the current sub audio signal has clipping based on the amplitude of the sub audio signal includes the following steps:

[0016] Step 21: Calculate the audio amplitude corresponding to each sample point. The audio amplitude of the nth sample point is recorded as x(n). Calculate the average amplitude A of the current sub-audio signal according to formula ①. avg :

[0017]

[0018] Wherein, N represents the total number of sub-audio signals;

[0019] Step 22: Compare the audio amplitudes of each sample point and find the audio amplitude with the largest value. The audio amplitude with the largest value is recorded as A. max ;

[0020] Step 23: Compare A max and A avg If the size relationship meets condition 1, the current sub-audio signal is clipped.

[0021] Condition 1: A max -A avg >D, D>0, D is the preset value.

[0022] Furthermore, the specific implementation process of traversing all sub-audio signals to determine the clipping start position and end position of the audio signal, thereby determining all clipping positions of the audio signal, includes the following steps:

[0023] Step 31: for the current sub-audio signal, starting from any clipped frame, traverse each sample point backward to find the first sample point with clipped top, and use the first sample point with clipped top as the clipping start position of the current sub-audio signal; traverse each sample point forward to find the last sample point with clipped top, and use the last sample point with clipped top as the clipping end position of the current sub-audio signal, thereby obtaining the clipping start position and end position of the current sub-audio signal;

[0024] Step 32: traverse each sub audio signal to determine the clipping start position and end position of each sub audio signal, the clipping start position of the audio signal is the clipping start position of the first sub audio signal, and the clipping end position of the audio signal is the clipping end position of the last sub audio signal.

[0025] Furthermore, based on the un-clipped audio signal or a known reference audio signal, sine wave parameters of the audio signal are extracted, the sine wave parameters including frequency, amplitude and phase, and the audio signal model of the standard sine wave is generated based on the sine wave parameters.

[0026] Further, if the sample points at the clipped positions of the audio signal are lost or damaged, interpolation is performed based on adjacent non-clipped sample points to estimate the lost or damaged sample points through interpolation.

[0027] Furthermore, interpolation adopts linear interpolation or spline interpolation.

[0028] A processing terminal, comprising:

[0029] A memory for storing program instructions;

[0030] The processor is used to run the program instructions to execute the steps of the sine wave audio processing method.

[0031] Beneficial effects of the present invention: Compared with existing restoration technologies that change the overall characteristics of audio, the present invention can restore the original form of the audio signal through sinusoidal clipping, and can keep the original purity and naturalness of the sound quality as much as possible. It effectively reduces the distortion caused by clipping and improves the listening experience of the audio. In addition, it can also restore the details of the clipped part and retain the integrity of the data. This is especially important for audio content such as music and speech that require high details. The algorithm can be executed automatically and can be implemented without the help of circuit devices or human intervention. It can save a lot of time and human resources when processing a large number of audio files, and can save the additional costs caused by traditional hardware-based circuit devices. BRIEF DESCRIPTION OF THE DRAWINGS

[0032] Figure 1 It is a schematic diagram of the process of the present invention;

[0033] Figure 2 A schematic diagram of the structure of the processing terminal. DETAILED DESCRIPTION

[0034] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments:

[0035] like Figure 1 As shown, a sine wave audio processing method comprises the following steps:

[0036] Step 1: Receive an audio signal, segment the audio signal to obtain a number of sub-audio signals, and determine the number of sampling points of each sub-audio signal.

[0037] For example, an audio signal with a duration of 1S (second) is received and divided into 1 sub-audio signal every 20ms (milliseconds), thereby obtaining 50 sub-audio signals in total. Assuming the sampling frequency is 44.1kHz (kilohertz), the sampling samples corresponding to each sub-audio signal are 44100 / 0.02=882, that is, each sub-audio signal includes 882 sampling points, and one sampling point is one sampling sample.

[0038] Step 2: traverse all sub-audio signals, and determine whether the current sub-audio signal has clipping based on the amplitude of the sub-audio signal. The audio signal with clipping is recorded as a clipped audio frame, thereby finding all sub-audio signals with clipping.

[0039] The specific implementation process of judging whether the current sub audio signal has clipping based on the amplitude of the sub audio signal includes the following steps:

[0040] Step 21: Calculate the audio amplitude corresponding to each sample point. The audio amplitude of the nth sample point is recorded as x(n). Calculate the average amplitude A of the current sub-audio signal according to formula ①. avg :

[0041]

[0042] Wherein, N represents the total number of sub-audio signals.

[0043] Step 22: Compare the audio amplitudes of each sample point and find the audio amplitude with the largest value. The audio amplitude with the largest value is recorded as A. max .

[0044] Step 23: Compare A max and A avg If the size relationship meets condition 1, the current sub-audio signal is clipped.

[0045] Condition 1: A max -A avg >D, D>0, D is the preset value.

[0046] Satisfying condition 1 means that the maximum amplitude (ie, peak value) of the current sub-audio signal is significantly higher than the average amplitude of the sub-audio signal, which indicates that clipping exists in the current sub-audio signal.

[0047] Step 3: Traverse all sub-audio signals to determine the clipping start position and end position of the audio signal, thereby determining all clipping positions of the audio signal.

[0048] The specific implementation process of traversing all sub-audio signals to determine the clipping start position and end position of the audio signal, thereby determining all clipping positions of the audio signal, includes the following steps:

[0049] Step 31: for the current sub-audio signal, starting from any clipped frame, traverse each sample point backward to find the first sample point with clipping, that is, find the first clipped audio frame, and use the first clipped sample point as the clipping start position of the current sub-audio signal; traverse each sample point forward to find the last sample point with clipping, that is, find the last clipped audio frame, and use the last clipped sample point as the clipping end position of the current sub-audio signal, thereby obtaining the clipping start position and end position of the current sub-audio signal.

[0050] Step 32: traverse each sub-audio signal to determine the clipping start position and end position of each sub-audio signal, and then determine the clipping start position and end position of the audio signal.

[0051] The clipping start position of the audio signal is also the clipping start position of the first sub audio signal, and the clipping end position of the audio signal is also the clipping end position of the last sub audio signal.

[0052] Step 4: Based on an un-clipped audio signal or a known reference audio signal, extract the sine wave parameters of the audio signal, the sine wave parameters include frequency, amplitude and phase, and generate a standard sine wave audio signal model based on the sine wave parameters. The clipped amplitude of the audio signal is predicted based on the standard sine wave audio signal model, and the amplitudes of each clipped portion of the audio signal from the clipping start position to the clipping end position are the amplitudes at the corresponding positions of the standard sine wave audio signal model, thereby restoring the clipped portion of the audio signal and completing the audio processing.

[0053] In an optional implementation, if the sample points at the clipped positions of the audio signal are lost or damaged, interpolation is performed based on adjacent non-clipped sample points to estimate the lost or damaged sample points through interpolation.

[0054] The interpolation adopts linear interpolation or spline interpolation. Since linear interpolation and spline interpolation are existing technologies, the specific interpolation method is not described here.

[0055] Compared with the existing restoration technology that changes the overall characteristics of the audio, the sine wave clipping restoration of the present invention can restore the original form of the audio signal and keep the original purity and naturalness of the sound quality as much as possible. It effectively reduces the distortion caused by clipping and improves the listening experience of the audio. In addition, it can also restore the details of the clipped part and retain the integrity of the data. This is especially important for audio content such as music and speech that require high details. The algorithm can be executed automatically and can be implemented without the help of circuit devices and manual intervention. It can save a lot of time and human resources when processing a large number of audio files, and can save the additional costs caused by traditional hardware-based circuit devices.

[0056] like Figure 2 As shown, the present invention also provides a processing terminal 100, which includes:

[0057] Memory 101, used for storing program instructions;

[0058] The processor 102 is used to run the program instructions to execute the steps of the sine wave audio processing method.

[0059] The embodiment disclosed in this specification is only an example of a unilateral feature of the present invention, and the protection scope of the present invention is not limited to this embodiment, and any other functionally equivalent embodiments fall within the protection scope of the present invention. For those skilled in the art, various other corresponding changes and deformations can be made according to the technical solutions and concepts described above, and all of these changes and deformations should fall within the protection scope of the claims of the present invention.

Claims

1. A sine wave audio processing method, characterized in that: The following steps are involved: Step 1: Segment the received audio signal to obtain a number of sub-audio signals, and determine the number of sampling points of each sub-audio signal; Step 2: traverse all sub-audio signals, and determine whether the current sub-audio signal has clipping based on the amplitude of the sub-audio signal. The audio signal with clipping is recorded as a clipped audio frame; Step 3: traverse all sub-audio signals to determine the clipping start position and end position of the audio signal, thereby determining all clipping positions of the audio signal; Step 4: Generate a standard sine wave audio signal model, the amplitude of each clipping of the audio signal from the clipping start position to the clipping end position is the amplitude at the corresponding position of the standard sine wave audio signal model, so as to restore the clipping of the audio signal and complete the audio processing.

2. The sine wave audio processing method according to claim 1, characterized in that: The audio signal is cut according to a preset time interval, and the number of sampling points of each sub-audio signal is determined based on a sampling frequency and the preset time interval.

3. The sine wave audio processing method according to claim 1, characterized in that: The specific implementation process of judging whether the current sub audio signal has clipping based on the amplitude of the sub audio signal includes the following steps: Step 21: Calculate the audio amplitude corresponding to each sample point. The audio amplitude of the nth sample point is recorded as x(n). Calculate the average amplitude A of the current sub-audio signal according to formula ①. avg : Wherein, N represents the total number of sub-audio signals; Step 22: Compare the audio amplitudes of each sample point and find the audio amplitude with the largest value. The audio amplitude with the largest value is recorded as A. max ; Step 23: Compare A max and A avg If the size relationship meets condition 1, the current sub-audio signal is clipped. Condition 1: A max -A avg >D, D>0, D is the preset value.

4. The sine wave audio processing method according to claim 1 or 3, characterized in that: The specific implementation process of traversing all sub-audio signals to determine the clipping start position and end position of the audio signal, thereby determining all clipping positions of the audio signal, includes the following steps: Step 31: for the current sub-audio signal, starting from any clipped frame, traverse each sample point backward to find the first sample point with clipped top, and use the first sample point with clipped top as the clipping start position of the current sub-audio signal; traverse each sample point forward to find the last sample point with clipped top, and use the last sample point with clipped top as the clipping end position of the current sub-audio signal, thereby obtaining the clipping start position and end position of the current sub-audio signal; Step 32: traverse each sub audio signal to determine the clipping start position and end position of each sub audio signal, the clipping start position of the audio signal is the clipping start position of the first sub audio signal, and the clipping end position of the audio signal is the clipping end position of the last sub audio signal.

5. The sine wave audio processing method according to claim 4, characterized in that: Based on an un-clipped audio signal or a known reference audio signal, sine wave parameters of the audio signal are extracted, the sine wave parameters including frequency, amplitude and phase, and the audio signal model of the standard sine wave is generated based on the sine wave parameters.

6. The sine wave audio processing method according to claim 5, characterized in that: If the sample points at the clipped positions of the audio signal are lost or damaged, interpolation is performed based on adjacent non-clipped sample points to estimate the lost or damaged sample points through interpolation.

7. The sine wave audio processing method according to claim 6, characterized in that: Interpolation uses linear interpolation or spline interpolation.

8. A processing terminal, characterized in that: It includes: A memory for storing program instructions; A processor is used to run the program instructions to execute the steps of the sine wave audio processing method as claimed in any one of claims 1 to 7.