Audio data offset detection and compensation method and system, storage medium and equipment

Abstract

The invention relates to the technical field of audio optimization, and discloses an audio data offset detection and compensation method and system, a storage medium and equipment, and the method comprises the steps: building a timestamp synchronization mechanism with nanosecond precision, and distributing a unique time identifier for each floating-point audio sampling point; detecting time sequence offsets of input and output signals through a self-adaptive sliding window, and positioning and determining an offset value based on a cross-correlation function extreme value; a compensation strategy is dynamically selected according to different intervals where the offset absolute value is located, and meanwhile a dynamic cache management mechanism is established to support real-time offset compensation operation; constructing a time sequence relation model through inter-channel signal correlation analysis in the multi-channel system, and implementing coordinated offset compensation based on a correlation analysis result and the compensation strategy; a performance monitoring index system is established to evaluate the offset compensation effect in real time, compensation parameters are adaptively adjusted according to audio content characteristics and system performance feedback, and accurate time sequence control over audio data is achieved through the method.

Description

Technical Field

[0001] The present invention relates to the field of audio optimization technology, and in particular to an audio data offset detection and compensation method, system, storage medium and device. Background Art

[0002] In digital audio systems, the input and output of audio signals involves complex clock synchronization and data transmission mechanisms. Traditional audio processing systems are primarily based on 16-bit or 24-bit integer formats. However, with the advancement of audio technology, 32-bit floating-point formats have gradually become the standard in the professional audio field. However, existing timing control technologies face numerous challenges when processing 32-bit audio data.

[0003] First, 32-bit floating-point data processing requires higher precision, which traditional integer operations cannot meet. Second, clock frequency differences between audio input and output devices can cause time offsets at the sampling points. This offset accumulates and amplifies over long periods of time, seriously affecting audio quality. Existing offset compensation algorithms often use simple linear interpolation or fixed delay compensation, which cannot handle dynamically changing time offsets. Furthermore, in multichannel audio systems, the relative time offsets between channels are even more complex, making it difficult for traditional algorithms to achieve precise synchronization.

[0004] It can be seen that current audio systems generally have input and output time offset problems when processing 32-bit digital signals. Traditional clock synchronization mechanisms cannot effectively handle the timing deviations of high-precision audio signals, resulting in misaligned audio sampling points, signal distortion, and inconsistent delays. Most existing offset compensation algorithms only support 16-bit or 24-bit precision and are insufficient for processing 32-bit floating-point audio. In addition, in multi-channel audio systems, the cumulative effect of offsets between channels seriously affects the sound quality. Especially in professional audio production and real-time audio processing scenarios, time offset errors can cause audio synchronization failures, affecting the overall audio quality and user experience. These technical deficiencies limit the performance of 32-bit audio systems in professional applications, and there is an urgent need to develop specialized offset skew algorithms to address these problems. Summary of the Invention

[0005] The purpose of the present invention is to address the shortcomings of the above-mentioned prior art and to provide an audio data offset detection and compensation method, system, storage medium and device. By establishing a high-precision timestamp calibration mechanism and an adaptive offset detection module, precise timing control of 32-bit floating-point audio data is achieved.

[0006] In one aspect, a method for detecting and compensating an audio data offset is disclosed, comprising the following steps: S1: Establish a nanosecond-level precision timestamp synchronization mechanism to assign a unique time identifier to each floating-point audio sampling point; S2: Detect the timing offset between the input and output signals through an adaptive sliding window, and determine the offset value based on the extreme value positioning of the cross-correlation function; S3: Dynamically select a compensation strategy based on the different intervals of the absolute value of the offset, and establish a dynamic cache management mechanism to support real-time offset compensation operations. The compensation strategies include coarse compensation, fine compensation, and precise compensation. S4: constructing a timing relationship model in a multi-channel system by analyzing the correlation of signals between channels, and implementing coordinated offset compensation based on the correlation analysis results and the compensation strategy; S5: Establish a performance monitoring indicator system to evaluate the offset compensation effect in real time, and adaptively adjust the compensation parameters based on audio content characteristics and system performance feedback.

[0007] Furthermore, in step S1, establishing a timestamp synchronization mechanism with nanosecond precision includes: A high-precision timestamp generator based on the system clock is used to establish a timestamp synchronization mechanism between channels, assigning a unique time identifier to each sampling point of the audio data. The timestamp synchronization mechanism adopts a master-slave clock architecture, with the master channel timestamp as the benchmark and the slave channel timestamps calibrating the time differences of each channel by superimposing the signal propagation delay compensation amount.

[0008] Furthermore, in step S2, detecting the timing offset between the input and output signals by using an adaptive sliding window includes: The sliding window length of the offset detection is dynamically configured according to the audio sampling rate. By calculating the cross-correlation function of the input and output signals, the offset corresponding to the maximum correlation value is found, which is the detected time offset; A prediction model based on historical offset data is established, and an exponential smoothing algorithm is used to predict future offset change trends, creating conditions for active offset compensation.

[0009] Preferably, the establishing of a prediction model based on historical offset data further comprises: S21: Establish a first-in-first-out data buffer, continuously collect and store the most recently detected offset sequence as a historical offset data set, perform outlier filtering on the offset data, and normalize it to a standard value; S22: Set the sampling period, build a prediction model based on the historical offset within the sampling period in the data buffer, use the exponential smoothing algorithm to calculate the predicted value, and adaptively configure the smoothing coefficient and prediction step size according to the scenario; S23: Statistically analyze historical prediction errors and divide confidence intervals based on the analysis results, output the results after denormalization, and update parameter configurations based on historical prediction errors to dynamically correct subsequent predictions.

[0010] Furthermore, in step S3, the dynamic selection of the compensation strategy includes: According to the offset size, three compensation levels are set in descending order, and the offset threshold range of each compensation level is set. The compensation strategy is formulated according to the compensation level of the detected offset. If the offset is within the first compensation level range, the coarse compensation strategy is adopted to perform the entire sampling point displacement; If the offset is within the range of the secondary compensation level, a fine compensation strategy is adopted, using linear interpolation to achieve sub-sampling point compensation; If the offset is within the range of the third compensation level, a fine compensation strategy is adopted, an interpolation filter based on the sinc function is used, and a Kaiser window function is applied to suppress spectrum leakage.

[0011] Preferably, the dynamic selection compensation strategy further includes: S31: After executing each compensation strategy, obtaining the offset detection value after the compensation in real time; S32: re-determining the compensation level range based on the updated offset value, and triggering a corresponding compensation strategy according to the newly determined compensation level; S33: Steps S31 to S32 are iteratively executed in a loop until the absolute value of the offset detection value is lower than a preset minimum compensation threshold.

[0012] Furthermore, in step S4, the timing relationship model is used to quantify the timing correlation between channels through the mathematical relationship between the input signal, the delay variable and the output function, further comprising: S41: The input signal sequence of the fixed reference channel is used as a time reference, and the signal sequence of another channel is shifted by a specified number of sampling points to align the signals. The specified number is the delay offset. S42: performing a three-stage operation on each translated position, including cross-correlation calculation, channel energy normalization, and normalization processing; S43: Traverse the preset offset range, record the correlation coefficient corresponding to each delay offset, and locate the maximum value of the mutual correlation coefficient and its corresponding offset.

[0013] Preferably, in step S4, the coordinated offset compensation includes: S44: Calculating the normalized mutual correlation coefficient between each channel and the reference channel using the timing relationship model; S45: generating a channel weight based on the maximum value of the cross-correlation coefficient and a channel reliability evaluation value, wherein the channel reliability evaluation value is obtained by evaluating the signal stability of the reference channel based on historical data; S46: Collect the independent offset requirements of all channels to be compensated, use a weighted average algorithm to calculate the compensation requirements of all channels, and output a coordinated compensation amount.

[0014] Furthermore, in step S5, establishing a performance monitoring indicator system includes: The system monitors the signal-to-noise ratio improvement, total harmonic distortion reduction, and channel synchronization accuracy in real time, generates a comprehensive quality index through weighted calculation, and triggers adaptive adjustment of compensation parameters when the comprehensive quality index falls below a set threshold.

[0015] Furthermore, in step S5, the adaptively adjusting the compensation parameters further includes: If the monitoring indicator system detects that the offset compensation effect is poor, dynamically optimize the offset detection window length, the smoothing coefficient of the exponential smoothing prediction model, and the threshold for switching the hierarchical compensation strategy; Through the performance feedback mechanism, compensation parameters are optimized to adapt to different audio content and working environments.

[0016] Preferably, in step S5, establishing a dynamic cache management mechanism further includes: Setting a minimum buffer capacity of the audio buffer based on the maximum expected offset, and setting maximum and minimum buffer capacity thresholds of the audio buffer based on performance and application scenarios; The read / write pointer position is dynamically offset according to the real-time compensation amount.

[0017] Furthermore, the method further comprises: For different sampling rate configurations, the timestamp generation interval, offset detection window length, and audio buffer capacity parameters are scaled proportionally to maintain the timing accuracy unchanged.

[0018] In another aspect, an audio data offset detection and compensation system is provided, comprising: The timestamp generation and synchronization module is used to establish a nanosecond-level precision timestamp synchronization mechanism and assign a unique time identifier to each floating-point audio sampling point; An offset detection module is used to detect the timing offset between the input and output signals through an adaptive sliding window and determine the offset value based on the extreme value positioning of the cross-correlation function; A hierarchical compensation execution module is used to dynamically select a compensation strategy based on the different intervals of the absolute value of the offset, and establish a dynamic cache management mechanism to support real-time offset compensation operations. The compensation strategies include coarse compensation, fine compensation, and precise compensation; A multi-channel coordination module is used to construct a timing relationship model through inter-channel signal correlation analysis in a multi-channel system, and implement coordinated offset compensation based on the correlation analysis results and the compensation strategy; The monitoring and optimization module is used to establish a performance monitoring indicator system to evaluate the offset compensation effect in real time and adaptively adjust the compensation parameters based on the audio content characteristics and system performance feedback.

[0019] In addition, a computer-readable storage medium is provided, on which a computer program is stored. When the program is executed by a processor, the method for detecting and compensating audio data offset described in any one of the above is implemented.

[0020] At the same time, an electronic device is provided, including: one or more processors; a storage device for storing one or more programs, which, when executed by the one or more processors, enables the one or more processors to implement any of the above-mentioned audio data offset detection and compensation methods.

[0021] Compared with the prior art, the present invention has the following beneficial effects: The present invention realizes precise timing control of 32-bit floating-point audio data by establishing a high-precision timestamp calibration mechanism and an adaptive offset detection module; The present invention adopts a hierarchical offset compensation strategy, combines hardware clock reference and software algorithm optimization, builds a dual calibration system, introduces dynamic cache management and predictive offset correction technology, and can monitor and compensate for the time offset of audio input and output in real time; The present invention supports multi-channel parallel processing, ensures the timing consistency between channels through cross-correlation analysis and phase locking technology, and effectively solves the time synchronization problem of 32-bit audio systems. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] The accompanying drawings are used to provide a further understanding of the present invention and constitute a part of the specification. Together with the embodiments of the present invention, they are used to explain the present invention and do not constitute a limitation of the present invention. In the accompanying drawings: Figure 1 A flowchart of an audio data offset detection and compensation method according to the present invention is provided; Figure 2 This is a schematic diagram of a process for establishing a prediction model based on historical offset data according to the present invention; Figure 3 A schematic diagram of a dynamic compensation strategy switching mechanism of the present invention; Figure 4 A schematic diagram of a dynamic compensation strategy flow of the present invention; Figure 5 A schematic diagram of a flow chart for establishing a temporal relationship model of the present invention; Figure 6 A schematic diagram of a coordinated offset compensation process of the present invention; Figure 7 This is a structural block diagram of an audio data offset detection and compensation system of the present invention; Figure 8 The figure is a schematic diagram of an embodiment of an electronic device according to the present invention. DETAILED DESCRIPTION

[0023] To make the purpose, technical solutions, and advantages of the embodiments of this application more clear, the technical solutions in the embodiments of this application will be clearly and completely described below in conjunction with the drawings in the embodiments of this application. Obviously, the described embodiments are part of the embodiments of this application, not all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by ordinary technicians in this field without making creative efforts are within the scope of protection of this application.

[0024] The present invention improves time accuracy from the traditional millisecond level to the nanosecond level by establishing a nanosecond-level high-precision timestamp generation mechanism and a multi-channel synchronization calibration system, with an accuracy improvement of 1000 times, providing unprecedented timing control capabilities for audio data. Secondly, the adaptive offset detection algorithm combined with sliding window technology and cross-correlation analysis can accurately detect time offsets at the level of a single sampling point in real time, with detection accuracy and response speed significantly superior to traditional methods. In terms of compensation strategy, an innovative hierarchical compensation mechanism is proposed, which intelligently selects coarse compensation, fine compensation, or fine compensation strategies based on the offset size, ensuring compensation accuracy while optimizing computational complexity. The audio offset compensation accuracy can reach 0.01 sampling points. The multi-channel coordinated compensation algorithm establishes a timing relationship model between channels through correlation analysis, achieving coordinated synchronization of each channel, and improving multi-channel synchronization accuracy by more than 80%. Most importantly, the algorithm has strong adaptive capabilities. Through a parameter self-adjustment mechanism and a real-time performance monitoring system, it can automatically optimize algorithm parameters according to different audio content and working environments, ensuring that the system always operates in the best state.

[0025] The specific implementation of the present invention is described below with reference to the accompanying drawings and embodiments.

[0026] Example 1 In this embodiment, we choose 32-bit audio data when processing the audio system. Most existing offset compensation algorithms only support 16-bit or 24-bit precision and are insufficient for processing 32-bit floating-point audio. The time accuracy of the 32-bit audio system can be improved to the nanosecond level, and the total harmonic distortion of the audio signal can be reduced by more than 60%.

[0027] like Figure 1 As shown in FIG, a technical solution of an audio data offset detection and compensation method provided in this embodiment includes the following steps: S1: Establish a nanosecond-level precision timestamp synchronization mechanism to assign a unique time identifier to each floating-point audio sampling point; S2: Detect the timing offset between the input and output signals through an adaptive sliding window, and determine the offset value based on the extreme value positioning of the cross-correlation function; S3: Dynamically select a compensation strategy based on the different intervals of the absolute value of the offset, and establish a dynamic cache management mechanism to support real-time offset compensation operations. The compensation strategies include coarse compensation, fine compensation, and precise compensation. S4: constructing a timing relationship model in a multi-channel system by analyzing the correlation of signals between channels, and implementing coordinated offset compensation based on the correlation analysis results and the compensation strategy; S5: Establish a performance monitoring indicator system to evaluate the offset compensation effect in real time, and adaptively adjust the compensation parameters based on audio content characteristics and system performance feedback.

[0028] For step S1 to establish a timestamp synchronization mechanism with nanosecond precision, we first generate a timestamp, including: A high-precision timestamp generator based on the system clock is used to establish a timestamp synchronization mechanism between channels, assigning a unique timestamp to each sampling point of the audio data. Specifically: For the 32-bit audio data in this embodiment, the timestamp accuracy reaches nanosecond level. The generated calculation formula is as follows: in, is the system base time, is the sampling point number, is the sampling frequency. For 32-bit audio at a 48kHz sampling rate, the time interval between each sample point is 20.833 microseconds. High-precision timestamps accurately identify the time position of each 32-bit floating-point sample point, providing a foundation for subsequent offset detection and compensation. This timestamp mechanism provides nanosecond-level time accuracy, a 1000-fold improvement over traditional millisecond-level accuracy, and provides a reliable foundation for precise timing control of 32-bit audio.

[0029] Next, the timestamp synchronization mechanism adopts a master-slave clock architecture, with the master channel timestamp as the benchmark, and the slave channel timestamps are superimposed with signal propagation delay compensation to achieve time difference calibration of each channel.

[0030] In this embodiment, for a multi-channel 32-bit audio system, it is necessary to establish a timestamp synchronization mechanism between channels. Using a master-slave clock architecture, the time offset of each channel is calculated. , which is expressed as follows: in, Indicates the main channel timestamp, Indicates the Channel timestamp, Indicates signal propagation delay compensation. In an 8-channel 32-bit audio system, channel 1 is the primary channel, and the other seven channels undergo timestamp calibration. Cross-correlation analysis detects time differences between channels and automatically adjusts timestamp offsets to ensure consistent time bases across all channels. The multi-channel synchronization calibration mechanism reduces inter-channel time offsets to within 10 nanoseconds, significantly improving the synchronization accuracy of multi-channel audio.

[0031] Then, the offset detection of step S2 is performed, wherein the sliding window length of the offset detection is dynamically configured according to the audio sampling rate, and the offset corresponding to the maximum correlation value is found by calculating the cross-correlation function of the input and output signals, which is the detected time offset.

[0032] In this embodiment, for input and output offset detection of a 32-bit audio signal, the detection window length is set to N sampling points, and the offset calculation formula is as follows: in, To input 32-bit audio signal, To output 32-bit audio signal, is the offset range, The detection window length is 1024 points for 32-bit audio with a sampling rate of 44.1kHz, which is about 23 milliseconds of audio data. By calculating the cross-correlation function of the input and output signals, the offset corresponding to the maximum correlation value is found, which is the detected time offset. The adaptive detection algorithm can accurately detect the offset under different audio content, with detection accuracy reaching the level of a single sampling point, providing accurate offset quantization for 32-bit audio. On this basis, we establish a prediction model based on historical offset data and use exponential smoothing algorithm to predict future offset change trends, creating conditions for active offset compensation. Figure 2 As shown, specifically including: S21: Establish a first-in-first-out data buffer, continuously collect and store the most recently detected offset sequence as a historical offset data set, perform outlier filtering on the offset data, and normalize it to a standard value; S22: Set the sampling period, build a prediction model based on the historical offset within the sampling period in the data buffer, use the exponential smoothing algorithm to calculate the predicted value, and adaptively configure the smoothing coefficient and prediction step size according to the scenario; S23: Statistically analyze historical prediction errors and divide confidence intervals based on the analysis results, output the results after denormalization, and update parameter configurations based on historical prediction errors to dynamically correct subsequent predictions.

[0033] The exponential smoothing algorithm is expressed as follows: in, is the smoothing coefficient, Indicates the predicted offset at the next moment, Indicates the offset of the current detection. Set the smoothing coefficient A prediction model is built based on the most recent 100 offset detection results. This model can predict offset changes within the next 5-10 sampling periods, providing a basis for proactive offset compensation. The prediction model can identify offset trends in advance with an accuracy rate exceeding 90%, paving the way for proactive offset compensation.

[0034] After obtaining the offset, we design and execute the compensation strategy in step S3, which specifically includes: According to the offset size, three compensation levels are set in descending order, and the offset threshold range of each compensation level is set. The compensation strategy is formulated according to the compensation level of the detected offset. If the offset is within the first compensation level range, the coarse compensation strategy is adopted to perform the entire sampling point displacement; If the offset is within the range of the secondary compensation level, a fine compensation strategy is adopted, using linear interpolation to achieve sub-sampling point compensation; If the offset is within the range of the third compensation level, a fine compensation strategy is adopted, an interpolation filter based on the sinc function is used, and a Kaiser window function is applied to suppress spectrum leakage.

[0035] In this embodiment, if Figure 3 As shown, setting three compensation levels includes: For coarse compensation (offset > 1 sampling point), the hard displacement is calculated as follows: Fine compensation (offset is between 0.1 and 1 sampling points), the linear interpolation calculation formula is as follows: Fine compensation (offset < 0.1 sampling points), the sinc interpolation filter compensation calculation formula is as follows: For a detected offset of 0.7 samples, a coarse compensation shift is first performed, followed by fine compensation through linear interpolation. For even smaller offsets of 0.05 samples, an 8-point sinc interpolation filter is used for fine compensation. This hierarchical compensation strategy ensures accuracy while optimizing computational complexity, achieving an offset compensation accuracy of 0.01 samples for 32-bit audio.

[0036] Preferably, if Figure 4 As shown, the dynamic selection compensation strategy further includes: S31: After executing each compensation strategy, obtaining the offset detection value after the compensation in real time; S32: re-determining the compensation level range based on the updated offset value, and triggering a corresponding compensation strategy according to the newly determined compensation level; S33: Steps S31 to S32 are iteratively executed in a loop until the absolute value of the offset detection value is lower than a preset minimum compensation threshold.

[0037] A real-time cache management mechanism is established for this compensation strategy, including: Setting a minimum buffer capacity of the audio buffer based on the maximum expected offset, and setting maximum and minimum buffer capacity thresholds of the audio buffer based on performance and application scenarios; The read / write pointer position is dynamically offset according to the real-time compensation amount.

[0038] In this embodiment, the cache management algorithm is expressed as follows: in, is the dynamic cache size, is the maximum expected offset, The current offset amount. At a 48kHz sampling rate, the minimum buffer size is set to 960 samples (20 milliseconds) and the maximum buffer size is set to 4800 samples (100 milliseconds). The read and write pointer positions are dynamically adjusted based on the real-time offset detection to achieve smooth offset compensation. Dynamic buffer management adapts to offset changes of varying magnitudes, preventing audio data loss or duplication and ensuring the continuity of the 32-bit audio stream.

[0039] In step S4, the timing relationship model is used to quantify the timing correlation between channels through the mathematical relationship between the input signal, the delay variable and the output function, such as Figure 5 As shown, further comprising: S41: The input signal sequence of the fixed reference channel is used as a time reference, and the signal sequence of another channel is shifted by a specified number of sampling points to align the signals. The specified number is the delay offset. S42: performing a three-stage operation on each translated position, including cross-correlation calculation, channel energy normalization, and normalization processing; S43: Traverse the preset offset range, record the correlation coefficient corresponding to each delay offset, and locate the maximum value of the mutual correlation coefficient and its corresponding offset.

[0040] Specifically, in this embodiment, we perform correlation analysis on multi-channel 32-bit audio and establish a timing relationship model between channels. The formula is as follows: in, Indicates channel and channel The correlation coefficient at the delay τ, and This method represents a 32-bit audio signal representing each channel. In a stereo system, it analyzes the correlation between the left and right channels. By calculating the correlation coefficient at different delays, the delay corresponding to the maximum correlation value is found, which is the time offset between the two channels. Correlation analysis accurately identifies the timing relationship between channels, providing a quantitative basis for multi-channel synchronization, and improving synchronization accuracy by 80%.

[0041] On this basis, we perform coordinated offset compensation, such as Figure 6 Shown, including: S44: Calculating the normalized mutual correlation coefficient between each channel and the reference channel using the timing relationship model; S45: generating a channel weight based on the maximum value of the cross-correlation coefficient and a channel reliability evaluation value, wherein the channel reliability evaluation value is obtained by evaluating the signal stability of the reference channel based on historical data; S46: Collect the independent offset requirements of all channels to be compensated, use a weighted average algorithm to calculate the compensation requirements of all channels, and output a coordinated compensation amount.

[0042] In this embodiment, by drawing Follow Changing curve, maximizing , and get the peak value , and then based on the inter-channel correlation analysis results, a coordinated offset compensation is implemented, which is expressed as follows: in, Indicates channel The comprehensive compensation amount, is the weight coefficient, represents the maximum correlation coefficient, Indicates channel Reliability assessment. In a 5.1-channel system, each channel is weighted based on its correlation with the center channel, with the center channel as a reference. Channels with high correlation receive greater weight, ensuring timing coordination across the entire system. The coordinated compensation algorithm balances the offset compensation needs of each channel, preventing the impact of compensation on overall synchronization from being affected by a single channel, and improving multi-channel synchronization stability by 90%.

[0043] Finally, in step S5, we establish a performance monitoring indicator system, including: Real-time monitoring of the three indicators of signal-to-noise ratio improvement, total harmonic distortion reduction, and channel synchronization accuracy, generates a comprehensive quality index through weighted calculation, and triggers adaptive adjustment of compensation parameters when the comprehensive quality index falls below the set threshold. The weighted formula is as follows: in, Indicates the improvement of signal-to-noise ratio, Indicates the degree of reduction of total harmonic distortion. Indicates synchronization accuracy, 、 and These are the weighting coefficients corresponding to the three indicators. The weights for SNR, THD, and synchronization accuracy are set to 0.4, 0.3, and 0.3, respectively. The system calculates the comprehensive quality index once per second. When the index falls below the set threshold, the parameter adjustment mechanism is triggered. The real-time monitoring system can promptly detect performance degradation and trigger optimization adjustments, ensuring that the 32-bit audio system always operates at its optimal state, improving overall audio quality by 50%.

[0044] Adaptively adjust compensation parameters based on real-time monitoring results, including: If the monitoring indicator system detects that the offset compensation effect is poor, dynamically optimize the offset detection window length, the smoothing coefficient of the exponential smoothing prediction model, and the threshold for switching the hierarchical compensation strategy; Through the performance feedback mechanism, compensation parameters are optimized to adapt to different audio content and working environments.

[0045] In this embodiment, the automatic parameter adjustment formula is as follows: in, represents the adjusted algorithm parameters, represents the adjustment coefficient, Indicates performance error. When the system detects poor offset compensation, it automatically adjusts the smoothing coefficient α and the detection window length N. Through a performance feedback mechanism, the algorithm parameters are optimized to adapt to different audio content and operating environments. This adaptive adjustment mechanism maintains optimal algorithm performance and stable compensation across different application scenarios, improving system adaptability by 70%.

[0046] The method further comprises: For different sampling rate configurations, the timestamp generation interval, offset detection window length, and audio buffer capacity parameters are scaled proportionally to maintain the timing accuracy unchanged.

[0047] By implementing all of the above technical solutions, we can effectively solve the input and output offset problem of audio systems, achieve high-precision timing control and high-quality audio transmission. The algorithm has excellent real-time performance, accuracy, and adaptability, providing reliable technical support for the widespread application of audio technology.

[0048] On the other hand, this embodiment also provides an audio data offset detection and compensation system, such as Figure 7 Shown, including: The timestamp generation and synchronization module is used to establish a nanosecond-level precision timestamp synchronization mechanism and assign a unique time identifier to each floating-point audio sampling point; An offset detection module is used to detect the timing offset between the input and output signals through an adaptive sliding window and determine the offset value based on the extreme value positioning of the cross-correlation function; A hierarchical compensation execution module is used to dynamically select a compensation strategy based on the different intervals of the absolute value of the offset, and establish a dynamic cache management mechanism to support real-time offset compensation operations. The compensation strategies include coarse compensation, fine compensation, and precise compensation; A multi-channel coordination module is used to construct a timing relationship model through inter-channel signal correlation analysis in a multi-channel system, and implement coordinated offset compensation based on the correlation analysis results and the compensation strategy; The monitoring and optimization module is used to establish a performance monitoring indicator system to evaluate the offset compensation effect in real time and adaptively adjust the compensation parameters based on the audio content characteristics and system performance feedback.

[0049] It should be noted that the steps in the audio data offset detection and compensation method provided in this embodiment can be implemented based on the corresponding modules in the audio data offset detection and compensation system. Those skilled in the art can refer to the technical solution of the system to implement the step flow of the method. That is, the embodiments in the system can be understood as preferred examples for implementing the method, which will not be elaborated here.

[0050] This embodiment also provides an electronic device, such as Figure 8 As shown, the electronic device includes a processor 14 and a memory 13 . The memory 13 stores machine-executable instructions that can be executed by the processor 14 . The processor 14 executes the machine-executable instructions to implement the above-mentioned audio control method.

[0051] Further, Figure 8 The electronic device shown further includes a bus 12 and a communication interface 11 , and the processor 14 , the communication interface 11 and the memory 13 are connected via the bus 12 .

[0052] The memory 13 may include high-speed random access memory (RAM) and may also include non-volatile memory, such as at least one disk storage. The communication connection between the system network element and at least one other network element is achieved through at least one communication interface 11 (which may be wired or wireless), and the Internet, wide area network, local area network, metropolitan area network, etc. may be used. The bus 12 may be an ISA bus, a PCI bus, or an EISA bus. The bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, Figure 8 Only one bidirectional arrow is used in the diagram, but this does not mean that there is only one bus or one type of bus.

[0053] The processor 14 may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method may be completed by hardware integrated logic circuits or software instructions in the processor 14. The processor 14 may be a general-purpose processor, including a central processing unit (CPU), a network processor (NP), etc.; it may also be a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It may implement or execute the various methods, steps, and logic block diagrams disclosed in this embodiment. The general-purpose processor may be a microprocessor or any conventional processor. The steps of the method disclosed in this embodiment may be directly implemented and executed by a hardware decoding processor, or by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium well-known in the art, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, registers, or the like. The storage medium is located in the memory 1001 , and the processor 1000 reads the information in the memory 1001 and completes the steps of the audio control method in combination with its hardware.

[0054] The present disclosure also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium. The computer-readable storage medium stores a computer program, which enables the computer to execute the steps of the audio control method when the computer program runs on the computer.

[0055] Finally, it should be noted that the above description is merely a preferred embodiment of the present invention, and the scope of protection of the present invention is not limited to the above embodiment. All technical solutions based on the principles of the present invention are within the scope of protection of the present invention. It should be noted that improvements and modifications that do not depart from the principles of the present invention, which are apparent to those skilled in the art, should also be considered within the scope of protection of the present invention.

[0056] The technical features of the above-mentioned embodiments can be combined arbitrarily. In order to make the description concise, not all possible combinations of the technical features in the above-mentioned embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

Claims

1. A method for detecting and compensating audio data offset, characterized in that: The steps include: S1: Establish a nanosecond-level precision timestamp synchronization mechanism to assign a unique time identifier to each floating-point audio sampling point; S2: Detect the timing offset between the input and output signals through an adaptive sliding window, and determine the offset value based on the extreme value positioning of the cross-correlation function; S3: Dynamically select a compensation strategy based on the different intervals of the absolute value of the offset, and establish a dynamic cache management mechanism to support real-time offset compensation operations. The compensation strategies include coarse compensation, fine compensation, and precise compensation. S4: constructing a timing relationship model in a multi-channel system by analyzing the correlation of signals between channels, and implementing coordinated offset compensation based on the correlation analysis results and the compensation strategy; S5: Establish a performance monitoring indicator system to evaluate the offset compensation effect in real time, and adaptively adjust the compensation parameters based on audio content characteristics and system performance feedback.

2. The audio data offset detection and compensation method according to claim 1, wherein: In step S1, the establishment of a timestamp synchronization mechanism with nanosecond precision further includes: A high-precision timestamp generator based on the system clock is used to establish a timestamp synchronization mechanism between channels, assigning a unique time identifier to each sampling point of the audio data. The timestamp synchronization mechanism adopts a master-slave clock architecture, with the master channel timestamp as the benchmark and the slave channel timestamps calibrating the time differences of each channel by superimposing the signal propagation delay compensation amount.

3. The audio data offset detection and compensation method according to claim 1, wherein: In step S2, detecting the timing offset between the input and output signals by using an adaptive sliding window further includes: The sliding window length of the offset detection is dynamically configured according to the audio sampling rate. By calculating the cross-correlation function of the input and output signals, the offset corresponding to the maximum correlation value is found, which is the detected time offset; A prediction model based on historical offset data is established, and an exponential smoothing algorithm is used to predict future offset change trends, creating conditions for active offset compensation.

4. The audio data offset detection and compensation method according to claim 3, wherein: The establishing of a prediction model based on historical offset data further comprises: S21: Establish a first-in-first-out data buffer, continuously collect and store the most recently detected offset sequence as a historical offset data set, perform outlier filtering on the offset data, and normalize it to a standard value; S22: Set the sampling period, build a prediction model based on the historical offset within the sampling period in the data buffer, use the exponential smoothing algorithm to calculate the predicted value, and adaptively configure the smoothing coefficient and prediction step size according to the scenario; S23: Statistically analyze historical prediction errors and divide confidence intervals based on the analysis results, output the results after denormalization, and update parameter configurations based on historical prediction errors to dynamically correct subsequent predictions.

5. The audio data offset detection and compensation method according to claim 1, wherein: In step S3, the dynamic selection compensation strategy includes: According to the offset size, three compensation levels are set in descending order, and the offset threshold range of each compensation level is set. The compensation strategy is formulated according to the compensation level of the detected offset. If the offset is within the first compensation level range, the coarse compensation strategy is adopted to perform the entire sampling point displacement; If the offset is within the range of the secondary compensation level, a fine compensation strategy is adopted, using linear interpolation to achieve sub-sampling point compensation; If the offset is within the range of the third compensation level, a fine compensation strategy is adopted, an interpolation filter based on the sinc function is used, and a Kaiser window function is applied to suppress spectrum leakage.

6. The audio data offset detection and compensation method according to claim 5, wherein: The dynamic selection compensation strategy further includes: S31: After executing each compensation strategy, obtaining the offset detection value after the compensation in real time; S32: re-determining the compensation level range based on the updated offset value, and triggering a corresponding compensation strategy according to the newly determined compensation level; S33: Steps S31 to S32 are iteratively executed in a loop until the absolute value of the offset detection value is lower than a preset minimum compensation threshold.

7. The audio data offset detection and compensation method according to claim 1, wherein: In step S4, the timing relationship model is used to quantify the timing correlation between channels through the mathematical relationship between the input signal, the delay variable and the output function, further comprising: S41: The input signal sequence of the fixed reference channel is used as a time reference, and the signal sequence of another channel is shifted by a specified number of sampling points to align the signals. The specified number is the delay offset. S42: performing a three-stage operation on each translated position, including cross-correlation calculation, channel energy normalization, and normalization processing; S43: Traverse the preset offset range, record the correlation coefficient corresponding to each delay offset, and locate the maximum value of the mutual correlation coefficient and its corresponding offset.

8. The audio data offset detection and compensation method according to claim 7, wherein: In step S4, the coordinated offset compensation includes: S44: Calculating the normalized mutual correlation coefficient between each channel and the reference channel using the timing relationship model; S45: generating a channel weight based on the maximum value of the cross-correlation coefficient and a channel reliability evaluation value, wherein the channel reliability evaluation value is obtained by evaluating the signal stability of the reference channel based on historical data; S46: Collect the independent offset requirements of all channels to be compensated, use a weighted average algorithm to calculate the compensation requirements of all channels, and output a coordinated compensation amount.

9. The audio data offset detection and compensation method according to claim 1, wherein: In step S5, establishing a performance monitoring indicator system includes: The system monitors the signal-to-noise ratio improvement, total harmonic distortion reduction, and channel synchronization accuracy in real time, generates a comprehensive quality index through weighted calculation, and triggers adaptive adjustment of compensation parameters when the comprehensive quality index falls below a set threshold.

10. The audio data offset detection and compensation method according to claim 9, wherein: In step S5, the adaptive adjustment of compensation parameters further includes: If the monitoring indicator system detects that the offset compensation effect is poor, dynamically optimize the offset detection window length, the smoothing coefficient of the exponential smoothing prediction model, and the threshold for switching the hierarchical compensation strategy; Through the performance feedback mechanism, compensation parameters are optimized to adapt to different audio content and working environments.

11. The audio data offset detection and compensation method according to claim 10, wherein: In step S3, the establishing of dynamic cache management further includes: Setting a minimum buffer capacity of the audio buffer based on the maximum expected offset, and setting maximum and minimum buffer capacity thresholds of the audio buffer based on performance and application scenarios; The read / write pointer position is dynamically offset according to the real-time compensation amount.

12. The audio data offset detection and compensation method according to claim 1, wherein: The method further comprises: For different sampling rate configurations, the timestamp generation interval, offset detection window length, and audio buffer capacity parameters are scaled proportionally to maintain the timing accuracy unchanged.

13. An audio data offset detection and compensation system, characterized in that: include: The timestamp generation and synchronization module is used to establish a nanosecond-level precision timestamp synchronization mechanism and assign a unique time identifier to each floating-point audio sampling point; An offset detection module is used to detect the timing offset between the input and output signals through an adaptive sliding window and determine the offset value based on the extreme value positioning of the cross-correlation function; A hierarchical compensation execution module is used to dynamically select a compensation strategy based on the different intervals of the absolute value of the offset, and establish a dynamic cache management mechanism to support real-time offset compensation operations. The compensation strategies include coarse compensation, fine compensation, and precise compensation; A multi-channel coordination module is used to construct a timing relationship model through inter-channel signal correlation analysis in a multi-channel system, and implement coordinated offset compensation based on the correlation analysis results and the compensation strategy; The monitoring and optimization module is used to establish a performance monitoring indicator system to evaluate the offset compensation effect in real time and adaptively adjust the compensation parameters based on the audio content characteristics and system performance feedback.

14. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the audio data offset detection and compensation method according to any one of claims 1 to 12 is implemented.

15. An electronic device, characterized in that: include: one or more processors; A storage device for storing one or more programs, which, when executed by the one or more processors, enables the one or more processors to implement the audio data offset detection and compensation method according to any one of claims 1 to 12.

Images