A dual-channel high-precision pickup method and a pickup device

Abstract

The application provides a kind of double-channel high-precision pickup method and pickup equipment, it is related to pickup processing technical field.The method includes obtaining double-channel sound data, and carrying out matching analysis based on the same source, determine homologous channel data;Distortion calibration is carried out to homologous channel data based on channel asynchrony, and real supplementary processing is carried out to calibration position, form non-distortion homologous channel data;Source energy coordination analysis is carried out to non-distortion homologous channel data, and double-channel pickup data is obtained.The method carries out distortion supplement and energy coordination based on the same sound source to the sound data collected by double channel, so that the homologous sound data obtained is more accurate, and the restoration effect is better.

Description

Technical Field

[0001] The present invention relates to the field of sound pickup processing technology, and in particular to a dual-channel high-precision sound pickup method and a sound pickup device. Background Art

[0002] Dual-channel sound pickup is a way to achieve stereo sound, and compared to single-channel sound pickup, it provides better sound pickup. Currently, there are advanced methods for processing sound data collected on channels, including Fourier transform processing and noise reduction, which greatly improve the collection of data from different sound sources in a single channel. However, due to the inherent limitations of sound data collected on a single channel, it cannot be significantly optimized through subsequent reasonable processing, so its application in single channels is also limited.

[0003] Dual-channel sound pickup uses two receiving channels at an angle to collect sound data separately, which then complements each other for analysis, yielding better sound data than a single-channel approach. Currently, analyzing and processing sound data collected using dual channels is not yet fully effective, and there is still room for improvement in distortion compensation and restoration.

[0004] Therefore, designing a dual-channel high-precision sound pickup method and sound pickup equipment, by performing distortion compensation and energy coordination based on the same sound source on the sound data collected by the dual channels, makes the obtained homologous sound data more accurate and achieves better restoration effect, is an urgent problem to be solved. Summary of the Invention

[0005] The object of the present invention is to provide a dual-channel high-precision sound pickup method, which obtains sound data collected by two channels respectively to match the same sound source, and then compares and analyzes the sound data of the same sound source on different channels to achieve mutual information distortion calibration and supplementation, further improve the information integrity of the dual-channel sound data, and at the same time perform reasonable amplitude energy coordination on the sound data information, so as to not only ensure low distortion of the data in terms of the integrity of the sound data, but also reasonably restore the sound energy information of the sound source, further improve the accuracy of the collected sound data, make the obtained sound data have higher precision, and effectively improve the quality of dual-channel sound pickup.

[0006] The present invention also aims to provide a dual-channel high-precision sound pickup device. The system is configured with dual channels that can respectively collect sound data to achieve comparative analysis based on the same sound source data, thereby reducing the distortion of the sound data and highly restoring the organic whole of the sound information. This effectively ensures the accuracy and precision of the collected sound data and is an important material basis for ensuring the quality of dual-channel sound pickup.

[0007] In a first aspect, the present invention provides a dual-channel high-precision sound pickup method, comprising: obtaining dual-channel sound data, and performing matching analysis based on the same source to determine homologous channel data; performing distortion calibration on the homologous channel data based on channel asynchrony, and performing real supplementary processing on the calibration position to form non-distorted homologous channel data; performing source energy collaborative analysis on the non-distorted homologous channel data to obtain dual-channel sound pickup data.

[0008] In the present invention, the method obtains the sound data collected by the two channels respectively to match the same sound source, and then compares and analyzes the sound data of the same sound source on the corresponding different channels to achieve mutual information distortion calibration and supplementation, further improve the information integrity of the two-channel sound data, and at the same time perform reasonable amplitude energy coordination on the sound data information, so that not only the integrity of the sound data is guaranteed to have low distortion, but also the sound energy information of the sound source can be reasonably restored, further improving the accuracy of the collected sound data, making the acquired sound data have higher precision, and effectively improving the quality of the two-channel sound pickup.

[0009] As a possible implementation method, dual-channel sound data is obtained and matching analysis based on the same source is performed to determine the homologous channel data, including: extracting the time domain change data of different sounds collected on the two channels to form the first channel sound data and the second channel sound data; extracting the first time domain change function of different sounds in the first channel sound data respectively. and a second time domain variation function of different sounds in the second channel sound data , m is the number of different first time domain change functions in the first channel sound data, n is the number of different second time domain change functions in the second channel sound data; and the second time domain variation function Perform matching analysis in the time dimension to determine the first time domain change function and the second time domain change function of the same source, and mark them as the first matching change function of the same source respectively and homologous second matching change function , k is the number of different matching sounds determined.

[0010] In the present invention, the sound data collected from the two channels are processed reasonably to form sound data of different sound sources. However, due to the difference in the sound data collected from the two channels due to the difference in the collection direction of the channels and the distance from the relative sound source, it is impossible to quickly match the sound data collected from the two channels for the same sound source. Instead, a reasonable analysis is required to determine. It should be noted here that, first of all, there are various ways to extract different sound sources from the sound data collected on the channels to obtain the sound data of the corresponding sound sources, such as Fourier transform analysis, amplitude-based feature analysis, etc. Secondly, for the sound data on different channels, the sound data of the same sound source are matched and matched. To ensure the accuracy and rationality of the matching analysis, it is necessary to make the expression of the sound data consistent. Considering the simplicity of data analysis, this application expresses the sound data in the form of a function in the time domain to achieve reasonable processing in the time domain during the matching analysis.

[0011] As a possible implementation method, the first time domain variation function and the second time domain variation function Perform matching analysis in the time dimension to determine the first time domain change function and the second time domain change function of the same source, and mark them as the first matching change function of the same source respectively and homologous second matching change function , including: for any first time domain variation function , if there exists a time displacement ∆t such that Throughout the message and any second time domain variation function Throughout the message If the following conditions are met, the first time domain variation function to be analyzed is determined and the second time domain variation function Collect data for different channels of the same sound source: , , Extraction satisfaction The total duration of the condition, P is the matching difference threshold, Indicates the minimum matching duration ratio. Indicates taking and The smaller value of the first time domain variation function that meets the matching condition Calibrated as the homologous first matching change function , the second time domain variation function that meets the matching condition Calibrated as the homologous second matching change function .

[0012] In the present invention, the matching analysis method for sound data from the same sound source on two channels considers that the difference in the time domain between the two channels' homologous sound data is primarily due to the positional differences between the channels relative to the sound source. Therefore, when performing the matching analysis, the more distant channel will experience a delay in receiving the same information compared to the closer channel. Therefore, a time-shift transformation of the time-domain function is used to determine the matching of homologous sound data. Of course, even after the time-shift transformation, the original acquired sound data will still have some deviation. This is because the acquisition process cannot completely eliminate defects such as distortion and noise. However, as long as the difference between the two is within an allowable range, the matching of the homologous sound data on the two channels can be accurately determined. Here, the threshold for analysis and judgment includes two aspects: first, the difference in amplitude at the matching time position must be within the allowable threshold range; second, the total duration of the deviation cannot exceed a specified percentage. The matching difference threshold and the minimum matching duration percentage can be set based on actual conditions or determined based on big data analysis.

[0013] As a possible implementation method, the distortion calibration of the homologous channel data based on channel asynchrony is performed, and the calibration position is truly supplemented to form non-distorted homologous channel data, including: the homologous first matching change function and homologous second matching change function , extract does not meet the matching analysis The information on the time period forms the homologous first non-adaptive segment function and the homologous second non-adaptive segment function , i means not satisfied The numbers of multiple different continuous time periods; the corresponding homologous first non-adaptive segment function and the homologous second non-adaptive segment function Perform frequency distortion calibration analysis to form distortion period data corresponding to the same sound source; perform true supplementary processing on the distortion period data corresponding to the matching variation function to form non-distorted homologous channel data.

[0014] In the present invention, after determining the sound data of the same sound source on different channels, the two sound data can be used for comparative analysis to determine the distortion caused by the performance of the channel acquisition data, and then reasonably supplement the distorted part to achieve the effect of improving the quality of the sound data. It can be understood that if there are different degrees of distortion in the two matching sound time domain change functions, then the difference between the two sound time domain change functions in the distorted time period is large, exceeding the allowable matching deviation range. Therefore, the distorted part must belong to the period when the amplitude difference exceeds the allowable deviation threshold. Of course, the period when the amplitude difference exceeds the allowable threshold does not correspond one-to-one to the distortion period. After all, data acquisition will also be affected by the environment, so it is necessary to conduct reasonable analysis and judgment to accurately determine the period of data distortion.

[0015] As a possible implementation method, the corresponding homologous first non-adaptive segment function and the homologous second non-adaptive segment function Perform frequency distortion calibration analysis to form distortion period data corresponding to the same sound source, including: the corresponding first non-adaptive segment function of the same source and the homologous second non-adaptive segment function , if the following conditions are met, the corresponding period is determined to be a distorted period: there is a time scaling amount x such that ; The first non-adaptive segment function of the same source corresponding to the time period determined as the distortion period and the homologous second non-adaptive segment function Extract and form distorted period data.

[0016] In the present invention, the determination of the period of data distortion is mainly based on the consideration that distortion will cause frequency changes, and thus mutual correspondence cannot be performed. The frequency correspondence analysis and judgment on the time domain function is mainly determined by performing a scaling analysis of the function in the time domain. Of course, due to the influence of environmental factors, there is a certain deviation in the matching comparison after scaling, but when this deviation is within the allowable threshold range, the corresponding matching period can be accurately determined as the distorted period.

[0017] As a possible implementation method, the distortion period data corresponding to the matching change function is subjected to distorted real supplementary processing to form non-distorted homologous channel data, including: for different distortion periods, determining the homologous first non-adaptive segment function The frequency value of the first preceding homologous source before and after the period and the first-last frequency value of the homology and the homologous first non-adaptive segment function The first average frequency value of the homology ; For different distortion periods, determine the homologous second non-adaptive segment function The second preceding frequency value of the same source before and after the period and the second-last frequency value of the same source and the homologous second non-adaptive segment function The second mean frequency of the homology ; For the corresponding matching change function, according to the homologous first non-adaptive segment function Corresponding homologous first preceding frequency value , homologous first-last frequency value and the homologous first mean frequency value and the homologous second non-adaptive segment function The corresponding homologous second preceding frequency value , the second frequency value of the same source and the second mean frequency of the homology Perform distortion compensation processing to form non-distorted homologous channel data.

[0018] In the present invention, the distorted portion of the sound data is supplemented primarily to account for the frequency changes caused by distortion. Therefore, two identical sound data sets are compared and supplemented to better restore the distorted portion. The key to distortion supplementation is determining which of the two sound data sets is distorted and requires supplementation. Normally, the frequency changes of captured sounds, especially human voices, are regular, with no sudden frequency fluctuations. Therefore, this can be determined by comparing and analyzing the frequency values ​​before and after the distorted segment with the average frequency value of the distorted segment.

[0019] As a possible implementation method, for the corresponding matching change function, according to the homologous first non-adaptive segment function Corresponding homologous first preceding frequency value , homologous first-last frequency value and the homologous first mean frequency value and the homologous second non-adaptive segment function The corresponding homologous second preceding frequency value , the second frequency value of the same source and the second mean frequency of the homology Perform distortion supplementation processing to form non-distorted homologous channel data, including: if the homologous first non-adaptive segment function ,satisfy: , for the second non-adaptive segment function of the same source , does not satisfy: , then in order to ensure the homology of the second non-adaptive segment function In the case where the average amplitude remains unchanged during the distortion period, the homologous first non-adaptive segment function The frequencies on the distortion period are assigned to the homology rather than the adaptation period function ; If the first non-adaptive segment function of the same source , does not satisfy: , for the second non-adaptive segment function of the same source ,satisfy: , then in order to ensure the homology of the first non-adaptive segment function In the case where the average amplitude remains unchanged during the distortion period, the second non-adaptive segment function of the same origin is converted to The frequency on the distortion period is assigned to the homologous first non-adaptive segment function ; If the first non-adaptive segment function of the same source ,satisfy: , for the second non-adaptive segment function of the same source ,satisfy: , then determine the homologous first non-adaptive segment function Frequency offset and the homologous second non-adaptive segment function Frequency offset ,when , then in order to ensure the homology of the second non-adaptive segment function In the case where the average amplitude remains unchanged during the distortion period, the homologous first non-adaptive segment function The frequency over the distortion period is assigned to the homologous second non-adaptive segment function ,when , then in order to ensure the homology of the first non-adaptive segment function In the case where the average amplitude remains unchanged during the distortion period, the second non-adaptive segment function of the same origin is converted to The frequency on the distortion period is assigned the homologous first non-adaptive segment function ,when ,but and The frequency value of the homologous non-adaptive segment function corresponding to the larger value in is assigned and The smaller value corresponds to the homologous non-adaptive segment function and ensures that the average amplitude remains unchanged, where , ; If the first non-adaptive segment function of the same source , does not satisfy: , for the second non-adaptive segment function of the same source , does not satisfy: , then determine the homologous first non-adaptive segment function Frequency offset and the homologous second non-adaptive segment function Frequency offset ,when , then in order to ensure the homology of the second non-adaptive segment function In the case where the average amplitude remains unchanged during the distortion period, the homologous first non-adaptive segment function The frequency over the distortion period is assigned to the homologous second non-adaptive segment function ,when , then in order to ensure the homology of the first non-adaptive segment function In the case where the average amplitude remains unchanged during the distortion period, the second non-adaptive segment function of the same origin is converted to The frequency on the distortion period is assigned the homologous first non-adaptive segment function ,when ,but and The frequency value of the homologous non-adaptive segment function corresponding to the larger value in is assigned and The smaller value of the homologous non-adaptive segment function is obtained and the average amplitude is kept unchanged; after distortion supplementation processing is performed on all distorted time periods of the corresponding matching change function, non-distorted homologous channel data is formed.

[0020] In the present invention, when comparing and analyzing distortion using the frequency values ​​at time points before and after a distortion segment with the average frequency value of the distortion segment, the following three situations may occur. First, if one of the average frequencies of the corresponding distortion periods of two sound data does not meet the sequential change requirement, the frequency of the sound data that does not meet the requirement is adjusted to maintain the same average amplitude during the distortion period, so that the frequency remains consistent with the frequency of the sound data that meets the requirement. It should be noted that the present application primarily considers the case where the frequency value from the preceding frequency to the succeeding frequency changes from small to large. Depending on the actual situation, there may also be cases where the frequency value changes from large to small, as long as the three frequency values ​​meet the sequential change requirement. The third situation is when both sound data meet the sequential change requirement. In this case, the difference between the average frequency values ​​relative to the preceding and succeeding frequency values ​​is used to determine the difference. The sound data with the larger difference undergoes the same frequency change with the same average amplitude as the sound data with the smaller difference. If the differences are equal, the frequency information with the larger average frequency value is assigned to the sound data with the smaller average frequency value based on the average value. The third type is the situation where neither of the two sound data satisfies the sequential change. Similarly, the difference between the previous frequency value and the subsequent frequency value is judged to determine the supplementary object of the distortion. Here, when the difference is equal, the one with the smaller average frequency value is used as the supplementary object because the data with larger frequency is more effective. After all, when the channel receives information, the sound data has been propagated in the environment and is affected by the environment, resulting in possible frequency attenuation, while the one with larger frequency is relatively less affected by the environment.

[0021] As a possible implementation method, source energy collaborative analysis is performed on the non-distorted homologous channel data to obtain dual-channel pickup data, including: obtaining the theoretical unit amplitude attenuation of the dual channels and effective channel spacing ; After the distortion supplementation process, the different corresponding homologous first matching change functions and homologous second matching change function , combined with the theoretical unit amplitude attenuation and effective channel spacing , perform energy collaborative analysis and obtain dual-channel pickup data.

[0022] In this invention, after distortion compensation, the amplitude of the two homologous sound data will change after reception due to the distance between the acquisition channel and the sound source. Therefore, energy coordination is required to avoid environmental influences that may cause inaccurate sound energy information and affect the quality of sound pickup. Energy coordination primarily considers the difference between theoretical energy attenuation and actual attenuation results, and coordinates processing based on this difference.

[0023] As a possible implementation method, the first matching change functions of the same source that are different from each other after the distortion supplementation process are and homologous second matching change function , combined with the theoretical unit amplitude attenuation and effective channel spacing , perform energy synergy analysis and obtain dual-channel pickup data, including: the corresponding homologous first matching change function after distortion supplementation , homologous second matching change function And the effective channel spacing , determine the actual amplitude attenuation change rate ,in: ;According to the actual amplitude attenuation change rate and theoretical unit amplitude attenuation , perform the following energy synergy analysis: If , then the corresponding homologous first matching change function after distortion supplementation is and homologous second matching change function unchanged; if , then determine The period and the corresponding excess amount, and according to the excess amount, respectively, according to the homologous first matching change function Upper amplitude and homologous second matching change function The corresponding amplitude is compensated to make the corresponding period meet the ; After completing the energy synergy analysis, the corresponding homologous first matching change function and homologous second matching change function Identify the sound pickup information as coming from the same sound source.

[0024] In this invention, synergy analysis primarily compares the unit attenuation caused by the energy difference between two sound data points relative to the distance between the two channels with the theoretical unit attenuation to determine if they are synergistic. If the difference is within the permitted threshold, synergy is determined and no further synergy is required. This means that the environmental influence on the amplitude is consistent and will not degrade the sound pickup quality. However, if the difference exceeds the threshold, environmental influences are considered, and appropriate increases or decreases in the relative magnitude of the amplitudes received by the two channels are required to ensure that the difference is within the permitted threshold.

[0025] In a second aspect, the present invention provides a dual-channel high-precision sound pickup device, comprising: a first-channel acquisition unit, configured to acquire sound data to form first-channel sound data; a second-channel acquisition unit, configured to acquire sound data to form second-channel sound data; a distortion collaborative analysis unit, configured to perform distortion calibration and supplementation and perform energy collaborative analysis on the first-channel sound data acquired by the first-channel acquisition unit and the second-channel sound data acquired by the second-channel acquisition unit, to form dual-channel sound pickup data; a result output unit, configured to acquire and output the dual-channel sound pickup data acquired by the distortion collaborative analysis unit; an acquisition control unit, configured to control the acquisition of sound data by the first-channel acquisition unit and the second-channel acquisition unit, and to adjust the acquisition angles of the first-channel acquisition unit and the second-channel acquisition unit; and a ranging unit, configured to perform activity detection and control the operation of the acquisition control unit according to the monitoring results.

[0026] In this invention, the system utilizes dual channels capable of independently collecting sound data, enabling comparative analysis based on the same sound source, thereby minimizing distortion and highly restoring the overall sound information. This effectively ensures the accuracy and precision of the collected sound data, providing a crucial foundation for ensuring the quality of dual-channel sound pickup. Furthermore, the ranging unit controls the collection process by detecting human activity within its measurement range, effectively avoiding unseen acquisitions and conserving resources.

[0027] The dual-channel high-precision sound pickup method and sound pickup device provided by the present invention have the following beneficial effects:

[0028] The method obtains the sound data collected by the two channels respectively to match the same sound source, and then compares and analyzes the sound data of the same sound source on the corresponding different channels to achieve mutual information distortion calibration and supplementation, further improving the information integrity of the two-channel sound data, and at the same time performing reasonable amplitude energy coordination on the sound data information, which not only ensures low data distortion in terms of the integrity of the sound data, but also can reasonably restore the sound energy information of the sound source, further improving the accuracy of the collected sound data, making the obtained sound data have higher precision, and effectively improving the quality of the two-channel sound pickup.

[0029] By configuring dual channels capable of independently collecting sound data, the device enables comparative analysis based on data from the same sound source, minimizing distortion and effectively restoring the overall sound information. This effectively ensures the accuracy and precision of the collected sound data, serving as a crucial foundation for ensuring the quality of dual-channel sound pickup. Furthermore, the ranging unit monitors the presence of human activity within the measurement range to control the collection process, effectively avoiding empty sampling and conserving resources. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the following briefly introduces the drawings required for use in the embodiments of the present invention. It should be understood that the following drawings only illustrate certain embodiments of the present invention and therefore should not be regarded as limiting the scope. For ordinary technicians in this field, other relevant drawings can be obtained based on these drawings without paying any creative work.

[0031] Figure 1 A diagram showing the steps of a dual-channel high-precision sound pickup method provided by an embodiment of the present invention;

[0032] Figure 2 A schematic structural diagram of a dual-channel high-precision sound pickup system provided by an embodiment of the present invention;

[0033] Figure 3 This is a diagram of the distortion supplement steps of the dual-channel high-precision sound pickup method provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0034] The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention.

[0035] Dual-channel sound pickup is a way to achieve stereo sound, and compared to single-channel sound pickup, it provides better sound pickup. Currently, there are advanced methods for processing sound data collected on channels, including Fourier transform processing and noise reduction, which greatly improve the collection of data from different sound sources in a single channel. However, due to the inherent limitations of sound data collected on a single channel, it cannot be significantly optimized through subsequent reasonable processing, so its application in single channels is also limited.

[0036] Dual-channel sound pickup uses two receiving channels at an angle to collect sound data separately, which then complements each other for analysis, yielding better sound data than a single-channel approach. Currently, analyzing and processing sound data collected using dual channels is not yet fully effective, and there is still room for improvement in distortion compensation and restoration.

[0037] refer to Figures 1 to 3The embodiment of the present invention provides a dual-channel high-precision sound pickup method. The method obtains sound data collected by two channels respectively to match the same sound source, and then compares and analyzes the sound data of the same sound source on different channels to achieve mutual information distortion calibration and supplementation, further improving the information integrity of the dual-channel sound data. At the same time, reasonable amplitude energy coordination is performed on the sound data information. This not only ensures low data distortion in terms of sound data integrity, but also can reasonably restore the sound energy information of the sound source, further improving the accuracy of the collected sound data, making the obtained sound data have higher precision, and effectively improving the quality of dual-channel sound pickup.

[0038] The dual-channel high-precision sound pickup method specifically includes the following steps:

[0039] S1: Obtain dual-channel sound data and perform matching analysis based on the same source to determine the homologous channel data.

[0040] Acquire dual-channel sound data and perform matching analysis based on the same source to determine the homologous channel data, including: extracting the time domain change data of different sounds collected on the two channels to form the first channel sound data and the second channel sound data; extracting the first time domain change function of different sounds in the first channel sound data respectively and a second time domain variation function of different sounds in the second channel sound data , m is the number of different first time domain change functions in the first channel sound data, n is the number of different second time domain change functions in the second channel sound data; and the second time domain variation function Perform matching analysis in the time dimension to determine the first time domain change function and the second time domain change function of the same source, and mark them as the first matching change function of the same source respectively and homologous second matching change function , k is the number of different matching sounds determined.

[0041] The sound data collected from the two channels are processed reasonably to form sound data from different sound sources. However, due to the difference in the sound data collected from the two channels due to the difference in the channel collection direction and the distance from the relative sound source, it is impossible to quickly match the sound data collected from the same sound source on the two channels. Instead, a reasonable analysis is needed to determine it. It should be noted here that, first of all, there are various ways to extract different sound sources from the sound data collected on the channels to obtain the sound data of the corresponding sound sources, such as Fourier change analysis, amplitude-based feature analysis, etc. Secondly, for the sound data on different channels, the sound data of the same sound source are matched and matched. To ensure the accuracy and rationality of the matching analysis, it is necessary to make the expression of the sound data consistent. Considering the simplicity of data analysis, this application expresses the sound data in the form of a function in the time domain to achieve reasonable processing in the time domain during the matching analysis.

[0042] For the first time domain variation function and the second time domain variation function Perform matching analysis in the time dimension to determine the first time domain change function and the second time domain change function of the same source, and mark them as the first matching change function of the same source respectively and homologous second matching change function , including: for any first time domain variation function , if there exists a time displacement ∆t such that Throughout the message and any second time domain variation function Throughout the message If the following conditions are met, the first time domain variation function to be analyzed is determined and the second time domain variation function Collect data for different channels of the same sound source: , , Extraction satisfaction The total duration of the condition, P is the matching difference threshold, Indicates the minimum matching duration ratio. Indicates taking and The smaller value of the first time domain variation function that meets the matching condition Calibrated as the homologous first matching change function , the second time domain variation function that meets the matching condition Calibrated as the homologous second matching change function .

[0043] The matching analysis method for sound data from two channels originating from the same source considers that the difference in the time domain between the two channels' homologous sound data is primarily due to the positional differences between the channels relative to the sound source. Therefore, when performing the matching analysis, the more distant channel will experience a delay in receiving the same information compared to the closer channel. Therefore, a time-shift transformation of the time-domain function can be used to determine the matching of homologous sound data. Of course, even after the time-shift transformation, the original acquired sound data will still exhibit some deviation. This is because the acquisition process cannot completely eliminate defects such as distortion and noise. However, as long as the difference between the two is within an acceptable range, the matching of the homologous sound data from the two channels can be accurately determined. The threshold for the analysis and judgment includes two aspects: first, the amplitude difference at the matching time position must be within the allowed threshold range; second, the total duration of the deviation must not exceed a certain percentage. The matching difference threshold and the minimum matching duration percentage can be set based on actual conditions or determined based on big data analysis.

[0044] S2: Perform distortion calibration on the homologous channel data based on channel asynchrony, and perform real supplementary processing on the calibration position to form non-distorted homologous channel data.

[0045] The distortion calibration of the homologous channel data is performed based on the channel asynchrony, and the calibration position is supplemented to form the non-distorted homologous channel data, including: the homologous first matching change function and homologous second matching change function , extract does not meet the matching analysis The information on the time period forms the homologous first non-adaptive segment function and the homologous second non-adaptive segment function , i means not satisfied The numbers of multiple different continuous time periods; the corresponding homologous first non-adaptive segment function and the homologous second non-adaptive segment function Perform frequency distortion calibration analysis to form distortion period data corresponding to the same sound source; perform true supplementary processing on the distortion period data corresponding to the matching variation function to form non-distorted homologous channel data.

[0046] After determining the sound data of the same sound source on different channels, the two sound data can be used for comparative analysis to determine the distortion caused by the performance of the channel data acquisition, and then make reasonable supplements to the distorted part to achieve the effect of improving the quality of the sound data. It is understandable that if there are different degrees of distortion in the two matching sound time domain change functions, then the difference between the two sound time domain change functions in the distorted time period is large, exceeding the allowable matching deviation range. Therefore, the distorted part must belong to the period when the amplitude difference exceeds the allowable deviation threshold. Of course, the period when the amplitude difference exceeds the allowable threshold does not correspond one-to-one to the distortion period. After all, data acquisition will also be affected by the environment, so reasonable analysis and judgment are needed to accurately determine the period of data distortion.

[0047] For the corresponding homologous first non-adaptive segment function and the homologous second non-adaptive segment function Perform frequency distortion calibration analysis to form distortion period data corresponding to the same sound source, including: the corresponding first non-adaptive segment function of the same source and the homologous second non-adaptive segment function , if the following conditions are met, the corresponding period is determined to be a distorted period: there is a time scaling amount x such that ; The first non-adaptive segment function of the same source corresponding to the time period determined as the distortion period and the homologous second non-adaptive segment function Extract and form distorted period data.

[0048] The determination of the period of data distortion is mainly based on the consideration that distortion will cause frequency changes, which will make it impossible to correspond to each other. The frequency correspondence analysis and judgment on the time domain function is mainly determined by performing a scaling analysis of the function in the time domain. Of course, due to the influence of environmental factors, there is a certain deviation in the matching comparison after scaling, but when this deviation is within the allowable threshold range, the corresponding matching period can be accurately determined as the distorted period.

[0049] The distortion period data corresponding to the matching change function is subjected to the real supplementary processing of the distortion to form the non-distorted homologous channel data, including: determining the homologous first non-adaptive segment function for different distortion periods The frequency value of the first preceding homologous source before and after the period and the first-last frequency value of the homology and the homologous first non-adaptive segment function The first average frequency value of the homology ; For different distortion periods, determine the homologous second non-adaptive segment function The second preceding frequency value of the same source before and after the period and the second-last frequency value of the same source and the homologous second non-adaptive segment function The second mean frequency of the homology ; For the corresponding matching change function, according to the homologous first non-adaptive segment function Corresponding homologous first preceding frequency value , homologous first-last frequency value and the homologous first mean frequency value and the homologous second non-adaptive segment function The corresponding homologous second preceding frequency value , the second frequency value of the same source and the second mean frequency of the homology Perform distortion compensation processing to form non-distorted homologous channel data.

[0050] Compensating for distorted sound data primarily considers the frequency shifts caused by distortion. Therefore, two identical sound data sets are compared and supplemented to better restore the distorted portion. The key to distortion compensation is determining which of the two sound data sets is distorted and needs to be supplemented. Normally, the frequency shifts of captured sounds, especially human voices, are regular, with no sudden frequency fluctuations. Therefore, this can be determined by comparing the frequency values ​​before and after the distorted segment with the average frequency value of the distorted segment.

[0051] For the corresponding matching change function, according to the homologous first non-adaptive segment function Corresponding homologous first preceding frequency value , homologous first-last frequency value and the homologous first mean frequency value and the homologous second non-adaptive segment function The corresponding homologous second preceding frequency value , the second frequency value of the same source and the second mean frequency of the homology Perform distortion supplementation processing to form non-distorted homologous channel data, including: if the homologous first non-adaptive segment function ,satisfy: , for the second non-adaptive segment function of the same source , does not satisfy: , then in order to ensure the homology of the second non-adaptive segment function In the case where the average amplitude remains unchanged during the distortion period, the homologous first non-adaptive segment function The frequencies on the distortion period are assigned to the homology rather than the adaptation period function ; If the first non-adaptive segment function of the same source , does not satisfy: , for the second non-adaptive segment function of the same source ,satisfy: , then in order to ensure the homology of the first non-adaptive segment function In the case where the average amplitude remains unchanged during the distortion period, the second non-adaptive segment function of the same origin is converted to The frequency on the distortion period is assigned the homologous first non-adaptive segment function ; If the first non-adaptive segment function of the same source ,satisfy: , for the second non-adaptive segment function of the same source ,satisfy: , then determine the homologous first non-adaptive segment function Frequency offset and the homologous second non-adaptive segment function Frequency offset ,when , then in order to ensure the homology of the second non-adaptive segment function In the case where the average amplitude remains unchanged during the distortion period, the homologous first non-adaptive segment function The frequency over the distortion period is assigned to the homologous second non-adaptive segment function ,when , then in order to ensure the homology of the first non-adaptive segment function In the case where the average amplitude remains unchanged during the distortion period, the second non-adaptive segment function of the same origin is converted to The frequency on the distortion period is assigned the homologous first non-adaptive segment function ,when ,but and The frequency value of the homologous non-adaptive segment function corresponding to the larger value in is assigned and The smaller value corresponds to the homologous non-adaptive segment function and ensures that the average amplitude remains unchanged, where , ; If the first non-adaptive segment function of the same source , does not satisfy: , for the second non-adaptive segment function of the same source , does not satisfy: , then determine the homologous first non-adaptive segment function Frequency offset and the homologous second non-adaptive segment function Frequency offset ,when , then in order to ensure the homology of the second non-adaptive segment function In the case where the average amplitude remains unchanged during the distortion period, the homologous first non-adaptive segment function The frequency over the distortion period is assigned to the homologous second non-adaptive segment function ,when , then in order to ensure the homology of the first non-adaptive segment function In the case where the average amplitude remains unchanged during the distortion period, the second non-adaptive segment function of the same origin is converted to The frequency on the distortion period is assigned the homologous first non-adaptive segment function ,when ,but and The frequency value of the homologous non-adaptive segment function corresponding to the larger value in is assigned and The smaller value of the homologous non-adaptive segment function is obtained and the average amplitude is kept unchanged; after distortion supplementation processing is performed on all distorted time periods of the corresponding matching change function, non-distorted homologous channel data is formed.

[0052] When comparing and analyzing distortion using the frequency values ​​at time points before and after the distortion segment and the average frequency value of the distortion segment, the following three situations may occur. One is when one of the average frequencies of the corresponding distortion periods of the two sound data does not meet the sequential change requirement. In this case, the frequency of the sound data that does not meet the requirement is adjusted to maintain the same average amplitude during the distortion period, so that the frequency remains consistent with the frequency of the sound data that meets the requirement. It should be noted that the present application mainly determines the case where the frequency value from the preceding frequency to the succeeding frequency changes from small to large. Depending on the actual situation, there may also be a case where the frequency value changes from large to small, as long as the three frequency values ​​meet the sequential change requirement. The third situation is when both sound data meet the sequential change requirement. In this case, the difference between the average frequency value and the preceding and succeeding frequency values ​​is used to determine the difference. The sound data with the larger difference is subjected to the same frequency change with the same average amplitude as the sound data with the smaller difference. If the differences are equal, the frequency information with the larger average frequency value is assigned to the sound data with the smaller average frequency value based on the size of the average value. The third type is the situation where neither of the two sound data satisfies the sequential change. Similarly, the difference between the previous frequency value and the subsequent frequency value is judged to determine the supplementary object of the distortion. Here, when the difference is equal, the one with the smaller average frequency value is used as the supplementary object because the data with larger frequency is more effective. After all, when the channel receives information, the sound data has been propagated in the environment and is affected by the environment, resulting in possible frequency attenuation, while the one with larger frequency is relatively less affected by the environment.

[0053] S3: Perform source energy collaborative analysis on the non-distorted homologous channel data to obtain dual-channel pickup data.

[0054] Perform source energy collaborative analysis on non-distorted homologous channel data to obtain dual-channel pickup data, including: obtaining the theoretical unit amplitude attenuation of the dual channels and effective channel spacing ; After the distortion supplementation process, the different corresponding homologous first matching change functions and homologous second matching change function , combined with the theoretical unit amplitude attenuation and effective channel spacing , perform energy collaborative analysis and obtain dual-channel pickup data.

[0055] After distortion compensation, the amplitude of the two homologous sound data will change after reception due to the distance between the acquisition channel and the sound source. Therefore, energy coordination is necessary to prevent environmental influences from causing inaccurate sound energy information and affecting the quality of sound pickup. Energy coordination primarily considers the difference between theoretical energy attenuation and actual attenuation, and coordinates processing accordingly.

[0056] The first matching change function of the same source that is different from each other after distortion supplementation processing and homologous second matching change function , combined with the theoretical unit amplitude attenuation and effective channel spacing , perform energy synergy analysis and obtain dual-channel pickup data, including: the corresponding homologous first matching change function after distortion supplementation , homologous second matching change function And the effective channel spacing , determine the actual amplitude attenuation change rate ,in: ;According to the actual amplitude attenuation change rate and theoretical unit amplitude attenuation , perform the following energy synergy analysis: If , then the corresponding homologous first matching change function after distortion supplementation is and homologous second matching change function unchanged; if , then determine The period and the corresponding excess amount, and according to the excess amount, respectively, according to the homologous first matching change function Upper amplitude and homologous second matching change function The corresponding amplitude is compensated to make the corresponding period meet the ; After completing the energy synergy analysis, the corresponding homologous first matching change function and homologous second matching change function Identify the sound pickup information as coming from the same sound source.

[0057] Synergy analysis primarily compares the unit attenuation caused by the energy difference between the two sound data points relative to the distance between the two channels with the theoretical unit attenuation. If the difference is within the permitted threshold, synergy is confirmed and no further coordination is required. This means that the environmental influence on the amplitude is consistent and will not degrade the sound pickup quality. However, if the difference exceeds the threshold, environmental influences are considered, and appropriate adjustments need to be made based on the relative magnitude of the amplitudes received by the two channels to ensure that the difference is within the permitted threshold.

[0058] The present invention also provides a dual-channel high-precision sound pickup device, comprising: a first-channel acquisition unit for collecting sound data to form first-channel sound data; a second-channel acquisition unit for collecting sound data to form second-channel sound data; a distortion collaborative analysis unit for performing distortion calibration and supplementation on the first-channel sound data acquired by the first-channel acquisition unit and the second-channel sound data acquired by the second-channel acquisition unit, and performing energy collaborative analysis to form dual-channel sound pickup data; a result output unit for acquiring and outputting the dual-channel sound pickup data acquired by the distortion collaborative analysis unit; an acquisition control unit for controlling the acquisition of sound data by the first-channel acquisition unit and the second-channel acquisition unit, and adjusting the acquisition angles of the first-channel acquisition unit and the second-channel acquisition unit; and a ranging unit for detecting human activity and controlling the operation of the acquisition control unit based on the monitoring results. The ranging unit may be a laser rangefinder that can adjust the ranging range and determine whether human activity exists within the ranging range. When human presence is confirmed, the unit sends a signal to the acquisition control unit, which then controls the first-channel acquisition unit and the second-channel acquisition unit to acquire sound data.

[0059] Ranging units come in various forms. This application uses a laser radar. The laser of a laser radar can sense human activity within a certain distance range. Radar detection has a wide range angle. This application provides a detection angle of 120 degrees, and the detection of human bodies is intermittent and continuous, typically set to one detection every three seconds. This frequency can be adjusted based on actual needs. When a person enters the laser radar's detection range, that is, within the set distance range of 120 degrees, the laser radar triggers a human detection signal, which then controls the acquisition and control unit to operate based on the detection results.

[0060] Considering that the sound data to be acquired by the acquisition control unit is human voice, in order to ensure that the human voice information can be acquired in a timely and effective manner, and to avoid continuing to collect invalid sound data when the laser radar determines that there is no person in the detection range, the laser radar controls the acquisition control unit to collect sound data according to the detection results when performing human body detection in the detection range. That is, the acquisition control unit will be controlled to collect human voice data only when there is someone in the detection range, but when no one is detected in the range, the acquisition control unit is controlled to stop collecting sound data, so that data collection control is achieved that records when people come and stops when people leave. On the one hand, this can ensure the effectiveness of sound data acquisition and improve the purity of the collected data, so that the collected sound data can be fully and effectively processed and applied, and there is no need to judge whether there is valid human voice data. On the other hand, it can also save resources consumed by sound data acquisition to a certain extent and ensure higher utilization of resources.

[0061] By configuring dual channels capable of independently collecting sound data, the device enables comparative analysis based on data from the same sound source, minimizing distortion and effectively restoring the overall sound information. This effectively ensures the accuracy and precision of the collected sound data, serving as a crucial foundation for ensuring the quality of dual-channel sound pickup. Furthermore, the ranging unit monitors the presence of human activity within the measurement range to control the collection process, effectively avoiding empty sampling and conserving resources.

[0062] The system provided in this application is specifically an intelligent desktop directional sound pickup device that deeply integrates cutting-edge sound pickup, sensing, and data transmission technologies. It has an integrated dual-directional 8-microphone array, which cooperates with the acoustic noise reduction algorithm to filter out environmental noise and ensure pure sound. The device adopts a laser and radar collaborative sensing trigger mechanism, which can keenly and accurately capture the dynamics of the sound source. Equipped with dual-channel role separation, it can accurately distinguish different sound-making subjects, and lock the gain processing for the target voice to enhance the key sound signal. In terms of data transmission, it supports network port, WiFi, and 4G multi-mode transmission to meet the needs of diverse scenarios. The device is based on intelligent algorithms and sensor triggering technology in user scenarios. Complete the one-to-one correspondence between the current work order and the target voice and the recording segment. Realize high-definition sound pickup-role separation-audio data in real time, continuously and completely uploaded to the cloud background, providing a solid foundation for applications such as data storage, analysis and feeding models.

[0063] In summary, the dual-channel high-precision sound pickup method and sound pickup device provided by the embodiments of the present invention have the following beneficial effects:

[0064] The method obtains the sound data collected by the two channels respectively to match the same sound source, and then compares and analyzes the sound data of the same sound source on the corresponding different channels to achieve mutual information distortion calibration and supplementation, further improving the information integrity of the two-channel sound data, and at the same time performing reasonable amplitude energy coordination on the sound data information, which not only ensures low data distortion in terms of the integrity of the sound data, but also can reasonably restore the sound energy information of the sound source, further improving the accuracy of the collected sound data, making the obtained sound data have higher precision, and effectively improving the quality of the two-channel sound pickup.

[0065] By configuring dual channels capable of independently collecting sound data, the device enables comparative analysis based on data from the same sound source, minimizing distortion and effectively restoring the overall sound information. This effectively ensures the accuracy and precision of the collected sound data, serving as a crucial foundation for ensuring the quality of dual-channel sound pickup. Furthermore, the ranging unit monitors the presence of human activity within the measurement range to control the collection process, effectively avoiding empty sampling and conserving resources.

[0066] In the embodiment of the present application, "indication" may include direct indication and indirect indication, and may also include explicit indication and implicit indication. The information indicated by a certain information is called information to be indicated. In the specific implementation process, there are many ways to indicate the information to be indicated, such as but not limited to, the information to be indicated can be directly indicated, such as the information to be indicated itself or the index of the information to be indicated. The information to be indicated can also be indirectly indicated by indicating other information, wherein there is an association relationship between the other information and the information to be indicated. It is also possible to indicate only a part of the information to be indicated, while the other parts of the information to be indicated are known or agreed in advance. For example, the indication of specific information can also be achieved by means of the arrangement order of each piece of information agreed in advance (such as specified in the protocol), thereby reducing the indication overhead to a certain extent. At the same time, the common parts of each piece of information can also be identified and indicated uniformly to reduce the indication overhead caused by indicating the same information separately.

[0067] In addition, the specific indication method can also be various existing indication methods, such as but not limited to the above-mentioned indication methods and various combinations thereof. The specific details of the various indication methods can be referred to the prior art and will not be repeated herein. As can be seen from the above, for example, when it is necessary to indicate multiple information of the same type, there may be a situation where the indication methods for different information are different. In the specific implementation process, the required indication method can be selected according to specific needs. The embodiment of the present application does not limit the selected indication method. In this way, the indication method involved in the embodiment of the present application should be understood to cover various methods that can enable the party to be indicated to obtain the information to be indicated.

[0068] It should be understood that the information to be indicated can be sent as a whole or divided into multiple sub-information and sent separately, and the sending period and / or sending time of these sub-information can be the same or different. The specific sending method is not limited in the embodiments of this application. The sending period and / or sending time of these sub-information can be predefined, for example, predefined according to a protocol, or can be configured by the transmitting device by sending configuration information to the receiving device.

[0069] "Pre-definition" or "pre-configuration" can be implemented by pre-saving corresponding codes, tables or other methods that can be used to indicate relevant information in the device, and the embodiments of the present application do not limit the specific implementation method. Among them, "saving" can mean saving in one or more memories. The one or more memories can be set separately or integrated in an encoder or decoder, a processor, or a communication device. The one or more memories can also be partially set separately and partially integrated in a decoder, a processor, or a communication device. The type of memory can be any form of storage medium, and the embodiments of the present application do not limit this.

[0070] The "protocol" involved in the embodiments of the present application may refer to a protocol family in the communication field, a standard protocol with a similar protocol family frame structure, or a related protocol used in future communication systems. The embodiments of the present application do not make specific limitations on this.

[0071] In the embodiments of the present application, descriptions such as "when...", "in the case of...", "if" and "if" all mean that the device will perform corresponding processing under certain objective circumstances. It does not limit the time, nor does it require the device to perform judgment actions when implemented, nor does it mean that there are other limitations.

[0072] In the description of the embodiments of this application, unless otherwise specified, " / " indicates that the associated objects are in an "or" relationship. For example, A / B can mean A or B. "And / or" in the embodiments of this application is merely a description of the associated relationship between the associated objects, indicating that three relationships can exist. For example, "A and / or B" can mean: A alone, A and B together, or B alone. A and B can be singular or plural. Furthermore, in the description of the embodiments of this application, unless otherwise specified, "multiple" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, "at least one of a, b, or c" can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or plural. Furthermore, to facilitate the clear description of the technical solutions of the embodiments of this application, the terms "first" and "second" are used in the embodiments of this application to distinguish between identical or similar items with substantially the same function or effect. Those skilled in the art will understand that words such as "first" and "second" do not limit the quantity and execution order, and words such as "first" and "second" do not necessarily limit differences. At the same time, in the embodiments of the present application, words such as "exemplary" or "for example" are used to indicate examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "for example" in the embodiments of the present application should not be interpreted as being more preferred or more advantageous than other embodiments or design. Specifically, the use of words such as "exemplary" or "for example" is intended to present related concepts in a concrete way for easy understanding.

[0073] It should be understood that the processor in the embodiments of the present application may be a central processing unit (CPU), but may also be other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or any conventional processor, etc.

[0074] It should also be understood that the memory in the embodiments of the present application may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories. Among them, the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory. The volatile memory may be a random access memory (RAM), which is used as an external cache. By way of example and not limitation, many forms of random access memory (RAM) are available, such as static RAM (SRAM), dynamic random access memory (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link DRAM (SLDRAM), and direct rambus RAM (DR RAM).

[0075] The above embodiments can be implemented in whole or in part via software, hardware (e.g., circuits), firmware, or any other combination thereof. When implemented using software, the above embodiments can be implemented in whole or in part in the form of a computer program product. The computer program product comprises one or more computer instructions or computer programs. When loaded or executed on a computer, the processes or functions described in the embodiments of this application are fully or partially generated. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired means (e.g., infrared, wireless, microwave, etc.). The computer-readable storage medium can be any available medium accessible by a computer or a data storage device such as a server or data center that contains a collection of one or more available media. The available medium can be magnetic media (e.g., floppy disks, hard disks, magnetic tapes), optical media (e.g., DVDs), or semiconductor media. The semiconductor media can be a solid-state drive.

[0076] It should be understood that the term "and / or" as used herein simply describes a relationship between associated objects, indicating that three possible relationships exist. For example, "A and / or B" can represent: A alone, A and B together, or B alone. A and B can be singular or plural. Furthermore, the character " / " as used herein generally indicates an "or" relationship between the associated objects, but it may also indicate an "and / or" relationship. For specific understanding, please refer to the context.

[0077] In this application, "at least one" means one or more, and "plurality" means two or more. "At least one of the following" or similar expressions refers to any combination of these items, including any combination of single or plural items. For example, "at least one of a, b, or c" can mean: a, b, c, ab, ac, bc, or abc, where a, b, and c can be single or plural.

[0078] It should be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application.

[0079] Those skilled in the art can clearly understand that the units and algorithm steps of each example described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0080] Those skilled in the art can clearly understand that, for the convenience and brevity of the description, the specific working processes of the above-described system, device and unit can refer to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

[0081] In several embodiments provided in the present application, it should be understood that the disclosed system, device and method can be implemented in other ways. For example, the above-described device embodiments are only schematic, for example, the division of the units is only a logical function division, and actual implementation can have another division manner, for example, a plurality of units or components can be combined or integrated into another system, or some features can be ignored or not executed. In addition, the coupling or direct coupling or communication connection between the units shown or discussed can be indirect coupling or communication connection through some interface, device or unit, and can be electrical, mechanical or other forms.

[0082] The units described as separate components can or can not be physically separated, and the components shown as units can or can not be physical units, that is, they can be located in one place, or can be distributed on a plurality of network units. Part or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.

[0083] In addition, each functional unit in each embodiment of the present application can be integrated into a processing unit, or each unit can exist physically independently, or two or more units can be integrated into one unit.

[0084] If the functions are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application, or the part that contributes to the prior art, or the part of the technical solution, can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes several instructions for enabling a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes various media that can store program code, such as a USB flash drive, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.

[0085] The above description is merely a specific embodiment of the present application, but the scope of protection of the present application is not limited thereto. Any changes or substitutions that can be easily conceived by a person skilled in the art within the technical scope disclosed in this application should be included in the scope of protection of this application. Therefore, the scope of protection of this application should be based on the scope of protection of the claims.

Claims

1. A dual-channel high-precision sound pickup method, characterized in that: include: Obtain dual-channel sound data and perform matching analysis based on the same source to determine the homologous channel data; Performing distortion calibration on the homologous channel data based on channel asynchrony, and performing true supplementary processing on the calibration position to form non-distorted homologous channel data; Performing source energy collaborative analysis on the non-distorted homologous channel data to obtain dual-channel sound pickup data; The process of obtaining dual-channel sound data and performing matching analysis based on the same source to determine homologous channel data includes: Extracting time domain variation data of different sounds collected on the two channels respectively to form first channel sound data and second channel sound data; Extract the first time domain variation functions of different sounds in the first channel sound data respectively and a second time domain variation function of different sounds in the second channel sound data , m is the number of different first time-domain variation functions in the first channel sound data, and n is the number of different second time-domain variation functions in the second channel sound data; The first time domain variation function and the second time domain variation function Perform matching analysis in the time dimension to determine the first time domain change function and the second time domain change function of the same source, and mark them as the first matching change function of the same source and homologous second matching change function , k is the number of different matching sounds: For any of the first time domain variation functions , if there is a time displacement , making Throughout the message On the second time domain variation function with any one Throughout the message If the following conditions are met, the first time domain variation function to be analyzed is determined and the second time domain variation function Collect data for different channels of the same sound source: ， ， Extraction satisfaction The total duration of the condition, P is the matching difference threshold, Indicates the minimum matching duration ratio. Indicates taking and The smaller value of ; The first time domain variation function that meets the matching condition Calibrated as the homologous first matching change function , the second time domain variation function that meets the matching condition Calibrated as the homologous second matching change function ; The homologous channel data is calibrated for distortion based on channel asynchrony, and the calibrated position is subjected to true supplementary processing to form undistorted homologous channel data, including: The first matching change function of the homology and the homologous second matching change function , extract does not meet the matching analysis The information on the time period forms the homologous first non-adaptive segment function and the homologous second non-adaptive segment function , i means not satisfied The numbers of multiple different consecutive time periods; For the corresponding homologous first non-adaptive segment function and the homologous second non-adaptive segment function Conduct frequency distortion calibration analysis to generate distortion period data corresponding to the same sound source; The distorted time period data corresponding to the matching variation function is subjected to true supplementary processing to form non-distorted homologous channel data.

2. The dual-channel high-precision sound pickup method according to claim 1, characterized in that: The corresponding homologous first non-adaptive segment function and the homologous second non-adaptive segment function Perform frequency distortion calibration analysis to generate distortion period data corresponding to the same sound source, including: For the corresponding homologous first non-adaptive segment function and the homologous second non-adaptive segment function If the following conditions are met, the corresponding period is determined to be a distortion period: There exists a time scaling amount x such that ; The homologous first non-adaptive segment function corresponding to the time period of the distortion period is determined and the homologous second non-adaptive segment function Extraction forms the distortion period data.

3. The dual-channel high-precision sound pickup method according to claim 2, characterized in that: The step of performing true supplementary processing on the distorted time period data corresponding to the matching variation function to form non-distorted homologous channel data includes: For different distortion periods, the homologous first non-adaptive segment function is determined. The frequency value of the first preceding homologous source before and after the period and the first-last frequency value of the homology And the homologous first non-adaptive segment function The first average frequency value of the homology ; For different distortion periods, the homologous second non-adaptive segment function is determined The second preceding frequency value of the same source before and after the period and the second-last frequency value of the same source And the homologous second non-adaptive segment function The second mean frequency of the homology ; For the corresponding matching change function, according to the homologous first non-adaptive segment function The corresponding first preceding frequency value of the homology , the first subsequent frequency value of the homology and the homologous first average frequency value and the homologous second non-adaptive segment function The corresponding homologous second previous frequency value , the second frequency value of the same source and the homologous second average frequency value Distortion compensation processing is performed to form the non-distorted homologous channel data.

4. The dual-channel high-precision sound pickup method according to claim 3, characterized in that: The corresponding matching change function is based on the homologous first non-adaptive segment function The corresponding first preceding frequency value of the homology , the first subsequent frequency value of the homology and the homologous first average frequency value and the homologous second non-adaptive segment function The corresponding homologous second previous frequency value , the second frequency value of the same source and the homologous second average frequency value Performing distortion supplementation processing to form the non-distorted homologous channel data includes: If the homologous first non-adaptive segment function ,satisfy: , for the homologous second non-adaptive segment function , does not satisfy: , then in order to ensure that the homologous second non-adaptive segment function In the case where the average amplitude remains unchanged over the distortion period, the homologous first non-adaptive segment function The frequency over the distortion period is assigned to the homologous second non-adaptive segment function ; If the homologous first non-adaptive segment function , does not satisfy: , for the homologous second non-adaptive segment function ,satisfy: , then in order to ensure that the homologous first non-adaptive segment function In the case where the average amplitude remains unchanged over the distortion period, the homologous second non-adaptive segment function The frequency over the distortion period is assigned to the homologous first non-adaptive segment function ; If the homologous first non-adaptive segment function ,satisfy: , for the homologous second non-adaptive segment function ,satisfy: , then determine the homologous first non-adaptive segment function Frequency offset and the homologous second non-adaptive segment function Frequency offset ,when , then in order to ensure that the homologous second non-adaptive segment function In the case where the average amplitude remains unchanged over the distortion period, the homologous first non-adaptive segment function The frequency over the distortion period is assigned to the homologous second non-adaptive segment function ,when , then in order to ensure that the homologous first non-adaptive segment function In the case where the average amplitude remains unchanged over the distortion period, the homologous second non-adaptive segment function The frequency over the distortion period is assigned to the homologous first non-adaptive segment function ,when ,but and The frequency value of the homologous non-adaptive segment function corresponding to the larger value in is assigned and The smaller value corresponds to the homologous non-adaptive segment function and ensures that the average amplitude remains unchanged, where , ; If the homologous first non-adaptive segment function , does not satisfy: , for the homologous second non-adaptive segment function , does not satisfy: , then determine the homologous first non-adaptive segment function Frequency offset and the homologous second non-adaptive segment function Frequency offset ,when , then in order to ensure that the homologous second non-adaptive segment function In the case where the average amplitude remains unchanged over the distortion period, the homologous first non-adaptive segment function The frequency over the distortion period is assigned to the homologous second non-adaptive segment function ,when , then in order to ensure that the homologous first non-adaptive segment function In the case where the average amplitude remains unchanged over the distortion period, the homologous second non-adaptive segment function The frequency over the distortion period is assigned to the homologous first non-adaptive segment function ,when ,but and The frequency value of the homologous non-adaptive segment function corresponding to the larger value in is assigned and The smaller value corresponds to the homologous non-adaptive segment function and ensures that the average amplitude remains unchanged; After distortion supplementation processing is performed on all distorted time periods of the corresponding matching variation function, non-distorted homologous channel data is formed.

5. The dual-channel high-precision sound pickup method according to claim 4, characterized in that: The performing source energy collaborative analysis on the non-distorted homologous channel data to obtain dual-channel sound pickup data includes: Get the theoretical unit amplitude attenuation of dual channels and effective channel spacing ; The first matching change functions of the same source that are different from each other after the distortion supplementation process and the homologous second matching change function , combined with the theoretical unit amplitude attenuation and the effective channel spacing , perform energy collaborative analysis and obtain dual-channel pickup data.

6. A dual-channel high-precision pickup device, characterized in that: include: A first channel acquisition unit, configured to acquire sound data to form first channel sound data; A second channel acquisition unit, configured to acquire sound data to form second channel sound data; The distortion collaborative analysis unit is configured to perform distortion calibration and supplementation and perform energy collaborative analysis on the first channel sound data acquired by the first channel acquisition unit and the second channel sound data acquired by the second channel acquisition unit to form dual-channel sound pickup data, wherein: Obtain dual-channel sound data and perform matching analysis based on the same source to determine the homologous channel data; Performing distortion calibration on the homologous channel data based on channel asynchrony, and performing true supplementary processing on the calibration position to form non-distorted homologous channel data; Performing source energy collaborative analysis on the non-distorted homologous channel data to obtain dual-channel sound pickup data; The process of obtaining dual-channel sound data and performing matching analysis based on the same source to determine homologous channel data includes: Extracting time domain variation data of different sounds collected on the two channels respectively to form first channel sound data and second channel sound data; Extract the first time domain variation functions of different sounds in the first channel sound data respectively and a second time domain variation function of different sounds in the second channel sound data , m is the number of different first time-domain variation functions in the first channel sound data, and n is the number of different second time-domain variation functions in the second channel sound data; The first time domain variation function and the second time domain variation function Perform matching analysis in the time dimension to determine the first time domain change function and the second time domain change function of the same source, and mark them as the first matching change function of the same source and homologous second matching change function , k is the number of different matching sounds: For any of the first time domain variation functions , if there is a time displacement , making Throughout the message On the second time domain variation function with any one Throughout the message If the following conditions are met, the first time domain variation function to be analyzed is determined and the second time domain variation function Collect data for different channels of the same sound source: ， ， Extraction satisfaction The total duration of the condition, P is the matching difference threshold, Indicates the minimum matching duration ratio. Indicates taking and The smaller value of ; The first time domain variation function that meets the matching condition Calibrated as the homologous first matching change function , the second time domain variation function that meets the matching condition Calibrated as the homologous second matching change function ; The homologous channel data is calibrated for distortion based on channel asynchrony, and the calibrated position is subjected to true supplementary processing to form undistorted homologous channel data, including: The first matching change function of the homology and the homologous second matching change function , extract does not meet the matching analysis The information on the time period forms the homologous first non-adaptive segment function and the homologous second non-adaptive segment function , i means not satisfied The numbers of multiple different consecutive time periods; For the corresponding homologous first non-adaptive segment function and the homologous second non-adaptive segment function Conduct frequency distortion calibration analysis to generate distortion period data corresponding to the same sound source; Performing true supplementary processing on the distorted period data corresponding to the matching variation function to form non-distorted homologous channel data; A result output unit, configured to obtain and output the dual-channel sound pickup data obtained by the distortion collaborative analysis unit; an acquisition control unit, configured to control the first channel acquisition unit and the second channel acquisition unit to acquire sound data, and to adjust the acquisition angles of the first channel acquisition unit and the second channel acquisition unit; The ranging unit is used to detect human activities and control the operation of the acquisition control unit according to the monitoring results.

Images