Distributed-sound-system delay detection method and apparatus, and medium and electronic device
By mixing characteristic signals of different frequencies in the audio signal and using frequency detection technology to accurately calculate the delay between speakers, the problem of inaccurate detection in the prior art is solved, and the scalability of distributed audio systems is improved.
Patent Information
- Application Number
- PCT/CN2024/134295
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2024-01-26
- Filing Date
- 2024-11-25
- Publication Date
- 2025-07-31
AI Technical Summary
The existing delay detection methods cannot conveniently, efficiently and accurately detect the delay between multiple speakers in a distributed audio system, resulting in poor system expansion and can only achieve the combination of a limited variety of speakers.
After mixing the audio signal with characteristic signals of different frequencies, multiple mixing signals are generated, and a preset microphone is used to receive the sound signal played by the speaker, frequency detection is performed, and the delay between speakers is calculated.
It realizes convenient, efficient and accurate detection of delays between multiple speakers in a distributed audio system, improving the scalability of the system.
Smart Images

Figure CN2024134295_31072025_PF_FP_ABST
Abstract
Description
Distributed sound system delay detection method, device, medium and electronic equipment
[0001] This application claims priority to the Chinese patent application filed with the China Patent Office on January 26, 2024, with application number 202410119411.6 and application name “Distributed sound system delay detection method, device, medium and electronic device”, the entire contents of which are incorporated by reference into this application. Technical Field
[0002] The present application relates to the field of sound playback technology, and in particular to a distributed sound system delay detection method, device, medium and electronic equipment. Background Art
[0003] A distributed sound system is a playback system consisting of multiple speakers, such as a television's built-in speakers and an external soundbar. Each speaker in a distributed sound system has different transmission and audio processing delays, resulting in delays between the speakers. Measuring this delay has a significant impact on synchronizing playback across multiple speakers.
[0004] Among the current related delay detection methods, some methods usually determine the delay between a limited number of speakers based on pre-set parameters corresponding to the speaker types. However, in a distributed audio system, multiple speakers are often matched by users according to their needs. For example, users may connect external speakers of different brands to their TVs. Faced with such diverse speaker combinations, it is very easy for the delay to be uncertain. In some other methods, the delay is obtained by detecting the time difference between the speakers receiving the sounds of multiple microphones. However, the applicant has found that the accuracy of delay detection is prone to errors under this method. Technical issues
[0005] Current delay detection methods cannot conveniently, efficiently, and accurately detect the delay between multiple speakers in a distributed sound system, resulting in poor scalability of the distributed sound system and the distributed sound system can only support the combination of a limited number of speaker types. Technical Solutions
[0006] The embodiments of the present application provide a distributed sound system delay detection solution, which can conveniently, efficiently and accurately detect the delay between multiple speakers in the distributed sound system, thereby improving the scalability of the distributed sound system.
[0007] The embodiments of this application provide the following technical solutions:
[0008] According to one embodiment of the present application, a distributed sound system delay detection method includes: mixing an audio signal with characteristic signals of different frequencies to obtain multiple mixed signals, and transmitting the multiple mixed signals to multiple speakers in the distributed speaker system; obtaining a mixed sound signal received by a preset microphone, wherein the mixed sound signal is the sound signal received by the preset microphone when the multiple speakers play sounds based on the received mixed signal; performing frequency detection on the mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal; and calculating according to the positions of characteristic signals of different frequencies contained in the mixed sound signal to obtain the delay between the multiple speakers in the distributed speaker system.
[0009] In some embodiments of the present application, the step of mixing an audio signal with characteristic signals of different frequencies to obtain a plurality of mixed signals includes: performing band-stop filtering on the audio signal through a band-stop filter to obtain a filtered audio signal, wherein the band-stop filter is used to filter out the signal components of the different frequencies; and mixing the filtered audio signal with characteristic signals of different frequencies to obtain a plurality of mixed signals.
[0010] In some embodiments of the present application, the calculation based on the positions of characteristic signals of different frequencies contained in the mixed sound signal to obtain the delay between multiple speakers in the distributed speaker system includes: calculating based on the positions of characteristic signals of different frequencies contained in the mixed sound signal to obtain the position difference between different characteristic signals; multiplying the position difference between the different characteristic signals by the sampling rate of the audio signal to obtain the delay between the different characteristic signals; and obtaining the delay between the speakers corresponding to the different characteristic signals based on the delay between the different characteristic signals.
[0011] In some embodiments of the present application, the frequency detection of the mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal includes: band-pass filtering the mixed sound signal through a band-pass filter to obtain a filtered mixed sound signal, the band-pass filter being used to filter out signals outside the predetermined frequency range, and the different frequencies being within the predetermined frequency range; and frequency detection of the filtered mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal.
[0012] In some embodiments of the present application, the frequency detection of the filtered mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal includes: segmenting the filtered mixed sound signal and passing it through multiple notch filters to obtain frequency amplitude change data under each of the notch filters, wherein the center frequencies of the multiple notch filters are the different frequencies respectively; and obtaining the positions of characteristic signals of different frequencies contained in the mixed sound signal based on the frequency amplitude change data under each of the notch filters and a predetermined amplitude change threshold.
[0013] In some embodiments of the present application, before the audio signal is mixed with characteristic signals of different frequencies to obtain multiple mixed signals, the method also includes: determining the number of speakers of the multiple speakers in the distributed speaker system; obtaining a target number of characteristic signals of different frequencies from a preset signal set, and the target number is equal to the number of speakers.
[0014] In some embodiments of the present application, the obtaining of a target number of characteristic signals of different frequencies from a preset signal set includes one of the following methods: randomly obtaining a target number of characteristic signals of different frequencies from a preset signal set; obtaining speaker information of the multiple speakers, and obtaining characteristic signals of frequencies matching the speaker information of each of the speakers from the preset signal set, to obtain a target number of characteristic signals of different frequencies.
[0015] According to one embodiment of the present application, a distributed sound system delay detection device includes: a mixing module for mixing an audio signal with characteristic signals of different frequencies to obtain multiple mixed signals, and transmitting the multiple mixed signals to multiple speakers in the distributed speaker system; an acquisition module for acquiring a mixed sound signal received by a preset microphone, wherein the mixed sound signal is the sound signal received by the preset microphone when the multiple speakers play sound based on the received mixed signal; a detection module for performing frequency detection on the mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal; and a calculation module for performing calculation based on the positions of characteristic signals of different frequencies contained in the mixed sound signal to obtain the delay between the multiple speakers in the distributed speaker system.
[0016] In some embodiments of the present application, the mixing module is used to: perform band-stop filtering on the audio signal through a band-stop filter to obtain a filtered audio signal, wherein the band-stop filter is used to filter out the signal components of different frequencies; and mix the filtered audio signal with characteristic signals of different frequencies to obtain multiple mixed signals.
[0017] In some embodiments of the present application, the calculation module is used to: calculate based on the positions of characteristic signals of different frequencies contained in the mixed sound signal to obtain the position difference between different characteristic signals; multiply the position difference between the different characteristic signals by the sampling rate of the audio signal to obtain the delay between the different characteristic signals; and obtain the delay between the speakers corresponding to the different characteristic signals based on the delay between the different characteristic signals.
[0018] In some embodiments of the present application, the detection module is used to: perform bandpass filtering on the mixed sound signal through a bandpass filter to obtain a filtered mixed sound signal, wherein the bandpass filter is used to filter out signals outside the predetermined frequency range, and the different frequencies are within the predetermined frequency range; perform frequency detection on the filtered mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal.
[0019] In some embodiments of the present application, the detection module is used to: divide the filtered mixed sound signal into segments and pass it through multiple notch filters to obtain frequency amplitude change data under each notch filter, wherein the center frequencies of the multiple notch filters are the different frequencies respectively; and obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal based on the frequency amplitude change data under each notch filter and a predetermined amplitude change threshold.
[0020] In some embodiments of the present application, before the audio signal is mixed with characteristic signals of different frequencies to obtain multiple mixed signals, the device also includes a signal module for: determining the number of speakers of the multiple speakers in the distributed speaker system; obtaining a target number of characteristic signals of different frequencies from a preset signal set, where the target number is equal to the number of speakers.
[0021] In some embodiments of the present application, the signal module is used to implement one of the following methods: randomly obtaining a target number of characteristic signals of different frequencies from a preset signal set; obtaining speaker information of the multiple speakers, and obtaining characteristic signals of frequencies matching the speaker information of each of the speakers from the preset signal set, to obtain a target number of characteristic signals of different frequencies.
[0022] According to another embodiment of the present application, a storage medium stores a computer program thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute the method described in the embodiment of the present application.
[0023] According to another embodiment of the present application, an electronic device may include: a memory storing a computer program; and a processor reading the computer program stored in the memory to execute the method described in the embodiment of the present application.
[0024] According to another embodiment of the present application, a computer program product or computer program includes computer instructions stored in a computer-readable storage medium. A processor of a computer device reads the computer instructions from the computer-readable storage medium and executes the computer instructions, causing the computer device to perform the methods provided in various optional implementations described in the embodiments of the present application. Beneficial effects
[0025] In an embodiment of the present application, an audio signal is mixed with characteristic signals of different frequencies to obtain multiple mixed signals, and the multiple mixed signals are respectively transmitted to multiple speakers in a distributed speaker system; a mixed sound signal received by a preset microphone is obtained, and the mixed sound signal is the sound signal received by the preset microphone when the multiple speakers play sound based on the received mixed signal; the frequency of the mixed sound signal is detected to obtain the positions of the characteristic signals of different frequencies contained in the mixed sound signal; and calculation is performed based on the positions of the characteristic signals of different frequencies contained in the mixed sound signal to obtain the delay between the multiple speakers in the distributed speaker system.
[0026] In this way, after mixing characteristic signals of different frequencies in the audio signal, the multiple mixed signals are respectively transmitted to the multiple speakers in the distributed speaker system, so that the sounds played by the multiple speakers are embedded with characteristic signals of different frequencies. The mixed sound signal received by the preset microphone is mixed with the sounds played by the multiple speakers. The positions of the characteristic signals of different frequencies contained in the mixed sound signal can be accurately obtained through frequency detection. Furthermore, based on the positions of the characteristic signals of different frequencies, the delay between the multiple speakers in the distributed speaker system can be accurately obtained. Overall, the delay between the multiple speakers in the distributed sound system can be detected conveniently, efficiently and accurately, thereby improving the scalability of the distributed sound system. BRIEF DESCRIPTION OF THE DRAWINGS
[0027] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0028] FIG1 shows a flow chart of a distributed sound system delay detection method according to an embodiment of the present application.
[0029] FIG2 shows a signal mixing flow chart according to an embodiment of the present application.
[0030] FIG3 shows a frequency detection flow chart according to an embodiment of the present application.
[0031] FIG4 shows a frequency response characteristic diagram according to an example of the present application.
[0032] FIG5 shows a block diagram of a distributed sound system delay detection device according to an embodiment of the present application.
[0033] FIG6 shows a block diagram of an electronic device according to an embodiment of the present application.
[0034] Implementation Methods of the Application
[0035] The present disclosure will be further described in detail below in conjunction with the accompanying drawings and examples. It should be understood that the examples provided herein are merely for explaining the present disclosure and are not intended to limit the present disclosure. In addition, the examples provided below are partial examples for implementing the present disclosure, rather than providing all examples for implementing the present disclosure. In the absence of conflict, the technical solutions described in the examples of the present disclosure may be implemented in any combination.
[0036] It should be noted that, in the embodiments of the present disclosure, the terms "include", "comprise" or any other variants thereof are intended to cover non-exclusive inclusion, so that a method or apparatus comprising a series of elements includes not only the elements explicitly stated, but also other elements not explicitly listed, or also includes elements inherent to the implementation of the method or apparatus. In the absence of further restrictions, an element defined by the sentence "comprising a ..." does not exclude the presence of other related elements (such as steps in the method or units in the apparatus, for example, a unit may be part of a circuit, part of a processor, part of a program or software, etc.) in the method or apparatus comprising the element.
[0037] For example, the distributed sound system delay detection method provided in the embodiment of the present disclosure includes a series of steps, but the distributed sound system delay detection method provided in the embodiment of the present disclosure is not limited to the recorded steps. Similarly, the distributed sound system delay detection device provided in the embodiment of the present disclosure includes a series of units, but the device provided in the embodiment of the present disclosure is not limited to including the units explicitly recorded, and may also include units required to obtain relevant information or perform processing based on the information.
[0038] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by those skilled in the art to which the present disclosure pertains. The terms used herein are for the purpose of describing specific embodiments only and are not intended to limit the present disclosure.
[0039] Figure 1 schematically shows a flow chart of a distributed audio system delay detection method according to an embodiment of the present application. The distributed audio system delay detection method can be executed by any device with processing capabilities, such as a television, computer, mobile phone, smart watch, and home appliance.
[0040] In a specific embodiment of the present application, the executor of the distributed sound system delay detection method is a television, the built-in speakers of the television and at least one external speaker form a distributed sound system, and the microphone of the television serves as a preset microphone.
[0041] As shown in FIG1 , the distributed sound system delay detection method may include steps S110 to S140 .
[0042] Step S110, mixing the audio signal with characteristic signals of different frequencies to obtain multiple mixed signals, and transmitting the multiple mixed signals to multiple speakers in the distributed speaker system respectively; Step S120, obtaining the mixed sound signal received by the preset microphone, wherein the mixed sound signal is the sound signal received by the preset microphone when the multiple speakers play sound based on the received mixed signal; Step S130, performing frequency detection on the mixed sound signal to obtain the positions of the characteristic signals of different frequencies contained in the mixed sound signal; Step S140, calculating according to the positions of the characteristic signals of different frequencies contained in the mixed sound signal to obtain the delay between the multiple speakers in the distributed speaker system.
[0043] The device can mix an audio signal with characteristic signals of different frequencies to obtain multiple mixed signals. For example, if there are three speakers, audio signal A can be superimposed with characteristic signal X1 of frequency f1 to obtain mixed signal AX1, audio signal A can be superimposed with characteristic signal X2 of frequency f2 to obtain mixed signal AX2, and audio signal A can be superimposed with characteristic signal X3 of frequency f3 to obtain mixed signal AX3. Mixed signals AX1 to AX3 can be respectively transmitted to speakers 1 to 3. It will be understood that the number of speakers can be set as needed. Accordingly, the number of characteristic signals is equal to the number of speakers, and the number of mixed signals is equal to the number of speakers.
[0044] Specifically, characteristic signals of different frequencies can be inserted into the same position in the audio signal. Consequently, the characteristic signals in multiple mixed signals have the same position but different frequencies. For example, characteristic signal X1 can be inserted into position A5 of audio signal A to generate mixed signal AX1, and characteristic signal X2 can be inserted into position A5 of audio signal A to generate mixed signal AX2. Consequently, the position of characteristic signal X1 in mixed signal AX1 is the same as the position of characteristic signal X2 in mixed signal AX2.
[0045] Multiple mixed signals are respectively transmitted to multiple speakers in the distributed speaker system, and then each speaker plays sound based on the received mixed signal. At the same time, the preset microphone can receive the sound in the space to obtain a mixed sound signal. That is, the mixed sound signal is the sound signal received by the preset microphone when the multiple speakers play sound based on the received mixed signal. The mixed sound signal will integrate the sounds played by multiple speakers.
[0046] Furthermore, frequency detection can be performed on the mixed sound signal to detect the different frequencies contained in the mixed sound signal and then determine the positions of the characteristic signals of different frequencies in the mixed sound signal. For example, characteristic signal X1 of frequency f1 can be detected at position f1 in the mixed sound signal, and characteristic signal X2 of frequency f2 can be detected at position f2 in the mixed sound signal.
[0047] Furthermore, by calculating the positions of characteristic signals of different frequencies contained in the mixed sound signal, the delay between each pair of characteristic signals of different frequencies can be accurately calculated, thereby accurately determining the delay between two speakers corresponding to each pair of characteristic signals of different frequencies among the multiple speakers. For example, mixed signals AX1 to AX3 can be transmitted to speakers 1 to 3, respectively, and the delay T12 between characteristic signal X1 of frequency f1 and characteristic signal X2 of frequency f2 can be calculated. This delay T12 is also the delay between speakers 1 and 2. The delay T13 between characteristic signal X1 of frequency f1 and characteristic signal X3 of frequency f3 can be calculated. This delay T13 is also the delay between speakers 1 and 3. And so on, the delay between each pair of speakers can be determined.
[0048] In this way, based on steps S110 to S140, after mixing characteristic signals of different frequencies into the audio signal, multiple mixed signals are respectively transmitted to multiple speakers in the distributed speaker system, so that the sounds played by the multiple speakers are embedded with characteristic signals of different frequencies. The sounds played by the multiple speakers are mixed in the mixed sound signal received by the preset microphone. The positions of the characteristic signals of different frequencies contained in the mixed sound signal can be accurately obtained through frequency detection. Furthermore, calculations based on the positions of the characteristic signals of different frequencies can accurately obtain the delays between the multiple speakers in the distributed speaker system. Overall, it is possible to conveniently, efficiently and accurately detect the delays between the multiple speakers in the distributed sound system, thereby improving the scalability of the distributed sound system.
[0049] The following describes further optional specific embodiments of each step performed when performing distributed sound system delay detection in the embodiment of FIG. 1 .
[0050] In one embodiment, before the audio signal is mixed with characteristic signals of different frequencies to obtain multiple mixed signals, the method also includes: determining the number of speakers of the multiple speakers in the distributed speaker system; obtaining a target number of characteristic signals of different frequencies from a preset signal set, and the target number is equal to the number of speakers.
[0051] A first number of characteristic signals of different frequencies can be preset in the preset signal set. The device first determines the number of speakers in the distributed speaker system. Then, according to the number of speakers, an equal target number of characteristic signals of different frequencies can be obtained from the preset signal set. Then, they are mixed with the audio signals respectively to obtain a mixed signal for inputting each speaker.
[0052] For example, 10 characteristic signals of different frequencies may be preset in the preset signal set. If it is determined that the number of speakers in the distributed speaker system is 2, 2 characteristic signals of different frequencies may be obtained from the preset signal set.
[0053] Furthermore, in one embodiment, obtaining a target number of characteristic signals of different frequencies from a preset signal set may include one of the following methods:
[0054] The first method is to randomly obtain a target number of characteristic signals of different frequencies from a preset signal set;
[0055] The second method is to obtain speaker information of the multiple speakers, and obtain a characteristic signal of a frequency matching the speaker information of each speaker from the preset signal set, to obtain a target number of characteristic signals of different frequencies.
[0056] In the first method, a target number of characteristic signals of different frequencies are randomly obtained from a preset signal set. For example, 10 characteristic signals of different frequencies can be preset in the preset signal set. If the number of speakers in the distributed speaker system is determined to be 2, 2 characteristic signals of different frequencies are randomly selected from the preset signal set.
[0057] In the second method, first obtain the speaker information of each speaker, such as the speaker model or manufacturer. Further, obtain the characteristic signal of the frequency matched by the speaker information of each speaker, thereby obtaining the target number of characteristic signals of different frequencies. For example, if the frequency matched by the speaker information 1 of speaker 1 is f1, then obtain a characteristic signal of the frequency f1; if the frequency matched by the speaker information 1 of speaker 2 is f2, then obtain a characteristic signal of the frequency f2. The mixed signal obtained by mixing the characteristic signal of the frequency f1 can be used to be transmitted to speaker 1 for playback, and the mixed signal obtained by mixing the corresponding characteristic signal of the frequency f2 can be used to be transmitted to speaker 2 for playback. Thus, the sound played by each speaker can contain an effective characteristic signal for detection, which can further ensure the detection accuracy of the characteristic signal of each frequency in the signal received by the preset microphone, and further improve the accuracy of delay detection.
[0058] In one embodiment, the mixing of the audio signal with characteristic signals of different frequencies to obtain multiple mixed signals may include: performing band-stop filtering on the audio signal through a band-stop filter to obtain a filtered audio signal, wherein the band-stop filter is used to filter out the signal components of different frequencies; and mixing the filtered audio signal with characteristic signals of different frequencies to obtain multiple mixed signals.
[0059] For example, referring to Figure 2, the characteristic signals of different frequencies may include two, namely, a characteristic signal 230 of frequency f1 and a characteristic signal 240 of frequency f2; the audio signal 210 is band-stop filtered through a band-stop filter 220 to obtain a filtered audio signal, and the band-stop filter is used to filter out the signal components of the different frequencies (frequency f1 and frequency f2). If the audio signal 210 includes signal components of frequency f1 and frequency f2, they will be filtered out to obtain a filtered audio signal that does not include signal components of frequency f1 and frequency f2.
[0060] The filtered audio signal is mixed with the characteristic signal 230 of the f1 frequency to obtain a mixed signal 1, which can be used to input the built-in speaker 250; the filtered audio signal is mixed with the characteristic signal 240 of the f2 frequency to obtain a mixed signal 2, which can be used to input the external speaker 260.
[0061] The audio signal passes through a band-stop filter before being mixed with characteristic signals of different frequencies, which can filter out signal components with the same frequency as the characteristic signal, and avoid the simultaneous presence of signal components with the same frequency as the characteristic signal in the audio signal, thereby reliably avoiding position errors of the characteristic signal detected in subsequent steps, and further effectively ensuring the accuracy of delay detection.
[0062] It is understandable that in other embodiments, the audio signal that does not contain signal components with the same frequency as the characteristic signal can be collected in advance through detection processing and other means. Furthermore, the audio signal can be directly mixed with characteristic signals of different frequencies without performing band-stop filtering to obtain multiple mixed signals.
[0063] In one embodiment, calculating, based on the positions of characteristic signals of different frequencies included in the mixed sound signal, to obtain the delays between the multiple speakers in the distributed speaker system may include:
[0064] Calculation is performed based on the positions of characteristic signals of different frequencies contained in the mixed sound signal to obtain the position difference between the different characteristic signals; the position difference between the different characteristic signals is multiplied by the sampling rate of the audio signal to obtain the delay between the different characteristic signals; and based on the delay between the different characteristic signals, the delay between the speakers corresponding to the different characteristic signals is obtained.
[0065] Calculations are performed based on the positions of characteristic signals of different frequencies contained in the mixed sound signal to obtain the positional difference between the different characteristic signals. For example, characteristic signal X1 of frequency f1 can be detected at position f1 in the mixed sound signal, and characteristic signal X2 of frequency f2 can be detected at position f2 in the mixed sound signal. By performing a difference calculation based on the positions f1 and f2, the positional difference between characteristic signal X1 and characteristic signal X2 ("f1 position - f2 position") can be obtained.
[0066] Furthermore, the position difference between different characteristic signals is multiplied by the sampling rate of the audio signal to obtain the delay between different characteristic signals. For example, T12 = (f1 position - f2 position) * Fs, where Fs is the audio signal sampling rate, and T12 is the delay between characteristic signal X1 and characteristic signal X2.
[0067] Furthermore, based on the delay between different characteristic signals, the delay between the speakers corresponding to different characteristic signals is obtained. For example, the characteristic signal X1 is mixed to obtain the mixed signal 1 for input into speaker 1, then the speaker corresponding to the characteristic signal X1 is speaker 1. Similarly, the speaker corresponding to the characteristic signal X2 is speaker 2. Therefore, the delay between speaker 1 and speaker 2 is T12 = (f1 position - f2 position) * Fs. Then, the delay between the corresponding speakers is accurately calculated based on the position of the characteristic signals of different frequencies.
[0068] In one embodiment, referring to Figure 3, the frequency detection of the mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal may include: step S310, bandpass filtering: bandpass filtering the mixed sound signal through a bandpass filter to obtain a filtered mixed sound signal, wherein the bandpass filter is used to filter out signals outside the predetermined frequency range, and the different frequencies are within the predetermined frequency range; step S320, frequency detection: frequency detection of the filtered mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal.
[0069] By filtering out signals outside a predetermined frequency range in the mixed sound signal through a bandpass filter, a filtered mixed sound signal is obtained, and different frequencies are within the predetermined frequency range, which can reliably reduce the frequency detection range, thereby enabling efficient and accurate frequency detection of the filtered mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal.
[0070] It can be understood that in other embodiments, the frequency detection of the mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal may include: directly performing frequency detection on the mixed sound signal without band-pass filtering to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal.
[0071] In one embodiment, the frequency detection is performed on the filtered mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal, including: segmenting the filtered mixed sound signal and passing it through multiple notch filters to obtain frequency amplitude change data under each of the notch filters, wherein the center frequencies of the multiple notch filters are the different frequencies respectively; and obtaining the positions of characteristic signals of different frequencies contained in the mixed sound signal based on the frequency amplitude change data under each of the notch filters and a predetermined amplitude change threshold.
[0072] In this embodiment, a notch filter is used to perform frequency detection to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal. The notch filter can be used to conveniently and efficiently detect the positions of characteristic signals of different frequencies.
[0073] Multiple notch filters are set, and the center frequencies of the multiple notch filters are different frequencies. For example, if the different frequencies are f1 and f2, notch filter 1 and notch filter 2 can be set, and the center frequencies of notch filter 1 and notch filter 2 are f1 and f2 respectively.
[0074] The filtered mixed sound signal is segmented and passed through multiple notch filters to obtain frequency and amplitude change data under each notch filter. For example, the filtered mixed sound signal is segmented and passed through notch filter 1 to obtain frequency and amplitude change data 1 under notch filter 1; the filtered mixed sound signal is segmented and passed through notch filter 2 to obtain frequency and amplitude change data 2 under notch filter 2.
[0075] Based on the frequency amplitude change data for each notch filter and the predetermined amplitude change threshold, the locations of characteristic signals of different frequencies contained in the mixed sound signal can be determined. For example, Figure 4 shows the frequency response characteristic diagram of the notch filter. At its center frequency ω0, the corresponding amplitude changes. Therefore, the location where the amplitude change exceeds the predetermined amplitude change threshold in frequency amplitude change data 1 is the location of the characteristic signal of frequency f1. Correspondingly, the location where the amplitude change exceeds the predetermined amplitude change threshold in frequency amplitude change data 2 is the location of the characteristic signal of frequency f2.
[0076] In other embodiments, the frequency detection may be performed by other methods such as Fast Fourier Transform (FFT).
[0077] To facilitate better implementation of the distributed sound system delay detection method provided in the embodiments of this application, the embodiments of this application also provide a distributed sound system delay detection device based on the above-described distributed sound system delay detection method. The meanings of the terms herein are the same as those in the above-described distributed sound system delay detection method. For specific implementation details, please refer to the description in the method embodiments. Figure 5 shows a block diagram of the distributed sound system delay detection device according to one embodiment of the present application.
[0078] As shown in Figure 5, the distributed sound system delay detection device 400 may include: a mixing module 410 can be used to mix the audio signal with characteristic signals of different frequencies to obtain multiple mixed signals, and transmit the multiple mixed signals to multiple speakers in the distributed speaker system respectively; an acquisition module 420 can be used to obtain a mixed sound signal received by a preset microphone, and the mixed sound signal is the sound signal received by the preset microphone when the multiple speakers play sound based on the received mixed signal; the detection module 430 can be used to perform frequency detection on the mixed sound signal to obtain the position of the characteristic signals of different frequencies contained in the mixed sound signal; the calculation module 440 can be used to perform calculations based on the positions of the characteristic signals of different frequencies contained in the mixed sound signal to obtain the delay between the multiple speakers in the distributed speaker system.
[0079] In some embodiments of the present application, the mixing module is used to: perform band-stop filtering on the audio signal through a band-stop filter to obtain a filtered audio signal, wherein the band-stop filter is used to filter out the signal components of different frequencies; and mix the filtered audio signal with characteristic signals of different frequencies to obtain multiple mixed signals.
[0080] In some embodiments of the present application, the calculation module is used to: calculate based on the positions of characteristic signals of different frequencies contained in the mixed sound signal to obtain the position difference between different characteristic signals; multiply the position difference between the different characteristic signals by the sampling rate of the audio signal to obtain the delay between the different characteristic signals; and obtain the delay between the speakers corresponding to the different characteristic signals based on the delay between the different characteristic signals.
[0081] In some embodiments of the present application, the detection module is used to: perform bandpass filtering on the mixed sound signal through a bandpass filter to obtain a filtered mixed sound signal, wherein the bandpass filter is used to filter out signals outside the predetermined frequency range, and the different frequencies are within the predetermined frequency range; perform frequency detection on the filtered mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal.
[0082] In some embodiments of the present application, the detection module is used to: divide the filtered mixed sound signal into segments and pass it through multiple notch filters to obtain frequency amplitude change data under each notch filter, wherein the center frequencies of the multiple notch filters are the different frequencies respectively; and obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal based on the frequency amplitude change data under each notch filter and a predetermined amplitude change threshold.
[0083] In some embodiments of the present application, before the audio signal is mixed with characteristic signals of different frequencies to obtain multiple mixed signals, the device also includes a signal module for: determining the number of speakers of the multiple speakers in the distributed speaker system; obtaining a target number of characteristic signals of different frequencies from a preset signal set, where the target number is equal to the number of speakers.
[0084] In some embodiments of the present application, the signal module is used to implement one of the following methods: randomly obtaining a target number of characteristic signals of different frequencies from a preset signal set; obtaining speaker information of the multiple speakers, and obtaining characteristic signals of frequencies matching the speaker information of each of the speakers from the preset signal set, to obtain a target number of characteristic signals of different frequencies.
[0085] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiment of the application, the features and functions of two or more modules or units described above can be concretized in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be concretized.
[0086] In addition, an embodiment of the present application further provides an electronic device, as shown in FIG6 . FIG6 shows a block diagram of an electronic device according to an embodiment of the present application. Specifically:
[0087] The electronic device may include components such as a processor 501 with one or more processing cores, a memory 502 with one or more computer-readable storage media, a power supply 503, and an input unit 504. Those skilled in the art will appreciate that the electronic device structure shown in FIG6 does not limit the electronic device and may include more or fewer components than shown, or combine certain components, or arrange the components differently.
[0088] Processor 501 is the control center of the electronic device. It utilizes various interfaces and circuits to connect the various components of the entire computer device. By running or executing software programs and / or modules stored in memory 502 and accessing data stored in memory 502, it performs various computer device functions and processes data, thereby providing overall monitoring of the electronic device. Optionally, processor 501 may include one or more processing cores; preferably, processor 501 may integrate an application processor and a modem processor, wherein the application processor primarily processes the operating system, user interfaces, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into processor 501.
[0089] The memory 502 can be used to store software programs and modules. The processor 501 executes various functional applications and data processing by running the software programs and modules stored in the memory 502. The memory 502 may mainly include a program storage area and a data storage area, wherein the program storage area may store an operating system, at least one application required for a function (such as a sound playback function, an image playback function, etc.); the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 502 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, or other volatile solid-state storage device. Accordingly, the memory 502 may also include a memory controller to provide the processor 501 with access to the memory 502.
[0090] The electronic device also includes a power supply 503 for supplying power to various components. Preferably, the power supply 503 can be logically connected to the processor 501 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 503 can also include one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other arbitrary components.
[0091] The electronic device may further include an input unit 504, which may be used to receive input digital or character information and generate keyboard, mouse, joystick, optical or trackball signal input related to user settings and function control.
[0092] Although not shown, the electronic device may further include a display unit, etc., which will not be described in detail here. Specifically, in this embodiment, the processor 501 in the electronic device will load the executable files corresponding to one or more computer program processes into the memory 502 according to the following instructions, and the processor 501 will run the computer program stored in the memory 502, thereby realizing the various functions of the aforementioned embodiments of the present application. For example, the processor 501 may perform the following steps:
[0093] An audio signal is mixed with characteristic signals of different frequencies to obtain multiple mixed signals, and the multiple mixed signals are respectively transmitted to multiple speakers in the distributed speaker system; a mixed sound signal received by a preset microphone is obtained, and the mixed sound signal is the sound signal received by the preset microphone when the multiple speakers play sounds based on the received mixed signal; the frequency of the mixed sound signal is detected to obtain the positions of the characteristic signals of different frequencies contained in the mixed sound signal; and calculation is performed based on the positions of the characteristic signals of different frequencies contained in the mixed sound signal to obtain the delay between the multiple speakers in the distributed speaker system.
[0094] In some embodiments of the present application, the step of mixing an audio signal with characteristic signals of different frequencies to obtain a plurality of mixed signals includes: performing band-stop filtering on the audio signal through a band-stop filter to obtain a filtered audio signal, wherein the band-stop filter is used to filter out the signal components of different frequencies; and mixing the filtered audio signal with characteristic signals of different frequencies to obtain a plurality of mixed signals.
[0095] In some embodiments of the present application, the calculation based on the positions of characteristic signals of different frequencies contained in the mixed sound signal to obtain the delay between multiple speakers in the distributed speaker system includes: calculating based on the positions of characteristic signals of different frequencies contained in the mixed sound signal to obtain the position difference between different characteristic signals; multiplying the position difference between the different characteristic signals by the sampling rate of the audio signal to obtain the delay between the different characteristic signals; and obtaining the delay between the speakers corresponding to the different characteristic signals based on the delay between the different characteristic signals.
[0096] In some embodiments of the present application, the frequency detection of the mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal includes: band-pass filtering the mixed sound signal through a band-pass filter to obtain a filtered mixed sound signal, the band-pass filter being used to filter out signals outside the predetermined frequency range, and the different frequencies being within the predetermined frequency range; and frequency detection of the filtered mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal.
[0097] In some embodiments of the present application, the frequency detection of the filtered mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal includes: segmenting the filtered mixed sound signal and passing it through multiple notch filters to obtain frequency amplitude change data under each of the notch filters, wherein the center frequencies of the multiple notch filters are the different frequencies respectively; and obtaining the positions of characteristic signals of different frequencies contained in the mixed sound signal based on the frequency amplitude change data under each of the notch filters and a predetermined amplitude change threshold.
[0098] In some embodiments of the present application, before the audio signal is mixed with characteristic signals of different frequencies to obtain multiple mixed signals, it also includes: determining the number of speakers of the multiple speakers in the distributed speaker system; obtaining a target number of characteristic signals of different frequencies from a preset signal set, and the target number is equal to the number of speakers.
[0099] In some embodiments of the present application, the obtaining of a target number of characteristic signals of different frequencies from a preset signal set includes one of the following methods: randomly obtaining a target number of characteristic signals of different frequencies from a preset signal set; obtaining speaker information of the multiple speakers, and obtaining characteristic signals of frequencies matching the speaker information of each of the speakers from the preset signal set, to obtain a target number of characteristic signals of different frequencies.
[0100] Those skilled in the art will appreciate that all or part of the steps in the various methods of the above embodiments may be accomplished by a computer program, or by controlling related hardware through a computer program. The computer program may be stored in a computer-readable storage medium and loaded and executed by a processor.
[0101] To this end, an embodiment of the present application further provides a storage medium storing a computer program, which can be loaded by a processor to execute the steps of any method provided in the embodiment of the present application.
[0102] The storage medium may be a computer-readable storage medium, and the storage medium may include a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk.
[0103] Since the computer program stored in the storage medium can execute the steps of any method provided in the embodiments of the present application, the beneficial effects that can be achieved by the method provided in the embodiments of the present application can be achieved. Please refer to the previous embodiments for details and will not be repeated here.
[0104] Those skilled in the art will readily conceive of other embodiments of the present application after considering the specification and practicing the embodiments disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present application that follow the general principles of this application and include common knowledge or customary techniques in the art that are not disclosed herein.
[0105] It should be understood that the present application is not limited to the embodiments that have been described above and shown in the accompanying drawings, but various modifications and changes may be made without departing from the scope thereof.
Claims
1. A distributed sound system delay detection method, wherein: include: Mixing the audio signal with characteristic signals of different frequencies to obtain a plurality of mixed signals, and transmitting the plurality of mixed signals to a plurality of speakers in the distributed speaker system; Acquire a mixed sound signal received by a preset microphone, where the mixed sound signal is a sound signal received by the preset microphone when the multiple speakers play sounds based on the received mixed sound signal; Performing frequency detection on the mixed sound signal to obtain positions of characteristic signals of different frequencies contained in the mixed sound signal; The delays between the multiple loudspeakers in the distributed loudspeaker system are obtained by calculation based on the positions of the characteristic signals of different frequencies contained in the mixed sound signal.
2. The method according to claim 1, wherein The step of mixing the audio signal with characteristic signals of different frequencies to obtain a plurality of mixed signals comprises: Performing band-stop filtering on the audio signal through a band-stop filter to obtain a filtered audio signal, wherein the band-stop filter is used to filter out signal components of different frequencies; The filtered audio signal is mixed with characteristic signals of different frequencies to obtain a plurality of mixed signals.
3. The method according to claim 1, wherein The calculating, based on the positions of the characteristic signals of different frequencies contained in the mixed sound signal, to obtain the delays between the multiple speakers in the distributed speaker system includes: Calculating based on the positions of characteristic signals of different frequencies contained in the mixed sound signal to obtain position differences between different characteristic signals; Multiplying the position difference between the different characteristic signals by the sampling rate of the audio signal to obtain the delay between the different characteristic signals; According to the delays between the different characteristic signals, the delays between the loudspeakers corresponding to the different characteristic signals are obtained.
4. The method according to claim 1, wherein The performing frequency detection on the mixed sound signal to obtain positions of characteristic signals of different frequencies contained in the mixed sound signal includes: performing bandpass filtering on the mixed sound signal through a bandpass filter to obtain a filtered mixed sound signal, wherein the bandpass filter is configured to filter out signals outside a predetermined frequency range, and the different frequencies are within the predetermined frequency range; Frequency detection is performed on the filtered mixed sound signal to obtain positions of characteristic signals of different frequencies contained in the mixed sound signal.
5. The method according to claim 4, wherein The performing frequency detection on the filtered mixed sound signal to obtain positions of characteristic signals of different frequencies contained in the mixed sound signal includes: Passing the filtered mixed sound signal through a plurality of notch filters in sections to obtain frequency amplitude change data under each notch filter, wherein the center frequencies of the plurality of notch filters are the different frequencies; The positions of characteristic signals of different frequencies contained in the mixed sound signal are obtained according to the frequency amplitude change data under each of the notch filters and a predetermined amplitude change threshold.
6. The method according to claim 1, wherein Before the step of mixing the audio signal with characteristic signals of different frequencies to obtain a plurality of mixed signals, the method further comprises: determining a number of speakers of a plurality of speakers in the distributed speaker system; A target number of characteristic signals of different frequencies are acquired from a preset signal set, where the target number is equal to the number of the loudspeakers.
7. The method according to claim 6, wherein: The method of obtaining a target number of characteristic signals of different frequencies from a preset signal set includes one of the following methods: Randomly obtain a target number of characteristic signals of different frequencies from a preset signal set; Speaker information of the multiple speakers is obtained, and a characteristic signal of a frequency matching the speaker information of each speaker is obtained from the preset signal set to obtain a target number of characteristic signals of different frequencies.
8. The method according to claim 1, wherein Before the step of mixing the audio signal with characteristic signals of different frequencies to obtain a plurality of mixed signals, the method further comprises: Detecting the collected signals; If the signal does not include a signal component having the same frequency as the characteristic signal, the signal is used as the audio signal.
9. The method according to claim 5, wherein: The obtaining, based on the frequency amplitude change data under each of the notch filters and a predetermined amplitude change threshold, positions of characteristic signals of different frequencies contained in the mixed sound signal comprises: Determine a position in the frequency amplitude change data under each notch filter where an amplitude change greater than a predetermined amplitude change threshold occurs; The position where the amplitude change is greater than a predetermined amplitude change threshold is determined as the position of the characteristic signal of different frequencies contained in the mixed sound signal.
10. The method according to claim 1, wherein The step of mixing the audio signal with characteristic signals of different frequencies to obtain a plurality of mixed signals comprises: The characteristic signals of different frequencies are respectively inserted into the same position of the audio signal to obtain the multiple mixed signals, wherein the characteristic signals in the multiple mixed signals have the same position but different frequencies.
11. The method according to claim 1, wherein The performing frequency detection on the mixed sound signal to obtain positions of characteristic signals of different frequencies contained in the mixed sound signal includes: Directly perform frequency detection on the mixed sound signal without performing band-pass filtering to obtain positions of characteristic signals of different frequencies contained in the mixed sound signal.
12. A distributed sound system delay detection device, wherein: include: a mixing module, configured to mix the audio signal with characteristic signals of different frequencies to obtain a plurality of mixed signals, and transmit the plurality of mixed signals to a plurality of speakers in the distributed speaker system; an acquisition module, configured to acquire a mixed sound signal received by a preset microphone, wherein the mixed sound signal is a sound signal received by the preset microphone when the multiple speakers play sounds based on the received mixed sound signal; a detection module, configured to perform frequency detection on the mixed sound signal to obtain positions of characteristic signals of different frequencies contained in the mixed sound signal; The calculation module is used to calculate according to the positions of the characteristic signals of different frequencies contained in the mixed sound signal to obtain the delays between the multiple speakers in the distributed speaker system.
13. The device according to claim 12, wherein The mixing module is used to: perform band-stop filtering on the audio signal through a band-stop filter to obtain a filtered audio signal, wherein the band-stop filter is used to filter out the signal components of different frequencies; and mix the filtered audio signal with characteristic signals of different frequencies to obtain multiple mixed signals.
14. The device according to claim 12, wherein The calculation module is used to: calculate according to the positions of characteristic signals of different frequencies contained in the mixed sound signal to obtain the position difference between different characteristic signals; multiply the position difference between the different characteristic signals by the sampling rate of the audio signal to obtain the delay between the different characteristic signals; and obtain the delay between the speakers corresponding to the different characteristic signals based on the delay between the different characteristic signals.
15. The device according to claim 12, wherein The detection module is used to: perform bandpass filtering on the mixed sound signal through a bandpass filter to obtain a filtered mixed sound signal, wherein the bandpass filter is used to filter out signals outside the predetermined frequency range, and the different frequencies are within the predetermined frequency range; perform frequency detection on the filtered mixed sound signal to obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal.
16. The device according to claim 15, wherein The detection module is used to: divide the filtered mixed sound signal into segments and pass it through multiple notches to obtain frequency amplitude change data under each notch, wherein the center frequencies of the multiple notches are the different frequencies; and obtain the positions of characteristic signals of different frequencies contained in the mixed sound signal based on the frequency amplitude change data under each notch and a predetermined amplitude change threshold.
17. The device according to claim 12, wherein Before the audio signal is mixed with characteristic signals of different frequencies to obtain multiple mixed signals, the device also includes a signal module for: determining the number of speakers of the multiple speakers in the distributed speaker system; obtaining a target number of characteristic signals of different frequencies from a preset signal set, where the target number is equal to the number of speakers.
18. The device according to claim 17, wherein The signal module is used to implement one of the following methods: randomly obtaining a target number of characteristic signals of different frequencies from a preset signal set; obtaining speaker information of the multiple speakers, and obtaining a characteristic signal of a frequency matching the speaker information of each speaker from the preset signal set, to obtain a target number of characteristic signals of different frequencies.
19. A storage medium, wherein: A computer program is stored thereon, and when the computer program is executed by a processor of a computer, the computer is caused to execute the method according to any one of claims 1 to 11.
20. An electronic device, wherein: include: a memory storing a computer program; A processor reads a computer program stored in a memory to execute the method according to any one of claims 1 to 11.
Citation Information
Patent Citations
Distributed sound system delay detection method and device, medium and electronic equipment
CN117998270A
Multi-channel audio system capable of tracking user and equipment with multi-channel audio system
CN106686520A
Setup method for audio reproducing system and apparatus therefor
JP1999243599A
Device and method for measuring delay time, and device and method for correcting delay time
JP2017122781A
Wireless audio system, controller, wireless speaker, and computer readable program
JP2017143357A