Acoustic distance ranging system

By transmitting and converting the frequency of an audio ranging signal in an audio system, and combining it with time conversion and sound speed calculation by the receiver, the inaccuracy and noise problems in distance measurement between devices in wireless audio systems are solved, achieving higher precision distance measurement.

CN116685867BActive Publication Date: 2026-11-17SHURE ACQUISITION HLDG INC
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202180088034.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-12-01
Filing Date
2021-12-01
Publication Date
2026-11-17
Estimated Expiration
2041-12-01

AI Technical Summary

Technical Problem

Existing wireless audio systems suffer from inaccurate measurements and introduce noise and distortion when determining the distance between devices, especially when using mechanical delay conversion.

Method used

The distance between the devices is calculated by transmitting and converting the frequency of an audio ranging signal using an audio transmitter, receiving the signal transition time using an audio receiver, and using the known speed of sound. This avoids noise and distortion introduced by mechanical delays, and the use of continuous phase conversion technology ensures measurement accuracy.

Benefits of technology

It enables more accurate and precise distance measurement between audio devices, reduces noise and distortion, and improves system performance.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN116685867B_ABST
    Figure CN116685867B_ABST
Patent Text Reader

Abstract

A wireless audio system configured to perform acoustic ranging operations is disclosed. The audio system includes an audio transmitter and an audio receiver, and is configured to determine the distance between the audio transmitter and the audio receiver.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Cross-citation of related applications

[0002] This application claims the benefit and priority of U.S. Provisional Patent Application No. 63 / 120,050, filed December 1, 2020, the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application generally relates to a wireless audio system comprising at least one audio transmitter and at least one audio receiver, and a method and system for measuring distance between devices in the audio system using acoustic signals. Background Technology

[0004] An audio system typically operates best when information about the spatial relationships between its devices is known. For example, the distances between speakers or audio output devices, microphones or audio input devices, and any other audio devices in the audio system can be used to model the environment. This model, and / or simply the distances between the devices themselves, can be used to adjust speakers, microphones, and / or other devices to make input and output signals clearer, less distorted, correctly positioned, and otherwise improved.

[0005] Therefore, there is an opportunity for a wireless audio system that enables accurate distance measurement between devices in the system. Summary of the Invention

[0006] This disclosure aims to describe and illustrate exemplary methods and systems for acoustic distance ranging. In one example, a method operable by an audio system includes transmitting an audio ranging signal having a first frequency by an audio transmitter at a first time point. The method further includes receiving the audio ranging signal having the first frequency by an audio receiver at a second time point. The method further includes switching the audio ranging signal from the first frequency to a second frequency by the audio transmitter at a third time point. The method still further includes receiving the switching of the audio ranging signal from the first frequency to the second frequency by the audio receiver at a fourth time point. The method further includes determining the distance between the audio transmitter and the audio receiver based on (1) the difference between the third time point and the fourth time point and (2) a determined speed of sound.

[0007] In another example, an audio system includes an audio transmitter configured to transmit an audio ranging signal. The audio system also includes an audio receiver configured to receive the audio ranging signal. The audio system further includes a processor communicatively coupled to the audio transmitter and the audio receiver. The processor is configured to cause the audio transmitter to transmit the audio ranging signal having a first frequency at a first time point. The processor is also configured to determine that the audio receiver has received the audio ranging signal having the first frequency at a second time point. The processor is further configured to cause the audio transmitter to switch the audio ranging signal from the first frequency to a second frequency at a third time point. The processor is further configured to determine that the audio receiver has received the switch of the audio ranging signal from the first frequency to the second frequency at a fourth time point. The processor is further configured to determine the distance between the audio transmitter and the audio receiver based on (1) the difference between the third and fourth time points and (2) the determined speed of sound.

[0008] In another example, a non-transitory computer-readable storage medium has instructions stored thereon that, when executed by a processor, cause the execution of a set of actions. The set of actions includes transmitting an audio ranging signal having a first frequency by an audio transmitter at a first time point. The set of actions also includes receiving the audio ranging signal having the first frequency by an audio receiver at a second time point. The set of actions further includes switching the audio ranging signal from the first frequency to a second frequency by the audio transmitter at a third time point. The set of actions further includes receiving the switching of the audio ranging signal from the first frequency to the second frequency by the audio receiver at a fourth time point. And the set of actions further includes determining the distance between the audio transmitter and the audio receiver based on (1) the difference between the third and fourth time points and (2) the determined speed of sound.

[0009] These and other embodiments, as well as various arrangements and aspects, will become apparent from and be more fully understood from the following detailed description and accompanying drawings, which illustrate illustrative embodiments in which the principles of the invention may be employed. Attached Figure Description

[0010] Figure 1 This is a simplified schematic diagram of a wireless audio system configured to perform acoustic distance ranging according to some embodiments.

[0011] Figure 2 This is a simplified schematic diagram of the timing of an example of an acoustic distance ranging operation involving an audio ranging signal that transitions between two frequencies, according to some embodiments.

[0012] Figure 3 It is an explanation and Figure 2 The flowchart of the instance methods related to the sequence diagram.

[0013] Figure 4 This is a simplified schematic diagram of the timing of an example of acoustic distance ranging operation involving an audio ranging signal that transitions between three frequencies, according to some embodiments.

[0014] Figure 5 It is an explanation and Figure 4 The flowchart of the instance methods related to the sequence diagram. Detailed Implementation

[0015] The following description illustrates, describes, and exemplifies one or more specific embodiments of the invention based on the principles of the invention. This specification is provided not to limit the invention to the embodiments described herein, but rather to explain and teach the principles of the invention in a manner that enables those skilled in the art to understand these principles, and by such understanding, to apply them not only to the practice of the embodiments described herein, but also to the practice of other embodiments that may conceive based on these principles. The scope of the invention is intended to cover all such embodiments that fall within the scope of the appended claims (both literally and under the principle of equivalence).

[0016] It should be noted that similar or substantially similar elements may be labeled with the same reference numerals in the description and accompanying drawings. However, sometimes these elements may be labeled with different numerals, for example, where such labeling facilitates a clearer description. Furthermore, the accompanying drawings set forth herein are not necessarily drawn to scale, and in some instances, the scale may have been exaggerated to more clearly depict certain features. Such labeling and drawing practice does not necessarily imply any underlying material purpose. As stated above, this specification is intended to be considered as a whole and to be interpreted in accordance with the principles of the invention taught herein, and to be understood by one of ordinary skill in the art.

[0017] Audio systems can be used in a variety of different contexts. In many contexts, such as a conference room, it may be beneficial to determine the exact distances between the devices of the audio system. For example, in the case where the audio system comprises multiple microphone arrays located around the conference room, it may be beneficial to ensure that they are properly spaced for optimal performance.

[0018] Furthermore, it may be beneficial to use existing hardware to determine the distance between devices. While laser ranging or other technologies can be used, they may require additional hardware and electronics to operate.

[0019] Embodiments of this disclosure enable the determination of distances between devices in an audio system using acoustic frequencies, thereby utilizing existing hardware of the devices. To determine the distance between a first device and a second device, one of the devices must be capable of functioning as an audio transmitter, and the other device must be capable of functioning as an audio receiver. The first and second devices may be referred to herein as an "audio transmitter" and an "audio receiver," or simply as "transmitter" and "receiver." In some instances, the audio transmitter may be configured to generate sound, and therefore may be referred to as a sound generating device.

[0020] In some instances, the system operates using a shared reference frame. One example of having a shared reference frame includes using a common clock or synchronization clock between devices. However, it should be understood that other techniques for having a shared reference frame can also be used, including those that do not include a common or synchronization clock.

[0021] In an example embodiment, the audio transmitter begins by initiating acoustic distance ranging operations. The audio transmitter begins transmitting an audio ranging signal at a first frequency. After a certain amount of time, the audio transmitter begins transitioning the audio ranging signal from the first frequency to a different second frequency. The audio receiver receives the audio ranging signal and processes the signal to determine when the transition from the first frequency to the second frequency occurs. The timing of the transition from the first frequency to the second frequency is an important metric for determining distance because it enables a more accurate measurement than other possibilities. Conversely, if the system were to use a single frequency, or if the audio transmitter were to transition from off to on at the first frequency, the additional mechanical delay of turning on the speaker introduces noise and / or distortion. This additional mechanical delay can also be variable, introducing unknown delays that result in reduced accuracy in any resulting distance measurement. Therefore, using a frequency transition while the audio transmitter is currently "on" achieves a more precise and accurate measurement because it does not introduce additional noise and / or distortion.

[0022] Then, by calculating the time it takes for the audio ranging signal to travel from the audio transmitter to the audio receiver, and based on the known speed of sound, the audio system can determine the distance between the two devices. Because the speed of sound is known within a small tolerance (e.g., the speed varies slightly based on temperature, pressure, etc.), the calculated travel time of the audio ranging signal from the audio transmitter to the audio receiver, measured in seconds, can be multiplied by the speed of sound, measured in meters per second, to determine the distance between the audio transmitter and the audio receiver, measured in meters. The above example results in distance measurements in meters; however, it should be understood that the units used can vary.

[0023] Figure 1An example audio system 100 operable according to embodiments of the present disclosure is described. The audio system 100 includes an audio transmitter 110 and an audio receiver 120. Additionally, the system may include a processor, access point, hub, or other connected devices. Furthermore, the processor, access point, and / or hub may be integrated with the audio transmitter 110 and / or audio receiver 120.

[0024] Audio transmitter 110 may include a loudspeaker, a loudspeaker array, and / or any device capable of emitting audible sound. The loudspeaker may be integrated into a larger device that may also include one or more microphones or other audio devices. Audio transmitter 110 may be configured to emit an audio ranging signal that can be used to determine the distance between audio transmitter 110 and audio receiver 120.

[0025] Audio receiver 120 may include a microphone, microphone array, and / or any device capable of receiving and detecting audible sound. The microphone may be integrated into a larger device that may also include one or more speakers or other audio devices. Audio receiver 120 may be configured to receive an audio ranging signal emitted by audio transmitter 110, which can be used to determine the distance between audio transmitter 110 and audio receiver 120.

[0026] A processor, which may be part of the audio transmitter 110 and the audio receiver 120, and / or separately but communicatively coupled to the audio transmitter 110 and the audio receiver 120, may be configured to perform one or more of the functions described herein. For example, the processor may initiate an acoustic distance ranging operation by controlling the audio transmitter 110 to begin transmitting an audio ranging signal. Furthermore, the processor may be configured to calculate the distance between the two devices using timing data determined by the audio transmitter 110 and the audio receiver 120. Additionally, the processor may be integrated with a user interface or communicatively coupled to a device including a user interface. The processor may receive commands and information from a user via this user interface to initiate the acoustic distance ranging operation, and / or provide the calculated distance to the user, and / or take various actions in response to the calculated distance.

[0027] It should be understood that the term "processor" as used herein should not be limited to any particular type or function. Any suitable processor or controller can be used, including digital signal processor (DSP) hardware, network processors, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), read-only memory (ROM) for storing software, random access memory (RAM), and non-volatile storage devices. Other hardware (conventional and / or custom) may also be included in the understanding of a processor herein. It should be further understood that while a single processor is referred to, multiple processors may be used to perform the functions described herein.

[0028] Figure 2 A simplified timing diagram illustrating the acoustic ranging operation is provided. In the timing diagram, events located further to the right occur later than those located to the left. Furthermore, the intervals between events are not necessarily proportional, but have been shown to reflect relative timing. The timing diagrams from points 202 to 218 illustrate some of the actions and events that occur during the acoustic ranging operation. Figure 2 The diagram illustrates that after the audio receiver receives an audio ranging signal at a first frequency, the audio transmitter switches from outputting an audio ranging signal at the first frequency to outputting an audio ranging signal at a second frequency. However, this sequence of events (e.g., the switch to the second frequency occurring after the audio receiver receives the first frequency audio ranging signal) is not necessarily required and is merely one example of such a sequence. In some embodiments, the audio transmitter may begin the switch from outputting the first frequency audio ranging signal to outputting the second frequency audio ranging signal before the audio receiver receives the first frequency audio ranging signal. The timing between the initial transmission of the first frequency audio ranging signal by the audio transmitter and the start of the switch to transmitting the second frequency audio ranging signal occurs or is controlled independently of the moment the audio receiver receives the first frequency audio ranging signal.

[0029] The initial steps (not shown) include determining when acoustic ranging operations should begin. This step may include receiving input via a user interface or communication interface that is part of or communicatively coupled to the audio transmitter 110 and / or audio receiver 120 (e.g., a hub or access point).

[0030] At point 202, the acoustic ranging operation includes determining that the audio transmitter should initiate the acoustic ranging operation by transmitting an audio ranging signal at a first frequency. Point 202 may be the time point at which the processor associated with the audio transmitter initiates the acoustic ranging operation and starts the internal audio transmitter process to begin transmitting the audio ranging signal.

[0031] At point 203, the acoustic ranging operation involves the audio transmitter initiating the transmission of an audio ranging signal at a first frequency. Point 203 may be referred to as the “first time point”, at which point the speaker of the audio transmitter begins physical movement to cause the audio ranging signal to be transmitted. The delay between points 202 and 203 (e.g., the delay between deciding to transmit the audio ranging signal and when the audio ranging signal is actually transmitted) is caused by the digital and analog hardware delays associated with the audio transmitter. The digital component of the audio transmitter delay includes buffering delay, while the analog component includes delays due to digital-to-analog conversion, filtering, and any other physical delays. The audio transmitter delay can vary between devices and / or across product lines. The audio transmitter delay can be determined based on manufacturing tolerances and / or based on the average delay from multiple devices of the same type. In some instances, a typical audio transmitter delay may be a few (e.g., 3) samples or fewer at 48 kHz.

[0032] During the time period between point 203 and point 213, the audio transmitter continues to transmit an audio ranging signal at the first frequency.

[0033] During the time period between point 203 and point 207, the audio ranging signal travels in the air between the audio transmitter and the audio receiver (e.g., audio ranging signal flight time).

[0034] At point 207, the audio receiver first receives the audio ranging signal transmitted by the audio transmitter. Point 207 may be referred to as the "second time point," at which the audio receiver receives the audio ranging signal having a first frequency.

[0035] At point 208, the acoustic ranging operation involves the audio receiver processing the audio ranging signal and first determining that an audio ranging signal of a first frequency has been received. The delay between points 207 and 208 (e.g., the delay between when the audio ranging signal is first received and when the audio receiver determines that the audio ranging signal has been received) is caused by digital and analog hardware delays associated with the audio receiver. Audio receiver delay may be due to the same or similar reasons as audio transmitter delay, including buffer delay, analog-to-digital conversion, filtering, etc. Audio receiver delay can vary between devices and / or across product lines. Audio receiver delay can be determined based on manufacturing tolerances and / or based on the average delay from multiple devices of the same type. In some instances, a typical audio receiver delay may be a few (e.g., 3) samples or fewer at 48 kHz.

[0036] At point 208, based on the determination that an audio ranging signal has been received, the audio receiver may take one or more actions in response. For example, in response to receiving and processing an audio ranging signal at a first frequency, the audio receiver may transmit a message indicating or verifying that an audio ranging process is occurring. The audio receiver may also enter an audio ranging state, in which the audio receiver takes one or more actions to prepare for receiving an upcoming transition of the audio ranging signal from the first frequency to a second frequency. The audio ranging state may also include preparing to calculate or determine the distance between the audio transmitter and the audio receiver based on one or more calculated or estimated time points. The audio ranging state may also include preparing to transmit data to one or more devices, such as: an audio transmitter, a hub or access point, a device including a user interface configured for interaction with a user, or another device.

[0037] At point 212, the audio ranging operation may further include the audio transmitter determining to switch the currently transmitted audio ranging signal from a first frequency to a second frequency. The second frequency must be different from the first frequency. The duration between points 202 and 212 (e.g., the duration for which the audio transmitter transmits the audio ranging signal at the first frequency) may be a preset duration. For example, the duration between points 202 and 212 may be any suitable duration based on the amount of delay or timing of certain events associated with the operation of the system. Various delays associated with the system may include: (1) an internal delay associated with the audio transmitter, (2) an external delay associated with the audio receiver, and (3) the delay or duration required for the audio ranging signal to traverse the distance between the devices. The internal audio transmitter delay may be approximately 150 μs. The internal audio receiver delay may be on the same order of magnitude as the internal transmitter delay and / or substantially smaller. The duration between points 202 and 212 may be selected or set such that it is greater than the combined internal audio transmitter delay, internal audio receiver delay, and the duration required to traverse the distance between the devices.

[0038] At point 213, the audio ranging operation includes the audio transmitter switching the transmitted audio ranging signal from a first frequency to a second frequency. Step 213 can be a "third time point" at which the audio transmitter begins transmitting the audio ranging signal switching from the first frequency to the second frequency. The delay between points 212 and 213 can be similar to or the same as the delay between points 202 and 203, wherein the delay is based on the digital and analog delays associated with the audio transmitter.

[0039] In some instances, switching the audio ranging signal from a first frequency to a second frequency involves causing the output of the audio transmitter to begin switching from outputting an audio ranging signal at the first frequency to outputting an audio ranging signal at the second frequency at a third time point. Even if the determination of the start of the switch occurs at point 212, the internal delay associated with the audio transmitter may cause the transmission of the switch to begin at point 213.

[0040] In some instances, the transition of the audio ranging signal from a first frequency to a second frequency can be performed in a phase-continuous manner. A phase-continuous transition may involve the transmitter switching from transmitting an audio ranging signal at the first frequency to transmitting an audio ranging signal at the second frequency when the first frequency crosses zero, thus ensuring that the phase of the output audio ranging signal remains the same when the transmitter switches the output frequency from the first frequency to the second frequency. Performing the transition in a phase-continuous manner, rather than introducing abrupt changes or some other type of transition in the phase of the output audio ranging signal, allows the system to maintain quasi-steady-state operation by using continuous energy. Audio receiver detection methods used to determine that they have received an audio ranging signal can rely on this continuous energy (e.g., by using one or more resonators), thus making a phase-continuous transition preferable. If a non-phase-continuous transition were to be used instead, the audio ranging signal could contain additional noise and / or artifacts (e.g., discontinuities), which reduces the audio receiver's ability to accurately determine the timing of the transition. This reduced accuracy of the audio receiver will then translate into reduced accuracy in determining the distance between the audio transmitter and the audio receiver.

[0041] During the duration between points 213 and 217, the audio ranging signal transition can traverse the distance between the audio transmitter and the audio receiver. This duration is an important metric for determining the distance between the two devices.

[0042] At point 217, the audio receiver begins to receive the transition of the audio ranging signal from the first frequency to the second frequency. Point 217 may be referred to as the "fourth time point," at which the audio receiver receives the transition of the audio ranging signal from the first frequency to the second frequency.

[0043] At point 218, the acoustic ranging operation may involve the audio receiver processing the transition of the audio ranging signal and determining that the received audio ranging signal has transitioned from a first frequency to a second frequency. The delay between points 217 and 218 may be the same as the delay between points 207 and 208 discussed above. Alternatively, the delay between points 217 and 218 may be different. For example, if the audio receiver enters the audio ranging state at point 208, then a portion of the audio ranging state may include the audio receiver preparing to receive the transition of the audio ranging signal, thereby reducing the internal delay of the detection performed by the audio receiver.

[0044] refer to Figure 2 The points described in the audio ranging operation may be directly measurable (e.g., the timing associated with these points may be directly measurable), while others may only be estimable. Specifically, points 202, 208, 212, and 218 may be directly measured or determined based on the audio transmitter and audio receiver processor and their use of a common or synchronous clock. Figure 2 Each point described herein may have an associated timestamp based on a common or synchronous clock, which can be used to determine the time or duration between any two given points. These times or durations can then be used to perform one or more calculations or determinations as described in detail herein. Timestamps associated with the determination to begin transmitting an audio ranging signal (e.g., point 202) and the determination to begin transitioning the audio ranging signal to a second frequency (e.g., point 212) can be determined directly. Furthermore, timestamps associated with the determination to have received an audio ranging signal (e.g., point 208) and the determination to have received a transition in the audio ranging signal (e.g., point 218) can also be determined directly.

[0045] Conversely, there may not be directly determinable timestamps associated with the actual time point when the audio transmitter begins transmitting the audio ranging signal (e.g., point 203), the time point when the audio receiver begins receiving the audio ranging signal (e.g., point 207), the transition time point when the audio transmitter begins transmitting the audio ranging signal (e.g., point 213), and the transition time point when the audio receiver begins receiving the audio ranging signal (e.g., point 217). In addition to the known delays associated with the audio transmitter and audio receiver, the precise timing of points 203, 207, 213, and 217 can also be indirectly determined based on directly determinable time points (e.g., points 202, 208, 212, and 218).

[0046] Using these principles, a first time point (point 203) at which the transmitter begins transmitting an audio ranging signal at a first frequency can be determined based on the known timing of point 202 and the known audio transmitter delay. Point 203 can be determined by adding the known internal transmitter delay to the timestamp associated with point 202. Similarly, a second time point (point 207) at which the audio receiver begins receiving the audio ranging signal can be determined based on the known timing of point 208 and the known audio receiver delay. Point 207 can be determined by subtracting the known internal receiver delay from the timestamp associated with point 208. A third time point (point 213) at which the audio transmitter begins transmitting the audio ranging signal can be determined based on the known timing of point 212 and the known audio transmitter delay. Point 213 can be determined by adding the known internal transmitter delay to the timestamp associated with point 212. Furthermore, a fourth time point (point 217) at which the audio receiver begins receiving the audio ranging signal can be determined based on the known timing of point 218 and the known audio receiver delay. Point 217 can be determined by subtracting the known internal receiver delay from the timestamp associated with point 218.

[0047] After point 218, the system can be configured to determine a distance 130 between the audio transmitter 110 and the audio receiver 120. Distance 130 can be determined based on (1) the time difference between a third and a fourth time point (e.g., 217 to 213, or the flight time of the audio ranging signal) and (2) the determined speed of sound. In some instances, the distance can be determined by the audio receiver itself. In other instances, the distance can be determined by the audio transmitter, by a hub or access point, or by some other communication-coupled device. In some embodiments, the system can be configured to provide a distance estimate from 0 to 20 feet with an accuracy of approximately 0.5 inches. In cases where interference from external or internal noise sources is present, the distance estimation accuracy can be reduced to approximately 3.3 inches. It should be understood that these values ​​are merely examples, and other embodiments may have increased or decreased distance measurement ranges and accuracy.

[0048] In some instances, the calculated distance can be used for one or more purposes. For example, system 100 may use the calculated distance to: (1) determine the maximum allowable gain before feedback occurs (e.g., the highest gain that can be applied to the output audio signal, where applying a gain higher than the maximum gain results in feedback), (2) prompt the user to reposition one or more of the devices, (3) provide a distance indication to the user via a user interface, (4) modify an algorithm or program executed by one or more of the devices, (5) adjust or modify the directivity of a speaker or microphone array, and (6) when the system includes ceiling-mounted or wall-mounted microphones, for example, the system may estimate the distance and orientation of the speaker relative to the microphone to allow null-shifting of the microphone array (to reduce echo, speaker noise, etc.). Null-shifting may include causing the microphone pickup pattern to avoid picking up audio from a specific area, and / or reducing or removing audio picked up by the microphone via the null-shifting beam.

[0049] In some instances, audio system 100 may be part of a larger audio system or “ecosystem” that includes one or more loudspeakers, loudspeaker arrays, beamforming systems, microphones, microphone arrays, digital signal processors (DSPs), mixers, and / or other components. One or more of the components may be coupled to each other via wired or wireless communication paths. Loudspeakers and / or microphones may be standalone loudspeakers or microphones, or standalone loudspeaker arrays or microphone arrays. Alternatively, loudspeakers and / or microphones may be part of a multipurpose component that may include the functionality of another component of the ecosystem. In some embodiments, the microphones of the ecosystem may provide improved performance, including minimizing crosstalk and acoustic echo cancellation (AEC) through higher source-receiver isolation. In some embodiments, the ecosystem may be configured to simultaneously produce multiple individual audio outputs using various loudspeakers or combinations of loudspeakers, and direct each audio output toward a designated location or audience.

[0050] Ecosystems can be used in open-plan office environments, conference rooms, museums, performance stages, airports, and many other environments. Acoustic distance measurement operations can be performed within an ecosystem to execute one or more of the actions described herein, such as modifying the gain associated with a specific ecosystem element, prompting the user to reposition the ecosystem element, etc.

[0051] In some instances, acoustic distance ranging can be performed on multiple different devices within the same system (or ecosystem). Additional actions are also possible in these cases. For example, when the system includes a desktop speaker equipped with two or more microphone arrays (e.g., for use in a conference room), distance calculations can be used to determine appropriate inter-array spacing by indicating that two arrays are too close to each other. Furthermore, when the system contains multiple similarly oriented microphone arrays, the system can use a speaker (e.g., an audio transmitter) to calculate the distance between the speaker and each microphone array, enabling mapping the placement of each microphone array and speaker. If the arrays are not similarly oriented, the same calculations can be performed by inputting knowledge of the orientation of each microphone array (e.g., by the user, or by gathering additional information from one or more other sources). Similarly oriented arrays may exist in cases where the system includes a square or rectangular ceiling-mounted array oriented in one of four different directions. If the system does not include ceiling-mounted form factors, orientation can be determined based on sequential orientation.

[0052] In some instances, the audio transmitter and audio receiver both operate or share a common clock for measuring and... Figure 2 The time associated with each point shown in the diagram. The public clock may take the form of Precision Time Protocol (PTP), Network Time Protocol (NTP), NTC, Dante, or another public clock mechanism or technology.

[0053] In some instances, as mentioned above, the system operates by transmitting an audio ranging signal at a first frequency and then transitioning the audio ranging signal to a second frequency. The timing associated with the transition of the audio ranging signal is then used to determine the time of flight between devices. One advantage of using the method described herein is that transmitting an audio ranging signal at a first frequency and transitioning to a second frequency allows the audio ranging signal to be transmitted above a noise floor in the environment in which the system is used. If, instead of the method used herein, the system only uses the transition of the audio ranging signal from off to on, then the noise floor can cause problems. For example, the receiver may incorrectly determine that an audio ranging signal has been received and / or may be inaccurate in determining when the audio ranging signal is turned on. Conversely, using the method of this disclosure, the audio receiver can more easily determine that audio ranging operation is in progress because detecting the transition of the audio ranging signal from the first frequency to the second frequency is easier than detecting the transition from no audio ranging signal to any given audio ranging signal. Due to the known first and second frequencies and the ability to avoid dealing with noise floor, the method of this disclosure also requires less complexity and processing power. Furthermore, the use of measurement points for ranging calculations, or transitions in the audio ranging signal used for measurement purposes (rather than simply the start of an audio ranging signal being emitted), results in reduced time transients. For example, time transients occur when a signal is suddenly switched on, causing the signal amplitude to oscillate above and below the desired steady-state response. Using the method of this disclosure, which includes having the audio transmitter emit an audio ranging signal as it transitions from a first frequency to a second frequency, the transmitter does not transition from an off state to an on state, and therefore there is no time transient introduced by the transition from the transmitter's off to on state. Specifically, the audio transmitter remains in the on state and only transitions from one frequency to another. By remaining in the on state, the transmitter's speaker is already in motion when the frequency transition occurs, thereby removing the additional mechanical delay required to transition the speaker from the off state to the on state and allowing for more accurate and precise measurements.

[0054] In some instances, the first and second frequencies can be in the range of 20 Hz to 20 kHz. This range corresponds to the usable range of many loudspeakers, and therefore the system does not require new dedicated hardware to operate. In some instances, the first and second frequencies can be in the range of 1 kHz to 2 kHz. For example, the first frequency could be 1 kHz and the second frequency could be 2 kHz. Frequencies in this range are likely preferred due to relatively low interference, high signal-to-noise ratio, and uniform sound pressure level. Specifically, very low frequencies are avoided due to the possibility of signal interference and contamination as it travels through the air. Furthermore, low-mid frequencies are likely preferred because they offer a better trade-off in their dispersion mode by providing a less directional signal, which ensures or improves the linearity of the audio transmitter and receiver.

[0055] It should be understood that although specific frequencies are listed, any frequency that can be emitted as a sound wave by an audio transmitter and received by an audio receiver can be used. Furthermore, while this disclosure discusses examples with respect to the first and second frequencies, each of the first and second frequencies may include multiple frequencies emitted together, rather than a single tone. However, as mentioned in the examples above, the first and second frequencies may be a single frequency or tone.

[0056] Figure 3 A flowchart illustrating an example method 300 according to an embodiment of the present disclosure is provided. Method 300 enables the operation of an audio system to determine the distance between two or more devices of the system. Figure 3 The flowchart represents machine-readable instructions stored in memory and may include one or more programs that, when executed by a processor, cause one or more computing devices and / or systems to perform one or more functions described herein. Although references... Figure 3 The flowcharts described herein illustrate an example program, but many other methods can be used alternatively to perform the functions described herein. For example, the execution order of the boxes can be rearranged or executed sequentially or in parallel, and boxes can be changed, eliminated, and / or combined to perform method 300. Furthermore, since method 300 is a combination of... Figures 1 to 2 The components are public, so some of their functionalities will not be described in detail below.

[0057] Method 300 may begin at box 302. At box 304, method 300 may include initiating acoustic ranging operations. This may be performed by a user via the user interface of the audio system, or it may be performed automatically by the audio system or based on some other trigger.

[0058] At block 306, method 300 may include transmitting an audio ranging signal having a first frequency by an audio transmitter of an audio system at a first time point. At block 308, method 300 may include receiving the audio ranging signal having the first frequency by an audio receiver of the audio system at a second time point. At block 310, method 300 may include switching the audio ranging signal from the first frequency to a second frequency by the audio transmitter at a third time point. At block 312, method 300 may include receiving the switch of the audio ranging signal from the first frequency to the second frequency by the audio receiver at a fourth time point. At block 314, method 300 may include determining the distance between the audio transmitter and the audio receiver. The distance may be determined based on (1) the difference between the third and fourth time points and (2) the determined speed of sound. It should be understood that various actions, such as those mentioned above, may be taken by one or more devices of the audio system based on the determined distance. Method 300 may then end at block 316.

[0059] Figure 3The method describes how, after an audio ranging signal of a first frequency is received by an audio receiver, the audio transmitter switches from outputting an audio ranging signal of the first frequency to outputting an audio ranging signal of the second frequency. However, the order of events mentioned above is not necessarily required and is merely one example of such an order. In some embodiments, the audio transmitter may begin the transition from outputting an audio ranging signal of the first frequency to outputting an audio ranging signal of the second frequency before the audio receiver receives the audio ranging signal of the first frequency. The timing between the initial transmission of the audio ranging signal of the first frequency by the audio transmitter and the start of the transition to the audio ranging signal of the second frequency occurs or is controlled independently of the time when the audio receiver receives the audio ranging signal of the first frequency.

[0060] Figure 4 A simplified schematic diagram illustrating the timing of an example of the second acoustic distance ranging operation. Figure 4 The second acoustic distance ranging operation described herein may be related to Figure 2 The examples shown are similar or identical. Figure 4 The instance 400 shown may include those not included in Figure 2 One or more additional steps or features in the example 200 shown in the document.

[0061] As mentioned above, using Figure 2 The acoustic distance ranging operation shown can determine the distance between the transmitter and receiver based on the timing associated with the transmission of an audio ranging signal at a first frequency and the transition to an audio ranging signal at a second frequency. In some cases, the accuracy of distance determination using only the first frequency and the transition to the second frequency may be limited. Accuracy limitations may be based on the receiver's limitations in detecting the audio ranging signal at the first frequency and the transition to the second frequency. In other words, the methods and techniques used to detect the audio ranging signal at the first frequency and the transition to the second frequency introduce a lower limit to the resolution of distance calculation.

[0062] To improve the resolution of distance calculations relative to the first acoustic distance ranging operation discussed above, various systems can utilize a second acoustic distance ranging operation. Figure 4A second timing diagram 400 illustrates certain events occurring during the second acoustic distance ranging operation. Points 402, 403, 407, 408, 412, 413, 417, and 418 may be similar to or identical to points 202, 203, 207, 208, 212, 213, 217, and 218 discussed in detail above. Specifically, the transmitter may decide to transmit an audio ranging signal of the first frequency at point 402 and begin transmitting the audio ranging signal of the first frequency at point 403 (due to the internal transmitter delay between points 402 and 403). The receiver may begin receiving the audio ranging signal of the first frequency at point 407 and, after an internal receiver delay, determine that the audio ranging signal of the first frequency has been received at point 408. The transmitter can then decide to switch to transmitting an audio ranging signal at a second frequency at point 212, and actually begin transmitting the second frequency audio ranging signal at point 413 (due to the internal transmitter delay between points 412 and 413). At point 417, the receiver can begin receiving the transition of the audio ranging signal to the second frequency, and the transition can be detected by the receiver at point 418 (due to the internal receiver delay between points 417 and 418).

[0063] Up to point 418, the first timing diagram 200 is identical to the second timing diagram 400. The second timing diagram illustrates the further transition from transmitting the second frequency audio ranging signal to transmitting the third frequency audio ranging signal after a known duration of transmission. At point 422, the transmitter decides to begin transitioning to transmitting the third frequency audio ranging signal. At point 423, the transmitter actually begins transmitting the third frequency audio ranging signal (due to the internal transmitter delay between points 422 and 423). Then, at point 427, the receiver begins receiving the third frequency audio ranging signal. And at point 428, the receiver confirms that it is receiving the third frequency audio ranging signal (due to the internal receiver delay between points 427 and 428).

[0064] The second timing diagram 400 illustrates the existence of two separate pairs of measurements that can be used to determine the time of flight (TOF) between the audio transmitter and the audio receiver, and therefore two separate calculations that can be used to determine the distance between them. These two pairs of measurements correspond to the duration between points 413 and 417 (in Figure 4 (1) Marked as the first TOF measurement), and (2) the duration between points 423 and 427 (marked as the second TOF measurement).

[0065] Furthermore, by transmitting an audio ranging signal at a second frequency for a known duration (e.g., the duration from point 412 to point 422 or from point 413 to point 423, assuming the transmitter delay is substantially constant), the system can compare the known duration with the actually measured duration (e.g., the duration from point 418 to point 428). If there is consistency between the known duration and the measured duration, then the system can be confident that there is no error in determining the timing of the detection of the transition of the audio ranging signal from the first frequency to the second frequency and from the second frequency to the third frequency.

[0066] However, if an inconsistency exists, it indicates an error in determining the time corresponding to the transition from the audio ranging signal to the second frequency (e.g., point 418) or the transition from the audio ranging signal to the third frequency (e.g., point 428). The system can then correct for this error in the measurement (discussed in further detail below), thereby improving the resolution of distance measurements taken using these time points.

[0067] The selection of the first, second, and third frequencies (specifically the second and third frequencies) enables the differentiation of possible combinations of errors associated with the measured duration of the transmission of the audio ranging signal at the second frequency. The specific selection of the second and third frequencies allows for the determination of whether the measurement of point 418, point 428, or both contains errors, and also allows for the determination of appropriate corrections.

[0068] Detecting the time points at which the audio ranging signal transitions to a second and / or third frequency occurs (e.g., points 418 and 428) may involve the use of one or more resonators. Specifically, focusing on the transition to the second frequency, when the receiver begins receiving the audio ranging signal at the second frequency, the resonator (which can be tuned to the second frequency) can begin to exponentially increase the signal output. However, due to noise, interference, and other influences, there may not be sufficient confidence or clarity regarding the specific time point at which the audio ranging signal at the second frequency emitted by the transmitter is first picked up by the receiver. To determine that the audio ranging signal at the second frequency has indeed been received (and is not merely noise or interference), the receiver can look for specific increases over some cycles, samples, or wavelengths of the second frequency (e.g., four consecutively increasing peaks in a line) and then recall the time point at which the exponential growth began. The resonator signal can be filtered to obtain absolute values, meaning that consecutive peaks in the signal are separated by half a wavelength. Operating as described above allows the system to determine with sufficient confidence that an audio ranging signal of the second frequency has been received within a defined half-wavelength, and at what specific time the audio ranging signal was received. However, due to the deterministic nature of the resonator signal, an error equal to + / - half-wavelength of the second frequency can be introduced. This error is introduced because noise in the resonator may make it unclear which of two consecutive peaks (separated by half a wavelength) marks the beginning of receiving the audio ranging signal of the second frequency.

[0069] Uncertainties in these detections mean that the measured duration of the transmission of the second frequency audio ranging signal (e.g., the difference between points 418 and 428) may contain one of nine possible combinations of errors, such as (a) determining that point 418 is deviated from +1 / 2 wavelength, correctly, and deviated from -1 / 2 wavelength, and (b) determining that point 428 is deviated from +1 / 2 wavelength, correctly, and deviated from -1 / 2 wavelength, one of nine permutations.

[0070] The selection of the first, second, and third frequencies (and specifically the second and third) allows for differentiation among nine possible combinations of errors. The frequencies can also be selected based on their sensitivity or resilience to local noise sources (e.g., HVAC, lighting, etc.). Furthermore, the first, second, and third frequencies, as well as the sampling rate, can be selected such that each frequency has half a wavelength as an integer number of samples. In one example, the first, second, and third frequencies can be in the range of 20 Hz to 20 kHz. In a specific example, the first frequency can be 1 kHz, the second frequency can be 2 kHz, and the third frequency can be 800 Hz.

[0071] In one instance, the second and third frequencies can be selected such that they have half wavelengths of M and N samples, respectively. These frequencies can be selected such that each of the nine possible error combinations has a different value, wherein the nine combinations may include any of the following: (1) -M, -N; (2) -M, 0; (3) -M, +N; (4) 0, -N; (5) 0, 0; (6) 0, +N; (7) +M, -N; (8) +M, 0; (9) +M, +N.

[0072] Since only one of nine error combinations can occur at a time (i.e., it is differentiated based on the selected frequency), the system can correct for errors in the measurement. In practice, since the frequency is known, determining the appropriate correction to be applied may involve looking up the measured duration of the transmission of the audio ranging signal at the second frequency (e.g., the difference between point 428 and point 418) in a lookup table that includes the expected duration plus each of the nine possible errors, and determining which one is the best fit. If the expected duration is, for example, 1 second, then the lookup table may include nine different durations clustered around 1 second. Assuming that the error in each measurement of 418 or 428 deviates at most from 1 / 2 of the corresponding wavelength of the second and third frequencies, the measured duration will be close to or equal to one of these nine possible durations.

[0073] Once the error is known, the system can then determine the precise times when points 417 and 427 occur, taking the determined correction into account. The system then has two separate time-of-flight measurements, which can be used to determine the distance between the transmitter and receiver. The first time-of-flight measurement is between points 413 and 417, and the second time-of-flight measurement is between points 423 and 427. These durations, along with the speed of sound, can then be used to determine the distance between the transmitter and receiver.

[0074] Figure 5 A flowchart illustrating an example method 500 according to an embodiment of the present disclosure is provided. Method 500 enables the operation of an audio system to determine the distance between two or more devices of the system. Figure 5 The flowchart represents machine-readable instructions stored in memory and may include one or more programs that, when executed by a processor, cause one or more computing devices and / or systems to perform one or more functions described herein. Although references... Figure 5 The flowcharts described herein illustrate an example program, but alternatively, many other methods can be used to perform the functions described herein. For example, the execution order of the boxes can be rearranged or executed sequentially or in parallel, and boxes can be changed, eliminated, and / or combined to perform method 500. Furthermore, since method 500 is a combination of... Figures 1 to 4 The components are public, so some of their functionalities will not be described in detail below.

[0075] Method 500 may be similar to or the same as method 300 in one or more respects. For example, boxes 502, 504, 506, 508, 510 and 512 may be similar to or the same as boxes 302, 304, 306, 308, 310 and 312 discussed above.

[0076] At block 514, method 500 may include switching the audio ranging signal from a second frequency to a third frequency at a fifth time point. At block 516, method 500 may include a receiver receiving the switching of the audio ranging signal from the second frequency to the third frequency at a sixth time point.

[0077] At block 518, method 500 may include determining whether an error exists in the following measurements: (1) the time when the audio ranging signal is received by the receiver from a first frequency to a second frequency, and (2) the time when the audio ranging signal is received by the receiver from a second frequency to a third frequency.

[0078] At box 520, the method may include determining the distance between an audio transmitter and an audio receiver. The distance determination may be based on one or more of the following: (1) the time when the transmitter begins transmitting the audio ranging signal from a first frequency to a second frequency, (2) the time when the transmitter begins transmitting the audio ranging signal from a second frequency to a third frequency, (3) the measured time when the receiver receives the audio ranging signal from the first frequency to the second frequency, (4) the measured time when the receiver receives the audio ranging signal from the second frequency to the third frequency, (5) an error determined in the measurement of when the receiver receives the audio ranging signal from the first frequency to the second frequency, (6) an error determined in the measurement of when the receiver receives the audio ranging signal from the second frequency to the third frequency, and (7) the speed of sound. The method 500 may then end at box 522.

[0079] Any process description or box in the figure should be understood as representing a module, fragment, or portion of code that includes one or more executable instructions for implementing a specific logical function or step in the process, and alternative implementations are included within the scope of the embodiments of the invention, wherein, depending on the function involved, the function may not be performed in the order shown or discussed, including generally simultaneous or reverse order, as will be understood by one of ordinary skill in the art.

[0080] This disclosure is intended to explain how various embodiments can be made and used according to the present technology, and not to limit its true, intended, and fair scope and spirit. The foregoing description is not intended to be exhaustive or limited to the precise forms disclosed. In view of the foregoing teachings, modifications or variations are possible. The embodiments were chosen and described to provide the best illustration of the principles of the described technology and its practical application, and to enable those skilled in the art to utilize the described technology in various embodiments and in combination with various modifications suitable for the particular purpose considered. All such modifications and variations, when interpreted according to their fair, lawful, and justly conferred scope, are within the scope of the embodiments that can be modified during the pending period of this patent application and all its equivalents, as defined by the appended claims.

Claims

1. A method comprising: The audio transmitter and receiver are operated using a common clock. The audio transmitter switches the audio ranging signal from a first frequency to a second frequency in a phase-continuous manner at a first time point and maintains it at the second frequency for a predetermined duration. At a second time point, the audio ranging signal is received by the audio receiver and changes from the first frequency to the second frequency and remains at the second frequency; Based on (1) the difference between the first time point and the second time point and (2) the speed of sound determined, the distance between the audio transmitter and the audio receiver is determined; The audio ranging signal is switched from the second frequency to the third frequency by the audio transmitter in a phase-continuous manner at a third time point and maintained at the third frequency; At the fourth time point, the audio ranging signal is received by the audio receiver and transitions from the second frequency to the third frequency and remains at the third frequency; and Correcting the distance between the audio transmitter and the audio receiver to a modified distance includes: The duration of the transition of the audio ranging signal at the second frequency is measured, the duration including the difference between the fourth time point and the second time point; A correction to the distance is determined based on a comparison between the measured duration and the predetermined duration; and Based on the correction, the distance is updated to the modified distance.

2. The method of claim 1, wherein the distance between the audio transmitter and the audio receiver is further determined based on the following: The transmitter hardware delay associated with the audio transmitter; and Receiver hardware delay associated with the audio receiver.

3. The method according to claim 1, further comprising: The maximum gain is determined based on the determined distance between the audio transmitter and the audio receiver; feedback occurs if the gain exceeds the maximum gain. and The gain of the audio transmitter is modified based on the determined maximum gain.

4. The method of claim 1, wherein the audio receiver comprises an audio receiver array, and the method further comprises modifying a lobe diagram of the audio receiver array based on the determined distance between the audio transmitter and the audio receiver to achieve null-point turning relative to the audio transmitter.

5. The method of claim 1, wherein receiving the audio ranging signal transitioning from the first frequency to the second frequency comprises: The audio ranging signal that transitions from the first frequency to the second frequency is detected using the resonator of the audio receiver.

6. A method of operating an audio transmitter, the method comprising: The audio transmitter and audio receiver are operated using a common clock. The audio transmitter transmits an audio ranging signal having a first frequency to the audio receiver; The audio ranging signal is switched from the first frequency to the second frequency in a phase-continuous manner at a first time point and held at the second frequency for a predetermined duration, wherein the audio receiver receives the audio ranging signal switched from the first frequency to the second frequency and held at the second frequency at a second time point, and the distance between the audio transmitter and the audio receiver can be determined based on (1) the difference between the first time point and the second time point and (2) the determined speed of sound. At a third time point, the audio ranging signal is transitioned from the second frequency to the third frequency and maintained at the third frequency in a phase-continuous manner, wherein the audio receiver receives the audio ranging signal transitioned from the second frequency to the third frequency and maintained at the third frequency at a fourth time point, and wherein the distance is corrected to a modified distance based on comparing the predetermined duration with a measured duration including the difference between the fourth time point and the second time point.

7. The method of claim 6, wherein the distance between the audio transmitter and the audio receiver is further determined based on the transmitter hardware delay associated with the audio transmitter.

8. The method of claim 6, further comprising: The maximum gain is determined based on the distance between the audio transmitter and the audio receiver; feedback occurs if the gain exceeds the maximum gain. and The gain of the audio transmitter is modified based on the determined maximum gain.

9. The method of claim 6, wherein the first frequency and the second frequency are in the range of 1 kHz to 2 kHz.

10. The method of claim 6, wherein the audio ranging signal transitioning from the first frequency to the second frequency is detected by the audio receiver at the second time point using a resonator.

11. A method of operating an audio receiver, the method comprising: The audio receiver and audio transmitter are operated using a common clock. The audio receiver receives an audio ranging signal with a first frequency emitted by the audio transmitter; and After the audio transmitter transmits the audio ranging signal at a first time point in a phase-continuous manner from the first frequency to the second frequency and maintains it at the second frequency for a predetermined duration, the audio receiver receives the audio ranging signal at a second time point in the transition from the first frequency to the second frequency and maintains it at the second frequency, wherein the distance between the audio transmitter and the audio receiver can be determined based on (1) the difference between the first time point and the second time point and (2) the determined speed of sound; After the audio ranging signal is transmitted by the audio transmitter at a third time point in a phase-continuous manner from the second frequency to the third frequency and maintained at the third frequency, the audio receiver receives the audio ranging signal at a fourth time point in the same manner, wherein the distance is corrected to a modified distance based on a comparison of the predetermined duration with a measured duration including the difference between the fourth time point and the second time point.

12. The method of claim 11, wherein the distance between the audio transmitter and the audio receiver is further determined based on receiver hardware latency associated with the audio receiver.

13. The method of claim 11, wherein the audio receiver comprises an audio receiver array, and the method further comprises modifying the directivity of the audio receiver array based on the determined distance between the audio transmitter and the audio receiver.

14. The method of claim 11, wherein the audio receiver comprises an audio receiver array, and the method further comprises modifying a lobe diagram of the audio receiver array based on the determined distance between the audio transmitter and the audio receiver to achieve null-point turning relative to the audio transmitter.

15. The method of claim 11, wherein receiving the transition of the audio ranging signal from the first frequency to the second frequency comprises detecting the transition using a resonator of the audio receiver.

Citation Information

Patent Citations

  • Ultrasonic echo frontier inspection based on modulation domain measurement

    CN101029932A

  • Acoustic suppression using ancillary RF link

    CN102257750A

  • Method and device for distance measurement (separation measurement)

    DE3800800A1

  • Sound ranging system

    WO2013088281A1

  • Apparatus, system, and method for detecting physiological movement from audio and multimodal signals

    WO2018050913A1