Dynamically determining volume balance in multi-channel audio system

Abstract

The disclosed embodiments include techniques for balancing volume in a multi-channel audio system. The techniques include determining, for each speaker of a plurality of speakers of an audio system, an amplitude-distance value of a plurality of amplitude-distance values, wherein the amplitude-distance value determined for the speaker is based on an amplitude of a first tone detected by the microphone and a distance value determined based on a pair of second tones detected by the microphone. The techniques further include identifying a minimum amplitude-distance value of the plurality of amplitude-distance values. The techniques further include, for each speaker of the plurality of speakers, determining a gain factor for the speaker based on a ratio of the minimum amplitude-distance value to the amplitude-distance value determined for the speaker. The techniques further include adjusting a volume level for each speaker based on the gain factor determined for the speaker.

Description

Technical Field

[0001] Embodiments of this disclosure generally relate to audio processing systems, and more specifically, to techniques for dynamically determining volume balance in a multi-channel audio system. Background Technology

[0002] Entertainment systems (such as audio / video systems implemented in cinemas, high-end home theaters, and music venues) continue to deliver increasingly immersive experiences, including high-resolution video and multi-channel audio tracks. For example, commercial cinema systems typically utilize multiple distinct audio channels, which are transmitted to individual speakers placed in front of, behind, and to the sides of the listener. Such audio / video systems may also include audio channels transmitted to individual speakers located above and below the listener. As a result, the listener experiences a fully immersive, three-dimensional (3D) sound field that surrounds them.

[0003] Audio content (such as audio tracks) can include multiple audio tracks with desired relative volume levels. For example, tracks of audio content may have the same relative volume level. A set of relative volume levels is typically adjusted to create a desired volume balance between audio channels. To reproduce audio content, an audio system sends sound data based on each audio track to the corresponding speakers via the respective audio channels. The configuration of a particular audio system (such as the location and characteristics of the speakers) can affect the sound field heard by the listener. Therefore, to accurately reproduce audio content, the audio system adjusts the volume balance between audio channels so that the listener hears the track of the content with the desired audio balance via the audio channels. For example, to achieve the desired audio volume balance where tracks have the same relative volume level, the audio system adjusts the volume balance between audio channels so that the listener hears the track with the same relative volume level.

[0004] Multi-channel audio systems often employ various techniques to adjust volume balance. One such technique involves adjusting the volume level of sound data transmitted via audio channels to an appropriate target volume level. For example, an audio system can set the volume level of each audio channel to a target volume level by configuring the audio source to generate audio signals with specific volume levels for each audio channel. The target volume level is determined so that the listener hears the audio track at the desired volume level.

[0005] Human users can use digital audio workstations or other applications that support multichannel mixing. With a digital audio workstation, users can adjust the level of each individual audio source on each channel and use panning and other effects to adjust the balance between channels. This technique involves manually adjusting fader and panning controls in the digital audio workstation interface. As an alternative to a digital audio workstation, a mixing console can be used by human users to adjust the levels and panning of multiple audio sources on individual channels. As another alternative, digital signal processing tools can be used by human users to dynamically adjust the levels and balance of multiple audio sources on individual channels. For example, multi-band compressors and dynamic equalizers can be used to selectively boost or attenuate certain frequency ranges for a specified channel.

[0006] Adjusting the volume balance in a multi-channel audio system can be a complex process involving a human user determining the volume levels for many different tracks or other sources of audio. While tools such as digital audio workstations can provide interfaces for adjusting parameters such as fader controls and panning controls, determining the volume level involves a manual process in which the human user determines the target volume level. This manual process can be time-consuming and requires a person with specialized skills to perform. For example, performing the manual process requires an understanding of the complex acoustic characteristics of the speakers.

[0007] As previously demonstrated, improved techniques for adjusting volume balance in multi-channel audio systems would be useful. Summary of the Invention

[0008] Various embodiments of this disclosure illustrate a computer-implemented method for adjusting volume balance. The method includes determining an amplitude-distance value among a plurality of amplitude-distance values ​​for each of a plurality of speakers in an audio system, wherein the amplitude-distance value determined for that speaker is based on the amplitude of a first tone detected by a microphone and a distance value determined based on a pair of second tones detected by the microphone. The method further includes identifying a minimum amplitude-distance value among the plurality of amplitude-distance values. The method further includes determining a gain factor for each of the plurality of speakers based on a ratio of the minimum amplitude-distance value to the amplitude-distance value determined for that speaker. The method further includes adjusting the volume level of the speaker based on the gain factor determined for each speaker.

[0009] Other embodiments include, but are not limited to, a system for implementing one or more aspects of the disclosed technology, and one or more computer-readable media including instructions for performing one or more aspects of the disclosed technology.

[0010] At least one technical advantage of the disclosed technology over existing technologies is that, using the disclosed technology, the system itself can adjust the volume balance in a multi-channel audio system without relying on a human user to determine the appropriate volume balance between channels. For example, a digital audio workstation can use the disclosed technology to adjust the volume balance without user input. Therefore, the digital audio workstation can perform volume balancing automatically, thereby improving ease of use and efficiency. Volume balancing determines the appropriate volume level for each channel without trial and error or parameter experimentation. Furthermore, there is no need to store volume balance tables in the speaker equipment, and the user does not need to understand the acoustic characteristics of the speakers. These technical advantages provide one or more technical improvements over existing methods. Attached Figure Description

[0011] To gain a detailed understanding of the features described in one or more embodiments set forth above, a more specific description of the above-briefly summarized embodiments can be made by referring to certain specific embodiments, some of which are illustrated in the accompanying drawings. However, it should be noted that the drawings illustrate only typical embodiments and should therefore not be considered as limiting its scope in any way, as other embodiments are also included in the scope of this disclosure.

[0012] Figure 1 A computing system configured to implement one or more aspects of various embodiments is shown;

[0013] Figure 2 This is a block diagram of an audio system having a balance adjustment module for balancing speaker volume levels according to various embodiments;

[0014] Figure 3 This is a block diagram illustrating a speaker amplitude and distance measurement audio system according to various embodiments;

[0015] Figure 4 It is a graph showing the audio pitch produced by a loudspeaker over time according to various embodiments;

[0016] Figure 5 It is a graph of time shift measurements of audio pitch according to various embodiments;

[0017] Figure 6A It is a graph showing the amplitude of audio pitch at the main microphone over time according to various embodiments;

[0018] Figure 6B It is a graph showing the amplitude measurement of audio pitch over time at a secondary microphone according to various embodiments;

[0019] Figure 7This is a flowchart of method steps for adjusting the balance of multiple loudspeakers based on corresponding determined amplitude-distance values ​​for the loudspeakers, according to various embodiments.

[0020] Figure 8 This is a flowchart of method steps for determining an amplitude-distance value for an auxiliary speaker relative to a main microphone, according to various embodiments; and

[0021] Figure 9 This is a flowchart of method steps for determining an amplitude-distance value for a primary loudspeaker relative to a primary microphone, according to various embodiments. Detailed Implementation

[0022] In the following description, numerous specific details are set forth to provide a more comprehensive understanding of certain specific embodiments. However, it will be apparent to those skilled in the art that other embodiments may be practiced without one or more of these specific details or with additional specific details.

[0023] Figure 1 A computing device 100 configured to implement one or more aspects of various embodiments is shown. As illustrated, the computing device 100 includes, but is not limited to, a processor 102, a storage device 104, an input / output (I / O) device interface 106, a network interface 108, an interconnect 110, and a system memory 112.

[0024] Processor 102 retrieves and executes programming instructions stored in system memory 112. Similarly, processor 102 stores and retrieves application data residing in system memory 112. Interconnect 110 facilitates the transfer of programming instructions and application data, such as those between processor 102, I / O device interface 106, storage device 104, network interface 108, and system memory 112. I / O device interface 106 is configured to receive input data from user I / O device 122. Examples of user I / O device 122 may include one or more buttons, a keyboard, a mouse, or other pointing devices. I / O device interface 106 may also include an audio output unit configured to generate an electrical audio output signal, and user I / O device 122 may further include a speaker configured to generate an acoustic output in response to the electrical audio output signal. Another example of user I / O device 122 is a display device, which generally refers to any technically feasible means for generating an image for display. For example, the display device can be a liquid crystal display (LCD), an organic light-emitting diode (OLED) display, or a digital light processing (DLP) display. The display device can be a TV including a broadcast or cable tuner for receiving digital or analog television signals. The display device can be included in a head-mounted display (HMD) assembly (such as a VR / AR head-mounted device or a head-up display (HUD) assembly). Further, the display device can project images onto one or more surfaces, such as a wall, a projection screen, or a vehicle's windshield. Additionally or alternatively, the display device can ( For example (Through retinal projection) the image is projected directly onto the user's eyes.

[0025] The system includes processor 102 to represent a single central processing unit (CPU), multiple CPUs, a single CPU with multiple processing cores, a digital signal processor (DSP), a field-programmable gate array (FPGA), a graphics processing unit (GPU), a tensor processing unit, etc. It also typically includes system memory 112 to represent random access memory. Storage device 104 can be a disk drive storage device. Although shown as a single unit, storage device 104 can be a combination of fixed and / or removable storage devices, such as fixed disk drives, floppy disk drives, tape drives, removable memory cards or optical storage devices, network-attached storage devices (NAS), or storage area networks (SANs). Processor 102 communicates with other computing devices and systems via network interface 108, wherein network interface 108 is configured to transmit and receive data via a communication network.

[0026] System memory 112 includes, but is not limited to, a balance adjustment module 132, an audio source module 134, and a data storage device 140. Data storage device 140 includes, but is not limited to, amplitude values ​​142, distance values ​​144, amplitude-distance values ​​146, and gain factors 148. Each amplitude-distance value 146 may be the product of the corresponding amplitude value 142 and the corresponding distance value 144. When executed by processor 102, balance adjustment module 132 and audio source module 134 perform one or more operations associated with the techniques described herein.

[0027] Audio source module 134 provides audio data sent from computing device 100 to a speaker (not shown). The speaker uses the audio data provided by audio source module 134 to generate audio pitch at times specified by balance adjustment module 132. Balance adjustment module 132 determines amplitude value 142 and distance value 144 based on audio data received from a microphone associated with computing device 100. The audio data may include encodings of the pitch detected by the microphone.

[0028] The balance adjustment module 132 may receive one or more of amplitude values ​​142, distance values ​​144, and / or amplitude-distance values ​​146 from one or more other computing devices. Alternatively or additionally, the balance adjustment module 132 may determine one or more of amplitude values ​​142 and distance values ​​144 based on data received from one or more other computing devices. The data received from the other computing devices may include amplitude values ​​and / or distance values ​​determined by the other computing devices, and / or audio pitch data representing audio pitch detected by one or more microphones associated with the other computing devices. The balance adjustment module 132 may determine the amplitude-distance value 146 by multiplying the corresponding amplitude value 142 by the distance value 144, and determine a gain factor 148 based on the corresponding amplitude-distance value 146.

[0029] When performing operations associated with the balance adjustment module 132, the processor 102 stores data in various portions of the data memory 140 and retrieves data from those portions, such as amplitude values ​​142, distance values ​​144, amplitude-distance values ​​146, and gain factors 148. When performing operations associated with the audio source module 134, the processor 102 stores data in various portions of the data storage device 140 and retrieves data from those portions, such as audio data (not shown).

[0030] Figure 2This is a block diagram of an audio system 200 with a balance adjustment module 132 for balancing speaker volume levels, according to various embodiments. The audio system 200 includes a computing device 100, which includes the balance adjustment module 132 and an audio source module 134. The computing device 100 performs operations associated with the balance adjustment module 132 and the audio source module 134 to balance the volume of speakers 204 such that, for example, a listener 210 hears the audio generated from each of speakers 204 at the same relative volume level.

[0031] Audio system 200 includes a primary speaker 204A, a secondary speaker 204B (also referred to herein as a first auxiliary speaker 204B), a second auxiliary speaker 204C, and a third auxiliary speaker 204N. For simplicity, the speakers are also referred to as speaker A 204A, speaker B 204B, speaker C 204C, and speaker N 204N, respectively. Although four speakers 204 are shown, audio system 200 may include any suitable number of speakers 204. Computing device 100 transmits audio data to each of the speakers 204 via a corresponding audio interface 208. Audio interface 208A can be used when audio data is transmitted to speaker 204A via audio channel 202A. Similarly, audio interfaces 208B, 208C, and 208N can be used when audio data is transmitted to speakers 204B, 204C, and 204N, respectively, via audio channels 202B, 202C, and 202N. For example, each audio interface 208 can use a wired connection or wireless radio frequency. The audio source module 134 generates audio data, which is then sent to each speaker 204 via the corresponding audio interface 208. The audio data can be encoded audio in a suitable format, or other sound representations with specified characteristics (such as specified amplitude and frequency).

[0032] The audio system 200 also includes at least two microphones 206, referred to as a primary microphone 206A and a secondary microphone 206B. The primary microphone 206A is located near the primary speaker 204A, while the secondary microphone 206B is located near the secondary speaker 204B. Each microphone 206 may be located within a threshold distance of the corresponding speaker 204. The speaker 204 and the associated microphone 206 may be in the same physical housing or may be physically separate devices. The microphones 206 and the corresponding speakers 204 may communicate via an interface such as an audio interface 208, enabling sound data acquired by the microphones 206 to be transmitted via the speakers 204 to the computing device 100 for processing by the balance adjustment module 132. Alternatively or additionally, the microphones 206 may communicate with the computing device 100 via an interface independent of the corresponding speakers 204. Each audio interface 208 provides communication between the computing device 100 and the corresponding speaker 204 for a corresponding audio channel 202. The balance adjustment module 132 and other modules on the computing device 100 can address each speaker 204 by specifying an identifier for the corresponding audio channel 202. For example, the balance adjustment module 132 can specify that a stream of audio data is sent to audio channel 202A, and the audio source module 134 or other modules accordingly send that audio data to the speaker 204 corresponding to audio channel 202A (which is the main speaker 204A in this example).

[0033] The audio system 200 adjusts the volume balance among the speakers 204 by determining a gain factor 148 for each audio channel 202 and amplifying the initial volume level associated with the audio channel 202 by the gain factor 148. Amplifying the volume level by the gain factor increases or decreases the volume of the sound produced by the speaker 204 corresponding to the audio channel 202. For example (Amplitude). To facilitate the calculation of the gain factor, each speaker generates a reference audio pitch at a predetermined time, as described below. The balance adjustment module 132 measures the characteristics of the pitch detected by the microphone 206 and determines a gain factor for each audio channel 202 that equalizes the volume level of the speaker as heard at a specific location (such as the location of the listener 210).

[0034] The balance adjustment module 132 determines the gain factor 148 for each audio channel based on the amplitude-distance value 146 of the speaker 204 associated herein with respect to a given microphone position. The speaker amplitude-distance value 146 represents the relationship between the amplitude of a sound wave and the distance from the source of that sound wave. The amplitude of a sound wave is inversely proportional to the distance from the sound source, therefore the amplitude decreases as the distance from the sound source increases. The amplitude-distance value 146 of the speaker 204 with respect to a given microphone 205 measuring the sound from the speaker 204 is calculated as the product of the measured amplitude value 142 of the sound produced by the speaker 204 as measured by microphone 206 and the distance value 144 between the speaker 204 and microphone 206. For example, the sound may be a reference audio pitch. The distance may be determined based on the phase difference between the pitches produced by the two speakers as measured by microphone 206. Amplitude-distance can represent the amplitude per unit distance. The relationship between the amplitude and distance of a spherical sound wave can be expressed by the sound wave attenuation formula:

[0035] A = A0 / (r * d).

[0036] In the attenuation formula, A is the amplitude of the sound wave at a distance r, where r is the distance the sound wave travels. A0 is the amplitude of the sound wave at a distance d, where d is the reference distance. According to the attenuation formula, the amplitude of the sound wave decreases as the distance increases. If the reference distance d is 1, then the unit amplitude A0 is A*r. Therefore, the product A*r represents the amplitude per unit distance.

[0037] Since each audio channel 202 is associated with a corresponding speaker 204, the gain factor 148 for each audio channel 202 is also referred to herein as the gain factor 148 for the speaker 204. The balance adjustment module 132 determines the gain factor for each auxiliary speaker 204 based on measurements taken from the main microphone 206A. Since the gain factor for each speaker 204 should be determined based on measurements from the same microphone, the balance adjustment module 132 also needs to determine the gain factor for the main speaker 204A based on measurements taken from the main microphone 206A. The main speaker 204A is located close to its own microphone (…). For exampleThe location of the primary microphone 206A is considered. Therefore, calculating the relationship between sound amplitude and distance for the primary speaker 204A using the primary microphone 206A is difficult. Therefore, the audio system 200 uses one of the secondary speakers and the secondary microphone, along with additional measurements, to derive the gain factor for the primary speaker 204A as measured by the primary microphone 206A. Other measurements are performed by the secondary microphone 206B and the primary microphone 206A. These other measurements include the amplitude-distance value of the auxiliary speaker as measured by the primary microphone 206A, the amplitude-distance value of the primary speaker 204A as measured by the secondary microphone 206B, and the amplitude-distance value of the auxiliary speaker 204C as measured by the secondary microphone 206B. The audio system 200 then determines the gain factor of the primary speaker 204A based on the derived amplitude-distance value of the primary speaker 204A with reference to the primary microphone 206A, as described in further detail below.

[0038] The balance adjustment module 132 determines the gain factor 148 of each auxiliary speaker 204 based on the product of the amplitude of the reference pitch generated by the auxiliary speaker 204 as measured by the main microphone 206A and the distance of the auxiliary speaker 204 from the main microphone 206A.

[0039] The balance adjustment module 132 determines the distance between two speakers by having each of the speakers 204 generate a reference tone. For example, the balance adjustment module 132 can cause the audio source module 134 to send audio data representing the reference tone to each speaker 204 that will generate the reference tone, and instruct the speaker to generate the reference tone for a specified time and for a specified duration. Each speaker 204 receiving the audio data can use an initial volume level ( For example A reference tone is generated by a microphone 206 associated with one of the speakers 204. The system calculates the distance between the speakers based on the phase difference between the tones generated by the speakers. The phase difference corresponds to the amount of time it takes for sound to travel between the speakers. The distance between the speakers is calculated by multiplying the speed of sound in air by the phase difference.

[0040] The balance adjustment module 132 (using a microphone associated with another speaker) determines the amplitude-distance of a given speaker as measured at that other speaker by multiplying the amplitude of that given speaker as measured at that other speaker by the distance between the speakers. For example, for three speakers A 204A, B 204B, and C 204C, where A is the primary speaker and B and C are auxiliary speakers, the amplitude-distance for each speaker A, B, and C is determined as measured at speaker A (except that the amplitude-distance determined for speaker A as measured at speaker A is determined using auxiliary speaker B, and that amplitude is not multiplied by the distance). The balance adjustment module 132 identifies the minimum amplitude-distance of the speakers. The balance adjustment module 132 determines the gain factor for each audio channel 202 by dividing the minimum amplitude-distance by the amplitude-distance determined for speaker 204 associated with audio channel 202. For example, the gain factor Ga for speaker A 204A can be determined by dividing the minimum amplitude by the amplitude-distance determined for speaker A as measured at speaker A. As another example, the gain factor Gb for speaker B 204B can be determined by dividing the minimum amplitude by the amplitude-distance determined for speaker B, as measured at speaker A. The system can adjust the volume balance based on the corresponding determined gain factor for each respective speaker. For example, if the audio system volume is to be set to a value G, the audio source module 134 can apply a gain G*Ga to the audio data sent to speaker A 204A via channel A, a gain G*Gb to the audio data sent to speaker B 204B via channel B, and a gain G*Gc to the audio data sent to speaker C 204C via channel C.

[0041] Figure 3This is a block diagram of an audio system 300 illustrating speaker amplitude and distance measurement 302 according to various embodiments. The audio system 300 includes four speakers: a primary speaker 204A, a secondary speaker 204B, an auxiliary speaker 204C, and an auxiliary speaker 204N. To equalize the speaker volume, the audio system 200 determines a gain factor 148 for each audio channel 202 and amplifies the initial volume level associated with the audio channel 202 by the gain factor 148. The gain factor 148 for each channel is determined based on the amplitude-distance value 146 of the speaker 204 associated with the audio channel 202 with respect to a given microphone position. The amplitude-distance value 146 of the speaker 204 with respect to a given microphone 205 measuring the sound from the speaker 204 is calculated as the product of a measured amplitude value 142 of the sound produced by the speaker 204 as measured by microphone 206 and a distance value 144 between the speaker and the microphone. The balance adjustment module 132 uses the measurements shown in amplitude and distance measurements 302A and 302B to determine the measured amplitude value 142 and distance value 144 for the four-speaker audio system 300.

[0042] For the 4-speaker audio system 300, the balance adjustment module 132 determines the gain factor of each of the auxiliary speakers 204B, 204C, and 204N based on amplitude and distance measurements 302A taken by the main microphone 206A. Since the main speaker 204A is located close to its own microphone, calculating the relationship between sound amplitude and distance for that main speaker using its own microphone is difficult. Therefore, the balance adjustment module 132 uses the secondary microphone 206B and additional amplitude and distance measurements 302 taken by the secondary microphone 206B to derive the gain factor for the main speaker 204A as measured by the main microphone 206A.

[0043] Amplitude and distance measurements 302A are determined by the balance adjustment module 132 using the primary microphone 206A. Amplitude and distance measurements 302B are determined by the balance adjustment module 132 using the secondary microphone 206B. (See the text regarding...) Figure 2 The computing device 100 can send audio data to each speaker 204 using a corresponding audio interface 208, and can also receive data from each microphone 206 using the same corresponding audio interface or another audio interface dedicated to communication with the microphone 206. The amplitude and distance measurements 302A determined using the main microphone 206A are shown in a table with three rows. The symbol A is used herein. Amic-B To represent the amplitude of a loudspeaker as measured by a microphone (“A”), such as the amplitude of a loudspeaker B as measured by microphone A. Symbol D AB This represents distance, such as the distance between microphone A and speaker B. Audio data and timing for distance measurements are presented in... Figure 4 The audio data and timing for the amplitude measurements are shown in Figure 6. The first row of the table contains the amplitude measurements A of the secondary speaker 204B using the primary microphone 206A. Amic-B 610 and distance measurement D AB 304. The second line contains the amplitude measurement A of the auxiliary speaker 204C using the main microphone 206A. Amic-C 612 and distance measurement D AC 306, and the third line contains the amplitude measurement A of the auxiliary speaker 204N using the main microphone 206A. Amic-N 614 and distance measurement D AN 306.

[0044] To determine the magnitude A shown in the first row of the table Amic-B 610 and distance D AB 304, The balance adjustment module 132 will adjust the specified timing according to the specified timing ( Figure 4 Audio data of tone 410B (shown in the diagram) is sent to secondary speaker 204B. Amplitude and distance measurements are measurements of the sound produced by secondary speaker 204B. For both amplitude and distance measurements, secondary speaker 204B produces audible tone 410B based on audio data with a specified timing, and primary microphone 206A captures audible tone 410B.

[0045] For a given distance D AB Distance measurement of 304 Figure 4 A representation of audio data is shown for generating tone 410A at speaker 204A and tone 410B at speaker 204B to measure the distance between speakers A and B. Figure 4 The timing 402 shown indicates that tones 410A and 410B will be generated simultaneously by speakers 204A and 204B. To measure tones 410A and 410B, the balance adjustment module 132 causes the main microphone 206A to acquire audio during the time period when speakers 204A and 204B are generating tones 410A and 410B. The balance adjustment module 132 then receives the audio representations of tones 410A and 410B from the main microphone 206A. The balance adjustment module 132 determines the distance D from the received audio representations of tones 410A and 410B by measuring the phase difference between the two tones. AB Since the phase difference corresponds to the amount of time it takes for sound to travel between speakers 204A and 204B, the distance D between the speakers... AB It is calculated by multiplying the speed of sound in the air by the phase difference.

[0046] Determine the distance D shown in the second and third rows of the table.AC 306 and D AN The measurement of 308 is similar to that of distance D. AB The measurement was performed. For determining D... AC Distance measurement of 306 Figure 4 A representation of the audio data used to generate tone 410A at speaker 204A and tone 410C at speaker 204C to measure the distance between speakers A and C is shown. Figure 4 The timing 404 shown indicates that tones 410A and 410C will be generated simultaneously by speakers 204A and 204C. To measure tones 410A and 410C, the balance adjustment module 132 causes the main microphone 206A to acquire audio during the time period when speakers 204A and 204C are generating tones 410A and 410C. The balance adjustment module 132 then receives the audio representations of tones 410A and 410C from the main microphone 206A. The balance adjustment module 132 determines the distance D from the received audio representations of tones 410A and 410C by measuring the phase difference between the two tones. AC Since the phase difference corresponds to the amount of time it takes for sound to travel between speakers 204A and 204C, the distance D between the speakers... AC It is calculated by multiplying the speed of sound in the air by the phase difference.

[0047] For determining D AN Distance measurement of 308 Figure 4 A representation of the audio data used to generate tone 410A at speaker 204A and tone 410N at speaker 204N to measure the distance between speakers A and N is shown. Figure 4 The timing 406 shown specifies that tones 410A and 410N will be generated simultaneously by speakers 204A and 204N. To measure tones 410A and 410N, the balance adjustment module 132 causes the main microphone 206A to acquire audio during the time that speakers 204A and 204N are generating tones 410A and 410N. The balance adjustment module 132 then receives the audio representations of tones 410A and 410N from the main microphone 206A. The balance adjustment module 132 determines the distance D from the received audio representations of tones 410A and 410N by measuring the phase difference between the two tones. AN Since the phase difference corresponds to the amount of time it takes for sound to travel between speakers 204A and 204N, the distance D between the speakers... AN It is calculated by multiplying the speed of sound in the air by the phase difference.

[0048] For a given amplitude A Amic-B Amplitude measurement, Figure 6AThe diagram shows the tone 410B used to generate the measurement pitch A for measuring amplitude A. Amic-B The audio data is represented as A. The amplitude specified in the audio data is displayed as A. Amic-B 610. Figure 6A The timing specified in the diagram indicates that speaker 204B will produce tone 410B before the tones for speakers C and N. To measure tone 410B, balance adjustment module 132 causes primary microphone 206A to capture audio during the time when secondary speaker 204B is producing tone 410B. Balance adjustment module 132 then receives the audio representation of tone 410B from primary microphone 206A. Balance adjustment module 132 determines amplitude A based on the received audio representation of tone 410B. Amic-B 610. For example, amplitude 610 can be identified by finding the peak of the sine wave representation of pitch 410B and measuring the distance between the x-axis and that peak.

[0049] For a given amplitude A Amic-C Amplitude measurement, Figure 6A The diagram shows the tone 410C used to measure amplitude A. Amic-C The audio data is represented as A. The amplitude specified in the audio data is displayed as A. Amic-C 612. Figure 6A The timing-specified tone 410C shown will be generated by speaker 204C between the tones for speakers B and N. To measure tone 410C, balance adjustment module 132 causes main microphone 206A to capture audio during the period when tone 410C is being generated by speaker 204C. Balance adjustment module 132 then receives the audio representation of tone 410C from main microphone 206A. Balance adjustment module 132 determines amplitude A based on the received audio representation of tone 410C. Amic-C 612. For example, amplitude 612 can be identified by finding the peak of a sine wave representing pitch 410C and measuring the distance between the x-axis and that peak. Amplitude A Amic-N The pitch 410N is similarly determined by causing the speaker 402N to produce a tone. The balance adjustment module 132 determines the amplitude A based on the received audio representation of the pitch 410N. Amic-N 614.

[0050] The amplitude and distance measurements 302B determined using the secondary microphone 206B are shown in a table with two rows. The first row contains the amplitude and distance measurements of the primary speaker 204A taken using the secondary microphone 206B. To determine the amplitude A shown in the first row of the table... Bmic-A 618, the balance adjustment module 132 will adjust the specified timing according to the specified timing 402 ( Figure 4 The audio data for tone 410A (shown in the diagram) is sent to the main speaker 204A. It is used to determine amplitude A.Bmic-A The tone 410A of 618 should be produced by the main loudspeaker 204A during the period in which no other loudspeakers produce tone.

[0051] To determine the amplitude A shown in the second row of the table for measuring 302B. Bmic-C 622, the balance adjustment module 132 will adjust the specified timing according to the specified timing 408 ( Figure 4 The audio data for tone 410C (shown in the image) is sent to the auxiliary speaker 204C. This is used to determine amplitude A. Bmic-C The tone 410C of 622 should be produced by the auxiliary speaker 204C during the period in which no other speaker produces a tone.

[0052] Distance D BA 312 can be similar to the distance D described in this article. AB 304 is used to determine this. Alternatively, due to distance D BA 312 and D AB 304 is similar or identical, and the previously determined distance D can be used. AB The value 304 is used as the distance DBC 314. This is used to determine the distance D for the second row of the table. BC Distance measurement, Figure 4 A representation of the audio data used to generate tone 410C at speaker 204C and tone 410B at speaker 204B to measure the distance between speakers B and C is shown. Figure 4 The timing 408 shown specifies that tones 410B and 410C will be generated simultaneously by speakers 204B and 204C. To measure tones 410B and 410C, the balance adjustment module 132 causes the secondary microphone 206B to acquire audio during the time period when tones 410B and 410C are being generated by speakers 204B and 204C. The balance adjustment module 132 then receives the audio representations of tones 410B and 410C from the secondary microphone 206B. The balance adjustment module 132 determines the distance D from the received audio representations of tones 410B and 410C by measuring the phase difference between the two tones. BC Since the phase difference corresponds to the amount of time it takes for sound to travel between speakers 204B and 204C, the distance D between the speakers... BC It is calculated by multiplying the speed of sound in the air by the phase difference.

[0053] As this article is about Figure 2The balance adjustment module 132 determines the gain factor 148 of each auxiliary speaker 204 based on the product of the amplitude of the reference pitch produced by the auxiliary speaker 204 as measured by the main microphone 206A and the distance between the auxiliary speaker 204 and the main microphone 206A. Each amplitude-distance value 146 is the product of a corresponding amplitude value 142 and a corresponding distance value 144. More specifically, the amplitude-distance value 146 of the speaker 204 with respect to a given microphone 205 for measuring the sound from the speaker 204 is calculated as the product of the measured amplitude value 142 of the sound produced by the speaker 204 as measured by the microphone 206 and the distance value 144 between the speaker and the microphone.

[0054] The amplitude-distance of the auxiliary speaker 204, as measured by the main microphone 206 (referred to as microphone A), is:

[0055] Amplitude of speaker B minus distance = A Amic-B * D AB ,

[0056] Amplitude of speaker C minus distance = A Amic-C * D AC ,as well as

[0057] Amplitude of speaker N minus distance = A Amic-N * D AN .

[0058] Since the gain factor for each speaker 204 should be determined based on measurements from the same microphone, the balance adjustment module 132 also needs to determine the gain factor for the main speaker 204A based on measurements taken by the main microphone 206A. However, the main speaker is located close to its own microphone, and it is difficult to calculate the relationship between the sound amplitude and distance for that main speaker using its own microphone. Therefore, the system uses the secondary microphone 206B and additional measurements to derive the gain factor for the main speaker 204A as measured by the main microphone 206A.

[0059] The amplitudes of speakers A and C, measured by microphone B, correspond to the amplitude of a reference audio sine wave. The microphone gains of speakers A and B can be different; therefore, the amplitudes of the audio played by speaker C, measured by speakers A and B, serve as microphone gain calibration. The ratio of the amplitude of speaker A as measured by a given microphone A to the amplitude of speaker A as measured by a given microphone B is called the microphone gain ratio, which correlates the microphone gain of microphone A with the microphone gain of microphone B. This ratio is the same for different speakers, so the ratio can be equal for different speakers. By measuring the amplitudes of two different speakers using microphones A and B, an equation can be constructed that includes the unknown amplitude of speaker A, as measured at microphone A.

[0060] More specifically, the microphone gain ratio of microphone A to microphone B when measuring the amplitude of speaker A can be equal to the microphone gain ratio of microphone A to microphone B when measuring the amplitude of speaker C. By substituting amplitude position for amplitude distance, the equation between microphone gains when measuring two different speakers A and C is:

[0061] (A Amic-A ) / (A Bmic-A * D AB ) = (A Amic-C * D AC ) / (A Bmic-C * D BC )

[0062] Amplitude Distance A Amic-A This represents the unknown amplitude-distance, which is the amplitude-distance of speaker A measured at microphone A multiplied by the distance between speaker A and microphone A. Because amplitude-distance A... Amic-A It is derived from other measurements, rather than being measured directly using microphone A, therefore the amplitude-distance A Amic-A In this paper, this is referred to as the amplitude-distance between the main loudspeaker 204A and the main microphone 206A. Solve for A. Amic-A Generate a target for A Amic-A The following equation, expressed in terms of known amplitude-distance:

[0063] A Amic-A = (A Amic-C * D AC ) * (A Bmic-A * D AB ) / (A Bmic-C * D BC )

[0064] In the equation above, the known amplitude-distance ratio is A. Bmic-A * DAB A Amic-C * D AC and A Bmic-C * D BC These amplitude and distance values ​​are determined by, for example... Figure 3 Measurements 302A and 302B shown are used to determine this. Therefore, the amplitude of speaker A (A) as measured at microphone A can be determined using the equation above, based on the known amplitude-distance. Amic-A ).

[0065] The gain factor for each channel is determined by identifying the smallest gain factor among the gain factors for audio channels 202 in the audio system 200. Figure 2 The example audio system 200 shown has four channels, including audio channel 202A (associated with the primary microphone 206A), audio channel 202B (associated with the secondary microphone 206B), audio channel 202C (associated with the auxiliary speaker 204C), and audio channel 202N (associated with the auxiliary speaker 204N). The amplitude-distance for the four example channels is A for channel A. Amic-A A for channel B Amic-B * D AB A for channel C Amic-C * D AC and A for channel N Amic-N * D AN It is called A. Amic-min The minimum gain factor is the minimum value of amplitude minus distance:

[0066] A Amic-min = min(A Amic-A A Amic-B *L AB A Amic-C *L AC A Amic-N *L AN )

[0067] The minimum amplitude-distance is used to prevent acoustic clipping. Alternatively, the maximum amplitude-distance can be used, but the possibility of acoustic clipping will exist. Each of the gain factors GA, GB, GC, GN for the corresponding channels A, B, C, N is determined by dividing the minimum amplitude-distance by the amplitude-distance of the corresponding channel:

[0068] G A = A Amic-min / A Amic-A ,

[0069] G B = AAmic-min / (A Amic-B * L AB ),

[0070] G C = A Amic-min / (A Amic-C * L AC ),as well as

[0071] G N = A Amic-min / (A Amic-N * L AN ).

[0072] Balance adjustment module 132 or other suitable components ( For example The main speaker 204A) will set the gain ratio of all channels (G) A G B G C G N The parameters are sent to an audio source, which reprocesses each channel according to these parameters and assigns it to the corresponding speaker. The balance adjustment module 132 can adjust the volume of the audio system 200 to a specified target volume G by applying a specified volume to each audio channel 202. 音量 To apply a specified volume, the balance adjustment module 132 determines the equalized volume for each channel by multiplying the specified volume by the channel's gain factor:

[0073] Using a uniform variable gain applied to all channels of the audio source module 134 (e.g., applied to channels such as G... 音量 *G A G 音量 *G B G 音量 *G C G 音量 *G N The above algorithm can achieve volume equalization adjustment for multi-channel audio systems by adjusting the volume of the gain ratio set G of the system.

[0074] The balance adjustment module 132 can adjust the equalization volume G of the channel. 音量 *G A G 音量 *G B G 音量 *G C G 音量 *G NThe audio source module 134 is provided with the volume GA, GB, GC, and GN of each channel set to the corresponding equalizer volume. The audio source module 134 increases or decreases the volume level applied to each channel by a gain factor, and the volume level of the sound produced by the corresponding speaker increases or decreases according to the equalizer volume level.

[0075] As an example, volume balancing can be performed in an audio system with three or more speakers, such as... Figure 3 As shown below, the balance adjustment module 132 uses the audio pitch generated by the main speaker 204A and the first auxiliary speaker 204B and acquired by the main microphone 206A to determine the amplitude-distance value (e.g., A) for the first auxiliary speaker 204B relative to the main microphone 206A. Amic-B * D AB The amplitude-distance value for speaker 204B is the amplitude A of speaker 204B relative to microphone 206A. Amic-B The distance between speaker 204B and microphone 206A (D) AB The amplitude is determined using the audio pitch generated by speaker 204B. The distance is determined using the phase difference between the audio pitches generated by speakers 204A and 204B.

[0076] The balance adjustment module 132 also uses the audio pitch generated by the main speaker 204A and the second auxiliary speaker 204C and acquired by the main microphone 206A to determine the amplitude-distance value (e.g., A) for the second auxiliary speaker 204C relative to the main microphone 206A. Amic-C * D AC The amplitude-distance value for speaker 204C is the amplitude A of speaker 204C relative to microphone 206A. Amic-C The distance (D) between speaker 204C and microphone 206A AC The amplitude is determined using the audio tone generated by speaker 204C. The distance is determined using the phase difference between the audio tones generated by speakers 204A and 204C.

[0077] The balance adjustment module 132 can similarly determine the amplitude-distance value for the additional speakers. For example, for each additional auxiliary speaker 204N, the balance adjustment module 132 can use the audio pitch generated by the main speaker 204A and the additional auxiliary speakers 204N and captured by the main microphone to determine the amplitude-distance value for the first auxiliary speaker 204B (e.g., A). Amic-N * D AN ).

[0078] The balance adjustment module 132 also uses the amplitude-distance value for the second auxiliary speaker 204C and further uses the audio pitch generated by the main speaker 204A and the first auxiliary speaker 204B and captured by the secondary microphone 206B, and further uses the audio pitch generated by the first auxiliary speaker 204A and the second auxiliary speaker 204C and captured by the secondary microphone 206B to determine the amplitude-distance value (A) for the main speaker 204A relative to the main microphone 206A. Amic-A ).

[0079] To determine the amplitude-distance value (A) of the main speaker 204A relative to the main microphone 206A. Amic-A The balance adjustment module 132 uses the audio pitch generated by the primary speaker and the first auxiliary speaker and captured by the secondary microphone to determine the amplitude-distance value for the primary speaker 204A, as measured by the secondary speaker 204B (e.g., A). Bmic-A *D BA D, as determined above AB The value can be used in D BA Since both represent the distance between the primary speaker 204A and the secondary speaker 204B. Further, the balance adjustment module 132 uses the audio pitch generated by the first and second auxiliary speakers and captured by the secondary microphone to determine the amplitude-distance value (e.g., A) for the second auxiliary speaker. Bmic-C * D BC The balance adjustment module 132 calculates the amplitude-distance value (A) for the main speaker 204A relative to the main microphone 206A. Amic-A ), which is A Amic-C * D AC With (A) Bmic-A * D AB The product of ) divided by (A) Bmic-C * D BC As mentioned above.

[0080] The balance adjustment module 132 identifies the minimum amplitude-distance value determined for loudspeakers 204A, 204B, 204C (and auxiliary loudspeaker 204N, if present). The balance adjustment module 132 then determines a gain factor for each loudspeaker based on the ratio of this minimum amplitude-distance value to a corresponding amplitude-distance value for the respective auxiliary loudspeaker. The balance adjustment module 132 then adjusts the volume level of each loudspeaker based on the corresponding gain factor.

[0081] Figure 4 It is a graph showing the audio pitch produced by a speaker over time according to various embodiments. Figure 4The timing of the reference tone pairs 410 generated at loudspeaker pairs 204 for distance measurement is shown. Each pair of reference tones 410 will be generated at times referred to herein as timings 402, 404, 406, or 408, indicated by vertical boxes. The loudspeakers 204 that generate each tone are shown as horizontal lines, labeled with the letters A, B, C, or N, respectively, representing loudspeakers 204A, 204B, 204, or 204N. Timing 402 for the tones of loudspeakers A and B specifies that tone 410A will be generated at loudspeaker A, while tone 410B will be generated at loudspeaker B, and earlier than timing 404.

[0082] Timing 404 for the tones of speakers A and C specifies that, after timing 402 and before timing 406, tone 410A is generated on speaker A, and tone 410C is generated on speaker C. Timing 404 for the tones of speakers A and C specifies that, after timing 402 and before timing 406, tone 410A is generated on speaker A, and tone 410C is generated on speaker C. Timing 406 for the tones of speakers A and N specifies that, after timing 404 and before timing 408, tone 410A is generated on speaker A, and tone 410N is generated on speaker N. Timing 408 for the tones of speakers B and C specifies that, after timing 406, tone 410B is generated on speaker B, and tone 410C is generated on speaker C.

[0083] Although a specific timing sequence is shown, at other times, each pair of tones on the two different speakers is generated at a different time that does not overlap with other pairs of tones. The tones shown can be generated repeatedly in a loop. For example, the tone pairs shown in timing sequences 402, 404, 406, 408 can be generated sequentially as shown, and timing sequences 402, 404, 406, 408 can be repeated until a threshold condition is met (such as a threshold number of cycles generated, a threshold number of times elapsed), or the balance adjustment module 132 determines that the distance between each pair of speakers 204 has been successfully measured.

[0084] Figure 5 Figure 500 124 shows the time-shift measurement of audible tones 502, 504 according to various embodiments. Microphone 206 detects audible tone 502 from speaker A at a first time point and audible tone 504 from speaker B at a second time point. Audible tones 502, 504 are generated simultaneously by the respective speakers A and B. For example ,according to Figure 4The timing shown is 402, but due to the different distances between speakers A and B and microphone 206, sound arrives at speakers A and B at different times. The balance adjustment module 132 identifies the time 506 between the peak value represented by the sine wave of tone 502 and the peak value represented by the sine wave of tone 504. The time 506 between the peak values ​​corresponds to the phase difference between tones 502 and 504. The balance adjustment module 132 can determine the distance between speakers A and B by multiplying the speed of sound in air by this phase difference.

[0085] Although the example phase difference is determined by identifying the time 506 between peaks, the phase difference can also be identified by any suitable technique, such as by identifying the time between different corresponding parts of pitches 502, 504, such as the point where the pitches intersect the time axis.

[0086] Figure 6A This is a graph of the amplitude measurement 600 of the audio pitch at the main microphone over time according to various embodiments. Measurement 600 includes amplitudes 610, 612, and 614 respectively for audible pitches 410B, 410C, and 410N. Figure 3 As shown in the example, the audio pitch is generated by corresponding speakers B, C, and N for measurement by the main microphone 206A. The result of amplitude measurement 600 is... Figure 3 The amplitude of measurement 302A is shown in the table. The audible tones 410B, 410C, and 410N are generated by the loudspeaker in response to commands or signals generated by the balance adjustment module 132 in the order shown. The balance adjustment module 132 causes the loudspeaker to produce audible tones 410B, 410C, and 410N while providing sufficient delay between the audible tones 410B, 410C, and 410N so that the audible tones do not overlap in time.

[0087] The balance adjustment module 132 causes the speakers to generate each tone 410B, 410C, 410N with the same amplitude. The measured amplitudes 610, 612, 614 are different because the corresponding speakers B, C, and N are located at different distances from the main microphone 206A that detects the audible tones. The amplitude of the audible tone detected from the speaker located closer to the microphone is greater than the amplitude of the audible tone detected from the speaker located farther from the microphone.

[0088] The amplitude of the audible pitch 410B, measured by the balance adjustment module 132 based on the audio signal received from the main microphone 206A, is A. Amic-B 610. Similarly, the amplitude of the audible pitch 410C, measured by the balance adjustment module 132 based on the audio signal received from the main microphone 206A, is A. Amic-C612. Further, the amplitude of the audible pitch 410N measured by the balance adjustment module 132 based on the audio signal received from the main microphone 206A is A. Amic-N 614.

[0089] Figure 6B This is a graph of amplitude measurements 620 of audio pitch over time at secondary microphone 206B, according to various embodiments. Measurement 600 includes amplitudes 618 and 622 respectively for audible pitches 410A and 410C. The audio pitch is generated by corresponding speakers A and C for measurement by secondary microphone 206B, such as... Figure 3 The example shown in [the image] illustrates the amplitude measurement result of 620. Figure 3 The amplitude of measurement 302B is shown in the column. The audible tones 410A and 410C are generated by the loudspeaker in response to commands or signals generated by the balance adjustment module 132 in the order shown. The balance adjustment module 132 causes the loudspeaker to produce audible tones 410A and 410C, while there is sufficient delay between the audible tones 410A and 410C so that the audible tones do not overlap in time.

[0090] The balance adjustment module 132 causes the speakers to generate each tone 410A, 410C with the same amplitude. The measured amplitudes 618, 622 are different because the corresponding speakers A and C are located at different distances from the secondary microphone 206B that detects the audible tone. The amplitude of the audible tone 410A, measured by the balance adjustment module 132 based on the audio signal received from the secondary microphone 206B, is A. Bmic-A 618. Similarly, the amplitude of the audible pitch 410C, measured by the balance adjustment module 132 based on the audio signal received from the secondary microphone 206B, is A. Amic-C 622.

[0091] Figure 7 This is a flowchart of method steps for adjusting the balance of multiple loudspeakers 204 according to various embodiments, based on an amplitude-distance value 146 determined for the response of loudspeaker 204. Although combined with... Figures 1 to 6B The system describes the method steps, but those skilled in the art will understand that any system configured to perform the method steps in any order is within the scope of this disclosure.

[0092] As shown, method 700 begins at step 702, where computing device 100 determines a corresponding amplitude-distance value 146 among a plurality of amplitude-distance values ​​146 for each auxiliary speaker 204B (or 204N) of the plurality of speakers 204 in audio system 200. For auxiliary speaker 204B (e.g., A... Amic-B)The determined amplitude-distance value 146 is based on the corresponding amplitude value 142 of the first tone detected by microphone 206 and the corresponding distance value 144 determined based on a pair of second reference tones 410 detected by microphone 206. The amplitude-distance value 146 may be determined based on the product of the amplitude of the first tone for the speaker and the distance value for that speaker. The distance value 144 may represent the distance between speaker 204 and microphone 206 and may be determined based on the phase difference between the pair of second reference tones 410. The amplitude of the first reference tone 410 may be the amplitude of the first tone produced by auxiliary speaker 204B as measured by microphone 206A. In one example, the first tone is received from auxiliary speaker 204B, the third tone of the pair of second tones is received from auxiliary speaker 204B, and the fourth tone of the pair of second tones is received from another speaker (such as auxiliary speaker 204C) associated with the microphone. Further details on determining the amplitude-distance value 146 for each auxiliary speaker 204B to 204N are provided herein. Figure 8 As stated above.

[0093] At step 704, the computing device 100 determines a primary speaker amplitude-distance value 146 among a plurality of amplitude-distance values ​​146 for a primary speaker 204A among a plurality of speakers 204. The primary speaker amplitude-distance value 146 is also referred to herein as A. Amic-A The main speaker amplitude-distance value 146 corresponds to the amplitude-distance value 146 determined for the main speaker 204A as measured by the main microphone 206A associated with the main speaker 204A.

[0094] At step 704, the computing device 100 may determine a primary speaker amplitude-distance value among a plurality of amplitude-distance values ​​for a primary speaker among a plurality of speakers. The primary speaker amplitude-distance value corresponds to an amplitude-distance value determined for that primary speaker as measured by a primary microphone associated with that primary speaker. The computing device 100 may determine the primary speaker amplitude-distance value based on at least one additional amplitude-distance value determined using a secondary microphone associated with a first auxiliary speaker, wherein the at least one amplitude-distance value is based on at least one tone produced by the primary speaker and at least one tone produced by a second auxiliary speaker. (Reference to this document) Figure 9 Further details are described regarding the determination of the amplitude-distance values ​​for the main loudspeaker.

[0095] At step 706, the computing device 100 identifies the minimum value of the determined amplitude-distance value 146. At step 708, the computing device 100 determines a corresponding gain factor 148 for each of the plurality of speakers 204 based on the ratio of the minimum amplitude-distance value 146 to the corresponding amplitude-distance value 146 determined for the speaker 204. At step 710, the computing device 100 adjusts the volume level of the speaker based on the corresponding gain factor 148 determined for each speaker 204. The volume level of the speaker can be adjusted based on the gain factor determined for each speaker and further based on a target volume level. For example, the volume level of each speaker can be changed to an updated volume level determined by multiplying the gain factor determined for that speaker by the target volume level.

[0096] Figure 8 This is a flowchart of method steps for determining amplitude-distance values ​​146 for auxiliary speakers 204B to 204N relative to the main microphone 206A, according to various embodiments. Although combined with... Figures 1 to 6B The system describes the method steps, but those skilled in the art will understand that any system configured to perform the method steps in any order is within the scope of this disclosure.

[0097] As shown, method 800 begins at step 802, wherein for each of the plurality of auxiliary loudspeakers 204 204B to 204N, computing device 100 causes the auxiliary loudspeaker 204 to generate an amplitude measurement reference tone 410. Figure 6A and 6B An example timing sequence for generating the amplitude measurement reference tone is shown. At step 804, the computing device 100 uses the primary microphone 206A to determine the measured amplitude 610 of the amplitude measurement reference tone 410 generated by the auxiliary speaker 204. At step 806, the computing device 100 causes the auxiliary speaker 204 to generate the first reference tone 410 at a specified time. At step 808, the computing device 100 causes the primary speaker 204A associated with the primary microphone 206A to generate the reference tone 410 at a specified time. An example timing sequence for generating the reference tone 410 for each pair of speakers used in determining the distance value between the speaker and the microphone is shown in [the original text]. Figure 4 As shown in the image.

[0098] At step 810, the computing device 100 uses the main microphone to determine the measured distance value 144 between the auxiliary speaker 204 and the main microphone 206A based on the time 506 between the first and second reference tones 410 received by the main microphone 204A. (See also: [link to document]) Figure 4An example of determining the measured distance value 144 based on time 506 is described. At step 812, the computing device 100 determines the amplitude-distance value 146 for the auxiliary speaker 204, as measured by the main microphone 206A, based on the measured amplitude 610 and the measured distance value 144. For example, the amplitude-distance value can be determined by multiplying the amplitude by the distance. Method 800 returns to step 802 to iteratively perform steps 802 through 812 until steps 802 through 812 have been performed for each auxiliary speaker.

[0099] Figure 9 This is a flowchart of method steps for determining an amplitude-distance value 146 for a primary speaker 204A relative to a primary microphone 206A, according to various embodiments. The amplitude-distance value 146 for the primary speaker 204A relative to the primary microphone 206A can be as described herein. Figure 3 The quantity A described Amic-A Despite the combination Figures 1 to 6B The system describes the method steps, but those skilled in the art will understand that any system configured to perform the method steps in any order falls within the scope of this disclosure.

[0100] As shown, method 900 begins at step 902, where computing device 100 calculates the amplitude 612 (e.g., A) of the measured pitch 410C produced by auxiliary speaker 204C based on the amplitude 612 of the measured pitch 410C. Amic-C The measured distance value 144 between the auxiliary speaker 204C and the main microphone 206A determines a first amplitude-distance value 146 for the auxiliary speaker 204C, as measured by the main microphone 206A (e.g., A). Amic-C * D AC The distance between the auxiliary speaker 204C and the main speaker 204A can be D. AC ,like Figure 3 As shown in the figure. The measured distance D AC It can be determined based on the phase difference between the tone produced by the auxiliary speaker 204C and the tone produced by the main speaker 204A.

[0101] At step 904, the calculation device 100 calculates the amplitude (e.g., A) based on the measured amplitude of the main loudspeaker 204A. Bmic-A The measured distance value 144 between the primary speaker 204A and the secondary microphone 206B (e.g., D) and the primary speaker 204A and the secondary microphone 206B. BA 312) to determine a second amplitude-distance value 146 for the main speaker 204A, as measured by the secondary microphone 206B (e.g., A). Bmic-A * D AB ). Due to D BA 312 and D AB304 and 204 are similar distance measurements that can represent the distance between the primary speaker 204A and the secondary speaker 204B, value D. BA 312 and D AB 304 can be used interchangeably. For example, distance D AB 304 can replace D AB 304 is used to calculate the second amplitude distance value for the main speaker 204A, as measured by the secondary microphone 206B, therefore it is not necessary to determine the distance D. AB 304.

[0102] At step 906, the calculation device 100 calculates the amplitude (e.g., A) based on the measured amplitude of the auxiliary loudspeaker 204C. Bmic-C The measured distance value 144 between the auxiliary speaker 204C and the secondary microphone 206B (e.g., D) BC 314) Determine the third amplitude-distance value 146 for the auxiliary speaker 204C, as measured by the secondary microphone 206B (e.g., A). Bmic-C * D BC ).

[0103] At step 908, the computing device 100 determines the amplitude-distance value 146 (e.g., A) for the reference main microphone 204A to the main speaker 204A based on the product of the first amplitude-distance value 146 and the second amplitude-distance value 146 divided by the third amplitude-distance value. Amic- A). For example, at step 908, computing device 100 may use the references herein. Figure 3 The description is for A Amic-A The formula (A) Amic-A = (A Amic-C * D AC ) * (A Bmic-A * D AB ) / (A Bmic-C * D BC To determine the amplitude-distance value 146 for the reference main microphone 204A to the main speaker 204A.

[0104] In summary, a multi-channel audio system adjusts the volume balance among multiple speakers by determining a gain factor for each audio channel and amplifying the initial volume level associated with that audio channel using that gain factor. The system includes an audio source that distributes audio data to a set of speakers via a set of audio channels. Adjusting the volume balance equalizes the volume levels of the audio channels so that, for example, a listener can hear the audio generated from each of those channels at the same relative volume level.

[0105] Each audio channel is associated with a corresponding speaker. The speakers include a primary speaker and one or more auxiliary speakers. Two of the speakers (including one of the auxiliary speakers and the primary speaker) have associated microphones. Each microphone is located close to its corresponding speaker. The auxiliary speaker with the associated microphone is referred to herein as the secondary speaker. The microphones associated with the primary and secondary speakers are referred to herein as the primary microphone and secondary microphone, respectively. To facilitate the calculation of the gain factor, each speaker generates a reference audio tone at a predetermined time.

[0106] The system determines the gain factor for each audio channel based on a quantity referred to herein as the amplitude-distance of the speaker with respect to a given microphone location. The speaker amplitude-distance represents the relationship between the amplitude of a sound wave and its distance from the source of that sound wave. Sound wave amplitude is inversely proportional to the distance from the sound source, therefore, the amplitude decreases as the distance from the sound source increases. The speaker amplitude-distance with respect to a given microphone from which the sound from the speaker is measured is calculated as the product of the measured amplitude of the sound produced by the speaker as measured by that microphone and the distance between the speaker and the microphone. For example, the sound may be a reference audio pitch.

[0107] More specifically, the system determines the gain factor of each auxiliary speaker by determining the amplitude of a reference pitch produced by each auxiliary speaker, as measured by the primary microphone, and multiplying the measured amplitude by the distance of that auxiliary speaker from the primary microphone. The system also determines the gain factor of the primary speaker. Since the primary speaker is located close to its own microphone, calculating the relationship between sound amplitude and distance for that primary speaker using its own microphone is difficult. Therefore, the system uses secondary microphones and additional measurements to derive the amplitude-distance value of the primary speaker relative to the primary microphone from other measurements. These other measurements include the amplitude-distance value of the auxiliary speaker as measured by the primary microphone, the amplitude-distance value of the primary speaker as measured by the secondary microphone, and the amplitude-distance value of the auxiliary speaker as measured by the secondary microphone. The system then determines the gain factor of the primary speaker based on the derived amplitude-distance value of the primary speaker relative to the primary microphone.

[0108] The system determines the distance between two speakers by having each speaker generate a reference pitch. A microphone associated with one of the speakers records the reference pitch. The system calculates the distance between the speakers based on the phase difference between the pitches, which corresponds to the amount of time it takes for sound to travel between the speakers. This distance can be calculated by multiplying the speed of sound in air by the phase difference. The system identifies a minimum amplitude-distance for each speaker. The gain factor for each audio channel is determined by dividing the minimum amplitude-distance by the amplitude-distance determined for the speaker associated with that audio channel. The system can adjust the volume balance based on the determined gain factor for each speaker.

[0109] At least one technical advantage of the disclosed technology over existing technologies is that, using the disclosed technology, the system itself can adjust the volume balance in a multi-channel audio system without relying on a human user to determine the appropriate volume balance between channels. For example, a digital audio workstation can use the disclosed technology to adjust the volume balance without user input. Therefore, the digital audio workstation can perform volume balancing automatically, thereby improving ease of use and efficiency. Volume balancing determines the appropriate volume level for each channel without trial and error or parameter experimentation. Furthermore, there is no need to store volume balance tables in the speaker equipment, and the user does not need to understand the acoustic characteristics of the speakers. These technical advantages provide one or more technical improvements over existing methods.

[0110] 1. Various embodiments include a computer-implemented method for adjusting volume balance, the method comprising: determining an amplitude-distance value among a plurality of amplitude-distance values ​​for each of a plurality of speakers in an audio system, wherein the amplitude-distance value determined for the speaker is based on the amplitude of a first tone detected by a microphone and a distance value determined based on a pair of second tones detected by the microphone; identifying a minimum amplitude-distance value among the plurality of amplitude-distance values; determining a gain factor for each of the plurality of speakers based on a ratio of the minimum amplitude-distance value to the amplitude-distance value determined for the speaker; and adjusting the volume level of each speaker based on the gain factor determined for the speaker.

[0111] 2. The computer-implemented method as described in Clause 1, wherein the amplitude-distance value is determined based on the product of the amplitude of the first tone for the speaker and the distance value for the speaker.

[0112] 3. The computer-implemented method as described in Clause 1 or 2, wherein the distance value is determined based on the phase difference between the pair of second tones.

[0113] 4. The computer-implemented method of any one of claims 1 to 3, wherein the distance value represents the distance between the speaker and the microphone.

[0114] 5. The computer-implemented method of any one of claims 1 to 4, wherein the amplitude of the first tone represents the amplitude of the first tone produced by the speaker as measured by the microphone.

[0115] 6. The computer-implemented method of any one of claims 1 to 5, wherein the volume level of each speaker is adjusted based on a gain factor determined for the speaker and further based on a target volume level.

[0116] 7. The computer-implemented method of any one of claims 1 to 6, wherein the plurality of amplitude-distance values ​​includes at least one auxiliary amplitude-distance value determined for an auxiliary speaker.

[0117] 8. The computer-implemented method of any one of claims 1 to 7, further comprising determining a primary speaker amplitude-distance value among the plurality of amplitude-distance values ​​for a primary speaker among the plurality of speakers, wherein the primary speaker amplitude-distance value corresponds to an amplitude-distance value determined for the primary speaker as measured by a primary microphone associated with the primary speaker.

[0118] 9. The computer-implemented method of any one of claims 1 to 8, wherein the primary speaker amplitude-distance value is determined based on at least one additional amplitude-distance value determined using a secondary microphone associated with a first auxiliary speaker, wherein the at least one additional amplitude-distance value is based on at least one tone generated by the primary speaker and at least one tone generated by the second auxiliary speaker.

[0119] 10. A computer-implemented method according to any one of claims 1 to 9, wherein: a first tone is received from the speaker; a third tone is received from the speaker in the pair of second tones; and a fourth tone is received from another speaker associated with the microphone in the pair of second tones.

[0120] 11. A non-transitory computer-readable medium storing one or more program instructions, which, when executed by one or more processors, cause the one or more processors to perform the following steps: determining an amplitude-distance value among a plurality of amplitude-distance values ​​for each of a plurality of speakers in an audio system, wherein the amplitude-distance value determined for the speaker is based on the amplitude of a first tone detected by a microphone and a distance value determined based on a pair of second tones detected by the microphone; identifying a minimum amplitude-distance value among the plurality of amplitude-distance values; determining a gain factor for each of the plurality of speakers based on a ratio of the minimum amplitude-distance value to the amplitude-distance value determined for the speaker; and adjusting a volume level for the speaker based on the gain factor determined for each speaker.

[0121] 12. One or more non-transitory computer-readable media as described in Clause 11, wherein the amplitude-distance value is determined based on the product of the amplitude of the first tone for the speaker and the distance value for the speaker.

[0122] 13. One or more non-transitory computer-readable media as described in Clause 11 or 12, wherein the distance value is determined based on the phase difference between the pair of second tones.

[0123] 14. One or more non-transitory computer-readable media as described in any one of clauses 11 to 13, wherein the distance value represents the distance between the speaker and the microphone.

[0124] 15. One or more non-transitory computer-readable media as described in any one of clauses 11 to 14, wherein the amplitude of the first tone represents the amplitude of the first tone produced by the speaker as measured by the microphone.

[0125] 16. One or more non-transitory computer-readable media as described in any one of Clauses 11 to 15, wherein the volume level of each speaker is based on the gain factor determined for the speaker and further adjusted based on a target volume level.

[0126] 17. One or more non-transitory computer-readable media as described in any one of clauses 11 to 16, wherein the step further comprises determining a primary speaker amplitude-distance value among the plurality of amplitude-distance values ​​for a primary speaker among the plurality of speakers, wherein the primary speaker amplitude-distance value corresponds to an amplitude-distance value determined for the primary speaker as measured by a primary microphone associated with the primary speaker.

[0127] 18. One or more non-transitory computer-readable media as described in any one of Clauses 11 to 17, wherein the primary speaker amplitude-distance value is determined based on at least one additional amplitude-distance value determined using a secondary microphone associated with a first auxiliary speaker, wherein the at least one additional amplitude-distance value is based on at least one tone produced by the primary speaker and at least one tone produced by a second auxiliary speaker.

[0128] 19. One or more non-transitory computer-readable media as described in any one of clauses 11 to 18, wherein: the first tone is received from the speaker; a third tone of the pair of second tones is received from the speaker; and a fourth tone of the pair of second tones is received from another speaker associated with the microphone.

[0129] 20. A system comprising: a main speaker; a main microphone associated with the main speaker; a first auxiliary speaker and a second auxiliary speaker; a secondary microphone associated with the first auxiliary speaker; one or more memories storing instructions; and one or more processors coupled to the one or more memories, and, upon executing the instructions: determining an amplitude-distance value for the first auxiliary speaker using audio pitches generated by the main speaker and the first auxiliary speaker and acquired by the main microphone; determining an amplitude-distance value for the second auxiliary speaker using audio pitches generated by the main speaker and the second auxiliary speaker and acquired by the main microphone; and determining an amplitude-distance value for the second auxiliary speaker using the amplitude-distance value for the second auxiliary speaker and the audio pitches generated by the main speaker and the first auxiliary microphone. The system generates an audio pitch and collects it from the secondary microphone, and generates an audio pitch from the first auxiliary speaker and the second auxiliary speaker and collects it from the secondary microphone. It then determines an amplitude-distance value for the primary speaker, wherein the amplitude-distance value for the primary speaker is relative to the primary microphone; identifies the minimum amplitude-distance value among the amplitude-distance values ​​for the first auxiliary speaker, the second auxiliary speaker, and the primary speaker; determines a first auxiliary gain factor for the first auxiliary speaker based on the ratio of the minimum amplitude-distance value to the amplitude-distance value for the first auxiliary speaker; and adjusts the volume level of the first auxiliary speaker based on the first auxiliary gain factor.

[0130] Any and all combinations of any claim element listed in any claim and / or any element described in this application in any manner fall within the scope of this disclosure and protection.

[0131] Various embodiments have been described for illustrative purposes and are not intended to be exhaustive or limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments.

[0132] Aspects of this embodiment may be embodied as a system, method, or computer program product. Therefore, aspects of this disclosure may take the form of a completely hardware embodiment, a completely software embodiment (including firmware, resident software, microcode, etc.), or an embodiment combining software and hardware aspects, all of which are generally referred to herein as a "module" or "system." Furthermore, aspects of this disclosure may take the form of a computer program product implemented on one or more computer-readable media having computer-readable program code thereon.

[0133] Any combination of one or more computer-readable media may be used. A computer-readable medium can be a computer-readable signal medium or a computer-readable storage medium. A computer-readable storage medium can be, for example, but not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, apparatuses, or devices, or any suitable combination of the foregoing. More specific examples (not an exhaustive list) of computer-readable storage media will include: an electrical connection having one or more wires, a portable computer floppy disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable optical disc read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing media. In the context of this document, a computer-readable storage medium can be any tangible medium that can contain or store programs for use by or connected to an instruction execution system, apparatus, or device.

[0134] Various aspects of this disclosure are described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to disclosed embodiments. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, or other programmable data processing apparatus to produce a machine such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, can perform the functions / actions specified in one or more blocks of the flowchart illustrations and / or block diagrams. Such processors can be, but are not limited to, general-purpose processors, special-purpose processors, special-purpose processors, or field-programmable gate arrays.

[0135] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this respect, each block in a flowchart or block diagram may represent a module, segment, or portion of code comprising one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions mentioned in the blocks may not appear in the order shown in the drawings. For example, depending on the functionality involved, two blocks shown consecutively may be executed substantially simultaneously, or sometimes the blocks may be executed in reverse order. It should also be noted that each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a special-purpose hardware-based system that performs the specified function or action, or by a combination of special-purpose hardware and computer instructions.

[0136] While the foregoing describes embodiments of this disclosure, other and further embodiments of this disclosure may be devised without departing from the basic scope of this disclosure, as defined by the following claims.

Claims

1. A computer-implemented method for adjusting volume balance, the method comprising: For each of a plurality of speakers in an audio system, an amplitude-distance value is determined from a plurality of amplitude-distance values, wherein the amplitude-distance value determined for the speaker is based on the amplitude of a first tone detected by a microphone and a distance value determined based on a pair of second tones detected by the microphone; Identify the smallest amplitude-distance value among the plurality of amplitude-distance values; For each of the plurality of loudspeakers, a gain factor is determined for that loudspeaker based on the ratio of the minimum amplitude-distance value to the amplitude-distance value determined for that loudspeaker; as well as The volume level of the speaker is adjusted based on the gain factor determined for each speaker.

2. The computer-implemented method of claim 1, wherein the amplitude-distance value is determined based on the product of the amplitude of the first tone for the speaker and the distance value for the speaker.

3. The computer-implemented method of claim 1, wherein the distance value is determined based on the phase difference between the pair of second tones.

4. The computer-implemented method of claim 1, wherein the distance value represents the distance between the speaker and the microphone.

5. The computer-implemented method of claim 1, wherein the amplitude of the first tone represents the amplitude of the first tone produced by the speaker as measured by the microphone.

6. The computer-implemented method of claim 1, wherein the volume level of each speaker is adjusted based on the gain factor determined for the speaker and further based on a target volume level.

7. The computer-implemented method of claim 1, wherein the plurality of amplitude-distance values ​​includes at least one auxiliary amplitude-distance value determined for the auxiliary speaker.

8. The computer-implemented method of claim 1, further comprising determining a primary speaker amplitude-distance value among the plurality of amplitude-distance values ​​for a primary speaker among the plurality of speakers, wherein the primary speaker amplitude-distance value corresponds to an amplitude-distance value determined for the primary speaker as measured by a primary microphone associated with the primary speaker.

9. The computer-implemented method of claim 8, wherein the primary speaker amplitude-distance value is determined based on at least one additional amplitude-distance value determined using a secondary microphone associated with a first auxiliary speaker, wherein the at least one additional amplitude-distance value is based on at least one tone generated by the primary speaker and at least one tone generated by the second auxiliary speaker.

10. The computer-implemented method as described in claim 1, wherein: Receive the first tone from the speaker; Receives the third tone from the pair of second tones from the loudspeaker; and The fourth tone of the pair of second tones is received from another speaker associated with the microphone.

11. A non-transitory computer-readable medium storing one or more program instructions, which, when executed by one or more processors, cause the one or more processors to perform the following steps: For each of a plurality of speakers in an audio system, an amplitude-distance value is determined from a plurality of amplitude-distance values, wherein the amplitude-distance value determined for the speaker is based on the amplitude of a first tone detected by a microphone and a distance value determined based on a pair of second tones detected by the microphone; Identify the smallest amplitude-distance value among the plurality of amplitude-distance values; For each of the plurality of loudspeakers, a gain factor is determined for that loudspeaker based on the ratio of the minimum amplitude-distance value to the amplitude-distance value determined for that loudspeaker; as well as The volume level of the speaker is adjusted based on the gain factor determined for each speaker.

12. One or more non-transitory computer-readable media as claimed in claim 11, wherein the amplitude-distance value is determined based on the product of the amplitude of the first tone for the speaker and the distance value for the speaker.

13. One or more non-transitory computer-readable media as claimed in claim 11, wherein the distance value is determined based on the phase difference between the pair of second tones.

14. One or more non-transitory computer-readable media as claimed in claim 11, wherein the distance value represents the distance between the speaker and the microphone.

15. One or more non-transitory computer-readable media as claimed in claim 11, wherein the amplitude of the first tone represents the amplitude of the first tone produced by the speaker as measured by the microphone.

16. One or more non-transitory computer-readable media as claimed in claim 11, wherein the volume level of each speaker is adjusted based on the gain factor determined for the speaker and further based on a target volume level.

17. The one or more non-transitory computer-readable media of claim 11, wherein the step further comprises determining a primary speaker amplitude-distance value among the plurality of amplitude-distance values ​​for a primary speaker among the plurality of speakers, wherein the primary speaker amplitude-distance value corresponds to an amplitude-distance value determined for the primary speaker as measured by a primary microphone associated with the primary speaker.

18. One or more non-transitory computer-readable media as claimed in claim 17, wherein the primary speaker amplitude-distance value is determined based on at least one additional amplitude-distance value determined using a secondary microphone associated with a first auxiliary speaker, wherein the at least one additional amplitude-distance value is based on at least one tone generated by the primary speaker and at least one tone generated by a second auxiliary speaker.

19. One or more non-transitory computer-readable media as claimed in claim 11, wherein: Receive the first tone from the speaker; Receives the third tone from the pair of second tones from the loudspeaker; and The fourth tone of the pair of second tones is received from another speaker associated with the microphone.

20. A system comprising: Main speaker; The main microphone associated with the main speaker; First auxiliary loudspeaker and second auxiliary loudspeaker; A secondary microphone associated with the first auxiliary speaker; One or more memory storing instructions; and One or more processors, said one or more processors being coupled to said one or more memories and, when executing said instructions: The amplitude-distance value for the first auxiliary speaker is determined using the audio pitch generated by the main speaker and the first auxiliary speaker and acquired by the main microphone; The amplitude-distance value for the second auxiliary speaker is determined using the audio pitch generated by the main speaker and the second auxiliary speaker and acquired by the main microphone; The amplitude-distance value for the main speaker is determined using the amplitude-distance value for the second auxiliary speaker, the audio pitch generated by the main speaker and the first auxiliary speaker and captured by the secondary microphone, and the audio pitch generated by the first auxiliary speaker and the second auxiliary speaker and captured by the secondary microphone, wherein the amplitude-distance value for the main speaker is relative to the main microphone; Identify the minimum amplitude-distance value among the amplitude-distance value for the first auxiliary speaker, the amplitude-distance value for the second auxiliary speaker, and the amplitude-distance value for the main speaker; For the first auxiliary loudspeaker, a first auxiliary gain factor is determined based on the ratio of the minimum amplitude-distance value to the amplitude-distance value for the first auxiliary loudspeaker; as well as The volume level of the first auxiliary speaker is adjusted based on the first auxiliary gain factor.

Images