Method and apparatus for reducing unwanted sound transmission

Abstract

The present disclosure relates to reducing unwanted sound transmission. A method for reducing the audibility of sound generated by an audio device comprises: generating an audio output by the audio device at a first position; detecting a detected audio signal corresponding to the audio output in the form of multiple frequency bands at a second position different from the first position; determining an audio transfer function for attenuating one or more frequency bands of the audio output based on the detected audio signal and multiple thresholds, wherein for a given frequency band, when the given frequency band of the detected audio signal exceeds the corresponding threshold, the audio transfer function attenuates the given frequency band of the audio output; and modifying the audio output by the audio device by applying the audio transfer function.

Description

[0001] This application is a divisional application based on the Chinese invention patent application with application date of January 8, 2019, application number 2019800075013, and invention name “REDUCING UNWANTED SOUND TRANSMISSION”. Technical Field

[0002] The present disclosure relates to using intercommunication between devices to reduce audio transmission between adjacent rooms. Background Art

[0003] Unless otherwise indicated herein, the approaches described in this section are not prior art to the claims in this application and are not admitted to be prior art by inclusion in this section.

[0004] A typical home includes multiple rooms, such as a living room, dining room, and one or more bedrooms. Sometimes, audio generated by an audio device in one room may be perceived in another room. This can be distracting if someone is trying to sleep or the level of audio being listened to in another room is masked by audio from an adjacent room. Summary of the invention

[0005] In view of the above, there is a need to reduce audio perceived in adjacent rooms. Embodiments relate to communication between two audio devices in separate rooms. Audio transmission characteristics from one room to another are determined by playing audio via one device and detecting the transmitted audio by another device. The transmission characteristics can be determined on a frequency band-by-band basis. This allows for frequency band-by-band adjustments during audio playback to reduce transmission from one room to another.

[0006] The audio device may determine an audio transfer function for adjusting at least some frequency bands of the audio output to at least reduce transmission from one listening area to another listening area based on a comparison of the audio output to the detected audio.

[0007] Further features may include dividing the audio output and detected audio into spectral bands; performing a per band comparison of the detected audio to band-specific threshold levels; and reducing the audio output only for those bands where the detected audio exceeds the band-specific threshold levels (e.g., set at audible levels for human hearing in each specific band). Another further feature may include, when outputting audio in one room, detecting ambient sound in another room and comparing the ambient sound to known audio outputs to determine if audio is passing from one listening area to another. Another further feature may include adapting the audio output based on conversation characteristics to enhance the intelligibility of the audio output.

[0008] According to an embodiment, a method reduces the audibility of sounds generated by an audio device. The method includes generating an audio output by the audio device at a first position. The method further includes detecting a detected audio signal corresponding to the audio output at a second position different from the first position. The method further includes transmitting information related to the detected audio signal to the audio device, for example, transmitting the information from the second position to the audio device. The method further includes determining, by the audio device, an audio transfer function for attenuating one or more frequency bands based on the information. The method further includes modifying the audio output by the audio device by applying the audio transfer function. In this way, the audibility of the audio output from the audio device can be reduced at the second position.

[0009] Determining the audio transfer function may include comparing the information related to the detected audio signal, the information related to the audio output, and at least one threshold value.

[0010] A physical barrier may separate the first location and the second location, and the audio device may determine the audio transfer function of the detected audio signal based on the audio output as modified by the physical barrier.

[0011] The audio device may be a first audio device; a second audio device at the second location may detect the detected audio signal, and the second audio device may transmit the information related to the detected audio signal to the first audio device. The first audio device may modify the audio output while the second audio device detects the detected audio signal. Alternatively, the second audio device may detect the detected audio signal during a setup phase; the first audio device may determine the audio transfer function during the setup phase; and the first audio device may modify the audio output during an operation phase following the setup phase.

[0012] The audio output may include a plurality of frequency bands, and modifying the audio output includes modifying (e.g., attenuating) the audio output at one or more of the plurality of frequency bands. The plurality of frequency bands may be defined according to a physiological response of human hearing. Modifying the audio output may include modifying the audio output at one or more of the plurality of frequency bands by one or more different amounts based on a comparison of the audio output and information associated with the detected audio signal, optionally further taking into account an ambient noise level at the second location.

[0013] The audio transfer function may be determined based on a measured transfer characteristic between the first position and the second position, thereby taking into account an ambient noise level at the second position. In an example, the ambient noise is determined by comparing the information related to the detected audio signal with the audio output. In another example, the ambient noise is determined before the audio device generates an audio output (e.g., by detecting an audio signal representing the ambient noise at the second position in the absence of any audio output by the audio device at the first position).

[0014] Optionally, ambient noise is determined for each of the one or more frequency bands.

[0015] Optionally, the method includes determining whether the ambient noise masks one or more frequency bands in the detected audio signal, wherein, in response to determining that the ambient noise masks one or more frequency bands in the detected audio signal, the audio transfer function does not attenuate frequency bands of the audio output corresponding to the one or more masked frequency bands.

[0016] For example, for each frequency band, it is determined whether the level of the detected audio signal in the frequency band exceeds the ambient noise level of the frequency band, and only in response to determining that the detected audio signal exceeds the ambient noise level of the frequency band, the audio output is attenuated for the frequency band by the audio transfer function. For frequency bands where the level of the detected audio signal does not exceed the ambient noise level (e.g., when the level of the detected audio signal is equal to or lower than the ambient noise level), no attenuation is applied.

[0017] Optionally, a predetermined threshold is used in the comparison of the detected audio signal and the ambient noise level. For example, it is determined whether the detected audio signal exceeds the ambient noise level by at least a predetermined threshold. The predetermined threshold may be the same for all frequency bands, or a separate threshold may be provided for each frequency band.

[0018] The audio transfer function may be determined based on measured transfer characteristics between the first location and the second location and a physiological response of human hearing.

[0019] The audio device comprises a plurality of speakers, and modifying the audio output may comprise controlling speaker directivity using the plurality of speakers to adjust the positional response of the audio output such that a level of the detected audio signal at the second position is reduced.

[0020] The audio output may be modified using at least one of loudness leveling and loudness domain processing.

[0021] The method may further include continuously detecting an ambient noise level at the second location using a microphone, and using machine learning to determine at least one pattern in the detected ambient noise level, wherein the audio output is modified based on the audio transfer function and the at least one pattern. The microphone may be a microphone of the second audio device described above.

[0022] The method may further include generating, by a third audio device, a second audio output at a third location, wherein the detected audio signal detected at the second location corresponds to the audio output and the second audio output, wherein the information is related to the detected audio signal and the second detected audio signal, and wherein the information is transmitted to the audio device and the third audio device. The method may further include determining, by the third audio device, a second audio transfer function for attenuating one or more frequency bands of the second audio output based on the information. The method may further include modifying, by the third audio device, the second audio output by applying the second audio transfer function.

[0023] According to an embodiment, an apparatus includes an audio device, a processor, a memory, a speaker, and a network component. The processor is configured to control the audio device to perform a process, the process including generating an audio output by the speaker at a first location; receiving information related to a detected audio signal from a second location different from the first location by the network component, the detected audio signal corresponding to the audio output detected at the second location; determining, by the processor based on the information, an audio transfer function for attenuating one or more frequency bands of the audio output; and modifying, by the processor, the audio output based on the audio transfer function.

[0024] According to an embodiment, a system reduces the audibility of sounds generated by an audio device. The system includes a first audio device and a second audio device. The first audio device includes a processor, a memory, a speaker, and a network component, and the second audio device includes a processor, a memory, a microphone, and a network component. The processor of the first audio device and the processor of the second audio device are configured to control the first audio device and the second audio device to perform processing, the processing including: generating an audio output by the speaker of the first audio device at a first position; detecting a detected audio signal corresponding to the audio output by the microphone of the second audio device at a second position different from the first position; transmitting information related to the detected audio signal from the second position to the network component of the first audio device via the network component of the second audio device; determining, by the processor of the first audio device, an audio transfer function for attenuating one or more frequency bands of the audio output based on the information; and modifying the audio output by the processor of the first audio device by applying the audio transfer function.

[0025] According to an embodiment, a non-transitory computer readable medium stores a computer program for controlling an audio device to reduce the audibility of sounds generated by the audio device. The device may include a processor, a memory, a speaker, and a network component. The computer program, when executed by the processor, may control the audio device to perform one or more of the method steps described above.

[0026] The following detailed description and accompanying drawings provide a further understanding of the nature and advantages of various embodiments. BRIEF DESCRIPTION OF THE DRAWINGS

[0027] Figure 1 is a diagram of acoustic environment 100 .

[0028] Figure 2 is a flow chart of a method 200 of reducing the audibility of sounds generated by an audio device.

[0029] Figure 3 is a flow chart of a method 300 of configuring and operating an audio device.

[0030] Figure 4 is a block diagram of the audio device 400 .

[0031] Figure 5 is a block diagram of the audio device 500 .

[0032] FIG. 6A to FIG. 6E is a table illustrating examples of thresholds and frequency bands for audio output and detected audio signals. DETAILED DESCRIPTION

[0033] This article describes techniques for reducing audio transmission between adjacent rooms. In the following description, for the purpose of explanation, many examples and specific details are set forth in order to provide a thorough understanding of the present disclosure. However, it is apparent to those skilled in the art that the present disclosure as defined by the claims may include some or all of the features in these examples alone or in combination with other features described below, and may further include modifications and equivalents of the features and concepts described herein.

[0034] In the following description, various methods, processes, and procedures are described in detail. Although a particular step may be described in the form of a gerund, this wording also indicates a state in the form. For example, "storing data in a memory" may at least indicate the following: the data is currently stored in the memory (e.g., the memory did not previously store the data); the data currently exists in the memory (e.g., the data was previously stored in the memory); etc. When it is not clear from the context, this situation will be clearly indicated. Although specific steps may be described in a specific order, this order is mainly for convenience and clarity. A specific step may be repeated more than once, may occur before or after other steps (even if the steps are otherwise described in another order), and may occur in parallel with other steps. The second step is required to follow the first step only if the first step must be completed before the second step begins. When it is not clear from the context, this situation will be clearly indicated.

[0035] In this document, the terms "and", "or", and "and / or" are used. Such terms should be understood to have an inclusive meaning. For example, "A and B" may at least mean the following meanings: "both A and B", "at least both A and B". As another example, "A or B" may at least mean the following meanings: "at least A", "at least B", "both A and B", "at least both A and B". As another example, "A and / or B" may at least mean the following meanings: "A and B", "A or B". When exclusive OR is intended, this will be clearly indicated (e.g., "either A or B", "at most one of A and B").

[0036] This document uses the terms "audio", "sound", "audio signal", and "audio data". In general, these terms are used interchangeably. When specificity is desired, the terms "audio" and "sound" are used to refer to input captured by a microphone or output generated by a speaker. The term "audio data" is used to refer to data representing audio, such as as processed by an analog-to-digital converter (ADC), as stored in a memory, or as transmitted via a data signal. The term "audio signal" is used to refer to audio detected, processed, received, or transmitted in analog or digital electronic form.

[0037] Figure 1 1 is a diagram of an acoustic environment 100. Examples of acoustic environments 100 include a house, an apartment, and the like. Acoustic environment 100 includes room 110 and room 112. Acoustic environment 100 may include other rooms (not shown). Room 110 and room 112 may be adjacent as shown or may be separated by other rooms or spaces (e.g., a hallway). Room 110 and room 112 may be on the same floor (as shown) or on different floors. Room 110 and room 112 may also be referred to as locations.

[0038] Room 110 and room 112 are separated by a physical barrier 114. Physical barrier 114 may include one or more parts, such as door 116, wall 118, floor, ceiling, etc.

[0039] The audio device 130 is located in the room 110, and the audio device 140 is located in the room 112. The audio device 130 includes a speaker 132 and may include other components. The audio device 140 includes a microphone 142 and may include other components. The audio device 130 and the audio device 140 may be audio devices of the same type (e.g., both have a speaker and a microphone). The speaker 132 generates an audio output 150, and the microphone 142 detects an audio signal 152 corresponding to the audio output 150. Although each audio device can perform two functions at various times (e.g., the first device generates an audio output and listens to the audio output from the second device, and the second device generates an audio output and listens to the audio output from the first device), for ease of description, the audio device 130 may be referred to as an active audio device (e.g., actively generates an audio output), and the audio device 140 may be referred to as a listening audio device (e.g., listens to the output from the active audio device).

[0040] Typically, audio device 130 modifies (eg, reduces) its audio output in response to audio detected by audio device 140 (eg, when the detected audio is above a threshold). Figure 2 More details about the operation of audio device 130 and audio device 140 are described.

[0041] Figure 2 2 is a flow chart of a method 200 for reducing the audibility of a sound generated by an audio device. For example, the method 200 may be performed by the audio device 130 and the audio device 140 (see Figure 1 ) is performed to reduce the audibility of sounds generated in room 110 and perceived in room 112.

[0042] At 202, an audio device generates an audio output at a first location. For example, the audio device 130 (see Figure 1 ) can generate audio output 150 in room 110.

[0043] At 204, an audio signal is detected at the second location (referred to as a "detected audio signal"). The detected audio signal corresponds to an audio output as modified according to various factors such as distance, attenuation (e.g., due to physical barriers), and other sounds (e.g., ambient noise). For example, the audio device 140 (see Figure 1 ) can detect a detected audio signal 152 in the room 112, wherein the detected audio signal 152 corresponds to the audio output 150 generated in the room 110 as modified by the distance between the speaker 132 and the microphone 142 and the attenuation applied by the wall 118 and the door 116.

[0044] At 206, information related to the detected audio signal is transmitted from the second location to the audio device (e.g., Figure 1 For example, the audio device 140 (see Figure 1 ) can transmit information related to the detected audio signal from room 112 to audio device 130 in room 110.

[0045] At 208, an audio device (eg, Figure 1 The audio device 130 of the present invention may determine the audio transfer function based on the information (transmitted at 206). For example, the audio device 130 may determine the audio transfer function based on the information from the audio device 140. As an example, the audio device 130 may compare the audio output 150 and the information related to the detected audio signal 152 to determine the audio transfer function. Generally, the audio transfer function is generated to attenuate the audio signal 150 as detected in another room. The audio transfer function may correspond to different attenuations applied to different frequency bands of the audio output 150. Generally, if the detected audio signal 152 exceeds a defined threshold in a particular frequency band, the audio transfer function will attenuate the particular frequency band. For example, as the level at which the detected audio exceeds the threshold increases, the attenuation may increase.

[0046] When determining the audio transfer function, the audio device may also take into account the ambient noise at the second location. For example, if there is fan noise in the second room, the audio device in the first room may determine the presence of fan noise by comparing information associated with the detected audio signal (which includes the fan noise) and the audio output (the audio output does not include the fan noise). In this way, the audio device may determine the audio transfer function so that the audio device excludes consideration of the fan noise, so that only the propagation of the audio output into the second location is considered and the ambient sound at the second location is excluded. The ambient noise may include any sound that does not correspond to the audio output attenuated by transmission from the first location to the second location. In other words, the ambient noise may include one or more components of the detected audio that cannot be attributed to the transmission of the audio output from the first location to the second location. For example, the ambient noise may be determined from a comparison between the audio detected at the second location and the audio output at the first location.

[0047] At 210, an audio device (eg, Figure 1The audio device 130 of the room 112 may modify the audio output based on the audio transfer function (i.e., by applying the audio transfer function). For example, if it is determined that the detected audio signal 152 is above a threshold in a particular frequency band, the application of the audio transfer function by the audio device 130 may reduce the audio output 150 so that the detected audio signal 152 (when subsequently detected) falls below the threshold. As an example, the physical barrier 114 may not adequately attenuate low-frequency components of the audio output 150, so the audio device 130 may reduce the audio output 150 in the corresponding frequency band. As another example, the room 112 may have fan noise that masks a given frequency band in the detected audio signal 152, so the audio device 130 may not need to reduce the audio output 150 in the given frequency band (but may reduce the audio output 150 in other frequency bands). The method 200 may then return to 202 for continued modification of the audio output.

[0048] Method steps 204 to 208 may be performed simultaneously with method step 202 and method step 210. For example, in the audio device 130 (see Figure 1 ) generates an audio output 150 (step 202), the audio device receives information related to the detected audio signal 152 (step 206), determines an audio transfer function (step 208), and dynamically modifies the audio output 150 (step 210). In this way, the audio device 130 reacts to changing conditions.

[0049] Alternatively, as referenced Figure 3 As further described, one or more of method steps 204 to 208 may be performed during a setup phase, and steps 202 and 210 may be performed during an operation phase.

[0050] Figure 3 is a flow chart of a method 300 of configuring and operating an audio device. Figure 1 The audio device 130 and the audio device 140) operate simultaneously, and the audio devices can operate in two stages: a setting stage and an operation stage.

[0051] At 302, the audio devices enter a setup phase. The audio devices may be referred to as a primary audio device (generally corresponding to audio device 130) and a secondary audio device (generally corresponding to audio device 140). The secondary audio device may be implemented with a mobile device (e.g., a mobile phone) executing a setup application. The primary audio device is located at a first location (e.g., in room 110), and the secondary audio device is located at a second location (e.g., in room 112).

[0052] At 304, the main audio device outputs a test audio output. (The test audio output is similar to Figure 1) Typically, the test audio output covers a range of levels and frequencies.

[0053] At 306, the secondary audio device detects a detected test audio signal corresponding to the test audio output. (The detected test audio signal is similar to Figure 1 The detected audio signal 152. )

[0054] At 308, the secondary audio device transmits information related to the detected test audio signal to the primary audio device.

[0055] At 310, the host audio device determines an audio transfer function based on the information. Since the test audio output covers a range of levels and frequencies, the method determines the attenuation of the test audio output at the second location (eg, due to the physical barrier 114, etc.). At this point, the setup phase ends.

[0056] At 312, the master audio device enters an operation phase.

[0057] At 314, the main audio device modifies the audio output based on the audio transfer function and outputs the modified audio output. For example, if the level of a specific frequency band of the detected audio is higher than a threshold, the main audio device reduces the audio output in the specific frequency band.

[0058] The device may re-enter the setup phase at a later time as needed. For example, if during initial setup the door 116 (see Figure 1 ) is closed, and then the door 116 is opened, the user may desire the primary audio device to re-determine the audio transfer function. As another example, if the user desires to reconfigure the primary audio device to accommodate the detected audio signal at the third position, the user may place the secondary audio device at the third position and re-enter the setup phase to determine the audio transfer function associated with the third position.

[0059] Figure 4 4 is a block diagram of an audio device 400. The audio device 400 may correspond to the audio device 130 or the audio device 140 (see Figure 1 ). The audio device 400 may implement the method 200 (see Figure 2 ) or method 300 (see Figure 3 ). Audio device 400 includes processor 402, memory 404, network component 406, speaker 408, and microphone 410. Audio device 400 may include other components, which are not described in detail for the sake of brevity. The hardware of audio device 400 may be implemented by an existing device that has been modified to have additional functionality as described throughout this document, such as the Echo from Amazon. TM The device may be HomePod from AppleTM equipment.

[0060] The processor 402 generally controls the operation of the audio device 400. The processor 402 may implement the method 200, for example, by executing one or more computer programs (see Figure 2 ) or method 300 (see Figure 3 ) steps.

[0061] The memory 404 generally provides storage for the audio device 400. The memory 404 may store programs executed by the processor 402, various configuration settings, and the like.

[0062] Network component 406 generally enables electronic communication between audio device 400 and other devices (not shown). For example, when audio device 400 is used to implement audio device 130 and audio device 140 (see Figure 1 ), the network component 406 enables electronic communication between the audio device 130 and the audio device 140. As another example, the network component 406 can connect the audio device 400 to a router device (not shown), a server device (not shown), or another device that serves as an intermediary between the audio device 400 and another device. The network component 406 can implement wireless protocols such as IEEE 802.11 protocols (e.g., wireless local area networking), IEEE 802.15.1 protocols (e.g., Bluetooth TM Standards) etc. Typically, the network component 406 implements the transmission of information related to the detected audio signal (see Figure 2 206).

[0063] Speaker 408 typically outputs audio output (eg, corresponding to Figure 1 The speaker 408 may be one of a plurality of speakers that are part of the audio device 400.

[0064] Microphone 410 generally detects audio signals. As discussed above, when audio device 400 implements audio device 140 (see Figure 1 ), the microphone 410 detects the audio signal 152 propagating from the audio device 130 into the room 112. The microphone 410 can also detect other audio inputs near the audio device 400, such as fan noise, ambient noise, conversations, etc.

[0065] As an alternative to having both the speaker 408 and the microphone 410, the audio device 400 may have only one of the speaker and the microphone. As an example, the audio device 400 may omit the microphone 410. As another example, the audio device 400 may omit the speaker 408.

[0066] Figure 5 500 is a block diagram of an audio device 500. Figure 4 ), the audio device 500 includes a speaker array 508. The speaker array 508 includes a plurality of speakers (shown as 408a, 408b, and 408c). The audio device 500 also includes a processor 402, a memory 404, a network component 406, and a microphone 410, as described above with respect to the audio device 400 (see Figure 4 (As discussed above with respect to audio device 400, microphone 410 may be omitted from audio device 500.)

[0067] The speaker array 508 can apply speaker directivity to its audio output in order to reduce detected audio in adjacent rooms. Generally, speaker directivity refers to adjusting the size, shape, or direction of the audio output. Speaker directivity can be implemented by using only a subset of the speakers in the speaker array 508, by selecting only a subset of the drivers for the speaker array 508, or by using multiple drivers for beamforming. Generally, beamforming includes adjusting the output (such as delay, volume, and phase) from each speaker to control the size, shape, or direction of the aggregate audio output. For example, the level of the audio output can be increased in one direction or position and decreased in another direction or position.

[0068] When audio device 500 modifies its audio output (see Figure 2 210), the audio device can control the speaker directionality. For example, if information related to the detected audio signal from another room (see Figure 2 206) exceeds a threshold value in a particular frequency band, the audio device 500 can modify the speaker directivity to adjust the direction or position of the audio output and monitor the result. If subsequent information related to the detected audio signal indicates that the detected audio signal no longer exceeds the threshold value, the directivity adjustment has been successful; otherwise, the audio device 500 provides a different directivity adjustment to the radiation pattern or position of the audio output.

[0069] The following sections describe additional features of the audio devices discussed herein.

[0070] frequency band

[0071] In general, a transfer function refers to a function that maps various input values ​​to various output values. As used herein, an audio transfer function refers to the amplitude of the output as a function of the frequency of the input. An audio device may determine an audio transfer function on a per-band basis, where each particular band has a different amount of attenuation applied to its amplitude.

[0072] The audio devices described herein (e.g., Figure 4 The audio device 400 of the present invention can use different thresholds for different frequency bands of the detected audio signal. If the information related to the detected audio signal exceeds the threshold in a specific frequency band, the audio device determines an audio transfer function that reduces the amplitude of the audio output in the specific frequency band when applied to the audio output. For example, a low frequency band can have a lower threshold than a mid-frequency band or a high frequency band. The threshold can be defined based on human psychoacoustics. For example, if human hearing is more sensitive in a first band than in a second band, the threshold for the first band can be set lower than the threshold for the second band.

[0073] The thresholds may be set according to a psychoacoustic model of human hearing. An example of a psychoacoustic model using thresholds is described by BCJ Moore, B. Glasberg, T. Baer, ​​"A Model for the Prediction of Thresholds, Loudness, and Partial Loudness", Journal of the Audio Engineering Society, Vol. 45, No. 4, April 1997, pp. 224-240. In this model, a set of critical band filter responses are evenly spaced along an equivalent rectangular bandwidth (ERB) scale, where each filter shape is described by a rounded exponential function and the bands are distributed using intervals of 1 ERB. The number of filter responses in the set may be 40 or 20 or another suitable value. Another example of a psychoacoustic model using thresholds is described in U.S. Pat. No. 8,019,095.

[0074] When a threshold is exceeded in a particular frequency band, the audio device may apply a gradual reduction in dB to the audio output. For example, when a detected audio signal exceeds a threshold of 5 dB in a particular band, the audio device may gradually (e.g., over a span of 5 seconds) apply a 5 dB reduction in the particular band to the audio output using an audio transfer function.

[0075] Alternatively, the band-specific thresholds may be determined based on both the ambient noise level that has been determined for the particular band and a predetermined threshold for the band (e.g., based on a psychoacoustic model). For example, each band-specific threshold may be the maximum of the predetermined threshold levels for the band based on a psychoacoustic model (the psychoacoustic model being independent of the actual audio output and the actual noise level) and the ambient noise level for the band (the ambient noise level being based on the actual noise at the second location). Thus, the band-specific thresholds based on the psychoacoustic model will be used except where the ambient noise level exceeds the threshold level.

[0076] FIG. 6A to FIG. 6E is a table illustrating examples of thresholds and frequency bands for audio output and detected audio signals. Fig. 6A The level of the audio output in the first position is shown, the level being 100 dB in each of the three bands. (For ease of illustration, only three bands are shown, but as discussed above, the audio device may implement more than three bands, e.g., 20 to 40 bands.) Figure 6B The levels of the detected audio signal at the second position are shown, the levels being 75 dB in the first band, 60 dB in the second band, and 50 dB in the third band. Fig. 6A and Figure 6B It should be noted that the transmission characteristic between the two positions is more transmissive for the first band than for the second band, and more transmissive for the second band than for the third band.

[0077] Figure 6C Thresholds for three bands are shown, which are 70 dB, 60 dB and 55 dB. Figure 6B and Figure 6C It should be noted that the threshold is exceeded by 5 dB in the first band, so the audio device determines an audio transfer function that reduces the audio output in said band (eg, gradually by 5 dB).

[0078] Fig.6D The level of the audio output at the first position is shown as a result of applying the audio transfer function. Fig. 6A and Fig.6D It should be noted that the audio output in the first band is now 95dB (previously 100dB), and the other bands are unchanged. Fig. 6E shows the level of the detected audio signal at the second position; note that all bands are now at or below Figure 6C The threshold value.

[0079] In effect, the audio device operates as a multi-band compressor / limiter of the audio output based on comparing the threshold value to the detected audio signal.

[0080] Audio Processing

[0081] The audio devices described herein (e.g., Figure 4 The audio device 400 may implement one or more audio processing techniques to modify the audio output (see Figure 2 210 in ). For example, the audio device may implement Audio TM Solutions Digital Plus Solutions, Multi-stream decoder MS 12 solution or other suitable audio processing technology. The audio device can use various features to modify the audio output, such as a dialogue enhancer feature, a volume leveler feature, an equalizer feature, an audio regulator feature, etc. For example, if the audio device determines that the audio output includes dialogue, the audio device can activate the dialogue enhancer feature before applying the audio transfer function. As another example, the audio device can apply the volume leveler feature before applying the audio transfer function. As another example, if the information related to the detected audio signal from another room exceeds a threshold in the specific frequency band, the audio device can use the equalizer feature to adjust the level of the audio output in the specific frequency band. As another example, before applying the audio transfer function, the audio device can use the audio regulator feature (traditionally used to keep the speaker within the defined limits to avoid distortion (usually lower frequency distortion)) to reduce the selected frequency band (for example, using a multi-band compressor).

[0082] Machine Learning

[0083] The audio devices described herein (e.g., Figure 4 The audio device 400 of the present invention can collect usage statistics and perform machine learning to determine the usage pattern, and the determined usage pattern can be used when adjusting the audio output. The usage pattern can be combined into a daily pattern, a weekday to weekend pattern, etc. For example, if the amount of ambient noise in the adjacent room is low between midnight and 6 am during most days, this can indicate that someone is sleeping in the adjacent room; as a result of this usage pattern, the audio device can also reduce its audio output during the time period even if there is no detected audio signal exceeding the threshold. As another example, the ambient noise in the adjacent room can shift to a later period on weekends (corresponding to the person in the adjacent room staying up later and sleeping later); as a result of this usage pattern, the audio device can reduce its audio output at a later time than during weekdays. As another example, if the user moves the audio device within a first position (or moves from a first position to a different position), the usage statistics will begin to reflect the new position (relative to the second position, due to the change of transmission, directionality, etc.), and machine learning ultimately causes the audio output to be adjusted according to the new position.

[0084] Once the audio device identifies a usage pattern, the audio device may ask the user to confirm the usage pattern. For example, when the audio device identifies a quiet period in an adjacent room between midnight and 6 a.m. on weekdays, the audio device asks the user to confirm this usage pattern. The audio device may also reset its usage statistics, for example, based on a user selection. For example, Figure 1In an arrangement of , if the audio device 140 is moved to a third room (not shown), the user may select the audio device 130 to reset its usage statistics to conform to the new location of the audio device 140.

[0085] The audio devices described herein (e.g., Figure 5 The audio device 500) can collect usage statistics and perform machine learning when performing speaker directivity control on the audio output. This allows the audio device to establish a speaker directivity map at the location of another audio device and select a speaker directivity configuration that has worked in the past to reduce the detected audio signal at the second location. For example, Figure 1 In an arrangement of , the audio device 130 initially does not perform speaker directivity control, and the audio output 150 is directed at 0 degrees. Based on the detected audio signal 152, the audio device 130 adjusts its radiation pattern; the machine learning indicates that the maximum level of the detected audio signal 152 is when the audio output 150 is directed at 0 degrees, and falls below a threshold when the audio output 150 is directed at +30 degrees (e.g., 30 degrees to the right when viewed from above). When the audio device 130 performs speaker directivity control at a future time, the audio device can use +30 degrees as the selected primary acoustic radiation direction, and then monitor for the level of the detected audio signal 152 to fall below the threshold.

[0086] Preset Features

[0087] The audio devices described herein (e.g., Figure 4 Rather than continuously detecting a detected audio signal and modifying the audio output (e.g., Figure 2 ) or perform setup functions (for example, Figure 3 ). Each generic audio transfer function may correspond to one of a variety of listening environment configurations, wherein the values ​​in each audio transfer function may be empirically calculated for the various listening environment configurations. For example, the listening environment configurations may include a small apartment (e.g., 1 bedroom and 2 other rooms), a large apartment (e.g., 3 bedrooms and 3 other rooms), a townhouse with 2 floors, a townhouse with 3 floors, a small house (e.g., 2 bedrooms and 4 other rooms), a large house (e.g., 4 bedrooms and 6 other rooms), a large house with 2 floors, and the like. When the user selects the relevant listening environment configuration, the user may also indicate the room location of the audio device, which may affect the audio transfer function. For example, when the audio device is placed in a bedroom, the audio transfer function may attenuate the audio output less than when the audio device is placed in a living room.

[0088] Client-Server Characteristics

[0089] As discussed above (e.g., Figure 2 206), audio equipment (e.g., Figure 1 Alternatively, the server device may receive information related to the detected audio signal from the second location (e.g., transmitted by the audio device 140), determine the audio transfer function, and transmit the audio transfer function to the first location (e.g., to the audio device 130). The server device may be a computer located in a residence with the audio device, or the server device may be located remotely (e.g., a cloud service accessed via a computer network).

[0090] The server may also collect usage statistics from the audio devices, may perform machine learning on the usage statistics, and may provide the results to the audio devices. For example, the audio device 140 in the second room may send its usage statistics to the server; the server may perform machine learning and determine that there is typically no ambient noise in the second room between midnight and 6 a.m.; the server sends its analysis results to the audio device 130 in the first room; and the audio device 130 modifies the audio output accordingly.

[0091] Multi-device features

[0092] As shown above (e.g., Figure 1 ), the acoustic environment 100 is discussed in the context of two rooms and audio devices in each room. These features can be extended to operate in more than two rooms and more than two audio devices: each audio device can generate an audio output and detect an audio signal from another audio device. For example, if there are three rooms and three audio devices, the first audio device can generate an audio output and can detect audio signals from the second audio device and the third audio device; the second audio device can generate an audio output and can detect audio signals from the first audio device and the third audio device; the third audio device can generate an audio output and can detect audio signals from the first audio device and the second audio device.

[0093] Each audio device can then determine an audio transfer function based on the detected audio signals from each of the other audio devices. Returning to the three device example, if (from the perspective of the first audio device) the detected audio signal from the second audio device exceeds a threshold in a first frequency band, and the detected audio signal from the third audio device exceeds a threshold in a second frequency band, then the first audio device can determine the audio transfer function as a combined function that attenuates the audio output in the first frequency band and the second frequency band.

[0094] Each audio device may determine the presence of other nearby audio devices based on the implemented network protocol. For example, for IEEE 802.11 network protocols, individual audio devices may discover each other via wireless ad hoc networking, or may each connect to a wireless access point that provides discovery information. As another example, for IEEE 802.15.1 network protocols, individual audio devices may use a pairing process to discover each other.

[0095] Family Room Features

[0096] As shown above (e.g., Figure 1 ), the acoustic environment 100 is discussed in the context of a single home or apartment. The functionality of the audio devices can be extended so that an audio device in one home (or apartment) adjusts its audio output in response to information from an audio device in another home (or apartment). This adjustment can be performed without the knowledge of the owners of the individual audio devices. For example, imagine a college dormitory with 20 rooms on each floor and audio devices in each room. Each audio device adjusts its output in response to detected audio signals from each other audio device, thereby reducing the amount of sound in the individual dormitory rooms.

[0097] Implementation details

[0098] Embodiments can be implemented in hardware, executable modules stored on computer-readable media, or a combination of the two (e.g., programmable logic arrays). Unless otherwise specified, the steps performed by the embodiments need not be inherently related to any particular computer or other device, although they may be related in certain embodiments. Specifically, various general-purpose machines can be used with programs written according to the teachings of this article, or more professional devices (e.g., integrated circuits) can be more conveniently constructed to perform the required method steps. Therefore, embodiments can be implemented in one or more computer programs executed on one or more programmable computer systems, each of which includes at least one processor, at least one data storage system (including volatile and non-volatile memory and / or storage element), at least one input device or port, and at least one output device or port. Program code is applied to input data to perform the functions described herein and generate output information. Output information is applied to one or more output devices in a known manner.

[0099] Each such computer program is preferably stored in or downloaded to a storage medium or device (e.g., solid-state memory or media, or magnetic or optical media) readable by a general or special purpose programmable computer for use in configuring and operating the computer system to execute the procedures described herein when the storage medium or device is read by the computer system. The system of the present invention may also be considered to be implemented as a non-transitory computer-readable storage medium configured with a computer program, wherein the storage medium so configured causes the computer system to operate in a specific and predefined manner to perform the functions described herein. (Software itself and intangible or transitory signals are excluded in the sense that they are non-patentable subject matter.)

[0100] The above description illustrates various embodiments of the present invention and examples of how aspects of the present invention may be implemented. The above examples and embodiments should not be considered to be the only embodiments, but are presented to illustrate the flexibility and advantages of the present invention as defined by the appended claims. Based on the above disclosure and the appended claims, other arrangements, embodiments, implementations and equivalents will be apparent to those skilled in the art and may be adopted without departing from the spirit and scope of the present invention as defined by the claims.

[0101] Various aspects of the present invention may be understood from the following enumerated example embodiments (EEE):

[0102] 1. A method of reducing the audibility of sound generated by an audio device, the method comprising:

[0103] generating, by the audio device, an audio output at a first location;

[0104] detecting a detected audio signal corresponding to the audio output at a second location different from the first location;

[0105] transmitting information related to the detected audio signal from the second location to the audio device; determining, by the audio device, an audio transfer function of the detected audio signal based on the information; and

[0106] The audio output is modified by the audio device based on the audio transfer function.

[0107] 2. The method of EEE 1, wherein determining the audio transfer function comprises comparing the information related to the detected audio signal, the information related to the audio output, and at least one threshold.

[0108] 2A. The method of claim 2, wherein the audio device determines the audio transfer function for attenuating one or more frequency bands of the audio output, the method comprising:

[0109] Dividing the audio output and the detected audio into at least three spectral bands, e.g., 20 to 40 spectral bands;

[0110] performing a spectral band-by-spectral comparison of the detected audio to band-specific threshold levels; and

[0111] Only those spectral bands of the audio output where the detected audio exceeds a threshold level specific to that band are attenuated.

[0112] 3. The method of EEE 1, wherein a physical barrier separates the first location and the second location.

[0113] 4. The method of EEE 3, wherein the audio device determines the audio transfer function of the detected audio signal based on the audio output as modified by the physical barrier.

[0114] 5. The method of EEE 1, wherein the audio device is a first audio device, wherein a second audio device at the second location detects the detected audio signal, and wherein the second audio device transmits the information related to the detected audio signal to the first audio device.

[0115] 6. The method of EEE 5, wherein the first audio device modifies the audio output while the second audio device detects the detected audio signal.

[0116] 7. The method of EEE 5, wherein the second audio device detects the detected audio signal during a setup phase, wherein the first audio device determines the audio transfer function during the setup phase, and wherein the first audio device modifies the audio output during an operation phase after the setup phase.

[0117] 8. The method of EEE 1, wherein the audio output comprises a plurality of frequency bands, wherein modifying the audio output comprises modifying the audio output in one or more frequency bands of the plurality of frequency bands based on the audio transfer function.

[0118] 9. The method of EEE 8, wherein the plurality of frequency bands are defined according to a physiological response of human hearing.

[0119] 10. The method of EEE 8, wherein modifying the audio output comprises modifying the audio output by one or more different amounts in one or more frequency bands of the plurality of frequency bands based on the audio transfer function.

[0120] 11. The method of EEE 1, wherein the audio transfer function is based on a measured transfer characteristic between the first location and the second location and an ambient noise level at the second location.

[0121] 12. The method of EEE 1, wherein the audio transfer function is based on measured transfer characteristics between the first location and the second location and a physiological response of human hearing.

[0122] 13. The method of EEE 1, wherein the audio device comprises a plurality of speakers, and wherein modifying the audio output comprises:

[0123] Speaker directivity is controlled using the plurality of speakers to adjust the positional response of the audio output such that a first level of the audio output at the first position is maintained and a second level of the detected audio signal at the second position is reduced.

[0124] 14. The method of EEE 1, wherein the audio output is modified using at least one of loudness leveling and loudness domain processing.

[0125] 15. The method according to EEE 1, further comprising:

[0126] continuously detecting an ambient noise level at the second location; and

[0127] using machine learning to determine at least one pattern in the detected ambient noise level,

[0128] Wherein the audio output is modified based on the audio transfer function and the at least one mode.

[0129] 16. The method of EEE 1, further comprising:

[0130] generating, by a third audio device, a second audio output at a third location, wherein the detected audio signal detected at the second location corresponds to the audio output and the second audio output, wherein the information is related to the detected audio signal and the second detected audio signal, and wherein the information is communicated to the audio device and the third audio device;

[0131] determining, by the third audio device, a second audio transfer function of the detected audio signal based on the information; and

[0132] The second audio output is modified by the third audio device based on the second audio transfer function.

[0133] 17. An apparatus comprising an audio device, the apparatus being configured to reduce the audibility of a sound generated by the audio device, the apparatus comprising:

[0134] processor;

[0135] Memory;

[0136] Speakers; and

[0137] Network components,

[0138] Wherein, the processor is configured to control the audio device to perform a process, the process comprising:

[0139] generating an audio output by the speaker at a first location;

[0140] receiving, by the network component, information related to a detected audio signal from a second location different from the first location, the detected audio signal corresponding to the audio output detected at the second location;

[0141] determining, by the processor, an audio transfer function of the detected audio signal based on the information; and

[0142] The audio output is modified, by the processor, based on the audio transfer function.

[0143] 18. A system for reducing the audibility of sounds generated by an audio device, the system comprising:

[0144] a first audio device, the first audio device comprising a processor, a memory, a speaker, and a network component; and

[0145] a second audio device, the second audio device comprising a processor, a memory, a microphone and a network component,

[0146] Wherein, the processor of the first audio device and the processor of the second audio device are configured to control the first audio device and the second audio device to perform a process, the process comprising:

[0147] generating an audio output by the speaker of the first audio device at a first location;

[0148] detecting, by the microphone of the second audio device at a second location different from the first location, a detected audio signal corresponding to the audio output;

[0149] transmitting information related to the detected audio signal from the second location to the network component of the first audio device via the network component of the second audio device;

[0150] determining, by the processor of the first audio device, an audio transfer function of the detected audio signal based on the information; and

[0151] The audio output is modified, by the processor of the first audio device, based on the audio transfer function.

[0152] 19. The system of EEE 18, wherein the first audio device further comprises a microphone, wherein the second audio device further comprises a speaker, and wherein the second audio device adjusts an audio output of the second audio device in response to information related to the detected audio signal of the first audio device.

[0153] 20. A non-transitory computer readable medium storing a computer program for controlling an audio device to reduce the audibility of a sound generated by the audio device, wherein the audio device comprises a processor, a memory, a speaker, and a network component, wherein the computer program, when executed by the processor, controls the audio device to perform a process comprising:

[0154] generating an audio output by the speaker at a first location;

[0155] receiving, by the network component, information related to a detected audio signal from a second location different from the first location, the detected audio signal corresponding to the audio output detected at the second location;

[0156] determining, by the processor, an audio transfer function of the detected audio signal based on the information; and

[0157] The audio output is modified, by the processor, based on the audio transfer function.

[0158] References

[0159] 1: EP application EP0414524 A2 published on February 27, 1991.

[0160] 2: U.S. Application Publication No. 2012 / 0121097.

[0161] 3: ES application ES2087020 A2 published on July 1, 1996.

[0162] 4: ES application ES2087020 A2.

[0163] 5: U.S. Application Publication No. 2012 / 0195447.

[0164] 6: U.S. Application Publication No. 2009 / 0129604.

[0165] 7: U.S. Application Publication No. 2016 / 0211817.

[0166] 8: U.S. Patent No. 8,019,095.

Claims

1. A method of reducing the audibility of sound generated by an audio device, the method comprising: generating, by the audio device, an audio output at a first location; detecting a detected audio signal corresponding to the audio output in a plurality of frequency bands at a second location different from the first location; determining an audio transfer function for attenuating one or more frequency bands of the audio output based on the detected audio signal and a plurality of thresholds, wherein for a given frequency band, the audio transfer function attenuates the given frequency band of the audio output when the given frequency band of the detected audio signal exceeds a corresponding threshold; and modifying, by the audio device, the audio output by applying the audio transfer function, wherein the audio transfer function is determined based on a measured transfer characteristic between the first location and the second location, wherein the measured transfer characteristic takes into account an ambient noise level at the second location, and The method further includes determining whether the ambient noise masks one or more frequency bands in the detected audio signal, wherein, in response to determining that the ambient noise masks one or more frequency bands in the detected audio signal, the audio transfer function does not attenuate frequency bands of the audio output corresponding to the one or more masked frequency bands.

2. The method of claim 1, further comprising: Information related to the detected audio signal is transmitted to the audio device, wherein the audio device determines the audio transfer function based on the information.

3. The method of claim 2, wherein: The audio device is a first audio device, wherein a second audio device detects the detected audio signal at the second location, and wherein the second audio device transmits information related to the detected audio signal to the first audio device.

4. The method of claim 3, wherein: the second audio device detects the detected audio signal during a setup phase, wherein the first audio device determines the audio transfer function during the setup phase, and wherein the first audio device modifies the audio output during an operation phase subsequent to the setup phase, wherein during the setup phase, the first audio device outputs a test audio output covering a range of frequencies, and the second audio device receives a detected test audio signal corresponding to the test audio output, and When the level of a specific frequency band in the detected test audio signal exceeds a corresponding threshold value of the specific frequency band, the audio transfer function attenuates the specific frequency band in the test audio output.

5. The method of claim 1, further comprising: transmitting information related to the detected audio signal to a server device, wherein the server device determines an audio transfer function based on the information; as well as An audio transfer function is transmitted from the server device to the audio device.

6. The method of claim 5, wherein: The audio device is a first audio device, wherein a second audio device detects the detected audio signal at the second location, and wherein the second audio device transmits information related to the detected audio signal to the server device.

7. The method of claim 6, wherein: the second audio device detects the detected audio signal during a setup phase, wherein the server device determines the audio transfer function during the setup phase, and wherein the first audio device modifies the audio output during an operation phase subsequent to the setup phase, wherein during the setup phase, the first audio device outputs a test audio output covering a range of frequencies, and the second audio device receives a detected test audio signal corresponding to the test audio output, and When the level of a specific frequency band in the detected test audio signal exceeds a corresponding threshold value of the specific frequency band, the audio transfer function attenuates the specific frequency band in the test audio output.

8. The method of claim 1, wherein: The plurality of thresholds are defined according to a physiological response of human hearing.

9. The method of claim 8, wherein: According to the physiological response of human hearing, a first threshold value of a first frequency band is different from a second threshold value of a second frequency band.

10. The method of claim 1, wherein: Modifying the audio output includes attenuating the one or more frequency bands of the audio output by one or more different amounts.

11. The method of claim 1, wherein: The ambient noise is determined by comparing information associated with the detected audio signal and the audio output.

12. The method of claim 1, further comprising: dividing the audio output and the detected audio signal into at least three spectral bands; performing a spectral band-by-spectral comparison of the detected audio signal with band-specific threshold levels; as well as Only those spectral bands of the audio output where the detected audio signal exceeds the band-specific threshold level are attenuated.

13. A non-transitory computer readable medium storing a computer program, which, when executed by a processor, controls a device to perform the processing of the method according to any one of claims 1 to 12.

14. An apparatus for attenuating sound generated by an audio device, comprising: Audio equipment; processor; as well as speaker; wherein the processor is configured to control the audio device to generate an audio output by the audio device at a first location; wherein the detected audio signal is detected at a second location different from the first location, wherein the detected audio signal corresponds to the audio output in a plurality of frequency bands; wherein an audio transfer function for attenuating one or more frequency bands of the audio output is determined based on the detected audio signal and a plurality of thresholds, wherein for a given frequency band, when the given frequency band of the detected audio signal exceeds a corresponding threshold, the audio transfer function attenuates the given frequency band of the audio output; and wherein the processor is configured to control the audio device to modify the audio output by applying the audio transfer function, wherein the audio transfer function is determined based on a measured transfer characteristic between the first location and the second location, wherein the measured transfer characteristic takes into account an ambient noise level at the second location, and The processor is further configured to determine whether the ambient noise masks one or more frequency bands in the detected audio signal, wherein, in response to determining that the ambient noise masks one or more frequency bands in the detected audio signal, the audio transfer function does not attenuate frequency bands of the audio output corresponding to the one or more masked frequency bands.

15. The device of claim 14, wherein: The audio device is a first audio device including the processor and the speaker, and the apparatus further includes: Second audio device, wherein the second audio device is configured to detect the detected audio signal at the second location, wherein the second audio device is configured to transmit information related to the detected audio signal to the first audio device, and wherein the processor is configured to control the first audio device to determine the audio transfer function based on the information.

16. The apparatus of claim 14, further comprising: Server equipment, wherein the server device is configured to receive information related to the detected audio signal, wherein the server device is configured to determine an audio transfer function based on the information, and wherein the server device is configured to transmit the audio transfer function to the audio device.

17. The device of claim 16, wherein: The audio device is a first audio device including the processor and the speaker, and the apparatus further includes: Second audio device, Wherein the second audio device is configured to detect the detected audio signal at the second location, and wherein the second audio device is configured to transmit information related to the detected audio signal to the server device.

18. A computer program product comprising a computer program which, when executed by a processor, controls an apparatus to perform the processing of the method according to any one of claims 1 to 12.

Images