Dynamic calculation of system response volume

Abstract

To provide a consumer-accessible method, a program, and a computing system that can further improve the listening experience.SOLUTION: A system and a methods disclosed herein include determining that a requirement exists for outputting a system response, (I) setting a system response volume for a first speaker associated with a first network device in accordance with the determination that a requirement exists for outputting a system response, and (II) outputting a system response at the set system response volume via the first speaker associated with the first network device.SELECTED DRAWING: Figure 8

Description

CROSS-REFERENCE TO RELATED APPLICATIONS

[0001] This application claims priority to U.S. patent application Ser. No. 15 / 699,982, entitled "DYNAMIC CALCULATION OF SYSTEM RESPONSE VOLUME," filed Sep. 8, 2017, the contents of which are incorporated herein by reference in their entirety.

[0002] This application also relates to (i) application Ser. No. 62 / 298,410, filed February 22, 2016 and entitled "Default Playback Device(s)," (ii) application Ser. No. 62 / 298,418, filed February 22, 2016 and entitled "Acoustic Responsive Playback," (iii) application Ser. No. 62 / 298,433, filed February 22, 2016 and entitled "Room Corrected Audio Detection," (iv) application Ser. No. 62 / 298,439, filed February 22, 2016 and entitled "Content Mixing," (v) application Ser. No. 62 / 298,425, filed February 22, 2016 and entitled "Music Services Section," (v (i) Application No. 62 / 298,350, entitled "Metadata Exchange Involving Networked Playback Systems and Networked Microphone Systems," filed on February 22, 2016; (vii) Application No. 62 / 298,388, entitled "Handling Loss of Pairing Between Networked Devices," filed on February 22, 2016; (viii) Application No. 62 / 298,393, entitled "Actions Based on User ID," filed on February 22, 2016; and (ix) Application No. 62 / 132,350, entitled "Voice Control of a Media Playback System," filed on March 12, 2015. The entire contents of applications 62 / 298,410, 62 / 298,418, 62 / 298,433, 62 / 298,439, 62 / 298,425, 62 / 298,350, 62 / 298,388, 62 / 298,393, and 62 / 132,350 are incorporated herein by reference in their entirety. [Technical field]

[0003] This application relates to consumer products, and in particular to methods, systems, products, features, services, and other elements directed to media playback, or aspects thereof. [Background technology]

[0004] In 2003, Sonos Incorporated filed one of its first patent applications, entitled "Method of Synchronizing Audio Playback Among Multiple Networked Devices," and began selling its media playback system in 2005. Until then, access to and listening options for digital audio in out-loud settings were severely limited. Sonos wireless HiFi systems allow people to experience virtually unlimited music from many sources through one or more networked playback devices. Through a software control application installed on a smartphone, tablet, or computer, people can play the music they want in any room equipped with a networked playback device. They can also use the controller, for example, to stream different songs to each room equipped with a playback device, group multiple rooms for synchronized playback, or listen to the same song in all rooms in sync. Summary of the Invention

[0005] Given the ever-increasing interest in digital media, there is a need for further development of consumer-accessible technologies that can further enhance the listening experience.

[0006] Among other things, this disclosure describes systems and methods for determining and setting a system response volume for network devices that generate and output system responses (e.g., system responses such as audio responses) in response to voice commands. One example of a voice command is "What song is playing?" The system response can be "Let It Be by The Beatles." In another example, the voice command can be "What movie is playing on my TV?" and the system response might be "Mothra vs. Godzilla." In operation, the playback volume of audio content played by the system (e.g., the volume of music or sounds associated with video programming) can differ from the system response volume (i.e., the volume of the audio response).

[0007] This disclosure describes many examples for determining system response volume for one or more network devices under many different configuration models. The disclosed examples describe functions implemented by network devices, voice enabled devices (Voice Enabled Devices, VEDs), network microphone devices (NMDs), audio playback devices (Audio Playback Devices, PBDs), and video playback devices (Video Playback Devices, VPDs). As used herein, the term network device is a class of devices that includes, but is not limited to, VEDs, NMDs, PBDs, and VPDs.

[0008] VEDs are a homogeneous class of devices, including but not limited to NMDs, PBDs, and VPDs. For example, one type of VED is the NMD, which is a network device that includes one or more processors, a network interface, and one or more microphones. Some NMDs may further include one or more speakers to realize the media playback function. Another type of VED is the PBD, which is a network device that includes one or more processors, a network interface, and one or more speakers. Some PBDs may optionally include one or more microphones to realize the functions of the NMD. Yet another type of VED is the VPD, which is a network device that includes one or more processors, a network interface, one or more speakers, and at least one video display. Some VPDs may optionally include one or more microphones to realize the functions of the NMD. PBDs and VPDs may be generally referred to as media playback devices.

[0009] Some examples include determining that a requirement exists for outputting a system response, and in response to determining that a requirement exists for outputting a system response, (i) setting a system response volume of a first speaker associated with the first network device, and (ii) outputting the system response at the set system response volume via the first speaker associated with the first network device.

[0010] In some examples, these steps occur at (or substantially at) the same time that the system outputs the system response or in response to a particular triggering event. This may be advantageous because it allows the system to evaluate the ambient environment at the time that the system outputs the system response or at the time of the particular triggering event. That is, this may reduce the likelihood of hearing the system response at an undesirably high or undesirably low system response volume due to changes in the ambient environment between the determination that a requirement exists to output the system response and the output of the system response.

[0011] By performing these steps at the time of system output, the system evaluates the environment at the time of outputting the system response (or almost immediately before outputting the system response), so that the system can dynamically set the system response volume to output the system response, taking into account sudden changes in the environment. For example, a user may be playing audio content through the PBD at a loud volume. Shortly thereafter, the user may mute the audio content. By setting the system response volume at the time of outputting the system response, the system can recognize that the user has muted the audio content and can set an appropriate system response volume.

[0012] In some examples, determining that a requirement for outputting a system response exists includes receiving audio input via a first microphone associated with the first network device, hi some examples, determining that a requirement for outputting a system response exists includes activating a system alarm or notification.

[0013] In some examples, the first network device comprises a first speaker and a first microphone. In some examples, the first network device comprises the first microphone and the second network device comprises the first speaker. In some examples, the first network device comprises the first speaker and the second network device comprises the first microphone.

[0014] In some examples, the first network device comprises a first speaker and the second network device comprises a second speaker, and the step of outputting the system response at the set system response volume via the first speaker associated with the first network device includes outputting the system response at the set system response volume via the first speaker associated with the first network device in synchronization with the second network device outputting the system response at the set system response volume via the second speaker.

[0015] In some examples, the step of setting a system response volume of a first speaker associated with the first network device includes (i) obtaining a sound pressure level (SPL) measurement via one or more microphones associated with the first network device, and (ii) setting the system response volume based on the SPL measurement.

[0016] In some examples, the system may set the system response volume to a predetermined amount higher than the acquired SPL measurement, which may be advantageous in situations where there is ambient noise (people talking in the listening area and / or media content playing) so that the user can hear the system response above the ambient noise.

[0017] In some examples, setting the system response volume based on the obtained sound pressure level measurement includes setting the system response volume between about 1 dB and about 6 dB higher than the instantaneous and / or previous sound measurement (e.g., the SPL measurement, and / or a measurement derived from the SPL measurement).

[0018] In some examples, the step of setting a system response volume of a first speaker associated with the first network device includes (i) accessing a predetermined system response volume, and (ii) setting the system response volume to the predetermined system response volume.

[0019] In some examples, the predetermined system response volume is determined through steps including: (i) detecting a triggering event; and (ii) determining a system response volume in response to detecting the triggering event. In some examples, the triggering event includes changing a volume of media playback during playback of media through a first speaker, and determining a system response volume for a first speaker associated with a first network device includes (i) obtaining an SPL measurement through one or more microphones associated with the first network device, and (ii) setting a system response volume based on the SPL measurement. In some examples, changing the volume of media playback includes at least one of: (i) increasing a volume of media playback, (ii) decreasing a volume of media playback, (iii) muting the media playback, and (iv) unmuting the media playback.

[0020] In some examples, the triggering event includes a reconfiguration of the first network device, in some examples, the reconfiguration includes one of: (i) configuring the first network device from playing media content as a stand-alone playback device to playing media synchronously with at least a second network device, and (ii) configuring the first network device from playing media synchronously with at least a second network device to playing media as a stand-alone playback device.

[0021] In some examples, the triggering event includes expiration of a time frame, and determining a system response volume for a first speaker associated with the first network device includes (i) obtaining SPL measurements via one or more microphones associated with the first network device, and (ii) setting the system response volume based on the SPL measurements.

[0022] In some examples, the triggering event includes at least one of: (i) detection of motion within an area of ​​the first network device by a motion detector associated with the first network device; and (ii) detection of a change in light within an area of ​​the first network device by a light detector associated with the first network device. [Brief description of the drawings]

[0023] [Figure 1] FIG. 1 illustrates an exemplary media playback system configuration in which certain embodiments may be implemented. [Diagram 2] FIG. 2 illustrates a functional block diagram of an exemplary playback device. [Diagram 3] FIG. 3 illustrates a functional block diagram of one example of an exemplary control device. [Figure 4] FIG. 4 illustrates an exemplary controller interface. [Diagram 5] FIG. 5 illustrates exemplary network devices. [Figure 6] FIG. 6 illustrates a functional block diagram of an exemplary network microphone device. [Figure 7] FIG. 7 illustrates an example configuration of a media playback system in which certain embodiments may be implemented. [Figure 8] FIG. 8 illustrates an example method according to some embodiments.

[0024] The features, aspects, and advantages of the technology disclosed herein will become better understood with reference to the following description, the appended claims, and the accompanying drawings. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0025] I. Overview As mentioned above, this disclosure relates to functions provided by a class of network devices generally referred to herein as voice-enabled devices (VEDs). One type of VED is a network microphone device (NMD), which is a network device that includes one or more processors, a network interface, and one or more microphones. Some NMDs may further include one or more speakers. Another type of VED is a sound playback device (PBD), which is a network device that includes one or more processors, a network interface, one or more microphones, and one or more speakers. Yet another type of VED is a video playback device (VPD), which is a network device that includes one or more processors, a network interface, one or more microphones, one or more speakers, and at least one video display. PBDs and VPDs may be generally referred to as media playback devices. As used herein, the term network device includes, but is not necessarily limited to, VEDs, PBDs, NMDs, and PVDs, and the term VED includes, but is not necessarily limited to, PBDs, NMDs, and PVDs.

[0026] Each of the VEDs described above implements at least some voice control functionality, enabling the VED (either alone or perhaps in conjunction with one or more other computing devices) to act on voice commands received via a microphone, thereby enabling a user to control the VED and perhaps other devices as well.

[0027] One aspect of the voice control functionality includes playing a system response via one or more speakers. As used herein, a system response includes a voice response or any other type of audible response (e.g., an alarm, a beep, a click, or other notification, response, or confirmation sound) that the VED plays via one or more speakers associated with the VED in response to a voice command received via one or more microphones associated with the VED.

[0028] In some embodiments, a VED equipped with microphone(s) and speaker(s) may play a voice response (or other system response) via its speaker(s) in response to a voice command received via its microphone(s).

[0029] In other embodiments, a first VED equipped with microphone(s) may instruct or cause a second VED equipped with at least one speaker to play a voice response (or other system response) via the speaker(s) of the second VED in response to a voice command received via the microphone(s) of the first VED.

[0030] In another embodiment, a first VED equipped with a microphone and speaker(s) may instruct or cause a second VED equipped with at least one speaker to play a voice response (or other system response) in synchronization with the first VED in response to a voice command received via the microphone(s) of the first VED.

[0031] As described above, some VEDs include one or more speakers, e.g., NMDs with one or more speakers, PBDs with one or more speakers, and VPDs with one or more speakers. In operation, any of these VEDs with one or more speakers can play both audio content (e.g., music, video-related audio tracks, speech content, or other audio content) and voice responses (or other system responses) through its one or more speakers. Any of these VEDs with speakers can also play other common system responses (e.g., wake-up alarms, timer notifications, and / or system notifications, such as bells, beeps, clicks, and other notifications) through its one or more speakers.

[0032] In some cases, the VED plays audio content and system responses at the same volume. For example, if a user is having a party and turns up the volume of the PBD to better fill the room with music, the system response volume of the PBD is also turned up. This is undesirable because the system response may interfere with conversation or impair the enjoyment of the audio content. Furthermore, if the audio content stops playing, the system response volume is still set to a higher volume, which may surprise users in the room when the PBD (or other VED) outputs the system response later.

[0033] In some cases, the VED plays the system response at a static volume that does not change with the volume of any audio content. In these cases, the volume of the system response may not be appropriate depending on the volume of the audio content. For example, if the user sets the audio playback to a high volume, the user may not hear the system response when it occurs. Conversely, without audio playback, the system response volume may be too loud or too quiet depending on the location of the VED.

[0034] In some cases, the VED plays the system response as an alarm that is sounded at a different volume level than the volume level of the audio content. This can be useful when a user uses an alarm to wake up and wants the alarm set to a specific volume. However, if the user uses the media playback system 700 for different daily events (setting additional alarms, issuing commands, etc.), the user may need to repeatedly set (or reset) the system response volume throughout the day. If the user forgets to reset the system response volume to an appropriate volume for the alarm, the alarm may startle the user if the volume is too loud, or may fail to notify the user if the volume is too quiet.

[0035] In some cases, it may be desirable for the VED to dynamically set the system response volume based on the surrounding environment, such as sound reproduction volume and sound pressure level ("SPL") measured within the area in which the VED is located. For example, in some embodiments, the VED calculates the system response volume in response to determining (or detecting) a requirement to output a system response. During operation, upon determining (or detecting) a requirement to output a system response, the VED measures the SPL via one or more microphones associated with the VED and then sets the system response volume based at least in part on the measured SPL.

[0036] In some embodiments, the VED may also or alternatively set (or re-set) the system response volume in response to conditions other than determining (or detecting) a requirement to output a system response. For example, in some embodiments, the VED may set (re-set) the system response volume in response to receiving a command or instruction to obtain a new SPL measurement and reconfigure a new configuration and / or settings of the VED device based at least in part on the SPL measurement, including, for example, (i) receiving a new acoustic volume setting, (ii) receiving a command to group / ungroup the VED with one or more other VEDs in a synchronized group, stereo pair, combined group of VEDs, integrated VED (as described herein), and / or (iii) receiving settings of other VED configurations.

[0037] In some embodiments, the VED may calculate the SPL and reset the system response volume many times and in many different ways. The calculation of the new SPL may occur prior to the system response, at a predetermined period, or a combination of both. The calculation of the new SPL may be performed by one or more of the VEDs in the sound reproduction configuration. The measurement and / or calculation of the SPL may be performed by (i) the VED that outputs the system response, (ii) other VEDs or other network devices in the configuration that are not tasked with outputting the system response, or (iii) a group of two or more VEDs and / or network devices.

[0038] In operation, calculation of the system response volume can be accomplished in many different ways. The system response volume may be determined and set by one or more network devices in a collection of network devices configured to operate as a media playback system. For example, in a media playback system with one NMD and two PBDs, the NMD may obtain SPL measurements and set the system response volume, and one or more of the PBDs may play the actual system response at the system response volume set by the NMD. In such a media playback system, any one of the one or more network devices of the media playback system (either alone or in conjunction with any one or more of the other network devices of the media playback system) may perform any one of the following: (i) measure the SPL; (ii) set the system response volume; and / or (iii) play the actual system response at the system response volume.

[0039] Another embodiment includes a tangible, non-transitory computer readable medium having stored thereon program instructions that, when executed by a computing device, cause the computing device to implement the features and functionality disclosed and described herein.

[0040] Some embodiments include a computing device having at least one processor, and a data storage device and / or program instructions that, in operation, are stored in the data storage device and, when executed by the at least one processor, cause the computing device (alone or in conjunction with other components or systems) to implement the features and functionality disclosed and described herein.

[0041] Although some of the examples described herein may refer to functions performed by given actors, such as a "user" and / or other entities, it should be understood that this is for illustrative purposes only. The claims should not be construed as requiring action by any such example actors unless expressly required by the language of the claim itself. Those skilled in the art will appreciate that the present disclosure encompasses numerous other embodiments.

[0042] II. Operating environment examples 1 illustrates an exemplary configuration of a media playback system 100 that may be implemented in accordance with one or more embodiments disclosed herein. As illustrated, the media playback system 100 is associated with an exemplary home environment having multiple rooms and spaces, such as a master bedroom, an office, a dining room, and a living room. As illustrated in the example of FIG. 1, the media playback system 100 includes playback devices 102-124, controllers 126 and 128, and a wired or wireless network router 130.

[0043] Further descriptions of the different components of the exemplary media playback system 100 and how the different components interact to provide a media experience to a user are provided in the following sections. Although the description herein generally refers to the media playback system 100, the techniques described herein are not limited to application in a home environment as shown in Figure 1. For example, the techniques described herein are useful in environments where multi-zone audio is desired, such as commercial environments such as restaurants, malls, or airports, vehicles such as sports utility vehicles (SUVs), buses or cars, ships or boards, airplanes, and the like.

[0044] a. Exemplary playback device Figure 2 shows a functional block diagram of an exemplary playback device 200 that may constitute one or more of the playback devices 102-124 of the media playback system 100 of Figure 1. As mentioned above, playback device (PBD) 200 is a type of voice-enabled device (VED).

[0045] The playback device 200 may include one or more processors 202, software components 204, memory 206, audio processing components 208, audio amplifiers 210, speakers 212, and a network interface 214. The network interface 214 includes a wireless interface 216 and a wired interface 218. In some cases, the playback device 200 may not include speakers 212, but may include a speaker interface for connecting the playback device 200 to an external speaker. In other cases, the playback device 200 may not include speakers 212 or audio amplifiers 210, but may include an audio interface for connecting the playback device 200 to an external audio amplifier or audiovisual receiver.

[0046] In one example, the one or more processors 202 may include one or more clocked computer components configured to process input data based on instructions stored in the memory 206. The memory 206 may be a non-transitory computer-readable storage medium configured to store instructions executable by the one or more processors 202. For example, the memory 206 may be a data storage into which one or more of the software components 204 executable by the one or more processors 202 may be loaded to perform a function. In one example, the function may include the playback device 200 reading audio data from an audio source or another playback device. In another example, the function may include the playback device 200 transmitting audio data to another device or playback device on a network. In yet another example, the function may include pairing the playback device 200 with one or more playback devices to create a multi-channel audio environment.

[0047] One function includes the playback device 200 synchronizing the playback of the audio content with one or more other playback devices. During the synchronized playback, preferably, the listener does not notice any delay between the playback of the audio content by the playback device 200 and the playback by the one or more other playback devices. U.S. Patent No. 8,234,395, entitled "System and Method for Synchronizing Operation Among Multiple Independently Clocked Digital Data Processing Devices," is incorporated herein by reference, and provides a more detailed example in which synchronizing audio playback among playback devices is described.

[0048] Additionally, memory 206 may be configured to store data, e.g., data associated with playback device 200, such as playback device 200 included as part of one or more zones and / or zone groups, audio sources accessible by playback device 200, or playback queues that may be associated with playback device 200 (or other playback devices). The data may be periodically updated and stored as one or more state variables that indicate the state of playback device 200. Memory 206 may also include data associated with the state of other devices in the media system, and may be shared between devices from time to time so that one or more devices have more-current data relevant to the system. Other embodiments are possible.

[0049] The audio processing component 208 may include one or more digital-to-analog converters (DACs), audio processing components, audio enhancement components, digital signal processors (DSPs), and the like. In some embodiments, the one or more audio processing components 208 may be subcomponents of the one or more processors 202. In some embodiments, audio content may be processed and / or purposefully altered by the audio processing component 208 to generate an audio signal. The generated audio signal is sent to the audio amplifier 210, amplified, and played through the speaker 212. In particular, the audio amplifier 210 may include a device configured to amplify the audio signal to a level capable of driving one or more speakers 212. The speaker 212 may comprise a complete speaker system including a separate transducer (e.g., a "driver") or an enclosure that contains one or more drivers. Some drivers included in the speaker 212 may include, for example, a subwoofer (e.g., for low frequencies), a mid-range driver (e.g., for mid-frequency frequencies), and / or a tweeter (for high frequencies). In some cases, the transducers of each of the one or more speakers 212 may be driven by a corresponding individual audio amplifier of the audio amplifiers 210. In addition to generating analog signals for playback on the playback device 200, the audio processing component 208 processes audio content and sends the audio content to one or more other playback devices for playback.

[0050] The audio content to be processed and / or played by the playback device 200 may be received from an external source, for example, via an audio line-in input connection (eg, an auto-detecting 3.5 mm audio line-in connection) or via a network interface 214.

[0051] The network interface 214 may be configured to facilitate data flow between the playback device 200 and one or more other devices on a data network, including, but not limited to, data exchanged with other VEDs (e.g., commands to perform SPL measurements, SPL measurement data, commands to set system response volume, and other data and / or commands that facilitate the implementation of the features and functions disclosed and described herein). Thus, the playback device 200 may be configured to receive audio content over a data network from one or more other playback devices in communication with the playback device 200, or a network device in a local area network, or an audio content source on a wide area network such as the Internet. The playback device 200 may transmit and receive metadata to and from other devices on the network, including, but not limited to, components of the network microphone system disclosed and described herein. In one example, signals such as audio content (e.g., signals such as metadata) transmitted and received by the playback device 200 may be transmitted in the form of digital packet data that includes an Internet Protocol (IP)-compliant source address and an IP-compliant destination address. In such cases, the network interface 214 may be configured to parse the digital packet data so that data destined for the playback device 200 is appropriately received and processed by the playback device 200 .

[0052] As shown, the network interface 214 may include a wireless interface 216 and a wired interface 218. The wireless interface 216 provides a network interface function for the playback device 200 and may wirelessly communicate with other devices (e.g., other playback devices, speakers, receivers, network devices, and control devices in a data network associated with the playback device 200) based on a communication protocol (e.g., any of wireless standards including wireless standards IEEE802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.15, 4G mobile communication standards, etc.). The wired interface 218 provides a network interface function for the playback device 200 and may communicate via a wired connection with other devices based on a communication protocol (e.g., IEEE802.3). Although the network interface 214 shown in FIG. 2 includes both the wireless interface 216 and the wired interface 218, the network interface 214 may include only a wireless interface or only a wired interface in some embodiments.

[0053] The microphone 220 may be positioned to detect sounds in the environment of the playback device 200. For example, the microphone may be mounted on an outer wall of the playback device housing. The microphone may be any type of microphone now known or later developed, such as a condenser microphone, an electret condenser microphone, or a dynamic microphone. The microphone may be sensitive to a portion of the frequency range of the speakers 220. One or more of the speakers 220 may operate inversely to the microphones 220. In some aspects, the playback device 200 may not include the microphones 220.

[0054] In some examples, the playback device 200 and the other playback device may be paired to play two separate audio components of the audio content. For example, the playback device 200 may be configured to play a left channel audio component, while the other playback device may be configured to play a right channel audio component. This may create or enhance a stereo effect of the audio content. The paired playback devices (also referred to as "combined playback devices," "combined group," or "stereo pair") may further play the audio content in synchronization with the other playback device.

[0055] In another example, the playback device 200 may be acoustically integrated with one or more other playback devices to form a single integrated playback device (integrated playback device). The integrated playback device may be configured to process and reproduce sound differently than a non-integrated or paired playback device, because the integrated playback device may have additional speakers that reproduce the audio content. For example, if the playback device 200 is designed to reproduce low-frequency range audio content (e.g., a subwoofer), the playback device 200 may be integrated with a playback device designed to reproduce full-frequency range audio content. In this case, the full-frequency range playback device may be configured to reproduce only the mid-high frequency components of the audio content when integrated with the low-frequency playback device 200, while the low-frequency range playback device 200 reproduces the low-frequency components of the audio content. Furthermore, the integrated playback device may be paired with a single playback device or with yet another integrated playback device.

[0056] As an example, Sonos Incorporated currently offers playback devices including "PLAY:1", "PLAY:3", "PLAY:5", "PLAYBAR", "CONNECT:AMP", "CONNECT", and "SUB". Any other past, present, and / or future playback devices may additionally or alternatively be implemented and used with the playback device embodiments disclosed herein. Furthermore, it is understood that the playback device is not limited to the specific example shown in FIG. 2 or the Sonos products provided. For example, the playback device may include wired or wireless headphones. In another example, the playback device may include or interact with a docking station for a personal mobile media playback device. In yet another example, the playback device may be integrated with another device or component, such as a television, a lighting fixture, or some other device for use indoors or outdoors.

[0057] b. Exemplary Play Zone Configurations Returning to the media playback system of FIG. 1, an environment has one or more playback zones, each containing one or more playback devices and / or other VEDs. Media playback system 100 is formed with one or more playback zones, and one or more zones may be added or removed later to form the exemplary configuration shown in FIG. 1. Each zone may be given a name based on a different room or space, e.g., office, bathroom, master bedroom, bedroom, kitchen, dining room, living room, and / or balcony. In some cases, a single playback zone may include multiple rooms or spaces. In other cases, a single room or space may include multiple playback zones.

[0058] 1, the balcony, dining room, kitchen, bathroom, office, and bedroom zones each have one playback device, while the living room and master bedroom zones each have multiple playback devices. The living room zone may be configured such that playback devices 104, 106, 108, and 110 play audio content synchronously as separate playback devices, as one or more combined playback devices, as one or more integrated playback devices, or any combination thereof. Similarly, in the case of the master bedroom, playback devices 122 and 124 may be configured such that playback content synchronously as separate playback devices, as a combined playback device, or as an integrated playback device.

[0059] In one example, one or more playback zones in the environment of FIG. 1 each play different audio content. For example, a user may listen to hip hop music played by playback device 102 while grilling in the balcony zone, while another user may listen to classical music played by playback device 114 while preparing a meal in the kitchen zone. In another example, a playback zone may play the same audio content in synchronization with another playback zone. For example, if a user is in the office zone, playback device 118 in the office zone may play the same music as the music being played by playback device 102 in the balcony. In such a case, playback devices 102 and 118 are playing rock music in synchronization, allowing the user to seamlessly (or at least nearly seamlessly) enjoy the audio content played out-loud as they move between different playback zones. Synchronization between playback zones may be performed in a manner similar to synchronization between playback devices as described in the aforementioned U.S. Pat. No. 8,234,395.

[0060] As mentioned above, the zone configuration of the media playback system 100 may change dynamically, and in some embodiments, the media playback system 100 supports multiple configurations. For example, if a user physically moves one or more playback devices into or out of a zone, the media playback system 100 may be reconfigured to accommodate the change. For example, if a user physically moves playback device 102 from a balcony zone to an office zone, the office zone may include both playback device 118 and playback device 102. If desired, playback device 102 may be paired or grouped into the office zone and / or renamed via a control device, e.g., control devices 126 and 128. On the other hand, if one or more playback devices are moved into an area in the Home environment that does not already have a playback zone established, a new playback zone may be formed in that area.

[0061] Furthermore, different playback zones of the media playback system 100 may be dynamically combined into zone groups or split into separate playback zones. For example, the dining room zone and the kitchen zone may be combined into a zone group for a dinner party so that playback devices 112 and 114 can synchronously render audio content. On the other hand, if some users want to watch television while other users want to listen to music in the living room space, the living room zone may be divided into a TV zone including playback device 104 and a listening zone including playback devices 106, 108, and 110.

[0062] c. Exemplary Control Device 3 illustrates a functional block diagram of an exemplary control device 300 constituting one or both of the control devices 126 and 128 of the media playback system 100. As illustrated, the control device 300 may include one or more processors 302, memory 304, a network interface 306, a user interface 308, a microphone 310, and software components 312. In one example, the control device 300 may be a dedicated control device for the media playback system 100. In another example, the control device 300 may be a network device, such as an iPhone®, iPad®, or any other smartphone, tablet, or network device (e.g., a network computer such as a PC or Mac®), with media playback system controller application software installed.

[0063] The one or more processors 302 may be configured to perform functions related to enabling user access, control, and configuration of the media playback system 100. The memory 304 may be data storage that may be loaded with one or more software components executable by the one or more processors 302 to perform those functions. The memory 304 may also be configured to store media playback system controller application software and other data associated with the media playback system 100 and users.

[0064] In one example, the network interface 306 may be based on an industry standard (e.g., infrared, wireless, wired standards such as IEEE 802.3, wireless standards such as IEEE 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.15, 3G, 4G, 5G communication standards, etc.). The network interface 306 may provide a means for the control device 300 to communicate with other devices in the media playback system 100. In one example, data and information (e.g., state variables) may be communicated between the control device 300 and the other devices via the network interface 306. For example, the configuration of playback zones and zone groups in the media playback system 100 may be received by the control device 300 from a playback device or another network device, or may be transmitted by the control device 300 to another playback device or network device via the network interface 306. In one case, the other network device may be another control device.

[0065] Player control commands, such as volume control and audio playback controls, may be communicated from the control device 300 to the players via the network interface 306. As described above, configuration changes to the media playback system 100 may be made by a user using the control device 300. Configuration changes may include adding one or more playback devices to a zone, removing one or more playback devices from a zone, adding one or more zones to a zone group, removing one or more zones from a zone group, forming a combined or unified player, splitting one or more playback devices from a combined or unified player, etc. Thus, the control device 300 may be referred to as a controller, and the control device 300 may be a dedicated controller with media playback system controller application software installed or a network device.

[0066] The control device 300 may include a microphone 310. The microphone 310 may be positioned to detect sounds in the environment of the control device 300. The microphone 310 may be any type of microphone now known or later developed, such as a condenser microphone, an electret condenser microphone, or a dynamic microphone. The microphone may be sensitive to a portion of a frequency range. Two or more microphones 310 may be positioned to capture location information of an audio source (e.g., a voice, an audible sound) and / or to assist in filtering background noise.

[0067] The user interface 308 of the control device 300 may be configured to enable user access and control of the media playback system 100 by providing a controller interface, such as the exemplary controller interface 400 shown in FIG. 4. The controller interface 400 includes a playback control area 410, a playback zone area 420, a playback status area 430, a playback queue area 440, and an audio content source area 450. The illustrated user interface 400 is merely one example of a user interface provided with a network device, such as the control device 300 of FIG. 3 (and / or the control devices 126 and 128 of FIG. 1), that may be accessed by a user to control a media playback system, such as the media playback system 100. Alternatively, other user interfaces of different formats, styles, and interaction sequences may be implemented on one or more network devices to provide similar control access to the media playback system.

[0068] Playback control area 410 may include selectable icons (e.g., by touch or using a cursor) that cause playback devices in the selected playback zone or zone group to play or stop, fast forward, rewind, skip forward, skip forward, turn shuffle mode on / off, turn repeat mode on / off, and turn crossfade mode on / off. Playback control area 410 may include other selectable icons that may change other settings, such as equalization settings, playback volume, etc.

[0069] The playback zones area 420 may include a representation of the playback zones within the media playback system 100. In some embodiments, the graphical representation of the playback zones may be selectable. By moving additional selectable icons, the playback zones within the media playback system may be managed or configured. For example, other management or configuration may be performed, such as creating combined zones, creating zone groups, splitting zone groups, and renaming zone groups.

[0070] For example, as shown, a "group" icon may be provided in each of the graphical representations of the playback zones. The "group" icon in the graphical representation of a zone may be selectable to provide an option to select and group one or more zones in the media playback system with the zone. Once grouped, the playback devices in the zones grouped with the zone are configured to play audio content in sync with the playback devices in the zone. Similarly, a "group" icon may be provided in the graphical representation of a zone group. In this case, the "group" icon may be selectable to provide an option to deselect one or more zones in the zone group to remove one or more zones in the zone group from the zone group. Other interactions for grouping and ungrouping zones are possible and may be implemented via a user interface, such as user interface 400. The display of the playback zones in playback zone area 420 may be dynamically updated as the playback zone or zone group configuration is changed.

[0071] The playback status area 430 may include a graphical representation of currently played, previously played, or next scheduled to play audio content in the selected playback zone or zone group. The selectable playback zones or groups may be visually distinguished on the user interface, for example, in the playback zone area 420 and / or the playback status area 430. The graphical representation may include track title, artist name, album name, album year, track length, and other relevant information useful to a user when controlling a media playback system via the user interface 400.

[0072] The playback queue area 440 may include a graphical representation of the audio content in a playback queue associated with a selected playback zone or zone group. In some embodiments, each playback zone or zone group may be associated with a playback queue that includes information corresponding to zero or more audio items to be played by the playback zone or zone group. For example, each audio item in the playback queue may include a Uniform Resource Identifier (URI), Uniform Resource Identifier (URL), or other identifier that can be used by a playback device in the playback zone or zone group to locate and / or retrieve the audio item from a local or network audio content source and play it by the playback device.

[0073] In one example, a playlist may be added to the play queue. In this case, information corresponding to each audio item in the playlist may be added to the play queue. In another example, the audio items in the play queue may be saved as a playlist. In yet another example, the play queue may be empty or "unused" but filled when the playback device continues to play streaming audio content, e.g., Internet radio, which plays continuously unless stopped, rather than audio items that have a play time and therefore do not play continuously. In another embodiment, the play queue may contain Internet radio and / or other streaming audio content items and may be "unused" when a playback zone or zone group is playing those items. Other examples are possible.

[0074] When a playback zone or zone group is "grouped" or "ungrouped", the playback queues associated with the affected playback zones or zone groups may be cleared or reassociated. For example, if a first playback zone containing a first playback queue is grouped with a second playback zone containing a second playback queue, the formed zone group may have an associated playback queue. The associated playback queue may initially be empty, contain audio items of the first playback queue (e.g., if the second playback zone is added to the first playback zone), contain audio items of the second playback queue (e.g., if the first playback zone is added to the second playback zone), or combine audio items of both the first and second playback queues. If the formed zone group is subsequently ungrouped, the ungrouped first playback zone may be reassociated with the previous first playback queue, may be associated with a new playback queue that is empty, or may be associated with a new playback queue that contains audio items of the playback queue that was associated with the zone group before the zone group was ungrouped. Similarly, the ungrouped second playback zone may be reassociated with the previous second playback queue, may be associated with an empty new playback queue, or may be associated with a new playback queue containing the audio items in the playback queue that were associated with the zone group before the zone group was ungrouped.

[0075] Returning to the user interface 400 of FIG. 4, the graphical representation of the audio content in the play queue area 440 may include track title, artist name, track length, and other relevant information associated with the audio content in the play queue. In some examples, the graphical representation of the audio content may include additional selectable icons that may be selected and moved to allow management and / or editing of the play queue and / or the audio content displayed in the play queue. For example, the displayed audio content may be removed from the play queue, moved to a different position in the play queue, selected to play immediately or after currently playing audio content, or other actions may be performed. The play queue associated with a play zone or zone group may be stored in memory of one or more playback devices in the play zone or zone group, in memory of a playback device not in the play zone or zone group, and / or in memory of other designated devices.

[0076] The audio content source area 450 may include a graphical representation of selectable audio content sources from which audio content may be retrieved and played by a selected playback zone or zone group, a description of which may be found in the following sections.

[0077] d. Exemplary Audio Content Sources As previously illustrated, one or more playback devices within a zone or zone group may be configured to retrieve audio content for playback from multiple available audio content sources (e.g., based on the audio content's corresponding URI or URL). In one example, the audio content may be retrieved by the playback device directly from the corresponding audio content source (e.g., a line-in connection). In another example, the audio content may be provided to the playback device over a network via one or more other playback devices or network devices.

[0078] Exemplary audio content sources may include the memory of one or more playback devices in a media playback system, such as the media playback system 100 of FIG. 1, a local music library on one or more networked devices (e.g., a control device, a network-enabled personal computer, or a network-attached storage (NAS)), a streaming audio service that provides audio content over the Internet (e.g., the cloud), or an audio source connected to the media playback system via a line-in input connection of a playback device or network device, or other possible system.

[0079] In some embodiments, audio content sources may be periodically added or removed from a media playback system, such as the media playback system 100 of FIG. 1. In some examples, audio item indexing may occur each time one or more audio content sources are added, removed, or updated. Indexing of audio items may include scanning for identifiable audio items in all folders / directories shared over a network, where the network is accessible by playback devices in the media playback system. Indexing of audio items may also include creating or updating an audio content database that includes metadata (e.g., title, artist, album, track length, etc.) and other related information, which may include, for example, a URI or URL for locating each identifiable audio item. Other examples for managing and maintaining audio content sources are possible.

[0080] The above discussion of playback devices, controller devices, playback zone configurations, and media content sources provides only a few examples of operating environments in which the functions and methods described below may be implemented. Other operating environments and configurations of media playback systems, playback devices, and network devices not explicitly described herein are also applicable and suitable for implementation of the functions and methods.

[0081] e. Multiple network devices example FIG. 5 illustrates an example plurality of devices 500 that may be configured to provide an audio playback experience based on voice control. Those skilled in the art will appreciate that the devices illustrated in FIG. 5 are for illustrative purposes only and that variations including different and / or additional (or fewer) devices may be possible. As illustrated, the networked plurality of devices 500 includes computers 504, 506, and 508, network microphone devices (NMDs) 512, 514, and 516, playback devices (PBDs) 532, 534, 536, and 538, and a controller device (CR) 522. As discussed above, at least one or all of the NMDs 512-16, PBDs 532-38, and / or CRs 522 may be voice-enabled devices (VEDs).

[0082] Each of the networked devices 500 may be a network-enabled device capable of establishing communications with one or more other devices in the plurality of devices over one or more types of networks, such as a wide area network (WAN), a local area network (LAN), and a personal area network (PAN), among other examples, according to one or more network protocols, such as NFC, Bluetooth, Ethernet, and IEEE 802.11.

[0083] As shown, computers 504, 506, and 508 are part of cloud network 502. Cloud network 502 may include additional computers (not shown). In one example, computers 504, 506, and 508 may be different servers. In another example, two or more computers 504, 506, and 508 may be modules of a single server. Similarly, each of computers 504, 506, and 508 may include one or more modules or servers. For purposes of ease of illustration herein, each of computers 504, 506, and 508 may be configured to perform a particular function within cloud network 502. For example, computer 508 may be a source of audio content for a streaming music service.

[0084] As shown, computer 504 may be configured to interface with NMDs 512, 514, and 516 via communications path 542. NMDs 512, 514, and 516 may be components of one or more “Smart Home” systems. In one case, NMDs 512, 514, and 516 may be physically distributed throughout a home, similar to the distribution of devices illustrated in FIG. 1. In another case, two or more NMDs 512, 514, and 516 may be physically located relatively close to one another. Communications path 542 may comprise one or more types of networks, such as WANs, LANs, and / or PANs, including the Internet, among others.

[0085] In one example, one or more of the NMDs 512, 514, and 516 are devices configured primarily for audio detection. In another example, one or more of the NMDs 512, 514, and 516 may be components of devices having different primary utilities. For example, as alluded to above in connection with FIGs. 2 and 3, one or more of the NMDs 512, 514, and 516 may be, include, or be part of the microphone 220 of the playback device 200 or the microphone 310 of the network device 300. Furthermore, in some cases, one or more of the NMDs 512, 514, and / or 516 may be the playback device 200 or the network device 300. In an example, one or more of the NMDs 512, 514, and / or 516 may include multiple microphones arranged in a microphone array. Also, in some examples, one or more of NMDs 512, 514 and / or 516 may be a microphone located on a mobile device (eg, a smartphone, tablet, or other device).

[0086] As shown, computer 506 is configured to interface with CR 522 and PBDs 532, 534, 536, and 538 via communication path 544. In one example, CR 522 may be a network device, such as network device 200 of FIG. 2. Thus, CR 522 may be configured to provide controller interface 400 of FIG. 4. Similarly, PBDs 532, 534, 536, and 538 may be playback devices, such as playback device 300 of FIG. 3. In this manner, PBDs 532, 534, 536, and 538 may be physically distributed throughout the home, as illustrated in FIG. 1. For purposes of illustration, PBDs 536 and 538 are part of a combined zone 530, while PBDs 532 and 534 are part of their own respective zones. As discussed above, PBDs 532, 534, 536, and 538 may be dynamically combined, grouped, uncombined, and ungrouped. The communications path 544 may comprise one or more types of networks, such as a WAN, a LAN, and / or a PAN, including the Internet, among others.

[0087] In one example, CR 522 and PBDs 532, 534, 536, and 538, like NMDs 512, 514, and 516, may be components of one or more "Smart Home" systems. In one case, PBDs 532, 534, 536, and 538 may be distributed throughout the same home as NMDs 512, 514, and 516. Additionally, as alluded to above, one or more of PBDs 532, 534, 536, and 538 may be one or more of NMDs 512, 514, and 516. For example, at least one or all of NMD 512-16, PBD 532-38, and / or CR 522 may be a voice enabled device (VED).

[0088] The NMDs 512, 514, and 516 may be part of a local area network, and the communication path 542 may include access points that link the local area networks of the NMDs 512, 514, and 516 to the computer 504 via a WAN (communication path not shown). Similarly, each of the NMDs 512, 514, and 516 may communicate with each other via such access points.

[0089] Similarly, the CR 522 and the PBDs 532, 534, 536, and 538 may be part of a local area network and / or local playback network, as alluded to in the previous section, and the communication path 544 may include an access point linking the local area network and / or local playback network of the CR 522 and the PBDs 532, 534, 536, and 538 to the computer 506 via the WAN. Thus, each of the CR 522 and the PBDs 532, 534, 536, and 538 may also communicate with each other via an access point or the like.

[0090] In one example, the communication paths 542 and 544 are configured with the same access point. In one example, each of the NMDs 512, 514, and 516, the CR 522, and the PBDs 532, 534, 536, and 538 can access the cloud network 502 through the same home access point.

[0091] 5, each of the NMDs 512, 514, and 516, the CR 522, and the PBDs 532, 534, 536, and 538 may also communicate directly with one or more of the other devices via a communication means 546. The communication means 546 described herein may include one or more forms of communication between devices according to one or more network protocols, including over one or more types of networks, and / or through one or more other network devices. For example, the communication means 546 may include one or more of Bluetooth™ (IEEE 802.15), NFC, Wireless Direct, and / or proprietary wireless, among others.

[0092] In one example, the CR 522 can communicate with the NMD 512 via Bluetooth™ and with the PBD 534 via another local area network. In another example, the NMD 514 can communicate with the CR 522 via another local area network and with the PBD 536 via Bluetooth. In a further example, each of the PBDs 532, 534, 536, and 538 can also communicate with each other according to a spanning tree protocol over the local playback network, while each communicating with the CR 522 over a local area network different from the local playback network. Other examples are possible.

[0093] In some cases, the communication means between the NMDs 512, 514, and 516, the CR 522, and the PBDs 532, 534, 536, and 538 may be different or change depending on the type of communication between the devices, the network conditions, and / or the latency requirements. For example, the communication means 546 may be used when the NMD 516 is first installed in a home having the PBDs 532, 534, 536, and 538. In one case, the NMD 516 may transmit identification information corresponding to the NMD 516 to the PBD 538 via NFC, and in response, the PBD 538 may transmit local area network information to the NMD 516 via NFC (or other form of communication). However, once the NMD 516 is configured in the home, the communication means between the NMD 516 and the PBD 538 may change. For example, the NMD 516 may then communicate with the PBD 538 via communication path 542, cloud network 502, and communication path 544. In another example, the NMD and PBD never communicate via local communication means 546. In a further example, the NMD and PBD may communicate primarily via local communication means 546. Other examples are possible.

[0094] In an illustrative example, NMDs 512, 514, and 516 may be configured to receive voice input to control PBDs 532, 534, 536, and 538. Available control commands may include any of the media playback system controls previously suggested, such as playback volume control, playback transport control, music source selection, and grouping, among others. In one instance, NMD 512 may receive voice input to control one or more of PBDs 532, 534, 536, and 538. In response to receiving the voice input, NMD 512 may transmit the voice input via communication path 542 to communication device 504 for processing. In one example, computer 504 may convert the voice input into an equivalent text command and parse the text command to identify the command. Computer 504 may then transmit the text command to computer 506. In another example, computer 504 may convert the voice input into an equivalent text command and then transmit the text command to computer 506. The computer 506 can then parse the text command to identify one or more playback commands, and the computer 506 can further control at least one of the PBDs 532-538 to execute the commands.

[0095] For example, if the text command is "Play 'Track 1' by 'Artist 1' from 'Streaming Service 1' in 'Zone 1'", then computer 506 may identify (i) a URL for 'Track 1' by 'Artist 1' available from 'Streaming Service 1', and (ii) at least one playback device in 'Zone 1'. In this example, the URL for 'Track 1' by 'Artist 1' from 'Streaming Service 1' may be a URL pointing to computer 508, and 'Zone 1' may be the combined zone 530. Thus, upon identifying the URL and one or both of PBDs 536 and 538, computer 506 may transmit the identified URL to one or both of PBDs 536 and 538 via communication path 544 for playback. One or both of PBDs 536 and 538 may each retrieve audio content from computer 508 according to the received URL and initiate playback of 'Track 1' by 'Artist 1' from 'Streaming Service 1'.

[0096] Those skilled in the art will appreciate that the above is merely one illustrative example and that other implementations are possible. In one case, the operations performed by one or more of the plurality of network devices 500 as described above may be performed by one or more other devices in the plurality of network devices 500. For example, the conversion of voice input to text commands may alternatively be performed, in part or in full, by another device such as the CR 522, the NMD 512, the computer 506, the PBD 536, and / or the PBD 538. Similarly, the identification of URLs may alternatively be performed, in part or in full, by another device such as the NMD 512, the computer 504, the PBD 536, and / or the PBD 538.

[0097] f. Network microphone device example 6 illustrates a functional block diagram of an exemplary network microphone device 600 that may be configured to be any of the VEDs described herein and / or one or more of the NMDs 512, 514, and 516 of FIG. 5. As illustrated, the network microphone device 600 includes one or more processors 602, a computer-readable memory 604, a microphone array 606 (e.g., one or more microphones), a network interface 608, a user interface 610, software components 612, and a speaker 614. Those skilled in the art will appreciate that other network microphone device configurations and arrangements are possible. For example, the network microphone device may alternatively omit the speaker 614 or have a single microphone in place of the microphone array 606.

[0098] The one or more processors 602 may include one or more processors and / or controllers, which may take the form of a general purpose or special purpose processor or controller. For example, the one or more processors 602 may include a microprocessor, a microcontroller, an application specific integrated circuit, a digital signal processor, etc. The memory 604 may be a data storage into which one or more of the software components executable by the one or more processors 602 to perform these functions may be loaded. Thus, the memory 604 may include one or more non-transitory computer-readable storage media, examples of which include, among others, volatile storage media such as random access memory, registers, caches, and non-volatile storage media such as read-only memory, hard disk drives, solid state drives, flash memories, and / or optical storage devices.

[0099] The microphone array 606 may be a plurality of microphones arranged to detect sounds in the environment of the network microphone device 600. The microphone array 606 may include any type of microphone now known or later developed, such as a condenser microphone, an electret condenser microphone, or a dynamic microphone, among others. In one example, the microphone array may be arranged to detect audio from one or more directions relative to the network microphone device. The microphone array 606 may be sensitive to a portion of a frequency range. In one example, a first subset of the microphone array 606 is sensitive to a first frequency range, while a second subset of the microphone array is sensitive to a second frequency range. The microphone array 606 may be further arranged to capture location information of an audio source (e.g., a voice, an audible sound) and / or assist in filtering background noise. Notably, in some embodiments, the microphone array may be comprised of only a single microphone rather than multiple microphones.

[0100] The network interface 608 can be configured to facilitate wireless and / or wired communications between various network devices, e.g., referring to FIG. 5, the CR 522, the PBDs 532-538, the computers 504-508 in the cloud network 502, and other network microphone devices. As such, the network interface 608 can take any suitable form for performing these functions, examples of which can include an Ethernet interface adapted to facilitate wireless communications, a serial bus interface (e.g., FireWire, USB 2.0, etc.), a chipset, and an antenna, and / or any other interface that provides wired and / or wireless communications. In one example, the network interface 608 can be based on industry standards (e.g., infrared, wireless, wired standards including IEEE 802.3, wireless standards including IEEE 802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.15, 4G mobile communications standards, etc.).

[0101] The user interface 610 of the networked microphone device 600 can be configured to facilitate user interaction with the networked microphone device. In one example, the user interface 608 can include one or more of physical buttons, a touch-sensitive screen, and / or a surface-mounted graphical interface, among others, for a user to provide input directly to the networked microphone device 600. The user interface 610 can further include one or more of a light and a speaker 614 to provide visual and / or audio feedback to the user. In one example, the networked microphone device 600 can also be configured to play audio content via the speaker 614. III. EXEMPLARY SYSTEMS AND METHODS

[0102] In some cases, it is desirable for a voice-enabled device (VED) to dynamically calculate and set a system response volume. In some situations, the audio playback system may generally set the system response volume based on the environment (e.g., based on a default setting). This method does not take into account subsequent changes in the sound of the room, and the system response may be too loud or too quiet for the environment at the time the system issues the system response. To address this potential problem, in some examples, the VED may dynamically calculate and set the system response volume at the time of playing the system response (or immediately before playing the system response). This may be beneficial in situations where the sound environment of the room is subject to change. For example, a user may play audio content through the VED at a high volume while occasionally muting the audio content to take a phone call. The VED may evaluate the environment to calculate and set the system response volume while outputting the system response (or immediately before outputting the system response). This allows the system to output the system response at a system response volume appropriate for the environment.

[0103] It is further preferred that one or more voice-enabled devices (VEDs) in the system of network devices calculate and set a system response volume for the system of network devices. One or more VEDs in the system of network devices may calculate and set a system response volume for the system of network devices (i) locally via a local area network (LAN) and / or (ii) remotely via a cloud server. For example, one of the one or more VEDs in the system may calculate and set a system response volume and send the system response volume to other VEDs in the system via a LAN. In another example, one of the one or more VEDs in the system may calculate and set a system response volume and send the system response to a cloud server. In this example, other VEDs in the system may obtain the system response volume from the cloud server and set the system response volume accordingly. In another example embodiment, one or more VEDs may send a sample of the ambient sound (measured in the room in which the system of network devices is located) to a cloud computing system, which in turn sets the system response volume for the system of network devices. In such example embodiments, the cloud computing system may set the system response volume to the same volume level for each VED in the system of multiple network devices, or the cloud computing system may set the system response volume to two or more different volume levels for each VED in the system of multiple network devices.

[0104] As previously described, a voice-enabled device (VED) may be a playback device (PBD), a network microphone device (NMD), a video playback device (VPD), or any other network device equipped with one or more microphones and / or speakers. In operation, a VED equipped with one or more speakers can play both audio content (e.g., video-related music, audio tracks, speech content, and other audio content) and audio responses (or other system responses) through one or more speakers. The VED may also play other common system responses (e.g., wake-up alarms, timer notifications, and / or system notifications such as bells, beeps, clicks, and other notifications) through one or more speakers.

[0105] As discussed above, some conventional network devices set their system response volume (i) to be the same as the volume of the audio content, (ii) to a fixed volume, and / or (iii) based on a manual input setting by the user.

[0106] However, in many situations, the system response volume of a VED or other network device is not appropriate for the room, installation location, or user. For example, if the VED or other network device is located in a large room, the system response volume may not be loud enough to alarm a user standing on the opposite side of the room from the network device. As another example, if the user is hard of hearing, the system response volume may not be loud enough to alarm the user. As yet another example, if audio content is not being played in the room, the system response volume may be too loud and startle the user.

[0107] Thus, it may be desirable for the VED or other network device to set the system response volume based on factors including, but not limited to, (i) the size of the room, (ii) various sound pressure level (SPL) measurements, (iii) the audio reproduction volume, (iv) the loudness of the audio reproduction content, (v) the number of network devices in the system, and (vi) the configuration of the network devices in the system.

[0108] 7 illustrates a media playback system 700 according to an example embodiment. The media playback system 700 includes VEDs 704, 706, and 708. The VED 704 includes a microphone 710 and a speaker 712. The VED 706 includes a microphone 714 and a speaker 716. The VED 708 includes a microphone 718 and a speaker 720. The VEDs 704, 706, and 708 are configured to play acoustic content and output system responses to the listening area 702 during operation.

[0109] Each of the VEDs 704, 706, and 708 may be either a network microphone device (NMD), a sound reproduction device (PBD), a video reproduction device (VPD), or any other network device with one or more microphones and one or more speakers. The VEDs 704, 706, and 708 may operate independently of one another, may be grouped to operate as a stereo pair, and / or may be grouped to play music or other audio content in sync with one another.

[0110] In operation, the VEDs 704, 706, and 708 are configured to receive voice commands from a user via their microphones and output audio content and system responses via their speakers. In some alternative embodiments (not shown), one or more of the VEDs 704, 706, and 708 may include both a microphone and a speaker, one or more of the VEDs 704, 706, and 708 may include a microphone but not a speaker, and one or more of the VEDs 704, 706, and 708 may include a speaker but not a microphone.

[0111] In some embodiments, the VEDs 704, 706, and 708 may be configured to operate in a manner that interacts with one another in a manner similar to how the NMDs 512, 514, 516 and / or the PBDs 532, 534, 536, 538 operate in a manner that interacts with one another as described with respect to FIG. a. Example of system response volume calculation

[0112] In some embodiments, each or all of the VEDs 704, 706, and 708 may calculate and set a system response volume (SRV) in response to a determination that a requirement exists to output a system response. Specifically, the VEDs 704, 706, and 708 may (i) calculate and set their own SRV independently of each other, and / or (ii) calculate and set one SRV for all of the VEDs 704, 706, and 708. Alternatively, one of the VEDs 704, 706, and 708 may be designated to provide the system response, and the designated VED (or perhaps another VED or other computing system) may calculate and set the SRV for the designated VED.

[0113] In one example, the VED 704 may determine that a requirement exists to output a system response and then calculate and set a system response volume for the media playback system 700. The VED 704 may calculate the desired system response volume (i) prior to outputting the system response, (ii) in response to a new SPL calculation, (iii) in response to a new system configuration, (iv) in response to a new acoustic volume setting, and / or (v) in response to a manual configuration of the SRV.

[0114] In each embodiment described herein, the VED 704 is used as a network device that determines whether a requirement exists for outputting a system response and calculates a new system response volume. In operation, any of the VEDs 704, 706, and 708 (individually or in combination with one or more other connected network devices) may (i) determine that a requirement exists for outputting a system response, and (ii) calculate and set a system response volume for the individual VED and / or for the entire sound reproduction system. The VED 704 is used merely as an example device to illustrate the functionality of determining whether a requirement exists and calculating a new system response volume in response to the determination. Further, in models in which two or more of the VEDs 704, 706, and 708 work in cooperation, in conjunction with one another, or in unison to determine whether a requirement exists for outputting a system response and to calculate and / or set a new system response volume, the VEDs 704, 706, and 708 may be configured to communicate with one another via wireless and / or wired network capabilities based on any one or more of: (i) a determination that a requirement exists for outputting a system response; (ii) data for making a determination as to whether a requirement exists for outputting a system response; (iii) setting the calculated system response volume; (iv) data for calculating the system response volume; and / or (v) a command for setting the system response volume.

[0115] In some embodiments, the VED 704 determines that a requirement exists for outputting a system response, and then outputs the system response after calculating a system response volume. In some embodiments, after determining that a requirement exists for outputting a system response, the VED 704 records sound in an area surrounding the VED 704 using the microphone 710. The VED 704 then processes the recorded sound to determine the SPL of the sound in the area surrounding the VED 704.

[0116] Requirements for outputting a system response may include a requirement for one or more of the VEDs 704, 706 and / or 708 to (i) activate an alarm, (ii) issue a notification, and / or (iii) respond to a voice command received from a user.

[0117] For example, in some embodiments, when a user speaks a voice command in the area of ​​the VED 704, the VED 704 (i) determines that a requirement exists for outputting a system response, and then (ii) calculates an appropriate system response volume before outputting the response. In this example, if a user speaks a command that requests an audio response (or other system response) from the media playback system 700 in a quiet room, the VED 704 determines that a requirement exists for outputting a system response, calculates the SPL of the room, and then sets the system response volume based on the SPL calculation. Because the room is quiet, setting the system response volume based on the SPL calculation may include decreasing the system response volume from its previous volume level.

[0118] In operation, the SPL calculation may be based on sound measurements obtained from any one or more of the microphones 710, 714, and / or 718 of the VEDs 704, 706, and 708, respectively. The VEDs 704, 706, and 708 are configured to (i) receive various sound measurements and / or calculations, i.e., SPL calculations, from other VEDs in the configuration, and (ii) transmit system response volume settings to other VEDs in the configuration. For example, the VED 704 may receive various sound measurements from the microphone 714 of the VED 706 and the microphone 718 of the VED 708. The VED 704 may use these measurements to calculate the SPL of the listening area 702 and set an appropriate system response volume based on the calculated SPL. The VED 704 may then send the appropriate system response volume to the VEDs 706, 708 via a network interface (e.g., via a LAN and / or via a cloud server). In another example, all of the VEDs 704, 706, and / or 708 may calculate the SPL independently of one another. In this example, the VED 704 may receive the SPL calculations from the VEDs 706, 708 and set the system response volume using the SPL calculations. The VED 704 may then send the system response volume to the VEDs 706, 708 via a network interface and executed by the VEDs 706, 708.

[0119] In another example, when a user speaks a command requesting a voice response (or other system response) from the media playback system 700 in a noisy room, the VED 704 determines that a requirement exists for outputting a system response, calculates the SPL of the room, and then sets the system response volume based on the SPL calculation. As described above, the SPL calculation may be based on sound measurements obtained from any one or more of the microphones 710, 714, and / or 718 of the VEDs 704, 706, and 708, respectively. Because the room is noisy, setting the system response volume based on the SPL calculation may include increasing the system response volume from its previous volume level.

[0120] In some embodiments, the amount by which the system response volume is increased or decreased in response to determining that a requirement exists for outputting a system response may depend on the hearing characteristics of the user. The hearing characteristics may be based on (i) one or more user account settings; or (ii) manual input by the user. The user account settings may include settings related to the user's hearing ability (i.e., normal hearing or hearing impairment (and possibly the degree of hearing impairment). Thus, for a user with a hearing impairment, the VED 704 in some embodiments increases the system volume more in noisy environments and / or decreases the system volume less in quiet environments compared to the amount of increase and / or decrease for a user without a hearing impairment. For example, for a user with a hearing impairment, the VED 704 may set the system response volume to a level that is +3 decibels (dB) higher than the system response volume level that it sets for a user without a hearing impairment.

[0121] In some embodiments, the step of setting the system response volume based on the SPL calculation and then outputting the system response at the set system response volume includes unmuting one or more VEDs. For example, if all VEDs 704, 706, and 708 are muted when the VED 704 determines that a requirement exists to output an audio response (or other system response), the step of setting the system response volume includes (i) unmuting one or more of the VEDs 704, 706, and 708 to set the system response volume, and (ii) outputting the audio response (or other system response) at the set system response volume. In some embodiments, it additionally includes re-muting a VED that was previously unmuted. In yet another embodiment, a distinction may be made between muting the playback of audio content and playing an audio response, such that the VED can play an audio response from one or more speakers even when the audio playback is muted.

[0122] In some circumstances, the system response volume is set based on the sound playback volume of the VED 704 when the VED 704 is playing the media content. As a result, a problem occurs if the VED 704 outputs a system response after the user mutes the sound playback volume of the VED 704, because the system response volume is still based on the sound playback volume of the VED 704 when the VED 704 was playing the media content. To overcome this problem, some embodiments include the VED 704 limiting the system response volume to a predetermined threshold when the VED 704 is in a muted state. The threshold can be a value ranging from 1 to 10 (other ranges can be used) depending on the placement and configuration of the media playback system 700. For example, a user may listen to media content through the VED 704 at a sound playback volume of 8. When the user mutes the sound playback volume of the VED 704, the VED may limit the system response volume to an appropriate threshold (i.e., any value less than 8). In this manner, when the VED 704 outputs a system response, the system response volume is appropriate and is less likely to startle the user.

[0123] In some embodiments, the system response volume is set based on the loudness of the sound reproduction content when the VED 704 is playing the media content. This can be beneficial because the VED 704 can set the system response volume to the volume of the sound content played by the VED 704. For example, a user may be playing media content through the VED 704 that is characterized by sporadic bursts of sound with longer pauses. The VED 704 may obtain an updated loudness measurement when the VED 704 outputs the system response by monitoring the loudness of the sound reproduction content via the microphone 710. The VED 704 then sets an appropriate system response volume based on the loudness of the sound reproduction content. For further discussion regarding setting the output volume based on the volume of the sound content, see U.S. Patent Application Serial No. 62 / 298,439, paragraphs 100-103, the contents of which are incorporated herein by reference.

[0124] In some embodiments, the VED 704 (on a scale of 1 to 10) may set a system response volume based on the loudness of the sound reproduction content in addition to the instantaneous SPL measurement before outputting a system response. For example, the VED 704 may monitor the loudness of the sound reproduction content via the microphone 710, and further, the VED 704 may obtain an instantaneous SPL measurement after determining that a requirement exists for outputting a system response. The VED 704 may then set the system response volume to an appropriate value based on the loudness of the sound reproduction content and the instantaneous SPL measurement. This may be beneficial because the VED 704 can take into account the loudness of the sound reproduced by the VED 704 in addition to other sound and / or noise sources in the listening area 702.

[0125] Also, in some embodiments, rather than calculating the SPL immediately prior to outputting a system response, one or more VEDs in media playback system 700 may instead be configured to calculate the SPL for listening area 702 periodically (or perhaps semi-periodically or on some other predetermined basis) and then set a system response volume based at least in part on the calculated SPL in response to calculating a new SPL for listening area 702. In some embodiments, one or more of the VEDs may be configured to (i) calculate an SPL periodically or semi-periodically or on some other predetermined basis and then set a system response volume based at least in part on the calculated SPL, and (ii) calculate an SPL in response to determining that the VED should output an audio response (or some other system response) and then set a system response volume based at least in part on the calculated SPL.

[0126] In models in which the VEDs 704, 706, and / or 708 are playing high volume and / or sporadic audio content through their respective speakers, the instantaneous SPL measurements taken by one or more of the VEDs 704, 706, and / or 708 to estimate the SPL may not accurately reflect the average SPL for the listening area 702. For example, if the VED 704 makes an SPL measurement during a period of an unusually high volume song, the SPL taken during the high volume period may cause the VED 704 to set a system response volume that is too high for the listening area 702. In some embodiments, the VEDs 704, 706, and / or 708 may address this issue by (i) lowering the audio playback volume of the VED(s) that are playing the audio content while making the SPL measurements, and / or (ii) taking SPL measurements during temporary pauses in audio playback or between songs. This allows the VEDs 704, 706, and / or 708 to have better access to other sound sources within the listening area 702 that might otherwise be drowned out by the sound reproduction volume.

[0127] However, in some embodiments, the VEDs 704, 706, and / or 708 may be used without changing (e.g., lowering) the sound reproduction volume when setting the system response volume to provide a system response volume according to the sound reproduction volume.

[0128] In other models, all of the VEDs 704, 706, and 708 may be playing audio content, again complicating the setting of the system response volume based on the SPL measurements. One or more of the VEDs 704, 706, and / or 708 may address this issue by lowering the audio playback volume of one or more of the VEDs 704, 706, and / or 708 to an appropriate volume and obtaining an SPL measurement. The particular VED selected to lower the volume may depend on the configuration of the VEDs 704, 706, and / or 708 in the media playback system 700.

[0129] For example, VEDs 704, 706, and 708 may play audio content in sync with one another within listening area 702 as shown in Figure 7. In this example, when VED 704 needs to make an SPL measurement, VED 704 may turn down the audio reproduction volume of VED 706 due to the proximity of VED 704 and VED 706. VED 704 may not need to turn down the audio reproduction volume of VED 708 because VED 708 is not as close to VED 704 as VED 706 and the audio reproduction volume of VED 708 may not affect the SPL measurement made by VED 704 to the same extent as the audio reproduction volume of VED 706.

[0130] However, depending on the model, it may be advantageous for the VEDs 704, 706, and / or 708 to obtain SPL measurements while one or more of the VEDs 704, 706, and 708 are playing audio content. For example, if the audio playback volume of the VED 704 does not interfere with the SPL measurement, the VED may perform the SPL measurement without changing the audio playback volume of its own and / or other VEDs. In another example, if the VED 704 is playing audio content that does not often alternate between high and low volume passages, the VED 704 may be able to assess the SPL of the area 702 more easily by not lowering the volume before obtaining the SPL measurement than if it had lowered the audio playback volume before taking the SPL measurement, since the SPL measurement will include audio content being played at maximum volume.

[0131] In some embodiments, the VED 704 calculates a new system response volume based on the signal-to-noise ratio of the volume of the user's voice command and the measurement of the ambient sound in the listening area 702. In these embodiments, the VED 704 measures the ambient sound in the listening area 702 before outputting the system response. The VED 704 then measures the volume of the user's voice command (e.g., a command that asks the VED 704 to perform an action). In response to performing these measurements, the VED 704 calculates the signal-to-noise ratio of the volume of the user's voice to the measurement of the ambient sound and uses the ratio to set the appropriate system response volume. In one example, if the volume of the user's voice is high compared to the ambient noise in the listening area 702, the VED 704 may set the system response volume to a lower value since the ambient noise has little effect on the system response. In another example, if the volume of the user's voice is low compared to the ambient noise, the VED 704 may set the system response volume to a higher value to compensate for the high level of ambient noise. In yet another example, if the volume of the user's voice is approximately the same volume as the ambient noise, the VED may set the system response volume to a value higher than the ambient noise so that the user can distinguish the response from the ambient noise.

[0132] Additionally, the VED 704 may calculate a new system response volume based on the signal-to-noise ratio of the user's voice command relative to the ambient sound in the listening area 702, as well as the distance at which the user issues the voice command. The user's location may cause the VED 704 to raise or lower the system response volume. In one example, if the user issues a voice command at a short distance from the VED 704 and the volume of the user's voice is low compared to the ambient noise, the VED 704 may set the system response volume higher than the ambient noise but not as high as if the user were located at a greater distance from the VED 704. In another example, if the user issues a voice command at a greater distance from the VED 704 and the volume of the user's voice is high compared to the ambient noise, the VED 704 may set the system response volume lower than the user's voice but not as low as if the user were to issue a voice command closer to the VED 704.

[0133] In some circumstances, the ambient noise level may change after the user issues a voice command but before the VED 704 outputs a system response. To overcome this potential problem, in some embodiments, the VED 704 may use the instantaneous SPL value to modify the system response calculated using the signal-to-noise ratio of the user's voice command to the ambient sound in the listening area 702. For example, the VED 704 may calculate a new system response based on the signal-to-noise ratio of the user's voice command to the ambient sound in the listening area 702, as described above. Then, just before outputting the system response, the VED 704 may obtain an instantaneous SPL measurement. If the instantaneous SPL measurement indicates that the ambient noise has changed since calculating the system response volume, the VED 704 may adjust the system response volume based on the instantaneous SPL measurement.

[0134] In some embodiments, the VED 704 calculates a new system response volume in response to a new system configuration, which may occur when a user (i) adds and / or removes VEDs or other network devices from the media playback system 700, or (ii) performs a diagnostic or calibration in response to repositioning one or more VEDs or other network devices within the listening area 702.

[0135] For example, if the media playback system 700 includes only VEDs 704, 706 and a user adds a VED 708 to the configuration of the media playback system 700, in some embodiments, the VED 704 calculates a new system response volume in response to the change in configuration (e.g., adding the VED 708 to the media playback system 700).

[0136] In another example, a user may perform a diagnostic and / or calibration procedure on the sound reproduction system 700, such as tuning one or more of the VEDs 704, 706, and / or 708 according to a Sonos Trueplay™ calibration procedure or other automated calibration procedure. In some embodiments, one or more of the VEDs 704, 706, and / or 708 perform a new SPL calculation and / or set a new system response volume upon or at least after the diagnostic and / or calibration procedure is completed.

[0137] In some embodiments, the VED 704 calculates a new system response in response to a new system configuration and immediately prior to outputting the system response. This may be advantageous because it allows the VED 704 to calculate an up-to-date system response volume. For example, if the media playback system 700 includes only the VEDs 704, 706 and the user adds the VED 708 to the configuration of the media playback system 700, the VED 704 calculates a new system response volume in response to the change in configuration (i.e., adding the VED 708 to the media playback system 700). The VED 704 may then determine that a requirement exists to output a system response and calculate a new system response volume in response to the determination.

[0138] In some embodiments, the VED 704 calculates a new system response volume in response to receiving a new sound reproduction volume setting. The new sound volume setting may include when the user (i) increases, (ii) decreases, or (iii) mutes the volume. For example, when the user increases the sound reproduction volume, the VED 704 calculates and sets a higher system response volume based on the amount the user increases the volume. Similarly, when the user decreases the sound reproduction volume, the VED 704 calculates and sets a lower system response volume based on the amount the user decreases the sound reproduction volume. In some embodiments, the VED 704 may increase or decrease the system response volume based on the amount the sound reproduction volume was increased or decreased without taking a new SPL measurement. In other embodiments, increasing or decreasing the sound reproduction volume may cause the VED 704 to take a new SPL measurement and set the system response volume based, at least in part, on the new SPL measurement. Additionally, when the user mutes the sound reproduction volume, the VED 704 calculates and sets the system response volume based on a default system response volume. In some embodiments, the default system response volume may be based on a new or previous SPL calculation.

[0139] In some embodiments, the VED 704 calculates a new system response volume in response to a user specifically adjusting the system response volume on the VED 704. In operation, a user may adjust the system response volume via (i) a physical mechanism (e.g., a knob, button, slider, or other control) located on the VED 704 and / or (ii) a wirelessly connected control device (e.g., via RF, IR, or other wireless methods) configured to send a control / instruction signal to the VED 704 that causes the VED 704 to set the system response volume in response to a system response volume control setting command received from the user.

[0140] For example, a user may desire a higher system response volume because the user is interested in hearing certain notifications from the VED 704. In one model, the user may turn up the system response volume to hear alarms that indicate that the user should complete an important action (i.e., take medicine, turn off the stove, etc.).

[0141] In another example, a user may desire a lower system response volume due to a sensitive hearing client or due to a health condition. One model may include a user who suffers from migraines, where it would be advantageous to lower the system response volume to avoid further exacerbating the user's migraine symptoms.

[0142] In some embodiments, the VED 704 sets a new system response volume based at least in part on a predetermined system response volume in response to an event trigger, which may include a user (i) changing the sound reproduction volume of one or more of the VEDs 704, 706, and / or 708, (ii) configuring one or more of the VEDs 704, 706, and / or 708 to operate as standalone sound reproducers or in a group with one or more other VEDs, (iii) detecting motion within the listening area 702 (or possibly some other area), (iv) detecting a change in light within the listening area 702 (or possibly some other area), and / or (v) a time of day or a configured time frame.

[0143] For example, if the VED704 has predetermined a system response volume suitable for nighttime or early morning, then when the VED704 determines (based on the system clock) that it is nighttime or early morning, it may set the system response volume according to the predetermined system response volume.

[0144] In another example, if the VED 704 has predetermined a system response volume that is appropriate for when a user turns off his or her bedroom night light, the VED 704 may set the system response volume according to that predetermined system response volume upon determining both: (i) that it is nighttime (based on the system clock) and (ii) that the lights are off in the listening area 702 (based on the light sensor, messages from the light sensor, and / or messages from the lighting control system).

[0145] In yet another example, if the VED 704 has predetermined a system response volume suitable for a certain configuration of VEDs (e.g., a stereo pair of VEDs 704, 706), the VED 704 may set the system response volume according to the predetermined system response volume upon determining that the VEDs 704, 706 are configured as a stereo pair, or perhaps as a step of configuring the VEDs 704 and 706 to operate as a stereo pair.

[0146] In yet another example, if the VED 704 has predetermined a system response volume appropriate for the afternoon when children are returning home from school, the VED 704 may set the system response volume in accordance with the predetermined system response volume when it determines that (i) it is between 3:00 p.m. and 6:00 p.m. and (ii) there is movement within the listening area 702 (based on a motion sensor or a message from the motion sensor) that indicates the presence of children.

[0147] In some embodiments, two or more of the VEDs 704, 706, and 708 are configured to output the system response at a system response volume. In these embodiments, the system response volume may be based at least in part on the number of network devices that output the system response. In operation, the system response volume for each VED configured to output the system response may be set to a level such that the total amount of system response reproduced by the multiple VEDs is the desired system response volume. For example, if the desired system response volume is X dB, then (i) for a system configured to output the system response through a single VED, the system response volume of the single VED may be set to X dB, and (ii) for a system configured to output the system response volume through two VEDs, the system response volume of each VED may be set to X-3 dB, or perhaps some other offset factor to account for the fact that multiple VEDs output the system response.

[0148] Additionally or additionally, in some embodiments, the system response volume may be based, at least in part, on the configuration of the media playback system 700. In these embodiments, the VEDs 704, 706, and / or 708 may be operating as different types of playback devices (e.g., speakers or subwoofers) or in sync with each other (a combined stereo pair). For example, the VEDs 704, 706 may be operating as a combined stereo pair while the VED 708 is operating as a subwoofer. In this configuration, the VEDs 704, 706 may have their system response volumes set lower than the VED 708, given that they are a combined stereo pair with multiple speakers 710 and 714 that output the system response. The amount by which the VEDs 704, 706 lower their system response volumes may correspond to a look-up table that includes equal loudness system response volume modifications for different configurations of the media playback system 700 (e.g., lowering the system response volume by -2 dB for a stereo pair configuration and -4 dB for a 5.1 home theater configuration).

[0149] In some embodiments, each (or any) of VEDs 704, 706, and 708 determines whether a requirement exists for outputting a system response, and in response to a determination that a requirement exists for outputting a system response, determines a new system response volume based on one or more factors, including, but not limited to, (i) the number of network devices connected to the media playback system 700, (ii) SPL measurements from one or more (or all) of the VEDs of the media playback system 700, and / or (iii) the type of each VED of the media playback system.

[0150] In some embodiments, each of the VEDs 704, 706, and 708 determines whether a requirement exists to output a system response, and in response to the determination, determines and / or sets a new system response volume for one or more of the VEDs 704, 706, and / or 708 (individually or as a group) based at least in part on the number of VEDs in the media playback system 700. In these embodiments, after each of the VEDs 704, 706, and 708 calculates its individual system response volume, each VED, in response to a determination that two or more network devices are connected, modifies its calculated system response volume to take into account the other VEDs in the media playback system 700. Each VED modifies (e.g., reduces) its own system response volume to take into account the other VEDs in the media playback system 700, so that the collection of VEDs in the media playback system 700 avoids playing the system response at a higher volume than desired. For example, if VED 704 (either alone or in conjunction with VED 706, VED 708, and / or perhaps other computing devices (not shown)) determines the system response volume of the media playback system's collection of VEDs 704, 706, and 708 to be 5 (e.g., on a scale of 1 to 10), then if all VEDs set their system response volume to 5, the effective volume of the system response played by all of VEDs 704, 706, and 708 may be greater than 5. However, if each VED reduces its system response volume from 5 to, for example, 3.5 based on the media playback system 700 having the other two VEDs playing the system response, then the effective volume of the system response played by all of VEDs 704, 706, and 705 may be approximately 5, assuming each VED set its system response volume to, for example, 3.5.

[0151] Additionally or alternatively, in some embodiments, each of the VEDs 704, 706, and 708 determines whether a requirement exists to output a system response, and in response to that determination, determines and / or sets a new system response volume for one or more of the VEDs 704, 706, and / or 708 (individually or as a group) based at least in part on one or more SPL measurements from one or more of the VEDs 704, 706, and / or 708, or perhaps an aggregate SPL measurement from a collection of the VEDs 704, 706, and 708. For example, each of the VEDs 704, 706, and 708 may make an individual SPL measurement. A group coordinator (i.e., one of the VEDs 704, 706, and 708) analyzes the individual SPL measurements to determine an aggregate SPL measurement for the listening area 702. The group coordinator (e.g., VED 704) then determines a new system response volume based on the overall SPL measurements, configures itself with the system response volume determined based on the overall SPL measurements, and further (i) configures other VEDs (e.g., VEDs 706, 708) to the system response volume determined based on the overall SPL measurements, or (ii) sends the determined system response volume to the other VEDs (e.g., VEDs 706, 708) so that the other VEDs can configure themselves to the determined system response volume.

[0152] Additionally or alternatively, in some embodiments, each of the VEDs 704, 706, and 708 determines whether a requirement exists to output a system response, and in response to the determination, determines and / or sets a new system response volume based at least in part on the type(s) of the VEDs of the media playback system 700. Some VEDs may have more or fewer speakers and / or different configurations of speakers during operation than other VEDs. For example, the VEDs 704, 706 may have two to four small to medium sized speakers (e.g., approximately 2-8 inches in diameter) configured to output full-range sound, while the VED 708 may have one or two large speakers (e.g., 8-12 inches in diameter) configured to output low frequency sound. In this example configuration, the system response volume settings for the VEDs 704, 706 may be different from the system response volume settings for the VED 708, given the differences in speaker types and configurations between the different VEDs.

[0153] Additionally or alternatively, in some embodiments, the VEDs 704, 706, and / or 708 may calculate different system response volumes. This may occur when each VED is located in a different room or in different areas of the same room with different SPL measurements. An example may be when a user is having a conversation in close proximity with one or more of the VEDs 704, 706, and 708. In these embodiments, a group coordinator (i.e., one of the VEDs 704, 706, or 708 tasked with compiling the system response volume calculations) may communicate with other VEDs of the media playback system 700 to receive their respective system volume determinations, calculate an average or weighted master system response volume, and instruct the network devices to set their system response volumes to the master system response volume or possibly to individual system response volume settings such that the effective system response volume of the collection of VEDs when they play the system response is the determined master system response volume. For example, if a group coordinator (e.g., VED 704) determines the master system response volume to be 5 (on a scale of 1 to 10), the group coordinator can set its own system response volume to 4, set VED 706's system response volume to 4, and set VED 708's system response volume to 2, so that when the collection of VEDs 704, 706, and 708 plays a system response, the VED collection can play the system response at an effective master system response volume of, for example, 5.

[0154] In some embodiments, when all of the VEDs 702, 704, 706 are playing media content while one of the VEDs 704, 706, and 708 is outputting a system response, the system response volume may be too low in the listening area 702. For example, in terms of decibel output, 10 speakers each playing media content at 50 dB is equivalent to one speaker playing media content at 60 dB. This additive effect may be more noticeable when the VEDs 704, 706, and 706 are close to each other. For example, if a group coordinator (e.g., VED 704) sets the sound reproduction volume for each VED to 5, the effective sound reproduction volume (effective volume when all of the VEDs 704, 706, and 708 are playing media content) may be 7 or 8 depending on the configuration of the media playback system 700. To overcome this problem, after the group coordinator determines the system response volume, it modifies the system response volume to take into account the number of VEDs in the configuration of the media playback system 700. For example, the media playback system 700 may have a configuration including VEDs 704, 706, and 708 arranged as shown in Figure 7, with VED 704 as the group coordinator. In this example, VED 704 may determine that there are three VEDs in the configuration (VEDs 704, 706, and 708) and may modify the system response volume to a value appropriate for a configuration including three VEDs.

[0155] During operation, the VED704: L m =L u +10log 10 N The system response volume may be modified using an equation such as:

[0156] In the above formula, L m represents the corrected system response volume, and L uwhere N represents the unmodified system response volume (i.e., the system response volume determined by the group coordinator), and N represents the number of VEDs in the configuration. After the group coordinator (VED 704 in this example) calculates the modified system response volume, it sets the system response volume according to the modified system response volume.

[0157] In some embodiments, when a group coordinator determines and sets system response volumes for the VEDs 704, 706, and 708 in the listening area 702, the system response volumes may be too loud or too quiet for users in the listening area 702. To overcome this potential problem, in some embodiments, the group coordinator may limit the system response volumes of the VEDs 704, 706, and 708 based on predefined thresholds. These thresholds may represent the maximum and / or minimum system response volumes acceptable to a user. For example, based on the characteristics of the listening area 702, the predefined thresholds may be system response volumes of 2 and 8 for a low threshold and a high threshold, respectively. A user may set the predefined thresholds, or one or more of the VEDs 704, 706, and 708 may automatically set the predefined thresholds based on the listening area 702. In this example, if the group coordinator (either alone or in conjunction with one or more other devices) determines the system response volume to be 9, the group coordinator may set the system response volume to 8 to avoid a system response that is too loud. Similarly, if the group coordinator determines the system response volume to be 1, the group coordinator may set the system response volume to 2 to avoid a system response that is too quiet.

[0158] Additionally or alternatively, in some embodiments, the group coordinator limits the system response volume based on the audio playback volume of the media playback system 700. This can be advantageous because it avoids the system response being too quiet or too loud when the media playback system 700 is playing audio content. For example, if the group coordinator determines the system response volume to be 3, while the audio playback volume of the media playback system 700 is 6, the group coordinator may set the system response volume to 6 (e.g., the audio playback volume) to avoid the system response being too quiet and / or being drowned out by the audio content. This feature is useful in models where the media playback system is configured to "duck" (i.e., temporarily lower) the audio playback volume when one or more VEDs are playing a system response. In another example, if the group coordinator determines the system response volume to be 7, while the sound playback volume of the media playback system 700 is 3, the group coordinator may set the system response volume to a predetermined maximum value of 5 to avoid the system response being too loud compared to the sound playback.

[0159] In any of the above examples, one or more VEDs may transmit information, including but not limited to information for purposes of determining and / or setting a system response volume, to any one or more other VEDs. For example, a first VED may transmit to a second VED (and possibly additional VEDs) any one or more of: (i) its current sound reproduction volume level; (ii) its current system volume level; (iii) an SPL measurement; (iv) measurement data on which the SPL measurement is based; (v) configuration status information (e.g., standalone, stereo pair, sync group, bonded player, home theater, etc.); and / or (vi) any other information that may be used in connection with determining a system response volume. Furthermore, in response to receiving some of the information from the first VED, the second VED may use the information to (i) determine and set its own system response volume and (ii) determine and / or set a system response volume for one or more additional VEDs.

[0160] In some of the examples described above, one or more VEDs may also or may not transmit information to the cloud computing system to determine and / or set a system response volume for one or more (or all) VEDs in a particular system. For example, a first VED may transmit to the cloud computing system: (i) its current sound reproduction volume level, (ii) its current system volume level, (iii) the SPL measurement, (iv) the measurement data on which the SPL measurement is based, (v) configuration status information (e.g., standalone, stereo pair, sync group, bonded player, home theater, etc.), and / or (vi) any other information that may be used in connection with determining the system response volume. Further, in response to receiving some of the information from the first VED, the cloud computing system can use the information to determine and / or set a system response volume for the first VED and / or additional VEDs in a particular media playback system. b. Sound reproduction volume calculation example

[0161] In some embodiments, if content is being played from the media playback system 700 prior to the system response, the VEDs 704, 706, and / or 708 may lower their audio playback volume by a predetermined amount (e.g., 35% or -3 dB for each VED) immediately prior to playing the system response to allow the user to better hear the system response over the audio content. For example, if the VEDs 704, 706, and / or 708 determine that a requirement exists to output a system response while playing content, the VEDs 704, 706, and / or 708 may lower their respective audio playback volumes by 35% to allow the user to better hear the system response.

[0162] One challenge for a media playback system with multiple VEDs is that when media content is being played from all of the VEDs, lowering the sound playback volume of each VED by 35% or -3 dB may not result in an effective sound playback volume lower than the calculated system response volume. The effective sound playback volume is the collective playback volume of all VEDs in the media playback system 700. As explained above, in terms of decibel output, 10 speakers each playing the system response at 50 dB is equivalent to one speaker playing the system response at 60 dB. For example, if VEDs 704, 706, and 708 are playing media content at a sound playback volume of 4 when volume settings are on a scale of 1 to 10 (or other scales are possible), then the effective sound playback volume of the media playback system 700 may be 5 or 6.

[0163] To overcome this problem, in some embodiments, the VEDs 704, 706, and / or 708 modify (e.g., lower) the sound reproduction volume (sometimes referred to as "ducking") when outputting a system response. The amount by which the VEDs 704, 706, and / or 708 modify the sound reproduction volume is based on the number of VEDs present in the media reproduction system 700. For example, the media reproduction system 700 may have a configuration that includes VEDs 704, 706, and 708 arranged as shown in FIG. 7, with VED 704 as the group coordinator. In this example, VED 704 may determine (or recognize) that there are three VEDs (VEDs 704, 706, and 708) in the configuration and may modify the sound reproduction volume of each VED to a value appropriate for a configuration that includes three VEDs.

[0164] During operation, the VED704: L m =L u -10log 10 N The sound reproduction volume may be modified using a formula such as:

[0165] In the above formula, L m represents the corrected sound reproduction volume, and L u where N represents the unmodified sound reproduction volume (i.e., the sound reproduction volume of each of VEDs 704, 706, and 708), and N represents the number of VEDs in the configuration. After calculating the modified sound reproduction volume, the group coordinator (VED 704 in this example) sets the sound reproduction volume according to the modified sound reproduction volume.

[0166] Additionally or alternatively, in some embodiments, the VEDs 704, 706, and / or 708 modify the sound reproduction volume based on the configuration of the media reproduction system 700. In these embodiments, the VEDs 704, 706, and / or 708 have access to a look-up table that contains equal loudness sound reproduction volume corrections for each different configuration of the media reproduction system 700 (i.e., a -3 dB correction for a stereo pair configuration). The look-up table may be added to or updated periodically or semi-periodically via a network interface. The VEDs 704, 706, and / or 708 may have the look-up table in their memory or may access the look-up table through a network interface (e.g., a cloud-based server, a LAN, etc.). For example, the media reproduction system 700 may have the VEDs 704 and 706 operating as a stereo pair. In this configuration, before outputting the system response, the VEDs 704 and / or 706 may access a lookup table to modify the sound reproduction volume by -2 to -4 dB (or some other value defined in the table). In another example, the media reproduction system 700 may have the VEDs 704 and 706 operating as a stereo pair and the VED 708 operating as a subwoofer. In this configuration, before outputting the system response, the VEDs 704, 706, and / or 708 may access a lookup table to modify the sound reproduction volume by -3 to -5 dB (or some other value defined in the table).

[0167] Additionally or alternatively, in some embodiments, the VEDs 704, 706, and / or 708 modify the sound reproduction volume based on the playback mode (e.g., ambient sound mode, full sound mode, and / or home theater mode) of the media playback system 700. In these embodiments, the VEDs 704, 706, and / or 708 have access to a look-up table that contains additional equal-loudness sound reproduction volume correction values ​​for each of the different playback modes of the media playback system 700. For example, the media playback system 700 may have a five-speaker configuration of the VEDs 704, 706, and 708 operating in a home theater mode and two additional VEDs (not shown). In this configuration and playback mode, one or more of the VEDs may access the look-up table and modify the sound reproduction volume of one or more of the VEDs by −6 to −8 dB based on the volume adjustment values ​​in the table before outputting a system response. In another example, media playback system 700 may have VEDs 704, 706, and 708 in a five speaker, one subwoofer configuration operating in full sound mode, plus three additional VEDs (not shown), in which one or more of the VEDs may access a lookup table and modify the sound playback volume of one or more of the VEDs by −7 to −9 dB based on an adjustment value in the table before outputting the system response.

[0168] In some embodiments, the VED 704, 706, and / or 708 modify the sound playback volume based on the loudness of the sound playback content when the VED 704 is playing the media content. This can be beneficial because the VED 704 can lower the sound playback volume during the system response to an appropriate volume relative to the volume of the sound content played by the VED 704. For example, a user may be playing media content through the VED 704 that features sporadic bursts of sound with longer pauses. The VED 704 can obtain an updated loudness measurement when the VED 704 outputs the system response by monitoring the loudness of the sound playback content via the microphone 710. The VED 704 then lowers the sound playback volume by an appropriate amount based on the loudness of the sound playback content while outputting the system response. c. Example of how to

[0169] Method 800 of Figure 8 illustrates an embodiment of a method that may be implemented within an operating environment that includes or includes, for example, media playback system 100 of Figure 1, one or more playback devices of Figure 2, one or more controllers 300 of Figure 3, a user interface of Figure 4, the configuration shown in Figure 5, the NMD shown in Figure 6, and / or media playback system 700 shown in Figure 7. Method 800 may include one or more operations, functions, or actions, such as those illustrated by one or more of blocks 802 and 804. Although the blocks are illustrated in chronological order, the blocks may be performed in parallel and / or in a different order than described herein. Additionally, various blocks may be merged into fewer blocks, divided into additional blocks, and / or deleted based on a desired implementation.

[0170] Further, for method 800 and other processes and methods disclosed herein, the flowchart illustrates the functions and operations of one possible implementation of some embodiments. In this regard, each block may represent a module, segment, or portion of program code, which includes one or more instructions executable by one or more processors to implement a particular logical function or step in the process. The program code may be stored on any type of computer readable medium, such as a storage device, including a disk or hard drive. The computer readable medium may include non-transitory computer readable media, such as a tangible non-transitory computer readable medium that stores data for a short period of time, such as a register memory, a processor cache, and a random access memory (RAM). The computer readable medium may also include non-transitory media, such as a secondary or persistent long-term storage device, such as a read only memory (ROM), an optical or magnetic disk, a compact disk read only memory (CD-ROM). The computer readable medium may also be any other volatile or non-volatile storage system. The computer readable medium may be considered, for example, a computer readable storage medium or a tangible storage device. Additionally, with respect to method 800 and other processes and methods disclosed herein, each block in FIG. 8 may represent circuitry that is wired to implement a particular logical function within the process.

[0171] Method 800 begins at block 802 with a first network device (or alternatively, a computing device configured to control the first network device) determining that a requirement exists for outputting a system response. In some embodiments, determining that a requirement exists for outputting a system response includes receiving audio input via a first microphone associated with the first network device. In some embodiments, determining that a requirement exists for outputting a system response includes activating a system alarm or notification.

[0172] Next, the method 800 proceeds to block 802, which includes, in response to a determination that a requirement exists for outputting a system response, (i) setting a system response volume of a first speaker associated with the first network device, and (ii) outputting the system response at the set system response volume via the first speaker associated with the first network device.

[0173] In some embodiments, the first network device includes a first speaker and a first microphone. In some embodiments, the first network device includes the first microphone and the second network device includes the first speaker.

[0174] In some embodiments, the first network device includes a first speaker and the second network device includes a second speaker. Further, in some embodiments, outputting the system response at the set system response volume via a first speaker associated with the first network device includes outputting the system response at the set system response volume via a first speaker associated with a first network device that is synchronized with a second network device that outputs the system response at the set system response volume via a second speaker.

[0175] In some embodiments, setting a system response volume for a first speaker associated with the first network device includes (i) obtaining a sound pressure level (SPL) measurement via one or more microphones (e.g., the first microphone) associated with the first network device, and (ii) setting the system response volume based at least in part on the SPL measurement.

[0176] In some embodiments, the SPL measurements are based on one or more of: (i) an SPL measurement at the output of a first speaker, (ii) an SPL measurement at the output of a second speaker, (iii) an SPL measurement at a designated listening position in a room, (iv) an SPL measurement based on multiple SPL measurements from multiple microphones, (v) an SPL measurement of sounds within a predetermined frequency band. In some embodiments, the SPL measurement is a first type of SPL measurement when the first speaker is playing media content of a first type, and in some embodiments, the SPL measurement is a second type of SPL measurement when the first speaker is playing media content of a second type (e.g., playing sounds associated with a television program).

[0177] In some embodiments, setting the system response volume based on the acquired sound pressure level measurement includes setting the system response volume between about 1 dB and about 6 dB higher than the instantaneous and / or previous sound measurement (e.g., the SPL measurement, and / or a measurement derived from the SPL measurement).

[0178] In some embodiments, the step of setting a system response volume of a first speaker associated with a first network device includes (i) accessing a predetermined system response volume, and (ii) setting the system response volume to the predetermined system response volume.

[0179] In some embodiments, the predetermined system response volume is determined via steps including: (i) detecting a triggering event; and (ii) determining a system response volume in response to detecting the triggering event. In some embodiments, the triggering event includes changing a volume of media playback while playing media through a first speaker. Further, in some embodiments, determining a system response volume for a first speaker associated with a first network device includes (i) obtaining SPL measurements via one or more microphones associated with the first network device; and (ii) setting a system response volume based on the SPL measurements.

[0180] In some embodiments, the step of changing the volume of the media playback includes at least one of: (i) increasing the volume of the media playback; (ii) decreasing the volume of the media playback; (iii) muting the media playback; and (iv) unmuting the media playback.

[0181] In some embodiments, the triggering event includes a reconfiguration of the first network device, which in some embodiments includes one of: (i) configuring the first network device from playing media content as a stand-alone playback device to playing media synchronously with at least a second network device, and (ii) configuring the first network device from playing media synchronously with at least a second network device to playing media as a stand-alone playback device.

[0182] In some embodiments, the triggering event includes expiration of a time frame, and determining a system response volume for a first speaker associated with the first network device includes (i) obtaining SPL measurements via one or more microphones associated with the first network device, and (ii) setting the system response volume based on the SPL measurements.

[0183] In some embodiments, the triggering event includes at least one of: (i) detection of motion within an area of ​​the first network device by a motion detector associated with the first network device; and (ii) detection of a change in light within an area of ​​the first network device by a light detector associated with the first network device.

[0184] In some embodiments, the system response volume is different from the volume of media playback through a first speaker associated with the first network device.

[0185] IV. Conclusion The above description discloses various exemplary systems, methods, apparatus, and products including, among other things, components, firmware, and / or software running on hardware. It is understood that such examples are merely exemplary and should not be considered limiting. For example, it is contemplated that any or all of the firmware, hardware, and / or software aspects or components may be implemented in hardware only, software only, firmware only, or any combination of hardware, software, and / or firmware. Thus, the examples provided are not the only ways to implement such systems, methods, apparatus, and / or products.

[0186] Additionally, references herein to an "embodiment" mean that a particular feature, structure, or characteristic described in connection with the embodiment can be included in at least one exemplary embodiment of the present invention. Appearances of this phrase in various places in the specification do not necessarily all refer to the same embodiment, nor are they separate or alternative embodiments mutually exclusive of other embodiments. Thus, the embodiments described herein can be explicitly and implicitly understood by those skilled in the art and combined with other embodiments.

[0187] The present specification has been broadly described in terms of example environments, systems, procedures, steps, logic blocks, processes, and other symbolic representations, which are analogous to the operation of data processing devices directly or indirectly connected to a network. These process descriptions and representations are commonly used by those skilled in the art to most effectively convey the substance of their work to others skilled in the art. Many specific details have been provided to aid in understanding the present disclosure. However, those skilled in the art will understand that certain embodiments of the present disclosure may be practiced without certain, specific details. In other instances, well-known methods, procedures, components, and circuits have not been described in detail to avoid unnecessarily obscuring the embodiments. Thus, the scope of the present disclosure is defined by the appended claims rather than by the embodiments described above.

[0188] If any of the appended claims are read to cover implementations solely in software and / or firmware, then one or more of the elements in at least one example are expressly defined herein to include a tangible, non-transitory storage medium, e.g., memory, DVD, CD, Blu-ray®, etc., that stores the software and / or firmware.

Claims

1. in a second network device configured to play audio content synchronously with the first network device, playing the audio content through a first speaker of the first network device synchronously with playing the audio content by a second speaker of the second network device; receiving audio input via a first microphone associated with the first network device; determining, based on the received audio input, that a requirement exists for outputting a system response via a first speaker, In response to a determination that a requirement exists for outputting a system response, setting a system response volume of the first speaker, where the setting of the system response volume is based on (i) an audio playback volume and (ii) a configuration of a second network device that plays audio content synchronously with the first network device; and outputting a system response at a set system response volume through the first speaker while playing audio content through the first speaker and the second speaker; The method according to claim 1,

2. Setting the system response volume of the first speaker includes: obtaining an SPL measurement, the SPL measurement being a measurement of sound pressure level of ambient sound including ambient noise, via one or more microphones associated with the first network device; Setting a system response volume based on the SPL measurement; The method of claim 1 , comprising:

3. The SPL measurement value is the measured SPL at the output of the first loudspeaker; SPL measurements at the outputs of different loudspeakers associated with the first network; SPL measurements at designated listening positions in the room; an SPL measurement based on multiple SPL measurements from multiple microphones; SPL measurements of sounds within a predetermined frequency band; Based on one or more of the following: The method of claim 2.

4. the SPL measurement is a first type of SPL measurement when the first speaker is playing the first type of media content; the SPL measurement is a second type of SPL measurement when the first speaker is playing the second type of media content; The method according to claim 2 or 3.

5. The first type of media content includes music, The method according to claim 4.

6. the second type of media content includes audio related to at least one of television programs and movies; The method according to claim 4 or 5.

7. determining that a requirement for outputting a system response exists includes activating a system alarm or notification; The method according to any one of claims 1 to 6.

8. Furthermore, determining that the first and second network devices have a stereo pair configuration; In response to determining that the first and second network devices have a stereo pair configuration, increasing a system response volume by a predetermined number of decibels (dB); Equipped with The method according to any one of claims 1 to 7.

9. outputting the system response at the set system response volume through the first speaker; outputting the system response at the set system response volume in synchronization with the third network device outputting the system response at the set system response volume via a third speaker associated with the third network device; The method according to any one of claims 1 to 8.

10. Furthermore, determining that the first, second, and third network devices have a home theater configuration; increasing a system response volume by a predetermined number of decibels (dB) in response to determining that the first, second, and third network devices have a home theater configuration; Equipped with 10. The method of claim 9.

11. the third network device comprises a subwoofer; 11. The method according to claim 9 or 10.

12. Setting the system response volume of the first speaker further includes determining a signal-to-noise ratio of the audio input included in the SPL measurement; Setting the system response volume based on the SPL measurement is setting the system response volume based on the signal to noise ratio; The method of claim 2.

13. A computer readable medium storing instructions which, when executed by one or more processors, cause a computing system to perform the method of any of claims 1 to 12.

14. A speaker and A microphone and one or more processors; A computer readable medium according to claim 13; A computing system comprising:

15. A computer program product for causing a processor to carry out the method according to any one of claims 1 to 12.

Images