Design of a compact home assistant combining an acoustic waveguide and a heat sink

Abstract

To provide a compact voice-activated electronic device with speakers, electronic components and a dual-purpose waveguide / heatsink structure that directs sound from the speakers to an outside of the device and to dissipate heat from the electronic components to the outside of the device.SOLUTION: A compact voice-activated electronic device 404 comprises: a speaker assembly 436; a bottom housing 408 on which the speaker assembly is mounted; an upper housing 406 serving as a speaker grill; a printed circuit board 432 on which electronic components are mounted; and an acoustic waveguide / heatsink 434 configured to direct sound from the speaker assembly to an outside of the voice-activated electronic device and to dissipate heat generated in the electronic components to the outside of the device.SELECTED DRAWING: Figure 4E

Description

[Technical field]

[0001] Technical Field This application relates generally to computer technology, including, but not limited to, methods and systems for providing voice-activated electronic devices for use as user interfaces in smart home or smart media environments. [Background technology]

[0002] background Electronic devices integrated with microphones have been widely used to collect voice input from users and perform different voice-activated functions according to the voice input. For example, many state-of-the-art mobile devices include voice assistant systems (e.g., Siri® and Google Assistant) that are configured to use the voice input to make calls, search for restaurants, initiate routing on a map, create events on a calendar, add posts to social networks, recognize songs, and complete many other tasks. Mobile devices often include a display screen that allows the user making the voice input to check the status of the task requested via the voice input.

[0003] However, in many operating environments, it is more desirable / convenient (or even necessary) for users to receive an audible response to their voice input instead of visual information shown on a display. This may be the case when the electronic device providing user assistance does not have a display screen (as is the case with the Google Home voice-activated speaker with Google Assistant) or when the user is unable to interact with a display screen (as is the case in many home environments where the user is interacting with a voice-activated assistant device that is not nearby or where the user is focused on a particular task).

[0004] In such operating environments, it is useful to provide an electronic device with a speaker system that generates sounds with sufficient clarity and volume to provide an effective audible response to a user request for assistance. Such electronic devices also require on-board auxiliary electronics, such as one or more of: a radio receiver, transmitter, and antenna to support wireless communication; power circuitry and connectors; a processor and support chips for on-device processing; and a data connector. Depending on the home / operating environment in which such electronic assistants are deployed, the assistants may also be designed with different appearances and / or form factors. Especially when a compact form factor is desired, it becomes a challenge to combine the above components to effectively dissipate heat generated by the electronics while also providing sufficient space for effective operation of the speaker system. This challenge is further heightened when it is desired that the electronic device implement voice-activated functions similar to those that can be performed by mobile devices, while having a relatively simple structure and being able to be manufactured at low cost.

[0005] Therefore, there is a need for a compact design for an electronic voice assistant device with efficient audio output and heat dissipation. Summary of the Invention

[0006] overview A voice-activated electronic device is disclosed that provides voice assistant functionality in a small form factor. The voice assistant functionality allows a user to perform a series of activities by natural language voice commands, including one or more of controlling local and remote electronic devices, issuing requests for services and information to remote servers, and / or transmitting media information to other electronic devices for consumption by the user or other users. In some embodiments, the voice-activated electronic device includes visual indicators, such as one or more full-color LEDs, that are used to indicate the status of voice processing associated with a voice request from the user. In some embodiments, the voice-activated electronic device includes one or more speakers that can be used to relay audible information to the user to provide answers to user requests (such as a search query or a request for basketball scores), provide audible status of voice processing operations, play a selected piece of music, and / or read aloud a summary of the current news or current weather forecast. Given that voice input is convenient for users, some embodiments allow a user to utilize voice input to request Internet-based services and functions from remote servers and mobile devices, as well as to control other electronic devices accessible to the user.

[0007] Thus, described herein are embodiments of electronic devices that provide an eyes-free and hands-free voice interface that allows a user to activate voice-activated features on an associated media player device, issue information requests to a remote server, consume audible information or media, and / or control smart home or smart media devices coupled within a voice-activated electronic device in a smart media or smart home environment. In various embodiments described herein, the smart media environment includes one or more voice-activated electronic devices and a plurality of media display devices, each of which is located in a separate location. In some embodiments, these devices are coupled to a casting device (e.g., a set-top box, a Google Chromecast, a smart television, etc.). These devices can be instructed via a voice request issued to the voice-activated electronic device to play a media item verbally identified by the user.

[0008] These networked voice-activated electronic devices are typically placed on surfaces in different locations in a smart home environment. As such, in some embodiments, the voice-activated electronic device is configured to have a form factor and appearance that can fit throughout the smart home environment and / or integrate with multiple compatible surfaces and devices throughout the environment. For example, in some embodiments, the voice-activated electronic device includes a detachable base that can be swapped out to better match the surface finishes in various home environments. In some embodiments, the detachable base may be a detachable grill with different surface appearances, such as fabric, leather, metal, and smooth. In some embodiments, the base is connected to the top portion of the electronic device via magnetic attraction, thereby securely fastening the base and top portions of the electronic device, but allowing for separation using manual manipulation by a user. In some embodiments, the base and top portions can be separated by a twisting motion followed by a separation motion, and in some embodiments, the base and top portions can be separated by a separation motion alone. In some embodiments, the electronic device includes a top portion that functions as a speaker grille that allows for the transmission of sound from one or more speakers contained within the electronic device to the exterior of the device. In some embodiments, the top portion / speaker grille can be constructed with different surface finishes and / or can be securely but separably fastened to the base as described above.

[0009] In some embodiments, the electronic device is a compact device that includes one or more speakers and a number of electronic components, such as a microprocessor, memory, support, and the like. The electronic device may include one or more of a chip, a radio receiver and transmitter, an antenna, a power circuit, one or more cameras, a power and / or data connector, etc., some of which are mounted on one or more printed circuit boards. The speaker may be used for any audio output purpose, including outputting an audible response to a user voice input, playing an audio track of media content, and generating audible alerts (including beeps, alarms, sirens, etc.). In some embodiments, the one or more speakers are mounted within the electronic device such that there is no direct path for the sound generated by the one or more speakers to travel outside the device. In such embodiments, to facilitate effective speaker operation (including effective transmission of the acoustic output by the speaker to the outside of the device), a waveguide is provided within the electronic device to redirect the acoustic output by the one or more speakers from the inside to the outside of the device. In some embodiments, the waveguide is configured to redirect the output of the sound to a speaker grill provided on the exterior of the electronic device.

[0010] In some embodiments, the waveguide is also configured to act as a heat sink to dissipate heat generated by operation of the electronic components to the exterior of the electronic device and is mounted in close proximity to at least some of the electronic components.

[0011] In some embodiments, one or more speakers are mounted to the base of the electronic device and have a primary acoustic radiation direction facing upward within the device towards a curved portion of the dual-purpose waveguide / heat sink. The curved portion is designed to redirect sound output from the one or more speakers to the exterior of the electronic device. Heat-generating electronic components and / or one or more printed circuit boards carrying electronic components are directly attached (or indirectly coupled thereto using thermally conductive paths) to the second portion of the dual-purpose waveguide / heat sink to transfer heat generated by operation of the electronic components to the heat sink. The heat sink is configured to transfer heat transferred thereto from the attached electronic components to the exterior of the electronic device. In some embodiments, the heat sink is made from a material with a high effective thermal conductivity to facilitate the transfer of heat from the interior of the device to the exterior of the device. In some embodiments, the curved portion is the bottom surface of the dual purpose waveguide / heat sink (e.g., the surface facing downward toward the one or more speakers) and the second portion is the top surface of the dual purpose waveguide / heat sink opposite the bottom surface of the dual purpose waveguide / heat sink (e.g., the surface facing upward, on which the electronic components are mounted). In some embodiments, the positions of the electronic components and the one or more speakers are swapped such that the one or more speakers are located on the top portion of the electronic device and protrude downward toward the (curved) top surface of the dual purpose waveguide / heat sink and such that the electronic components are mounted to the base of the electronic device and the waveguide / heat sink is mounted to the bottom of the electronic device.

[0012] For a better understanding of the various embodiments described above, reference should be made to the following description of implementations in conjunction with the accompanying drawings, in which like reference numerals refer to corresponding parts throughout and in which: [Brief description of the drawings]

[0013] [Figure 1] FIG. 1 illustrates an exemplary operating environment according to some embodiments. [Diagram 2] FIG. 1 illustrates an exemplary voice-activated electronic device according to some embodiments. [Diagram 3] FIG. 1 illustrates an exemplary voice assistance server system according to some embodiments. [Figure 4A] 1 is a front view of an exemplary voice-activated electronic device, according to some embodiments. [Figure 4B] 1 is a side view of an exemplary voice-activated electronic device, according to some embodiments. [Figure 4C] 1 is a rear view of an exemplary voice-activated electronic device, according to some embodiments. [Figure 4D] 1 is a perspective view of an exemplary voice-activated electronic device according to some embodiments. [Figure 4E] 1 is a cross-sectional view of an exemplary voice-activated electronic device illustrating a dual-purpose waveguide / heat sink according to some embodiments. [Figure 4F] 1 is an exploded view of an exemplary voice-activated electronic device, according to some embodiments. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0014] Throughout the drawings, like reference numbers refer to corresponding parts. Description of the embodiments The digital revolution has brought many benefits to date, from enabling open sharing of information to a sense of global togetherness. However, new emerging technologies often cause confusion, doubt, and fear among consumers, which prevents them from benefiting from the technology. Electronic devices are conveniently used as voice interfaces to receive voice input from users to initiate voice-activated functions. Thereby, electronic devices provide an eyes-free and hands-free solution that enables easy and productive user interaction with both existing and emerging technologies. In particular, voice input received by an electronic device with voice operation capabilities can convey instructions and information even when the user's gaze is unclear and the user's hands are occupied. To enable a hands-free and eyes-free experience, a voice-activated electronic device according to the present invention "listens" to its surroundings (i.e., constantly processes audio signals collected from its surroundings) either constantly or only when triggered to do so (e.g., via the user speaking a "hot word" to trigger the operation of the electronic device). Meanwhile, the user's identity is tied to the user's voice and the language used by the user. To protect the identity of the user, these voice-activated electronic devices are typically used in private locations that are protected and controlled personal spaces (eg, homes and cars).

[0015] Specifically, in some embodiments, the electronic device provides an eyes-free and hands-free voice interface for activating voice-activated features on other media playback devices or smart home devices coupled within a smart media or home environment. The smart media environment includes one or more voice-activated electronic devices and a plurality of media display devices, each located at a separate location. Some of the electronic devices are coupled to a casting device (e.g., a set-top box). Each voice-activated electronic device is configured to record a voice message from which the crowdcast service server determines a user's voice request (e.g., a request to play media, a request to transfer media, or a request to start closed captioning). The crowdcast service server then forwards the user's voice request to the destination casting device as indicated by the voice message. A similar method could be used to control smart home devices to implement voice-activated features in a smart home environment. Such a method optionally complements or replaces conventional methods that require a user to use a remote control or a client device to control a media device or smart home device in a smart media or home environment.

[0016] In accordance with various embodiments of the present application, networked voice-activated electronic devices are typically placed on surfaces in different locations of a smart home environment. Each voice-activated electronic device is configured to have a form factor that matches the overall smart home environment. For example, a voice-activated electronic device includes a base that can match and contact various types of surfaces, including desktops, furniture surfaces, docking stations, media player devices, or other surfaces. Such a voice-activated electronic device is configured to couple to its base in a compact and robust manner, thereby blending naturally into various home environments.

[0017] In some embodiments, the electronic device is a compact device that includes one or more speakers and a number of electronic components, including one or more of a microprocessor, memory, support chips, wireless receivers and transmitters, antennas, power supply circuitry, one or more cameras, power and / or data connectors, and the like, some of which are mounted on one or more printed circuit boards. The speakers can be used for any audio output purpose, including outputting an audible response to a user voice input, playing an audio track of media content, and generating audible alerts (including beeps, alarms, sirens, and the like). In some embodiments, the one or more speakers are mounted within the electronic device such that there is no direct path for the sound generated by the one or more speakers to travel outside the device. In such embodiments, to facilitate effective speaker operation (including effective transmission of the acoustic output by the speakers to the exterior of the device), a waveguide is provided within the electronic device to redirect the acoustic output by the one or more speakers from the interior to the exterior of the device. In some embodiments, the waveguide is configured to redirect the output of the sound to a speaker grill provided on the exterior surface of the electronic device. In some embodiments, the waveguide is also configured to act as a heat sink to dissipate heat generated by operation of the electronic components to the exterior of the electronic device and is mounted in close proximity to at least some of the electronic components.

[0018] Reference will now be made in detail to the embodiments, examples of which are illustrated in the accompanying drawings. In the following detailed description, numerous specific details are set forth in order to provide a thorough understanding of the various embodiments being described. However, it will be apparent to those skilled in the art that the various embodiments described may be practiced without these specific details. In other instances, well-known methods, procedures, components, circuits, and networks have not been described in detail so as not to unnecessarily obscure aspects of the embodiments.

[0019] Voice assistant experience 1 is an exemplary operating environment according to some embodiments. Operating environment 100 includes one or more voice-activated electronic devices 104 (e.g., voice-activated electronic devices 104-1 through 104-N, hereafter referred to as "voice-activated device(s)"). The one or more voice-activated devices 104 may be located in one or more locations (e.g., throughout multiple spaces within a structure, or all within rooms or spaces of a structure spread across multiple structures (e.g., one in a home and one in a user's car)).

[0020] The environment 100 also includes one or more controllable electronic devices 106 (e.g., electronic devices 106-1 through 106-N, hereafter referred to as "controllable device(s)"). Examples of controllable devices 106 include media devices (smart televisions, speaker systems, wireless speakers, set-top boxes, media streaming devices, casting devices) and smart home devices (e.g., smart cameras, smart thermostats, smart lights, smart hazard detectors, smart door locks).

[0021] The voice-activated devices 104 and the controllable devices 106 are communicatively coupled to the voice assistant service 140 (e.g., to a voice assistance server system 112 of the voice assistant service 140) through a communication network 110. In some embodiments, one or more of the voice-activated devices 104 and the controllable devices 106 are communicatively coupled to a local network 108, which is communicatively coupled to the communication network 110; the voice-activated device(s) 104 and / or the controllable device(s) 106 are communicatively coupled to the communication network(s) 110 via the local network 108 (and to the voice assistance server system 112 via the communication network 110). In some embodiments, the local network 108 is a local area network implemented with a network interface (e.g., a router). The voice-activated devices 104 and the controllable devices 106 that are communicatively coupled to the local network 108 may also communicate with each other through the local network 108.

[0022] Optionally, one or more of the voice-activated devices 104 are communicatively coupled to the communications network 110 and are not on the local network 108. For example, these voice-activated devices are not on a Wi-Fi network corresponding to the local network 108, but are connected to the communications network 110 via a cellular connection. In some embodiments, communication between the voice-activated devices 104 on the local network 108 and the voice-activated devices 104 not on the local network 108 occurs through the voice assistance server system 112. The voice-activated devices 104 (whether on the local network 108 or on the network 110) are known to the voice assistance server system 112 because they are registered in the device registry 118 of the voice assistant service 140. Similarly, the voice-activated devices 104 not on the local network 108 can communicate with the controllable devices 106 through the voice assistant server system 112. The controllable devices 106 (whether on the local network 108 or on the network 110) are also registered in the device registry 118. In some embodiments, communication between the voice-activated devices 104 and the controllable devices 106 is via the voice assistance server system 112.

[0023] In some embodiments, the environment 100 also includes one or more content hosts 114. The content hosts 114 may be remote content sources from which content is streamed or otherwise obtained according to requests contained in a user's voice input or commands. The content hosts 114 may be information sources from which the voice assistance server system 112 retrieves information according to a user's voice request.

[0024] In some embodiments, the controllable device 106 may receive an instruction or request (e.g., from the voice-activated device 104 and / or the voice assistance server system 112) to perform a specified operation or transition to a specified state, and may perform the operation or transition to a state according to the received instruction or request.

[0025] In some embodiments, one or more of the controllable devices 106 are media devices deployed in the operating environment 100 to provide media content, news, and / or other information to one or more users. In some embodiments, the content provided by the media devices is stored in a local content source, streamed from a remote content source (e.g., content host(s) 114), or generated locally (e.g., from local text to a voice processor that reads customized news briefs, emails, documents, local weather forecasts, etc., to one or more people using the operating environment 100). In some embodiments, the media devices include media output devices that output media content directly to an audience (e.g., one or more users) and networked casting devices that stream media content to the media output devices. Examples of media output devices include, but are not limited to, television (TV) displays and music players. Examples of casting devices include, but are not limited to, set-top boxes (STBs), DVD players, TV boxes, and media streaming devices such as Google's Chromescast® media streaming device.

[0026] In some embodiments, the controllable device 106 is also a voice-activated device 104. In some embodiments, the voice-activated device 104 is also a controllable device 106. For example, the controllable device 106 may be a voice assistance service 140 (e.g., a device that receives voice input from a user). As another example, a voice-activated device 104 may also perform certain operations and transition to certain states in response to requests or commands in a voice input (e.g., a voice interface device that can also play streaming music).

[0027] In some embodiments, the voice-activated devices 104 and the controllable devices 106 are associated with a user with a respective account, or with multiple users (e.g., a group of related users, such as users in a family or organization; more generally, a primary user and one or more authorized additional users, etc.) with respective user accounts in a user domain. The users can input voice inputs or voice commands into the voice-activated devices 104. The voice-activated devices 104 receive these voice inputs from the users (e.g., user 102), and the voice-activated devices 104 and / or the voice assistance server system 112 proceed to determine the request in the voice input and to generate a response to the request.

[0028] In some embodiments, the request included in the voice input is a command or request to cause the controllable device 106 to perform an operation (e.g., play media, pause media, fast forward or rewind media, change the volume, change screen brightness, change light brightness) or transition to another state (e.g., change operating modes, turn on or off, go into or out of sleep mode).

[0029] In some embodiments, the voice-activated electronic device 104 responds to voice input by generating and providing voice responses to voice commands (e.g., speaking the current time in response to the question "What time is it?"); streaming requested media content to the user (e.g., "Play the Bach Boys"); reading a news article or daily news summary prepared for the user; playing media items stored on the personal assistant device or on the local network; changing the state of or operating one or more other devices connected within the operating environment 100 (e.g., turning lights, appliances or media devices on / off, locking / opening, opening windows, etc.); or issuing a corresponding request to a server over the network 110.

[0030] In some embodiments, one or more voice-activated devices 104 are deployed in the operating environment 100 to collect voice inputs to initiate various functions (e.g., media playback functions on a media device). In some embodiments, these voice-activated devices 104 (e.g., devices 104-1 through 104-N) are deployed near controllable devices 104 (e.g., media devices), for example, in the same room as cast devices and media output devices. Alternatively, in some embodiments, the voice-activated devices 104 are deployed in a structure that has one or more smart home devices but no media devices. Alternatively, in some embodiments, the voice-activated devices 104 are deployed in a structure that has one or more smart home devices and one or more media devices. Alternatively, in some embodiments, the voice-activated devices 104 are deployed in locations that do not have networked electronic devices. Additionally, in some embodiments, a room or space in a structure may have multiple voice-activated devices 104.

[0031] In some embodiments, the voice-activated device 104 includes at least one or more microphones, a speaker, a processor, and memory that stores at least one program for execution by the processor. The speaker is configured to enable the voice-activated device 104 to transmit voice messages and other sounds (e.g., audible tones) to the location where the voice-activated device 104 is located in the operating environment 100, thereby broadcasting music, , report the status of the voice input processing, converse with, or provide instructions to, a user of the voice input device 104. As an alternative to audio messages, visual signals may be used to provide feedback to the user of the voice-activated device 104 regarding the status of the voice input processing. When the voice-activated device 104 is a mobile device (e.g., a mobile phone or tablet computer), its display screen is configured to display notifications regarding the status of the voice input processing.

[0032] In some embodiments, the voice-activated device 104 is a voice interface device that is networked to provide voice recognition functionality using the voice assistance server system 112. For example, the voice-activated device 104 includes a smart speaker that provides music to the user and allows eyes-free and hands-free access to a voice assistant service (e.g., Google Assistant). Optionally, the voice-activated device 104 is one of a desktop or laptop computer, a tablet, a mobile phone including a microphone, a casting device including a microphone and optionally a speaker, an audio system including a microphone and a speaker (e.g., a stereo system, a speaker system, a portable speaker, etc.), a television including a microphone and a speaker, and a user interface system of an automobile including a microphone, a speaker, and optionally a display. Optionally, the voice-activated device 104 is a simple, low-cost voice interface device. In general, the voice-activated device 104 can be any device that is network-enabled and includes a microphone, a speaker, and programs, modules, and data for interacting with a voice assistant service. Given the simplicity and low cost of the voice-activated device 104, the voice-activated device 104 includes an array of light emitting diodes (LEDs) rather than a full display screen, and displays visual patterns on the LEDs to indicate the status of the voice input process. In some embodiments, the LEDs are full color LEDs, and the color of the LEDs may be employed as part of the visual pattern displayed on the LEDs. Examples of using LEDs to display visual patterns to convey information or device status are described in U.S. Provisional Patent Application No. 62 / 336,566, filed May 13, 2016, entitled "LED Design Language for Visual Affordance of Voice User Interfaces," which is incorporated by reference in its entirety.In some embodiments, the visual pattern indicating the state of a voice processing operation is displayed using a distinctive image shown on a conventional display associated with the voice-activated device that is performing the voice processing operation.

[0033] In some embodiments, LEDs or other visual displays are used to communicate the collective voice processing status of multiple participating electronic devices. For example, in an operating environment with multiple voice processing or voice interface devices (e.g., multiple electronic devices 400 as shown in FIG. 4A of the '566 application; multiple voice-activated devices 104), groups of colored LEDs (e.g., LED 404 as shown in FIG. 4A of the '566 application) associated with each electronic device can be used to communicate which electronic devices are listening to the user and which of the listening devices is the leader (a "leader" device typically takes the lead role in responding to voice requests issued by the user).

[0034] More generally, the '566 application (see, e.g., paragraphs

[0087] -

[0100] ) describes an "LED design language" for visually indicating various voice processing states of an electronic device using collections of LEDs, such as "hot word detection and listening states," "think mode or work mode," and "answer mode or busy mode." In some embodiments, unique states of the voice processing operations described herein are represented using groups of LEDs in accordance with one or more aspects of the "LED design language" of the '566 application. These visual indicators may also be combined with one or more audible indicators generated by the electronic device performing the voice processing operations. The resulting The audio and / or visual indicators enable a user within a voice interactive environment to understand the status of various voice processing electronic devices within the environment and to effectively interact with those devices in a natural and intuitive manner.

[0035] In some embodiments, when voice input to the voice-activated device 104 is used to control media output devices via a cast device, the voice-activated device 104 effectively enables a new level of control of cast-enabled media devices. In a specific example, the voice-activated device 104 includes a casual enjoyment speaker with far-field voice access capability and serves as a voice interface device for a voice assistant service. The voice-activated device 104 can be deployed in any area in the operating environment 100. When multiple voice-activated devices 104 are distributed in multiple rooms, they are synchronized to become cast audio receivers providing audio input from these rooms.

[0036] Specifically, in some embodiments, the voice-activated device 104 includes a Wi-Fi speaker with a microphone that is connected to a voice-activated voice assistant service (e.g., Google Assistant). A user can issue a media playback request via the microphone of the voice-activated device 104, asking the voice assistant service to play media content on the voice-activated device 104 itself or on another connected media output device. For example, a user can issue a media playback request by saying to the Wi-Fi speaker, "Okay, Google, play cat videos on my living room TV." The voice assistant service then fulfills the media playback request by playing the requested media content on the requested device using a default or specified media application.

[0037] In some embodiments, a user can issue voice requests via the microphone of the voice-activated device 104 regarding media content that is already playing or is playing on the display device (e.g., the user can request information about the media content, purchase the media content at an online store, or create and publish a social post about the media content).

[0038] In some embodiments, users may want to take their current media session with them as they move around the house and may request such a service from one or more of the voice-activated devices 104. This requests that the voice assistant service 140 transfer the current media session from a first cast device to a second cast device that is not directly connected to the first cast device or is unaware of the existence of the first cast device. Following the transfer of the media content, a second output device coupled to the second cast device continues playing the media content that was previously playing on the first output device coupled to the first cast device from the exact point in the music track or video clip where the media content was playing on the first output device. In some embodiments, a voice-activated device 104 that receives a request to transfer a media session can fulfill the request. In some embodiments, a voice-activated device 104 that receives a request to transfer a media session relays the request to another device or system (e.g., the voice assistance server system 112) for processing.

[0039] Additionally, in some embodiments, a user may issue a request for information or a request to perform an action or operation via the microphone of the voice-activated device 104. The information requested may be personal (e.g., the user's email, the user's calendar events, the user's flight information, etc.), non-personal (e.g., sports scores, news, etc.), or a variety of other information (e.g., the user's email, the user's calendar events, the user's flight information, etc.). The requested information or action / operation may include access to personal information (e.g., purchasing a digital media item with payment information provided by the user, purchasing a physical good). The voice-activated device 104 responds to the request with a voice message response to the user, which may include, for example, a request for additional information to fulfill the request, confirmation that the request has been fulfilled, a notice that the request cannot be fulfilled, etc.

[0040] In some embodiments, in addition to the voice-activated devices 104 and the media devices among the controllable devices 106, the operating environment 100 may also include one or more smart home devices among the controllable devices 106. The integrated smart home devices include intelligent, multi-sensor, networked devices that seamlessly integrate with each other and / or with a central server or cloud computing system in a smart home network to provide a variety of useful smart home functions. In some embodiments, the smart home devices are deployed in the same location of the operating environment 100 as the cast device and / or output device, and thus are located in close proximity or at a known distance from the cast device and output device.

[0041] The smart home devices in the operating environment 100 may include, but are not limited to, one or more intelligent, multi-sensor, networked thermostats, one or more intelligent, multi-sensor, networked hazard detectors, one or more intelligent, multi-sensor, networked interface devices and (hereinafter referred to as "smart doorbells" and "smart door locks"), one or more intelligent, multi-sensor, networked alarm systems, one or more intelligent, multi-sensor, networked camera systems, one or more intelligent, multi-sensor, networked wall switches, one or more intelligent, multi-sensor, networked power sockets, and one or more intelligent, multi-sensor, networked lights. In some embodiments, the smart home devices in the operating environment 100 of Figure 1 may include a plurality of intelligent, multi-sensor, network-connected appliances (hereinafter referred to as "smart appliances"), such as refrigerators, stoves, ovens, televisions, washers, dryers, lights, stereos, intercom systems, garage door openers, floor fans, ceiling fans, wall mounted air conditioners, pool heaters, irrigation systems, security systems, heating appliances, window AC units, powered duct vents, etc. In some embodiments, any one of these smart home device types may be equipped with a microphone and one or more voice processing capabilities described herein to respond in whole or in part to voice requests from a current occupant or user.

[0042] In some embodiments, each of the controllable devices 104 and voice-activated devices 104 can communicate data and share information with other controllable devices 106, voice-activated electronic devices 104, a central server or cloud computing system, and / or other networked devices (e.g., client devices). Data communication can be performed using any of a variety of conventional or standard wireless protocols (e.g., IEEE 802.15.4, Wi-Fi, ZigBee, 6LoWPAN, Thread, Z-Wave, Bluetooth Smart, ISA100.1la, WirelessHART, MiWi, etc.) and / or any of a variety of conventional or standard wired protocols (e.g., Ethernet, HomePlug, etc.), or any other suitable communication protocol, including communication protocols yet to be developed as of the filing date of this document.

[0043] Through a communication network (e.g., the Internet) 110, the controllable devices 106 and The controllable devices 106 and the voice-activated devices 104 can communicate with a server system (also referred to herein as a central server system and / or a cloud computing system). Optionally, the server system may be associated with a manufacturer, support entity, or service provider associated with the controllable devices and the media content displayed to the user. Thus, the server system includes a voice assistance server 112 that processes voice input collected by the voice-activated devices 104, one or more content hosts 114 that provide the displayed media content, optionally a crowdcast service server that creates a virtual user domain based on the distributed device terminals, and a device registry 118 that maintains a record of the distributed device terminals in the virtual user environment. Examples of distributed device terminals include, but are not limited to, the controllable devices 106, the voice-activated devices 104, and the media output devices. In some embodiments, these distributed device terminals are linked to user accounts (e.g., Google user accounts) in the virtual user domain. It should be understood that processing of voice input collected by the voice-activated device 104 can be performed locally at the voice-activated device 104, at the voice assistance server 112, at another smart home device (e.g., a hub device), or a combination of all or a subset of the above.

[0044] It will be appreciated that in some embodiments, the voice-activated device(s) 104 can function in environments without smart home devices. For example, the voice-activated device 104 can respond to user requests for information or to perform actions and / or initiate or control various media playback functions without the presence of smart home devices. The voice-activated device 104 can also function in a wide range of environments, including, but not limited to, in a vehicle, boat, business, or manufacturing environment.

[0045] In some embodiments, the voice-activated device 104 is "woke" by a voice input that includes a hot word (also referred to as a "wake word") (e.g., activating an interface for a voice assistant service on the voice-activated device 104 and placing the voice-activated device 104 in a state in which the voice-activated device 104 is ready to receive a voice request to the voice assistant service). In some embodiments, the voice-activated device 104 is required to wake up if it has been inactive for at least a predetermined time (e.g., 5 minutes) with respect to receiving voice input; the predetermined time corresponds to the amount of inactivity allowed before a voice interface session or conversation times out. The hot word may be a word or phrase, may be a predetermined default, and / or may be customized by the user (e.g., a user may set a nickname for a particular voice-activated device 104 as the device's hot word). In some embodiments, there may be multiple hot words that can wake up the voice-activated device 104. The user can speak the hotword and wait for an acknowledgment response from the voice-activated device 104 (e.g., the voice-activated device 104 outputs a greeting) and they make the first voice request. Alternatively, the user can combine the hotword and the first voice request into one voice input (e.g., the voice input includes the hotword followed by the voice request).

[0046] In some embodiments, the voice-activated device 104 interacts with a controllable device 106 (e.g., a media device, a smart home device), a client device, or a server system of the operating environment 100 according to some embodiments. The voice-activated device 104 is configured to receive voice input from an environment proximate to the voice-activated device 104. Optionally, the voice-activated device 104 stores the voice input and processes the voice input at least partially locally. Optionally, the voice-activated device 104 communicates the received voice input, or the partially processed voice input, to a voice assistance server system 112 via a communication network 110 for further processing. The voice-activated device 104 or the voice assistance server system 112 determines whether there is a request in the voice input and what the request is, and responds to the request. The controllable device(s) 106 may then determine and generate a response to the request and communicate the request to one or more controllable device(s) 106. The controllable device(s) 106 receiving the response are configured to perform an operation or change state according to the response. For example, the media device may be configured to retrieve media or Internet content from one or more content hosts 114 for display on an output device coupled to the media device according to the response to the request in the audio input.

[0047] In some embodiments, the controllable device(s) 106 and the voice-activated device(s) 104 are linked to each other in a user domain, and more specifically, are associated with each other through user accounts in the user domain. Information about the controllable devices 106 (whether on the local network 108 or the network 110) and the voice-activated devices 104 (whether on the local network 108 or the network 110) is stored in a device registry 118 in association with the user account. In some embodiments, there is a device registry for the controllable devices 106 and a device registry for the voice-activated devices 104. The controllable device registry can reference devices in the voice-activated device registry that it is associated with in the user domain, and vice versa.

[0048] In some embodiments, one or more voice-activated devices 104 (and one or more cast devices) and one or more controllable devices 106 are commissioned to the voice assistant service 140 via the client device 103. In some embodiments, the voice-activated device 104 does not include a display screen at all and relies on the client device 103 to provide a user interface during the commissioning process, as does the controllable device 106. Specifically, an application is installed on the client device 103 that enables a user interface to facilitate commissioning of new voice-activated devices 104 and / or controllable devices 106 deployed near the client device. A user may send a request on the user interface of the client device 103 to initiate the commissioning process for the new electronic device 104 / 106 that needs to be commissioned. After receiving the request for commissioning, the client device 103 establishes a short-range communication link with the new electronic device 104 / 103 that needs to be commissioned. Optionally, the short-range communication link is established based on Near Field Communication (NFC), Bluetooth, Bluetooth Low Energy (BLE), and the like. Then, the client device 103 transmits wireless configuration data related to a wireless local area network (WLAN) (e.g., local network 108) to the new device or electronic device 104 / 106. The wireless configuration data includes at least a WLAN security code (i.e., a service set identifier (SSID) password), and optionally includes an SSID, an Internet Protocol (IP) address, a proxy setting, and a gateway setting. After receiving the wireless configuration data via the short-range communication link, the new electronic device 104 / 106 decodes and recovers the wireless configuration data, and joins the WLAN based on the wireless configuration data.

[0049] In some embodiments, the additional user domain information is entered into a user interface displayed on the client device 103 and used to link the new electronic device 104 / 106 to an account in the user domain. Optionally, the additional user domain information is communicated to the new electronic device 104 / 106 along with wireless communication data via a short-range communications link. Optionally, the additional user domain information is communicated to the new electronic device 104 / 106 via the WLAN after the new device joins the WLAN.

[0050] Once an electronic device 104 / 106 is authorized in a user domain, other devices and their associated operations can be controlled via multiple control paths. Following one control path, an application installed on the client device 103 can control the other devices and their associated operations. Used to control associated operations (e.g., media playback operations) or, following another control path, electronic device 104 / 106 may be used to enable eyes-free and hands-free control of other devices and their associated operations.

[0051] In some embodiments, the voice-activated devices 104 and the controllable devices 106 may be assigned nicknames by the user (e.g., by the primary user with which the devices are associated in the user domain). For example, a speaker device in the living room may be assigned the nickname "Living Room Speaker." In this way, the user can more easily refer to the device with voice input by speaking the device nickname. In some embodiments, the device nicknames and corresponding mappings to devices are stored in the voice-activated device 104 (which stores nicknames only for devices associated with the same user as the voice-activated device) and / or in the voice assistance server system 112 (which stores device nicknames associated with different users). For example, the voice assistance server system 112 stores multiple device nicknames and mappings across different devices and users, and a voice-activated device 104 associated with a particular user downloads the nicknames and mappings for the devices associated with the particular user for local storage.

[0052] In some embodiments, a user may group one or more of the voice-activated devices 104 and / or controllable devices 106 into user-created device groups. Similar to referencing individual devices by nicknames, groups may be named and groups of devices may be referenced by group names. Similar to device nicknames, device groups and group names may be stored in the voice-activated device 104 and / or voice assistance server system 112.

[0053] The voice input from the user may explicitly specify a target controllable device 106, or a target group of devices, for the request in the voice input. For example, a user may issue the voice input "play classical music on the living room speakers." The target devices in the voice input are the "living room speakers"; the request in the voice input is a request to have the "living room speakers" play classical music. As another example, a user may issue the voice input "play classical music on the house speakers," where "house speakers" is the name of a group of devices. The target device group in the voice input is the "house speakers"; the request in the voice input is a request to have the devices in the "house speakers" group play classical music.

[0054] The voice input from the user may not have an explicit designation of a target device or device group; there is no reference to a target device or device group by name in the voice input. For example, following the exemplary voice input above, "Play classical music on living room speakers," the user may utter a subsequent voice input, "pause." The voice input does not include a designation of a target device for a request for a pause operation. In some embodiments, the designation of a target device in the voice input may be ambiguous. For example, the user may have uttered a device name incompletely. In some embodiments, if there is no explicit target device designation or the designation of the target device is ambiguous, a target device or device group may be assigned to the voice input, as described below.

[0055] In some embodiments, when the voice-activated device 104 receives a voice input with an explicit designation of a target device or device group, the voice-activated device 104 establishes a focus session with respect to the specified target device or device group. In some embodiments, the voice-activated device 104 stores for the focus session a session start time (e.g., a timestamp of the voice input based on which the focus session was started) and the target device or group of devices designated as the focused device for the focus session. In some embodiments, the voice-activated device 104 also logs subsequent voice inputs in the focus session. The voice-activated device 104 logs at least the most recent voice input in the focus session, and optionally logs and retains previous voice inputs in the focus session as well. In some embodiments, the voice assistance server system 112 establishes the focus session. In some embodiments, the focus session may be terminated by a voice input that explicitly designates a different target device or group of devices.

[0056] While a focus session for a device is active and the voice-activated device receives voice input, the voice-activated device 104 makes one or more determinations regarding the voice input. In some embodiments, the determinations include: whether the voice input includes an explicit target device designation, whether the requirements in the voice input are one that can be fulfilled by the focused device, and the time of the voice input compared to the time of the last voice input in the focus session and / or the session start time. If the voice input does not include an explicit target device designation, can be fulfilled by the focused device, and meets predefined time criteria with respect to the time of the last voice input in the focus session and / or the session start time, then the focused device is assigned as the target device for the voice input. Further details regarding focus sessions are described below.

[0057] Devices in the operating environment FIG. 2 is a block diagram illustrating an exemplary voice-activated device 104 adapted as a voice interface for collecting user voice commands in an operating environment (e.g., operating environment 100) according to some embodiments. The voice-activated device 104 typically includes one or more processing units (CPUs) 202, one or more network interfaces 204, memory 206, and one or more communication buses 208 for interconnecting these components (sometimes referred to as a chipset). The voice-activated device 104 includes one or more input devices 210 for facilitating user input, such as buttons 212, a touch-sensitive array 214, and one or more microphones 216. The voice-activated device 104 also includes one or more output devices 218, including one or more speakers 220, optionally an array of LEDs 222, and optionally a display 224. In some embodiments, the array of LEDs 222 is an array of full-color LEDs. In some embodiments, the voice-activated device 104 includes either an array of LEDs 222, a display 224, or both, depending on the type of device. In some embodiments, the voice-activated device 104 also includes a location detection device 226 (eg, a GPS module) and one or more sensors 228 (eg, an accelerometer, a gyroscope, a light sensor, etc.).

[0058] Memory 206 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; and optionally includes non-volatile memory, such as one or more magnetic disk storage devices, one or more optical disk storage devices, one or more flash memory devices, or one or more other non-volatile solid-state storage devices. Memory 206 optionally includes one or more storage devices located remotely from the one or more processing units 202. Memory 206, or the non-volatile memory within memory 206, includes a non-transitory computer-readable storage medium. In some embodiments, memory 206, or the non-transitory computer-readable storage medium of memory 206, stores the following programs, modules, and data structures, or a subset or superset thereof: - Procedures for handling various basic system services, and hardware-dependent tasks 232 an operating system that contains instructions for executing the script; a network communications module 234 for connecting the voice-activated device 104 to other devices (e.g., a voice assistance service 140, one or more controllable devices 106, one or more client devices 103, and other voice-activated device(s) 104) via one or more network interfaces 204 (wired or wireless) and one or more networks 110, such as the Internet, other wide area networks, local area networks (e.g., local network 108), metropolitan area networks, etc.; An input / output control module 236 for receiving input via one or more input devices and enabling presentation of information on the voice-activated device 104 via one or more output devices 218, including: a voice processing module 238 for processing voice input or voice messages collected in the environment surrounding the voice-activated device 104 or for preparing the collected voice input or voice messages for processing in the voice assistance server system 112; an LED control module 240 for generating visual patterns on the LEDs 222 according to the device state of the voice-activated device 104; and ○ A touch sense module 242 for detecting touch events on the top surface of the voice-activated device 104 (e.g., on the touch sensor array 214); A voice-activated device data 244 for storing at least data related to the voice-activated device 104, including: ○ voice device settings 246 for storing information related to the voice-activated device 104 itself, including common device settings (such as service tier, device model, storage capacity, processing capabilities, communication capabilities, etc.), information for one or more user accounts in a user domain, device nicknames and device groups, settings related to restrictions when dealing with unregistered users, and display specifications related to one or more visual patterns displayed by the LED 222; and ○ Voice control data 248 for storing voice signals, voice messages, response messages, and other data related to the voice interface functions of the voice-activated device 104; a response module 250 for executing instructions included in the voice request responses generated by the voice assistance server system 112 and, in some embodiments, generating responses to certain voice inputs; and A focus session module 252 for establishing, managing, and terminating a focus session with respect to the device.

[0059] In some embodiments, the audio processing module 238 includes the following modules (not shown): · a user identification module for identifying and disambiguating users providing voice input to the voice input device 104; a hotword recognition module for determining whether the voice input includes a hotword to activate the voice-activated device 104 and for recognizing such in the voice input; and A request recognition module for determining a user request contained in the speech input.

[0060] In some embodiments, the memory 206 also stores focus session data 254 for outstanding focus sessions, including: · Identifiers of the device or device group focused in an outstanding focus session (e.g., device nickname, device group name, device MAC address(es) for storing the device(s) on which the session is focused 256; Session start time 258 for storing a timestamp for the start of an outstanding focus session; and A session command history 260 for storing a log of previous requests or commands in a focus session, including at least the most recent request / command. The log includes the previous requests or commands recorded in the log. It contains at least the timestamp(s) of the request(s) / command(s).

[0061] Each of the above identified elements may be stored in one or more of the aforementioned memory devices and corresponds to a set of instructions for performing the functions described above. The above identified modules or programs (i.e., sets of instructions) need not be implemented as separate software programs, procedures, modules, or data structures, and thus various subsets of these modules may be combined or otherwise rearranged in various implementations. In some embodiments, memory 206 optionally stores a subset of the above identified modules and data structures. Additionally, memory 206 optionally stores additional modules and data structures not described above. In some embodiments, a subset of the programs, modules, and / or data stored in memory 206 may be stored on and / or executed by voice assistance server system 112.

[0062] In some embodiments, one or more of the modules in memory 206 described above are part of a voice processing library of modules. The voice processing library may be implemented and embedded in a wide variety of devices. An example of a voice processing library is described in U.S. Provisional Patent Application No. 62 / 334,434, filed May 10, 2016, entitled "Implementations for Voice Assistant on Devices," which is incorporated by reference in its entirety.

[0063] FIG. 3 is a block diagram illustrating an exemplary voice assistance server system 112 of a voice assistant service 140 of an operating environment (e.g., operating environment 100) according to some embodiments. The server system 112 typically includes one or more processing units (CPU(s)) 302, one or more network interfaces 304, memory 306, and one or more communication buses 308 for interconnecting these components (sometimes referred to as a chipset). The server system 112 may include one or more input devices 310 to facilitate user input, such as a keyboard, a mouse, a voice command input unit or microphone, a touch screen display, a touch-sensitive input pad, a gesture capture camera, or other input buttons or controls. Additionally, the server system 112 may use a microphone and voice recognition, or a camera and gesture recognition to supplement or replace a keyboard. In some embodiments, the server system 112 includes one or more cameras, scanners, or optical sensor units, for example, for capturing images of graphic series codes printed on an electronic device. The server system 112 may also include one or more output devices 312 that enable presentation of the user interface and display content, including one or more speakers and / or one or more visual displays.

[0064] Memory 306 includes high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state memory devices; optionally includes non-volatile memory, such as one or more magnetic disk storage devices, one or more optical disk storage devices, one or more flash memory devices, or one or more other non-volatile solid-state storage devices. Memory 306 optionally includes one or more storage devices located remotely from the one or more processing units 302. Memory 306, or the non-volatile memory within memory 306, includes a non-transitory computer-readable storage medium. In some embodiments, memory 306, or the non-transitory computer-readable storage medium of memory 306, stores the following programs, modules, and data structures, or a subset or superset thereof: · an operating system 316 that contains procedures for handling various basic system services and for performing hardware-dependent tasks; The server system 112 can be connected to other devices (e.g., the client device 103, the controllable device 106, a network communications module 318 for connecting to the voice-activated device 104) via one or more network interfaces 304 (wired or wireless) and one or more networks 110, such as the Internet, other wide area networks, local area networks, metropolitan area networks, etc.; · a user interface module 320 for enabling presentation of information on the client device (e.g., application(s) 322-328, widgets, websites and their web pages, and / or graphical user interfaces for presenting games, audio and / or video content, text, etc.); An instruction execution module 321 for server-side execution (e.g., games, social network applications, smart home applications, and / or other web or non-web based applications for controlling client devices 103, controllable devices 106, voice-activated devices 104, and smart home devices and reviewing data captured by such devices), including one or more of the following: o A cast device application 322 that runs to provide server-side functionality for device provisioning, device control, and user account management associated with the cast device(s); o One or more media player applications 324 executed to provide server-side functionality for media presentation and user account management associated with corresponding media sources; one or more smart home device applications 326 that execute to provide server-side functionality for device provisioning, device control, data processing, and data review for a corresponding smart home device; and a voice assistance application 328 for organizing voice processing of voice messages received from a voice-activated device 104 or for directly processing the voice messages to extract a user's voice command and one or more parameters for the user's voice command (e.g., designation of a cast device or another voice-activated device 104); and Server system data 330 that stores at least data related to the automated control of media display (e.g., in automatic media output mode and follow-up mode) and other data, including one or more of the following: o Client device configuration 332 for storing information associated with one or more client devices, including common device configuration (e.g., service tier, device model, storage capacity, processing capabilities, communication capabilities, etc.) and information for automated media display control; o Cast device settings 334 for storing information associated with a user account of the cast device application 322, including one or more of account access information, information for device configuration (e.g., service tier, device model, storage capacity, processing capabilities, communication capabilities, etc.), and information for automatic media display control; o media player application settings 336 for storing information associated with a user account of one or more media player applications 324, including one or more of account access information, user preferences for media content types, review history data, and information for automated media display control; o smart home device settings 338 for storing information related to a user account of the smart home application 326, including one or more of the following: account access information, information for one or more smart home devices (e.g., service tier, device model, storage capacity, processing capabilities, communication capabilities, etc.); o Voice assistance data 340 for storing information related to a user account of the voice assistance application 328, including one or more account access information, information for one or more voice-activated devices 104 (e.g., service tier, device model, storage capacity, processing capabilities, communication capabilities, etc.); ○ User subscriptions (e.g., music streaming service subscriptions, video streaming service subscriptions, newsletter subscriptions), user devices (e.g., each user user data 342 for storing information about users in the user domain, including device nicknames, devices registered in the device registry 118 associated with device groups, user accounts (e.g., the user's email accounts, calendar accounts, financial accounts, etc.), and other user data; ○ A user voice profile 344 for storing a voice profile of a user in a user domain, including, for example, a voice model or voice fingerprint of the user and the user's comfortable volume level threshold; and o Focus Session Data 346 for storing focus session data for multiple devices.

[0065] · a device registration module 348 for managing the device registry 118; a voice processing module 350 for processing voice input or voice messages collected in the environment surrounding the electronic device 104; and A focus session module 352 for establishing, managing, and terminating a focus session with respect to the device.

[0066] In some embodiments, the memory 306 also stores focus session data 346 for one or more outstanding focus sessions 3462-1 through 3462-M, including: · a session source device 3464 for storing an identifier of a device with which a focus session is established; · session focused device(s) 3466 for storing an identifier of the focused device or device group in an outstanding focus session (e.g., device nickname, device group name, device MAC address(es)); session start time 3468 for storing a timestamp for the start of an outstanding focus session; and · Session command history 3470 for storing a log of previous requests or commands in a focus session, including at least the most recent request / command.

[0067] In some embodiments, the voice assistance server system 112 is primarily responsible for processing voice input, and thus one or more of the programs, modules, and data structures in memory 206 described above with reference to FIG. 2 are included in respective modules in memory 306 (e.g., the programs, modules, and data structures included in voice processing module 238 are included in voice processing module 350). The voice-activated device 104 communicates the captured voice input to the voice assistance server system 112 for processing, or first pre-processes the voice input and communicates the pre-processed voice input to the voice assistance server system 112 for processing. In some embodiments, the voice assistance server system 112 and the voice-activated device 104 have some shared responsibilities and some divided responsibilities with respect to processing the voice input, and the programs, modules, and data structures shown in FIG. 2 may be included in both the voice assistance server system 112 and the voice-activated device 104, or divided among the voice assistance server system 112 and the voice-activated device 104. Other programs, modules, and data structures shown in FIG. 2, or the like, may also be included in the voice assistance server system 112.

[0068] Each of the above elements may be stored in one or more of the memory devices mentioned above and corresponds to an instruction set for performing the functions described above. The above modules or programs (i.e., instruction sets) need not be implemented as separate software programs, procedures, modules, or data structures, and therefore various subsets of these modules may be combined or rearranged in various embodiments. In some embodiments, , memory 306 may store a subset of the above modules and data structures, if desired. Additionally, memory 306 may store additional modules and data structures not described above, if desired.

[0069] Design of a compact home assistant combining an acoustic waveguide and a heat sink 4A, 4B, and 4C are front, side, and back views, respectively, of an exemplary compact voice-activated electronic device 404, according to some embodiments. The electronic device 404 includes an exterior that includes a top portion 406 and a base portion 408, electronic components, and one or more speakers that are included throughout the exterior. The electronic device 404 is compact and blends naturally into many areas of the home. The electronic device 404 includes one or more microphones 216 and optionally includes an array of full-color LEDs (not shown). The full-color LEDs (e.g., LEDs 222 in FIG. 2) can be hidden under a top surface of the electronic device 404 and invisible to the user when they are not illuminated. The rear of the electronic device 404 optionally includes a power connector 410 configured to couple to a power source, and the front optionally includes a power switch 412.

[0070] In some embodiments, the electronic device 404 presents a clean appearance with no visible buttons, and interaction with the electronic device 404 is based on voice and touch gestures. Alternatively, in some embodiments, the electronic device 404 includes a limited number of physical buttons, and interaction with the electronic device 404 is based on button presses in addition to voice and touch gestures.

[0071] 4D is a perspective view of a voice-activated electronic device 404. One or more speakers (not shown) are disposed and concealed within the electronic device 404 and radiate sound through a porous wall on the exterior of the device to allow sound waves generated by the speakers to transmit to the exterior of the device.

[0072] FIG. 4E is a cross-sectional view of an exemplary voice-activated electronic device 404 showing a dual-purpose waveguide / heat sink, according to some embodiments. In some embodiments, the electronic device 404 is a compact device that includes one or more speakers 436 and a number of electronic components, including one or more of a microprocessor, memory, support chips, wireless receivers and transmitters, antennas, power supply circuitry, one or more cameras, power and / or data connectors, etc., some of which are mounted on one or more printed circuit boards 432. The speaker ("speaker assembly") 436 can be used for any audio output purpose, including outputting an audible response to a user voice input, playing an audio track of media content, and generating audible alerts (including beeps, alarms, sirens, etc.). In some embodiments, the one or more speakers 436 are mounted within the electronic device 404 such that there is no direct path for sound generated by the one or more speakers 436 to travel outside of the device. In such an embodiment, to facilitate efficient speaker operation (including efficient transmission of acoustic output by the speaker(s) 436 to the exterior of the device), an acoustic waveguide 434 is provided within the electronic device 404 to redirect acoustic output by one or more speakers 436 from the interior to the exterior of the device.

[0073] In some embodiments, the electronic device includes a top portion 406 that functions as a speaker grill to enable transmission of sound from one or more speakers 436 contained within the electronic device 404 to the exterior of the device. In some embodiments, the waveguide 434 is configured to redirect the output of the sound to a speaker grill located on the exterior surface of the electronic device. In some embodiments, the top portion / speaker grill can be configured with a different surface finish and / or can be securely attached to the base, as described in Provisional Patent Application No. 62 / 403,681, entitled "VOICE-ACTIVATED ELECTRONIC DEVICE ASSEMBLY WITH SEPARABLE BASE," the contents of which are incorporated herein by reference in their entirety. The top portion may be secured to the base in a secure but separable manner. For example, the top portion may have a first inner surface having a first attachment structure and a first outer surface extending beyond the first inner surface in a direction opposite the first attachment structure, and the base may have a second inner surface having a second attachment structure and a circular opening. The first and second inner surfaces have conformable shapes that allow the top portion and the base to be moved from a separated position to a joined position by movement of the first inner surface through the circular opening in the bottom. As a result, when the top portion and the base are in the joined position, the first and second inner surfaces form a nested arrangement to allow interaction between the first and second attachment structures, with the extended portion abutting the base. The first and second attachment structures are configured to form a secure but separable connection to one another via magnetic attraction when the first and second portions are in the joined position. The top portion and the bottom portion are configured to be securely joined and separated by manual human manipulation of one or both of the top portion and the base to move the top portion and the base between the separated and joined positions.

[0074] In some embodiments, the exterior surface of the electronic device is configured to provide electrical contacts for accessing an external power source and / or data connector that is part of a stand-alone docking station, counter, furniture (e.g., a TV stand), or appliance (e.g., a media player). In some embodiments, the bottom surface of the top portion is configured to provide electrical contacts for accessing an external power source and / or data connector that is part of a stand-alone docking station, counter, furniture, or appliance. The electronic device can be placed on a docking station, counter, furniture, or appliance with or without a bottom.

[0075] In some embodiments, the acoustic waveguide 434 is also configured to act as a heat sink to dissipate heat generated by the operation of the electronic components to the exterior of the electronic device, and is mounted proximate to at least some of the electronic components (e.g., components mounted on the PCB 432, i.e., printed circuit board 432).

[0076] In some embodiments, the one or more speakers 436 are mounted to the base 408 (e.g., "bottom housing") of the electronic device 404 and have a primary acoustic radiation direction facing upward within the device, toward a curved portion of the dual-purpose waveguide / heat sink 434. The curved portion is designed to redirect the output of sound from the one or more speakers 436 to the exterior of the electronic device 404. Heat-generating electronic components and / or one or more printed circuit boards 432 carrying the electronic components are directly attached (or indirectly coupled thereto using a thermally conductive path) to the second portion of the dual-purpose waveguide / heat sink 434 to transfer heat generated by operation of the electronic components to the heat sink. The heat sink 434 is configured to transfer heat transferred thereto from the attached electronic components to the exterior of the electronic device. In some embodiments, the heat sink 434 is made from a material with a high effective thermal conductivity to facilitate the transfer of heat from the interior of the device to the exterior of the device. In some embodiments, the curved portion is a bottom surface of the dual purpose waveguide / heat sink 434 (e.g., the surface facing downward toward the one or more speakers 436) and the second portion is a top surface of the dual purpose waveguide / heat sink 434 (e.g., the surface facing upward where electronic components are mounted) opposite the bottom surface of the dual purpose waveguide / heat sink 434. Other shapes and configurations of the top and bottom portions of the waveguide / heat sink 434 can be used, as would be apparent to one skilled in the art.

[0077] In some embodiments, the positions of the electronic components and the one or more speakers 436 are swapped, such that the electronic components are mounted to the base 408 of the electronic device 404 and the waveguide / heat sink 434 is mounted to the bottom (e.g., “bottom housing”) of the electronic device, with the one or more speakers 436 located in the upper portion 406 of the electronic device 404 and protruding downward toward the (curved) top surface of the dual-purpose waveguide / heat sink.

[0078] In some embodiments, the acoustic waveguide design transfers sound from the speaker 436 to the desired output port and is thermally attached to the PCB 432, allowing the waveguide 434 to also act as a heat sink / spreader. Wrapping the waveguide / heat sink 434 inside the housing allows for a larger thermal mass and a larger surface area for heat radiation. In some embodiments, a cutout pattern on the wrapped portion of the waveguide increases thermal efficiency and allows sound to transfer outward. In some embodiments, during speaker function, the sound waves also blow air over the waveguide / heat sink 434, thus further improving thermal performance at maximum heat generation.

[0079] In some embodiments, the cone of the waveguide / heat sink redirects the sound output from the upward-facing speaker 436 to the side, as shown in FIG. 4E. Since the PCB 432 is directly above the waveguide 434, it also serves as a heat sink. The waveguide 434 can be any material, but the heat sink should be a highly thermally conductive material. In some embodiments, the waveguide material is metal (e.g., aluminum or copper), but the waveguide / heat sink 434 can also be made from materials other than metal.

[0080] 4F is an exploded view of an exemplary voice-activated electronic device according to some embodiments, showing the perforated top portion 406 that allows for the transmission of sound waves, the PCB 432, the acoustic waveguide / heat sink 434, the bottom of the waveguide and speaker assembly 436, and the base 408.

[0081] The terminology used in the description of the various implementations described herein is for the purpose of describing particular implementations only and is not intended to be limiting. As used in the description of the various implementations described and in the appended claims, the singular terms "a," "an," and "the" are used interchangeably. The forms are intended to include the plural unless the context clearly indicates otherwise. It is also understood that the term "and / or" as used herein refers to and includes any and all possible combinations of one or more of the associated listed items. It is further understood that the terms "comprises," "including," "comprises," and / or "comprising," as used in this specification, specify the presence of stated features, integers, steps, operations, elements, and / or components, but do not exclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and / or groups thereof.

[0082] The term "if" as used herein is interpreted, optionally depending on the context, to mean "when" or "then" or "in response to determining" or "in response to detecting" or "following a determination that." Similarly, the phrase "if it is determined" or "if [a stated condition or event] is detected" is interpreted, optionally depending on the context, to mean "upon determining" or "in response to determining" or "upon detecting [a stated condition or event]" or "in response to detecting [a stated condition or event]" or "following a determination that [a stated condition or event] is detected."

[0083] It should be appreciated that a "smart media environment" may refer to a domestic smart environment, such as a single-family home, but the scope of the present teachings is not so limited. The present teachings are also applicable, without limitation, to duplexes, townhomes, multi-unit apartment buildings, hotels, retail stores, office buildings, industrial buildings, and more generally any living or working space.

[0084] It should also be appreciated that, although terms such as user, customer, installer, homeowner, resident, guest, tenant, landlord, repairman, and the like may be used to refer to a person or persons performing an act in the context of a particular situation described herein, these references are not intended to limit the scope of the present teachings to the person or persons performing such an act. As such, for example, the terms user, customer, purchaser, installer, subscriber, and homeowner may often refer to the same person in the case of a single family residence, since the householder is often the person who makes the purchasing decision, purchases the unit, installs and configures the unit, and is also one of the users of the unit. However, in other scenarios, such as a landlord-tenant environment, the customer may be the landlord for the purchase of the unit, the installer may be the apartment manager of the property, the first user may be the tenant, and the second user may again be the landlord for the remote control functionality. Importantly, while the identity of the person performing the action may be germane to the particular benefits provided by one or more of the implementations, in the following description, such identities should not be construed as necessarily limiting the scope of the present teachings to those particular individuals having those particular identities.

[0085] Although the various figures depict multiple logical steps in a particular order, steps that are not order dependent may be reordered and other steps may be combined or separated. While certain reorderings or other groupings are specifically mentioned, others will be apparent to those of ordinary skill in the art, and thus the ordering and groupings presented herein are not an exhaustive list of alternatives. Furthermore, it should be recognized that steps may be implemented in hardware, firmware, software, or any combination thereof.

[0086] The foregoing description has been provided for illustrative purposes with reference to specific implementations. However, the illustrative discussion above is not intended to be exhaustive or to limit the scope of the claims to the precise form disclosed. Numerous modifications and variations are possible in light of the above teachings. The implementations have been selected to best explain the principles underlying the claims and their practical application, thereby enabling those skilled in the art to best employ the implementations with various modifications as appropriate for the particular use contemplated.

Claims

1. An apparatus comprising: a rounded housing including a coupled first housing element and a base, the first housing element and the base being separated along a separation plane, the first housing element comprising: a perforated portion forming a ring adjacent the separation plane for transmitting sound through the perforated portion of the first housing element, the first housing element further comprising: a top portion that is not perforated and is less rounded than said perforated portion; The apparatus further comprises: a speaker disposed within the base such that a primary acoustic radiation path from the speaker is toward the first housing element, the apparatus further comprising: one or more surfaces that reflect at least a portion of sound from the speaker toward the perforated portion that is adjacent the separation plane and forms the ring; a circuit board disposed within the rounded housing and electrically coupled to the speaker, the circuit board comprising: one or more electronic components configured to drive the speaker; and a wireless transceiver configured to transmit and receive signals.

2. The device of claim 1 , further comprising a physical button configured to enable touch user interaction with the device.

3. The device of claim 2 , further comprising a microphone configured to enable audio user interaction with the device.

4. 4. The device of claim 1, wherein the circuit board further includes one or more modules configured to output an audible response to a user voice input, play an audio track of media content, and / or generate an audible alert.

5. The apparatus of any one of claims 1 to 4, wherein the separation plane lies on the major axis of a truncated ellipsoid formed by the first housing element and the base.

6. the first housing element has a first exterior cover that is acoustically transparent; The device of any one of claims 1 to 5, wherein the base has a second outer covering different from the first outer covering.

7. The apparatus of claim 6 , wherein the perforated portion of the first housing element is covered by the first exterior cover.

8. The apparatus of any one of claims 1 to 7, further comprising an acoustic waveguide that redirects sound from the speaker towards the perforated portion.

9. The apparatus of claim 8 , wherein the acoustic waveguide is mounted on the circuit board in close proximity to an electronic component such that the acoustic waveguide further functions as a heat sink.

10. 10. The apparatus of claim 9, wherein the acoustic waveguide includes a curved bottom surface to redirect the sound from the speaker toward the perforated portion.

11. The device of any preceding claim, further comprising a power switch.

12. The device of any preceding claim, wherein the wireless transceiver is further configured to communicate with a remote device over a short-range communications link.

13. The apparatus of claim 12 , wherein the short-range communications link comprises a Bluetooth link.

14. The device of any preceding claim, further comprising a visual indicator configured to indicate a status of the device.

15. 15. The device of claim 14, wherein the visual indicator is disposed in the first housing element and includes at least one LED (light emitting diode).

16. The apparatus of any one of claims 1 to 15, wherein the first housing element and the base are joined to form a truncated ellipsoid.

17. 17. The device of claim 16, wherein the truncated ellipsoid is truncated within the base by a truncation plane perpendicular to a minor axis of the truncated ellipsoid.

18. 20. The apparatus of claim 17, wherein a ground surface is formed by the truncated plane.

19. the minor axis corresponds to a height of the device from the ground surface; 20. The device of claim 18, wherein a major axis corresponds to a width of the device.

20. The apparatus of claim 18 , wherein the perforated portion is along the separation plane.

Images