Playback devices with integrated projection assemblies

WO2026213087A3PCT designated stage Publication Date: 2026-11-12SONOS INC
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
PCT/US2026/021549
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2025-04-01
Filing Date
2026-03-30
Publication Date
2026-11-12

AI Technical Summary

Technical Problem

Conventional large-format video displays and projection systems face challenges with space constraints, complex installations, audio synchronization, and limited orientation and placement options, particularly for immersive audio formats.

Method used

Media playback devices with integrated projection assemblies and audio transducers that can operate in multiple orientations, adjust video and audio output accordingly, and synchronize with other devices to create coordinated audiovisual experiences, including ambient visual content generation based on audio and environmental conditions.

Benefits of technology

Provides flexible installation options with integrated audiovisual solutions that maintain playback quality, reduce setup complexity, and enhance user experience through coordinated audio and video output.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure US2026021549_12112026_PF_FP_ABST
    Figure US2026021549_12112026_PF_FP_ABST
Patent Text Reader

Abstract

A media playback device includes a housing carrying a projection assembly and multiple audio transducers. The projection assembly includes a light source and optical elements. The audio transducers are arranged in the housing according to a first orientation with respect to gravity. The device receives media content comprising video content and audio content, where the audio content includes portions associated with different audio transducers in the first orientation. Upon detecting a change of orientation of the housing from the first orientation to a second orientation, the device adjusts the video content and outputs the adjusted video content via the projection assembly. The device also reassigns audio content portions among the transducers based on the detected second orientation, outputting the first portion via the second transducer and the second portion via the first transducer.
Need to check novelty before this filing date? Find Prior Art

Description

Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO PLAYBACK DEVICES WITH INTEGRATED PROJECTION ASSEMBLIESCROSS-REFERENCE TO RELATED APPLICATIONS

[0001] The present application claims the benefit of priority to U.S. Patent Application No.63 / 781,819, filed April 1, 2025, and to U.S. Patent Application No. 63 / 781,834, filed April 1, 2025, each of which is incorporated herein by reference in its entirety.FIELD OF THE DISCLOSURE

[0002] The present disclosure is related to consumer goods and, more particularly, to methods, systems, products, features, services, and other elements directed to media playback or some aspect thereof.BACKGROUND

[0003] Options for accessing and listening to digital audio in an out-loud setting were limited until in 2002, when SONOS, Inc. began development of anew type of playback system. Sonos then filed one of its first patent applications in 2003, entitled “Method for Synchronizing Audio Playback between Multiple Networked Devices,’' and began offering its first media playback systems for sale in 2005. The Sonos Wireless Home Sound System enables people to experience music from many sources via one or more networked playback devices. Through a software control application installed on a controller (e.g., smartphone, tablet, computer, voice input device), one can play what she wants in any room having a networked playback device. Media content (e.g., songs, podcasts, video sound) can be streamed to playback devices such that each room with a playback device can play back corresponding different media content. In addition, rooms can be grouped together for synchronous playback of the same media content, and / or the same media content can be heard in all rooms synchronously.BRIEF DESCRIPTION OF THE DRAWINGS

[0004] Features, examples, and advantages of the presently disclosed technology may be better understood with regard to the following description, appended claims, and accompanying drawings, as listed below. A person skilled in the relevant art will understand that the features shown in the drawings are for purposes of illustrations, and variations, including different and / or additional features and arrangements thereof, are possible.

[0005] Figure 1 A shows a partial cutaway view of an environment having a media playback system configured in accordance with aspects of the disclosed technology.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0006] Figure IB shows a schematic diagram of the media playback system of Figure 1 A and one or more networks.

[0007] Figure 1C shows a block diagram of a playback device.

[0008] Figure ID shows a block diagram of a playback device.

[0009] Figure IE shows a block diagram of a network microphone device.

[0010] Figure IF shows a block diagram of a network microphone device.

[0011] Figure 1G shows a block diagram of a playback device.

[0012] Figure 1H shows a partially schematic diagram of a control device.

[0013] Figures II through IL show schematic diagrams of corresponding media playback system zones.

[0014] Figure IM shows a schematic diagram of media playback system areas.

[0015] Figure 2 shows a schematic block diagram of a media playback system including media playback devices having integrated projection assemblies in accordance with examples of the present technology’.

[0016] Figure 3 A is a perspective view of a playback device in accordance with examples of the present technology.

[0017] Figure 3B is a side view of the playback device shown in Figure 3A.

[0018] Figures 4A and 4B illustrate example arrangements of a playback device within an environment.

[0019] Figure 4C illustrates an example method for keystone correction in accordance with examples of the present technology.

[0020] Figures 5A and 5B illustrate example audio channel assignments for a playback device in accordance with examples of the present technology’.

[0021] Figure 6 and 7 are flow charts of methods in accordance with examples of the present technology^.

[0022] Figure 8 illustrates another example arrangement of a playback device within an environment.

[0023] Figure 9 illustrates two playback devices configured to project a joint image in accordance with examples of the present technology'.

[0024] Figures 10 and 11 illustrate additional configurations of playback devices with integrated projection assemblies in accordance with examples of the present technology'.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0025] Figure 12 illustrates a credenza housing a media playback device in accordance with examples of the present technology.

[0026] Figures 13 and 14 illustrate projection of generative visual content via a playback device in accordance with examples of the present technology.

[0027] Figure 15 illustrates wireless power transfer via a playback device in accordance with examples of the present technology.

[0028] The drawings are for the purpose of illustrating example examples, but those of ordinary skill in the art will understand that the technology' disclosed herein is not limited to the arrangements and / or instrumentality shown in the drawings.DETAILED DESCRIPTIONI. Overview

[0029] Conventional approaches to large-format video display present various technical challenges. Traditional televisions often require dedicated wall space that may be unsuitable for other purposes, while conventional ceiling-mounted projectors can involve complex installation requirements including power and audiovisual cable routing. Ultra-short throw projectors may address some of these challenges but can present their own technical considerations regarding placement and stability. For example, when positioned on furniture near a projection surface, ultra-short throw projectors may be susceptible to physical displacement that affects image alignment. Additionally, integrating high-quality audio with projection systems can present technical hurdles. Televisions may have space constraints that limit audio transducer size and configuration, while projector installations may require separate audio systems that need careful synchronization to avoid latency between audio and video playback. Moreover, conventional projection systems may have limited options for orientation and placement while maintaining both optimal video projection and audio output, particularly for immersive audio formats that utilize height channels.

[0030] Examples of the present technology include media playback devices having integrated projection assemblies and audio transducers. In some implementations, a media playback device includes a housing that carries both a projection assembly and multiple audio transducers. The projection assembly can include a light source and one or more optical elements configured to project video content onto a projection surface. The audio transducers within the housing can be arranged to output different audio channels of multi-channel audio content that accompanies the video content.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0031] In some implementations, the media playback device can be configured in multiple orientations with respect to gravity. For instance, the housing can be positioned in a first orientation (e.g., on a horizontal surface with the projection assembly facing upward) or a second orientation (e.g., mounted to a ceiling with the projection assembly facing downward). The media playback device can detect its current orientation and correspondingly adjust both the projected video content and the audio output. For example, the device can modify video parameters such as keystone correction based on the detected orientation while also adapting audio channel assignments among the transducers to maintain desired audio imaging.

[0032] In some implementations, the media playback device can coordinate with other playback devices to create an enhanced audiovisual experience. For example, multiple media playback devices can synchronize their video projection to create a larger combined image while also operating as a bonded zone for synchronized multi-channel audio playback. The media playback devices can determine their relative positions and orientations to properly align their respective video outputs and adjust their audio channel responsibilities accordingly.

[0033] In some implementations, the media playback device includes one or more stabilization components configured to isolate the projection assembly from vibrations that may be caused by operation of the audio transducers. The media playback device can analyze upcoming audio content to predict when substantial vibration may occur (e.g., due to bass frequencies) and preemptively adjust the stabilization components. Additionally or alternatively, the media playback device can include sensors to detect ambient conditions and adjust various parameters of both the audio and video output to optimize playback quality based on the detected conditions.

[0034] In some implementations, the media playback device is configured to generate visual content, for instance corresponding to audio playback or environmental conditions. The device can analyze audio content being played through the system and generate synchronized visual elements that respond to characteristics such as tempo, rhythm, frequency content, and musical structure. These visualizations may include abstract paterns, landscapes, animations, or informational displays showing track information and album artwork. Additionally, the device can generate ambient visual content when not actively projecting traditional video content, analyzing environmental conditions such as time of day, ambient light levels, or room occupancy to create suitable background projections that transform walls or other surfaces into dynamic visual elements. The media playback device can employ various machine learningAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO models to improve content generation capabilities over time, learning from user preferences and behavior patterns to create more personalized visual experiences. These models enable the device to transition smoothly between different types of generated content based on playback state, user interactions, or environmental changes, while maintaining coordination between the projected visual elements and the spatial audio output. This capability allows the device to serve multiple functions beyond traditional audiovisual playback, providing increasingly relevant and engaging visual accompaniment to audio experiences whether playing music from a turntable, streaming service, or other audio sources.

[0035] The media playback device can thus provide an integrated audiovisual solution that addresses various challenges associated with conventional display technologies. For example, the ability to operate in multiple orientations while maintaining coordinated audio and video output can allow for flexible installation options without compromising playback quality'. The integration of projection and audio components in a single housing can reduce setup complexity' and cable management issues while enabling enhanced audiovisual experiences through coordination with other networked devices.

[0036] While some examples described herein may refer to functions performed by given actors such as “users,” “listeners,” and / or other entities, it should be understood that this is for purposes of explanation only. The claims should not be interpreted to require action by any such example actor unless explicitly required by the language of the claims themselves.

[0037] In the Figures, identical reference numbers identify generally similar, and / or identical, elements. To facilitate the discussion of any particular element, the most significant digit or digits of a reference number refers to the Figure in which that element is first introduced. For example, element 110a is first introduced and discussed with reference to Figure 1A. Many of the details, dimensions, angles, and other features shown in the Figures are merely illustrative of particular examples of the disclosed technology. Accordingly, other examples can have other details, dimensions, angles, and features without departing from the spirit or scope of the disclosure. In addition, those of ordinary skill in the art will appreciate that further examples of the various disclosed technologies can be practiced without several of the details described below.II. Suitable Operating Environment

[0038] Figure 1A is a partial cutaway view of a media playback system 100 distributed in an environment 101 (e.g., a house). The media playback system 100 comprises one or moreAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO playback devices 110 (identified individually as playback devices HOa-n), one or more network microphone devices (“NMDs”), 120 (identified individually as NMDs 120a-c), and one or more control devices 130 (identified individually as control devices 130a and 130b).

[0039] As used herein the term “playback device” can generally refer to a network device configured to receive, process, and output data of a media playback system. For example, a playback device can be a network device that receives and processes audio data. In some embodiments, a playback device includes one or more transducers or speakers powered by one or more amplifiers. In other embodiments, however, a playback device includes one of (or neither of) the speaker and the amplifier. For instance, a playback device can comprise one or more amplifiers configured to drive one or more speakers external to the playback device via a corresponding wire or cable.

[0040] Moreover, as used herein the term NMD (i.e., a “network microphone device”) can generally refer to a network device that is configured for audio detection. In some embodiments, an NMD is a stand-alone device configured primarily for audio detection. In other embodiments, an NMD is incorporated into a playback device (or vice versa).

[0041] The term “control device” can generally refer to a network device configured to perform functions relevant to facilitating user access, control, and / or configuration of the media playback system 100.

[0042] Each of the playback devices 110 is configured to receive audio signals or data from one or more media sources (e.g., one or more remote servers, one or more local devices) and play back the received audio signals or data as sound. The one or more NMDs 120 are configured to receive spoken word commands, and the one or more control devices 130 are configured to receive user input. In response to the received spoken word commands and / or user input, the media playback system 100 can play back audio via one or more of the playback devices 110. In certain embodiments, the playback devices 110 are configured to commence playback of media content in response to a trigger. For instance, one or more of the playback devices 110 can be configured to play back a morning playlist upon detection of an associated trigger condition (e.g., presence of a user in a kitchen, detection of a coffee machine operation). In some embodiments, for example, the media playback system 100 is configured to play back audio from a first playback device (e.g., the playback device 100a) in synchrony with a second playback device (e.g., the playback device 100b). Interactions between the playback devices 110, NMDs 120. and / or control devices 130 of the media playback system 100 configured inAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO accordance with the various embodiments of the disclosure are described in greater detail below with respect to Figures 1B-1L.

[0043] In the illustrated embodiment of Figure 1A, the environment 101 comprises a household having several rooms, spaces, and / or playback zones, including (clockwise from upper left) a master bathroom 101a, a master bedroom 101b, a second bedroom 101c, a family room or den lOld, an office lOle, a living room 10 If, a dining room 101g, a kitchen lOlh, and an outdoor patio lOli. While certain embodiments and examples are described below in the context of a home environment, the technologies described herein may be implemented in other ty pes of environments. In some embodiments, for example, the media playback system 100 can be implemented in one or more commercial settings (e.g.. a restaurant, mall, airport, hotel, a retail or other store), one or more vehicles (e.g., a sports utility vehicle, bus, car, a ship, a boat, an airplane), multiple environments (e.g., a combination of home and vehicle environments), and / or another suitable environment where multi-zone audio may be desirable.

[0044] The media playback system 100 can comprise one or more playback zones, some of which may correspond to the rooms in the environment 101. The media playback system 100 can be established with one or more playback zones, after which additional zones may be added, or removed to form, for example, the configuration show n in Figure 1 A. Each zone may be given a name according to a different room or space such as the office lOle, master bathroom 101a, master bedroom 101b, the second bedroom 101c, kitchen lOlh. dining room 101g, living room 101 f, and / or the patio lOli. In some aspects, a single playback zone may include multiple rooms or spaces. In certain aspects, a single room or space may include multiple playback zones.

[0045] In the illustrated embodiment of Figure 1A, the master bathroom 101a, the second bedroom 101c, the office lOle, the living room 101 f, the dining room 101g, the kitchen lOlh, and the outdoor patio lOli each include one playback device 110, and the master bedroom 101b and the den 101 d include a plurality of playback devices 110. In the master bedroom 101b, the playback devices 1101 and 110m may be configured, for example, to play back audio data in synchrony as individual ones of playback devices 110, as a bonded playback zone, as a consolidated playback device, and / or any combination thereof. Similarly, in the den 101 d, the playback devices 11 Oh-j can be configured, for instance, to play back audio data in synchrony as individual ones of playback devices 110, as one or more bonded playback devices, and / or as one or more consolidated playback devices. Additional details regarding bonded andAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO consolidated playback devices are described below with respect to, for example, Figures IB and IE and 1I-1M.

[0046] In some aspects, one or more of the playback zones in the environment 101 may each be playing different audio data. For instance, a user may be grilling on the patio lOli and listening to hip hop music being played by the playback device 110c while another user is preparing food in the kitchen lOlh and listening to classical music played by the playback device 110b. In another example, a playback zone may play the same audio data in synchrony with another playback zone. For instance, the user may be in the office lOle listening to the playback device 11 Of playing back the same hip hop music being played back by playback device 110c on the patio lOli. In some aspects, the playback devices 110c and 1 lOf play back the hip hop music in synchrony such that the user perceives that the audio data is being played seamlessly (or at least substantially seamlessly) while moving between different playback zones. Additional details regarding audio playback synchronization among playback devices and / or zones can be found, for example, in U.S. Patent No. 8,234,395 entitled, “System and method for synchronizing operations among a plurality of independently clocked digital data processing devices,” which is incorporated herein by reference in its entirety.a. Suitable Media Playback System

[0047] Figure IB is a schematic diagram of the media playback system 100 and a cloud network 102. For ease of illustration, certain devices of the media playback system 100 and the cloud network 102 are omitted fromFigure IB. One ormore communication links 103 (referred to hereinafter as “the links 103”) communicatively couple the media playback system 100 and the cloud network 102.

[0048] The links 103 can comprise, for example, one or more wired networks, one or more wireless networks, one or more wide area networks (WAN), one or more local area networks (LAN), one or more personal area networks (PAN), one or more telecommunication networks (e.g., one or more Global System for Mobiles (GSM) networks, Code Division Multiple Access (CDMA) networks, Long-Term Evolution (LTE) networks, 5G communication network networks, and / or other suitable data transmission protocol networks), etc. The cloud network 102 is configured to deliver media content (e.g., audio data, video data, photographs, social media content) to the media playback system 100 in response to a request transmitted from the media playback system 100 via the links 103. In some embodiments, the cloud network 102 is further configured to receive data (e.g., voice input data) from the media playback system 100Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO and correspondingly transmit commands and / or media content to the media playback system 100.

[0049] The cloud network 102 comprises computing devices 106 (identified separately as a first computing device 106a, a second computing device 106b, and a third computing device 106c). The computing devices 106 can comprise individual computers or servers, such as, for example, a media streaming service server storing audio and / or other media content, a voice service server, a social media server, a media playback system control server, etc. In some embodiments, one or more of the computing devices 106 comprise modules of a single computer or server. In certain embodiments, one or more of the computing devices 106 comprise one or more modules, computers, and / or servers. Moreover, while the cloud network 102 is described above in the context of a single cloud network, in some embodiments the cloud network 102 comprises a plurality of cloud networks comprising communicatively coupled computing devices. Furthermore, while the cloud network 102 is shown in Figure IB as having three of the computing devices 106, in some embodiments, the cloud network 102 comprises fewer (or more than) three computing devices 106.

[0050] The media playback system 100 can receive media content from the networks 102 via the links 103. The received media content can comprise, for example, a Uniform Resource Identifier (URI) and / or a Uniform Resource Locator (URL). For instance, in some examples, the media playback system 100 can stream, download, or otherwise obtain data from a URI or a URL corresponding to the received media content. A network 104 communicatively couples the links 103 and at least a portion of the devices (e.g., one or more of the playback devices 110, NMDs 120, and / or control devices 130) of the media playback system 100. The network 104 can include, for example, a wireless network (e.g., a WiFi network, a Bluetooth, a Z-Wave network, aZigBee, and / or other suitable wireless communication protocol network) and / or a wired network (e.g., a network comprising Ethernet, Universal Serial Bus (USB), and / or another suitable wired communication). As those of ordinary skill in the art will appreciate, as used herein, “WiFi’' can refer to several different communication protocols including, for example. Institute of Electrical and Electronics Engineers (IEEE) 802.11a. 802.11b. 802.11g, 802.1 In, 802.1 lac, 802.1 lac, 802.11 ad, 802.1 laf, 802.11 ah, 802.1 lai, 802.11aj, 802. Haq, 802.11ax, 802.11ay, 802.15, etc. transmitted at 2.4 Gigahertz (GHz), 5 GHz, and / or another suitable frequency.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0051] In some embodiments, the network 104 comprises a dedicated communication network that the media playback system 100 uses to transmit messages between individual devices and / or to transmit media content to and from media content sources (e.g., one or more of the computing devices 106). In certain embodiments, the network 104 is configured to be accessible only to devices in the media playback system 100, thereby reducing interference and competition with other household devices. In other embodiments, however, the network 104 comprises an existing household communication network (e.g., a household WiFi network). In some embodiments, the links 103 and the network 104 comprise one or more of the same networks. In some aspects, for example, the links 103 and the network 104 comprise a telecommunication network (e.g., an LTE network, a 5G network). Moreover, in some embodiments, the media playback system 100 is implemented without the network 104, and devices comprising the media playback system 100 can communicate with each other, for example, via one or more direct connections, PANs, telecommunication networks, and / or other suitable communication links.

[0052] In some embodiments, audio data sources may be regularly added or removed from the media playback system 100. In some embodiments, for example, the media playback system 100 performs an indexing of media items when one or more media content sources are updated, added to, and / or removed from the media playback system 100. The media playback system 100 can scan identifiable media items in some or all folders and / or directories accessible to the playback devices 110 and generate or update a media content database comprising metadata (e.g., title, artist, album, track length) and other associated information (e.g., URIs, URLs) for each identifiable media item found. In some embodiments, for example, the media content database is stored on one or more of the playback devices 110, network microphone devices 120, and / or control devices 130.

[0053] In the illustrated embodiment of Figure IB, the playback devices 1101 and 110m comprise a group 107a. The playback devices 1101 and 110m can be positioned in different rooms in a household and be grouped together in the group 107a on a temporary or permanent basis based on user input received at the control device 130a and / or another control device 130 in the media playback system 100. When arranged in the group 107a, the playback devices 1101 and 110m can be configured to play back the same or similar audio data in synchrony from one or more audio content sources. In certain embodiments, for example, the group 107a comprises a bonded zone in which the playback devices 1101 and 110m comprise left audioAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO and right audio channels, respectively, of multi-channel audio content, thereby producing or enhancing a stereo effect of the audio content. In some embodiments, the group 107a includes additional playback devices 110. In other embodiments, however, the media playback system 100 omits the group 107a and / or other grouped arrangements of the playback devices 110. Additional details regarding groups and other arrangements of playback devices are described in further detail below with respect to Figures 1-1 through IM.

[0054] The media playback system 100 includes the NMDs 120a and 120d, each comprising one or more microphones configured to receive voice utterances from a user. In the illustrated embodiment of Figure IB, the NMD 120a is a standalone device and the NMD 120d is integrated into the playback device 1 lOn. The NMD 120a, for example, is configured to receive voice input 121 from a user 123. In some embodiments, the NMD 120a transmits data associated with the received voice input 121 to a voice assistant sendee (VAS) configured to (i) process the received voice input data and (ii) transmit a corresponding command to the media playback system 100. In some aspects, for example, the computing device 106c comprises one or more modules and / or servers of a VAS (e.g., a VAS operated by one or more of SONOS®, AMAZON®, GOOGLE® APPLE®, MICROSOFT®). The computing device 106c can receive the voice input data from the NMD 120a via the network 104 and the links 103. In response to receiving the voice input data, the computing device 106c processes the voice input data (i.e.. “Play Hey Jude by The Beatles"), and determines that the processed voice input includes a command to play a song (e.g., “Hey Jude’’). The computing device 106c accordingly transmits commands to the media playback system 100 to play back “Hey Jude” by the Beatles from a suitable media service (e.g., via one or more of the computing devices 106) on one or more of the playback devices 110.b. Suitable Playback Devices

[0055] Figure 1C is a block diagram of the playback device 110a comprising an input / output 111. The input / output 111 can include an analog I / O Illa (e.g., one or more wires, cables, and / or other suitable communication links configured to cany' analog signals) and / or a digital I / O 11 lb (e.g., one or more wires, cables, or other suitable communication links configured to carry digital signals). In some embodiments, the analog I / O Illa is an audio line-in input connection comprising, for example, an auto-detecting 3.5mm audio line-in connection. In some embodiments, the digital I / O 111b comprises a Sony / Philips Digital Interface Format (S / PDIF) communication interface and / or cable and / or a Toshiba Link (TOSLINK) cable. InAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO some embodiments, the digital I / O 111b comprises a High-Definition Multimedia Interface (HDM1) interface and / or cable. In some examples, the digital I / O 111b comprises a USB-C interface. In some embodiments, the digital I / O 111b includes one or more wireless communication links comprising, for example, a radio frequency (RF), infrared, WiFi, Bluetooth, or another suitable communication protocol. In certain embodiments, the analog I / O Il la and the digital I / O 111b comprise interfaces (e.g., ports, plugs, jacks) configured to receive connectors of cables transmitting analog and digital signals, respectively, without necessarily including cables.

[0056] The playback device 110a, for example, can receive media content (e.g., audio data comprising music and / or other sounds) from a local audio source 105 via the input / output 111 (e.g., a cable, a wire, a PAN, a Bluetooth connection, an ad hoc wired or wireless communication network, and / or another suitable communication link). The local audio source 105 can comprise, for example, a mobile device (e.g., a smartphone, atablet, alaptop computer) or another suitable audio component (e.g., a television, a desktop computer, an amplifier, a phonograph, a Blu-ray player, a memory storing digital media files). In some aspects, the local audio source 105 includes local music libraries on a smartphone, a computer, a networked-attached storage (NAS), and / or another suitable device configured to store media files. In certain embodiments, one or more of the playback devices 110, NMDs 120, and / or control devices 130 comprise the local audio source 105. In other embodiments, however, the media playback system omits the local audio source 105 altogether. In some embodiments, the playback device 110a does not include an input / output 111 and receives all audio data via the network 104.

[0057] The playback device 110a further comprises electronics 112, a user interface 113 (e.g., one or more buttons, knobs, dials, touch-sensitive surfaces, displays, touchscreens), and one or more transducers 114 (referred to hereinafter as ‘’the transducers 114”). The electronics 112 is configured to receive audio from an audio source (e.g., the local audio source 105) via the input / output 111, one or more of the computing devices 106a-c via the network 104 (Figure IB)), amplify the received audio, and output the amplified audio for playback via one or more of the transducers 114. In some embodiments, the playback device 110a optionally includes one or more microphones 115 (e.g., a single microphone, a plurality of microphones, a microphone array) (hereinafter referred to as “the microphones 115”). In certain embodiments, for example, the playback device 110a having one or more of the optional microphones 115Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO can operate as an NMD configured to receive voice input from a user and correspondingly perform one or more operations based on the received voice input.

[0058] In the illustrated embodiment of Figure 1C, the electronics 112 comprise one or more processors 112a (referred to hereinafter as “the processors 112a”), memory7112b, software components 112c, a network interface 112d, one or more audio processing components 112g (referred to hereinafter as “the audio components 112g”), one or more audio amplifiers 112h (referred to hereinafter as “the amplifiers 112h”), and power 112i (e.g., one or more power supplies, power cables, power receptacles, batteries, induction coils, Power-over Ethernet (POE) interfaces, and / or other suitable sources of electric power).

[0059] In some examples, for instance, the media playback device 202 can receive both data and power over a single Ethernet cable, thereby simplifying installation, reducing cable clutter, and potentially increasing safety. The Ethernet cable can provide a high-speed data connection for receiving audio and video content, control signals, and other data, and simultaneously provide electrical power using Power over Ethernet (PoE) technology, which allows Ethernet cabling to carry electrical power in addition to data. The media playback device 202 can include a PoE module configured to receive and process PoE signals, separating the data and power components for use by the device's electronics. The data component can be routed to the network interfaces 218 for processing, while the power component can be used to power the various electronic components of the device, such as the projection assembly 204, audio transducers 214, and other electronics 228. In some examples, the PoE module can also include power management features, such as overcurrent protection and voltage regulation, to ensure safe and reliable operation of the media playback device 202. The use of PoE technology7can eliminate the need for separate power cables and outlets, making it easier to install the media playback device 202 in a variety of locations. For example, the device could be mounted on a ceiling or wall without requiring a nearby power outlet, as long as an Ethernet connection is available. This can be particularly advantageous in situations where power outlets are limited or difficult to access, or where a clean and uncluttered installation is desired. In some examples, when the playback device 202 receives PoE power, a crossover frequency can be adjusted (e.g., increased) since, as those of ordinary skill in the art will appreciate, low frequency audio may require more power to generate and output than mid and high frequency audio. In certain examples, the media playback device 202 dynamically offloads low frequency audio to nearby- capable devices. Additional details regarding intelligent routing of low-frequency content canAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO be found in U.S. Patent No. 12,143,785, issued November 12, 2024 and titled “Systems and Methods of Distributing and Playing Back Low-Frequency Audio Content,” which is hereby incorporated by reference in its entirety for all purposes.

[0060] In some embodiments, the electronics 112 optionally include one or more other components 112j (e.g., one or more sensors, video displays, touchscreens, battery charging bases). In some examples, for instance, the one or more other components 112j comprise one or more sensors whose data can indicate locations, positions, and / or orientations of devices and / or users (and / or perhaps relative to one another). Some ty pes of sensors that may be implemented include those described in U.S. Patent No. 9,084,058, issued July 14, 2015 and titled “Sound Field Calibration Using Listener Localization,” which is hereby incorporated by reference in its entirety for all purposes.

[0061] The processors 112a can comprise clock-driven computing component(s) configured to process data, and the memory' 112b can comprise a computer-readable medium (e.g., a tangible, non-transitory computer-readable medium, data storage loaded with one or more of the software components 112c) configured to store instructions for performing various operations and / or functions. The processors 112a are configured to execute the instructions stored on the memory' 112b to perform one or more of the operations. The operations can include, for example, causing the playback device 110a to retrieve audio information from an audio source (e.g., one or more of the computing devices 106a-c (Figure IB)), and / or another one of the playback devices 110. In some embodiments, the operations further include causing the playback device 110a to send audio information to another one of the playback devices 110a and / or another device (e.g., one of the NMDs 120). Certain embodiments include operations causing the playback device 110a to pair with another of the one or more playback devices 110 to enable a multi-channel audio environment (e.g., a stereo pair, a bonded zone).

[0062] The processors 112a can be further configured to perform operations causing the playback device 110a to synchronize playback of audio data with another of the one or more playback devices 110. As those of ordinary skill in the art w ill appreciate, during synchronous playback of audio data on a plurality of playback devices, a listener will preferably be unable to perceive time-delay differences between playback of the audio data by the playback device 110a and the other one or more other playback devices 110. Additional details regarding audio playback synchronization among playback devices can be found, for example, in U.S. Patent No. 8,234,395. which was incorporated by reference above.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0063] In some embodiments, the memory 112b is further configured to store data associated with the playback device 110a, such as one or more zones and / or zone groups of which the playback device 110a is a member, audio sources accessible to the playback device 110a, and / or a playback queue that the playback device 110a (and / or another of the one or more playback devices) can be associated with. The stored data can comprise one or more state variables that are periodically updated and used to describe a state of the playback device 110a. The memory 112b can also include data associated with a state of one or more of the other devices (e.g., the playback devices 110, NMDs 120, control devices 130) of the media playback system 100. In some aspects, for example, the state data is shared during predetermined intervals of time (e.g., every 5 seconds, every 10 seconds, every 60 seconds) among at least a portion of the devices of the media playback system 100, so that one or more of the devices have the most recent data associated with the media playback system 100.

[0064] The network interface 112d is configured to facilitate a transmission of data between the playback device 110a and one or more other devices on a data network such as. for example, the links 103 and / or the network 104 (Figure IB). The network interface 112d is configured to transmit and receive data corresponding to media content (e.g., audio data, video data, text, photographs) and other signals (e.g., non-transitory signals) comprising digital packet data including an Internet Protocol (IP)-based source address and / or an IP-based destination address. The network interface 112d can parse the digital packet data such that the electronics 112 properly receives and processes the data destined for the playback device 110a.

[0065] In the illustrated embodiment of Figure 1C, the network interface 112d comprises one or more wireless interfaces 112e (referred to hereinafter as “the wireless interface 112e”). The wireless interface 112e (e g., a suitable interface comprising one or more antennae) can be configured to wirelessly communicate with one or more other devices (e.g., one or more of the other playback devices 110, NMDs 120, and / or control devices 130) that are communicatively coupled to the netw ork 104 (Figure IB) in accordance with a suitable wireless communication protocol (e.g., WiFi, Bluetooth, LTE). In some embodiments, the network interface 112d optionally includes a wired interface 112f (e.g., an interface or receptacle configured to receive a network cable such as an Ethernet, a USB-A, USB-C, and / or Thunderbolt cable) configured to communicate over a wired connection with other devices in accordance with a suitable wired communication protocol. In certain embodiments, the network interface 112d includes the wired interface 112f and excludes the wireless interface 112e. In some embodiments, theAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO electronics 112 excludes the network interface 112d altogether and transmits and receives media content and / or other data via another communication path (e.g., the input / output 111).

[0066] Furthermore, the network interface 112d and / or one or more wireless interface 112e can, in some examples, comprise a wireless relay and / or internet source for other nearby devices — regardless of whether the devices are grouped or otherwise connected to the media playback device 202 for playback. In some examples, for instance, the media playback device 202 serves as a wireless access point or repeater, extending the reach of a local network (e.g., the network 104 of Figure IB). In these scenarios, the media playback device 202 relays signals received directly over a WAN (e.g., via one or more cables, optical fibers, terrestrial RF links, and / or satellite-based services, such as Starlink) and / or a LAN (e.g.. via one or more routers connected to a WAN). This functionality may provide several benefits. A ceiling mounting, for instance, may allow for a central location that provides optimal Wi-Fi coverage throughout a room or even an entire floor of a house. By being mounted above furniture and other obstacles, the wireless signal may have a clearer path, minimizing interference and improving performance. Moreover, a ceiling-mounted device can be less obtrusive than a standalone access point or repeater and can perhaps blend into the environment. Combining multiple functions (projector, audio source, and / or access point / router) into a single device may reduce cable clutter and simplify installation. In certain examples, the functionality allows the media playback device 202 to intelligently manage network traffic, prioritizing, for instance, media streaming to ensure uninterrupted playback while also providing reliable internet access to other devices.

[0067] The audio processing components 112g are configured to process and / or filter data comprising media content received by the electronics 112 (e.g., via the input / output 111 and / or the network interface 112d) to produce output audio signals. In some embodiments, the audio processing components 112g comprise, for example, one or more digital -to-analog converters (DAC), audio preprocessing components, audio enhancement components, digital signal processors (DSPs), and / or other suitable audio processing components, modules, circuits, etc. In certain embodiments, one or more of the audio processing components 112g can comprise one or more subcomponents of the processors 112a. In some embodiments, the electronics 112 omits the audio processing components 112g. In some aspects, for example, the processors 112a execute instructions stored on the memory 112b to perform audio processing operations to produce the output audio signals.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0068] The amplifiers 112h are configured to receive and amplify the audio output signals produced by the audio processing components 112g and / or the processors 112a. The amplifiers 112h can comprise electronic devices and / or components configured to amplify audio signals to levels sufficient for driving one or more of the transducers 114. In some embodiments, for example, the amplifiers 112h include one or more switching or class-D power amplifiers. In other embodiments, however, the amplifiers include one or more other types of power amplifiers (e.g., linear gain power amplifiers, class-A amplifiers, class-B amplifiers, class-AB amplifiers, class-C amplifiers, class-D amplifiers, class-E amplifiers, class-F amplifiers, class-G and / or class H amplifiers, and / or another suitable type of power amplifier). In certain embodiments, the amplifiers 112h comprise a suitable combination of two or more of the foregoing types of power amplifiers. Moreover, in some embodiments, individual ones of the amplifiers 112h correspond to individual ones of the transducers 114. In other embodiments, however, the electronics 112 includes a single one of the amplifiers 112h configured to output amplified audio signals to a plurality’ of the transducers 114. In some other embodiments, the electronics 112 omits the amplifiers 112h.

[0069] The transducers 114 (e.g., one or more speakers and / or speaker drivers) receive the amplified audio signals from the amplifier 112h and render or output the amplified audio signals as sound (e.g., audible sound waves having a frequency between about 20 Hertz (Hz) and 20 kilohertz (kHz)). In some embodiments, the transducers 114 can comprise a single transducer. In other embodiments, however, the transducers 114 comprise a plurality7of audio transducers. In some embodiments, the transducers 114 comprise more than one type of transducer. For example, the transducers 114 can include one or more low frequency¬ transducers (e.g., subwoofers, woofers), mid-range frequency transducers (e.g., mid-range transducers, mid-woofers), and one or more high frequency transducers (e.g., one or more tweeters). As used herein, “low frequency” can generally refer to audible frequencies below about 500 Hz, “mid-range frequency” can generally refer to audible frequencies between about 500 Hz and about 2 kHz, and “high frequency” can generally refer to audible frequencies above 2 kHz. In certain embodiments, however, one or more of the transducers 114 comprise transducers that do not adhere to the foregoing frequency ranges. For example, one of the transducers 114 may comprise a mid- woofer transducer configured to output sound at frequencies between about 200 Hz and about 5 kHz.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0070] In some examples, the transducers 114 comprise one or more compact forcecancelling transducers such as those described in (i) U.S. Patent No. 11,297,415, issued April 5, 2022 and titled “Low Profile Loudspeaker Device,” and (ii) International Patent Publication No. WO 2024 / 073298, published April 4, 2024 and titled “Suspension System for Loudspeaker,” each of which is hereby incorporated by reference in its entirety' for all purposes. As those of ordinary skill in the art will appreciate, projectors include optical components (e.g., the optical elements 208) that can be sensitive to vibrations. Including audio transducers, particularly transducers capable of low frequencies, that minimize vibration can mitigate some challenges associated with audio output within a projector.

[0071] By way of illustration, SONOS, Inc. presently offers (or has offered) for sale certain playback devices including, for example, a “SONOS ONE,” “ERA 100”, "PLAY:1,” “PLAY:3,” “ERA 300,” “FIVE” “PLAY:5 ,” “ARC,” “BEAM,” “RAY,” “PLAYBAR,” “PLAYBASE,” “ROAM,” “MOVE,” “ACE,” “CONNECT: AMP,” “CONNECT,” “PORT,” “AMP,” and “SUB.” Other suitable playback devices may additionally or alternatively be used to implement the playback devices of example embodiments disclosed herein. Additionally, one of ordinary skilled in the art will appreciate that a playback device is not limited to the examples described herein or to SONOS product offerings. In some embodiments, for example, one or more playback devices 110 comprises wired or wireless headphones (e.g., over-the-ear headphones, on-ear headphones, in-ear earphones). In other embodiments, one or more of the playback devices 110 comprise a docking station and / or an interface configured to interact with a docking station for personal mobile media playback devices. In certain embodiments, a playback device may be integral to another device or component such as a television, a projector, a lighting fixture, or some other device for indoor or outdoor use. In some embodiments, a playback device omits a user interface and / or one or more transducers. For example, FIG. ID is a block diagram of a playback device 1 lOp comprising the input / output 111 and electronics 112 without the user interface 113 or transducers 114.

[0072] Figure IE is a block diagram of a bonded playback device HOq comprising the playback device 110a (Figure 1C) sonically bonded with the playback device HOi (e.g., a subwoofer) (Figure 1 A). In the illustrated embodiment, the playback devices 110a and 1 lOi are separate ones of the playback devices 110 housed in separate enclosures. In some embodiments, however, the bonded playback device HOq comprises a single enclosure housing both the playback devices 110a and HOi. The bonded playback device HOq can beAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO configured to process and reproduce sound differently than an unbonded playback device (e.g., the playback device 110a of Figure 1C) and / or paired or bonded playback devices (e.g., the playback devices 1101 and 110m of Figure IB). In some embodiments, for example, the playback device 110a is full-range playback device configured to render low frequency, midrange frequency, and high frequency audio content, and the playback device HOi is a subwoofer configured to render low frequency audio content. In some aspects, the playback device 110a, when bonded with the first playback device, is configured to render only the midrange and high frequency components of a particular audio content, while the playback device HOi renders the low frequency component of the particular audio content. In some embodiments, the bonded playback device HOq includes additional playback devices and / or another bonded playback device. Additional playback device embodiments are described in further detail below with respect to Figures 2A-3D.c. Suitable Network Microphone Devices (NMDs)

[0073] Figure IF is a block diagram of the NMD 120a (Figures 1A and IB). The NMD 120a includes one or more voice processing components 124 (hereinafter "the voice components 124”) and several components described with respect to the playback device 110a (Figure 1 C) including the processors 112a, the memory 112b, and the microphones 115. The NMD 120a optionally comprises other components also included in the playback device 110a (Figure 1C), such as the user interface 113 and / or the transducers 114. In some embodiments, the NMD 120a is configured as a media playback device (e.g., one or more of the playback devices 110), and further includes, for example, one or more of the audio processing components 112g (Figure 1C), the transducers 114, and / or other playback device components. In certain embodiments, the NMD 120a comprises an Internet of Things (loT) device such as, for example, a thermostat, alarm panel, fire and / or smoke detector, etc. In some embodiments, the NMD 120a comprises the microphones 115, the voice processing 124, and only a portion of the components of the electronics 112 described above with respect to Figure IB. In some aspects, for example, the NMD 120a includes the processor 112a and the memory 112b (Figure IB), while omitting one or more other components of the electronics 112. In some embodiments, the NMD 120a includes additional components (e g., one or more sensors, cameras, thermometers, barometers, hygrometers).

[0074] In some embodiments, an NMD can be integrated into a playback device. Figure 1G is a block diagram of a playback device 1 lOr comprising an NMD 120d. The playback deviceAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO 11 Or can comprise many or all of the components of the playback device 110a and further include the microphones 115 and voice processing 124 (Figure IF). The playback device 1 lOr optionally includes an integrated control device 130c. The control device 130c can comprise, for example, a user interface (e.g., the user interface 113 of Figure IB) configured to receive user input (e.g., touch input, voice input) without a separate control device. In other embodiments, however, the playback device 11 Or receives commands from another control device (e g., the control device 130a of Figure IB). Additional NMD embodiments are described in further detail below with respect to Figures 3A-3F.

[0075] Referring again to Figure IF, the microphones 115 are configured to acquire, capture, and / or receive sound from an environment (e g., the environment 101 of Figure 1A) and / or a room in which the NMD 120a is positioned. The received sound can include, for example, vocal utterances, audio played back by the NMD 120a and / or another playback device, background voices, ambient sounds, etc. The microphones 115 convert the received sound into electrical signals to produce microphone data. The voice processing 124 receives and analyzes the microphone data to determine whether a voice input is present in the microphone data. The voice input can comprise, for example, an activation word followed by an utterance including a user request. As those of ordinary skill in the art will appreciate, an activation word is a word or other audio cue that signifying a user voice input. For instance, in querying the AMAZON® VAS, a user might speak the activation word "Alexa." Other examples include "Ok. Google” for invoking the GOOGLE® VAS and ‘Hey, Siri” for invoking the APPLE® VAS.

[0076] After detecting the activation word, voice processing 124 monitors the microphone data for an accompanying user request in the voice input. The user request may include, for example, a command to control a third-party device, such as a thermostat (e.g.. NEST® thermostat), an illumination device (e.g., a PHILIPS HUE ® lighting device), or a media playback device (e.g., a Sonos® playback device). For example, a user might speak the activation word “Alexa” followed by the utterance “set the thermostat to 68 degrees” to set a temperature in ahome (e.g., the environment 101 of Figure 1 A). The user might speak the same activation word followed by the utterance “turn on the living room” to turn on illumination devices in a living room area of the home. The user may similarly speak an activation word followed by a request to play a particular song, an album, or a playlist of music on a playback device in the home. Additional description regarding receiving and processing voice input data can be found in further detail below with respect to Figures 3A-3F.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO d. Suitable Control Devices

[0077] Figure 1H is a partially schematic diagram of the control device 130a (Figures 1A and IB). As used herein, the term “control device” can be used interchangeably with “controller” or “control system.” Among other features, the control device 130a is configured to receive user input related to the media playback system 100 and, in response, cause one or more devices in the media playback system 100 to perform an action(s) or operation(s) corresponding to the user input. In the illustrated embodiment, the control device 130a comprises a smartphone (e.g., an iPhone™, an Android phone) on which media playback system controller application software is installed. In some embodiments, the control device 130a comprises, for example, a tablet (e.g., an iPad™), a computer (e.g., a laptop computer, a desktop computer), and / or another suitable device (e.g., a television, an automobile audio head unit, an loT device). In certain embodiments, the control device 130a comprises a dedicated controller for the media playback system 100. In other embodiments, as described above with respect to Figure 1G, the control device 130a is integrated into another device in the media playback system 100 (e.g., one more of the playback devices 110, NMDs 120. and / or other suitable devices configured to communicate over a network).

[0078] The control device 130a includes electronics 132, a user interface 133, one or more speakers 134, and one or more microphones 135. The electronics 132 comprise one or more processors 132a (referred to hereinafter as “the processors 132a”). a memory 132b. software components 132c, and a network interface 132d. The processor 132a can be configured to perform functions relevant to facilitating user access, control, and configuration of the media playback system 100. The memory 132b can comprise data storage that can be loaded with one or more of the software components executable by the processor 302 to perform those functions. The software components 132c can comprise applications and / or other executable software configured to facilitate control of the media playback system 100. The memory 112b can be configured to store, for example, the software components 132c, media playback system controller application software, and / or other data associated with the media playback system 100 and the user.

[0079] The network interface 132d is configured to facilitate network communications between the control device 130a and one or more other devices in the media playback system 100, and / or one or more remote devices. In some embodiments, the network interface 132d is configured to operate according to one or more suitable communication industry standardsAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO (e.g., infrared, radio, wired standards including IEEE 802.3, wireless standards including IEEE 802. Ila, 802. lib, 802.11g, 802.1 In, 802.1 lac, 802.15, 4G. LTE). The network interface 132d can be configured, for example, to transmit data to and / or receive data from the playback devices 110, the NMDs 120, other ones of the control devices 130, one of the computing devices 106 of Figure IB, devices comprising one or more other media playback systems, etc. The transmitted and / or received data can include, for example, playback device control commands, state variables, playback zone and / or zone group configurations. For instance, based on user input received at the user interface 133, the network interface 132d can transmit a playback device control command (e.g., volume control, audio playback control, audio content selection) from the control device 130a to one or more of the playback devices. The network interface 132d can also transmit and / or receive configuration changes such as, for example, adding / removing one or more playback devices to / from a zone, adding / removing one or more zones to / from a zone group, forming a bonded or consolidated player, separating one or more playback devices from a bonded or consolidated player, among others. Additional description of zones and groups can be found below with respect to Figures 1-1 through IM.

[0080] The user interface 133 is configured to receive user input and can facilitate control of the media playback system 100. The user interface 133 includes media content art 133a (e.g., album art, lyrics, videos), a playback status indicator 133b (e.g., an elapsed and / or remaining time indicator), media content information region 133c. a playback control region 133d, and a zone indicator 133e. The media content information region 133c can include a display of relevant information (e.g., title, artist, album, genre, release year) about media content currently playing and / or media content in a queue or playlist. The playback control region 133d can include selectable (e g., via touch input and / or via a cursor or another suitable selector) icons to cause one or more playback devices in a selected playback zone or zone group to perform playback actions such as, for example, play or pause, fast forward, rewind, skip to next, skip to previous, enter / exit shuffle mode, enter / exit repeat mode, enter / exit cross fade mode, etc. The playback control region 133d may also include selectable icons to modify equalization settings, playback volume, and / or other suitable playback actions. In the illustrated embodiment, the user interface 133 comprises a display presented on a touch screen interface of a smartphone (e.g., an iPhone™, an Android phone). In some embodiments, however, user interfaces of varying formats, styles, and interactive sequences may alternatively beAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO implemented on one or more network devices to provide comparable control access to a media playback system.

[0081] The one or more speakers 134 (e.g., one or more transducers) can be configured to output sound to the user of the control device 130a. In some embodiments, the one or more speakers comprise individual transducers configured to correspondingly output low frequencies, mid-range frequencies, and / or high frequencies. In some aspects, for example, the control device 130a is configured as a playback device (e.g., one of the playback devices 110). Similarly, in some embodiments the control device 130a is configured as an NMD (e.g., one of the NMDs 120), receiving voice commands and other sounds via the one or more microphones 135.

[0082] The one or more microphones 135 can comprise, for example, one or more condenser microphones, electret condenser microphones, dynamic microphones, and / or other suitable types of microphones or transducers. In some embodiments, two or more of the microphones 135 are arranged to capture location information of an audio source (e g., voice, audible sound) and / or configured to facilitate filtering of background noise. Moreover, in certain embodiments, the control device 130a is configured to operate as a playback device and an NMD. In other embodiments, however, the control device 130a omits the one or more speakers 134 and / or the one or more microphones 135. For instance, the control device 130a may comprise a device (e.g., a thermostat, an loT device, a network device) comprising a portion of the electronics 132 and the user interface 133 (e.g., a touch screen) without any speakers or microphones. Additional control device embodiments are described in further detail below with respect to Figures 4A-4D and 5.e. Suitable Playback Device Configurations

[0083] Figures 1-1 through IM show example configurations of playback devices in zones and zone groups. Referring first to Figure IM, in one example, a single playback device may belong to a zone. For example, the playback device 110g in the second bedroom 101c (FIG.1A) may belong to Zone C. In some implementations described below, multiple playback devices may be “bonded” to form a “bonded pair” which together form a single zone. For example, the playback device 1101 (e g., a left playback device) can be bonded to the playback device 1101 (e.g., a left playback device) to form Zone A. Bonded playback devices may have different playback responsibilities (e.g., channel responsibilities). In another implementation described below, multiple playback devices may be merged to form a single zone. For example,Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO the playback device 11 Oh (e.g., a front playback device) may be merged with the playback device HOi (e.g., a subwoofer), and the playback devices HOj and 110k (e.g., left and right surround speakers, respectively) to form a single Zone D. In another example, the playback devices 110g and 11 Oh can be merged to form a merged group or a zone group 108b. The merged playback devices 110g and 11 Oh may not be specifically assigned different playback responsibilities. That is, the merged playback devices 1 lOh and 1 lOi may, aside from playing audio data in synchrony, each play audio data as they would if they were not merged.

[0084] Each zone in the media playback system 100 may be provided for control as a single user interface (UI) entity. For example, Zone A may be provided as a single entity named Master Bathroom. Zone B may be provided as a single entity named Master Bedroom. Zone C may be provided as a single entity named Second Bedroom.

[0085] Playback devices that are bonded may have different playback responsibilities, such as responsibilities for certain audio channels. For example, as shown in Figure 1-1, the playback devices 1101 and 110m may be bonded so as to produce or enhance a stereo effect of audio data. In this example, the playback device 1101 may be configured to play a left channel audio component, while the playback device 11 k may be configured to play a right channel audio component. In some implementations, such stereo bonding may be referred to as “pairing.”

[0086] Additionally, bonded playback devices may have additional and / or different respective speaker drivers. As shown in Figure 1J. the playback device 1 lOh named Front may be bonded with the playback device 11 Oi named SUB. The Front device 1 lOh can be configured to render a range of mid to high frequencies and the SUB device 1 lOi can be configured to render low frequencies. When unbonded, however, the Front device 11 Oh can be configured to render a full range of frequencies. As another example, Figure IK shows the Front and SUB devices 11 Oh and HOi further bonded with Left and Right playback devices HOj and 110k, respectively. In some implementations, the Right and Left devices HOj and 102k can be configured to form surround or “satellite” channels of a home theater system. The bonded playback devices 1 lOh, 1 lOi, HOj. and 110k may form a single Zone D (FIG. IM). Additional details and examples of flexibly configuring playback devices as “satellite” devices can be found in International Patent Publication no. WO 2024 / 073401, published April 4, 2024 and titled “Home Theatre Audio Playback With Multichannel Satellite Playback Devices,” which is hereby incorporated by reference in its entirety for all purposes.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0087] Playback devices that are merged may not have assigned playback responsibilities and may each render the full range of audio data the respective playback device is capable of. Nevertheless, merged devices may be represented as a single UI entity (i.e., a zone, as discussed above). For instance, the playback devices 110a and HOn in the master bathroom have the single UI entity of Zone A. In one embodiment, the playback devices 11 Oa and 11 On may each output the full range of audio data each respective playback devices 110a and 1 lOn are capable of, in synchrony.

[0088] In some embodiments, an NMD is bonded or merged with another device so as to form a zone. For example, the NMD 120b may be bonded with the playback device IlOe, which together form Zone F, named Living Room. In other embodiments, a stand-alone network microphone device may be in azone by itself. In other embodiments, however, a standalone network microphone device may not be associated with a zone. Additional details regarding associating network microphone devices and playback devices as designated or default devices may be found, for example, in previously referenced U.S. Patent Application No. 15 / 438,749.

[0089] Zones of individual, bonded, and / or merged devices may be grouped to form a zone group. For example, referring to Figure IM, Zone A may be grouped with Zone B to form a zone group 108a that includes the two zones. Similarly, Zone G may be grouped with Zone H to form the zone group 108b. As another example, Zone A may be grouped with one or more other Zones C-I. The Zones A-I may be grouped and ungrouped in numerous ways. For example, three, four, five, or more (e.g., all) of the Zones A-I may be grouped. When grouped, the zones of individual and / or bonded playback devices may play back audio in synchrony with one another, as described in previously referenced U.S. Patent No. 8,234,395. Playback devices may be dynamically grouped and ungrouped to form new or different groups that synchronously play back audio data.

[0090] In various implementations, the zones in an environment may be the default name of a zone within the group or a combination of the names of the zones within a zone group. For example. Zone Group 108b can be assigned a name such as "‘Dining + Kitchen”, as shown in Figure IM. In some embodiments, a zone group may be given a unique name selected by a user.

[0091] Certain data may be stored in a memory of a playback device (e.g., the memory 112b of Figure 1C) as one or more state variables that are periodically updated and used to describeAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO the state of a playback zone, the playback device(s). and / or a zone group associated therewith. The memory may also include the data associated with the state of the other devices of the media system, and shared from time to time among the devices so that one or more of the devices have the most recent data associated with the system.

[0092] In some embodiments, the memory may store instances of various variable types associated with the states. Variables instances may be stored with identifiers (e.g., tags) corresponding to type. For example, certain identifiers may be a first type “al” to identify playback device(s) of a zone, a second type “bl” to identify7playback device(s) that may be bonded in the zone, and a third type “cl” to identify a zone group to which the zone may belong. As a related example, identifiers associated with the second bedroom 101c may indicate that the playback device is the only playback device of the Zone C and not in a zone group. Identifiers associated with the Den may indicate that the Den is not grouped with other zones but includes bonded playback devices 11 Oh- 11 Ok. Identifiers associated with the Dining Room may indicate that the Dining Room is part of the Dining + Kitchen zone group 108b and that devices 110b and 1 lOd are grouped (FIG. IL). Identifiers associated with the Kitchen may indicate the same or similar information by virtue of the Kitchen being part of the Dining + Kitchen zone group 108b. Other example zone variables and identifiers are described below.

[0093] In yet another example, the media playback system 100 may variables or identifiers representing other associations of zones and zone groups, such as identifiers associated with Areas, as shown in Figure IM. An area may involve a cluster of zone groups and / or zones not within a zone group. For instance, Figure IM shows an Upper Area 109a including Zones A-D, and a Low er Area 109b including Zones E-I. In one aspect, an Area may be used to invoke a cluster of zone groups and / or zones that share one or more zones and / or zone groups of another cluster. In another aspect, this differs from a zone group, which does not share a zone with another zone group. Further examples of techniques for implementing Areas may be found, for example, in U.S. Application No. 15 / 682,506 filed August 21, 2017 and titled “Room Association Based onName,” and U.S. Patent No. 8.483,853 filed September 11, 2007, and titled “Controlling and manipulating groupings in a multi-zone media system.” Each of these applications is incorporated herein by reference in its entirety. In some embodiments, the media playback system 100 may not implement Areas, in which case the system may not store variables associated with Areas.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO III. Example Playback Devices with Integrated Projection Assembliesa. Audiovisual Media Playback Device Overview

[0094] Examples of the present technology include audiovisual media playback devices configured to play back audio content via on-board audio transducers and / or video content via on-board projection assemblies. As described in more detail below, in some implementations such playback devices are capable of being placed in multiple different orientations (e.g., in a first orientation in front of and below a projection surface, and in a second opposite orientation (inverted with respect to the first orientation) in front of and above a projection surface (e.g., mounted to the ceiling). In certain examples, the playback devices are configured to be oriented at an orthogonal angle (e.g., a vertical orientation) and / or oblique angle relative to the first and / or second orientations. In some examples, the media playback system can adaptively modify audio and / or video playback based on the determined orientation to provide an improved user experience.

[0095] Figure 2 shows a schematic block diagram of a media playback system 200 in accordance with examples of the present technology. In some implementations, the media playback system 200 includes one or more network devices, spatial computing devices, extended reality devices, and / or media playback devices 202 (shown as media playback devices 202a and 202b) configured to receive and output audiovisual content. In some implementations, each media playback device 202 comprises a housing 210 that carries various components including a projection assembly 204, audio transducer(s) 214, and other electronic and mechanical components described in further detail below. In other examples, the audio transducers 214 are omitted.

[0096] The projection assembly 204 includes one or more light sources 206 (referred to as a light source 206 for simplicity) and one or more optical elements 208. In some implementations, the light source 206 comprises a solid-state light source such as a laser or LED array. The optical elements 208 can include various components such as lenses, mirrors, fdters, and other elements configured to direct and shape light from the light source 206 to form projected images. In some implementations, the projection assembly 204 comprises an ultra-short throw projector configured to project video content at an acute angle relative to a projection surface. Additionally or alternatively, the optical elements 208 can be configurable between different positions or orientations to accommodate different mounting positions of the media playback device 202.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0097] In various implementations, the projection assembly 204 can be configured to operate in various projection configurations including ultra-short throw, short throw, and standard throw configurations. These configurations can be characterized by different throw ratios, which represent the relationship between the projection distance (the distance from the projector to the projection surface) and the width of the projected image.

[0098] In some implementations, the projection assembly 204 can be configured as an ultra-short throw projector having a throw ratio of less than about 0.5, meaning the projection distance can be less than half the width of the projected image. For instance, the projection assembly 204 can project a 100-inch diagonal image from a distance of approximately 50-60 centimeters from the projection surface. Ultra-short throw configurations can utilize specialized optical elements 208 such as aspheric mirrors or lenses to achieve accurate image formation at extreme angles relative to the projection surface.

[0099] In other implementations, the projection assembly 204 can be configured as a short throw projector with a throw ratio between about 0.5 and 1.0. Short throw configurations can achieve larger image sizes from relatively close distances while potentially using simpler optical arrangements compared to ultra-short throw configurations. Additionally or alternatively, the projection assembly 204 can be configured as a standard throw' projector with a throw' ratio greater than about 1.0, allowing for placement at greater distances from the projection surface.

[0100] In some implementations, the optical elements 208 can be configurable to switch between different throw ratio configurations. For example, the optical elements 208 may include movable or adjustable components that can modify the optical path to achieve different throw ratios. The media playback device 202 can adjust these components based on factors such as installation requirements, room dimensions, or user preferences. Additionally or alternatively, different media playback devices 202 can be manufactured with different throw ratio configurations while maintaining other features and capabilities described herein.

[0101] The flexibility to accommodate different throw ratios allows the media playback device 202 to be installed in various configurations while maintaining coordinated audiovisual playback capabilities. For example, a media playback device 202 in an ultra-short throw configuration may be particularly suitable for placement on a credenza or ceiling-mounting close to a wall, while a standard throw configuration may be more suitable for ceiling-mountingAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO in the center of a room where it can also serve as a down-firing height speaker for a home theater system.

[0102] In some implementations, the projection assembly 204 can be configured to project various types of images beyond traditional two-dimensional projection. In some examples, for instance, the projection assembly comprises an extended reality (e.g., mixed reality) projection system. In some XR scenarios, the optical elements 208 can include components configured to generate holographic images that appear to float in three-dimensional space in front of, behind, or adjacent to the projection surface 402. In some implementations, the media playback device may incorporate advanced holographic projection technology similar to the Proto holographic device. This technology allows for the creation of volumetric, three-dimensional content that appears to float in space without requiring viewers to wear special glasses or headsets. The system projects light onto a specially designed reflective surface that creates the illusion of depth and dimension, enabling lifelike representations of objects, people, or abstract visuals that can be viewed from multiple angles.

[0103] Additionally or alternatively, the projection assembly 204 can include optical elements configured to create autostereos copic (glasses-free) three-dimensional images, volumetric displays, or other forms of three-dimensional visual content. The light source 206 and optical elements 208 can be arranged to enable multiple viewing angles for three-dimensional content, potentially allowing different viewers to observe different perspectives of the projected content based on their viewing position. In some implementations, the projection assembly 204 can switch between different projection modes, such as transitioning between traditional two-dimensional projection and three-dimensional image projection based on content type or user preferences.

[0104] The audio transducers 214 can be arranged on and / or within the housing 210 in various configurations to output multi-channel audio content. In some implementations, the audio transducers 214 include multiple transducers configured to output different audio channels, such as left, right, center, and height channels of immersive audio content. The arrangement and channel assignments of the audio transducers 214 can be adjusted based on the orientation of the housing 210. For example, when the housing 210 is inverted from a first orientation to a second orientation, the media playback device 202 can reassign audio channels among the transducers 214 to maintain desired audio imaging. Additional details and examples regarding adjusting playback based on orientation can be found in U.S. Patent No. 9,042,556,Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO issued May 26. 2015 and titled ‘“Shaping Sound Responsive to Speaker Orientation." which is hereby incorporated by reference in its entirety for all purposes.

[0105] In some implementations, the arrangement of audio transducers within the housing 210 can be configured to utilize acoustic coupling with nearby surfaces to enhance audio reproduction characteristics. The transducers 214 can be oriented to direct audio output toward or away from surfaces such as walls or the projection surface 402 based on desired acoustic effects. In some implementations, audio output that couples with room surfaces can create a more spacious perceived sound field compared to direct audio radiation. For example, one or more transducers can be oriented to direct center channel content toward a front wall or projection surface 402, which may result in a broader, more spacious presentation of dialog and other center-anchored content. Additionally or alternatively, transducers can be configured to bounce audio output off multiple surfaces sequentially - for instance, directing sound toward a side wall that then reflects toward a ceiling - to create complex sound paths that enhance perceived spaciousness.

[0106] The media playback device 202 can analyze room characteristics to optimize acoustic coupling effects. In some implementations, the sensors 224 can detect the distance to nearby surfaces, surface materials and properties, and room dimensions. Based on the detected characteristics, the media playback device 202 can adjust parameters such as transducer orientation, audio processing, and channel assignment to achieve desired acoustic coupling effects. In some configurations, such as ceiling mounting, the media playback device 202 can take advantage of typically unobstructed acoustic paths to implement more predictable surface coupling compared to configurations where furniture or other objects may interfere with sound propagation. The ability to selectively utilize acoustic coupling through transducer arrangement and orientation provides additional flexibility in creating desired sound fields beyond direct audio radiation. Additional details regarding detection of environmental characteristics and / or corresponding adjustments to audio playback can be found in International Patent Publication No. WO 2025 / 014856, published February 13, 2025 and titled “Height Audio Adjustment Based on Listening Environment Characteristics." which is hereby incorporated by reference in its entirety for all purposes.

[0107] The media playback device 202 includes various interfaces for receiving audiovisual content, including an HDMI A / V input 216 and one or more network interfaces 218. While the illustrated example of Figure 2 indicates a single HDMI A / V input 216. in other examples, theAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO media playback device 202 includes a plurality of HDMI inputs 216 and / or HDMI outputs. Through these interfaces (and / or other interfaces), the media playback device 202 can receive content from remote content services 220 (e.g., streaming services) and / or local audiovisual content sources 222 (e.g., Blu-ray players, gaming consoles, etc.). The network interfaces 218 can include both wired and wireless interfaces to facilitate communication with other devices in the media playback system 200.

[0108] In some implementations, a suitable user interface (e.g., a graphical user interface) can be presented to a user via the projection assembly 204 for requesting and controlling playback of audiovisual content. The subject matter of U.S. Patent Application Publication No.2023 / 0131674. published April 27, 2023 and titled “Cloud-Based Video User interfaces” is hereby incorporated by reference herein in its entirety. The techniques for displaying cloudbased user interfaces via playback devices, as disclosed therein may be implemented by the media playback device 202 to provide user interface capabilities through the projection assembly 204.

[0109] The subject matter of U.S. Patent Application Publication No. 2023 / 0403424, published December 21, 2023 and titled “Wireless Streaming of Audio / Visual Content and Systems and Methods for Multi-Display User Interactions” is hereby incorporated by reference herein in its entirety. The techniques for displaying primary content via a projector while displaying corresponding secondary content via a second screen, as disclosed therein may be implemented by the media playback device 202 in coordination with one or more control devices 130 to provide enhanced content display capabilities. Moreover, the ‘424 publication describes techniques involving display devices that can coordinate and switch among multiple HDMI inputs.

[0110] The media playback device 202 includes one or more sensors 224 configured to detect various characteristics of the device and its environment. In some implementations, the sensors 224 include orientation sensors (e.g., accelerometers, gyroscopes, inertial measurement units) configured to detect an orientation of the housing 210 with respect to gravity. Additionally or alternatively, the sensors 224 can include proximity sensors, ambient light sensors, temperature sensors, microphones, image sensors, and / or other sensors configured to detect environmental conditions that may affect audiovisual playback. As discussed in more detail below, the media playback device 202 can adjust various playback parameters based on data from the sensors 224.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO [oni] The subject mater of U.S. Patent Application Publication No. 2024 / 0103799, published March 28, 2024 and titled “Immersive Audio Experiences Based on Visual Content or Objects” is hereby incorporated by reference herein in its entirety. The techniques for receiving an indication of a physical object or media item and displaying corresponding visual content via a video playback device, as disclosed therein may be implemented by the media playback device 202 to generate and project visual content corresponding to detected objects or media items in the environment (e.g., as detected via sensors 224).

[0112] Stabilization components 226 are configured to reduce or eliminate vibrations that might affect video projection quality. In some implementations, the stabilization components 226 include mechanical and / or electronic vibration isolation elements configured to isolate the projection assembly 204 from vibrations caused by operation of the audio transducers 214. In some instances, the stabilization components 226 can operate predictively by analyzing upcoming audio content to identify potential vibration-inducing content (e.g., bass frequencies) and adjusting isolation parameters accordingly. In some implementations, the stabilization components 226 can include active optical image stabilization elements similar to those found in camera systems.

[0113] The media playback device 202 additionally includes generative content components 230 configured to generate content, such as supplemental visual content. In some implementations, the generative content components 230 can include one or more machine learning models, generative models, and Al models and techniques to enhance its functionality. These models, which are provided merely as examples and alternatives rather than being required, can include Supervised Learning Models such as Linear Regression, Logistic Regression, Support Vector Machines (SVM), Decision Trees, Random Forests, Gradient Boosting Machines (GBM), and Neural Networks (including Convolutional Neural Networks - CNNs, Recurrent Neural Networks - RNNs, and Long Short-Term Memory - LSTM networks). The media playback device (202) can also utilize Unsupervised Learning Models such as K-Means Clustering, Hierarchical Clustering, Principal Component Analysis (PCA), and Autoencoders. Reinforcement Learning Models, such as Q-leaming, SARSA, and Deep Reinforcement Learning (DRL), may be employed as well. Various Generative Models can be used, including Variational Autoencoders (VAEs) for generating new data points similar to the training data; Generative Adversarial Networks (GANs), such as Deep Convolutional GANs (DCGANs), StyleGANs (e.g., for image generation with style control), and CycleGANs (e.g.,Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO for image-to-image translation); Diffusion Models, such as Denoising Diffusion Probabilistic Models (DDPMs) and Score-Based Generative Models; Large Language Models (LLMs), such as Transformer-based models (e.g., BERT, GPT) and Seq2Seq models; and other generative models like Markov Chains and Hidden Markov Models (HMMs). Additionally, the media playback device (202) can incorporate Al Models and Techniques such as Natural Language Processing (NLP) Models, including Text classification models, Named Entity Recognition (NER) models, Sentiment analysis models, and Machine translation models; Computer Vision Models, including Object detection models (e.g., YOLO, Faster R-CNN), Image segmentation models, and Image classification models; Time Series Models, including ARIMA and LSTM-based time series forecasting; Hybrid Models combining different types of models for complex tasks; and Al Agents, including Rule-based agents, Model-based agents, and Learning agents. These models and techniques may be implemented individually or in combination to provide diverse generative features, ranging from predictive modeling to advanced content generation and intelligent agent behavior.

[0114] The generative content components 230 can generate visual content corresponding to audio being played back through the media playback device 202, such as generating visualizations for music being played from a turntable or other audio source. The generated content can be output via the projection assembly 204. Additionally or alternatively, the generative content components 230 can generative audio content based on one or more input parameters. Moreover, in some examples the generative content components 230 can output audiovisual content (generating both audio and visual components), tactile content, text content, or any other suitable generative content to be output via the media playback device 202 or other devices communicatively coupled to the media playback device 202.

[0115] In some examples, for instance, one or more Large Language Models (LLMs) can be employed to generate real-time captions or subtitles in multiple languages, adapting to the audio content being projected. This feature can significantly enhance accessibility and cater to diverse audiences. Furthermore, LLMs can analyze scripts or storyboards and suggest corresponding visuals, sound effects, and even background music to complement the projected content. This capability can greatly assist in pre-production planning and live event scenarios.

[0116] In some examples, one or more generative models (e.g., LLMs, GANs, and / or diffusion models) can be utilized to create high-resolution images and videos optimized for projection. These models and / or other models can upscale existing content, fill in missingAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO details, and / or generate novel visual elements based on user prompts or contextual information. For instance. Al-driven upscaling techniques may involve trained model(s) that analyze low-resolution content and generate high-resolution versions with enhanced detail. This can, in some cases, facilitate an enhanced visual quality / resolution of older or lower-quality content on large projection surfaces. In some examples, immersive and / or special effects can be added in real-time (with or without regard to upscaling).

[0117] In some examples, one or more Al agents can automate routine tasks such as adjusting projector settings based on ambient lighting conditions, optimizing keystone correction, and managing content playback. These agents can also learn user preferences and tailor the projection experience accordingly, such as automatically selecting preferred content or adjusting projection parameters for different types of media. Moreover, one or more Al agents can monitor the projection system's performance, detect potential issues, and / or perform predictive maintenance to minimize downtime. By analyzing sensor data and / or usage patterns, for instance, these agents can identify anomalies, diagnose problems, and suggest necessary repairs or replacements. This proactive approach can facilitate smooth operation of projection systems, potentially reducing maintenance costs.

[0118] Further, generative models and / or Al agents can enhance interactive projection experiences. For example, one or more Al agents can process user input, such as voice commands or gestures, and generate corresponding visual responses in real-time. This can enable users to interact with projected content in a more natural and intuitive way, creating engaging and immersive experiences for various applications, including education, entertainment, and presentations. In some examples, generative models and / or Al agents can be used to generate content adaptively. For instance, if the system knows that a presenter is running short on time, it can automatically generate a shortened version of a presentation. Or, if the system 200 detects that the audience is losing interest (e g., via one or more sensors that track eye gaze, facial expressions, body language), interactive content, like a poll or quiz, can be generated to perhaps regain attention.

[0119] The media playback device 202 also includes wireless power components 232 configured to participate in wireless power transfer. In some implementations, the wireless power components 232 can transmit power to an external receiver device 234 and / or receive power from an external transmitter device 236. This capability may be useful when the media playback device 202 is mounted in locations where traditional power connections may beAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO difficult to access. Additionally or alternatively, this capability can allow the media playback device 202 to serve as a power hub, providing wireless power to a plurality of devices within the environment.

[0120] Other electronics 228 can include various components such as processors, memory7, software components, audio processing components, amplifiers, and additional power components. In some implementations, the other electronics 228 can include microphones and voice processing components for receiving and processing voice commands. The other electronics 228 can also include components for processing and routing audio and video signals, managing device coordination, and / or controlling various aspects of device function.

[0121] In operation, the media playback device 202 can communicate and coordinate with various other devices including one or more audio playback devices 110 and extended reality (XR) playback devices 238. For example, the media playback device 202 can form a bonded zone with one or more audio playback devices 110 for synchronized audio playback, or cause two or more of the audio playback devices 110 to form a bonded zone without the media playback device 202 itself necessarily joining the bonded zone. The media playback device 202 can also coordinate with XR playback devices 238 to create enhanced audiovisual experiences that include extended reality (XR) content (e.g., virtual reality, augmented reality, mixed reality, or any other suitable XR content). In some examples, for instance, projected content from the media playback device 202 is combined with XR content. Multiple media playback devices (e.g., 202a and 202b) can coordinate to provide enhanced capabilities, such as projecting different portions of a combined video image while also providing synchronized audio playback. In various implementations, audio output can be generated for and / or modified in view of XR visual content. Additional details regarding generating spatial audio based on position and / or orientation of a displayed XR virtual scene and positions of nearby playback devices can be found in: (i) U.S. Patent No. 11,483,670, issued October 25, 2022, titled “Systems and Methods of Providing Spatial Audio Associated with a Simulated Environment,” and (ii) U.S. Provisional Application No. 63 / 758,580, filed February 14, 2025 and titled “Agentic Control of Media Playback Systems” (also included as Appendix A to this application), each of which is hereby incorporated by reference in its entirety.

[0122] In some implementations, the media playback device 202 includes light control components configured to coordinate operation with one or more light sources in an environment. The sensors 224 can include, for example, one or more ambient light sensorsAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO configured to detect light levels and characteristics at various locations, including areas near or on the projection surface 402. As those of ordinary skill in the art will appreciate, however, the use of ambient light sensors may present certain challenges. For instance, ambient light sensors may vary' in accuracy and may require calibration to provide consistent readings. Factors such as sensor placement, angle, and sensitivity can affect the measurements. Ambient light can vary dramatically, from very dark to very bright conditions, and sensors need a wide dynamic range to accurately measure these extremes. If a sensor saturates in bright light or fails to detect subtle changes in dim light, it can limit the system's ability' to optimize projection and lighting. Additionally, certain ambient light sensors may only measure overall intensity and not the color temperature, which can affect how colors appear on the projected image, potentially leading to suboptimal color balance adjustments. Further, ambient light can create reflections and glare on the projection surface, which can interfere with the projected image. In some cases, sensors might not always accurately differentiate between ambient light and reflected light from the projector itself, leading to incorrect adjustments. In many environments, there are multiple light sources (e.g., lamps, windows, overhead lights) with varying intensities and color temperatures. Sensors might provide an averaged reading that doesn't accurately represent the light conditions across the entire projection surface.

[0123] Accordingly, in some examples, the system 200 may include multiple ambient light sensors (not shown) placed at one or more locations on the media playback device 202 and / or other devices in the same environment. Moreover, the one or more ambient light sensors may measure both intensity and color temperature. Based on the detected light conditions, the media playback device 202 can automatically adjust both projection parameters and environmental lighting to optimize viewing conditions. In some examples, for instance, the media playback device 202 and / or the system 200 may employ a generative Al model (e.g., one or more of the generative content components 230), and / or one or more suitable models, algorithms, etc. that can modify sensor data to fdter out noise and reflections, leam and adjust to the specific room and lighting conditions, and / or user calibration options to fine-tune the system's response.

[0124] In some examples the media playback device 202 communicates with networked light sources via the network interfaces 218. In some implementations, the network interfaces 218 establish communication with smart lighting systems using protocols such as WiFi, Zigbee, Z-Wave, Bluetooth, or other suitable communication standards. The media playback device 202 can transmit commands to adjust brightness levels, turn lights on or off, change colorAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO temperature, change color, and / or modify other lighting parameters of individual light sources or groups of light sources. For example, upon initiating video projection, the media playback device 202 can automatically reduce or deactivate ceiling-mounted light sources that might otherwise interfere with the projected image on the projection surface 402.

[0125] In some implementations, the media playback device 202 maintains data regarding the location and characteristics of light sources within the environment. The media playback device 202 can selectively control different light sources based on their position relative to the projection surface 402 and current projection parameters. For instance, the media playback device 202 may maintain full illumination from light sources that do not significantly impact image contrast while dimming only those lights that would materially degrade projection quality. The media playback device 202 can also adjust projection parameters such as brightness, contrast, and color balance in coordination with light control operations to maintain optimal image qualify as ambient lighting conditions change. In some examples, the data regarding location(s) and characteristics of light sources are stored in a distributed ledger, such as a blockchain. In some examples, the blockchain comprises a local blockchain distributed among one or more devices on a local network (e.g., the network 104 of Figure IB) such as the media playback device 202 and perhaps additional playback devices (e.g., one or more of the playback devices 110 of Figures 1A and IB). This data and other suitable devices can be stored in a content network record set (CNRS) that includes data regarding devices, platforms, content services, and so forth that form one or more users’ overall ecosystem of content consumption. Additional details regarding reading data from and / or writing data to block chains (including local blockchains, public blockchains, semi-public permissioned blockchains, etc.), a CNRS, and generative control of devices and systems can be found in International Patent Publication No. WO 2025 / 029673, published February 6, 2025 and titled "Systems and Methods for Maintaining Distributed Media Content History and Preferences,” which is hereby incorporated by reference in its entirety for all purposes.

[0126] The light control components can include machine learning models (e.g., one or more generative Al models) trained to recognize different viewing scenarios and apply corresponding lighting configurations. In some implementations, the models analyze factors such as content type (e.g., movies, sports, gaming), time of day, room occupancy, and user preferences to automatically adjust both projection and lighting parameters. The mediaAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO playback device 202 can store multiple lighting presets corresponding to different use cases and smoothly transition between presets based on detected conditions or user input.

[0127] Additionally or alternatively, the light control components can operate predictively by analyzing upcoming content to anticipate lighting adjustment needs (e.g., via one or more machine learning models such as one or more of the generative Al models and / or Al agents described above). For example, the media playback device 202 can detect scene transitions in video content that may benefit from corresponding changes in ambient lighting. When transitioning from a bright outdoor scene to a dark indoor scene, the media playback device 202 can adjust room lighting in coordination with the content to enhance the viewing experience while maintaining comfortable ambient light levels.

[0128] Figures 3A and 3B illustrate perspective and end views, respectively, of an example media playback device 302 (e.g., one or more of the playback devices 110a-l 10b of Figure IB and / or the media playback device 202 of Figure 2) configured in accordance with examples of the present technology. In the illustrated implementation, the media playback device 302 has an elongated housing similar to that of a soundbar. However, in other implementations as described above and in further detail below, the media playback device 302 can take other forms such as a credenza-mounted device, a subwoofer-sty le enclosure, a portable device, or another suitable form factor.

[0129] The media playback device 302 can include multiple audio transducers (not shown) arranged within the housing to output audio content along various sound axes. A forward sound axis Al extends normal to a front surface of the device 302 in a horizontal direction. A side sound axis A2 extends perpendicular to the forward sound axis Al and parallel to a longitudinal axis of the device 202. An intermediate side axis A3 is oriented horizontally between the side axis A2 and the forward axis Al. In some implementations, audio output along the side axis A2 and / or intermediate side axis A3 can be configured to reflect off nearby surfaces (e.g., walls) before reaching a listener position to create expanded soundfield effects.

[0130] The media playback device 302 additionally defines a vertical sound axis A4 oriented upward from the device 302. In some implementations, audio output along the vertical axis A4 can be configured to reflect off an overhead surface (e.g., a ceiling) before reaching a listener position to create height channel effects for immersive audio content. The assignment of audio channels to transducers corresponding to the various sound axes A1-A4 can be adjusted basedAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO on factors such as the orientation of the device 302, nearby surfaces, room characteristics, and listener position.

[0131] A video projection axis VI extends rearwardly and upwardly relative to the housing of device 302. In some implementations, the video projection axis VI can be adjusted via one or more moveable components of the projection assembly 204 (Figure 2). For example, the optical elements 208 may include adjustable mirrors, lenses, or other components that can modify the video projection axis V 1 to accommodate different mounting positions or projection surface locations. The ability to adjust both the video projection axis VI and audio channel assignments allows the media playback device 302 to maintain coordinated audiovisual playback in various orientations and configurations.

[0132] The projection assembly 204 projects video content along the video projection axis VI, which in some implementations corresponds to a centerline of the projected image on a projection surface 402 (Figure 4). The video projection axis VI can be defined as an imaginary line extending from the center of the light output of the projection assembly 204 to the center point of the projected image on the projection surface 402. In some implementations, one or more of the optical elements 208 are configured to adjust the angle of the video projection axis VI relative to a horizontal plane.

[0133] The angle of the video projection axis V 1 relative to horizontal can vary based on the specific configuration of the projection assembly 204. In implementations where the projection assembly 204 is configured as an ultra-short throw projector, the video projection axis VI may form an angle between approximately 45 degrees and 15 degrees relative to horizontal when the housing 210 is in the first orientation (positioned on a horizontal surface). This relatively steep angle enables the projection assembly 204 to create a large image from a position close to the projection surface 402 (e.g., within 50-60 centimeters). When the housing is in the second orientation (mounted to a ceiling), the video projection axis VI may form an angle between approximately -45 degrees and -15 degrees relative to horizontal for ultra-short throw7configurations.

[0134] In implementations where the projection assembly 204 is configured as a short throw projector, the video projection axis VI may form an angle between approximately 15 degrees and 5 degrees relative to horizontal in the first orientation, or between approximately -15 degrees and -5 degrees in the second orientation. For standard throw configurations, the video projection axis VI may form a shallower angle, typically between approximately 5 degrees andAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO 0 degrees relative to horizontal in the first orientation, or between approximately -5 degrees and 0 degrees in the second orientation. The specific angle in any configuration may be adjusted based on factors such as desired image size, distance to the projection surface 402, and mounting height of the media playback device 202.

[0135] In some implementations, the elongated housing of the media playback device 302 facilitates placement of audio transducers to achieve desired sound radiation patterns while also accommodating the projection assembly. The housing can be configured for placement on a horizontal surface (e.g., a credenza or table) or mounting to a vertical or overhead surface (e.g., a wall or ceiling) while maintaining both audio and video playback capabilities.b. Modifying Audio and / or Video Playback Based on Device Orientation

[0136] Figures 4A and 4B illustrate example arrangements of the media playback device 202 (Figure 2) within an environment in accordance with aspects of the present technology. The projection surface 402 (e.g., a wall, screen, or other suitable surface) is positioned, arranged and / or configured to display video content projected by the media playback device 202. A listener position 404 represents a location from which a user may experience the audiovisual content output by the media playback device 202.

[0137] Figure 4A shows the media playback device 202 in a first mode, configuration, or orientation where the device rests on a horizontal surface (e.g., a credenza, table, or stand) positioned below the projection surface 402. In this first orientation, the projection assembly of the media playback device 202 projects video content along video projection axis VI, which extends upwardly and rearwardly toward the projection surface 402. In some implementations where the projection assembly comprises an ultra-short throw projector, the video projection axis VI may form an acute angle with the projection surface 402 to achieve a large image size from a relatively close distance.

[0138] Figure 4B shows the media playback device 202 in a second mode, configuration, or orientation where the device is mounted above the projection surface 402 (e.g., mounted to a ceiling). In this second orientation, the video projection axis VI extends downwardly and rearwardly toward the projection surface 402. The media playback device 202 can detect this inverted orientation (e.g., via one or more sensors 224 as shown in Figure 2) and adjust various parameters of both video projection and audio output accordingly.

[0139] In the first orientation (Figure 4A), the audio transducers within the media playback device 202 can be configured to output various audio channels according to default channelAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO assignments. For example, upward-firing transducers can output height channel content that reflects off a ceiling before reaching the listener position 404, creating an immersive audio effect. Forward-firing and side-firing transducers can output other channels (e.g., left, right, and center channels) toward the listener position 404 either directly or via reflection off nearby surfaces.

[0140] When the media playback device 202 is mounted in the second orientation (Figure 4B), the device detects the inverted position and adjusts both video and audio output parameters. For video content, the media playback device 202 can modify parameters such as keystone correction, image orientation, and focus to maintain proper image display on the projection surface 402. These adjustments can be performed automatically upon detecting the change in orientation.

[0141] In some examples, one or more machine learning models, algorithms, generative Al models, and / or Al agents on the device 202 and / or the system 200 can perform at least a portion of the keystone correction. As those of ordinary skill in the art will appreciate, keystone correction beyond a threshold angle may, in some cases, cause a loss of resolution. An Al model or agent, for instance, trained to correct for any distortion associated with inverting the device 202.

[0142] Figure 4C illustrates a method 450 for implementing Al-based keystone correction in a media playback device, divided into two main phases: a Training Phase and a Deployment Phase. In the Training Phase, the process begins at block 452 with collecting training data, which involves creating a dataset of image pairs. Each pair includes a distorted image captured from an inverted projector at varying angles and distances, and a corresponding corrected image obtained through manual or algorithmic keystone correction. These datasets incorporate variations in the degree of inversion and tilt, projection surfaces (e.g., flat, curved, angled), image content (e.g., text, graphics, video), and different projector models with their unique optical characteristics. Metadata, such as the projector's orientation and distance to the screen, can be recorded for each image to aid the Al model in learning the relationship between these parameters and necessary corrections.

[0143] At block 454, the system generates these image pairs that serve as the foundation for training the Al model. Block 456 represents the training of the model, where a Convolutional Neural Network (CNN), such as a U-Net architecture, processes the dataset. CNNs are particularly suitable for image processing and image-to-image translation tasks, effectivelyAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO capturing both local and global image features relevant to keystone correction. During this training, a loss function — which may include Mean Squared Error (MSE), Structural Similarity Index (SSIM), or Perceptual Loss — quantifies the difference between the model's corrected output and the ground truth corrected image. The training process involves inputting distorted images into the CNN, processing them to output a corrected version, calculating the loss, and backpropagating to adjust the CNN's weights iteratively until performance converges.

[0144] Block 458 represents validation of the model's performance, followed by a decision point 460 where the system determines if performance meets acceptable thresholds. The model can be evaluated using metrics like Peak Signal-to-Noise Ratio (PSNR), Structural Similarity Index (SSIM), and visual inspection. If performance is inadequate, the process flows to block 464 to refine the model architecture or hyperparameters before returning to the training stage. These refinements might include adjustments to the model architecture, hyperparameter tuning, or collecting more training data.

[0145] To enhance the model, geometric knowledge can be incorporated by explicitly feeding geometric parameters like projector tilt angle and rotation as additional inputs, and / or by adding geometric loss terms to encourage geometrically accurate transformations, such as preserving straight lines. Data augmentation techniques, such as random rotations, translations, scaling, noise addition, blurring, and simulated lighting variations, can be applied to improve robustness, and regularization methods like dropout or weight decay may be used to prevent overfitting.

[0146] Beyond basic CNNs and U-Nets, alternative neural network architectures can be considered. For instance, Generative Adversarial Networks (GANs) could be explored for generating more visually appealing corrected images. Transformers, especially Vision Transformers (ViTs), could offer advantages in capturing long-range dependencies within the image. For embedded systems with limited resources, computationally efficient CNN architectures such as MobileNets or EfficientNets might be favored, even if they offer slightly less accuracy compared to larger models.

[0147] Additionally, advanced loss functions could be incorporated beyond standard options. For example, a Content Loss focusing on preserving the semantic content of the image, or an Adversarial Loss to encourage the generated corrected images to be indistinguishable from real corrected images, could be beneficial. Edge Loss could be used to specifically encourage sharpAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO and well-defined edges in the corrected image, which is particularly important for text and graphics.

[0148] Once performance is deemed acceptable, the process proceeds to block 462 where the trained model is saved for deployment. To achieve real-time performance in the deployment phase, various optimization techniques can be employed. Model quantization (reducing the precision of model weights and activations) and model pruning (removing less important connections in the network) can significantly reduce computational cost and memory footprint without drastically impacting accuracy. Hardware acceleration using dedicated Al chips or GPUs within the projector could also be implemented. Furthermore, techniques like model distillation, where a smaller, faster "student" model is trained to mimic the behavior of a larger, more accurate "teacher" model, can be effective.

[0149] The Deployment Phase begins at block 466, where the system determines keystone correction needs based on the current configuration of the media playback device. At block 484, the system loads the previously trained model from the Training Phase. The system then captures a potentially distorted image at block 468. which is processed through the Al model at block 470 to generate keystone correction parameters. At block 472, the system applies these corrections to produce a properly aligned projection.

[0150] The system continuously monitors the environment at block 474, implementing an adaptive approach to keystone correction. An Al agent could continuously monitor the projected image and environment through built-in sensors and dynamically adjust the keystone correction model parameters or even switch between different models based on detected changes in projector orientation, screen surface, or ambient lighting conditions. This adaptive approach provides optimal keystone correction even in dynamic and unpredictable environments.

[0151] At decision point 476, the system determines if the projector's orientation has changed. If no change is detected, monitoring continues; if a change is detected, the process flows to block 478 where the system detects the new projector orientation before returning to block 466 to determine updated keystone correction needs.

[0152] In some embodiments, the system could incorporate user feedback to refine the keystone correction. For instance, a user interface could allow users to subtly adjust the automatically corrected image or provide feedback on specific areas that are not corrected toAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO their satisfaction. This user feedback could be used to further fine-tune the Al model or to personalize the correction for individual user preferences.

[0153] This method enables the media playback device to automatically adjust for keystone distortion without manual intervention, particularly when transitioning between different mounting orientations. The Al-based approach can handle complex distortion patterns more effectively than traditional geometric correction methods, providing optimal image quality regardless of the device's physical positioning, while ensuring generalization to unseen images and projector orientations through a diverse dataset.

[0154] For audio content, the media playback device 202 can reassign audio channels among the transducers to maintain desired audio imaging despite the inverted orientation. For example, in the second orientation, transducers that previously output height channel content upward would now face downward toward the listening area. Accordingly, as described in more detail below with respect to Figure 6, the media playback device 202 can reassign height channel content to different transducers (e.g., forward firing and / or side-firing transducers) to maintain appropriate spatial audio reproduction. The device can similarly adjust assignments of other audio channels (e.g., left, right, and center channels) to facilitate proper audio imaging relative to the listener position 404. For instance, in some examples, the center channel audio can be re-assigned to the downward firing transducers in the second orientation (which are upward-firing in the first orientation).

[0155] In some implementations, the media playback device 202 can also modify audio processing parameters based on the detected orientation. For example, the device can adjust equalization, phase relationships, and / or other audio characteristics to optimize sound reproduction for the current orientation. These adjustments can take into account factors such as the distance to nearby surfaces, room acoustics, and listener position to maintain a consistent listening experience regardless of device orientation.

[0156] The ability to function effectively in multiple orientations allows the media playback device 202 to accommodate various installation requirements while maintaining high-quality audiovisual playback. In some implementations, the media playback device 202 can also coordinate with other playback devices to create enhanced audiovisual experiences, with the coordination taking into account the orientation of each device involved.

[0157] In some implementations, a ceiling-mounted configuration of the media playback device 202 (as depicted in Fig. 4B) can provide several acoustic advantages compared to otherAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO mounting locations. Ceiling mounting can enable, for instance, more predictable and consistent acoustic coupling with room surfaces due to typically unobstructed sound propagation paths between the device and primary reflective surfaces. Unlike wall-mounted or furniture-placed configurations where objects such as cabinets, chairs, or other furniture may obstruct or unpredictably reflect sound waves, ceiling mounting often provides clear acoustic paths for both direct sound radiation and intentional surface reflections.

[0158] In some implementations, the media playback device 202 can take advantage of unobstructed (or less obstructed) paths to create more precise and controlled sound fields. For example, when mounted to a ceiling, side-firing transducers can more reliably utilize wall reflections to create expanded soundstage effects since furniture placement is less likely to interfere with the intended reflection paths. Additionally or alternatively, downward-firing transducers can more consistently reach listener positions without interference from room objects that might otherwise block or diffract sound waves from lower mounting positions.

[0159] The sensors 224 and / or one or more other sensors on other devices (not shown) can analyze room characteristics to enhance acoustic output based on the ceiling-mounted position. In some implementations, the sensors 224 detect the presence and location of potential acoustic obstacles within the room, allowing the media playback device 202 to adjust audio processing parameters to compensate for or work around such obstacles. The media playback device 202, in some examples, can also measure acoustic responses at different frequencies and adjust equalization, phase relationships, and other parameters to take advantage of the consistent acoustic paths provided by ceiling mounting.

[0160] In certain implementations, the unobstructed acoustic environment enabled by ceiling mounting allows the media playback device 202 to implement sophisticated beam-forming and spatial audio processing techniques known to those of ordinary skill in the art. Without nearby obstacles to create unexpected early reflections or diffractive effects, the media playback device 202 can more accurately control sound propagation patterns to create precisely positioned virtual sound sources or optimize acoustic coverage of the listening area.

[0161] Figures 5 A and 5B illustrate example audio channel assignments for a media playback device 202 mounted in an inverted orientation (e g., mounted to a ceiling above a projection surface) in accordance with aspects of the present technology. The figures show various audio channel outputs represented by directional arrows, where “L” indicates a left channel, “R” indicates a right channel, C indicates a center channel, and “H” indicates a height channel.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0162] Figure 5A illustrates a first channel assignment configuration that occurs before orientation-based adjustment. Because the media playback device 202 is inverted from its standard orientation, the default channel assignments result in improperly oriented audio output. For example, the left channel (L) and right channel (R) outputs are reversed relative to a listening position, the center channel (C) is directed along the ceiling rather than toward the listening position, and the height channel (H) is directed downward rather than upward. Without adjustment, this configuration would result in an undesirable listening experience where the spatial audio image is incorrectly positioned.

[0163] Figure 5B illustrates the modified audio channel assignments after adjustment based on the detected inverted orientation. In this adjusted configuration, the media playback device 202 has reassigned the audio channels among its transducers to maintain proper audio imaging. The left channel (L) and right channel (R) outputs have been transposed to provide correct leftright orientation relative to the listening position. The center channel (C) has been reassigned to direct dialog and other center channel content toward the listening position rather than along the ceiling. Additionally, responsibility for reproducing the height channel (H) content has been reassigned from downward-facing transducers to different transducers that can maintain upward sound propagation despite the inverted orientation of the device.

[0164] In some implementations, these channel reassignments can be accompanied by adjustments to various audio processing parameters (e.g., equalization, phase relationships, timing) to optimize the sound reproduction for the inverted orientation. The media playback device 202 can also take into account factors such as room acoustics, nearby surfaces, and listener position when determining the specific parameters for each reassigned channel.

[0165] In some implementations, the media playback device 202 can dynamically adjust array patterns of the audio transducers 214 to target specific locations within a listening environment. The media playback device 202 can include beam-forming capabilities that enable precise control over sound radiation patterns to create focused audio content delivery to different spatial locations such as areas overhead, in front of, or behind listener positions. These array adjustments can be particularly beneficial when the media playback device 202 is mounted in elevated positions, such as on a ceiling, where directed sound paths may need to navigate around physical obstacles.

[0166] The media playback device 202 can employ occlusion routing techniques to enhance sound delivery paths based on one or more parameters, such as room characteristics and listenerAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO positions. In some implementations, for instance, the sensors 224 detect physical objects, furniture, or architectural features that might obstruct direct sound paths to listener locations. Based on the detected obstructions, the media playback device 202 can adjust array patterns to route audio content around these obstacles. For example, when an overhead lighting fixture or ceiling fan might interfere with direct downward sound projection, the array patterns can be adjusted to create alternative sound paths that maintain desired audio imaging at the listening position.

[0167] In some examples, the audio processing components of the electronics 228 can implement real-time array pattern adjustments based on various inputs. In some implementations, the media playback device 202 receives position data from presence sensors or connected mobile devices indicating current listener locations. The array patterns can be dynamically adjusted as listeners move within the environment to maintain optimal sound delivery. Additionally or alternatively, the array patterns can be modified based on the type of content being played back - for instance, creating broader, more diffuse patterns for music playback versus more focused patterns for movie dialogue. Additional details and examples regarding adjusting radiation patterns and / or transfer functions of playback devices based on listener locations and / or objects in the listening environment can be found in U.S. Patent No.9,973,851, issued May 15, 2028 and titled “Multi-Channel Playback of Audio Content,'’ which is hereby incorporated by reference in its entirety for all purposes.

[0168] The media playback device 202 can store multiple array pattern presets corresponding to different playback scenarios and room configurations. In some implementations, these presets are developed during a calibration process where the media playback device 202 measures acoustic responses at various locations while testing different array patterns. The calibration process can include analyzing both direct and reflected sound paths to determine optimal array configurations for different content types and listening positions. The media playback device 202 can smoothly transition between different array patterns by gradually adjusting the relative amplitudes and phase relationships among the transducers 214.

[0169] Additional details regarding adjustment of radiation patterns based on input parameters such as listener location or to otherwise achieve desired acoustic effects can be found in the following patents and publications, each of which is hereby incorporated by reference in its entirety for all purposes: U.S. PatentNo. 9,446,559, issued September 20, 2016 and titled “Speaker Terminals;” U.S. PatentNo. U.S. 9,712,912. issued July 18, 2017 and titledAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO “Manipulation of Playback Device response Using an Acoustic Filter;” and International Patent Publication No. WO 2024 / 073401, published April 4, 2024 and titled “Home theatre Audio Playback with Multichannel Satellite Playback Devices.”

[0170] International Patent Publication No. Wo 2025 / 014856, published February' 13, 2025 and titled “Height Audio Adjustment Based on Listening Environment Characteristics” is hereby incorporated by reference herein in its entirety. The techniques for determining ceiling height using multiple microphone-enabled devices and adjusting audio rendering accordingly, as disclosed therein may be implemented by the media playback device 202 to optimize audio output based on detected room dimensions.

[0171] International Patent Application No. PCT / US2025 / 016329, filed *** and titled “Adjusting Spatial Audio Playback Based on Device Orientation,” is hereby incorporated by reference herein in its entirety, and is included as Appendix B to the present application. The techniques for adjusting audio output of inverted devices with upfiring transducers, as disclosed therein may be implemented by the media playback device 202 to optimize audio output when mounted in an inverted orientation.

[0172] Figures 6 and 7 illustrate example methods 600 and 700 in accordance with the present technology'. The methods 600 and 700 can be implemented by any of the devices described herein, or any other suitable devices now known or later developed. Various embodiments of the methods 600 and 700 include one or more operations, functions, or actions illustrated by blocks. Although the blocks are illustrated in sequential order, these blocks may also be performed in parallel, and / or in a different order than the order disclosed and described herein. Also, the various blocks may be combined into fewer blocks, divided into additional blocks, and / or removed based upon a desired implementation. In some examples, for instance, the methods 600 and 700 are not encoded in software or code, but instead performed spontaneously or extemporaneously by one or more generative media modules (such as the generative content components 230 of Figure 2), one or more generative Al models, one or more Al agents, and / or one or more other suitable machine learning methods.

[0173] In addition, for the methods 600 and 700 and for other processes and methods disclosed herein, the flowchart shows functionality and operation of possible implementations of some embodiments. In this regard, each block may represent a module, a segment, or a portion of program code, which includes one or more instructions executable by one or more processors for implementing specific logical functions or steps in the process. The programAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO code may be stored on any type of computer readable medium such as, for example, a storage device including a disk or hard drive. The computer readable medium may include non-transitory computer readable media, for example, such as tangible, non-transitory computer-readable media that stores data for short periods of time like register memoiy, processor cache, and Random- Access Memory (RAM). The computer readable medium may also include non-transitory media, such as secondary or persistent long-term storage, like read only memory (ROM), optical or magnetic disks, compact disc read only memoiy7(CD-ROM), for example. The computer readable media may also be any other volatile or non-volatile storage systems. The computer readable medium may be considered a computer readable storage medium, for example, or a tangible storage device. In addition, for the methods and for other processes and methods disclosed herein, each block in Figures 6 and 7 may represent circuitry that is wired to perform the specific logical functions in the process.

[0174] Referring to Figure 6, at operation 602, a playback device (e.g., the media playback 202a of Figure 2 and / or the media playback device 302 of Figures 3 A and 3B) receives multichannel audio content, e.g., along with accompanying video content to be played back via the playback device. Accordingly, the playback device may prepare to render one or more audio channels of the multi-channel audio content. In some examples, the playback device receives the multi-channel audio content via a network interface such as the network interface 112d (Figure IC), either via the wireless interface(s) 112e. the wired interface(s) 112f, or perhaps both. In certain examples, the playback device receives the multi-channel audio via a hardware interface such as the input / output 111 (Figure IC). In some examples, the playback device receives the multi-channel audio from a primary7device ( e.g., a playback device such as the playback device I lOh (Figure IK), a local audio source (e.g., the local audio source 105 of Figure IC), and / or a network device such as a mobile device, television, digital streaming device, set-top box, etc.). In some cases, the primary device receives first audio data comprising multi-channel audio content, decodes a portion of the first audio data to generate second audio content and transmits the generated second audio to the playback device. In certain examples, the second audio comprises a downmixed version of a portion of the first audio that the playback device receives and up-mixes to produce the multichannel audio for which it is assigned playback. Further details regarding the distribution of audio among multi-channel devices can be found the following patents, each of which is hereby incorporated by reference in its entirety: U.S. Patent No. 8,788,080. issued on July 22. 2014 and titled "Multi-ChannelAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO Pairing in a Media System;'’ U.S. Patent No. 9,886,234. issued February 8, 2018 and titled “Systems and Methods of Distributing Audio to One or more Playback Devices;” International Patent Publication No. WO 2024 / 073401, published April 4, 2024 and titled ‘'Home Theatre Audio Playback with Multichannel Satellite Playback Devices;” and U.S. Patent No.11,985.376, issued May 14, 2024 and titled “Playback of Generative Media Content.”

[0175] Operation 604 includes obtaining orientation information for a playback device. For purposes of explanation, the following discussion may refer to the playback device 202 described above. However, those of ordinary skill in the art will appreciate that the method may be applied to playback devices having a different configuration from that show n. In some examples, obtaining an indication of device orientation at operation 604 can involve sensing an orientation of the playback device 202 via on-board sensors (e.g., one or more gyroscopes, accelerometers, inertial motion units (IMUs), and / or other suitable motion sensors that can determine whether the playback device is inverted or not), analyzing acoustic output of the playback device 202, using other sensors not associated with the playback device 202, or any other suitable technique.

[0176] In various examples, the orientation of the playback device can be determined by the playback device itself or can be determined via other devices and the indication can be transmitted to the playback device or other device of the media playback system. The orientation can include, for example, an angular orientation of the device ( e.g., rotation about a vertical axis extending through the playback device 202) relative to the environment, relative to a listener, and / or relative to other playback devices. In some examples, the orientation can also include other positional information (e.g., absolute location with an environment, distance between the playback device 202 and the listening location, other devices within the environment, a height of the playback device 202 relative to the environment, etc.). In some examples, determining that the playback device 202 is inverted includes detecting that the physical orientation of the playback device 202 has changed relative to the upright orientation by more than a threshold amount of change. The threshold amount of change may be 90° of rotation about the rotational axis of symmetry, but other examples are possible.

[0177] In some examples, one or more sensors disposed in and / or on a wall mount, ceiling mount, or another fastening device can be used in conjunction with (or perhaps exclusively) to determine the playback device orientation. In certain examples, other sensors such as one or more cameras, microphones, radio frequency (RF) sensors, either on-board the playback deviceAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO or another device, provide indications of the playback device in orientation. For instance, in some examples, a camera carried on board the playback device or another device can determine the orientation of the device by comparing a detected placement or orientation to a default orientation. In some examples, the playback device emits sound (e.g., a predetermined waveform such as a chirp, tone, sweep, and / or another suitable signal) toward another device (e.g.. such as another playback device, a television, mobile device) (or vice versa). The emitted signal is received by one or more microphones of another device, and based on a comparison between the emitted sound and the received microphone data, the orientation of the playback device is determined. Techniques for determining the orientation, or other positioning information, of playback devices are described, for example, in the following patents and publications, each of which is hereby incorporated by reference in its entirety: U.S. Patent No.11,178,504 titled “Wireless Multi-Channel Headphone Systems and Methods,” filed on May 17, 2019 and issued on November 16, 2021; U.S. Patent No. 9,042,556 titled “Shaping Sound Responsive to Speaker Orientation,” filed on July 19, 2011 and issued on May 26, 2015; U.S. Patent Publication No. 2022 / 0066008 titled “Ultrasonic Transmission for Presence Detection,” filed on August 30, 2021 and published on March 3, 2022; U.S. Patent Publication No.2021 / 0099736 titled “Systems and Methods for Playback Device Management,” filed on January' 28, 2020 and published on April 1, 2021; and U.S. Patent Publication No.2021 / 0297168 titled “Systems and Methods for State Detection via Wireless Radios.” filed on March 17, 2021 and published on September 23, 2021.

[0178] In some instances, aspects of operation 604 may be performed during a playback device set-up operation, or in response to one or more sensors detecting and / or providing an indication that the position (e.g.. orientation and / or location) of the playback device has changed. Accordingly, in some examples, aspects of operation 604 may be performed prior to operation 602. In such instances, after beginning operation 602, the playback device may access stored information indicating a current orientation of the playback device, or receive an indication of the orientation of the playback device from an external device. However, determination of the orientation of the playback device may have been performed prior to the start of operation 602, for a given playback session.

[0179] If the indication of the device orientation indicates that the playback device is in the standard orientation, the playback device may proceed to render audio content at operation 606. If the device is inverted, however, the method may include operation(s) 608 of adjustingAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO various configurations, parameters, and / or settings of the playback device (and optionally one or more other playback devices in a bonded zone (or another group) with the playback device, if applicable) such that the listener may perceive the same audio “image” (or a similar audio image) as if the playback device were in the standard orientation. In some instances, the left and right audio channels may behave very similarly when the playback device 202 is inverted compared to when the playback device is in the standard orientation. Accordingly, little or no adjustment to parameters controlling playback of these audio channels may be needed. However, in some examples, the center audio channel(s) and height channel(s) behave with some variation when the playback device 202 is inverted. For instance, the directivity' patterns of at least one of the center audio channel(s) and / or the height channel(s) may deviate from an expected or default direction by a threshold angle (e.g., 90 degrees, 180 degrees, 270 degrees, or perhaps an oblique angle) or other suitable quantity. Accordingly, the inventors have developed the techniques that are described below for adjusting parameters controlling playback of these channels to compensate for inversion of the playback device 202.

[0180] As described above, due to the arrangement of individual transducer assemblies and / or an array configuration within the playback device 202, the playback device can be configured to output one or more audio channels of the multi-channel audio along a number of sound axes (e.g., along the forward axis Al wherein the sound propagates in a direction generally perpendicular to a front face of the playback device 202, along one or more side axes (e.g., axis A2 or axis A3) wherein the sound propagates at a lateral angle with respect to the forward axis Al, and optionally along one or more vertical axes (e.g., axis A4) wherein the sound propagates at a vertical angle with respect to the forward axis Al to achieve a desired acoustic effect. In some instances, a single audio channel can be mapped to a particular sound axis, while in other instances a single audio channel can be output via two or more sound axes, and moreover two or more audio channels can be output via the same sound axis. Accordingly, perceived characteristics of audio playback can be modified by selectively distributing the audio output among the different transducer assemblies and thus the different sound axes of the playback device 202. These techniques can be applied to control and / or adjust the center and / or height audio channel(s) to maintain an overall audio image that provides a positive listening experience even when the playback device 202 is inverted.

[0181] In some examples, it may be desirable to adjust the sound field, or audio image, corresponding to one or more audio channels of the multi-channel audio content to shift aAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO perceived location of the source of that audio channel. For example, if a forward-firing transducer assembly outputs a center audio channel along the forward axis Al, a listener positioned in front of the playback device 202 may perceive the center audio channel to originate at (or proximate to) a center of the playback device 202. Depending on the vertical placement of the playback device 202 relative to other features of the listening environment and configuration of the playback device 202, this may or may not represent an optimal listening experience for the listener. For example, if the playback device 202 is part of a home theater group, it may be preferable for the perceived source of the center audio channel to correspond generally with a location of a television (or other video device) outputting video content corresponding to the audio content output by the playback devices of the home theater group. Thus, if the playback device 202 is placed in the standard orientation (right-side up) and below the projection screen, it may be preferable to elevate the perceived source of the center audio channel. Similarly, if the playback device 202 is mounted above the projection screen, it may be desirable to ”de-elevate" the center audio channel to relocate the perceived source to be coincident with the video device. A variety of other scenarios in which it may be desirable to reposition a perceive source of one or more audio channels of the multi-channel audio content can be envisioned.

[0182] With continued reference to Figure 6, operation(s) 608 may include an operation 610 of determining a desired sound field position of one or more audio channels to be output by the playback device 310. The one or more audio channels may include the center audio channel, for example, and / or one or more other audio channels (e.g., left and / or right audio channels). In some examples, operation 610 includes determining a vertical offset relative to the horizontal axis that corresponds to at least one perceived source location of an audio channel, such as the center audio channel, for example. Since this offset may differ based on whether or not the playback device 202 is inverted, determining the vertical offset may be based at least in part on the indication of the orientation of the playback device obtained at operation 604. In some examples, operation 610 further includes determining, based on the vertical offset, proportions of the audio channel can be assigned for playback via various sound axes (e.g.. a forward sound axis and a vertical sound axis) so as to generate a sound field corresponding to the audio channel at a height with respect to a center of the playback device 202 that corresponds to the vertical offset. This can be accomplished by controlling the digital signal processing chains for one or more transducers that are capable of outputting audio contentAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO along the selected sound axes. For example, the center audio content corresponding to the center audio channel can be directed to a forward-firing transducer assembly and to a vertically-firing transducer assembly, and the digital signal processing chains for these transducers can be configured with appropriate filtering, amplification, equalization, and / or other settings or parameters so as to cause the forward- firing transducer assembly and the vertically-firing transducer assembly to output proportions of the center audio channel that generate the desired audio image.

[0183] In some examples, one or more playback devices may be tilted at an oblique angle relative to the vertical or horizontal axes, rather than being oriented purely inverted. It will be appreciated that, depending on the relative placement and / or orientation of the playback device(s) 202 (e.g., positioned at same or different heights, inverted or not, etc.), the parameters of the individual playback device(s) 202 may be configured differently so as to position the overall sound field for a given audio channel (e g., the center audio channel) produced from a combination of all the playback devices in a group at a desired location, such as a desired height relative to the ceiling or floor of an environment or desired height (vertical offset) relative to the horizontal axis of one or more playback devices.

[0184] Further, referring to Figure 6, in some examples, operation 612 includes determining an updated transducer arrangement (e g., that the playback device 202 is inverted). Based on this determination, the method can further involve determining which audio channels are to be output by the playback device 202, and assigning responsibility for rendering of the audio channel(s) among one or more of the transducers of the playback device 202.

[0185] Referring again to Figure 6, operations 608 may include, at operation 612, adjusting audio channel assignment among the plurality of transducer assemblies of the playback device 202, and at operation 614, adjusting one or more audio playback parameters, such as characteristic phase response and / or magnitude response. Modifications to the characteristic phase response and / or magnitude response for a given audio channel can be achieved by using suitable signal processing techniques, for example subjecting the audio to appropriate filtering operations (e.g., using finite impulse response (FIR) filters, infinite impulse response (HR) filters, or other suitable filters).

[0186] As described above, a problem associated with inverting the orientation of the playback device 202 is that, without adjustment, the height audio information would be directed downward towards the floor, rather than upward toward the ceiling. As a result, the listenerAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO may no longer perceive the audio as originating from above the listener, as intended. Accordingly, to address this problem, operation 612 may include reassigning some or all responsibility for rendering the height audio channel to one or more transducer assemblies other than the vertically-firing transducer assembly. That is, as a result of operation 612, the height audio channel may be output via a lateral transducer assembly, rather than a conventional vertically oriented transducer assembly.

[0187] Operation 614 may include adjusting one or more parameters or settings in the digital signal processing chains associated with the transducer assemblies involved in the reassignment to accommodate output of the height audio channel while maintaining a desired audio image ( e.g., one that is very similar to the audio image corresponding to acoustic output by the playback device 202 if not inverted). Accordingly, operations 612 and 614 may be performed to reconfigure the height audio channel (and optionally one or more other audio channels) based on the playback device 202 being inverted, regardless of whether operation 610 is performed. Once the playback device 202 is configured with desired settings and audio channel distribution, the playback device 202 may render the multi-channel audio content at operation 606.

[0188] As described above, in some examples, inversion of the playback device 202 may not significantly impact the acoustic effects associated with the left and right audio channels. However, significant impact may be experienced or perceived with respect to the center audio channel(s) and height audio channel(s). According to certain examples, at operation 612, the following audio channel assignment modifications are made to allow the playback device 202 to properly render spatial audio, such as DOLBY ATMOS, for example, when inverted. In one example, the height audio channels are reassigned from the vertically-firing transducer assembly to a combination of a left woofer, a right woofer, and / or a center tweeter. In addition, the center audio channel can be redistributed to a combination of left and right woofers, the center tweeter, and vertically -firing tweeter.

[0189] Figure 7 illustrates a method 700 for operating a media playback device in accordance with examples of the present technology. The method 700 can be implemented by any of the media playback devices described herein, including but not limited to the media playback device 202. At block 702, the method includes receiving, at a media playback device, media content comprising video content and audio content. The audio content includes a first portion and a second portion associated with a first audio transducer and a second audio transducer,Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO respectively. In some implementations, the media content can be received via one or more interfaces such as an HDM1 input, network interfaces, or other suitable communication paths. The audio content can comprise various channels of multi-channel audio content, such as left, right, center, and height channels of immersive audio content.

[0190] At block 704, the method includes detecting a change of orientation of the media playback device. In some implementations, the change in orientation can be detected via one or more sensors such as accelerometers, gyroscopes, or inertial measurement units. The change in orientation can include, for example, a change from a first orientation where the device rests on a horizontal surface to a second orientation where the device is mounted to a ceiling.

[0191] At block 706, the method includes adjusting the video content based on the detected change in orientation. The adjustment can include modifying various parameters such as keystone correction, image orientation, focus, or other projection parameters to maintain proper image display despite the change in device orientation. In some implementations, the adjustment can include controlling moveable optical elements to modify a projection axis or other characteristics of the projected image.

[0192] At block 708, the method includes outputting the adjusted video content via a projection assembly. The projection assembly can include a light source and one or more optical elements configured to project the adjusted video content onto a projection surface. In some implementations, the projection assembly can be configured as an ultra-short throw, short throw, or standard throw projector depending on installation requirements.

[0193] At block 710, the method includes outputting the first portion of the audio content via the second audio transducer and the second portion of the audio content via the first transducer. This reassignment of audio content among the transducers maintains proper audio imaging despite the change in device orientation. For example, left and right channel assignments can be transposed, height channel content can be reassigned to maintain upward sound propagation, and center channel content can be redirected toward a listening position. In some implementations, various audio processing parameters such as equalization, phase relationships, and timing can also be adjusted to optimize sound reproduction for the new orientation.

[0194] The method 700 enables a media playback device to maintain coordinated audiovisual playback despite changes in physical orientation. In some implementations, the method canAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO also include coordinating with other playback devices to create enhanced audiovisual experiences, with the coordination taking into account the onentation of each device involved.

[0195] Figure 8 illustrates another example arrangement of a media playback device 202 within an environment in accordance with aspects of the present technology7. In this implementation, the media playback device 202 is mounted to a ceiling above a listening area and operates in conjunction with an audio playback device 110 (e.g., a soundbar) positioned below a projection surface 402.

[0196] The media playback device 202 is configured to project video content onto the projection surface 402. In some implementations, the media playback device 202 comprises a short throw or standard throw projector, which can allow for placement at a greater distance from the proj ection surface 402 compared to an ultra-short throw configuration. This placement flexibility can be particularly advantageous for creating immersive audiovisual experiences in environments such as bedrooms, home theaters, or other spaces where ceiling mounting is desired.

[0197] In the illustrated configuration, audio responsibilities are distributed between the media playback device 202 and the audio playback device 110. The audio playback device 110 outputs left-center-right (LCR) channels, providing primary audio content such as dialog, music, and front-channel sound effects. The media playback device 202 is configured to output various surround and height channels, including left surround (LS), right surround (RS), left rear (LR), and right rear (RR) channels. The media playback device 202 can also output height channel (H) content directed downward toward the listening area.

[0198] The media playback device 202 and audio playback device 110 can coordinate their operation to create a cohesive audiovisual experience. For example, the devices can synchronize their audio playback to ensure proper timing between front and surround channels. In some implementations, the audio channel assignments among the devices can be adjusted based on factors such as room characteristics, listening position, and the specific content being played back. The ability to distribute audio responsibilities between multiple devices while maintaining synchronized playback can provide enhanced flexibility in creating immersive audiovisual experiences.c. Additional Media Playback Device Arrangements

[0199] Figures 9-12 illustrate various arrangements and implementations of media playback devices in accordance with examples of the present technology. The media playback deviceAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO 202 can be configured in different form factors and arrangements to accommodate various use cases and installation requirements. In some implementations, multiple media playback devices can coordinate their operation to create enhanced audiovisual experiences, such as combining their video output to create larger or more complex projected images while providing synchronized audio playback. Additionally or alternatively, the media playback device 202 can be integrated into or housed within various types of furniture or enclosures, such as credenzas, cabinets, tablets, etc., as well as taking the form of soundbars (as described above), subwoofers, portable devices, or any other suitable form factor. As noted elsewhere herein, the media playback device 202 can also be configured to provide supplemental features beyond basic audiovisual playback, such as generating visual content based on audio input, providing wireless power transfer capabilities, or integrating with extended reality systems. These various arrangements and implementations demonstrate the adaptability of the present technology to different environments and use cases while maintaining coordinated audiovisual playback capabilities.

[0200] Figure 9 illustrates two media playback devices 202a and 202b configured to project a joint image onto a projection surface 402 in accordance with examples of the present technology7. The media playback devices 202a and 202b can coordinate their operation to create an enhanced audiovisual experience through synchronized proj ection and audio playback.

[0201] In some implementations, the media playback devices 202a and 202b project different portions of a single video image onto the projection surface 402. For example, the media playback device 202a may project a left portion of the image while the media playback device 202b projects a right portion. The devices can employ various image processing techniques such as warping and blending to create a seamless combined image on the projection surface 402. These techniques can allow the combined image to be projected onto various surface ty pes, including curved or non-uniform surfaces.

[0202] The media playback devices 202a and 202b can determine their relative positions and orientations with respect to each other and the projection surface 402. Based on this positional information, the devices can automatically adjust various projection parameters to ensure proper alignment and blending of their respective image portions. In some implementations, one device (e.g., media playback device 202a) may handle video playback coordination while the other device (e.g., media playback device 202b) manages audio playback coordination.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0203] The devices can also adjust their audio output based on the positioning required for optimal video projection. For example, if the media playback devices 202a and 202b need to be oriented at particular angles to achieve proper image alignment, they can modify their audio channel assignments and processing parameters to maintain appropriate audio imaging despite the non-standard orientations. In some implementations, machine learning models or other analysis tools can be used to synchronize the image portions and optimize both video alignment and audio output in real-time.

[0204] The coordinated operation of multiple media playback devices can provide enhanced capabilities compared to single-device implementations. For example, the combined projection can create larger images, achieve higher brightness levels, or provide improved coverage of non-standard projection surfaces. The devices can also create enhanced audio experiences by operating as a bonded zone for synchronized multi-channel audio playback while maintaining proper audio imaging regardless of the positioning requirements for video projection.

[0205] Figures 10 and 11 illustrate additional configurations of media playback devices with integrated projection assemblies in accordance with examples of the present technology. These configurations demonstrate how the media playback device 202 can be implemented in different form factors to serve various use cases while maintaining coordinated audiovisual playback capabilities.

[0206] Figure 10 shows the media playback device 202 implemented in a subwoofer form factor. In this implementation, the housing includes both low-frequency audio transducers and an integrated projection assembly configured to project video content onto the projection surface 402. The subwoofer form factor can accommodate larger transducers for enhanced low-frequency reproduction while also providing a stable base for video projection. In some implementations, the media playback device 202 can include additional transducers for outputting other audio channels, or it can operate in conjunction with other playback devices in a bonded zone. The stabilization components described above can be particularly beneficial in this implementation to isolate the projection assembly from vibrations generated during low-frequency audio playback.

[0207] Figure 11 illustrates the media playback device 202 implemented as a portable device having a generally cylindrical housing. This implementation can include battery power and wireless connectivity to enable portable operation, while maintaining the ability to project video content onto the projection surface 402 and output synchronized audio content. TheAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO portable form factor can be particularly suitable for temporary installations or mobile use cases. In some implementations, the portable device can include adjustable optical elements to accommodate different projection scenarios, and its audio output can be configured to create appropriate sound fields despite its compact size. The device can also be configured to coordinate with other portable or fixed playback devices to create expanded audiovisual experiences.

[0208] In both implementations, the media playback devices 202 maintain the ability' to detect their orientation and adjust both video and audio output accordingly. The devices can also include the various features described above, such as wireless power transfer capabilities, generative content functionality, and coordination with other playback devices, adapted as appropriate for their respective form factors.

[0209] Figure 12 illustrates a credenza 1200 housing a media playback device 202 in accordance with examples of the present technology7. The credenza 1200 provides an integrated solution that combines furniture functionality with audiovisual playback capabilities. The media playback device 202 is configured to project video content onto a projection surface 402 while providing high-quality' audio output through various integrated transducers.

[0210] In some implementations, the credenza 1200 includes multiple compartments configured to house various components of the media playback device 202. The larger enclosure volume available within the credenza 1200 can accommodate audio transducer configurations that may not be feasible in standalone soundbar-style devices. For example, the credenza 1200 can house one or more subw'oofers for enhanced low -frequency reproduction, with the larger enclosure volume enabling improved bass response. The credenza 1200 can also incorporate various types and arrangements of mid-range drivers and tweeters to create desired sound radiation patterns.

[0211] In some implementations, the credenza 1200 includes motorized components configured to adjust the position and orientation of certain audio transducers. For example, one or more tweeters can be mounted on motorized assemblies that can raise, lower, rotate, or otherwise adjust the tweeters based on factors such as room characteristics, listener location, and content being played back. These adjustable transducers can enable the system to optimize sound reproduction for different listening scenarios while maintaining an unobtrusive appearance when not in use. Optionally, these assemblies can include servo motors, stepper motors, linear actuators, or other suitable motorized components coupled to mountingAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO structures that carry one or more of the transducers 214. The mounting structures can enable various types of movement including rotation about one or more axes, linear translation along one or more axes, and / or combinations thereof.

[0212] In some implementations, high-frequency transducers such as tweeters are mounted on motorized assemblies that can raise, lower, rotate, or otherwise adjust the transducers based on playback conditions. For example, one or more tweeters can be mounted on telescoping arms that extend from the housing 210 during audio playback and retract when not in use. The telescoping arms can include motorized joints enabling the tweeters to rotate and tilt to achieve desired sound radiation patterns. Additionally or alternatively, mid-range transducers can be mounted on motorized platforms that adjust transducer orientation to modify sound dispersion characteristics. Additional details regarding adjustable transducer positions can be found in U.S. Patent Publication No. 2024 / 0314477, published September 19, 2024 and titled “Playback Devices Having Adjustable Transducer Positions,” which is hereby incorporated by reference in its entirety.

[0213] The media playback device 202 can determine optimal transducer positions and orientations based on various factors detected by the sensors 224, such as: (i) room characteristics including dimensions, surface materials, and acoustic properties; (ii) listener location(s) determined via presence sensors or other detection methods; (iii) current audio content characteristics such as channel configuration and frequency content; and / or (iv) selected audio playback modes or user preferences.

[0214] Based on the determined factors, the media playback device 202 can dynamically adjust transducer positions to optimize sound reproduction. For example, when playing back immersive audio content, tweeters can be automatically elevated and angled to enhance height channel reproduction. During stereo music playback, the transducers can be repositioned to create an optimal stereo image for the current listener location. The media playback device 202 can store multiple transducer position presets corresponding to different playback scenarios and smoothly transition between configurations as needed.

[0215] In some implementations, the motorized assemblies include position sensors that provide feedback regarding current transducer positions and orientations. The media playback device 202 can use this position data to maintain precise transducer alignment and make fine adjustments during operation. The position sensors can also enable automatic calibrationAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO routines where the media playback device 202 measures acoustic output while sweeping transducers through different positions to determine optimal configurations.

[0216] The motorized transducer assemblies can include vibration isolation elements to prevent mechanical noise from motors and actuators from affecting audio reproduction. Additionally or alternatively, the media playback device 202 can implement movement scheduling algorithms that adjust transducer positions during quiet passages or between content playback to minimize potential interference with the listening experience.

[0217] The credenza 1200 can also integrate additional media playback devices and sources. In some implementations, the credenza 1200 includes a turntable or other audio source device mounted in a dedicated compartment. When such devices are present, the media playback device 202 can analyze the audio content being played back and generate corresponding visual content for projection onto the projection surface 402. For example, when playing vinyl records, the media playback device 202 can generate synchronized visualizations, display album artwork, or create other visual content that complements the audio playback.

[0218] The credenza 1200 can include various features to optimize audiovisual playback quality. For example, the media playback device 202 can be mounted on vibration-isolating supports within the credenza 1200 to prevent audio-induced vibrations from affecting video projection quality. The credenza 1200 can also incorporate active cooling systems, cable management features, and acoustic treatments to enhance overall system performance. In some implementations, the credenza 1200 includes an integrated, retractable projection screen that can be raised or lowered based on user preferences or content being played back.

[0219] The larger form factor of the credenza 1200 can also accommodate enhanced sensing and processing capabilities. For example, the increased spacing available for microphone arrays can enable improved voice recognition and room acoustic measurements. The credenza 1200 can include environmental sensors to detect ambient conditions, presence sensors to detect occupancy, and other sensors that can influence both audio and video playback parameters. In some implementations, the credenza 1200 can include wireless power transmission components that take advantage of the larger enclosure to implement more powerful or sophisticated power transfer systems.

[0220] The media playback device 202 housed within the credenza 1200 maintains its ability to coordinate with other playback devices in the environment. For example, the device can operate as part of a bonded zone with other playback devices while taking advantage of itsAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO enhanced audio capabilities enabled by the credenza form factor. The credenza 1200 can also provide various user interface elements, such as touch-sensitive surfaces or displays, that facilitate control of the integrated audiovisual system while maintaining an aesthetically pleasing appearance consistent with furniture design.

[0221] While the example shown in Figure 12 takes the form of a credenza, in various implementations the media playback device 202 can be integrated into various types of furniture beyond a credenza 1200. For example, the media playback device 202 can be incorporated into a media cabinet, entertainment center, bookshelf, console table, sideboard, or other furniture pieces configured to house audiovisual components. The specific form factor of the furniture may vary based on room configuration, desired aesthetic appearance, and intended use case. For instance, a tall bookshelf implementation might place the projection assembly 204 at a higher elevation compared to a lower profile media cabinet, while a comer-oriented entertainment center might enable different projection angles compared to furniture positioned flat against a wall. In some implementations, the furniture piece can include modular components that allow for customization of both the furniture configuration and the positioning of the media playback device 202 components. For example, a modular shelving system might allow for adjustable placement of the projection assembly 204 and audio transducers 214 while maintaining the aesthetic and functional benefits of furniture integration. Additionally or alternatively, the furniture piece can be configured to accommodate various sizes and styles of the projection assembly 204 and associated components while providing appropriate ventilation, cable management, and acoustic properties.d. Generative Media Content for Audiovisual Media Playback Devices

[0222] Examples of the present technology can include media playback devices configured to generate supplemental content to enhance the audiovisual experience. In some implementations, the media playback device 202 includes generative content components 230 configured to create visual, audio, and / or audiovisual content based on various inputs and conditions. The generative content components 230 can utilize one or more machine learning models, such as neural networks, generative adversarial networks (GANs), transformer models, or other suitable architectures to produce content in real-time. In some examples, for instance, the generative content components 230 comprise one or more generative Al models and / or multimodal models. In certain examples, the generative content components 230 comprise one or more Al agents, as described for example in U.S. Provisional Application No. 63 / 758,580,Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO filed February 14, 2025 and titled "Agentic Control of Media Playback Systems” (also included as Appendix A to this application).

[0223] The generative content components 230 can receive input from various sources to influence content generation. In some implementations, the media playback device 202 can analyze audio being played back through the system, such as music from a turntable or other audio source, to generate corresponding visual content. For example, the device can extract features from the audio signal such as tempo, rhythm, frequency content, and musical structure to create synchronized visual elements. The generated visual content can include abstract patterns, landscapes, animations, or other imagery' that complements the audio playback. Additionally or alternatively, the generative content components 230 can receive data from the sensors 224 regarding environmental conditions such as ambient light levels, temperature, time of day, or room occupancy, and generate content adapted to these conditions.

[0224] In some implementations, the generative content components 230 can operate in a distributed manner, with certain processing occurring locally on the media playback device 202 while other operations are performed by remote computing resources. For example, resource-intensive model inference might be handled by cloud services while real-time adjustments and synchronization are managed locally. The media playback device 202 can also coordinate with other playback devices to create synchronized generative content across multiple projection surfaces or displays. Various parameters of the generative models can be adjusted based on user preferences, detected mood or activity levels, time-based factors, or other contextual information. The generated content can be integrated with traditional audiovisual play back, used as ambient visuals during audio-only playback, or employ ed as standalone content during periods when the device might otherwise be idle.

[0225] The generative content components 230 can employ various techniques for content creation and modification, such as style transfer algorithms for adapting visual content, audio analysis algorithms for extracting musical features, and fusion models for combining multiple input modalities. In some implementations, the components can include feedback mechanisms to refine and improve content generation based on user interactions, environmental responses, or other metrics. The system can also incorporate safeguards to ensure generated content remains appropriate for the intended environment and use case while maintaining reasonable computational and power requirements.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0226] The subject mater of U.S. Patent No. 11,985,376, issued May 14, 2024 and titled “Playback of Generative Media Content’7is hereby incorporated by reference herein in its entirety. The techniques for generating and distributing synthetic media content, including generative visual content based on input parameters, as disclosed therein may be implemented by the generative content components 230 of the media playback device 202 to create visual content corresponding to various inputs and conditions.

[0227] The subject mater of International Patent Application Publication No. WO 2023 / 225448, published November 23, 2023 and titled “Generating Digital Media Based on Blockchain Data” is hereby incorporated by reference herein in its entirety. The techniques for generating content based on blockchain data and adjusting blockchain data based on one or more generative models, as disclosed therein may be implemented by the generative content components 230 of the media playback device 202 to create and modify content based on blockchain-related parameters.

[0228] Figures 13 and 14 illustrate projection of generative visual content via a media playback device 202 in accordance with examples of the present technology. The media playback device 202 can generate and project various types of visual content onto a projection surface 402 to enhance the user experience during different operational modes.

[0229] Figure 13 shows the media playback device 202 projecting generated visual content in the form of an environmental scene onto the projection surface 402. In some implementations, this scene can be generated based on various inputs such as audio content being played back through the media playback system, detected environmental conditions, time of day, user preferences, or other contextual information. For example, the generative content components 230 (Figure 2) can analyze features of audio being played back (e g., genre, tempo, mood, intensity) and generate corresponding visual elements. The generated scene can evolve in real-time based on changes in the input parameters, creating a dynamic visual experience that complements the audio playback or ambient conditions.

[0230] Figure 14 illustrates the media playback device 202 projecting generated informational content onto the projection surface 402. In this example, the projected content includes metadata associated with audio content being played back, such as track information, playback status, and other relevant details. The generative content components 230 can create various visual layouts and presentations for this information, potentially adapting the visual style based on factors such as the type of content being played back, user preferences, ambientAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO light conditions, or viewing distance. In some implementations, this informational display can be integrated with other generated visual elements or transitioned between different visual styles based on user interaction or system events.

[0231] In both examples, the media playback device 202 can adjust various parameters of the projected content based on factors such as ambient light levels, projection surface characteristics, viewing angles, and room occupancy. The generative content components 230 can employ machine learning models or other algorithmic approaches to create visually appealing content while maintaining appropriate brightness, contrast, and other visual characteristics for the current environment. In some implementations, multiple media playback devices can coordinate their generative content output to create synchronized or complementary visual experiences across multiple projection surfaces.e. Wireless Power Transfer for Audiovisual Media Playback Devices

[0232] Examples of the present technology7can include media playback devices configured to participate in wireless power transfer. In some implementations, the media playback device 202 includes wireless power components 232 that can both transmit and receive power wirelessly to support various use cases. When mounted in elevated positions (e g., on a ceiling or high on a wall), the media playback device 202 can be particularly well-suited for wireless power transmission due to its unobstructed line of sight to potential receiver devices below7. The wireless power components 232 can include one or more induction coils, resonant circuits, beam-forming arrays, or other suitable elements configured to enable efficient wireless power transfer. In transmitter implementations, the media playback device 202 can supply power to various external devices such as mobile devices, other playback devices, lighting fixtures, or other compatible receivers within range. In receiver implementations, the wireless power components 232 can receive power from external transmitters, potentially reducing or eliminating the need for w ired power connections in certain installation scenarios. The media playback device 202 can coordinate its wireless power operations with its audiovisual playback functions, for example by adjusting power transmission parameters based on current device operations or nearby device positions.

[0233] Additional details regarding suitable wdreless power components and their operation can be found in (i) U.S. Patent Application Publication No. 2023 / 0205486, published June 29, 2023 and titled “Wireless Power Transfer for Audio Playback Devices,” and (ii) International Patent Publication No. WO 2024 / 020580, published January 25, 2024 and titled “PowerAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO Management for Audio Playback Devices / ' each of which is hereby incorporated by reference herein in its entirety. The wireless power transfer, energy harvesting, and other associated techniques disclosed therein may be implemented by the wireless power components 232 of the media playback device 202 to enable wireless power transmission to and / or reception from other devices in the environment.

[0234] Figure 15 illustrates wireless power transfer via a media playback device 202 in accordance with examples of the present technology. In the illustrated implementation, the media playback device 202 is mounted in an elevated position (e.g., ceiling-mounted) and configured to transmit wireless power to various devices within an environment while also projecting video content onto a projection surface 402 along video projection axis VI.

[0235] The media playback device 202 can wirelessly transmit power to multiple types of receiving devices within range. For example, the media playback device 202 can supply power to a playback device 110a (e.g., a subwoofer or other speaker), a wearable playback device 110b (e.g., wireless headphones), a control device 130 (e.g.. a tablet computer or smartphone), and / or other electronic devices such as a lamp 1502. The elevated mounting position of the media playback device 202 can provide advantageous line-of-sight power transmission paths to receiving devices positioned below.

[0236] In some implementations, the wireless power components 232 (Figure 2) of the media playback device 202 can employ various wireless power transmission technologies such as inductive coupling, resonant power transfer, or radio frequency power transmission. The media playback device 202 can adjust power transmission parameters based on factors such as the number of receiving devices, their respective power requirements, their positions within the environment, and their distance from the media playback device 202. The device can also coordinate power transmission with its audiovisual playback functions to maintain optimal performance of both capabilities.

[0237] The media playback device 202 can prioritize power distribution among receiving devices based on various factors such as device type, power requirements, battery levels, or user preferences. In some implementations, the wireless power transmission can be synchronized or coordinated with other operations of the media playback system. For example, the media playback device 202 might increase power transmission to wireless headphones during audio playback or adjust power transmission patterns to avoid interference with projected video content or audio playback.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO IV. Conclusion

[0238] The above discussions relating to playback devices, controller devices, playback zone configurations, and media content sources provide only some examples of operating environments within which functions and methods described below may be implemented. Other operating environments and / or configurations of media playback systems, playback devices, and network devices not explicitly described herein may also be applicable and suitable for implementation of the functions and methods.

[0239] The description above discloses, among other things, various example systems, methods, apparatus, and articles of manufacture including, among other components, firmware and / or software executed on hardware. It is understood that such examples are merely illustrative and should not be considered as limiting. For example, it is contemplated that any or all of the firmware, hardware, and / or software examples or components can be embodied exclusively in hardware, exclusively in software, exclusively in firmware, or in any combination of hardware, software, and / or firmware. Accordingly, the examples provided are not the only ways) to implement such systems, methods, apparatus, and / or articles of manufacture.

[0240] Additionally, references herein to “example” means that a particular feature, structure, or characteristic described in connection with the example can be included in at least one example embodiment or implementation of an invention. The appearances of this phrase in various places in the specification are not necessarily all referring to the same example, nor are separate or alternative examples mutually exclusive of other examples. As such, the examples described herein, explicitly and implicitly understood by one skilled in the art, can be combined with other examples.

[0241] The specification is presented largely in terms of illustrative environments, systems, procedures, steps, logic blocks, processing, and other symbolic representations that directly or indirectly resemble the operations of data processing devices coupled to networks. These process descriptions and representations are typically used by those skilled in the art to most effectively convey the substance of their work to others skilled in the art. Numerous specific details are set forth to provide a thorough understanding of the present disclosure. However, it is understood to those skilled in the art that certain examples of the present disclosure can be practiced without certain, specific details. In other instances, well known methods, procedures, components, and circuitry have not been described in detail to avoid unnecessarily obscuringAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO examples of the examples. Accordingly, the scope of the present disclosure is defined by the appended claims rather than the foregoing description of examples.

[0242] When any of the appended claims are read to cover a purely software and / or firmware implementation, at least one of the elements in at least one example is hereby expressly defined to include a tangible, non-transitory medium such as a memory, DVD, CD, Blu-ray, and so on, storing the software and / or firmware.

[0243] The disclosed technology is illustrated, for example, according to various examples described below. Various examples of examples of the disclosed technology are described as numbered examples (1, 2, 3, etc.) for convenience. These are provided as examples and do not limit the disclosed technology. It is noted that any of the dependent examples may be combined in any combination, and placed into a respective independent example. The other examples can be presented in a similar manner.

[0244] Example 1: A media playback device comprising a housing; a projection assembly carried by the housing, the projection assembly comprising a light source and one or more optical elements; a first audio transducer and a second audio transducer arranged in the housing according to a first orientation with respect to gravity; at least one processor; and memory having instructions stored thereon, wherein the instructions, when executed by the at least one processor, cause the media playback device to perform operations comprising receiving media content comprising video content and audio content, the audio content comprising a first portion and a second portion associated with the first audio transducer and a second audio transducer, respectively, in the first orientation; detecting a change of orientation of the housing from the first orientation to a second orientation; adjusting, based on the detected second orientation, the video content; outputting, based on the detected second orientation, adjusted video content via the light source and the one or more optical elements; and outputting, based on the detected second orientation, the first portion of the audio content via the second audio transducer and the second portion of the audio content via the first transducer.

[0245] Example 2: The media playback device of any of the preceding Examples, wherein the operations further comprise determining audio channel assignments for the first audio transducer and the second audio transducer based on the detected second orientation.

[0246] Example 3: The media playback device of any of the preceding Examples, wherein adjusting the video content comprises translating the video content from the first orientation to the second orientation.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0247] Example 4: The media playback device of any of the preceding Examples, wherein adjusting the video content comprises adjusting a configuration of the one or more optical elements from a first configuration to a second configuration based on the change of orientation from the first orientation to the second orientation.

[0248] Example 5: The media playback device of any of the preceding Examples, further comprising a network interface, wherein the operations further comprise causing, via the network interface, a second playback device to play back a third portion of the audio content in both the first orientation and the second orientation.

[0249] Example 6: The media playback device of any of the preceding Examples, wherein the projection assembly comprises an ultra-short throw projector configured to project the video content at an acute angle relative to the projection surface; and the plurality of audio transducers comprises at least one upward-firing transducer in a first orientation of the housing.

[0250] Example 7: The media playback device of any of the preceding Examples, wherein in the first orientation, the housing is configured to rest on a horizontal surface with the projection assembly facing upward toward the projection surface; and in a second orientation, the housing is configured to be mounted to a ceiling with the projection assembly facing downward toward the projection surface.

[0251] Example 8: The media playback device of any of the preceding Examples, wherein determining the audio channel assignments comprises in the first orientation, assigning height channel content to the at least one upward-firing transducer; and in the second orientation, assigning the height channel content to one or more different transducers of the plurality of audio transducers.

[0252] Example 9: The media playback device of any of the preceding Examples, wherein the operations further compnse receiving an indication of one or more additional playback devices; coordinating with the one or more additional playback devices to form a bonded zone; and outputting the audio content in synchrony with the one or more additional playback devices.

[0253] Example 10: The media playback device of any of the preceding Examples, wherein the operations further comprise detecting one or more environmental characteristics; and adjusting one or more parameters of the projection assembly based on the detected environmental characteristics.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0254] Example 11 : The media playback device of any of the preceding Examples, wherein the one or more environmental characteristics compnse at least one of ambient light level, presence of ceiling-mounted light sources, or room dimensions; and the one or more parameters comprise at least one of brightness, contrast, keystone correction, or focus.

[0255] Example 12: The media playback device of any of the preceding Examples, further comprising a wireless power transfer transmitter configured to supply power to one or more external devices within a predetermined range of the media playback device.

[0256] Example 13: The media playback device of any of the preceding Examples, wherein the operations further comprise receiving an indication of an audio source device comprising a turntable; detecting audio content being played by the turntable; and generating, via one or more machine learning models, visual content corresponding to the detected audio content.

[0257] Example 14: The media playback device of any of the preceding Examples, wherein the operations further comprise detecting one or more augmented reality devices within a playback environment; determining visual content being displayed by the one or more augmented reality devices: and adjusting the projected video content based on the determined visual content.

[0258] Example 15: The media playback device of any of the preceding Examples, wherein the operations further comprise projecting, via the projection assembly, a visual representation of virtual speaker locations within a playback environment.

[0259] Example 16: The media playback device of any of the preceding Examples, wherein the operations further comprise detecting, via one or more sensors, ambient light conditions when the media playback device is not projecting video content; and projecting, via the projection assembly, background visual content based on the detected ambient light conditions.

[0260] Example 17: The media playback device of any of the preceding Examples, further comprising one or more vibration isolation elements configured to isolate the projection assembly from vibrations caused by the plurality of audio transducers.

[0261] Example 18: The media playback device of any of the preceding Examples, further comprising one or more motorized elements configured to adjust a position or orientation of at least a subset of the plurality' of audio transducers based on characteristics of a playback environment.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0262] Example 19: The media playback device of any of the preceding Examples, wherein adjusting the configuration of the one or more optical elements comprises adjusting at least one of a lens shift setting or a keystone correction setting.

[0263] Example 20: A system comprising the media playback device of any of the preceding Examples; and an external projection surface configured to receive the adjusted video content from the projection assembly.

[0264] Example 21 : A media playback system comprising the media playback device of any of Examples 1-19, wherein the media playback device is a first media playback device; and a second media playback device comprising a second housing; a second projection assembly carried by the second housing; and a plurality’ of audio transducers carried by the second housing; wherein the first media playback device and the second media playback device are configured to coordinate projection of video content such that the projection assembly of the first media playback device projects a first portion of the video content and the second projection assembly projects a second portion of the video content; and output synchronized audio content via their respective audio transducers.

[0265] Example 22: The media playback system of any of the preceding Examples, wherein the first media playback device and the second media playback device are further configured to determine relative positions of the first media playback device and the second media playback device; and adjust one or more parameters of their respective projection assemblies based on the determined relative positions to align the first and second portions of the video content.

[0266] Example 23: The media playback sy stem of any of the preceding Examples, wherein the first media playback device is configured to coordinate video playback between the first media playback device and the second media playback device; and the second media playback device is configured to coordinate audio playback between the first media playback device and the second media playback device.

[0267] Example 24: A method comprising receiving, by a media playback device comprising a housing, a projection assembly, a first audio transducer, and a second audio transducer arranged in the housing according to a first orientation with respect to gravity, media content comprising video content and audio content, the audio content comprising a first portion and a second portion associated with the first audio transducer and the second audio transducer, respectively, in the first orientation; detecting a change of orientation of the housing from theAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO first orientation to a second orientation; adjusting, based on the detected second orientation, the video content; outputting, based on the detected second orientation, adjusted video content via a light source and one or more optical elements of the projection assembly; and outputting, based on the detected second orientation, the first portion of the audio content via the second audio transducer and the second portion of the audio content via the first transducer.

[0268] Example 25: The method of any of the preceding Examples, further comprising determining audio channel assignments for the first audio transducer and the second audio transducer based on the detected second orientation.

[0269] Example 26: The method of any of the preceding Examples, wherein adjusting the video content comprises translating the video content from the first orientation to the second orientation.

[0270] Example 27: The method of any of the preceding Examples, wherein adjusting the video content comprises adjusting a configuration of the one or more optical elements from a first configuration to a second configuration based on the change of orientation from the first orientation to the second orientation.

[0271] Example 28: The method of any of the preceding Examples, further comprising causing a second playback device to play back a third portion of the audio content in both the first orientation and the second orientation.

[0272] Example 29: The method of any of the preceding Examples, wherein the projection assembly comprises an ultra-short throw projector configured to project the video content at an acute angle relative to a projection surface; and the first audio transducer comprises an upward-firing transducer in the first orientation of the housing.

[0273] Example 30: The method of any of the preceding Examples, wherein in the first orientation, the housing is configured to rest on a horizontal surface with the projection assembly facing upward toward the projection surface; and in the second orientation, the housing is configured to be mounted to a ceiling with the projection assembly facing downward toward the projection surface.

[0274] Example 31: A non-transitory computer-readable medium comprising instructions stored thereon that, when executed by at least one processor, cause a media playback device to perform operations comprising receiving media content comprising video content and audio content, the audio content comprising a first portion and a second portion associated with a first audio transducer and a second audio transducer, respectively, arranged in a housingAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO according to a first orientation with respect to gravity; detecting a change of orientation of the housing from the first orientation to a second orientation; adjusting, based on the detected second orientation, the video content; outputting, based on the detected second orientation, adjusted video content via a light source and one or more optical elements of a projection assembly carried by the housing; and outputting, based on the detected second orientation, the first portion of the audio content via the second audio transducer and the second portion of the audio content via the first transducer.

[0275] Example 32: The non-transitory computer-readable medium of any of the preceding Examples, wherein the operations further comprise determining audio channel assignments for the first audio transducer and the second audio transducer based on the detected second orientation.

[0276] Example 33: The non-transitory computer-readable medium of any of the preceding Examples, wherein adjusting the video content comprises translating the video content from the first orientation to the second orientation.

[0277] Example 34: The non-transitory computer-readable medium of any of the preceding Examples, wherein adjusting the video content comprises adjusting a configuration of the one or more optical elements from a first configuration to a second configuration based on the change of orientation from the first orientation to the second orientation.

[0278] Example 35: The non-transitory computer-readable medium of any of the preceding Examples, wherein the operations further comprise causing a second playback device to play back a third portion of the audio content in both the first orientation and the second orientation.

[0279] Example 36: The non-transitory computer-readable medium of any of the preceding Examples, wherein the projection assembly comprises an ultra-short throw projector configured to project the video content at an acute angle relative to a projection surface; and the first audio transducer comprises an upward-firing transducer in the first orientation of the housing.

[0280] Example 37: The non-transitory computer-readable medium of any of the preceding Examples, wherein in the first orientation, the housing is configured to rest on a horizontal surface with the projection assembly facing upward toward the projection surface; and in the second orientation, the housing is configured to be mounted to a ceiling with the projection assembly facing downward toward the projection surface.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO

[0281] Example 38: A method for correcting keystone distortion in a media playback device having a projection assembly, the method comprising receiving, at the media playback device, video content for projection; detecting, via one or more sensors, an orientation of the media playback device with respect to a projection surface; obtaining a trained machine learning model configured to correct keystone distortion, wherein the trained machine learning model was trained using a dataset comprising pairs of distorted images and corresponding corrected images; processing the video content using the trained machine learning model to generate corrected video content based on the detected orientation, wherein the corrected video content includes keystone correction adjustments; and projecting the corrected video content via the projection assembly onto the projection surface.

[0282] Example 39: The method of any of the preceding Examples, wherein the trained machine learning model comprises a convolutional neural network trained to transform distorted images caused by non-perpendicular projection angles into corrected images with reduced keystone distortion.

[0283] Example 40: The method of any of the preceding Examples, further comprising continuously monitoring the orientation of the media playback device; detecting a change in the orientation of the media playback device with respect to the projection surface; and dynamically adjusting the keystone correction adjustments based on the detected change in orientation using the trained machine learning model.

[0284] Example 41: The method of any of the preceding Examples, wherein processing the video content using the trained machine learning model comprises providing, as input to the trained machine learning model, at least one of the video content, a detected projection angle, a detected distance to the projection surface, ambient light conditions, or projection surface characteristics; and receiving, as output from the trained machine learning model, transformation parameters for correcting the keystone distortion.

[0285] Example 42: The method of any of the preceding Examples, further comprising receiving user feedback regarding the projected corrected video content; adjusting the keystone correction adjustments based on the user feedback: and storing the adjusted keystone correction adjustments for use in subsequent keystone correction operations.

[0286] Example 43: The method of any of the preceding Examples, wherein the trained machine learning model is selected from multiple available machine learning models based onAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO characteristics of the detected orientation, wherein different machine learning models are optimized for different projection scenarios.

[0287] Example 44: The method of any of the preceding Examples, wherein the trained machine learning model corrects for complex distortion patterns beyond standard keystone distortion, including at least one of barrel distortion, pincushion distortion, or distortions resulting from projection onto non-planar surfaces.

[0288] Example 45: A media playback device comprising a housing; a projection assembly carried by the housing; one or more sensors configured to detect an orientation of the media playback device with respect to a projection surface; at least one processor; and memory having instructions stored thereon, wherein the instructions, when executed by the at least one processor, cause the media playback device to perform operations comprising receiving video content for projection; detecting, via the one or more sensors, the orientation of the media playback device with respect to the projection surface; obtaining a trained machine learning model configured to correct keystone distortion, wherein the trained machine learning model was trained using a dataset comprising pairs of distorted images and corresponding corrected images; processing the video content using the trained machine learning model to generate corrected video content based on the detected orientation, wherein the corrected video content includes keystone correction adjustments; and projecting the corrected video content via the projection assembly onto the projection surface.

[0289] Example 46: The media playback device of any of the preceding Examples, wherein the trained machine learning model comprises a convolutional neural network trained to transform distorted images caused by non-perpendicular projection angles into corrected images with reduced keystone distortion.

[0290] Example 47: The media playback device of any of the preceding Examples, wherein the operations further comprise continuously monitoring the orientation of the media playback device; detecting a change in the orientation of the media playback device with respect to the projection surface; and dynamically adjusting the keystone correction adjustments based on the detected change in orientation using the trained machine learning model.

[0291] Example 48: The media playback device of any of the preceding Examples, wherein processing the video content using the trained machine learning model comprises providing, as input to the trained machine learning model, at least one of the video content, a detected projection angle, a detected distance to the projection surface, ambient light conditions, orAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO projection surface characteristics; and receiving, as output from the trained machine learning model, transformation parameters for correcting the keystone distortion.

[0292] Example 49: The media playback device of any of the preceding Examples, wherein the operations further comprise receiving user feedback regarding the projected corrected video content; adjusting the keystone correction adjustments based on the user feedback; and storing the adjusted keystone correction adjustments for use in subsequent keystone correction operations.

[0293] Example 50: The media playback device of any of the preceding Examples, wherein the trained machine learning model is selected from multiple available machine learning models based on characteristics of the detected orientation, wherein different machine learning models are optimized for different projection scenarios.

[0294] Example 51 : The media playback device of any of the preceding Examples, wherein the trained machine learning model corrects for complex distortion patterns beyond standard keystone distortion, including at least one of barrel distortion, pincushion distortion, or distortions resulting from projection onto non-planar surfaces.

[0295] Example 52: A non-transitory computer-readable medium comprising instructions stored thereon that, when executed by at least one processor, cause a media playback device to perform operations comprising receiving video content for projection; detecting, via one or more sensors, an orientation of the media playback device with respect to a projection surface; obtaining a trained machine learning model configured to correct keystone distortion, wherein the trained machine learning model was trained using a dataset comprising pairs of distorted images and corresponding corrected images; processing the video content using the trained machine learning model to generate corrected video content based on the detected orientation, wherein the corrected video content includes keystone correction adjustments; and projecting the corrected video content via a projection assembly of the media playback device onto the proj ection surface.

[0296] Example 53: The non-transitory computer-readable medium of any of the preceding Examples, wherein the trained machine learning model comprises a convolutional neural network trained to transform distorted images caused by non-perpendicular projection angles into corrected images with reduced keystone distortion.

[0297] Example 54: The non-transitory computer-readable medium of any of the preceding Examples, wherein the operations further comprise continuously monitoring the orientation ofAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO the media playback device; detecting a change in the orientation of the media playback device with respect to the projection surface; and dynamically adjusting the keystone correction adjustments based on the detected change in orientation using the trained machine learning model.

[0298] Example 55: The non-transitory computer-readable medium of any of the preceding Examples, wherein processing the video content using the trained machine learning model comprises providing, as input to the trained machine learning model, at least one of the video content, a detected projection angle, a detected distance to the projection surface, ambient light conditions, or projection surface characteristics; and receiving, as output from the trained machine learning model, transformation parameters for correcting the keystone distortion.

[0299] Example 56: The non-transitory computer-readable medium of any of the preceding Examples, wherein the operations further comprise receiving user feedback regarding the projected corrected video content; adjusting the keystone correction adjustments based on the user feedback; and storing the adjusted keystone correction adjustments for use in subsequent keystone correction operations.

[0300] Example 57: The non-transitory computer-readable medium of any of the preceding Examples, wherein the trained machine learning model is selected from multiple available machine learning models based on characteristics of the detected orientation, wherein different machine learning models are optimized for different projection scenarios.

[0301] Example 58: The non-transitory computer-readable medium of any of the preceding Examples, wherein the trained machine learning model corrects for complex distortion patterns beyond standard keystone distortion, including at least one of barrel distortion, pincushion distortion, or distortions resulting from projection onto non-planar surfaces.

Claims

Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO CLAIMS1. A media playback device comprising:a housing;a projection assembly carried by the housing, the projection assembly comprising a light source and one or more optical elements;a first audio transducer and a second audio transducer arranged in the housing according to a first orientation with respect to gravity;at least one processor; andmemory having instructions stored thereon, wherein the instructions, when executed by the at least one processor, cause the media playback device to perform operations comprising:receiving media content comprising video content and audio content, the audio content comprising a first portion and a second portion associated with the first audio transducer and a second audio transducer, respectively, in the first orientation;detecting a change of orientation of the housing from the first orientation to a second orientation;adjusting, based on the detected second orientation, the video content; outputting, based on, adjusted video content via the light source and the one or more optical elements; andoutputting, based on the detected second orientation, the first portion of the audio content via the second audio transducer and the second portion of the audio content via the first transducer.

2. The media playback device of claim 1, wherein the operations further comprise determining audio channel assignments for the first audio transducer and the second audio transducer based on the detected second orientation.

3. The media playback device of any one of the preceding claims, wherein adjusting the video content comprises translating the video content from the first orientation to the second orientation.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO 4. The media playback device of any one of the preceding claims, wherein adjusting the video content comprises adjusting a configuration of the one or more optical elements from a first configuration to a second configuration based on the change of orientation from the first orientation to the second orientation.

5. The media playback device of any one of the preceding claims, further comprising a network interface, wherein the operations further comprise causing, via the network interface, a second playback device to play back a third portion of the audio content in both the first orientation and the second orientation.

6. The media playback device of any one of the preceding claims, wherein the projection assembly comprises an ultra-short throw projector configured to project the video content at an acute angle relative to the proj ection surface; and the plurality of audio transducers comprises at least one upward-firing transducer in a first orientation of the housing.

7. The media playback device of claim 6, wherein in the first orientation, the housing is configured to rest on a horizontal surface with the projection assembly’ facing upward toward the projection surface; and in a second orientation, the housing is configured to be mounted to a ceiling with the projection assembly facing downward toward the projection surface.

8. The media playback device of claim 7, wherein determining the audio channel assignments comprises: in the first orientation, assigning height channel content to the at least one upward-firing transducer; and in the second orientation, assigning the height channel content to one or more different transducers of the plurality of audio transducers.

9. The media playback device of any one of the preceding claims, wherein the operations further comprise:receiving an indication of one or more additional playback devices; coordinating with the one or more additional playback devices to form a bonded zone;andAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO outputing the audio content in synchrony with the one or more additional playback devices.

10. The media playback device of any one of the preceding claims, wherein the operations further comprise:detecting one or more environmental characteristics; andadjusting one or more parameters of the projection assembly based on the detected environmental characteristics.

11. The media playback device of claim 10, wherein:the one or more environmental characteristics comprise at least one of: ambient light level, presence of ceiling-mounted light sources, or room dimensions; and the one or more parameters comprise at least one of: brightness, contrast, keystone correction, or focus.

12. The media playback device of any one of the preceding claims, further comprising a wireless power transfer transmiter configured to supply power to one or more external devices within a predetermined range of the media playback device.

13. The media playback device of any one of the preceding claims, wherein the operations further comprise:receiving an indication of an audio source device comprising a turntable; detecting audio content being played by the turntable; andgenerating, via one or more machine learning models, visual content corresponding to the detected audio content.

14. The media playback device of any one of the preceding claims, wherein the operations further comprise:detecting one or more augmented reality devices within a playback environment; determining visual content being displayed by the one or more augmented reality devices; andadjusting the projected video content based on the determined visual content.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO 15. The media playback device of any one of the preceding claims, wherein the operations further comprise projecting, via the projection assembly, a visual representation of virtual speaker locations within a playback environment.

16. The media playback device of any one of the preceding claims, wherein the operations further comprise:detecting, via one or more sensors, ambient light conditions when the media playback device is not projecting video content; andprojecting, via the projection assembly, background visual content based on the detected ambient light conditions.

17. The media playback device of any one of the preceding claims, further comprising one or more vibration isolation elements configured to isolate the projection assembly from vibrations caused by the plurality of audio transducers.

18. The media playback device of any one of the preceding claims, further comprising one or more motorized elements configured to adjust a position or orientation of at least a subset of the plurality of audio transducers based on characteristics of a playback environment.

19. The media playback device of any one of the preceding claims, wherein adjusting the configuration of the one or more optical elements comprises adjusting at least one of a lens shift setting or a keystone correction setting.

20. A system comprising:the media playback device of any one of the preceding claims; andan external projection surface configured to receive the adjusted video content from the projection assembly.

21. A media playback system comprising:the media playback device of any one of claims 1 to 19, wherein the media playback device is a first media playback device; andAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO a second media playback device comprising:a second housing;a second projection assembly carried by the second housing; and a plurality of audio transducers carried by the second housing;wherein the first media playback device and the second media playback device are configured to:coordinate projection of video content such that the projection assembly of the first media playback device projects a first portion of the video content and the second projection assembly projects a second portion of the video content; andoutput synchronized audio content via their respective audio transducers.

22. The media playback system of claim 21, wherein the first media playback device and the second media playback device are further configured to:determine relative positions of the first media playback device and the second media playback device; andadjust one or more parameters of their respective projection assemblies based on the determined relative positions to align the first and second portions of the video content.

23. The media playback system of claim 21 or claim 22, wherein:the first media playback device is configured to coordinate video playback between the first media playback device and the second media playback device; and the second media playback device is configured to coordinate audio playback between the first media playback device and the second media playback device.

24. A method comprising:receiving, by a media playback device comprising a housing, a projection assembly, a first audio transducer, and a second audio transducer arranged in the housing according to a first orientation with respect to gravity, media content comprising video content and audio content, the audio content comprising aAttorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO first portion and a second portion associated with the first audio transducer and the second audio transducer, respectively, in the first orientation; detecting a change of orientation of the housing from the first orientation to a second orientation;adjusting, based on the detected second orientation, the video content; outputting, based on the detected second orientation, adjusted video content via a light source and one or more optical elements of the projection assembly; and outputting, based on the detected second orientation, the first portion of the audio content via the second audio transducer and the second portion of the audio content via the first transducer.

25. The method of claim 24, further comprising determining audio channel assignments for the first audio transducer and the second audio transducer based on the detected second orientation.

26. The method of claim 24 or claim 25, wherein adjusting the video content comprises translating the video content from the first orientation to the second orientation.

27. The method of any one of claims 24 to 26, wherein adjusting the video content comprises adjusting a configuration of the one or more optical elements from a first configuration to a second configuration based on the change of orientation from the first orientation to the second orientation.

28. The method of any one of claims 24 to 27, further comprising causing a second playback device to play back a third portion of the audio content in both the first orientation and the second orientation.

29. The method of any one of claims 24 to 28, wherein:the projection assembly comprises an ultra-short throw projector configured to project the video content at an acute angle relative to a projection surface; and the first audio transducer comprises an upward-firing transducer in the first orientation of the housing.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO 30. The method of claim 29, wherein:in the first orientation, the housing is configured to rest on a horizontal surface with the projection assembly facing upward toward the projection surface; and in the second orientation, the housing is configured to be mounted to a ceiling with the projection assembly facing downward toward the projection surface.

31. A non-transitory computer-readable medium comprising instructions stored thereon that, when executed by at least one processor, cause a media playback device to perform operations comprising:receiving media content comprising video content and audio content, the audio content comprising a first portion and a second portion associated with a first audio transducer and a second audio transducer, respectively, arranged in a housing according to a first orientation with respect to gravity; detecting a change of orientation of the housing from the first orientation to a second orientation;adjusting, based on the detected second orientation, the video content; outputting, based on the detected second orientation, adjusted video content via a light source and one or more optical elements of a projection assembly carried by the housing; andoutputting, based on the detected second orientation, the first portion of the audio content via the second audio transducer and the second portion of the audio content via the first transducer.

32. The non-transitory computer-readable medium of claim 31 , wherein the operations further comprise determining audio channel assignments for the first audio transducer and the second audio transducer based on the detected second orientation.

33. The non-transitory computer-readable medium of claim 31 or claim 32, wherein adjusting the video content comprises translating the video content from the first orientation to the second orientation.Attorney Docket No. 24-0405-PCT Fortem Reference No. SNS.156EO 34. The non-transitory computer-readable medium of any one of claims 31 to 33, wherein adjusting the video content comprises adjusting a configuration of the one or more optical elements from a first configuration to a second configuration based on the change of orientation from the first orientation to the second orientation.

35. The non-transitory computer-readable medium of any one of claims 31 to 34, wherein the operations further comprise causing a second playback device to play back a third portion of the audio content in both the first orientation and the second orientation.

36. The non-transitory computer-readable medium of any one of claims 31 to 35, wherein:the projection assembly comprises an ultra-short throw7projector configured to project the video content at an acute angle relative to a projection surface; and the first audio transducer comprises an upward-firing transducer in the first orientation of the housing.

37. The non-transitory computer-readable medium of claim 36, wherein:in the first orientation, the housing is configured to rest on a horizontal surface with the projection assembly facing upward toward the projection surface; and in the second orientation, the housing is configured to be mounted to a ceiling with the projection assembly facing downward toward the projection surface.